Information processing system, information processing apparatus, information processing method, and program

Abstract

To improve safety in driving of a mobile.SOLUTION: An information processing device comprises: a driving behavior detection section for detecting a driving behavior which is a behavior of a mobile by driving of a user; a diagnosis section for diagnosing an aptitude of the user to driving prior to the driving based on a state of the user prior to the driving and diagnosing an aptitude of the user during driving to driving based on a state of the user during driving and a detection result of the driving behavior; and a presentation control section for generating feedback information based on the diagnosis obtained by the diagnosis section. The driving behavior detection section detects the driving behavior based on a plurality of thresholds and as an aptitude degree of the user to driving based on the diagnosis is lower, a level of dangerous driving subjected to a detection target of the driving behavior detection section becomes lower. The present technique is applicable to e.g., an information processing system for performing a support in a case where a user drives a mobile, an information processing device or a mobile.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present technology relates to Information processing system, an information processing apparatus, an information processing method, and a program, and particularly relates to an Information processing system, information processing apparatus, an information processing method, and a program suitable for use in performing driving support for a moving body.

Background Art

[0002] Conventionally, in order to detect the state of a driver during driving, the driver's biometric information has been used.

[0003] For example, it has been proposed to correct a measured value of a driver's skin impedance based on correction data based on an average value of a measured value of the driver's skin impedance when the eyes are closed at rest and a measured value during normal activities, and to determine the driver's level of arousal based on the corrected value (see, for example, Patent Document 1).

[0004] For example, it has been proposed to transmit biometric data measured by a biometric sensor of a vehicle to a data processing device via a portable terminal installed in a charger in the vehicle and a public network line, and for the data processing device to transmit the received biometric data to the driver's portable terminal (see, for example, Patent Document 2).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] By the way, the driving safety of a moving object such as a vehicle is affected by various factors in addition to the driver's state during driving. And it is desired to improve the driving safety of the moving object while considering those influences as much as possible.

[0007] The present technology has been made in view of such a situation, and aims to improve the driving safety of a moving object.

Means for Solving the Problems

[0008] The information processing system according to the first aspect of the present technology includes a driving behavior detection unit that detects a driving behavior which is the behavior of a user or a vehicle during driving, a diagnosis unit that performs a driving diagnosis of the user based on the detection result of the driving behavior, and a presentation control unit that generates feedback information based on the driving diagnosis. The driving behavior detection unit detects dangerous driving using a parameter including a variable threshold value, and the Of dangerous driving risk To parameter including a variable threshold value can be adjusted based on the estimated The information processing system according to the second aspect of the present technology includes a driving behavior detection unit that detects a driving behavior which is the behavior of a user or a vehicle during driving, and a presentation control unit that generates feedback information. The driving behavior detection unit detects dangerous driving using a parameter including a variable threshold value, and the presentation control unit generates the feedback information including information regarding dangerous driving, and the Of dangerous driving risk To parameter including a variable threshold value can be adjusted based on the estimated The information processing device according to the third aspect of the present technology includes a driving behavior detection unit that detects a driving behavior which is the behavior of a user or a vehicle during driving, a diagnosis unit that performs a driving diagnosis of the user based on the detection result of the driving behavior, and a presentation control unit that generates feedback information based on the driving diagnosis. The driving behavior detection unit detects dangerous driving using a parameter including a variable threshold value, and the Of dangerous driving risk To parameter including a variable threshold value can be adjusted based on the estimated The information processing apparatus according to the fourth aspect of the present technology includes a driving behavior detection unit that detects a driving behavior, which is the behavior of the user or the vehicle during driving, and a presentation control unit that generates feedback information. The driving behavior detection unit detects dangerous driving using a parameter including a variable threshold value, and the presentation control unit generates the feedback information including information related to the dangerous driving, and enables adjustment of a parameter including a variable threshold value based on the estimated Of dangerous driving risk To risk. The information processing apparatus according to the fifth aspect of the present technology acquires data related to a driving behavior, which is the behavior of the user or the vehicle during driving, and includes a driving behavior detection unit that detects dangerous driving using a parameter including a variable threshold value based on the data related to the driving behavior, and a presentation control unit that generates feedback information including information related to the detected dangerous driving, and enables adjustment of a parameter including a variable threshold value based on the estimated Of dangerous driving risk To risk.

[0009] The information processing method according to the sixth aspect of the present technology includes: an information processing system detecting a driving behavior, which is the behavior of the user or the vehicle during driving; performing a driving diagnosis of the user based on the detection result of the driving behavior; generating feedback information based on the driving diagnosis; detecting dangerous driving using a parameter including a variable threshold value in the detection process of the driving behavior; and enabling adjustment of a parameter including a variable threshold value based on the estimated Of dangerous driving risk To risk.

[0010] The program according to the seventh aspect of the present technology causes a computer to execute a process of detecting a driving behavior, which is the behavior of the user or the vehicle during driving; performing a driving diagnosis of the user based on the detection result of the driving behavior; generating feedback information based on the driving diagnosis; detecting dangerous driving using a parameter including a variable threshold value in the detection process of the driving behavior; and enabling adjustment of a parameter including a variable threshold value based on the estimated Of dangerous driving risk To risk.

[0015] In a first aspect of the present technology, a driving behavior, which is the behavior of a user or a vehicle during driving, is detected, and based on the detection result of the driving behavior, a driving diagnosis of the user is performed. Operation Based on the driving diagnosis, feedback information is generated. Variable The threshold value of Using parameters including, dangerous driving is detected. In a second aspect of the present technology, driving behavior which is the behavior of the user or the vehicle during driving is detected, feedback information is generated, dangerous driving is detected using parameters including a variable threshold value, and the feedback information including information on dangerous driving is generated. In a third aspect of the present technology, driving behavior which is the behavior of the user or the vehicle during driving is detected, a driving diagnosis of the user is performed based on the detection result of the driving behavior, feedback information is generated based on the driving diagnosis, and dangerous driving is detected using parameters including a variable threshold value. In a fourth aspect of the present technology, driving behavior which is the behavior of the user or the vehicle during driving is detected, feedback information is generated, dangerous driving is detected using parameters including a variable threshold value, and the feedback information including information on dangerous driving is generated. In a fifth aspect of the present technology, A driving behavior, which is the behavior of a user or a vehicle during driving Data related to is acquired 、 Based on the driving behavior Data related to feedback information is generated. Using parameters including a variable threshold value, dangerous driving is detected, and including information on dangerous driving

[0016] 6 In a 6 certain aspect of the present technology, a driving behavior, which is the behavior of a user or a vehicle during driving, is detected. Operation Based on the detection result of the driving behavior, a driving diagnosis of the user is performed. Operation Based on the driving diagnosis, feedback information is generated. Variable The threshold value Using parameters including, dangerous driving is detected.

[0017] In a 7 certain aspect of the present technology, a driving behavior, which is the behavior of a user or a vehicle during driving, is detected. Operation Based on the detection result of the driving behavior, a driving diagnosis of the user is performed. Operation Based on the driving diagnosis, feedback information is generated. Variable The threshold value Using parameters including, dangerous driving is detected.

Advantages of the Invention

[0020] According to the first Up to the third aspect of the present technology, the diagnostic accuracy of the suitability of the user for driving the moving body is improved. As a result, the safety of driving the moving body is improved.

[0021] Note that the effects described here are not necessarily limited, and any of the effects described in the present disclosure may be applicable.

Brief Description of the Drawings

[0022]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0023] Hereinafter, embodiments for carrying out the present technology will be described. The description will be made in the following order. 1. Embodiment 2. Variation 3. Others

[0024] <<1. Embodiment>> <Configuration Example of Information Processing System> FIG. 1 is a block diagram showing an embodiment of an information processing system to which the present technology is applied.

[0025] The information processing system 10 is a system that provides services such as vehicle driving support and automobile insurance using, for example, telematics technology.

[0026] The information processing system 10 includes a user terminal unit 11, a vehicle 12, and a server 13. The user terminal unit 11 and the vehicle 12 communicate directly or via a network 14. The server 13 communicates with the user terminal unit 11 and the vehicle 12 via the network 14.

[0027] The user terminal unit 11 consists of one or more information processing terminals held by a user who uses the information processing system 10. For example, the user terminal unit 11 may include a mobile terminal and a wearable terminal.

[0028] The vehicle 12 is a vehicle driven by a user who uses the information processing system 10.

[0029] The server 13 communicates with the user terminal unit 11 and the vehicle 12 via the network 14 to provide services such as driving support and automobile insurance to the user who uses the information processing system 10.

[0030] In FIG. 1, for the sake of clarity, one user terminal unit 11, one vehicle 12, and one server 13 are illustrated, but two or more of each can be provided. For example, the number of user terminal units 11 and vehicles 12 provided is approximately equal to the number of users who use the information processing system 10.

[0031] Also, hereinafter, for the sake of simplicity, the description of "via the network 14" when the user terminal unit 11, the vehicle 12, and the server 13 communicate via the network 14 will be omitted.

[0032] <Configuration example of the user terminal unit> FIG. 2 is a block diagram showing a configuration example of the user terminal unit 11. In this example, the user terminal unit 11 includes a mobile terminal 51 and a wearable terminal 52.

[0033] The mobile terminal 51 consists of a portable information processing terminal such as, for example, a smartphone, a mobile phone, a tablet, a notebook personal computer, a portable game machine, a portable video or music playback device, etc.

[0034] The mobile terminal 51 includes a GNSS (Global Navigation Satellite System) receiver 61, an inertial sensor 62, an environmental sensor 63, a biological sensor 64, an input unit 65, an output unit 66, a control unit 67, and a communication unit 68.

[0035] The GNSS receiver 61 measures the current position of the mobile terminal 51 (the user having it) by receiving radio waves from positioning satellites, and supplies position data indicating the measured current position to the control unit 67.

[0036] The inertial sensor 62 detects various inertial data regarding the mobile terminal 51 (the user having it), and supplies the detected inertial data to the control unit 67. The inertial data detected by the inertial sensor 62 includes, for example, one or more of acceleration, angular velocity, etc.

[0037] The environmental sensor 63 detects various environmental data around the mobile terminal 51 (the user having it), and supplies the detected environmental data to the control unit 67. The environmental data detected by the environmental sensor 63 includes, for example, one or more of geomagnetism, atmospheric pressure, carbon dioxide concentration, etc.

[0038] The biological sensor 64 detects various biological data of the user, and supplies the detected biological data to the control unit 67. The biological data detected by the biological sensor 64 includes, for example, one or more of heartbeat, sweating amount, blood pressure, blood oxygen concentration, electromyogram, body temperature, body composition, breath alcohol concentration, maximum oxygen uptake, calorie consumption, voice tone, conversation speed, etc.

[0039] The input unit 65 includes an input device for inputting various types of data into the mobile terminal 51. For example, the input unit 65 includes one or more of buttons, switches, keys, touch panels, microphones, etc. The input unit 65 supplies the input data to the control unit 67.

[0040] The output unit 66 includes an output device for outputting various types of information and data. For example, the output unit 66 includes one or more of displays, speakers, buzzers, vibrators, etc.

[0041] The control unit 67 includes, for example, a control device such as various processors. The control unit 67 controls each part of the mobile terminal 51 and performs various processes based on the data supplied from the GNSS receiver 61, the inertial sensor 62, the environmental sensor 63, the biological sensor 64, and the input unit 65, as well as the data received from the outside via the communication unit 68. Also, the control unit 67 supplies the data obtained by various processes to the output unit 66 or transmits it to other devices via the communication unit 68.

[0042] The communication unit 68 communicates with other devices (for example, the vehicle 12, the server 13, the wearable terminal 52, etc.) by a predetermined communication method. Any wireless or wired communication method can be adopted for the communication method of the communication unit 68. Also, the communication unit 68 can support a plurality of communication methods.

[0043] The wearable terminal 52 is composed of a wearable terminal in any form such as glasses type, wristwatch type, bracelet type, necklace type, neckband type, earphone type, headset type, and head-mounted type, for example.

[0044] The wearable terminal 52 includes a biological sensor 81, an input unit 82, an output unit 83, a control unit 84, and a communication unit 85.

[0045] Similar to the biological sensor 64 of the mobile terminal 51, the biological sensor 81 detects various biological data of the user and supplies the detected biological data to the control unit 84. Note that the types of biological data detected by the biological sensor 81 and the types of biological data detected by the biological sensor 64 of the mobile terminal 51 may overlap.

[0046] The input unit 82 includes an input device for inputting various data to the wearable terminal 52. For example, the input unit 82 includes one or more of buttons, switches, keys, touch panels, microphones, etc. The input unit 82 supplies the input data to the control unit 67.

[0047] The output unit 83 includes an output device for outputting various information and data. For example, the output unit 83 includes one or more of a display, a speaker, a buzzer, a vibrator, etc.

[0048] The control unit 84 includes, for example, a control device such as various processors. The control unit 84 controls each part of the wearable terminal 52 and performs various processes based on the data supplied from the biological sensor 81 and the input unit 82, as well as the data received from the outside via the communication unit 85. Also, the control unit 84 supplies the data obtained by various processes to the output unit 83 or transmits it to other devices via the communication unit 85.

[0049] The communication unit 85 communicates with other devices (for example, the vehicle 12, the server 13, the mobile terminal 51, etc.) by a predetermined communication method. Any wireless or wired communication method can be adopted for the communication method of the communication unit 85. Also, the communication unit 85 can support a plurality of communication methods.

[0050] <Configuration example of vehicle> FIG. 3 is a block diagram showing a partial configuration example of the vehicle 12. The vehicle 12 includes an in-vehicle system 101. The in-vehicle system 101 includes a vehicle data acquisition unit 111, a video and audio acquisition unit 112, an input unit 113, an output unit 114, a control unit 115, and a communication unit 116.

[0051] The vehicle data acquisition unit 111 includes, for example, various sensors, communication devices, control devices, etc. The vehicle data acquisition unit 111 acquires vehicle data regarding the vehicle 12 and supplies the acquired vehicle data to the control unit 115. The vehicle data acquired by the vehicle data acquisition unit 111 includes, for example, vehicle speed, torque, steering angle, yaw angle, gear state, side brake state, accelerator pedal depression amount, brake pedal depression amount, direction indicator state, light state, tire rotation angle and rotation speed, data indicating the diagnostic result of OBD (On-board Diagnostics) (hereinafter referred to as OBD data), and one or more of sensor data such as millimeter-wave radar and lidar.

[0052] The video and audio acquisition unit 112 includes, for example, a camera and a microphone, etc. The camera included in the video and audio acquisition unit 112 may be a special camera such as a ToF (Time Of Flight) camera, a stereo camera, an infrared camera, etc., in addition to a normal camera. The video and audio acquisition unit 112 acquires, for example, the video and audio around and inside the vehicle 12 and supplies the video data and audio data indicating the acquired video and audio to the control unit 115.

[0053] The input unit 113 includes an input device for inputting various data to the vehicle 12. For example, the input unit 113 includes one or more of a button, a switch, a key, a touch panel, etc. The input unit 113 supplies the input data to the control unit 115.

[0054] The output unit 114 includes an output device for outputting various information and data. For example, the output unit 114 includes one or more of a display (e.g., a head-up display), a speaker, a buzzer, a vibrator, an instrument panel, etc.

[0055] The control unit 115 includes a control device such as an ECU (Electronic Control Unit). Based on the data supplied from the vehicle data acquisition unit 111, the video and audio acquisition unit 112, and the input unit 113, as well as the data received from the outside via the communication unit 116, the control unit 115 performs control of each part of the vehicle 12 and various processes. Also, the control unit 115 supplies the data obtained by various processes to the output unit 114 or transmits it to other devices via the communication unit 116.

[0056] The communication unit 116 communicates with other devices (for example, the server 13, the mobile terminal 51, the wearable terminal 52, etc.) by a predetermined communication method. Any wireless or wired communication method can be adopted for the communication method of the communication unit 116. Also, the communication unit 116 can support a plurality of communication methods.

[0057] <Configuration example of the server> FIG. 4 is a block diagram showing a configuration example of the server 13. The server 13 includes a communication unit 151, a state estimation unit 152, a peripheral data acquisition unit 153, a diagnosis unit 154, a driving behavior detection unit 155, a risk prediction unit 156, a damage prediction unit 157, a presentation control unit 158, an evaluation unit 159, a learning unit 160, an insurance premium calculation unit 161, and a storage unit 162.

[0058] The communication unit 151 communicates with other devices (for example, the vehicle 12, the mobile terminal 51, the wearable terminal 52, other servers (not shown), etc.) via the network 14 by a predetermined communication method. Any wireless or wired communication method can be adopted for the communication method of the communication unit 151. Also, the communication unit 151 can support a plurality of communication methods.

[0059] The state estimation unit 152 acquires data related to the user's state from the user terminal unit 11 and the vehicle 12 via the communication unit 151. The state estimation unit 152 generates and updates a state data log, which is a log of data related to the user's state, and stores it in the storage unit 162.

[0060] Further, the state estimation unit 152 performs an estimation process of the user's state using the state estimation model stored in the storage unit 162 based on the state data log. Here, the state estimation model is a model used for estimating the user's state and is generated for each user, for example. The state estimation unit 152 generates and updates an estimated state history, which is a history of the estimation results of the user's state, and stores it in the storage unit 162.

[0061] The surrounding data acquisition unit 153 acquires surrounding data indicating the state of the surroundings of the vehicle 12 based on the data received from the user terminal unit 11, the vehicle 12, and another server (not shown) via the communication unit 151. The surrounding data acquisition unit 153 supplies the acquired surrounding data to the diagnosis unit 154 and the risk prediction unit 156.

[0062] The diagnosis unit 154 acquires the estimated state history of the user, the driving behavior history, and the driving diagnosis model from the storage unit 162. Here, the driving behavior history is a history of the detection results of the driving behavior, which is the behavior of the user or the vehicle 12 during driving, and is generated for each user, for example. The driving diagnosis model is a model used for driving diagnosis to diagnose the suitability of the user's driving of the vehicle and is generated for each user, for example. The diagnosis unit 154 performs a driving diagnosis of the user using the driving diagnosis model based on the acquired history. The diagnosis unit 154 generates and updates a driving diagnosis history, which is a history of the driving diagnosis results of the user, and stores it in the storage unit 162.

[0063] The driving behavior detection unit 155 receives data from the user terminal unit 11 and the vehicle 12 via the communication unit 151. Also, the driving behavior detection unit 155 acquires the estimated state history of the user and the driving behavior detection model from the storage unit 162. Here, the driving behavior detection model is a model used for detecting driving behavior and is generated for each user, for example. Further, the driving behavior detection unit 155 acquires from the damage prediction unit 157 the risk related to the driving of the vehicle by the user and the prediction result of the damage caused by the risk. The driving behavior detection unit 155 performs a detection process of the user's driving behavior using the driving behavior detection model based on the acquired history and data, etc. The driving behavior detection unit 155 generates and updates the driving behavior history, which is a history of the detection results of the user's driving behavior, and stores it in the storage unit 162.

[0064] The risk prediction unit 156 acquires the estimated state history of the user, the driving diagnosis history, the driving behavior history, and the risk prediction model from the storage unit 162. Here, the risk prediction model is a model used for predicting the risk related to the driving of the vehicle 12 by the user and is generated for each user, for example. The risk prediction unit 156 performs risk prediction using the risk prediction model based on the acquired history. The risk prediction unit 156 supplies the prediction result of the risk to the damage prediction unit 157.

[0065] The damage prediction unit 157 predicts the damage caused by the risk predicted by the risk prediction unit 156 while using, as necessary, the compliance of the user evaluated by the evaluation unit 159. Here, the compliance is the degree to which the user obediently follows the proposals, etc. from the server 13. The damage prediction unit 157 supplies the prediction results of the risk and the damage to the driving behavior detection unit 155 and the presentation control unit 158.

[0066] The prompt control unit 158 acquires the driving diagnosis history of the user and the insurance premium calculated by the insurance premium calculation unit 161 from the storage unit 162. Based on the prediction results of risks and damages, as well as the driving diagnosis history and insurance premium of the user, the prompt control unit 158 generates feedback information including information on the predicted risks and presented to the user. The prompt control unit 158 controls the presentation of the feedback information to the user by transmitting the generated feedback information to the user terminal unit 11 or the vehicle 12 of the user via the communication unit 151. In addition, the prompt control unit 158 supplies the feedback information to the evaluation unit 159.

[0067] The evaluation unit 159 acquires the estimated state history and driving behavior history of the user from the storage unit 162. Then, based on the acquired history and the feedback information, the evaluation unit 159 evaluates the compliance of the user. The evaluation unit 159 supplies the compliance of the user to the damage prediction unit 157 and stores it in the storage unit 162.

[0068] The learning unit 160 acquires the estimated state history of the user from the storage unit 162. Based on the acquired estimated state history, the learning unit 160 learns the pattern of the standard state of the user (hereinafter referred to as the standard state pattern), and stores the data indicating the obtained standard state pattern in the storage unit 162.

[0069] In addition, the learning unit 160 acquires the estimated state history of each user included in a predetermined user set from the storage unit 162. Based on the acquired estimated state history, the learning unit 160 learns the pattern of the average state of the users in the user set (hereinafter referred to as the user set state pattern), and stores the data indicating the obtained user set state pattern in the storage unit 162.

[0070] Furthermore, the learning unit 160 acquires the state data log, estimated state history, driving diagnosis history, and driving behavior history of the user from the storage unit 162. Based on the acquired log and history, the learning unit 160 learns the state estimation model, driving diagnosis model, driving behavior detection model, and risk prediction model, and stores them in the storage unit 162.

[0071] The insurance premium calculation unit 161 acquires the driving diagnosis history, driving behavior history, and compliance degree of the user from the storage unit 162. Based on the acquired history and compliance degree, the insurance premium calculation unit 161 calculates the insurance premium for the user's automobile insurance. The insurance premium calculation unit 161 stores the data indicating the calculated insurance premium in the storage unit 162.

[0072] <Driving support process> Next, with reference to the flowcharts of FIGS. 5 and 6, the driving support process executed by the server 13 will be described.

[0073] Hereinafter, mainly the process for a specific user (hereinafter referred to as the target user) will be described as the center. However, in actuality, the processes for users other than the target user are performed in parallel.

[0074] In step S1, the server 13 starts the estimation process of the state of the user (target user) when not driving. Specifically, for example, the following processes are started.

[0075] The state estimation unit 152 acquires data related to the state of the target user from the data (for example, inertial data, environmental data, biological data, input data, etc.) received by the communication unit 151 from the user terminal unit 11 of the target user. The state estimation unit 152 stores each data in the storage unit 162 together with the time when the data is acquired. Thereby, the state data log of the target user is updated.

[0076] Note that the state data log of the target user may include not only data related to the state of the target user himself / herself but also data related to the state around the target user.

[0077] Based on the state data log of the target user within a recent predetermined period, the state estimation unit 152 estimates the current state of the target user using the state estimation model of the target user stored in the storage unit 162. For example, the state estimation unit 152 estimates the current biological state, behavior, and emotion of the target user as the current state of the target user.

[0078] For example, as illustrated in FIG. 7, based on the time-series changes in the sensor data group indicating the state of the target user, the state estimation unit 152 estimates the biological state and behavior of the target user for each frame of a predetermined time. For example, based on the heart rate and sweating amount of the target user, various biological states of the target user such as concentration, arousal level, fatigue level, stress level, tension level, and intensity of exercise are estimated. For example, based on the acceleration and angular velocity of the target user, as well as the ambient air pressure, etc., the type of behavior of the target user (e.g., stationary, walking, running, cycling, going up and down stairs, eating, sleeping, etc.) is estimated.

[0079] Also, for example, the state estimation unit 152 estimates the moving distance, moving speed, and behavior range, etc., of the target user based on the position data and acceleration of the target user.

[0080] Furthermore, the state estimation unit 152 estimates the emotion of the target user based on the biological data of the target user and the estimation results of the biological state of the target user. For example, the state estimation unit 152 estimates the degree of joy, anger, sorrow, and happiness, excitement level, anxiety level, uneasiness level, etc., of the target user.

[0081] Note that not all of the biological state and emotion of the target user are necessarily clearly distinguishable, and there are also overlapping ones. For example, the excitement level can be either the biological state or the emotion of the target user.

[0082] Also, any method can be adopted for the method of estimating the user's state. Furthermore, the types of the user's state to be estimated are not limited to the examples described above, and can be added or deleted as necessary.

[0083] The state estimation unit 152 stores the estimated state of the target user in the storage unit 162 together with the estimated time. Thereby, the estimated state history of the target user is updated.

[0084] Note that, for example, as illustrated in FIG. 7, the estimated state history includes data in which numerical values for each frame such as arousal level are arranged in time series, or data in which labels (indicating the type of action) assigned for each frame such as actions are arranged in time series.

[0085] In step S2, the learning unit 160 determines whether to learn the pattern of the standard state (standard state pattern) of the user (target user). For example, the learning of the standard state pattern of the target user is executed at a predetermined timing such as when the target user starts using the information processing system 10, every time a predetermined time elapses, or every time the amount of data in the estimated state history of the target user increases by a predetermined amount or more. Then, when it is the timing to learn the standard state pattern of the target user, the learning unit 160 determines to learn the standard state pattern of the target user, and the process proceeds to step S3.

[0086] In step S3, the learning unit 160 learns the pattern of the standard state (standard state pattern) of the user (target user). For example, as illustrated in FIG. 8, the learning unit 160 learns the standard state pattern of the target user based on the estimated state history within a relatively recent long-term period (e.g., monthly, yearly) of the target user.

[0087] For example, the learning unit 160 learns a transition pattern indicating the standard transition of each item for a predetermined period (e.g., one day) by calculating, as the standard state pattern of the target user, the average and variance, etc. for each period of a predetermined time (e.g., 1 minute, 10 minutes, 30 minutes, or 1 hour) of each of the following items. For example, the standard daily transition patterns of the target user's concentration, arousal level, fatigue level, stress level, tension level, intensity of movement, heart rate, sweating amount, amount of exercise, degree of emotions, excitement level, anxiety level, uneasiness level, etc. are learned.

[0088] Also, for example, the learning unit 160 learns a standard transition pattern per predetermined period (for example, one week) for each item by calculating the average, variance, etc. of each item on a daily (weekly) basis as the standard state pattern of the target user. For example, a standard transition pattern for one week such as sleep time, wake-up time, bedtime, amount of exercise, movement range, number of meals, meal time, meal time zone, driving time, driving time zone, commuting time zone, school commuting time zone, etc. is learned.

[0089] In addition, the learning unit 160 learns an average standard state pattern (user set state pattern) within the user set based on the estimated state history of each user within a predetermined user set as a comparison target for the standard state pattern of the target user.

[0090] Here, the user set may include all users of the information processing system 10, or may include only some users. In the latter case, for example, it may be a user set consisting of users similar to the target user. Here, users similar to the target user are, for example, users whose attributes (for example, age, gender, occupation, address, etc.), behavior patterns, preferences, etc. are similar to those of the target user. Also, the target user may or may not be included in the user set.

[0091] For example, as illustrated in FIG. 9, the learning unit 160 learns the user set state pattern by aggregating the average of the standard state patterns of each user within the user set. For example, by aggregating the average of the standard transition patterns for one day of each item within the user set, the average transition pattern for one day of each item within the user set is learned. Also, for example, by aggregating the average of the standard transition patterns for one week of each item within the user set, the average transition pattern for one week of each item within the user set is learned.

[0092] The learning unit 160 causes the storage unit 162 to store data indicating the learning results of the standard state pattern of the target user and the user set state pattern.

[0093] Note that the timing of learning the standard state pattern of the target user and the learning of the user collective state pattern does not necessarily need to be synchronized, and they may be performed at different timings respectively.

[0094] After that, the process proceeds to step S4.

[0095] On the other hand, in step S2, if it is determined not to learn the standard state pattern of the target user, the process of step S3 is skipped, and the process proceeds to step S4.

[0096] In step S4, the diagnosis unit 154 performs a driving diagnosis during non-driving. For example, based on the estimated state history of the target user, the diagnosis unit 154 detects a transition pattern (hereinafter referred to as the recent state pattern) within a relatively short period (for example, one day and one week) for the same items as the above-described standard state pattern.

[0097] Next, the diagnosis unit 154 calculates, for example, as illustrated in FIG. 10, a divergence degree vector x indicating the divergence degree between the recent state pattern of the target user and the standard state pattern, and a divergence degree vector y indicating the divergence degree between the recent state pattern of the target user and the user collective state pattern. For example, the divergence degree vector x and the divergence degree vector y are vectors including values obtained by normalizing the divergence degree for each item of the two state patterns to be compared.

[0098] Then, the diagnosis unit 154 calculates the driving suitability degree u of the target user during non-driving using the driving diagnosis model of the target user represented by the function f of the following formula (1).

[0099] u = f(x, y, wx, wy) ···(1)

[0100] Note that wx is the weight for the divergence degree vector x, and wy is the weight for the divergence degree vector y.

[0101] The driving suitability degree u increases as the deviation degrees of the items included in the deviation vector x decrease. That is, the closer the most recent state pattern of the target user is to the standard state pattern, in other words, the smaller the difference between the most recent state of the target user and the standard state, the more suitable the driving state is determined to be. On the other hand, the driving suitability degree u decreases as the deviation degrees of the items included in the deviation vector x increase. That is, the farther the most recent state pattern of the target user is from the standard state pattern, in other words, the larger the difference between the most recent state of the target user and the standard state, the less suitable the driving state is determined to be.

[0102] Also, the driving suitability degree u increases as the deviation degrees of the items included in the deviation vector y decrease. That is, the closer the most recent state pattern of the target user is to the user set state pattern, in other words, the smaller the difference between the most recent state of the target user and the average state in the user set, the more suitable the driving state is determined to be. On the other hand, the driving suitability degree u decreases as the deviation degrees of the items included in the deviation vector y increase. That is, the farther the most recent state pattern of the target user is from the user set state pattern, in other words, the larger the difference between the most recent state of the target user and the average state in the user set, the less suitable the driving state is determined to be.

[0103] Note that as the weight wx increases, the influence of the deviation vector x on the driving suitability degree u (that is, the difference between the most recent state pattern of the target user and the standard state pattern) increases. On the other hand, as the weight wy increases, the influence of the deviation vector y on the driving suitability degree u (that is, the difference between the user set state pattern of the target user and the standard state pattern) increases.

[0104] Further, for example, when the driving suitability degree u is less than a predetermined threshold value, the diagnosis unit 154 estimates the factor causing the decrease in the driving suitability degree u. For example, the diagnosis unit 154 extracts items in the deviation degree vector x where the product of the weight wx and the deviation degree is equal to or greater than a predetermined value. Further, the diagnosis unit 154 extracts items in the deviation degree vector y where the product of the weight wy and the deviation degree is equal to or greater than a predetermined value. Then, the diagnosis unit 154 estimates the factor causing the decrease in the driving suitability degree u by comparing each of the extracted items with the recent state pattern and the standard state pattern or the user set average pattern.

[0105] For example, when the sleep time in the recent state pattern of the target user is significantly lower than the standard state pattern or the user set average pattern, it is estimated that sleep deprivation is the factor causing the decrease.

[0106] For example, when one or more of the exercise time, heart rate, and sweating amount in the recent state pattern of the target user are significantly higher than the standard state pattern or the user set average pattern, it is estimated that physical fatigue due to intense exercise is the factor causing the decrease.

[0107] For example, when one or more of the stress level, tension level, and anxiety level in the recent state pattern of the target user are significantly higher than the standard state pattern or the user set average pattern, it is estimated that the anxiety of the target user is the factor causing the decrease.

[0108] Note that when the driving suitability degree u is equal to or greater than a predetermined threshold value, for example, there is no particular factor causing the decrease in the driving suitability degree u.

[0109] The diagnosis unit 154 stores the driving suitability degree u and the estimated factor causing the decrease, together with the diagnosis time, in the storage unit 162 as the diagnosis result of the driving suitability of the target user. Thereby, the driving diagnosis history of the target user is updated.

[0110] In step S5, the risk prediction unit 156 performs risk prediction. Specifically, the risk prediction unit 156 acquires the driving diagnosis history of the target user and the risk prediction model from the storage unit 162. Based on the driving diagnosis history of the target user, the risk prediction unit 156 uses the risk prediction model of the target user to predict the risk when the target user is driving at the current time.

[0111] For example, when the factor causing the decrease in the driving suitability degree u is lack of sleep or physical fatigue, it is estimated that there is a risk of dozing off while driving.

[0112] For example, when the factor causing the decrease in the driving suitability degree u is the impatience of the target user, for example, there is a risk of collision or contact with other vehicles due to speeding or unreasonable overtaking, and collision or contact with obstacles (for example, other vehicles, bicycles, pedestrians, etc.) due to the inattention of the target user.

[0113] In addition, the risk prediction unit 156 estimates the occurrence probability of the predicted risk. For example, the shorter the sleep time of the target user, the higher the estimated occurrence probability of dozing off while driving.

[0114] Generally, the lower the driving suitability degree u, the greater the predicted risk and the occurrence probability.

[0115] The risk prediction unit 156 supplies the prediction result of the risk to the damage prediction unit 157. This risk prediction result includes the predicted risk, the basis for predicting the risk (for example, the factor causing the decrease in the driving suitability degree u), and the occurrence probability of the risk.

[0116] In step S6, the damage prediction unit 157 performs damage prediction. Specifically, the damage prediction unit 157 predicts the damage (for example, risk / penalty value) caused by the risk predicted by the risk prediction unit 156. At this time, the occurrence probability of the risk is taken into account. That is, the higher the occurrence probability, the greater the predicted damage, and the lower the occurrence probability, the smaller the predicted damage. The damage prediction unit 157 supplies the prediction results of the risk and the damage to the driving behavior detection unit 155 and the presentation control unit 158.

[0117] In step S7, the driving behavior detection unit 155 adjusts the detection parameters of the driving behavior. For example, the driving behavior detection unit 155 adjusts the parameters for detecting dangerous driving among various driving behaviors according to the predicted risks and damages.

[0118] Here, the driving behaviors related to the detection of dangerous driving are, for example, sudden starts, sudden accelerations, sudden brakes, and sudden operations such as sudden steering, serpentine driving, drowsy driving, decreases in wakefulness and concentration, distracted driving, inattentiveness ahead, speed overrun, reckless overtaking, insufficient inter-vehicle distance, and approaching obstacles and other dangerous driving behaviors.

[0119] Also, as the estimated risks and damages increase, the detection parameters are adjusted so that the level (degree of danger) of the dangerous driving to be detected becomes lower. As a result, dangerous driving can be detected at an earlier and more minor stage.

[0120] For example, when the occurrence of drowsy driving is predicted, the threshold value of the number of blinks in drowsiness determination is decreased so as to detect the driver's drowsiness earlier. For example, when the occurrence of distracted driving, inattentiveness ahead, speed overrun, etc. is predicted, the threshold values for detecting sudden acceleration and sudden braking are decreased so that sudden acceleration and sudden braking are more easily detected.

[0121] Furthermore, the lower the level of the dangerous driving to be detected, the lower the level (degree of danger) of the risk to be predicted. That is, risks at an earlier and more minor stage can be predicted.

[0122] Here, the level of dangerous driving to be detected and the level of risk to be predicted change according to the driving suitability degree u of the target user. For example, as described above, generally, the lower the driving suitability degree u, the greater the predicted risk and the probability of damage occurrence, and the greater the predicted damage. Therefore, the detection parameters are adjusted so that the level of dangerous driving to be detected becomes lower. As a result, the lower the driving suitability degree u, the lower the level of dangerous driving to be detected and the level of risk to be predicted.

[0123] In step S8, the presentation control unit 158 determines whether to provide feedback to the user (target user). The feedback to the target user is executed at a predetermined timing. For example, when a feedback request is sent from the user terminal unit 11 of the target user, the feedback is executed at a timing such as every time a predetermined time has elapsed or when a significant risk is predicted. Then, when the current timing is the timing for providing feedback to the target user, the presentation control unit 158 determines to provide feedback to the target user, and the process proceeds to step S9.

[0124] In step S9, the server 13 provides feedback to the user (target user). Specifically, the presentation control unit 158 generates feedback information to be presented to the target user. This feedback information includes, for example, one or more of the results of the driving diagnosis of the target user, the content of the predicted risk, the basis for the driving diagnosis result or the basis for predicting the risk, and a proposal for avoiding the risk (hereinafter referred to as a risk avoidance plan). The presentation control unit 158 transmits the generated feedback information to the user terminal unit 11 of the target user via the communication unit 151.

[0125] For example, when the mobile terminal 51 of the target user receives feedback information, the output unit 66 of the mobile terminal 51 presents the feedback information to the target user by using at least one of visual information (e.g., video) and auditory information (e.g., voice). Also, for example, when the wearable terminal 52 of the target user receives feedback information, the output unit 83 of the wearable terminal 52 presents the feedback information to the target user by using at least one of visual information and auditory information.

[0126] For example, when it is estimated that the target user is sleep-deprived, an audio message such as "You are sleep-deprived. It is recommended that you get some sleep before driving." is output.

[0127] Also, for example, as the driving diagnosis result of the target user, the driving suitability degree u is presented by a value at a predetermined level (e.g., 10 levels), and the basis thereof is presented.

[0128] Furthermore, for example, the estimation result of the state of the target user may be presented. For example, the emotional indices such as the joy, anger, sorrow, happiness, excitement level, and aggressiveness of the target user may be presented by values at a predetermined level (e.g., 10 levels).

[0129] Thereafter, the process proceeds to step S10.

[0130] On the other hand, in step S8, when it is determined not to provide feedback to the target user, the process of step S9 is skipped, and the process proceeds to step S10.

[0131] In step S10, the state estimation unit 152 determines whether the user (target user) has started driving. Specifically, the state estimation unit 152 determines whether the target user has started driving based on the data received from at least one of the user terminal unit 11 and the vehicle 12 of the target user via the communication unit 151.

[0132] The driving start determination process may be performed by any one of the user terminal unit 11, the vehicle 12, and the server 13. For example, the mobile terminal 51 may execute the driving start determination process by performing the driving recognition process of the target user or performing beacon synchronization with the vehicle 12. Further, for example, a measuring device integrated with an in-vehicle display device or the like of the vehicle 12 may execute the driving start determination process.

[0133] When the determination process is performed by the user terminal unit 11 or the vehicle 12, the determination result is included in the data transmitted from the user terminal unit 11 or the vehicle 12, and the state estimation unit 152 determines whether or not the target user has started driving based on the determination result.

[0134] If it is determined that the target user has not started driving, the process returns to step S2. Thereafter, in step S10, the processes of steps S2 to S10 are repeatedly executed until it is determined that the target user has started driving. As a result, the driving diagnosis, risk prediction, and damage prediction of the target user are appropriately performed, and based on the results, the adjustment of the detection parameters for dangerous driving and the feedback to the target user are performed. In addition, the standard state pattern of the target user and the user collective state pattern are appropriately updated.

[0135] On the other hand, if it is determined in step S10 that the target user has started driving, the process proceeds to step S11.

[0136] In step S11, the server 13 starts the estimation process of the state of the user (target user) during driving. This estimation process is significantly different from the estimation process in step S1 in that the estimation process is performed based on the data transmitted from the vehicle 12 in addition to the user terminal unit 11 of the target user.

[0137] For example, based on the video data from the vehicle 12, the line of sight, blinking, facial expressions, etc. of the target user are detected and used to estimate the concentration, arousal level, fatigue level, emotions, etc. of the target user. Also, for example, based on the vehicle data from the vehicle 12, the content of the driving operation of the target user is estimated.

[0138] Furthermore, for example, based on the driving route of the vehicle 12 and the time zone when the target user is driving, the state of the target user is estimated. For example, if the heart rate and amount of movement of the target user increase rapidly and then the target user drives in a time zone different from normal (for example, late at night or early in the morning), or the vehicle 12 drives outside the daily living range of the target user, it is estimated that the target user is anxious due to some emergency.

[0139] Also, the state estimation unit 152 appropriately updates the state data log and the estimated state history of the target user in the same manner as the process in step S1.

[0140] In step S12, the peripheral data acquisition unit 153 starts acquiring the peripheral data of the vehicle 12. For example, the peripheral data acquisition unit 153 detects the states of structures, roads, traffic jams, weather, etc. around the vehicle 12 of the target user based on the position information transmitted from the user terminal unit 11 or the vehicle 12, and the map information received from other servers or the like via the communication unit 151. Also, for example, the peripheral data acquisition unit 153 detects the objects around the vehicle 12 (for example, vehicles, people, obstacles, structures, roads, traffic lights, traffic signs, road markings, etc.) based on the video data, audio data, and sensor data transmitted from the user terminal unit 11 or the vehicle 12. Note that the user terminal unit 11 or the vehicle 12 may perform the detection process of the objects around the vehicle 12 and transmit the detection results to the server 13.

[0141] The peripheral data acquisition unit 153 supplies the acquired peripheral data of the vehicle 12 to the diagnosis unit 154 and the risk prediction unit 156.

[0142] In step S13, the server 13 starts the detection process of the driving behavior. Specifically, for example, the following processes are started.

[0143] The driving behavior detection unit 155 acquires, from the communication unit 151, data related to the driving behavior (for example, the behavior of the target user or the vehicle 12 during driving) among the data received by the communication unit 151 from the user terminal unit 11 of the target user and the vehicle 12. Further, the driving behavior detection unit 155 detects the driving behavior by using the driving behavior detection model of the target user stored in the storage unit 162 based on the acquired data related to the driving behavior, the estimated state history of the target user stored in the storage unit 162, and the peripheral data of the vehicle 12 acquired from the peripheral data acquisition unit 153. That is, the behavior of the target user during driving and the behavior of the vehicle 12 are detected. For example, the speed, acceleration, deceleration, brake operation, steering angle, driving route, etc. of the vehicle 12 are detected.

[0144] Note that a part of the behavior of the target user during driving may be detected (estimated) by the state estimation unit 152 in step S11.

[0145] Also, the detection of the driving behavior may be performed by any of the user terminal unit 11, the vehicle 12, and the server 13, or may be performed by the user terminal unit 11, the vehicle 12, and the server 13 in cooperation.

[0146] Next, the driving behavior detection unit 155 performs a dangerous driving detection process based on the detected driving behavior, the estimated state history of the target user, and the peripheral data of the vehicle 12.

[0147] For example, a sudden operation is detected due to a sudden change in the speed, steering angle, or torque, etc. of the vehicle 12 based on OBD information or the like, or a sudden change in the acceleration or angular velocity detected by the user terminal unit 11.

[0148] For example, a weaving operation is detected based on periodic variations such as the speed, steering angle, or torque of the vehicle 12 based on OBD information or the like, or periodic variations such as acceleration or angular velocity detected by the user terminal unit 11.

[0149] For example, a shortage in the inter-vehicle distance is detected based on the position of a preceding vehicle detected using a stereo camera, a lidar, or a millimeter-wave radar.

[0150] Here, the detection parameter adjusted in the above-described step S7 or step S20 described later is used for the detection process of dangerous driving. Therefore, as described above, the lower the driving suitability degree u of the target user, the lower the level of dangerous driving to be detected, and the target is detected as dangerous driving from an earlier and milder stage.

[0151] The driving behavior detection unit 155 stores the detection result of the driving behavior in the storage unit 162 together with the detected time. Thereby, the driving behavior history of the target user is updated.

[0152] In step S14, the diagnosis unit 154 performs a driving diagnosis. For example, the diagnosis unit 154 corrects the driving suitability degree u using the driving diagnosis model of the target user stored in the storage unit 162 based on the estimated state history of the target user after the start of driving and the driving behavior history.

[0153] For example, when a decrease in the concentration or wakefulness of the target user, or an increase in the fatigue level, stress level, or tension level of the target user occurs, the driving suitability degree u is decreased. On the other hand, for example, when an increase in the concentration or wakefulness of the target user, or a decrease in the fatigue level, stress level, or tension level of the target user occurs, the driving suitability degree u is increased. Also, for example, when dangerous driving is detected, the driving suitability degree u is decreased according to the detection frequency. On the other hand, when the state where no dangerous driving is detected continues, the driving suitability degree u is increased according to the duration.

[0154] Note that the driving suitability degree u may be corrected based on the quality of the driving operations of the target user, such as the smoothness of braking and accelerator pedal operation, the handling of the steering wheel during cornering, and the smoothness of acceleration and deceleration.

[0155] The diagnosis unit 154 stores the corrected driving suitability degree u and the estimated degradation factor, together with the time of diagnosis, in the storage unit 162 as the diagnosis result of the driving suitability of the target user. Thereby, the driving diagnosis history of the target user is updated.

[0156] In step S15, the risk prediction unit 156 performs risk prediction. Here, different from the process of step S5, the risk prediction unit 156 further uses the estimated state history and driving behavior history of the target user stored in the storage unit 162, in addition to the driving diagnosis history of the target user, to perform risk prediction. For example, even if the driving suitability degree u of the target user is high, the higher the detection frequency of dangerous driving and the higher the degree of danger of the detected dangerous driving, the greater the predicted risk. On the other hand, for example, even if the driving suitability degree u of the target user is low, if no dangerous driving is detected, the predicted risk becomes smaller. In this way, since risk prediction is performed using the actual state and driving behavior of the target user during driving, the accuracy of risk prediction is improved compared to the process of step S5.

[0157] In addition, the risk prediction unit 156 can also predict not only the risk and its occurrence probability but also the time when the occurrence probability of the risk will increase in the future (hereinafter referred to as the risk increase time). For example, the risk prediction unit 156 estimates, based on the time-series changes in the concentration, tension, or arousal level of the target user, the time when they fall below a predetermined threshold as the risk increase time.

[0158] The risk prediction unit 156 supplies the prediction result of the risk to the damage prediction unit 157. The prediction result of this risk includes the content of the predicted risk, the basis for predicting the risk (for example, the degradation factor of the driving suitability degree u and the detection result of dangerous driving), and the occurrence probability of the risk. Also, if necessary, the risk increase time is included.

[0159] In step S16, similar to the process of step S6, damage prediction is performed. However, different from the process of step S6, the damage prediction unit 157 performs damage prediction using the compliance of the target user. That is, the higher the compliance of the target user, the higher the possibility of avoiding risks, and the lower the compliance, the lower the possibility of avoiding risks. Therefore, the higher the compliance, the smaller the predicted damage, and the lower the compliance, the larger the predicted damage. The damage prediction unit 157 supplies the prediction results of risks and damages to the driving behavior detection unit 155 and the presentation control unit 158.

[0160] Here, the level of dangerous driving to be detected and the level of risk to be predicted change according to the compliance of the target user. For example, as described above, the greater the decrease in the compliance of the target user, the greater the damage of the predicted risk. Therefore, the detection parameters are adjusted so that the level of dangerous driving to be detected becomes lower. As a result, the lower the compliance, the lower the level of dangerous driving to be detected and the level of risk to be predicted.

[0161] In step S17, the presentation control unit 158 determines whether to provide feedback to the user (target user). For example, when it is predicted that a risk that needs to be notified to the target user will occur, the presentation control unit 158 determines to provide feedback to the target user, and the process proceeds to step S18.

[0162] In step S18, similar to the process of step S8, feedback to the target user is provided. Here, specific examples of the feedback information presented to the target user will be described.

[0163] For example, when it is estimated that the target user is sleep - deprived and sudden operation or swerving driving is detected, a warning for dangerous driving is issued. For example, in the user terminal unit 11 or the vehicle 12 of the target user, an audio message such as "You are sleep - deprived. Please drive carefully." is output. For example, the part "Please drive carefully." becomes a risk - avoidance measure, and the part "You are sleep - deprived." becomes the basis for presenting the risk - avoidance measure.

[0164] For example, when it is estimated that the target user is outside the scope of daily life or is estimated to be feeling strong stress, and the detection of approaching the vehicle ahead is detected, a warning for dangerous driving is issued. For example, in the user terminal unit 11 or the vehicle 12 of the target user, an audio message such as "Are you in a hurry? Let's drive calmly." is output. For example, the part "Let's drive calmly." becomes a risk - avoidance measure, and the part "Are you in a hurry?" becomes the basis for presenting the risk - avoidance measure.

[0165] For example, when it is estimated that the target user has done intense exercise before driving, when the detection of the target user's fixed gaze is detected, or when a large number of pedestrians are detected around the vehicle 12, a warning against the risk of dangerous driving is issued. For example, in the user terminal unit 11 or the vehicle 12 of the target user, an audio message such as "Are you sleepy? Please drive while paying attention to the surroundings." is output. For example, the part "Please drive while paying attention to the surroundings." becomes a risk - avoidance measure, and the part "Are you sleepy?" becomes the basis for presenting the risk - avoidance measure.

[0166] For example, when it is estimated that the user of interest is outside the scope of daily life or when it is estimated that the user of interest lacks sleep, if a sudden operation or a weaving driving is detected while driving on a highway, a warning against dangerous driving is issued. For example, in the user terminal unit 11 or the vehicle 12 of the user of interest, an audio message such as "How about taking a break at the next service area? You lacked sleep yesterday and are currently driving in a weaving manner." is output. For example, the part "How about taking a break at the next service area?" becomes a risk avoidance plan, and the part "You lacked sleep yesterday and are currently driving in a weaving manner." becomes the basis for presenting the risk avoidance plan.

[0167] For example, when it is estimated that the user of interest lacks sleep or is in an extremely tense state and dangerous driving is frequently detected, a warning about an increase in the automobile insurance premium and the presentation of its cause are issued. For example, in the user terminal unit 11 or the vehicle 12 of the user of interest, an audio message such as "Dangerous driving due to lack of sleep (or tension) occurs frequently. If another x dangerous driving is detected, you will lose the right to insurance cashback." is output. For example, the part "If another x dangerous driving is detected, you will lose the right to insurance cashback." becomes a warning to the user of interest, and the part "Dangerous driving due to lack of sleep (or tension) occurs frequently." becomes the basis for issuing the warning.

[0168] For example, when it is estimated that the user of interest is driving on an unfamiliar road outside the scope of daily life and the time of increased risk due to fatigue is estimated, an audio message such as "Are you tired? How about taking a break at Service Area A?" is output. Note that Service Area A is a service area estimated to be reachable by the vehicle 12 of the user of interest before the time of increased risk. For example, the part "How about taking a break at Service Area A?" becomes a risk avoidance plan, and the part "Are you tired?" becomes the basis for presenting the risk avoidance plan.

[0169] Note that the risk avoidance plan can be made more specific, for example, like "Please reduce your speed to 60 km / h or less." or "Please face forward immediately."

[0170] Also, the presentation control unit 158 supplies the feedback information to the evaluation unit 159.

[0171] In step S19, the evaluation unit 159 evaluates the compliance of the user (the target user). Specifically, the evaluation unit 159 acquires from the storage unit 162 the estimated state history and driving behavior history of the target user after feedback has been given to the target user. Then, based on the acquired history, the evaluation unit 159 detects the reaction of the target user to the feedback (for example, the content of driving).

[0172] Also, the evaluation unit 159 updates the evaluation value of the compliance of the target user based on the reaction of the target user. For example, if the feedback information presented this time includes a risk avoidance plan and the target user follows the risk avoidance plan, the compliance of the target user increases. Also, the shorter the time until the target user follows the risk avoidance plan (the faster the reaction speed), or the smaller the difference between the reaction of the target user and the risk avoidance plan, the greater the increase in the compliance of the target user. Conversely, the longer the time until the target user follows the risk avoidance plan (the slower the reaction speed), or the greater the difference between the reaction of the target user and the risk avoidance plan, the smaller the increase in the compliance of the target user.

[0173] On the other hand, if the target user does not follow the risk avoidance plan, for example, if the target user ignores the risk avoidance plan or shows a reaction different from the risk avoidance plan, the compliance of the target user decreases. In particular, if the target user performs dangerous driving without following the risk avoidance plan, the decrease in the compliance of the target user is large.

[0174] The evaluation unit 159 supplies the updated compliance of the target user to the damage prediction unit 157 and stores it in the storage unit 162.

[0175] After that, the process proceeds to step S20.

[0176] On the other hand, if it is determined in step S17 not to provide feedback to the target user, the processes of steps S18 and S19 are skipped, and the process proceeds to step S20.

[0177] In step S20, similar to the process of step S7, the detection parameters of the driving behavior are adjusted.

[0178] In step S21, the state estimation unit 152 determines whether the user has stopped driving. That is, similar to the driving start determination process in step S10, the state estimation unit 152 determines whether the target user has stopped driving based on the data received from at least one of the user terminal unit 11 and the vehicle 12 of the target user via the communication unit 151.

[0179] If it is determined that the target user has not stopped driving, the process returns to step S14. After that, in step S21, the processes of steps S14 to S21 are repeatedly executed until it is determined that the target user has stopped driving. Thereby, the driving diagnosis, risk prediction, and damage prediction of the target user are appropriately performed, and based on the results, the detection parameters of dangerous driving are adjusted and feedback is provided to the target user. Also, the compliance of the target user is appropriately updated.

[0180] On the other hand, if it is determined in step S21 that the target user has stopped driving, the process proceeds to step S22.

[0181] In step S22, similar to the process of step S1, the estimation process of the state of the target user during non-driving is started.

[0182] In step S23, the surrounding data acquisition unit 153 stops acquiring the data around the vehicle 12.

[0183] In step S24, the driving behavior detection unit 155 stops the detection process of the driving behavior.

[0184] In step S25, the learning unit 160 performs learning processing. For example, the learning unit 160 performs learning of a state estimation model, a driving diagnosis model, a driving behavior detection model, and a risk prediction model based on the state data log of the target user, the estimated state history, the driving diagnosis history, and the driving behavior history stored in the storage unit 162.

[0185] For example, when safe driving is performed despite the driving suitability degree u being evaluated as low, the weights wx and wy of the formula (1) representing the above-described driving diagnosis model are set small. As a result, the driving suitability degree u of the target user is evaluated higher than before. Conversely, when dangerous driving is frequently performed despite the driving suitability degree u being evaluated as high, the weights wx and wy of the formula (1) are set large. As a result, the driving suitability degree u of the target user is evaluated lower than before.

[0186] Also, for example, when the difference between the most recent state pattern of the target user and the user set state pattern is large and safe driving is performed despite the driving suitability degree u being evaluated as low, the weight wx of the above-described formula (1) is increased and the weight wy is decreased. That is, in driving diagnosis, the difference between the most recent state pattern of the target user and the standard state pattern is more emphasized.

[0187] Note that, for example, when the target user starts using the service, a model corresponding to an average user obtained by prior experiments or the like is used. Thereafter, each model is updated (personalized) to a model more suitable for the target user by learning processing.

[0188] Note that this learning process does not necessarily have to be performed every time the driving of the target user ends. For example, it may be performed at any timing such as every predetermined period, every time the driving is performed a predetermined number of times, every time the driving time increases by a predetermined time or more. Also, it is not necessarily required to perform the learning process for all models simultaneously, and the learning process may be performed at different timings for each model.

[0189] Also, for example, the learning unit 160 may perform learning of a fatigue degree estimation model that predicts the fatigue degree of the target user based on the transition of the fatigue degree of the target user before and during driving shown in the estimated state history. For example, the state estimation unit 152 can estimate the fatigue degree of the target user at each point on the planned driving route using the fatigue degree estimation model. Further, for example, the learning unit 160 can improve the estimation accuracy of the fatigue degree by performing learning of the fatigue degree estimation model in consideration of the surrounding state of the vehicle 12 such as the time zone, weather, traffic jam situation, road type (for example, general road or highway).

[0190] Also, as the method of the learning process, for example, machine learning such as a neural network or any other method can be used.

[0191] In step S26, the insurance premium calculation unit 161 calculates the insurance premium of the user (target user). For example, when the insurance premium of the target user's automobile insurance or the cashback amount for the insurance premium fluctuates in real time, the insurance premium calculation unit 161 updates the insurance premium or the cashback amount based on the driving diagnosis history, driving behavior history, and compliance degree of the target user stored in the storage unit 162. The insurance premium calculation unit 161 stores the updated insurance premium or cashback amount of the target user in the storage unit 162.

[0192] For example, the lower the average value of the driving suitability degree u, the higher the insurance premium (or the lower the cashback amount), and the higher the average value of the driving suitability degree u, the lower the insurance premium (or the higher the cashback amount).

[0193] Also, for example, the higher the frequency or cumulative number of dangerous driving, the higher the insurance premium (or the lower the cashback amount), and the lower the frequency or cumulative number of dangerous driving, the lower the insurance premium (or the higher the cashback amount). Further, for example, the higher the average or total predicted damage for dangerous driving, the higher the insurance premium (or the lower the cashback amount), and the lower the average or total predicted damage for dangerous driving, the lower the insurance premium (or the higher the cashback amount).

[0194] Also, for example, the lower the compliance level, the less the risk reduction can be expected, so the insurance premium increases (or the cashback amount decreases), and the higher the compliance level, the more the risk reduction can be expected, so the insurance premium decreases (or the cashback amount increases). In particular, when the target user performs dangerous driving without following the risk avoidance plan, for example, as a penalty, the increase range of the insurance premium (or the decrease range of the cashback amount) becomes larger.

[0195] Note that this insurance premium calculation process does not necessarily have to be performed every time the driving of the target user ends. For example, it may be performed at any timing such as every predetermined period, every time a predetermined number of drives are performed, or every time the driving time increases by a predetermined time or more.

[0196] Also, this insurance premium calculation process may be executed, for example, at the time of the next insurance renewal to calculate the estimated amount of the insurance premium.

[0197] Furthermore, for example, in the case of automobile insurance per drive or per day, the insurance premium may be calculated by executing this insurance premium calculation process before driving. In this case, for example, the insurance premium is calculated using at least one of the driving suitability degree u and the compliance level of the target user.

[0198] Also, the calculated insurance premium or cashback amount may be presented to the target user as feedback information.

[0199] Thereafter, the process returns to step S2, and the processes after step S2 are executed.

[0200] For example, the driving behavior is affected not only by the state of the user during driving but also by the state of the user before driving (e.g., behavior, biological state, emotion, etc.). In contrast, as described above, by comprehensively considering the state of the user before driving in addition to the state of the user during driving and the driving behavior, the driving suitability degree u is evaluated more appropriately. Further, by improving the accuracy of the driving suitability degree u, the accuracy of risk prediction and damage prediction is improved. As a result, appropriate feedback information can be presented at a more appropriate timing, safety is improved, and the occurrence of accidents can be prevented.

[0201] In addition, since the basis of the result of the driving diagnosis or the basis for predicting the risk is shown in the feedback information, the user's acceptance is improved, and the probability that the user follows the risk avoidance plan increases. Further, when the presented basis is incorrect, for example, when the user instructs the server 13 to correct it and reflects it in the learning process, the accuracy of the driving diagnosis model and the risk prediction model is improved.

[0202] Furthermore, by evaluating the user's compliance and changing the level of dangerous driving to be detected and the level of risk to be predicted based on the compliance, the user can more surely avoid risks.

[0203] In addition, by calculating the automobile insurance premium (including the cashback amount) based not only on the driving behavior of the user but also on the driving suitability degree u and the compliance, a more appropriate insurance premium can be set for each user. Thereby, for example, the user can be motivated to follow the risk avoidance plan, and the user can more surely avoid risks.

[0204] <<2. Modification Example>> Hereinafter, a modification example of the embodiment of the technology according to the present disclosure described above will be described.

[0205] <Modification Example Regarding System Configuration> The configuration example of the information processing system 10 in FIGS. 1 to 4 is an example, and it can be changed as necessary.

[0206] For example, in the above description, an example is shown in which the server 13 performs most of the processing based on the data acquired from the user terminal unit 11 and the vehicle 12 (in-vehicle system 101). However, for example, it is also possible to distribute the processing among the user terminal unit 11, the vehicle 12, and the server 13, or for the user terminal unit 11 or the vehicle 12 to perform the processing alone.

[0207] For example, it is possible for at least one of the user terminal unit 11 and the vehicle 12 to perform part or all of the processing of the server 13.

[0208] For example, at least one of the user terminal unit 11 and the vehicle 12 may perform part or all of the processing of the state estimation unit 152, the driving behavior detection unit 155, and the evaluation unit 159, and transmit the estimation result and the detection result to the server 13.

[0209] For example, at least one of the user terminal unit 11 and the vehicle 12 may perform part or all of the processing of the peripheral data acquisition unit 153, and transmit the acquired peripheral data to the server 13.

[0210] For example, at least one of the user terminal unit 11 and the vehicle 12 may perform part or all of the processing of the diagnosis unit 154, the risk prediction unit 156, and the damage prediction unit 157, and transmit the diagnosis result and the prediction result to the server 13.

[0211] Alternatively, for example, the processing related to driving support may be performed by the user terminal unit 11. In this case, the user terminal unit 11 may be composed of a plurality of devices or may be composed of a single device. Further, the user terminal unit 11 may acquire various types of data (e.g., vehicle data, video data, audio data, etc.) from the vehicle 12 and use it for processing, or may not use the data from the vehicle 12 for processing. Also, a user collective state pattern may or may not be used for the driving diagnosis process. When using the user collective state pattern, for example, the server 13 performs learning of the user collective state pattern based on the standard state pattern of each user acquired from the user terminal unit 11 of each user. Then, the server 13 transmits data indicating the user collective state pattern to the user terminal unit 11 of each user.

[0212] In this case, the insurance premium calculation process may be performed by either the user terminal unit 11 or the server 13. When the user terminal unit 11 performs it, for example, an application program for performing the insurance premium calculation process is provided by the server 13. On the other hand, when the server 13 performs it, for example, data necessary for calculating the insurance premium is provided from the user terminal unit 11 to the server 13.

[0213] Furthermore, for example, among the processes related to driving support, almost all processes except the estimation process of the user's state during non-driving and the learning process of the standard state pattern may be performed by the vehicle 12 (in-vehicle system 101). In this case, for example, the user terminal unit 11 performs the estimation process of the user's state during non-driving and the learning process of the standard state pattern, and transmits data indicating the resulting estimated state history and standard state pattern to the vehicle 12 before driving. Then, the vehicle 12 executes the remaining processes. In this case, a user collective state pattern may or may not be used for the driving diagnosis process. When using the user collective state pattern, when using the user collective state pattern, for example, the server 13 performs learning of the user collective state pattern based on the standard state pattern of each user acquired from the user terminal unit 11 of each user. Then, the server 13 transmits data indicating the user collective state pattern to the user terminal unit 11 or the vehicle 12 of each user.

[0214] In this case, the insurance premium calculation process may be performed by any of the user terminal unit 11, the vehicle 12, and the server 13. When the user terminal unit 11 or the vehicle 12 performs it, for example, an application program for performing the insurance premium calculation process is provided from the server 13. On the other hand, when the server 13 performs it, for example, data necessary for calculating the insurance premium is provided from the user terminal unit 11 and the vehicle 12 to the server 13.

[0215] Also, for example, the processing may be shared between the user terminal unit 11 and the server 13. In this case, the data from the vehicle 12 may or may not be used for the processing.

[0216] Furthermore, for example, the processing may be shared between the vehicle 12 and the server 13. In this case, for example, data necessary for the processing (such as the user's standard state pattern and the most recent state pattern, etc.) is provided from the user terminal unit 11 to the vehicle 12 and the server 13.

[0217] Also, for example, the processing may be shared among a plurality of servers. For example, the processing related to driving support and the processing related to insurance premium calculation may be performed by different servers.

[0218] Furthermore, for example, the communication between the vehicle 12 and the server 13 may be performed via the user terminal unit 11. In this case, for example, the data from the vehicle 12 is first transmitted to the user terminal unit 11 and then transferred from the user terminal unit 11 to the server 13. Also, the data from the server 13 is first transmitted to the user terminal unit 11 and then transferred from the user terminal unit 11 to the vehicle 12.

[0219] Also, for example, the communication between the user terminal unit 11 and the server 13 may be performed via the vehicle 12. In this case, for example, the data from the user terminal unit 11 is first transmitted to the vehicle 12 and then transferred from the vehicle 12 to the server 13. Also, the data from the server 13 is first transmitted to the vehicle 12 and then transferred from the vehicle 12 to the user terminal unit 11.

[0220] Furthermore, for example, instead of the estimated state history, the state data log before estimating the user's state may be directly used to perform the operation diagnosis of the diagnosis unit 154, the risk prediction of the risk prediction unit 156, and the detection of the driving behavior of the driving behavior detection unit 155. In this case, it is possible to delete the state estimation unit 152.

[0221] <Other Modification Examples> For example, in addition to the degree of deviation between the user's most recent state pattern and the standard state pattern or the user set average pattern, the driving suitability degree u may be calculated using the current state of the user. For example, even if the difference between the user's most recent state pattern and the standard state pattern is small, for example, when the user's arousal level is low, excited, or depressed, there is a high possibility of dangerous driving. Therefore, for example, among the items indicating the user's state, for the items that have a great influence on driving, the current states of those items (for example, arousal level, excitement level, depression level) may be used in the calculation of the driving suitability degree u.

[0222] Also, the state of the user to be estimated is not limited to the above-mentioned three types of biological state, behavior, and emotion. For example, only one or two of the above three types may be estimated, or other types of states may be estimated.

[0223] Furthermore, for example, the user's behavior that is normally assumed not to directly affect driving may be used in the calculation of the driving suitability degree u. For example, based on the user's purchase history, when the user shops with a tendency different from normal (for example, when making a very expensive purchase), it is assumed that the user's state (for example, emotion) is different from normal. Therefore, for example, the user's purchase history may be used in the calculation of the driving suitability degree u.

[0224] Further, for example, when calculating the driving suitability degree u, the ability of the user detected based on the state of the user when not driving, which is an ability that also affects driving, may be used. For example, the driving suitability degree u of a user with high judgment ability in daily life may be set high, and the driving suitability degree u of a user with low judgment ability may be set low.

[0225] In this case, for example, even if users with high and low judgment abilities repeat lane changes frequently in the same way, the risk predicted for a user with high judgment ability is low, and the risk predicted for a user with low judgment ability is high. However, even for a user with high judgment ability, if a risk avoidance plan is presented to reduce lane changes but the user ignores it and repeats lane changes, the compliance is evaluated as low, so the predicted risk is high.

[0226] Furthermore, for example, risk prediction may be performed based on only one or two of the estimated result of the user's state, the result of driving diagnosis, and the detected result of driving behavior. Also, for example, when risk prediction is performed using the result of driving diagnosis, only one of the driving suitability degree u before driving and the driving suitability degree u during driving may be used.

[0227] Also, for example, driving diagnosis may be performed based on only the state of the user before or during driving.

[0228] Furthermore, for example, it is possible to use the estimated state history, driving diagnosis history, and driving behavior history to investigate the cause of an accident. For example, by recording the estimated state history, driving diagnosis history, and driving behavior history in a drive recorder, it becomes possible to investigate the cause of an accident based on the state and behavior of the user (driver) at the time of the accident, as well as the state of the user before driving.

[0229] Further, for example, the user terminal unit 11 or the vehicle 12 may be configured to obtain the driving suitability degree u of another user, the prediction result of the risk, etc. from the user terminal unit 11 or the vehicle 12 of another user, or the server 13. Thereby, for example, when a dangerous vehicle driven by a user with a low driving suitability degree u exists nearby, for example, the user can avoid being involved in an accident caused by the dangerous vehicle by obtaining the information in advance.

[0230] Furthermore, the personalization of the state estimation model, the driving diagnosis model, the driving behavior detection model, and the risk prediction model is not necessarily required, and a model using a predetermined algorithm or the like may be used. Also, for example, the learning of the above models may be performed not for each user but for the entire set of users, and a common model may be used for each user.

[0231] Also, for example, based on the compliance of the user, the presentation method, presentation frequency, and presentation content of the feedback information may be changed.

[0232] <Application Example> The driving support process of the present technology can be applied not only to the vehicles exemplified above but also to various moving bodies such as motorcycles, bicycles, personal mobility devices, airplanes, ships, construction machinery, and agricultural machinery (tractors). That is, using the estimation results of the user's state before and during driving, driving diagnosis, risk prediction, damage prediction, feedback to the user, etc. can be performed. Note that the moving bodies to which the present technology can be applied include not only those that move from place to place but also moving bodies such as some construction machinery (e.g., fixed cranes) where the parts that perform operations at a fixed location move. Also, the moving bodies to which the present technology can be applied include, for example, moving bodies such as drones and robots that are remotely driven (operated) without the user boarding.

[0233] In addition to automobile insurance, the present technology can be applied to systems and devices that provide various types of insurance such as life insurance, property insurance, and medical insurance. For example, various insurance premiums (including cashback amounts) can be calculated based on the estimated state history and compliance level of the user. Specifically, for example, in the case of life insurance or medical insurance, the user terminal unit 11 or the server 13 performs state estimation processing on the user and accumulates the estimated state history. Also, the user terminal unit 11 or the server 13 presents a proposal (risk avoidance plan) to the user for avoiding risks such as illness based on the user's lifestyle and biological state based on the estimated state history, and evaluates the compliance level of the user based on the response. Then, the user terminal unit 11 or the server 13 calculates the insurance premium for life insurance or medical insurance based on the user's lifestyle, biological state, and compliance level, etc.

[0234] For example, the better the user's lifestyle and biological state, the lower the insurance premium, and the worse the user's lifestyle and biological state, the higher the insurance premium. Also, the higher the compliance level of the user, the lower the insurance premium, and the lower the compliance level of the user, the higher the insurance premium. Thus, by considering not only the user's lifestyle and biological state but also the user's compliance level, an appropriate insurance premium can be set for each user in the same way as in the case of the above-described automobile insurance.

[0235] <<3. Others>> <Configuration Example of Computer> The above-described series of processes can be executed by hardware or by software. When the series of processes are executed by software, the program constituting the software is installed in a computer. Here, the computer includes a computer incorporated in dedicated hardware, and, for example, a general-purpose personal computer that can execute various functions by installing various programs.

[0236] FIG. 11 is a block diagram showing a configuration example of the hardware of a computer that executes the above-described series of processes by a program.

[0237] In a computer, a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, and a RAM (Random Access Memory) 403 are interconnected by a bus 404.

[0238] An input / output interface 405 is further connected to the bus 404. An input unit 406, an output unit 407, a recording unit 408, a communication unit 409, and a drive 410 are connected to the input / output interface 405.

[0239] The input unit 406 includes an input switch, buttons, a microphone, an imaging device, etc. The output unit 407 includes a display, a speaker, etc. The recording unit 408 includes a hard disk, a non-volatile memory, etc. The communication unit 409 includes a network interface, etc. The drive 410 drives a removable recording medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0240] In the computer configured as described above, the CPU 401 loads and executes, for example, a program recorded in the recording unit 408 via the input / output interface 405 and the bus 404 into the RAM 403, whereby the above-described series of processes are performed.

[0241] The program executed by the computer (CPU 401) can be recorded and provided on a removable recording medium 411 as a package medium or the like. Also, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0242] In a computer, a program can be installed in the recording unit 408 via the input / output interface 405 by attaching the removable recording medium 411 to the drive 410. Also, the program can be received by the communication unit 409 via a wired or wireless transmission medium and installed in the recording unit 408. Additionally, the program can be installed in advance in the ROM 402 or the recording unit 408.

[0243] Note that the program executed by the computer may be a program whose processing is performed in time series according to the order described in this specification, or a program whose processing is performed in parallel or at a necessary timing such as when a call is made.

[0244] In this specification, a system means a collection of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device in which a plurality of modules are housed in one housing are both systems.

[0245] Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0246] For example, the present technology can take a configuration of cloud computing in which one function is shared and jointly processed by a plurality of devices via a network.

[0247] Also, each step described in the above flowchart can be executed by one device or can be shared and executed by a plurality of devices.

[0248] Furthermore, when a plurality of processes are included in one step, the plurality of processes included in that one step can be executed by one device or can be shared and executed by a plurality of devices.

[0249] <Combination example of configurations> This technology can also adopt the following configurations.

[0250] (1) A diagnosis unit that diagnoses the suitability of the user's driving based on the state of the user before driving the moving body acquired in advance and the state of the user during driving acquired during driving, and A presentation control unit that generates feedback information based on the diagnosis obtained by the diagnosis unit An information processing apparatus comprising (2) Further comprising a driving behavior detection unit that detects the driving behavior, which is the behavior of the user or the moving body during driving, and the level of dangerous driving to be detected by the driving behavior detection unit changes based on the result of the diagnosis The information processing apparatus according to (1) above. (3) The diagnosis unit further performs the diagnosis based on the detection result of the driving behavior The information processing apparatus according to (2) above. (4) The diagnosis unit diagnoses the suitability of the user's driving before driving based on the state of the user before driving, and diagnoses the suitability of the user's driving during driving based on the state of the user during driving and the detection result of the driving behavior The information processing apparatus according to (3) above. (5) Further comprising a risk prediction unit that predicts the risk related to the driving of the moving body by the user based on at least one of the result of the diagnosis and the detection result of the driving behavior The information processing apparatus according to any one of (2) to (4) above, further comprising (6) The feedback information includes the content of the risk and the basis on which the risk is predicted The information processing apparatus according to (5) above. (7) The basis for predicting the risk is based on the result of the diagnosis The information processing apparatus according to (6) above (8) The feedback information includes a risk avoidance plan The information processing apparatus according to any one of (5) to (7) above (9) The lower the fitness level of the user's driving based on the diagnosis, the lower the level of dangerous driving to be detected by the driving behavior detection unit The information processing apparatus according to any one of (2) to (8) above (10) A learning unit that performs learning of the model for performing the diagnosis based on the result of the diagnosis and the detection result of the driving behavior The information processing apparatus according to any one of (2) to (9) above, further comprising (11) The diagnosis unit performs the diagnosis based on the difference between the user's most recent state and the user's standard state The information processing apparatus according to any one of (1) to (10) above (12) The diagnosis unit further performs the diagnosis based on the difference between the user's most recent state and the average state of the users in a set of users including a plurality of users The information processing apparatus according to (11) above (13) A state estimation unit that estimates the state of the user before and during driving Further comprising The diagnosis unit performs the diagnosis based on the estimation result of the user's state The information processing apparatus according to any one of (1) to (12) above (14) The state of the user includes at least one of the user's biological state, behavior, and emotion The information processing apparatus according to (13) above (15) The diagnosis unit performs the diagnosis based on the data indicating the state of the user acquired before and during driving by the user The information processing apparatus according to any one of (1) to (12) above. (16) A diagnosis step of diagnosing the suitability of the user's driving based on the state of the user before driving a moving body acquired in advance and the state of the user during driving acquired during driving; A presentation control step of generating feedback information based on the diagnosis obtained by the diagnosis unit; An information processing method including the above. (17) A diagnosis step of diagnosing the suitability of the user's driving based on the state of the user before driving a moving body acquired in advance and the state of the user during driving acquired during driving; A presentation control step of generating feedback information based on the diagnosis obtained by the diagnosis unit; A program for causing a computer to execute a process including the above.

[0251] Note that the effects described in this specification are merely examples and are not limited, and there may be other effects.

Explanation of Signs

[0252] 10 Information processing system, 11 User terminal unit, 12 Vehicle, 13 Server, 51 Mobile terminal, 52 Wearable terminal, 61 GNSS receiver, 62 Inertial sensor, 63 Environment sensor, 64 Biosensor, 66 Output unit, 67 Control unit, 81 Biosensor, 83 Output unit, 84 Control unit, 101 In-vehicle system, 111 Vehicle data acquisition unit, 112 Video and audio acquisition unit, 114 Output unit, 115 Control unit, 152 State estimation unit, 154 Diagnosis unit, 155 Driving behavior detection unit, 156 Risk prediction unit, 157 Damage prediction unit, 158 Presentation control unit, 159 Evaluation unit, 160 Learning unit, 161 Insurance premium calculation unit

Claims

1. A driving behavior detection unit that detects driving behavior, which is the behavior of a user or a vehicle during driving; A diagnosis unit that performs a driving diagnosis based on the detection result of the driving behavior; A presentation control unit that generates feedback information based on the driving diagnosis and comprising: The driving behavior detection unit detects dangerous driving using parameters including a variable threshold, and enables adjustment of parameters including a variable threshold based on the estimated risk of dangerous driving An information processing system.

2. A driving behavior detection unit that detects driving behavior, which is the behavior of a user or a vehicle during driving; A presentation control unit that generates feedback information and comprising: The driving behavior detection unit detects dangerous driving using parameters including a variable threshold, The presentation control unit generates the feedback information including information regarding dangerous driving, and enables adjustment of parameters including a variable threshold based on the estimated risk of dangerous driving An information processing system.

3. It is possible to adjust parameters including a variable threshold based further on damage predicted to occur due to the risk of dangerous driving The information processing system according to Claim 1 or 2.

4. Obtain the risk of dangerous driving and the prediction result of damage caused by the risk of dangerous driving, and enable adjustment of parameters including a variable threshold based on the obtained prediction result The information processing system according to Claim 3.

5. A risk prediction unit that predicts the risk of dangerous driving based on the estimated state history, driving diagnosis history, and driving behavior history of the user; A damage prediction unit that predicts damage caused by the risk of dangerous driving The information processing system according to Claim 3, further comprising.

6. The presentation control unit issues a warning against dangerous driving or the possibility of dangerous driving The information processing system according to any one of Claims 1 to 5.

7. Dangerous driving includes at least one of sudden start, sudden acceleration, sudden braking, sudden steering, sudden operation, weaving driving, drowsy driving, decrease in wakefulness, decrease in concentration, distracted driving, inattention ahead, speed over, reckless overtaking, insufficient inter-vehicle distance, and approaching an obstacle The information processing system according to any one of Claims 1 to 6.

8. The variable threshold includes a threshold for detecting sudden acceleration or sudden braking The information processing system according to Claim 7.

9. The diagnosis unit performs a driving diagnosis using a driving diagnosis model that diagnoses the suitability of the user for driving a vehicle based on the estimated state history and driving behavior history of the user The information processing system according to claim 1.

10. The diagnosis unit causes the storage unit to store the driving diagnosis result together with the time when the driving diagnosis is performed. The information processing system according to claim 1 or 9.

11. The feedback information includes the driving diagnosis result. The information processing system according to claim 1, 9, or 10.

12. The feedback information includes the detection result of dangerous driving. The information processing system according to any one of claims 1 to 11.

13. The feedback information includes the content of the risk or the basis for predicting the risk. The information processing system according to any one of claims 1 to 12.

14. The feedback information includes the basis for the driving diagnosis result. The information processing system according to claim 1, 9, 10, or 11.

15. The presentation control unit generates the feedback information to be presented to the target user. The information processing system according to any one of claims 1 to 14.

16. The presentation control unit generates the feedback information in parallel for the target user and other users. The information processing system according to claim 15.

17. The presentation control unit controls the presentation of the feedback information using at least one of visual information and auditory information. The information processing system according to any one of claims 1 to 16.

18. A user terminal, and a server The information processing system according to claim 1, 9, 10, 11, or 14, comprising the above.

19. The driving diagnosis in the diagnosis unit is performed in a shared manner by the user terminal and the server. The information processing system according to claim 18.

20. The detection of the driving behavior in the driving behavior detection unit is performed in a shared manner by the user terminal and the server. The information processing system according to claim 18 or 19.

21. The user terminal acquires data related to the behavior of the user or the vehicle. The information processing system according to any one of claims 18 to 20.

22. The user terminal is a drive recorder. The information processing system according to any one of claims 18 to 21.

23. The driving behavior includes at least one of the vehicle speed, acceleration, deceleration, braking operation, steering angle, driving route, torque, yaw angle, gear state, side brake state, accelerator pedal depression amount, brake pedal depression amount, direction indicator state, light state, tire rotation angle and rotation speed, data indicating the diagnostic results of On-board Diagnostics, and sensor data of millimeter-wave radar and lidar The information processing system according to any one of claims 1 to 22

24. A parameter adjustment unit that adjusts a parameter including a variable threshold The information processing system according to any one of claims 1 to 23, further comprising

25. The parameter adjustment unit adjusts a parameter including a variable threshold so that the level of dangerous driving to be detected becomes lower as the risk of dangerous driving increases The information processing system according to claim 24

26. When the occurrence of distracted driving, inattentiveness ahead, or speeding is predicted, the parameter adjustment unit adjusts the threshold for detecting sudden acceleration or sudden braking The information processing system according to claim 24 or 25

27. When the occurrence of drowsy driving is predicted, the parameter adjustment unit adjusts the threshold for the number of blinks in drowsiness determination The information processing system according to any one of claims 24 to 26

28. The parameter adjustment unit automatically adjusts a parameter including a variable threshold The information processing system according to any one of claims 24 to 27

29. The driving behavior detection unit automatically adjusts a parameter including a variable threshold The information processing system according to any one of claims 1 to 23

30. An acquisition unit that acquires data related to the user before driving The information processing system according to any one of claims 1 to 29, further comprising

31. The data related to the user before driving includes data related to the state of the user before driving The information processing system according to claim 30

32. The data related to the state of the user before driving includes data related to the behavior or biological state of the user before driving The information processing system according to claim 31

33. A driving behavior detection unit that detects driving behavior, which is the behavior of the user or the vehicle during driving, A diagnosis unit that performs a driving diagnosis based on the detection result of the driving behavior, A presentation control unit that generates feedback information based on the driving diagnosis and comprises The driving behavior detection unit detects dangerous driving using parameters including a variable threshold value, and enables adjustment of parameters including a variable threshold value based on the estimated risk of dangerous driving information processing apparatus.

34. An information processing apparatus comprising: a driving behavior detection unit that detects a driving behavior which is the behavior of a user or a vehicle during driving; and a presentation control unit that generates feedback information. The driving behavior detection unit detects dangerous driving using parameters including a variable threshold value, and the presentation control unit generates the feedback information including information regarding dangerous driving, and enables adjustment of parameters including a variable threshold value based on the estimated risk of dangerous driving information processing apparatus.

35. A driving behavior detection unit that acquires data regarding a driving behavior which is the behavior of a user or a vehicle during driving, and detects dangerous driving using parameters including a variable threshold value based on the data regarding the driving behavior; and a presentation control unit that generates feedback information including information regarding dangerous driving. The information processing apparatus is provided with and enables adjustment of parameters including a variable threshold value based on the estimated risk of dangerous driving information processing apparatus.

36. The parameter including a variable threshold value can be further adjusted based on damage predicted to occur due to the risk of dangerous driving. The information processing apparatus according to any one of claims 33 to 35.

37. The risk of dangerous driving and the predicted result of damage caused by the risk of dangerous driving are acquired, and the parameter including a variable threshold value can be adjusted based on the acquired predicted result. The information processing apparatus according to claim 36.

38. The information processing apparatus according to claim 36, further comprising: a risk prediction unit that predicts the risk of dangerous driving based on the estimated state history, driving diagnosis history, and driving behavior history of the user; and a damage prediction unit that predicts damage caused by the risk of dangerous driving.

39. The presentation control unit issues a warning against dangerous driving or the possibility of dangerous driving. The information processing apparatus according to any one of claims 33 to 38.

40. Dangerous driving includes at least one of sudden starting, sudden acceleration, sudden braking, sudden steering, sudden operation, serpentine driving, drowsy driving, decreased wakefulness, decreased concentration, distracted driving, inattentiveness ahead, speed over, forced overtaking, insufficient inter-vehicle distance, and approaching an obstacle. The information processing apparatus according to any one of claims 33 to 39.

41. The variable threshold value includes a threshold value for detecting sudden acceleration or sudden braking. The information processing apparatus according to claim 40. ​ ​

42. The diagnosis unit performs driving diagnosis using a driving diagnosis model that diagnoses the suitability of the user's driving of the vehicle based on the estimated state history and driving behavior history of the user. The information processing apparatus according to claim 33.

43. The diagnosis unit causes the storage unit to store the driving diagnosis result together with the time when the driving diagnosis is performed. The information processing apparatus according to claim 33 or 42.

44. The feedback information includes the driving diagnosis result. The information processing apparatus according to claim 33, 42, or 43.

45. The feedback information includes the detection result of dangerous driving. The information processing apparatus according to any one of claims 33 to 44.

46. The feedback information includes the content of the risk or the basis for predicting the risk. The information processing apparatus according to any one of claims 33 to 45.

47. The feedback information includes the basis for the driving diagnosis result. The information processing apparatus according to claim 33, 42, 43, or 44.

48. The presentation control unit generates the feedback information to be presented to the target user. The information processing apparatus according to any one of claims 33 to 47.

49. The presentation control unit generates the feedback information in parallel for the target user and other users. The information processing apparatus according to claim 48.

50. The presentation control unit controls the presentation of the feedback information using at least one of visual information and auditory information. The information processing apparatus according to any one of claims 33 to 49.

51. The driving behavior includes at least one of the vehicle speed, acceleration, deceleration, brake operation, steering angle, driving route, torque, yaw angle, gear state, side brake state, accelerator pedal depression amount, brake pedal depression amount, direction indicator state, light state, tire rotation angle and rotation speed, data indicating the diagnosis result of On-board Diagnostics, and sensor data of millimeter wave radar and lidar. The information processing apparatus according to any one of claims 33 to 50.

52. Further comprising a parameter adjustment unit that adjusts a parameter including a variable threshold. The information processing apparatus according to any one of claims 33 to 51.

53. The parameter adjustment unit adjusts a parameter including a variable threshold so that the level of dangerous driving to be detected becomes lower as the risk of dangerous driving increases. The information processing apparatus according to claim 52.

54. When the occurrence of peeking driving, inattentiveness ahead, or speeding is predicted, the parameter adjustment unit adjusts a threshold value for detecting sudden acceleration or sudden braking. The information processing apparatus according to claim 52 or 53.

55. When the occurrence of drowsy driving is predicted, the parameter adjustment unit adjusts a threshold value for the number of blinks in drowsiness determination. The information processing apparatus according to any one of claims 52 to 54.

56. The parameter adjustment unit automatically adjusts a parameter including a variable threshold value. The information processing apparatus according to any one of claims 52 to 55.

57. The driving behavior detection unit automatically adjusts a parameter including a variable threshold value. The information processing apparatus according to any one of claims 33 to 51.

58. An acquisition unit that acquires data related to the user before driving The information processing apparatus according to any one of claims 33 to 57, further comprising the acquisition unit.

59. The data related to the user before driving includes data related to the state of the user before driving. The information processing apparatus according to claim 58.

60. The data related to the state of the user before driving includes data related to the behavior or biological state of the user before driving. The information processing apparatus according to claim 59.

61. An information processing system detects a driving behavior that is the behavior of the user or the vehicle during driving, performs a driving diagnosis of the user based on the detection result of the driving behavior, generates feedback information based on the driving diagnosis, detects dangerous driving using a parameter including a variable threshold value in the detection process of the driving behavior, makes it possible to adjust a parameter including a variable threshold value based on the estimated risk of dangerous driving Information processing method.

62. Detect a driving behavior that is the behavior of the user or the vehicle during driving, perform a driving diagnosis of the user based on the detection result of the driving behavior, generate feedback information based on the driving diagnosis, detect dangerous driving using a parameter including a variable threshold value in the detection process of the driving behavior, makes it possible to adjust a parameter including a variable threshold value based on the estimated risk of dangerous driving A program for causing a computer to execute the process.

Images