Driving assistance system, information processing device, method, and program

Abstract

This driving assistance system includes: an evaluation value calculation unit that calculates an evaluation value for a driving operation of a driver on the basis of at least one of driving information related to driving of a vehicle driven by the driver and a video around the vehicle; an evaluation value determination unit that determines whether or not the evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, when the evaluation value is determined to be equal to or greater than the evaluation threshold, registers, as a good driving video, the video around the vehicle corresponding to the driving operation; and a transmission unit that, when the evaluation value is determined to be less than the evaluation threshold, outputs, to a user terminal device used by the driver, a good driving video captured in a driving environment identical or similar to the driving environment of the driver and driving information corresponding to the good driving video.

Description

Driving Support System, Information Processing Apparatus, Method, and Program

[0001] The present disclosure relates to a driving support system, an information processing apparatus, a method, and a program for a vehicle.

[0002] Conventionally, various driving support technologies for vehicles have been proposed. As an example of such technology, Patent Document 1 discloses a driving support device that presents a driver with a diagnosis result of a driving tendency analyzed based on driving information of a vehicle recorded during driving. This driving support device analyzes the driving tendency and displays on a display device the actual driving video during driving recorded as driving information and the diagnosis result of the analyzed driving tendency.

[0003] Japanese Patent No. 7238035

[0004] However, in the driving support device disclosed in Patent Document 1, there is a problem that a driver of a vehicle that has traveled in a certain driving environment cannot view a video of excellent driving in the same or similar driving environment as the current driving environment and the driving information corresponding to the video of excellent driving.

[0005] One object of the present disclosure is to provide a driving support system, an information processing apparatus, a method, and a program that enable a driver of a vehicle that has traveled in a certain driving environment to view a video of excellent driving in the same or similar driving environment as the current driving environment, in view of the above-described problems.

[0006] The driving support system according to the present disclosure includes: an evaluation value calculation unit that calculates an evaluation value for a driver's driving operation based on at least one of driving information related to the driving of a vehicle driven by the driver and an image around the vehicle; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that registers an image around the vehicle corresponding to the driving operation as an excellent driving video when it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold; and a transmission unit that outputs to a user terminal device used by the driver an excellent driving video captured in the same or similar driving environment as the driver's driving environment and driving information corresponding to the excellent driving video when it is determined that the calculated evaluation value is less than the evaluation threshold.

[0007] The information processing device relating to this disclosure includes: an evaluation value calculation unit that calculates an evaluation value for a driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by a driver and video footage of the vehicle's surroundings; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, if it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold, registers video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and a transmission unit that, if it is determined that the calculated evaluation value is less than the evaluation threshold, outputs good driving video footage taken in the same or similar driving environment as the driver's driving environment and driving information corresponding to the good driving video to a user terminal device used by the driver.

[0008] The method relating to this disclosure involves a computer calculating an evaluation value for the driver's driving operations based on at least one of driving information related to the driving of the vehicle driven by the driver and video footage of the vehicle's surroundings; determining whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, registering the video footage of the vehicle's surroundings corresponding to the driving operations as good driving footage; and if the calculated evaluation value is determined to be less than the evaluation threshold, outputting good driving footage and driving information corresponding to the good driving footage, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

[0009] The program relating to this disclosure causes a computer to perform the following steps: calculate an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of the vehicle driven by the driver and video footage of the vehicle's surroundings; determine whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold, register the video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and if it is determined that the calculated evaluation value is less than the evaluation threshold, output good driving video footage taken in the same or similar driving environment as the driver's driving environment, along with driving information corresponding to the good driving video, to a user terminal device used by the driver.

[0010] This disclosure provides a driver assistance system, information processing device, method, and program that enable a driver of a vehicle that has driven in a certain driving environment to view video footage of good driving in the same or similar driving environment.

[0011] This is a schematic diagram showing an example of a driver assistance system related to this disclosure. This is a diagram showing an example of the hardware configuration of an information processing device related to this disclosure. This is a diagram showing an example of the functional configuration of an information processing device related to this disclosure. This is a diagram showing an example of a registration information table. This is a diagram showing an example of a good driving information table. This is a diagram showing an example of a warning information table. This is a diagram showing an example of the hardware configuration of a user terminal device related to this disclosure. This is a diagram showing an example of the functional configuration of a user terminal device related to this disclosure. This is a diagram showing an example of the hardware configuration of an in-vehicle device related to this disclosure. This is a diagram showing an example of the functional configuration of an in-vehicle device related to this disclosure. This is a sequence diagram showing an example of a process executed in the driver assistance system related to this disclosure. This is a sequence diagram showing another example of a process executed in the driver assistance system related to this disclosure. This is a diagram showing an example of a process executed by an information processing device related to this disclosure. This is a diagram showing an example of a process executed by an information processing device related to this disclosure. This is a diagram showing an example of a screen displayed on the display of a user terminal device related to this disclosure. This is a diagram showing another This figure shows another example of a screen displayed on the user terminal device related to this disclosure. This figure shows the main components of the driver assistance system related to this disclosure. This figure shows another example of the functional configuration of the information processing device related to this disclosure. This figure shows an example of a driving environment driving operation information table related to this disclosure. This is a sequence diagram showing another example of a process performed in the driver assistance system related to this disclosure. This is a sequence diagram showing another example of a process performed in the driver assistance system related to this disclosure. This figure shows another example of a process performed by the information processing device related to this disclosure. This figure shows another example of a screen displayed on the user terminal device related to this disclosure.This figure shows another example of the screen displayed on the user terminal device related to this disclosure. This figure shows another example of the screen displayed on the user terminal device related to this disclosure. This figure shows another example of the screen displayed on the user terminal device related to this disclosure.

[0012] <First Embodiment> Hereinafter, an exemplary embodiment will be described with reference to the drawings. Figure 1 is a schematic diagram showing an example of a driver assistance system 1 according to the present disclosure. The driver assistance system 1 includes an information processing device 10, a user terminal device 20, and an in-vehicle device 30. The driver assistance system 1 may include a plurality of user terminal devices 20 and a plurality of in-vehicle devices 30.

[0013] The information processing device 10 communicates data with the user terminal device 20 and the in-vehicle device 30 via the network 40. The network 40 may be configured to include a wide-area network such as the Internet and a narrow-area network such as a LAN (Local Area Network).

[0014] Figure 2 shows an example of the hardware configuration of the information processing device 10. Specific examples of the information processing device 10 include a server. The information processing device 10 comprises a processor 11, a communication interface (I / F) 12, a memory 13, and a storage device 14. These devices exchange data via a bus 15.

[0015] The processor 11 is a device that performs overall control of the information processing device 10. Specific examples of the processor 11 include CPUs (Central Processing Units), GPUs (Graphics Processing Units), MPUs (Micro Processing Units), and other processors. The processor 11 executes the method defined by the program by loading the program stored in the storage device 14 into the memory 13 and executing it. In other embodiments, the functions performed by the processor 11 may also be performed by integrated circuits such as FPGAs (Field-Programmable Gate Arrays) and ASICs (Application Specific Integrated Circuits). These devices are equivalent to computers.

[0016] The communication interface 12 is an interface for data communication between the information processing device 10 and other devices. The storage device 14 stores various types of data, such as programs executed by the processor 11 and data processed by the processor 11.

[0017] Figure 3 shows an example of the functional configuration of the information processing device 10. The information processing device 10 includes a receiving unit 100, a registration unit 101, an evaluation information generation unit 102, an evaluation information generation model 103, an evaluation value calculation model 104, an evaluation value determination unit 105, a video registration determination unit 106, a video determination model 107, a risk level calculation unit 108, a risk level calculation model 109, a risk level determination unit 110, a transmission destination identification unit 111, and a transmission unit 112. These functional means can be implemented by a program.

[0018] The receiving unit 100 receives various information from other devices such as the user terminal device 20 and the in-vehicle device 30.

[0019] The registration unit 101 associates the identification information of the vehicle in which the in-vehicle device 30 is installed (video ID (Identification)), the identification information of the driving information related to the driving of the vehicle (driving information ID), the identification information of the driver of the vehicle (user ID), and the identification information of the in-vehicle device 30 (in-vehicle device ID) and registers them in a registration information table as shown in Figure 4. The driving information includes, for example, the positive and negative acceleration in the longitudinal direction of the vehicle, the angular velocity of the steering, the vehicle speed, the distance between the vehicle and surrounding vehicles, and the vehicle's fuel efficiency information.

[0020] Furthermore, the registration unit 101 registers information related to excellent driving in the excellent driving information table. Figure 5 shows an example of the excellent driving information table. The excellent driving information table registers the following in association: identification information of the excellent driving video (excellent driving video ID), which is the video of the area around the vehicle in which excellent driving occurred; identification information of the excellent driving information (excellent driving information ID), which is the driving information corresponding to the excellent driving video; identification information of the evaluation information for the excellent driving (evaluation information ID); and the user ID of the driver who performed the excellent driving. In addition, the registration unit 101 registers information in the registration information table that indicates that the video indicated by the excellent driving video ID is an excellent driving video (in the example in Figure 4, "Enable").

[0021] Furthermore, the registration unit 101 registers information regarding the driving environment that requires attention from the driver in the warning information table. The driving environment is the environment in which the vehicle is driving. The driving environment includes, for example, pedestrians, the shape of the roadway on which the vehicle is driving, the width of the roadway, the number of lanes on which the vehicle is driving, the color of the traffic signals corresponding to the roadway, intersections, pedestrian crossings, traffic signs, structures around the roadway, etc.

[0022] Figure 6 shows an example of a warning information table. The warning information table registers the following information in association with each other: identification information (warning video ID) of a warning video, which is a video showing a driving environment that requires attention from the driver; identification information (warning driving information ID) of warning driving information corresponding to the warning video; and the user ID of the driver who drove the vehicle in the driving environment shown in the warning video. In addition, the registration unit 101 registers information (in the example in Figure 4, "Enable") in the registration information table indicating that the video shown by the warning video ID is a warning video.

[0023] The evaluation information generation unit 102 generates evaluation information about driving operations based on at least one of the driving information provided by the in-vehicle device 30 and the video footage of the vehicle's surroundings. Specifically, the evaluation information generation unit 102 can generate evaluation information about driving operations using the evaluation information generation model 103.

[0024] The evaluation information generation model 103 is a machine learning model that, upon receiving at least one of driving information and video footage of the vehicle's surroundings, generates and outputs evaluation information about driving operations corresponding to the driving information and / or driving environment information.

[0025] The evaluation information generation model 103 is trained to generate and output evaluation information about the driving operations indicated by the driving information when driving information is input. For example, the evaluation information generation model 103 can be trained to generate and output evaluation information for sudden braking, sudden acceleration, and sudden steering when driving information corresponding to sudden braking, sudden acceleration, and sudden steering is input. In addition, the evaluation information generation model 103 can be trained to generate and output evaluation information for driving that is fuel-efficient when driving information corresponding to such driving is input.

[0026] Furthermore, the evaluation information generation model 103 is trained to generate and output evaluation information about driving operations in relation to the driving environment indicated by the driving environment information when video footage of the vehicle's surroundings is input. For example, the evaluation information generation model 103 can be trained to generate and output evaluation information for driving operations when the vehicle immediately decelerates when the traffic light in front of the vehicle turns yellow. The evaluation information generation model 103 can also be trained to generate and output evaluation information for driving operations when the vehicle stops in front of a crosswalk when a pedestrian is waiting at the crosswalk diagonally in front of the vehicle. In addition, the evaluation information generation model 103 can be trained to generate and output evaluation information for driving operations when the vehicle enters an intersection with a stop sign without stopping.

[0027] Furthermore, the evaluation information generation unit 102 calculates an evaluation value for driving operations based on at least one of the driving information provided by the in-vehicle device 30 and the video footage of the vehicle's surroundings. Specifically, the evaluation information generation unit 102 can calculate an evaluation value for driving operations using an evaluation value calculation model 104. The evaluation value calculation model 104 corresponds to the evaluation value calculation unit.

[0028] The evaluation value calculation model 104 is a machine learning model that, when at least one of driving information and video is input, calculates and outputs an evaluation value for the driving operation corresponding to the driving information and / or video.

[0029] The evaluation value calculation model 104 can be trained using driving information. For example, the evaluation value calculation model 104 can be trained to output a lower evaluation value the larger the absolute value of the vehicle's acceleration, and a higher evaluation value the smaller the absolute value of the vehicle's acceleration. Furthermore, the evaluation value calculation model 104 can be trained to output a lower evaluation value the larger the absolute value of the vehicle's acceleration, and a higher evaluation value the smaller the absolute value of the vehicle's acceleration. In addition, when the vehicle speed is above a predetermined speed, the evaluation value calculation model 104 can be trained to output a lower evaluation value the smaller the distance between its own vehicle and surrounding vehicles, and a higher evaluation value the larger the distance between its own vehicle and surrounding vehicles.

[0030] Furthermore, the evaluation value calculation model 104 can be trained using video footage of the vehicle's surroundings. For example, the evaluation value calculation model 104 can be trained to output a lower evaluation value the greater the degree to which the image region showing the vehicle in front expands in the video, and a higher evaluation value the smaller the degree to which the image region showing the vehicle in front expands. Here, the degree to which the image region showing the vehicle in front expands indicates the degree to which the own vehicle is approaching the vehicle in front.

[0031] The evaluation value determination unit 105 makes a determination by comparing the evaluation value calculated by the evaluation information generation unit 102 with a predetermined evaluation threshold.

[0032] The video registration determination unit 106 determines whether or not a video of good driving conditions, which are the same as or similar to the driving conditions shown in the video received by the in-vehicle device 30, has been registered. Specifically, the video registration determination unit 106 can use the video determination model 107 to detect a video of good driving conditions, which are the same as or similar to the driving conditions shown in the video received by the in-vehicle device 30.

[0033] The video recognition model 107 is a machine learning model that calculates and outputs a similarity score indicating the degree of similarity of the driving environment shown by two input videos. For example, the similarity score is set in the range of 0 to 1, where "0" indicates that the two videos are dissimilar and "1" indicates that the two videos are identical. In other words, the higher the similarity score, the higher the similarity. In this case, the video recognition model 107 can be trained to output "1" when two identical videos are input. The video recognition model 107 can also be trained to output "0" when two dissimilar videos are input. Furthermore, the video recognition model 107 can be trained to output a similarity score (a value greater than "0" and less than "1") corresponding to the similarity of these videos when two similar videos are input.

[0034] Furthermore, the video registration determination unit 106 uses the video determination model 107 to determine whether or not a warning driving video of the same or similar driving environment as the video provided by the in-vehicle device 30 has been registered.

[0035] The risk calculation unit 108 calculates a risk index value for the driving environment shown in the video provided by the in-vehicle device 30, based on at least one of the video and driving information provided by the in-vehicle device 30. Specifically, the risk calculation unit 108 can calculate a risk index value for the driving environment shown in the video provided by the in-vehicle device 30 using the risk calculation model 109.

[0036] The risk level calculation model 109 is a machine learning model that, upon input of at least one of video and driving information, calculates and outputs a risk level index value for the driving environment shown in the video. The risk level calculation model 109 can be trained using video of the area around the vehicle. For example, the risk level calculation model 109 can be trained to calculate and output a risk level index value indicating a high risk if the input video includes footage of a person, such as a child, suddenly running out into the road. The risk level calculation model 109 can also be trained to calculate and output a risk level index value indicating a high risk if the input video includes footage of dangerous driving by another vehicle. Furthermore, the risk level calculation model 109 can be trained to calculate and output a risk level index value indicating a low risk if the input video does not include footage of dangerous events.

[0037] Furthermore, the risk calculation model 109 can be trained using driving information. For example, the risk calculation model 109 can be trained to calculate and output a risk index value indicating a high level of risk when the absolute value of the vehicle's negative acceleration is greater than a predetermined value, in other words, when sudden braking occurs.

[0038] The risk determination unit 110 makes a determination by comparing the risk level calculated by the risk level calculation unit 108 with a predetermined risk level threshold.

[0039] The destination identification unit 111 identifies the user terminal device to which the warning driving video and warning driving information will be sent. Specifically, the destination identification unit 111 can identify a user terminal device used by a driver who has driven in the same or similar driving environment as shown in the warning video as the destination user terminal device. More specifically, the destination identification unit 111 can use the video judgment model 107 to identify a video from among the registered videos that shows the same or similar driving environment as shown in the warning video. Then, the destination identification unit 111 can refer to the registration information table and identify the terminal device ID registered in association with the video ID of the identified video, thereby identifying the user terminal device used by the driver.

[0040] Furthermore, the destination identification unit 111 may identify a user terminal device used by a driver whose number of times driving in the same or similar driving environment as the warning video exceeds a predetermined threshold as the destination user terminal device. More specifically, the destination identification unit 111 can use the video judgment model 107 to identify videos from among the registered videos that show the same or similar driving environment as the warning video. Next, the destination identification unit 111 refers to the registration information table and identifies the user ID registered in association with the video ID of the identified video. Next, the destination identification unit 111 counts the number of video IDs of videos showing the same or similar driving environment as the warning video that are associated with each identified user ID. This number of video IDs corresponds to the number of times the driver has driven in the same or similar driving environment as the warning video. The destination identification unit 111 can identify a user terminal device used by a driver whose number of such drives exceeds a predetermined threshold as the destination user terminal device.

[0041] The transmitting unit 112 transmits various information to other devices.

[0042] Figure 7 shows an example of the hardware configuration of a user terminal device 20. Specific examples of the user terminal device 20 include information and communication devices such as smartphones and PCs (Personal Computers). The user terminal device 20 comprises a processor 21, a communication interface (I / F) 22, memory 23, a storage device 24, and a display 26. These devices exchange data via a bus 25.

[0043] The processor 21 is a device that performs overall control of the user terminal device 20. Specific examples of the processor 21 include CPUs, GPUs, MPUs, and other processors. The processor 21 executes the method defined by the program by loading the program stored in the storage device 24 into the memory 23 and executing it. In other embodiments, the functions performed by the processor 21 may also be performed by integrated circuits such as FPGAs and ASICs. These devices are equivalent to computers.

[0044] The communication interface 22 is an interface for performing data communication between the user terminal device 20 and other devices. The storage device 14 stores various data such as programs executed by the processor 21 and data processed by the processor 21. The display 26 displays various images. The display 26 corresponds to a display unit.

[0045] FIG. 8 is a diagram showing an example of the functional configuration of the user terminal device 20. The user terminal device 20 includes a reception unit 200, a reception unit 201, a display control unit 202, and a transmission unit 203. These functions can be realized by a program.

[0046] The reception unit 200 receives various instructions from the user of the user terminal device 20.

[0047] The reception unit 201 receives various information from other devices such as the information processing device 10. The display control unit 202 controls the display 26 to display various information. The transmission unit 203 transmits various information to other devices such as the information processing device 10.

[0048] FIG. 9 is a diagram showing an example of the hardware configuration of the in-vehicle device 30. Specific examples of the in-vehicle device 30 include devices such as a drive recorder. The in-vehicle device 30 includes a processor 31, a communication interface (I / F) 32, a memory 33, and a storage device 34. These devices exchange data via a bus 35.

[0049] The processor 31 is a device that performs overall control of the in-vehicle device 30. Specific examples of the processor 31 include processors such as a CPU, a GPU, and an MPU. The processor 31 loads the program stored in the storage device 34 into the memory 33 and executes it, thereby executing the method defined by the program. In other embodiments, the functions executed by the processor 31 may also be executed by an integrated circuit such as an FPGA or an ASIC. These devices correspond to a computer.

[0050] The communication interface 32 is an interface for data communication between the in-vehicle device 30 and other devices. The storage device 34 stores various data, such as programs executed by the processor 31 and data processed by the processor 31.

[0051] Figure 10 shows an example of the functional configuration of the in-vehicle device 30. The in-vehicle device 30 includes an image acquisition unit 300, a driving information acquisition unit 301, and a transmission unit 302. These functions can be implemented by a program.

[0052] The video acquisition unit 300 acquires video footage including images of the surroundings of the vehicle on which the in-vehicle device 30 is installed. The video footage is generated by the camera installed on the in-vehicle device 30.

[0053] The driving information acquisition unit 301 acquires driving information from various detection sensors installed in the vehicle. The driving information acquisition unit 301 can acquire from the detection sensors positive and negative acceleration in the longitudinal direction of the vehicle, steering angular velocity, vehicle speed, distance between the vehicle and surrounding vehicles, and information used to calculate fuel efficiency. Information used to calculate fuel efficiency includes, for example, fuel consumption, distance traveled, and wheel rotation speed.

[0054] The transmitting unit 302 transmits various information to the information processing device 10. The information transmitted by the transmitting unit 302 includes video acquired by the video acquisition unit 300, driving information acquired by the driving information acquisition unit 301, a user ID that identifies the driver of the vehicle in which the in-vehicle device 30 is installed, and the in-vehicle device ID of the in-vehicle device 30.

[0055] Figure 11 is a sequence diagram showing an example of processing performed in the driver assistance system 1. In step S1, the video acquisition unit 300 of the in-vehicle device 30 acquires video, including images of the surroundings of the vehicle on which the in-vehicle device 30 is installed. In step S2, the driving information acquisition unit 301 of the in-vehicle device 30 acquires driving information from detection sensors installed in the vehicle. In step S3, the transmission unit 302 of the in-vehicle device 30 transmits the video acquired by the video acquisition unit 300 and the driving information acquired by the driving information acquisition unit 301 to the information processing device 10, along with the user ID of the driver operating the vehicle on which the in-vehicle device 30 is installed and the in-vehicle device ID.

[0056] When the information processing device 10 receives video, driving information, user ID, and in-vehicle device ID transmitted by the in-vehicle device 30, the registration unit 101 of the information processing device 10 executes a registration process in step S4. In this registration process, the registration unit 101 of the information processing device 10 associates and registers the video ID, which is the identification information of the received video, the driving information ID, which is the identification information of the driving information, the user ID, and the in-vehicle device ID. The registration unit 101 of the information processing device 10 also stores the received video and driving information.

[0057] In step S5, the information processing device 10 executes the processes shown in Figures 13 and 14. If it is determined that the evaluation value for the driving operation calculated in the process of Figure 13 is less than or equal to a predetermined second evaluation threshold, in step S6, the transmission unit 112 of the information processing device 10 transmits evaluation information, including excellent driving video in the same or similar driving environment as the video received by the information processing device 10, excellent driving information corresponding to the excellent driving video, and the evaluation value calculated in the process of Figure 13, to the user terminal device 20 used by the driver of the vehicle in which the in-vehicle device 30 is installed. Here, the user terminal device 20 to which the evaluation information and video are transmitted can be identified by the terminal device ID registered in association with the received user ID.

[0058] When the user terminal device 20 receives the evaluation information and video transmitted by the information processing device 10, in step S7, the display control unit 202 of the user terminal device 20 displays the excellent driving video, excellent driving information, and evaluation information on the display 26 of the user terminal device 20.

[0059] Figure 12 is a sequence diagram showing another example of the process performed in the driver assistance system 1. Steps S1 to S5 are the same as steps S1 to S5 in Figure 11. If a warning video and warning information are registered in the process of Figure 14, in step S8 the transmission unit 112 of the information processing device 10 transmits the registered warning video and warning information to the user terminal device 20, which was identified as the destination in the process of Figure 14.

[0060] When the user terminal device 20 receives the warning video and warning information transmitted by the information processing device 10, in step S9, the display control unit 202 of the user terminal device 20 displays the warning video and warning information on the display 26 of the user terminal device 20.

[0061] Figures 13 and 14 show examples of processes performed by the information processing device 10. The processes shown in Figures 13 and 14 are executed when the information processing device 10 receives video, driving information, user ID, and evaluation information ID from the in-vehicle device 30.

[0062] In step S10, the risk calculation unit 108 calculates a risk index value for the driving environment shown in the video based on at least one of the received video and driving information. In step S11, the risk determination unit 110 determines whether the risk index value calculated in step S10 is equal to or greater than a predetermined risk threshold. If it is determined that the calculated risk index value is less than the predetermined risk threshold (NO), the process branches to step S12.

[0063] In step S12, the evaluation information generation unit 102 calculates evaluation information, including an evaluation value for the driving operation, based on at least one of the received driving information and video. In step S13, the evaluation value determination unit 105 determines whether the evaluation value calculated in step S12 is equal to or greater than a first evaluation threshold. If it is determined that the evaluation value is equal to or greater than the first evaluation threshold (YES), the process branches back to step S12.

[0064] In step S14, the transmission unit 112 transmits the received video and driving information, along with evaluation information including the evaluation value calculated in step S12, to the user terminal device 20, which is identified by the received user ID.

[0065] In step S15, the video registration determination unit 106 determines whether or not a video of excellent driving in a driving environment identical or similar to the driving environment shown in the received video is registered. If it is determined that no video of excellent driving in a driving environment identical or similar is registered (NO), the process branches to step S17. On the other hand, if it is determined that a video of excellent driving in a driving environment identical or similar is registered (YES), the process branches to step S16.

[0066] In step S16, the evaluation value determination unit 105 determines whether the evaluation value calculated in step S12 is greater than the evaluation value registered in association with the excellent driving video that was determined to be registered in step S15. If it is determined that the calculated evaluation value is less than or equal to the evaluation value registered in association with the excellent driving video (NO), the process shown in Figure 13 ends. On the other hand, if it is determined that the calculated evaluation value is greater than the evaluation value registered in association with the excellent driving video (YES), the process branches to step S17.

[0067] In step S17, the registration unit 101 registers the received video and driving information as excellent driving video and excellent driving information, and the process shown in Figure 13 is completed. Here, the registration unit 101 registers the user ID and evaluation information ID received along with the received video and driving information, associating them with the video and driving information.

[0068] In step S13, if it is determined that the evaluation value calculated in step S12 is less than the first evaluation threshold (NO), the process branches to step S18. In step S18, the evaluation value determination unit 105 determines whether the evaluation value calculated in step S12 is less than or equal to a second evaluation threshold which is smaller than the first evaluation threshold. If it is determined that the calculated evaluation value exceeds the second evaluation threshold (NO), the process shown in Figure 13 ends. On the other hand, if it is determined that the calculated evaluation value is less than or equal to the second evaluation threshold (YES), the process branches to step S19.

[0069] In step S19, the video registration determination unit 106 determines whether or not a video of excellent driving conditions shown in the same or similar driving conditions as the video received has been registered. If it is determined that no video of excellent driving conditions shown in the same or similar driving conditions has been registered (NO), the process shown in Figure 13 ends. On the other hand, if it is determined that a video of excellent driving conditions shown in the same or similar driving conditions has been registered (YES), the process branches to step S20.

[0070] In step S21, the transmission unit 112 transmits the excellent driving video and excellent driving information, which are determined to be the same or similar driving environment that was registered in step S19, along with evaluation information including the evaluation value calculated in step S12, to the user terminal device 20 associated with the in-vehicle device 30 that transmitted the video and driving information, and the process shown in Figure 13 is completed.

[0071] In step S11, if it is determined that the calculated risk level is equal to or greater than the risk level threshold (YES), the process branches to step S21. In step S21, the evaluation information generation unit 102 calculates an evaluation value for the driving operation based on at least one of the received driving information and video. In step S22, the evaluation value determination unit 105 determines whether the evaluation value calculated in step S21 is equal to or greater than the first evaluation threshold. If it is determined that the evaluation value is less than the predetermined registration condition threshold (NO), the process shown in Figure 14 ends. On the other hand, if it is determined that the evaluation value is equal to or greater than the predetermined registration condition threshold (YES), the process branches to step S23.

[0072] In step S23, the video registration determination unit 106 determines whether or not a warning driving video for the same or similar driving environment as the one shown in the received video is registered. If it is determined that no warning driving video for the same or similar driving environment is registered (NO), the process branches to step S25. On the other hand, if it is determined that a warning driving video for the same or similar driving environment is registered (YES), the process branches to step S24.

[0073] In step S24, the evaluation value determination unit 105 determines whether the evaluation value calculated in step S21 is greater than the evaluation value registered in association with the cautionary driving video that was determined to be registered in step S23. If it is determined that the calculated evaluation value is less than or equal to the evaluation value registered in association with the cautionary driving video (NO), the process shown in Figure 14 ends. On the other hand, if it is determined that the calculated evaluation value is greater than the evaluation value registered in association with the cautionary driving video (YES), the process branches to step S25.

[0074] In step S25, the registration unit 101 registers the received video and driving information as a cautionary driving video and cautionary driving information, and the process shown in Figure 14 is completed. Here, the registration unit 101 registers the user ID received along with the received video and driving information, associating it with the video and driving information.

[0075] In step S26, the destination identification unit 111 identifies the user terminal device to which the warning driving video and warning driving information will be sent.

[0076] In step S27, the transmission unit 112 transmits the warning driving video and warning driving information registered in step S25 to the user terminal device identified in step S26, and the process shown in Figure 14 is completed.

[0077] Figure 15 shows an example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 15 is an image that displays a driving video 1500, driving environment information 1501 indicated by the driving video, driving information 1502, 1503, 1504 corresponding to the driving video, and evaluation information 1505, 1506 about the driving operation. This image is displayed on the user terminal device 20 of the driver who performed the driving when the evaluation value for the driving operation is equal to or greater than a first evaluation threshold. Driving information 1503 indicates the speed of the vehicle corresponding to the driving video. Driving information 1504 indicates the acceleration of the vehicle corresponding to the driving video. Image object 1507 is an object for saving the screen shown in Figure 15. When the user selects image object 1507, the user terminal device 20 can save the image to the storage device 24 of the user terminal device 20. In addition, the background of the screen shown in Figure 15 can be displayed in a color assigned to driving operations with an evaluation value equal to or greater than the first evaluation threshold, for example, green.

[0078] Figure 16 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 16 is for obtaining the user's consent when registering good driving videos. If the user consents to register the good driving videos, the user terminal device 20 sends a notification to that effect to the information processing device 10. When the information processing device 10 receives a notification that the user has consented to register the good driving videos, it can register the good driving videos.

[0079] Figure 17 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 17 is an image that displays a driving video 1700, driving environment information 1701 shown by the driving video, driving information 1702 corresponding to the driving video, and evaluation information 1603 about the driving operation. This image is displayed on the user terminal device 20 of the driver who performed the driving operation when the evaluation value for the driving operation is less than or equal to the second evaluation threshold. The image object 1704 is an object for saving the screen shown in Figure 17. In addition, the background of the screen shown in Figure 17 can be displayed in a color assigned to driving operations with an evaluation value of less than or equal to the second evaluation threshold, for example, red. This color is different from the color assigned to driving operations with an evaluation value of greater than or equal to the first evaluation threshold.

[0080] Figure 18 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 18 is an image that displays a driving video 1800, driving environment information 1801 shown by the driving video, driving information 1802 corresponding to the driving video, and evaluation information 1803 about the driving operation. This image is displayed on the user terminal device 20 of the driver who performed the driving operation if the evaluation value for the driving operation is below the second evaluation threshold. The image object 1804 is an object for saving the screen shown in Figure 18. The background of the screen shown in Figure 18 can also be displayed in a color assigned to driving operations whose evaluation value is below the second evaluation threshold, for example, red.

[0081] Figure 19 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 19 is an image that displays a video of excellent driving 1900, driving environment information 1901 shown in the video of excellent driving, driving information 1902 corresponding to the video of excellent driving, evaluation information 1903 about the driving operation, and the benefits 1904 of the excellent driving. This image is displayed on the user terminal device 20 of drivers other than the driver who performed the excellent driving. The image object 1905 is an object for saving the screen shown in Figure 19. The background of the screen shown in Figure 19 can be displayed in a color assigned to excellent driving, such as blue. This color is different from the color assigned to driving operations with an evaluation value of 1 or higher than the first evaluation threshold and the color assigned to driving operations with an evaluation value of 2 or lower than the second evaluation threshold.

[0082] Figure 20 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 20 is an image that displays driving video 2000, driving video 2001, and evaluation information 2002 and 2003 for driving operations corresponding to these driving videos. Image object 1804 is an object for saving the screen shown in Figure 18. This image is displayed on the user terminal device 20 of the driver who performed the driving. Driving video 2000 and driving video 2001 are driving videos of the same driver in the same or similar driving environment. The information processing device 10 may generate evaluation information for the driving operations of the same driver based on the video of the same or similar driving environment of the same driver and the driving information. The background of driving video 2000 can be displayed in a color assigned to driving operations whose evaluation value is equal to or greater than a first evaluation threshold. The background of driving video 2001 can be displayed in a color assigned to driving operations whose evaluation value is equal to or less than a second evaluation threshold.

[0083] Figure 21 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 21 is an example of a screen for searching for video and driving information stored by the information processing device 10. The screen shown in Figure 21 displays the user's driving video 2100 and evaluation information 2101 about the driving operation corresponding to the driving video. The screen shown in Figure 21 also displays videos 2102 and 2103 stored by the information processing device 10, along with the corresponding driving information. The image object 2104 is a field for searching for video and driving information stored by the information processing device 10. When a string representing the driving environment or a string representing driving information is entered into this field, the user terminal device 20 transmits the entered string to the information processing device 10. The information processing device 10 extracts video and driving information of good driving in the driving environment indicated by the string from the video and driving information stored by the information processing device 10 and transmits it to the user terminal device 20.

[0084] Figure 22 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 22 is another example of a screen for searching for video and driving information stored by the information processing device 10. The screen shown in Figure 22 displays the user's driving video 2200 and evaluation information 2201 for the driving operation corresponding to the driving video, the user's driving video 2202 and evaluation information 2203 for the driving operation corresponding to the driving video. In addition, the screen shown in Figure 22 displays videos 2205 to 2208 stored by the information processing device 10, along with the corresponding driving information. Image object 2204 is a field similar to image object 2104 in Figure 21.

[0085] Figure 23 shows the main components of the driver assistance system 1. The driver assistance system 1 includes a registration unit 101, an evaluation information generation unit 102, an evaluation value determination unit 105, and a transmission unit 112. The evaluation information generation unit 102 calculates an evaluation value for the driver's driving operations based on at least one of driving information related to the driving of the vehicle driven by the driver and video footage of the vehicle's surroundings. The evaluation value determination unit 105 determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold. If the registration unit 101 determines that the calculated evaluation value is equal to or greater than the evaluation threshold, it registers the video footage of the vehicle's surroundings corresponding to the driving operations as excellent driving video. If the transmission unit 112 determines that the calculated evaluation value is less than the evaluation threshold, it outputs the excellent driving video to a user terminal device 20 used by the driver of a vehicle that has driven in the same or similar driving environment as the driving environment shown in the excellent driving video.

[0086] By adopting this configuration, a driver of a vehicle that has driven in a certain driving environment can review video footage of excellent driving in the same or similar driving environment.

[0087] Furthermore, the transmission unit 112 outputs driving information corresponding to the excellent driving video, along with the excellent driving video, to the user terminal device 20. This allows the user to check the driving information corresponding to the excellent driving video.

[0088] Furthermore, the transmission unit 112 outputs to the user terminal device, along with the excellent driving video, the advantages of the driving indicated by the driving information corresponding to the excellent driving video. This allows the user to understand the advantages of the driving information corresponding to the excellent driving video.

[0089] Furthermore, the evaluation information generation unit 102 generates evaluation information about the driver's driving operations based on at least one of the driving information related to the vehicle's operation and the video footage of the vehicle's surroundings. The transmission unit 112 outputs the evaluation information to the user terminal device 20. This allows the user to check the evaluation information about the driver's driving operations.

[0090] Furthermore, the transmission unit 112 outputs the evaluation information, along with the corresponding driving information, to the user terminal device 20. The driving information includes at least one of the vehicle's speed and acceleration. This allows the user to check the driving information, such as the vehicle's speed and acceleration.

[0091] Furthermore, the risk calculation unit 108 calculates a risk index value for the driving environment in which the vehicle traveled, based on at least one of the vehicle's driving information and the video of the vehicle's surroundings. The risk determination unit 110 determines whether the calculated risk index value is equal to or greater than a predetermined risk threshold. If it is determined that the calculated risk index value is equal to or greater than the risk threshold, the registration unit 101 registers the video showing the driving environment in which the risk index value was calculated as a warning video. The transmission unit 112 outputs the warning video to a user terminal device 20 used by the driver of a vehicle that has traveled in the same or similar driving environment as the one shown in the warning video.

[0092] By adopting this configuration, drivers of vehicles traveling in the same or similar driving conditions as those shown in the warning video can view the warning video.

[0093] In the embodiment described above, the functions of the information processing device 10 are realized by a single device, but in other embodiments, the functions of the information processing device 10 may be distributed and realized by multiple devices.

[0094] <Second Embodiment>

[0095] Figure 24 shows another example of the functional configuration of the information processing device 10. In addition to the functions shown in Figure 3, the information processing device 10 includes a driving environment information generation unit 113, a driving environment information generation unit model 114, a driving environment information identification unit 115, a driving environment information determination unit 116, a driving operation information generation unit 117, a driving operation information generation model 118, a driving operation information identification unit 119, and a driving operation determination unit 120. These functional means can be implemented by a program.

[0096] The driving environment information generation unit 113 generates driving environment information that represents the driving environment shown in the video footage of the vehicle's surroundings provided by the in-vehicle device 30. The driving environment information includes, for example, information indicating pedestrians, information indicating the shape of the roadway on which the vehicle is traveling, information indicating the width of the roadway, information indicating the number of lanes on which the vehicle is traveling, information indicating the color of the traffic signals corresponding to the roadway, information indicating intersections, information indicating pedestrian crossings, information indicating traffic signs, and information indicating structures around the roadway. Specifically, the risk level calculation unit 108 can generate driving environment information that represents the driving environment shown in the video footage provided by the in-vehicle device 30 using the driving environment information generation unit model 114.

[0097] The driving environment information generation unit model 114 is a machine learning model that generates and outputs driving environment information that represents the driving environment shown in the input video. The driving environment information generation unit model 114 can be trained using video of the vehicle's surroundings. For example, the driving environment information generation unit model 114 can be trained to calculate and output driving environment information shown in the input video.

[0098] The driving environment information identification unit 115 refers to the driving environment driving operation information table and identifies the driving environment information ID registered in association with the user ID or on-board device ID provided by the on-board device 30. Figure 25 shows an example of the driving environment driving operation information table.

[0099] The driving environment information determination unit 116 determines whether the driving environment information generated by the driving environment information generation unit 113 matches the driving environment information indicated by the driving environment information ID identified by the driving environment information identification unit 115.

[0100] The driving operation information generation unit 117 generates driving operation information, which is information related to driving operations, based on at least one of the video of the vehicle's surroundings and driving information provided by the in-vehicle device 30. Specifically, the driving operation information generation unit 117 can generate driving operation information using the driving operation information generation model 118.

[0101] The driving operation information generation model 118 is a machine learning model that, upon receiving at least one of video footage of the vehicle's surroundings and driving information, generates and outputs driving operation information corresponding to the video footage and driving information. The driving operation information generation model 118 can be trained using video footage of the vehicle's surroundings. For example, if the input video footage represents a predetermined driving operation, such as a gentle start, gentle deceleration, sudden acceleration, sudden braking, or sudden steering, the driving operation information generation model 118 can be trained to generate and output driving operation information indicating these operations.

[0102] Furthermore, the driving operation information generation model 118 can be trained using driving information. For example, if the input driving information indicates a predetermined driving operation, such as a gentle start, gentle deceleration, sudden start, sudden braking, or sudden steering, the driving operation information generation model 118 can be trained to generate and output driving operation information indicating these operations.

[0103] The driving operation information identification unit 119 refers to the driving environment driving operation information table and identifies the driving operation information ID that is registered in association with the user ID or on-board device ID provided by the on-board device 30.

[0104] The driving operation determination unit 120 determines whether the driving operation indicated by the driving operation information provided by the in-vehicle device 30 matches the driving operation indicated by the driving operation information identified by the driving operation information ID identified by the driving operation information identification unit 119.

[0105] Figure 26 is a sequence diagram showing another example of the processing performed in the driver assistance system 1. In step S30, the reception unit 200 of the user terminal device 20 receives the driving environment information and driving operation information specified or entered by the user of the user terminal device 20. The driving environment information and driving operation information can be entered by the user of the user terminal device 20 themselves.

[0106] In other embodiments, the user terminal device 20 may present driving environment information and driving operation information to the user of the user terminal device 20. In this case, the user terminal device 20 may display driving operations with low ratings based on past evaluation results of the user's driving operations. The user terminal device 20 may also present driving operation information of other users in the same or similar driving environment. In this case, the information processing device 10 can provide the user terminal device 20 with driving operation information of other users in the same or similar driving environment, in accordance with the user terminal device 20's request.

[0107] In step S31, the transmission unit 112 of the user terminal device 20 transmits the driving environment information and driving operation information received in step S30, along with the terminal device ID of the user terminal device 20 and the user ID of the user, to the information processing device 10.

[0108] When the information processing device 10 receives the driving environment information, driving operation information, user ID, and terminal device ID transmitted by the user terminal device 20, in step S32, the registration unit 101 of the information processing device 10 associates the driving environment information ID of the driving environment information, the driving operation information ID of the driving operation information, the user ID, and the terminal device ID, registers them in the driving environment driving operation information table, and saves the driving environment information and the driving operation information.

[0109] Figure 27 is a sequence diagram showing another example of processing performed in the driver assistance system 1. In step S40, the video acquisition unit 300 of the in-vehicle device 30 acquires video including images of the surroundings of the vehicle on which the in-vehicle device 30 is installed. In step S41, the driving information acquisition unit 301 of the in-vehicle device 30 acquires driving information from detection sensors installed in the vehicle. In step S42, the transmission unit 302 of the in-vehicle device 30 transmits the video acquired by the video acquisition unit 300 and the driving information acquired by the driving information acquisition unit 301 to the information processing device 10, along with the user ID of the driver operating the vehicle on which the in-vehicle device 30 is installed and the in-vehicle device ID.

[0110] When the information processing device 10 receives the video, driving information, user ID, and in-vehicle device ID transmitted by the in-vehicle device 30, it executes the process shown in Figure 28 in step S43. In step S44, the transmission unit 112 of the information processing device 10 transmits the evaluation information generated in step S43 and the received video to the user terminal device 20 used by the driver of the vehicle in which the in-vehicle device 30 is installed. Here, the user terminal device 20 to which the evaluation information and video are transmitted can be identified by the terminal device ID registered in association with the received user ID.

[0111] When the user terminal device 20 receives the evaluation information and video transmitted by the information processing device 10, in step S45, the display control unit 202 of the user terminal device 20 displays the evaluation information and video on the display 26 of the user terminal device 20.

[0112] Figure 28 shows another example of processing performed by the information processing device 10. The processing shown in Figure 28 is performed when the information processing device 10 receives video, driving information, user ID, and in-vehicle device ID from the in-vehicle device 30.

[0113] In step S50, the driving environment information generation unit 113 of the information processing device 10 generates driving environment information indicating the driving environment represented by the received video, based on the video. In step S51, the driving environment information identification unit 115 identifies the driving environment information ID registered in association with the received user ID. In step S52, the driving environment information determination unit 116 determines whether the driving environment information generated in step S51 matches the driving environment information indicated by the driving environment information ID identified in step S51. If it is determined that these driving environment information do not match (NO), the process shown in Figure 28 ends. On the other hand, if it is determined that these driving environment information do match (YES), the process branches to step S53.

[0114] In step S53, the driving operation information generation unit 117 generates driving operation information based on at least one of the received video and driving information, as does the driving environment information generation unit 113 of the information processing device 10. In step S54, the driving operation information identification unit 119 identifies the driving operation information ID registered in association with the received user ID. In step S55, the driving operation determination unit 120 determines whether the driving operation indicated by the driving operation information generated in step S53 matches the driving operation indicated by the driving operation information identified by the driving operation information ID identified in step S54. If it is determined that these driving operations match (YES), the process branches to step S56. On the other hand, if it is determined that these driving operations do not match (NO), the process branches to step S57.

[0115] In step S56, the evaluation information generation unit 102 generates evaluation information that includes an evaluation result indicating that the driving operation indicated by the received driving operation information matches the driving operation indicated by the driving operation information ID identified in step S54, and the process shown in Figure 28 is completed.

[0116] In step S57, the evaluation information generation unit 102 generates evaluation information that includes an evaluation result indicating that the driving operation indicated by the received driving operation information does not match the driving operation indicated by the driving operation information identified by the driving operation information ID specified in step S54, and the process shown in Figure 28 ends.

[0117] Figure 29 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 29 is for the user to input and register driving environment information and driving operation information. The screen shown in Figure 29 displays a field 2900 for inputting driving environment information, a field 2901 for inputting driving operation information, and image objects 2902 and 2903 for registering driving environment information and driving operation information.

[0118] When the image object 2902 is selected with driving environment information and driving operation information entered in fields 2900 and 2901, respectively, the user terminal device 20 transmits the entered driving environment information and driving operation information to the information processing device 10. Upon receiving the driving environment information and driving operation information from the user terminal device 20, the information processing device 10 saves this information and updates the driving environment and driving operation information table.

[0119] Furthermore, when image object 2903 is selected with driving environment information and driving operation information entered in fields 2900 and 2901, respectively, the user terminal device 20 displays the image shown in Figure 31. This image is intended to notify the user of the reasons and benefits of performing the driving operation indicated by the driving operation information entered in field 2901. Field 3100 of the image shown in Figure 31 displays the reasons and benefits of performing the driving operation. When image object 3101 included in the image shown in Figure 31 is selected, the user terminal device 20 can display a predetermined website, such as the website "10 Recommendations for Eco-Driving" provided by the Ministry of the Environment.

[0120] Figure 30 shows another example of a screen displayed on the display 26 of the user terminal device 20. The screen shown in Figure 30, like the screen shown in Figure 29, is for the user to input and register driving environment information and driving operation information. The screen shown in Figure 30 displays a field 2900 for inputting driving environment information, a field 3001 for inputting driving operation information, and image objects 3002 and 3003 for registering driving environment information and driving operation information.

[0121] Furthermore, when image object 3003 is selected with driving environment information and driving operation information entered in fields 3000 and 3001, respectively, the user terminal device 20 displays the image shown in Figure 32. Similar to the image in Figure 31, this image is intended to notify the user of the reasons and advantages of performing the driving operation indicated by the driving operation information entered in field 3001. The field 3200 of the image shown in Figure 32 displays the reasons and advantages of performing the driving operation. When image object 3201 included in the image shown in Figure 32 is selected, the user terminal device 20 can display a predetermined website.

[0122] In the second embodiment, the driving environment information determination unit 116 determines whether the information indicating the driving environment shown in the video of the vehicle's surroundings matches the predetermined driving environment information that has been registered in advance. If it is determined that the information indicating the driving environment shown in the video of the vehicle's surroundings matches the predetermined driving environment information, the driving operation determination unit 120 determines whether the driving operation indicated by the vehicle's driving information matches the driving operation indicated by the predetermined driving information that has been registered in advance. The transmission unit 112 outputs the determination result from the driving operation determination unit 120 to the user terminal device 20 used by the driver. This allows the driver to confirm the determination result based on the driving operation indicated by the vehicle's driving information and the driving operation indicated by the predetermined driving information.

[0123] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disk (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals.

[0124] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0125] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments, rather than being associated with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps described in any of the drawings may be changed as appropriate.

[0126] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) A driving support system comprising: an evaluation value calculation unit that calculates an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by a driver and video footage of the vehicle's surroundings; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, if it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold, registers video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and a transmission unit that, if it is determined that the calculated evaluation value is less than the evaluation threshold, outputs the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver. (Note 2) The driving support system according to Note 1, wherein the transmission unit outputs the good driving video and driving information corresponding to the good driving video to the user terminal device. (Note 3) The driving support system according to Note 2, wherein the transmitting unit outputs to the user terminal device the advantages of driving indicated by the driving information corresponding to the excellent driving video, along with the excellent driving video. (Note 4) The driving support system according to any one of Notes 1 to 3, comprising an evaluation information generation unit that generates evaluation information about the driver's driving operations based on at least one of the driving information relating to the operation of the vehicle and the video of the area around the vehicle, wherein the transmitting unit outputs the evaluation information to the user terminal device. (Note 5) The driving support system according to Note 4, wherein the transmitting unit outputs to the user terminal device the driving information corresponding to the evaluation information, along with the evaluation information, and the driving information includes at least one of the vehicle's speed and acceleration.(Note 6) A driving support system according to any one of Notes 1 to 3, comprising: a risk calculation unit that calculates a risk index value of the driving environment in which the vehicle has driven based on at least one of the driving information of the vehicle and video footage of the area around the vehicle; a risk determination unit that determines whether the calculated risk index value is equal to or greater than a predetermined risk threshold; a registration unit that, if it is determined that the calculated risk index value is equal to or greater than the risk threshold, registers video footage showing the driving environment in which the risk index value was calculated as a warning video; and a transmission unit that outputs the warning video to a user terminal device used by a driver of a vehicle that has driven in the same or similar driving environment as the driving environment shown in the warning video. (Note 7) A driving support system according to any one of Notes 1 to 3, comprising: a driving environment information determination unit that determines whether information indicating the driving environment shown in the video of the vehicle's surroundings matches predetermined driving environment information that has been registered in advance; and a driving operation determination unit that, if it is determined that the information indicating the driving environment shown in the video of the vehicle's surroundings matches the predetermined driving environment information, determines whether the driving operation indicated by the vehicle's driving information matches the driving operation indicated by predetermined driving information that has been registered in advance, wherein the transmission unit outputs the determination result by the driving operation determination unit to a user terminal device used by the driver. (Note 8) An information processing device comprising: an evaluation value calculation unit that calculates an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, if it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold, registers video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and a transmission unit that, if it is determined that the calculated evaluation value is less than the evaluation threshold, outputs the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.(Note 9) A method comprising: a computer calculating an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; determining whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, registering the video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and if the calculated evaluation value is determined to be less than the evaluation threshold, outputting the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver. (Note 10) A program that causes a computer to perform the following steps: calculate an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; determine whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, register the video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and if the calculated evaluation value is determined to be less than the evaluation threshold, output the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

[0127] Some or all of the elements described in Appendices 2 to 7, which are dependent on Appendice 1, may also be dependent on Appendices 8 to 10 in the same manner as those described in Appendices 2 to 7. Some or all of the elements described in any appendice may be applied to various hardware, software, recording means, systems, and methods for recording software.

[0128] This application claims priority based on Japanese Patent Application No. 2025-8999, filed on 22 January 2025, and incorporates all of its disclosures herein.

[0129] 1: Driving support system 10: Information processing device 11: Processor 12: Communication interface 13: Memory 14: Storage device 15: Bus 100: Receiving unit 101: Registration unit 102: Evaluation information generation unit 103: Evaluation information generation model 104: Evaluation value calculation model, evaluation value calculation unit 105: Evaluation value determination unit 106: Video registration determination unit 107: Video determination model 108: Risk level calculation unit 109: Risk level calculation model 110: Risk level determination unit 111: Transmission destination identification unit 112: Transmission unit 113: Driving environment information generation unit 114: Driving environment information generation unit model 115: Driving environment information identification unit 116: Driving environment information determination unit 117: Driving operation information generation unit 118: Driving operation information generation model 119 : Driving operation information identification unit 120 : Driving operation determination unit 20 : User terminal device 21 : Processor 22 : Communication interface 23 : Memory 24 : Storage device 25 : Bus 26 : Display 200 : Reception unit 201 : Receiving unit 202 : Display control unit 203 : Transmission unit 30 : On-board device 31 : Processor 32 : Communication interface 33 : Memory 34 : Storage device 35 : Bus 300 : Video acquisition unit 301 : Driving information acquisition unit 302 : Transmission unit 40 : Network 1500 : Driving video 1501 : Driving environment information 1502 : Driving information 1503 : Driving information 1504 : Driving information 1505 : Evaluation information 1506 : Evaluation information 1507 : Image object 1603 : Evaluation Information 1700 : Driving Video 1701 : Driving Environment Information 1702 : Driving Information 1704 : Image Object 1800 : Driving Video 1801 : Driving Environment Information 1802 : Driving Information 1803 : Evaluation Information 1804 : Image Object 1900 : Excellent Driving Video 1901 : Driving Environment Information 1902 : Driving Information 1903 : Evaluation Information 1904 : Advantages 1905 : Image Object 2000 : Driving Video 2001 : Driving Video 2002 : Evaluation Information 2003 : Evaluation Information 2100 : Driving Video2101: Evaluation Information 2102: Video 2103: Video 2104: Image Object 2200: Driving Video 2201: Evaluation Information 2202: Driving Video 2203: Evaluation Information 2204: Image Object 2205: Video 2206: Video 2207: Video 2208: Video 2900: Field 2901: Field 2902: Image Object 3001: Field 3002: Image Object

Claims

1. A driving support system comprising: an evaluation value calculation unit that calculates an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, registers video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and a transmission unit that, if the calculated evaluation value is determined to be less than the evaluation threshold, outputs the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

2. The driving support system according to claim 1, wherein the transmitting unit outputs driving information corresponding to the excellent driving video, along with the excellent driving video, to the user terminal device.

3. The driving support system according to claim 2, wherein the transmitting unit outputs to the user terminal device, along with the excellent driving video, the advantages of the driving indicated by the driving information corresponding to the excellent driving video.

4. A driving support system according to any one of claims 1 to 3, comprising an evaluation information generation unit that generates evaluation information about the driver's driving operations based on at least one of driving information relating to the operation of the vehicle and video footage of the area around the vehicle, wherein the transmission unit outputs the evaluation information to the user terminal device.

5. The driving support system according to claim 4, wherein the transmitting unit outputs driving information corresponding to the evaluation information, along with the evaluation information, to the user terminal device, and the driving information includes at least one of the vehicle's speed and acceleration.

6. A driving support system according to any one of claims 1 to 3, comprising: a risk calculation unit that calculates a risk index value of the driving environment in which the vehicle has driven based on at least one of the driving information of the vehicle and video footage of the area around the vehicle; a risk determination unit that determines whether the calculated risk index value is equal to or greater than a predetermined risk threshold; a registration unit that, if it is determined that the calculated risk index value is equal to or greater than the risk threshold, registers video footage showing the driving environment in which the risk index value was calculated as a warning video; and a transmission unit that outputs the warning video to a user terminal device used by a driver of a vehicle that has driven in the same or similar driving environment as the driving environment shown in the warning video.

7. A driving support system according to any one of claims 1 to 3, comprising: a driving environment information determination unit that determines whether information indicating the driving environment shown in the video of the vehicle's surroundings matches predetermined driving environment information that has been registered in advance; and a driving operation determination unit that, if it is determined that the information indicating the driving environment shown in the video of the vehicle's surroundings matches the predetermined driving environment information, determines whether the driving operation indicated by the vehicle's driving information matches the driving operation indicated by the predetermined driving information that has been registered in advance, wherein the transmission unit outputs the determination result by the driving operation determination unit to a user terminal device used by the driver.

8. An information processing device comprising: an evaluation value calculation unit that calculates an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; an evaluation value determination unit that determines whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; a registration unit that, if it is determined that the calculated evaluation value is equal to or greater than the evaluation threshold, registers video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and a transmission unit that, if it is determined that the calculated evaluation value is less than the evaluation threshold, outputs the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

9. A method comprising: a computer calculating an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; determining whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, registering the video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and if the calculated evaluation value is determined to be less than the evaluation threshold, outputting the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

10. The method according to claim 9, wherein the output includes outputting, along with the excellent driving video, driving information corresponding to the excellent driving video to the user terminal device.

11. The method according to claim 10, wherein the output includes outputting, along with the excellent driving video, the advantages of the driving indicated by the driving information corresponding to the excellent driving video to the user terminal device.

12. The method according to any one of claims 9 to 11, wherein the computer generates evaluation information about the driver's driving operations based on at least one of driving information relating to the operation of the vehicle and video footage of the area around the vehicle, and outputs the evaluation information to the user terminal device.

13. The method according to claim 12, wherein the output includes outputting, together with the evaluation information, driving information corresponding to the evaluation information to the user terminal device, the driving information including at least one of the vehicle's speed and acceleration.

14. The method according to any one of claims 9 to 11, wherein the computer calculates a risk index value for the driving environment in which the vehicle has driven based on at least one of the driving information of the vehicle and video footage of the area around the vehicle, determines whether the calculated risk index value is equal to or greater than a predetermined risk threshold, and if it is determined that the calculated risk index value is equal to or greater than the risk threshold, registers video footage showing the driving environment in which the risk index value was calculated as a warning video, and outputs the warning video to a user terminal device used by the driver of a vehicle that has driven in the same or similar driving environment as the driving environment shown in the warning video.

15. The method according to any one of claims 9 to 11, wherein the computer determines whether information indicating the driving environment shown in the video of the vehicle's surroundings matches pre-registered predetermined information indicating the driving environment, and if it determines that the information indicating the driving environment shown in the video of the vehicle's surroundings matches the predetermined information indicating the driving environment, it determines whether the driving operations indicated by the vehicle's driving information match the driving operations indicated by the pre-registered predetermined driving information, and outputs the determination result to a user terminal device used by the driver.

16. A program that causes a computer to perform the following steps: calculate an evaluation value for the driver's driving operations based on at least one of driving information relating to the driving of a vehicle driven by the driver and video footage of the vehicle's surroundings; determine whether the calculated evaluation value is equal to or greater than a predetermined evaluation threshold; if the calculated evaluation value is determined to be equal to or greater than the evaluation threshold, register the video footage of the vehicle's surroundings corresponding to the driving operations as good driving video; and if the calculated evaluation value is determined to be less than the evaluation threshold, output the good driving video and driving information corresponding to the good driving video, taken in the same or similar driving environment as the driver's driving environment, to a user terminal device used by the driver.

Images