Program, information processing method, drive recorder, and information processing system

Abstract

To provide a program or the like capable of determining an operation state when a vehicle travels backward.SOLUTION: A drive recorder 10 detects the input of a reverse gear of a vehicle. In addition, the drive recorder 10 detects the occurrence of dangerous driving related to the backward traveling when backward movement of the vehicle is detected within a predetermined period after the input of the reverse gear is detected.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a program, an information processing method, a drive recorder, and an information processing system. [Background technology]

[0002] Patent Document 1 discloses a system that measures the distance between a vehicle and a vehicle ahead while the vehicle is traveling, and sounds an alarm when the distance falls below a threshold value for the distance between the vehicles. The system disclosed in Patent Document 1 records the occurrence of a distance warning event, and evaluates the driver's driving based on the recorded content. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-180727 Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses that a driver's driving is evaluated based on operational data such as speeding, sudden starts, sudden acceleration, and sudden braking, in addition to the distance from the vehicle ahead. On the other hand, a situation that can lead to an accident is when the vehicle is backing up, in which the vehicle is moving backward. However, Patent Document 1 does not disclose that a driver's driving is evaluated by detecting operational data when the vehicle is backing up.

[0005] The present disclosure has been made in consideration of the above circumstances, and its purpose is to provide a program or the like that is capable of determining the driving state of a vehicle when it is backing up. [Means for solving the problem]

[0006] A program according to one aspect of the present disclosure detects the input of reverse gear of a vehicle, and if the program detects the vehicle moving backward within a predetermined period after the input of reverse gear is detected, causes a computer to execute a process to detect the occurrence of dangerous driving related to backing up. [Effects of the Invention]

[0007] In one aspect of the present disclosure, the driving state of a vehicle when it is backing up can be determined. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of the configuration of an information processing system. [Figure 2] FIG. 1 is a block diagram illustrating an example of the configuration of a drive recorder. [Figure 3] FIG. 2 is a block diagram showing an example of the configuration of a server and a business operator terminal; [Figure 4] FIG. 2 is an explanatory diagram showing an example of the record layout of a business operator DB and a driver DB. [Figure 5] 10 is a flowchart illustrating an example of a procedure for detecting an event occurrence. [Figure 6] 10 is a flowchart illustrating an example of a procedure for detecting an event occurrence. [Figure 7] FIG. 1 is an explanatory diagram illustrating an example of the configuration of a learning model. [Figure 8] FIG. 10 is an explanatory diagram showing an example of notification information. [Figure 9] 10 is a flowchart illustrating an example of a procedure for viewing event information. [Figure 10] FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 11] FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 12] FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 13] FIG. 10 is an explanatory diagram showing an example of the configuration of a learning model according to the second embodiment. [Figure 14] 10 is a flowchart illustrating an example of a procedure for viewing event information according to the second embodiment. [Figure 15]FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 16] 10 is a flowchart illustrating another example of the procedure for detecting an event occurrence. [Figure 17] 10 is a flowchart illustrating another example of the procedure for detecting an event occurrence. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, a program, an information processing method, a drive recorder, and an information processing system according to the present disclosure will be described in detail with reference to the drawings illustrating embodiments thereof.

[0010] (Embodiment 1) FIG. 1 is an explanatory diagram showing an example of the configuration of an information processing system. In this embodiment, an information processing system is described that monitors whether dangerous driving has occurred using a drive recorder 10 installed in a vehicle, and if dangerous driving is detected, outputs an alert to the driver and notifies the business that manages the vehicle. The information processing system of this embodiment is used by businesses that use vehicles, such as transportation businesses, taxi businesses, and bus businesses, and the drive recorder 10 is installed in the vehicles managed by each business. Note that businesses that use the information processing system of this embodiment are not limited to the businesses described above; for example, the drive recorder 10 may be installed and used in company cars used by various businesses.

[0011] The information processing system of this embodiment includes a drive recorder 10 mounted on a vehicle, a server 30, and an operator terminal 40 used by an operator, and these devices are communicatively connected via a network N such as the Internet. The drive recorder 10 may be connected to the Internet via a mobile phone line such as a 4G (Generation) line, a 5G line, an LTE (Long Term Evolution) line, or an LPWA (Low Power Wide Area) line. The drive recorder 10 detects the driving state of the vehicle, determines whether dangerous driving has occurred, and transmits information indicating the driving state to the server 30 if dangerous driving is detected. In this embodiment, dangerous driving refers to a driving state that could lead to an accident when the vehicle is backing up, and in the following description, the occurrence of dangerous driving is referred to as the occurrence of an event.

[0012] The server 30 is a server managed by a business operator that provides the information processing system of this embodiment. The server 30 is an information processing device capable of various information processes and transmitting and receiving information, such as a server computer or a personal computer. The server 30 receives and stores information (hereinafter referred to as event information) related to an event (a dangerous driving state) detected by the drive recorder 10. The server 30 also notifies the business operator terminal 40 of the business operator that manages the vehicle in which the event occurred of the occurrence of the event. The server 30 also has a web server function and provides the stored event information to the business operator terminal 40 in response to access from the business operator terminal 40. The business operator terminal 40 is an information terminal used by a business operator who uses the information processing system of this embodiment, such as a personal computer, a smartphone, or a tablet terminal. The business operator terminal 40 is not limited to the above-mentioned devices, as long as it has the function of sending and receiving messages and browsing websites.

[0013] FIG. 2 is a block diagram showing an example configuration of the drive recorder 10. The drive recorder 10 includes a control unit 11, a memory unit 12, a communication unit 13, an input unit 14, a display unit 15, a memory / readout unit 16, a positioning unit 17, an exterior camera 18, an interior camera 19, a speaker 20, an interior communication unit 21, and the like, all of which are interconnected via a bus. The control unit 11 includes one or more processors, such as a central processing unit (CPU), a microprocessing unit (MPU), or a graphics processing unit (GPU). The control unit 11 executes various information processing and control processes to be performed by the drive recorder 10 by appropriately executing a program 12P stored in the memory unit 12. A clock 11a that indicates the date and time (year / month / day / hour / minute / second) is connected to the control unit 11, and the control unit 11 obtains the current date and time from the clock 11a.

[0014] The storage unit 12 includes a RAM (Random Access Memory), a flash memory, a hard disk, an SSD (Solid State Drive), etc. The storage unit 12 stores a program 12P (program product) executed by the control unit 11 and various data. The storage unit 12 also temporarily stores data and the like that is generated when the control unit 11 executes the program 12P. The program 12P and various data may be written to the storage unit 12 during the manufacturing stage of the drive recorder 10, or may be downloaded by the control unit 11 from another device via the communication unit 13 and stored in the storage unit 12.

[0015] The communication unit 13 is a communication module for performing processing related to wireless communication, and transmits and receives information to and from other devices via the network N. The input unit 14 accepts operation input by a user (e.g., a vehicle driver) and sends a control signal corresponding to the operation content to the control unit 11. The display unit 15 is a liquid crystal display, an organic EL display, or the like, and displays various information according to instructions from the control unit 11. A part of the input unit 14 and the display unit 15 may be a touch panel configured as an integrated unit.

[0016] The storage / reading unit 16 is configured to allow, for example, a storage medium 16a to be detachably attached, and performs data storage (writing) and readout processes on the attached storage medium 16a. The storage medium 16a is, for example, a portable storage medium such as an SD (Secure Digital) memory card or a USB (Universal Serial Bus) memory. The storage medium 16a does not need to be detachable from the drive recorder 10, but if it is configured to be detachable, the storage medium 16a removed from the drive recorder 10 can be attached to another device, and the data stored in the storage medium 16a can be processed in the other device. In the drive recorder 10 of this embodiment, video data captured using the cameras 18 and 19 is sequentially stored in the storage medium 16a.

[0017] The positioning unit 17 generates positioning data (e.g., data such as latitude, longitude, and altitude) indicating the current position of the drive recorder 10 and sends it to the control unit 11. The positioning unit 17 has, for example, a GPS (Global Positioning System) receiver, receives GPS signals transmitted from GPS satellites with the GPS receiver, and generates positioning data based on the received GPS signals. Note that if the drive recorder 10 can communicate with, for example, a navigation device installed in the vehicle, a communication unit that communicates with the navigation device may be provided instead of the positioning unit 17. In this case, the drive recorder 10 is provided with a navigation communication unit that performs wired or wireless communication with the navigation device and is configured to obtain positioning data generated by the navigation device based on, for example, GPS signals via the navigation communication unit. For example, the in-vehicle communication unit 21 can be configured to be connected to the navigation device via a communication line.

[0018] The exterior camera 18 is a camera that captures the surroundings of the vehicle and is installed in a position that allows it to capture, for example, the area in front of the vehicle. The exterior camera 18 may be configured to capture the rear, left, or right side of the vehicle, or all directions around the vehicle, in addition to the area in front of the vehicle, or may have multiple cameras that capture images in each direction. The interior camera 19 is a camera that captures the interior of the vehicle and is installed in a position that allows it to capture the driver seated in the driver's seat. The exterior camera 18 and the interior camera 19 each capture images in accordance with instructions from the control unit 11 and sequentially acquire one frame of image data (captured image). The cameras 18 and 19 are configured to acquire, for example, 60, 30, or 15 frames of video data per second. The acquired video data is sequentially sent to the memory readout unit 16 and stored in the storage medium 16a by the memory readout unit 16. The cameras 18 and 19 may be built into the drive recorder 10 or may be externally attached to the drive recorder 10. In this case, the drive recorder 10 is configured to include a camera communication unit that performs wired or wireless communication with the external camera and acquires video data captured by the external camera via the camera communication unit. The speaker 20 is an audio output unit that outputs audio in accordance with instructions from the control unit 11, and outputs a message or a warning sound in accordance with instructions from the control unit 11.

[0019] The in-vehicle communication unit 21 is connected to the in-vehicle devices via a communication line and communicates with the in-vehicle devices in accordance with a protocol such as CAN (Controller Area Network) or LIN (Local Interconnect Network). In this embodiment, the in-vehicle communication unit 21 is configured to be able to communicate with the vehicle speed sensor 21a and the transmission 21b, and acquires information on the vehicle speed measured by the vehicle speed sensor 21a and the gear shifted by the transmission 21b in response to the driver's operation of the shift lever. The vehicle speed sensor 21a periodically calculates the vehicle speed based on an electrical signal (vehicle speed pulse) output from a rotation sensor that detects the rotation speed of the axle (wheel), for example, and transmits information on the calculated vehicle speed (vehicle speed information) via the communication line. The transmission 21b also shifts gears in response to the operation of the shift lever and transmits information on the shifted gear (gear change information) via the communication line. In this embodiment, the in-vehicle communication unit 21 is only required to acquire, as gear information, information indicating that the vehicle has been shifted into reverse gear. If an ECU (Electronic Control Unit) mounted on the vehicle is configured to calculate the vehicle speed from the vehicle speed pulse, the in-vehicle communication unit 21 acquires vehicle speed information from the ECU. If the ECU is configured to acquire information about the gear to which the transmission 21b has been switched, the in-vehicle communication unit 21 acquires the gear information from the ECU.

[0020] In addition to the above-described components, the drive recorder 10 may include a compression / decompression unit that performs compression and decompression processing on video data stored in the storage medium 16a in accordance with a predetermined compression standard. The drive recorder 10 may also include a measurement unit that measures vehicle speed based on, for example, a GPS signal transmitted from a GPS satellite, in addition to acquiring vehicle speed information from the vehicle speed sensor 21a. The drive recorder 10 may also include a microphone that collects audio from inside the vehicle. The drive recorder 10 may also include a built-in acceleration sensor. The input unit 14 of the drive recorder 10 may also include only a power button for starting and stopping the operation of the drive recorder 10, or a reset button for resetting the operation of the drive recorder 10. The display unit 15 of the drive recorder 10 may also include only a lamp that lights up when an error occurs in the operation of the drive recorder 10, or a lamp that indicates that the drive recorder 10 is operating.

[0021] The drive recorder 10 having the above-described configuration starts processing such as capturing images using the cameras 18 and 19, displaying the captured images on the display unit 15, and obtaining vehicle speed information and gear information using the in-vehicle communication unit 21, for example, when the vehicle engine is turned on. The drive recorder 10 may be configured to start each of the above-described processes when the vehicle starts traveling or when an instruction to start recording is received from the driver, or may be configured to perform each of the above-described processes continuously. The drive recorder 10 also ends each of the above-described processes, for example, when the vehicle engine is turned off. The drive recorder 10 may also be configured to end each of the above-described processes when the vehicle stops traveling or when an instruction to stop recording is received from the driver, or

[0022] FIG. 3 is a block diagram showing an example configuration of the server 30 and the business operator terminal 40. The server 30 includes a control unit 31, a storage unit 32, a communication unit 33, an input unit 34, a display unit 35, etc., which are interconnected via a bus. The control unit 31, the storage unit 32, the communication unit 33, the input unit 34, and the display unit 35 of the server 30 have the same configurations as the control unit 11, the storage unit 12, the communication unit 13, the input unit 14, and the display unit 15 of the drive recorder 10, and therefore detailed description thereof will be omitted. The storage unit 32 of the server 30 stores, in addition to the program 32P (program product) executed by the control unit 31, a website 32S (a danger reporting site) for providing information about events occurring in each vehicle, a business operator DB 32a, and a driver DB 32b. The business operator DB 32a is a database that stores information about business operators using the system, and the driver DB 32b is a database provided for each business operator and stores information about drivers (drivers) belonging to each business operator. The business operator DB 32a and the driver DB 32b may be stored in another storage device connected to the server 30, or may be stored in another storage device with which the server 30 can communicate. The communication unit 33 of the server 30 may be configured to be connected to the network N by wired communication.

[0023] In the above-described configuration, the input unit 34 and the display unit 35 are not essential, and the server 30 may be configured to accept operations through a connected computer and output information to be displayed to an external display device. In this embodiment, the server 30 may be a multi-computer consisting of multiple computers, a virtual machine virtually constructed by software, or a cloud server. The server 30 may also include a reading unit that reads a non-transitory computer-readable portable storage medium 30a, and may read the program 32P from the portable storage medium 30a using the reading unit and store it in the storage unit 32. The program 32P may be executed on a single computer or on multiple computers interconnected via a network N.

[0024] The operator terminal 40 includes a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, a display unit 45, etc., and these units are interconnected via a bus. The control unit 41, the storage unit 42, the communication unit 43, the input unit 44, and the display unit 45 of the operator terminal 40 have the same configurations as the control unit 11, the storage unit 12, the communication unit 13, the input unit 14, and the display unit 15 of the drive recorder 10, and therefore detailed description thereof will be omitted. Note that the storage unit 42 of the operator terminal 40 stores a web browser 42AP (hereinafter referred to as browser 42AP) for browsing websites in addition to a program 42P (program product) executed by the control unit 41. A part of the storage unit 42 may be another storage device connected to the operator terminal 40. Furthermore, the communication unit 43 of the operator terminal 40 may be configured to be connected to the network N via wired communication.

[0025] In addition to the above-described configuration, the server 30 and the business operator terminal 40 of this embodiment have a function of sending and receiving messages. Specifically, an application program (message sending and receiving application) for realizing the process of sending and receiving messages is stored in the storage units 32 and 42. The message sending and receiving application may be, for example, a mailer for sending and receiving emails, or LINE (registered trademark) provided by LINE Corporation, but is not limited to these.

[0026] FIG. 4 is an explanatory diagram showing an example of the record layout of the business operator DB 32a and the driver DB 32b. FIG. 4A shows the business operator DB 32a, and FIG. 4B shows the driver DB 32b. The business operator DB 32a includes a business operator ID column, a business operator name column, a business operator information column, and a contact information column. The business operator ID column stores an ID uniquely assigned to a business operator using the system. The business operator name column, the business operator information column, and the contact information column store the name of the business operator, information about the business operator, and email or LINE address information in association with the business operator ID. The information about the business operator includes the address and telephone number of the business operator's company and sales office, information about the contract for using the system, etc.

[0027] The driver DB 32b is provided in association with the business ID of the business, and includes a driver ID column, a name column, a driver information column, a vehicle number column, a vehicle information column, and an event information column. The driver ID column stores an ID uniquely assigned to a driver belonging to the business. The name column and the driver information column store the driver's name and information about the driver in association with the driver ID. The information about the driver includes the name of the department to which the driver belongs and the number of years of service (years as a driver). The vehicle number column stores the vehicle registration number (license plate number) of the vehicle used (driven) by the driver in association with the driver ID. The vehicle information column stores information about the vehicle, such as the vehicle's manufacturing date, manufacturer, model, and year, in association with the vehicle number. The event information column stores information about events detected while the driver was driving the vehicle in association with the driver ID and the vehicle number. An event is an occurrence that could lead to an accident (a dangerous driving condition), and in this embodiment, events are when the driver does not sufficiently check the surroundings of the vehicle when backing up (insufficient checking when backing up), and when the vehicle speed when backing up is above a predetermined speed (excessive speed when backing up).

[0028] Event information is information indicating the content of the event, and the event information column includes a date and time column, a location column, a vehicle speed column, a risk type column, a risk rank column, and a video file column. The date and time column, location column, and vehicle speed column store the date and time of the event, information indicating the location of the event (e.g., latitude and longitude), and the vehicle speed at the time of the event, respectively. The risk type column stores the type of dangerous driving (event) during backing. The risk rank column stores a rank determined according to the content of the event (e.g., a 5-level rank, with 5 indicating the highest risk and 1 indicating the lowest risk). For example, in the case of an event of insufficient checking while backing, the higher the risk rank, the more the driver did not check the surroundings of the vehicle. For example, a rank based on the time the driver visually checked behind the vehicle can be used. Furthermore, in the case of an event of excessive speed while backing, the higher the rank, the higher the rank. The video file column stores the file names of video data captured by cameras 18 and 19 of the drive recorder 10 before and after the event. The video data is stored, for example, in a predetermined area (video folder) of the storage unit 32, and the file name includes a folder name and file name for reading out the video data from the predetermined area. The video data may be a still image or a video, but in this embodiment it is a video. In this embodiment, for the sake of simplicity, each driver uses the same vehicle, but it may also be configured to use different vehicles for each working day or for each predetermined period. In a configuration in which one driver uses different vehicles, the date and time when the driver used each vehicle, the vehicle number, vehicle information, and event information related to the vehicle used on each date and time are associated with one driver ID and stored in the driver DB 32b.

[0029] The following describes the processing performed by each device in the information processing system of this embodiment. First, the processing performed by the drive recorder 10 to detect the occurrence of an event will be described. FIGS. 5 and 6 are flowcharts showing an example of the procedure for detecting the occurrence of an event. In FIGS. 5 and 6, the left side shows the processing performed by the drive recorder 10, and the right side shows the processing performed by the server 30. The following processing is executed by the control unit 11 in accordance with a program 12P stored in the storage unit 12 of the drive recorder 10, and by the control unit 31 in accordance with a program 32P stored in the storage unit 32 of the server 30. Part of the following processing may be implemented by a dedicated hardware circuit.

[0030] The drive recorder 10 of this embodiment is activated, for example, when the vehicle engine is turned on or when an instruction to start recording is received, and starts processing such as recording by the cameras 18 and 19. After the drive recorder 10 is activated, the control unit 11 executes the following processing. Specifically, the control unit 11 starts the recording processing by the cameras 18 and 19 and starts the processing of storing the captured video data in the storage medium 16a by the storage / readout unit 16 (S11). As a result, the video data obtained by the recording processing by the cameras 18 and 19 is sequentially stored in the storage medium 16a. The cameras 18 and 19 continue to acquire video data at, for example, 60 frames, 30 frames, or 15 frames per second until the drive recorder 10 stops operating. The control unit 11 associates the recording date and time with the video data of each frame and stores it in the storage medium 16a.

[0031] The control unit 11 starts a process of acquiring vehicle speed information output from the vehicle speed sensor 21a through the in-vehicle communication unit 21 (S12), and starts a process of acquiring gear change information (gear information) output from the transmission 21b through the in-vehicle communication unit 21 (S13). The control unit 11 may sequentially store the acquired vehicle speed information and gear change information in the storage medium 16a. The in-vehicle communication unit 21 continues to acquire the vehicle speed information periodically transmitted from the vehicle speed sensor 21a and the gear change information appropriately transmitted from the transmission 21b until the drive recorder 10 ends its operation.

[0032] The control unit 11 (detection unit) determines whether the vehicle has been shifted into reverse gear based on the gear shift information sequentially acquired by the acquisition process started in step S13 (S14). Here, the control unit 11 determines whether the gear shift information transmitted from the transmission 21b is reverse gear information. If the control unit 11 determines that the vehicle has not been shifted into reverse gear (S14: NO), the control unit 11 waits while performing other processes. For example, the control unit 11 performs a process of displaying an image of the area in front of the vehicle captured by the exterior camera 18 on the display unit 15. If the control unit 11 determines that the vehicle has been shifted into reverse gear (S14: YES), the control unit 11 starts a process of measuring the elapsed time since the vehicle was shifted into reverse gear (S15). The control unit 11 determines whether the vehicle has started to reverse based on the vehicle speed information sequentially acquired by the acquisition process started in step S12 (S16). Here, the control unit 11 determines whether the vehicle speed information transmitted from the vehicle speed sensor 21a is a vehicle speed equal to or greater than 0. If it is determined that reverse driving has not started (S16: NO), the control unit 11 continues the timing process until it detects the start of reverse driving. Note that if the vehicle speed information includes information indicating whether the vehicle is moving forward or backward (while moving backward), in step S16 the control unit 11 determines whether reverse driving has started based on the vehicle speed information regarding the reverse vehicle speed, without using the vehicle speed information regarding the forward vehicle speed as a determination target. This prevents the start of reverse driving from being erroneously determined based on the forward vehicle speed when the vehicle is shifted into reverse gear before stopping while moving forward.

[0033] If it is determined that backing has started (S16: YES), the control unit 11 determines whether or not the elapsed time since the reverse gear was engaged is equal to or greater than a predetermined time (e.g., 3 seconds) based on the timing result of the timing process started in step S15 (S17). That is, the control unit 11 determines whether or not a predetermined time has elapsed since the reverse gear was engaged until backing started. The predetermined time (predetermined period) here can be arbitrarily set and configured to be, for example, a time (period) from 1 to 10 seconds in 1-second increments. For example, when an instruction to change the settings is input via the business operator terminal 40, the server 30 receives the changes from the business operator terminal 40 and sets the drive recorder 10 based on the received changes. As a result, the control unit 11 can acquire from the server 30 a designation of an arbitrary time (period) within a preset time (period) and set the acquired time (period) as the predetermined time (period) used in the determination process of step S17. In this case, the predetermined time can be set for each business operator, and the person in charge of the business operator can change the setting of the drive recorders 10 installed in the vehicles of the business operator collectively by instructing a change to the setting of the predetermined time using the business operator terminal 40. Note that the predetermined time here may be changeable, for example, by an operation via the input unit 14. In this case, the setting can be made for each drive recorder 10.

[0034] If it is determined that a predetermined time has not elapsed between the time the reverse gear is engaged and the time the vehicle starts to reverse (S17: NO), the control unit 11 outputs an alert (S18). In this embodiment, if the vehicle starts to reverse before the predetermined time has elapsed since the reverse gear was engaged, the control unit 11 (detection unit) determines that the driver backed up the vehicle without sufficiently checking the surroundings of the vehicle, and detects the occurrence of an event of insufficient checking while backing up (a dangerous driving state). Therefore, the control unit 11 outputs an alert message such as "Please check behind you" or "Please check your surroundings" from the speaker 20 to alert the driver. In addition, if the display unit 15 is configured to display a rear image of the vehicle rear captured by the external camera 18 when the vehicle is engaged in reverse, the control unit 11 may output an alert message such as "Please check behind you on the monitor." The content of the alert to be output as an audio message is preset in the program 12P.

[0035] Next, the control unit 11 generates event information (driving information) for the event related to the output alert. Here, the control unit 11 first determines the danger rank of the event for which the alert was output (S19). For example, in the case of an event of insufficient check while backing up, the control unit 11 determines the danger rank according to the elapsed time from when the reverse gear was engaged to when backing up started. For example, the control unit 11 determines the danger rank as rank 3 if the elapsed time is less than 1 second, as rank 2 if the elapsed time is between 1 second and 2 seconds, and as rank 1 if the elapsed time is between 2 seconds and 3 seconds. The control unit 11 may also determine the danger rank based on an image (video data) of the driver captured by the in-vehicle camera 19. For example, the control unit 11 may detect the driver's line of sight or facial direction based on the captured image of the driver and track the line of sight or facial direction to determine whether the driver is checking the rear of the vehicle, the surroundings of the vehicle, etc., and determine the danger rank according to the determination result.

[0036] The process of determining the driver's behavior based on captured images of the driver and assigning a risk level based on the determination result can also be performed using a learning model trained by machine learning. The learning model is expected to be used as a program module that functions as part of artificial intelligence software. For example, a learning model trained using an algorithm such as a convolution neural network (CNN) can be used to output a risk level for the driver in the captured image when the captured image is input. In this case, the control unit 11 inputs the captured image captured by the in-vehicle camera 19 at the time of the event into the learning model, and can assign a risk level for the driver in the captured image based on the output information from the learning model. The captured image input to the learning model may be a still image or a video. In addition to CNN, the learning model may be configured using any object detection algorithm such as R-CNN (Regions with CNN), Fast R-CNN, Faster R-CNN, Mask R-CNN, SSD (Single Shot Multibook Detector), or YOLO (You Only Look Once), or may be configured by combining several of these models.

[0037] FIG. 7 is an explanatory diagram showing an example of the configuration of a learning model. The learning model shown in FIG. 7 is trained to receive a captured image of a driver as input, perform a calculation to determine the risk rank of the driver in the captured image based on the input captured image, and output the calculation result. The learning model shown in FIG. 7 has multiple output nodes, where output node 0 outputs the probability of determining risk rank 1, output node 1 outputs the probability of determining risk rank 2, output node 2 outputs the probability of determining risk rank 3, output node 3 outputs the probability of determining risk rank 4, output node 4 outputs the probability of determining risk rank 5, and output node 5 outputs the probability of determining other. The output value of each output node is, for example, a value between 0 and 1.0, and the sum of the determination probabilities output from each output node is 1.0.

[0038] The learning model shown in FIG. 7 is generated by machine learning an untrained learning model using training data including training images and information (correct labels) indicating the risk rank determined for the driver in the captured image. When a training image is input, the learning model learns so that the output value from the output node corresponding to the risk rank indicated by the correct label approaches 1.0 and the output values ​​from the other output nodes approach 0.0. In the learning process, the learning model performs calculations based on the input captured image to calculate output values ​​from each output node. The learning model then compares the calculated output value of each output node with a value (0 or 1) corresponding to the correct label and optimizes parameters used in the calculation process so that each output value approximates the value corresponding to the respective correct label. The parameters are, for example, weights between neurons in the learning model. The parameter optimization method is not particularly limited, but examples include backpropagation, steepest descent, and the like. As a result, a learning model is obtained that is trained to determine the risk rank of the driver in the input captured image. When determining the danger rank using such a learning model, the control unit 11 identifies the danger rank corresponding to the output node that output the largest output value (discrimination probability) among the output values ​​output from the learning model as the danger rank for the driver in the captured image.

[0039] The learning model is trained by another learning device. The trained learning model generated by the other learning device is downloaded from the learning device to the drive recorder 10 via the network N or the storage medium 16a, for example, and stored in the storage unit 12. Note that the trained learning model may be incorporated into the program 12P and written to the storage unit 12 during the manufacturing stage of the drive recorder 10. The learning model is not limited to the configuration shown in FIG. 7 , and the number of output nodes may be the same as the number of risk ranks to be determined. Furthermore, the learning model is not limited to a configuration that determines the driver's risk rank, but may also be configured to determine, for example, the type of driver behavior. In this case, a learning model trained to determine, when a captured image is input, behavior such as whether the driver in the captured image visually checks the rear of the vehicle, checks the display unit 15 displaying an image of the rear of the vehicle, or visually checks the surroundings of the vehicle can be used. Using such a learning model, the driver's behavior can be determined from the captured image of the driver, and the occurrence of an event can be detected based on the determined behavior.

[0040] After determining the danger level, the control unit 11 reads video data for a predetermined time (e.g., 7 seconds) before and after the event occurrence from the video data captured by the cameras 18 and 19 and stored in the storage medium 16a (S20). Here, the control unit 11 reads video data of the outside of the vehicle captured by the exterior camera 18 and video data of the driver captured by the interior camera 19. If the exterior camera 18 is configured to capture an image of the area behind the vehicle, the control unit 11 reads video data of the area behind the vehicle (rear image data). If the exterior camera 18 is configured to capture an image of the area in front of and behind the vehicle, the control unit 11 reads video data of the areas in front of and behind the vehicle, and if the exterior camera 18 is configured to capture an image of the area around the vehicle, the control unit 11 reads video data of the area around the vehicle. The control unit 11 reads video data for 7 seconds, for example, from 4 seconds before to 3 seconds after the time when the event occurrence is detected (the timing of the event occurrence), but the time period is not limited to this. The amount of video data (shooting time) read by the control unit 11 can be arbitrarily changed, for example, via the business operator terminal 40. In this case, the server 30 receives the change from the business operator terminal 40 and sets the drive recorder 10 based on the received change. Therefore, when a business operator's representative instructs a change to the setting of the predetermined time (shooting time) using the business operator terminal 40, the setting of all the drive recorders 10 used by the business operator can be changed collectively. Note that the predetermined time may also be changeable, for example, by an operation via the input unit 14, in which case it can be set for each drive recorder 10.

[0041] Then, the control unit 11 generates event information (driving information) related to the event for which the alert was output (S21). For example, the control unit 11 generates the event information including the date and time at this time (date and time the event occurred), the location measured by the positioning unit 17 at this time (location of the event), the vehicle speed obtained from the vehicle speed sensor 21a at this time (vehicle speed when the event occurred), the type of event (danger) (here, insufficient confirmation while backing up), the danger rank determined in step S19, and the video data read out in step S20. Note that if the drive recorder 10 is configured to collect audio from inside the vehicle, the control unit 11 generates event information that also includes audio data corresponding to the video data. The control unit 11 (output unit) associates the generated event information with the vehicle number or the driver ID of the driver and transmits it to the server 30 (S22). The vehicle number or the driver ID is registered in the server 30 in association with, for example, the serial number assigned to the drive recorder 10, and when the drive recorder 10 is installed in a vehicle or when use of the drive recorder 10 is started, the vehicle number or the driver ID corresponding to the serial number of the drive recorder 10 is acquired from the server 30 and set in the drive recorder 10, and stored in, for example, the storage unit 12. Note that a configuration may also be adopted in which a storage medium 16a (for example, an SD memory card) in which the vehicle number or the driver ID is stored is attached to the drive recorder 10, and the vehicle number or the driver ID is acquired via the storage medium 16a.

[0042] The control unit 31 of the server 30 receives the event information transmitted from the drive recorder 10 and stores the received event information in the driver DB 32b (S23). Specifically, the control unit 31 stores the date and time of occurrence, the location of occurrence, the vehicle speed, the type of event (danger), and the danger rank of the event included in the received event information in the driver DB 32b in association with the vehicle number or the driver ID received from the drive recorder 10. The control unit 31 also assigns a file name to the video data included in the event information received from the drive recorder 10 and stores it in a predetermined area (video folder) of the storage unit 32, and stores the file name assigned to the video data in association with the vehicle number or the driver ID in the driver DB 32b. In this way, information on events detected by the drive recorder 10 is accumulated in the server 30.

[0043] Next, the control unit 31 generates notification information for notifying the business operator of information related to the event stored in the driver DB 32b (S24). FIG. 8 is an explanatory diagram showing an example of the notification information. As shown in FIG. 8A, the notification information includes the vehicle license plate number and a message notifying the business operator that an event (dangerous driving) has occurred in a vehicle with that vehicle license plate number. The notification information also includes the time, location, type, and danger rank of the event, the vehicle speed at the time of the event, the driver's name, and the name of the department. The control unit 31 can read this information from the driver DB 32b. The notification information also includes a uniform resource locator (URL) for displaying a map of the location where the event occurred and a URL for displaying video (video) captured by the cameras 18 and 19 of the drive recorder 10 at the time the event occurred. The URL for displaying the map may be a URL for accessing map data of a predetermined range centered on the location where the event occurred, if map data of the predetermined range centered on the location where the event occurred is stored in the storage unit 32, or a URL for displaying the location where the event occurred on a map application such as Google Maps. The control unit 31 generates the URL based on the location information read from the driver DB 32b. The notification information may be configured to display, in addition to a map showing the location of the event, still images captured by the cameras 18 and 19 of the drive recorder 10 at the time of the event, or multiple still images (e.g., seven seconds' worth of still images) extracted every second from the video data stored in the storage unit 32. The URL for displaying the video is a URL for accessing the video data stored in the storage unit 32, and is generated by the control unit 31 based on the file name of the video file read from the driver DB 32b. The control unit 31 generates the notification information using the information read from the driver DB 32b as described above and information generated from the read information.

[0044] The control unit 31 (output unit) transmits the generated notification information to the business operator terminal 40 by email or using a message sending / receiving app such as LINE (S25). The destination information of the business operator terminal 40 is stored in a contact information column of the business operator DB 32a. The control unit 31 reads the destination information of the business operator to which the driver belongs from the business operator DB 32a and transmits the notification information to the business operator terminal 40 using the read destination information. Although the process performed by the business operator terminal 40 is not shown in FIG. 5, the control unit 41 of the business operator terminal 40 receives the notification information transmitted from the server 30 using the message sending / receiving app. The control unit 41 also starts the message sending / receiving app in accordance with an operation via the input unit 44, and displays the notification information received from the server 30 on the display unit 45 to notify the user of the business operator terminal 40. When the control unit 41 of the business operator terminal 40 displays the notification information as shown in FIG. 8A, the control unit 41 of the business operator terminal 40 accepts a selection operation for the displayed URL via the input unit 44. When the control unit 41 receives a selection operation for a URL being displayed, it accesses the selected URL, receives a map of the location where the event occurred or video data at the time the event occurred, and displays it on the display unit 45.

[0045] If it is determined in step S17 that the predetermined time has elapsed (S17: YES), the control unit 11 skips steps S18 to S22. That is, if reverse driving is started after the predetermined time has elapsed since the reverse gear was engaged, the control unit 11 determines that an event of insufficient confirmation during reverse driving has not occurred, and proceeds to step S26. The control unit 11 determines whether the vehicle speed is equal to or greater than a predetermined speed based on the vehicle speed information sequentially acquired by the acquisition process started in step S12 (S26). That is, the control unit 11 determines whether the vehicle speed (reverse speed) during reverse driving is equal to or greater than a predetermined speed (e.g., 5 km / h). The predetermined speed here can be arbitrarily changed and can be set to any speed above 5 km / h in 1-kilometer increments, for example. For example, when a setting change instruction is input via the business operator terminal 40, the server 30 receives the change content from the business operator terminal 40 and applies the received change content to the drive recorder 10, thereby allowing the arbitrary speed to be set. The predetermined speed may be changeable by operation via the input unit 14 of the drive recorder 10.

[0046] If it is determined that the vehicle speed during backing is equal to or greater than the predetermined speed (S26: YES), the control unit 11 performs the same processes as steps S18 to S22 (S27 to S31), and the control unit 31 of the server 30 performs the same processes as steps S23 to S25 (S32 to S34). Specifically, the control unit 11 of the drive recorder 10 outputs an alert (S27). In this embodiment, if the vehicle speed during backing exceeds a predetermined speed (e.g., 5 km / h), the control unit 11 determines that the vehicle is driving dangerously, which could lead to an accident, and detects the occurrence of an event of excessive speed during backing. Therefore, in this case, the control unit 11 outputs an alert message, such as "Please reduce your speed," from the speaker 20 to alert the driver.

[0047] Next, the control unit 11 determines the danger rank of the event for which the alert was output (S28). In the case of an event of excessive speeding while backing up, the control unit 11 identifies the danger rank according to the vehicle speed while backing up. For example, the control unit 11 identifies the danger rank as rank 1 if the speed exceeds the predetermined speed by 2 km / h or more but less than 4 km / h; as rank 2 if the speed exceeds the predetermined speed by 4 km / h or more but less than 6 km / h; as rank 3 if the speed exceeds the predetermined speed by 6 km / h or more but less than 8 km / h; as rank 4 if the speed exceeds the predetermined speed by 8 km / h or more but less than 10 km / h; and as rank 5 if the speed exceeds the predetermined speed by 10 km / h or more. Here, the control unit 11 may also track the driver's line of sight or facial orientation based on an image of the driver captured by the in-vehicle camera 19, determine whether the driver is checking the rear of the vehicle, the surroundings of the vehicle, etc., and identify the danger rank according to the identification result.

[0048] Next, control unit 11 reads out video data for a predetermined period of time (e.g., 7 seconds) before and after the occurrence of the event from the video data captured by cameras 18 and 19 and stored in storage medium 16a (S29). Then, control unit 11 generates event information related to the event for which an alert was output in step S27 (S30). Here, control unit 11 generates the event information including the date and time at this point (date and time the event occurred), the location measured by positioning unit 17 at this point (location of the event), the vehicle speed acquired from vehicle speed sensor 21a at this point (vehicle speed at the time the event occurred), the type of event (danger) (here, excessive speed while backing up), the danger rank determined in step S28, and the video data read out in step S29. Control unit 11 associates the generated event information with the vehicle license plate number or the driver ID of the driver and transmits it to server 30 (S31).

[0049] The control unit 31 of the server 30 receives the event information transmitted from the drive recorder 10 and stores the received event information in the driver DB 32b (S32). Next, the control unit 31 generates notification information for notifying the business operator of the information related to the event stored in the driver DB 32b (S33). In this example, the control unit 31 generates notification information as shown in FIG. 8B. The notification information shown in FIG. 8B has the same content as the notification information shown in FIG. 8A. Note that the notification information shown in FIG. 8B includes "excessive speed while backing" as an event type. The control unit 31 transmits the generated notification information to the business operator terminal 40 using the message sending / receiving app (S34). Here, too, the control unit 41 of the business operator terminal 40 receives the notification information transmitted from the server 30 using the message sending / receiving app, and when the message sending / receiving app is launched, displays the notification information received from the server 30 on the display unit 45 to notify the user of the business operator terminal 40.

[0050] If it is determined that the vehicle speed during backing is not equal to or greater than the predetermined speed (S26: NO), the control unit 11 skips the processes of steps S27 to S31. The drive recorder 10 of this embodiment terminates the process of capturing images by the cameras 18 and 19 and terminates its operation, for example, when the vehicle engine is turned off or when an instruction to terminate capturing is received. Therefore, the control unit 11 determines whether or not the above-described process should be terminated (S35). If it is determined that the process should not be terminated (S35: NO), the control unit 11 returns to the process of step S14 and repeats the processes of steps S14 to S22 and S26 to S31 based on the video data, vehicle speed information, and gear shift information acquired by the processes started in steps S11 to S13. If it is determined that the process should be terminated (S35: YES), the control unit 11 terminates the series of processes.

[0051] Through the above-described process, the drive recorder 10 monitors whether the driver is sufficiently checking the surroundings of the vehicle when the vehicle is backing up and whether the vehicle speed (reverse speed) exceeds a predetermined speed, thereby detecting the occurrence of an event related to dangerous driving, such as the driver's insufficient checking or speeding. Furthermore, when the drive recorder 10 detects the occurrence of an event, it outputs an alert to alert the driver and notifies the server 30 of the details of the event. As a result, information on events detected by each drive recorder 10 is accumulated in the server 30. Note that in the process shown in FIGS. 5 and 6, the control unit 11 of the drive recorder 10 may execute the processes of steps S16 to S22 and steps S26 to S31 in parallel. In this case, the process of determining whether the driver has insufficiently checked the surroundings while backing up and outputting an alert in steps S16 to S22 and the process of determining whether the driver has exceeded the speed limit while backing up and outputting an alert in steps S26 to S31 can be executed in parallel.

[0052] Next, a process for viewing event information accumulated in the server 30 by the above-described process using the business operator terminal 40 will be described. Fig. 9 is a flowchart showing an example of the procedure for viewing event information, and Figs. 10 to 12 are explanatory diagrams showing example screens. In Fig. 9, the left side shows the process performed by the business operator terminal 40, and the right side shows the process performed by the server 30. In the following process, it is assumed that the business operator has previously registered as a user to use the website 32S (danger notification site) provided by the server 30, and has performed a login process to the server 30 (danger notification site 32S) using an ID and password. Part of the following process may be realized by a dedicated hardware circuit.

[0053] In the information processing system of this embodiment, a person in charge of a business who wishes to view event information stored in server 30 accesses danger notification site 32S (server 30) using business terminal 40. Then, the person in charge views event information of drivers belonging to the business via danger notification site 32S. Control unit 41 of business terminal 40 accesses danger notification site 32S provided by server 30 in accordance with an instruction from the person in charge via input unit 44 (S41). Here, control unit 31 may access danger notification site 32S by activating browser 42AP and accessing a specified URL, or may access danger notification site 32S by activating an application installed on business terminal 40.

[0054] The control unit 31 of the server 30 transmits to the business operator terminal 40 a web page in response to access from the business operator terminal 40, in this case an input screen for inputting search conditions for searching for event information (S42). FIG. 10 shows an example of the input screen, and the input screen shown in FIG. 10 displays the name of the business operator of the business operator terminal 40. The input screen also has an input field for specifying the business's business office or sales office (group) as search conditions, an input field for specifying a period, an input field for specifying the type of event, and a search button for instructing execution of a search process. Each input field may be configured to allow input of any information or date, or may have a pull-down menu for selecting any one of multiple options. The pull-down menu provided in the input field for the period may be configured to display a calendar from which any date can be selected. In the example shown in Figure 10, the pull-down menu provided in the type input field has menu items such as "When backing up" for specifying all event information detected when backing up, "Insufficient confirmation when backing up" for specifying event information regarding insufficient confirmation when backing up, "Excessive speed when backing up" for specifying event information regarding excessive speed when backing up, "Danger rank 1 and 2 only" for specifying event information determined to be danger rank 1 or 2, and "Danger rank 3 to 5" for specifying event information determined to be danger rank 3 to 5.

[0055] The control unit 41 of the business operator terminal 40 receives the input screen sent by the server 30 and displays it on the display unit 45 (S43). The business operator's representative enters search conditions related to the event information they wish to search for into each input field on the input screen. The control unit 41 of the business operator terminal 40 accepts the search conditions entered into each input field and displays the accepted search conditions in the respective input fields (S44). The control unit 41 also determines whether the search button on the input screen has been operated (S45). If it determines that the search button has not been operated (S45: NO), the control unit 41 returns to the processing of step S44 and continues accepting input of search conditions into the input fields.

[0056] When the control unit 41 determines that the search button has been operated (S45: YES), it transmits the search conditions entered in each input field to the server 30 (S46). The control unit 31 of the server 30 receives the search conditions transmitted by the business operator terminal 40 and reads out event information that matches the received search conditions from the business operator's driver DB 32b (S47). Here, the control unit 31 identifies drivers who belong to a group (business office, sales office, etc.) included in the search conditions based on the driver information of each driver stored in the driver DB 32b. Then, the control unit 31 extracts event information that matches the period and event type included in the search conditions from the event information of the identified drivers and reads it out from the driver DB 32b. Based on the read event information, the control unit 31 generates a report list screen for reporting detected events (S48).

[0057] FIG. 11 shows an example of a report list screen. In addition to the configuration shown in FIG. 10, the screen shown in FIG. 11 displays a list of event information searched based on search criteria entered in each entry field. In the example shown in FIG. 11, "Kanagawa Office, Kanto Region" is selected as the group to be searched, "November 1, 2021 to November 30, 2021" is selected as the period to be searched, and "Exceeding Speed ​​While Backing" is selected as the type of search target. The event information displayed on the report list screen includes the date and time of the event, the driver ID and name of the driver, the vehicle license plate number, the type of event (type of danger), and the danger rank. This information can be read from the driver DB 32b. The report list screen also displays four operation buttons B1 to B4 associated with each event information. Operation button B1 is a download button for issuing an instruction to download video data before and after the corresponding event occurred, and a link for downloading video data stored in the server 30 is set. Operation button B2 is a map button for issuing an instruction to display a map of the location where the corresponding event occurred, and a link is set to display a map of the location where the event occurred that is stored in server 30. Operation button B3 is a play button for issuing an instruction to play video data before and after the occurrence of the corresponding event, and a link is set to play video data that is stored in server 30. Operation button B4 is a delete button for issuing an instruction to delete the corresponding event information.

[0058] The control unit 31 transmits the generated report list screen to the provider terminal 40 (S49), and the control unit 41 of the provider terminal 40 receives the report list screen transmitted by the server 30 and displays it on the display unit 45 (S50). In the provider terminal 40 that displays the report list screen, the control unit 41 determines whether or not any of the operation buttons B1 to B4 corresponding to any of the event information has been operated, and if it determines that any of the operation buttons B1 to B4 has been operated, it executes a process corresponding to the operated operation button B1 to B4 for the selected event information. Note that Fig. 9 illustrates only the process that the provider terminal 40 and the server 30 perform when the play button B3 is operated.

[0059] Although not shown in Fig. 9, when any of the download buttons B1 is operated on the report list screen, the control unit 41 of the operator terminal 40 requests the server 30 to download the video data stored in the storage unit 32, following the link set in the operated download button B1. The control unit 31 of the server 30 reads the video data requested by the operator terminal 40 from a predetermined area (video folder) in the storage unit 32 and transmits it to the operator terminal 40, and the operator terminal 40 receives the video data transmitted by the server 30 and stores it in the storage unit 42. When the download button B1 is operated, the control unit 41 receives, via the input unit 44, designation of storage destination information (e.g., folder name and file name) for the video data downloaded from the server 30, and stores the received video data in the received storage destination.

[0060] Furthermore, when any of the map buttons B2 is operated on the report list screen, the control unit 41 of the business operator terminal 40 receives map data of the location where the selected event occurred, for example, from the server 30, according to the link set in the operated map button B2, and displays the map data on the display unit 45. Note that the control unit 41 may receive the map data of the location where the event occurred from a server that provides a map application. Furthermore, when any of the delete buttons B4 is operated on the report list screen, the control unit 41 requests the server 30 to delete the event information corresponding to the operated delete button B4. When the business operator terminal 40 requests the deletion of any of the event information, the control unit 31 of the server 30 deletes the event information corresponding to the request from the driver DB 32b. Note that the control unit 31 may be configured to store information indicating the deletion in the driver DB 32b, in association with the event information, instead of deleting the event information from the driver DB 32b. Event information deleted from the driver DB 32b is also deleted from the report list screen, and therefore the report list screen displayed on the business operator terminal 40 is updated to show that the selected event information has been deleted.

[0061] Returning to the explanation of FIG. 9, in the operator terminal 40 displaying the report list screen, the control unit 41 determines whether any of the play buttons B3 has been operated (S51). If it determines that none of the play buttons B3 have been operated (S51: NO), the control unit 41 waits. If the control unit 41 determines that any of the download button B1, map button B2, or delete button B4 has been operated, the control unit 41 performs the above-described process corresponding to the operated button B1, B2, or B4. If it determines that any of the play buttons B3 has been operated (S51: YES), the control unit 41 requests the server 30 to play video data stored in the storage unit 32, following the link set for the operated play button B3 (S52).

[0062] When the control unit 31 of the server 30 receives a request to play video data from the business operator terminal 40, it reads the requested video data from a predetermined area (video folder) in the storage unit 32 (S53). Then, based on the read video data, the control unit 31 generates a video screen for providing the video data to the business operator (S54). FIG. 12 shows an example of a video screen. The screen shown in FIG. 12 displays, for a selected event, the driver's name, the time of occurrence, the type of event, the speed at which the event occurred, and video data captured by the exterior camera 18 and the interior camera 19 before and after the event. This information can be read from the driver DB 32b. In the example shown in FIG. 12, the video data captured by the exterior camera 18 (e.g., rear image data) is displayed on a main screen with a large display area, and the video data captured by the interior camera 19 is displayed on a sub-screen with a smaller display area. 12, the recording time (7 seconds in FIG. 12), the time indicating the playback position (0 seconds in FIG. 12), and an indicator indicating the playback position relative to the recording time are displayed in association with each video. Also, the screen shown in FIG. 12 includes a play / stop button B5 for instructing playback and stopping, an audio button B6 for instructing audio output and stopping, and a full-screen button B7 for instructing full-screen display and stopping. The screen shown in FIG. 12 also includes a button B8 for instructing two videos to return to the beginning (the playback position at 0 seconds), a play / stop button B9 for instructing playback and stopping, a screen switch button B10 for instructing switching between videos displayed on the main screen and the sub-screen, and a sub-screen button B11 for instructing switching between displaying and hiding the sub-screen. The server 30 may generate a video screen such as that shown in FIG. 12 for each event in advance and store it in the storage unit 32. In this case, when the provider terminal 40 requests playback of video data (video screen), the server 30 can read the video screen from the storage unit 32 and provide it to the provider terminal 40.

[0063] The control unit 31 (output unit) transmits the generated video screen to the business operator terminal 40 (S55), and the control unit 41 of the business operator terminal 40 receives the video screen transmitted by the server 30 and displays it on the display unit 45 (S56). As a result, a video screen such as that shown in Fig. 12 is displayed on the business operator terminal 40. By playing back each video displayed on the video screen, the business operator's personnel can check the video before and after the event was detected and determine whether the detected event was appropriate.

[0064] The control unit 41 determines whether or not to end the browsing process of the danger reporting site 32S described above (S57). For example, when a logout button provided on the screen shown in Fig. 11 is operated, the control unit 41 accepts an instruction to end the browsing process and determines to end the above-mentioned process. When the control unit 41 determines not to end the above-mentioned process (S57: NO), it returns to the process of step S44 and repeats the processes of steps S44 to S56. Specifically, when search conditions are entered in each input field on the screen shown in Fig. 11, the control unit 41 accepts the entered search conditions and performs a process of acquiring from the server 30 a report list screen that matches the accepted search conditions.

[0065] When it is determined that the above-described processing should be ended (S57: YES), the control unit 41 instructs the server 30 to execute a logout process, and then ends the series of processing. Note that when the control unit 31 of the server 30 is instructed to execute a logout process by the operator terminal 40, it executes the logout process and then ends the series of processing.

[0066] According to the above-described process, in this embodiment, when dangerous driving that could lead to an accident is detected while a vehicle is backing up, an alert is output to the driver to warn them and the operator is notified of the issuance of the alert. Operator personnel can view video footage of the events before and after the event via the notification information shown in FIG. 8 , and can also view video footage of the events before and after the event via screens such as those shown in FIGS. 11 and 12 by accessing the danger notification site 32S provided by the server 30 from the operator terminal 40. If the operator detects a dangerous driving condition through the video footage, they can provide guidance to the driver to improve their driving, thereby preventing an accident from occurring. Viewing the video footage via the notification information can be completed in a short time. Furthermore, since the notification information is sent to the operator immediately after the event occurs, a response based on the notification information can be made quickly. Viewing the video footage via the danger notification site 32S can collectively view events detected for multiple drivers by their respective affiliations, and can also collectively view the events by type and time of occurrence, thereby enabling efficient viewing.

[0067] In this embodiment, the drive recorder 10 detects the occurrence of an event (unsafe driving state), outputs an alert to the driver, determines a danger level, and transmits event information to the server 30. In this configuration, the server 30 may also perform part of the processing performed by the drive recorder 10. For example, the server 30 may perform processing to determine the danger level based on the driving state of the vehicle. In this case, the drive recorder 10 generates event information including the date and time of the event, the location of the event, and the type of the event, as well as vehicle speed information, gear shift information, and video data before and after the event, and transmits the event information to the server 30 in association with the vehicle license plate number or the driver ID of the driver. The server 30 then determines a danger level based on the vehicle speed information, gear shift information, or video data received from the drive recorder 10, and stores the date and time of the event, the location of the event, the type of event, the vehicle speed at the time of the event, and the video data received from the drive recorder 10, as well as the determined danger level, in the driver DB 32b in association with the vehicle license plate number or the driver ID. Furthermore, the server 30 may perform a process of identifying a danger level from a captured image of the driver, and a process of determining the driver's behavior from a captured image of the driver and identifying a danger level according to the determination result. Even in such a configuration, the same processes as those of the present embodiment described above are possible, and similar effects can be obtained.

[0068] (Embodiment 2) This embodiment describes an information processing system that uses a learning model to determine the driver's behavior when a business operator checks the video captured by the cameras 18, 19 of the drive recorder 10 upon the occurrence of an event via notification information or a danger notification site 32S. The information processing system of this embodiment can be realized by a device similar to that of the information processing system of the first embodiment, and therefore a description of the configuration will be omitted. In this embodiment, in addition to the configuration shown in Fig. 3, the server 30 stores in the storage unit 32 a learning model that has been trained to output the driver's behavior in the captured image when an image of the driver captured by the in-vehicle camera 19 is input.

[0069] FIG. 13 is an explanatory diagram showing an example of the configuration of a learning model according to the second embodiment. The learning model shown in FIG. 13 is trained to receive a captured image of the driver as input, perform a calculation to determine the driver's behavior in the captured image based on the input captured image, and output the calculation result. The learning model shown in FIG. 13 has multiple output nodes. Output node 0 outputs the probability that the driver's behavior is determined to be visually checking the area behind the vehicle. Output node 1 outputs the probability that the driver is checking the monitor (display unit 15 of the drive recorder 10). Output node 2 outputs the probability that the driver is visually checking the area in front of the vehicle. Output node 3 outputs the probability that the driver is visually checking the left and right sides of the vehicle. Output node 4 outputs the probability that the driver is performing other behaviors. The output value of each output node is, for example, a value between 0 and 1.0, and the sum of the determination probabilities output from each output node is 1.0.

[0070] The learning model shown in FIG. 13 is generated by machine learning an untrained learning model using training data including training images and information (correct labels) indicating the behavior determined for the driver in the captured images. When a training image is input, the learning model learns so that the output value from the output node corresponding to the behavior indicated by the correct label approaches 1.0 and the output values ​​from the other output nodes approach 0.0. In the learning process, the learning model performs calculations based on the input captured images to calculate output values ​​from each output node. The learning model then compares the calculated output values ​​of each output node with the value corresponding to the correct label (0 or 1) and optimizes parameters used in the calculation process so that each output value approximates the value corresponding to the correct label. Here, the optimized parameters are weights between neurons in the learning model, and the parameter optimization method is not particularly limited. As a result, when a captured image is input, a learning model trained to determine the driver's behavior in the captured image is obtained. As with the learning model shown in FIG. 13, the input captured image may be a still image or a video.

[0071] The learning model is learned by another learning device. The learned learning model generated by learning on the other learning device is downloaded from the learning device to the server 30 via the network N or a portable storage medium 30a, for example, and stored in the storage unit 32. Note that the learning model is not limited to the configuration shown in FIG. 13, and the number of output nodes can be the number of behaviors to be determined.

[0072] In the information processing system of this embodiment, the drive recorder 10 and the server 30 execute the same processes as those in Fig. 5 and Fig. 6. Therefore, in this embodiment as well, the drive recorder 10 determines whether an event has occurred based on the vehicle's running state, specifically, vehicle speed information output from the vehicle speed sensor 21a and gear shift information output from the transmission 21b. If an event occurrence is detected, the drive recorder 10 can output an alert to the driver and store information related to the event in the server 30.

[0073] Fig. 14 is a flowchart showing an example of the procedure for viewing event information in the second embodiment, and Fig. 15 is an explanatory diagram showing an example screen. The process shown in Fig. 14 is the process shown in Fig. 9 with steps S61 to S65 added between steps S56 and S57. Explanation of the same steps as in Fig. 9 will be omitted. Also, Fig. 14 does not show steps S41 to S55 in Fig. 9.

[0074] In this embodiment, the control unit 41 of the business operator terminal 40 and the control unit 31 of the server 30 perform the same processes as steps S41 to S56 in Fig. 9. This allows a business operator's representative to access the danger notification site 32S using the business operator terminal 40 and view information about events that have occurred to drivers belonging to the business operator. In this embodiment, in step S56, the control unit 41 displays a video screen such as that shown in Fig. 15A on the display unit 45. The screen shown in Fig. 15A has the same configuration as the video screen shown in Fig. 12, and also includes an AI determination button B12 for issuing an instruction to automatically determine the driver's behavior from the displayed video of the driver.

[0075] In the operator terminal 40 displaying the video screen, the control unit 41 determines whether the AI ​​judgment button B12 has been operated (S61), and if it determines that the AI ​​judgment button B12 has not been operated (S61: NO), it waits. At this time, the control unit 41 executes a process corresponding to the operated button each time it receives an operation for a button on the video screen. If it determines that the AI ​​judgment button B12 has been operated (S61: YES), the control unit 41 requests the server 30 to perform an AI judgment for the event currently being displayed on the video screen (S62).

[0076] When the control unit 31 of the server 30 receives a request from the business operator terminal 40 to perform AI determination, the control unit 31 inputs the video data of the requested event into the learning model shown in FIG. 13 and determines the behavior of the driver captured in the video data based on the output information from the learning model (S63). Here, the control unit 31 may read from the driver DB 32b the video data (face image data) of the driver captured by the in-vehicle camera 19 among the video data of the requested event and input it to the learning model, or may input the video data of the driver among the video data read from the driver DB 32b in step S53 into the learning model. The control unit 31 also identifies the behavior of the driver in the captured image as the behavior corresponding to the output node that outputs the largest output value (discrimination probability) among the output values ​​output from the learning model.

[0077] The control unit 31 transmits the determination result (the identified behavior) to the business operator terminal 40 (S64). For example, when the control unit 31 determines that the driver is visually checking the area behind the vehicle, it transmits information indicating visual checking of the area behind the vehicle (for example, "visual check behind") to the business operator terminal 40. When the control unit 31 determines that the driver is checking a monitor, it transmits information indicating checking the monitor to the business operator terminal 40, and when the control unit 31 determines that the driver is visually checking the area ahead of the vehicle, it transmits information indicating visual checking of the area ahead of the vehicle. When the control unit 31 determines that the driver is visually checking the left or right side of the vehicle, it transmits information indicating visual checking of the left and right sides of the vehicle to the business operator terminal 40, and when the control unit 31 determines that the driver is visually checking another behavior, it transmits information indicating another behavior.

[0078] The control unit 41 of the business operator terminal 40 receives the determination result transmitted by the server 30 and displays the received determination result on the video screen being displayed on the display unit 45 (S65). FIG. 15B shows an example of how the determination result is displayed. In the example shown in FIG. 15B, the determination result (visual confirmation behind in FIG. 15B) is displayed to the right of the AI ​​determination button B12. This allows the business operator's staff member to check the determination result by the server 30 by operating the AI ​​determination button B12 before checking the video displayed on the video screen, for example. In this case, the staff member can select the video to be checked by themselves, taking into consideration the determination result by the server 30. This eliminates the need for the staff member to check the video of all events, thereby reducing the workload.

[0079] In this embodiment, the same effects as those of the first embodiment can be obtained. Furthermore, in this embodiment, in response to a request from a user (a person in charge of the business) via the business terminal 40, the server 30 can use a learning model to determine the driver's behavior from video data of the driver before and after the occurrence of an event, and present the determined behavior to the user. Therefore, the user can determine whether the driver has engaged in dangerous driving in consideration of the determination result by the server 30, and the user's determination work can be assisted. In this embodiment as well, the modified examples described in the first embodiment as appropriate can be applied.

[0080] In this embodiment, the server 30 is not limited to a configuration in which the server 30 determines the driver's behavior using a learning model when the AI ​​determination button B12 on the video screen is operated. For example, in step S54 in Fig. 9, the control unit 31 of the server 30 may determine the driver's behavior from the video data using a learning model when generating the video screen. In this case, the video screen including the driver's behavior determined by the server 30 can be provided to the business operator terminal 40.

[0081] (Embodiment 3) A modified example of the process for detecting an event (dangerous driving) when backing up will be described. FIGS. 16 and 17 are flowcharts showing another example of the process procedure for detecting the occurrence of an event. The process shown in FIGS. 16 and 17 is the process shown in FIGS. 5 and 6, with steps S81 and S82 added between steps S13 and S14, and step S83 added between YES in step S26 and step S27. Explanations of the same steps as in FIGS. 5 and 6 will be omitted. Also, steps S11 to S13 in FIG. 5 are not shown in FIG. 16.

[0082] In this embodiment, after the processes of steps S11 to S13, the control unit 11 of the drive recorder 10 determines whether the vehicle has stopped based on the vehicle speed information sequentially acquired by the acquisition process started in step S12 (S81). Here, the control unit 11 determines whether the vehicle speed information transmitted from the vehicle speed sensor 21a has become 0. If it is determined that the vehicle has stopped (S81: YES), the control unit 11 starts a process of measuring the vehicle's stopped time (S82). If it is determined that the vehicle has not stopped (S81: NO), the control unit 11 skips the process of step S82. Thereafter, the control unit 11 executes the processes from step S14 onwards.

[0083] In this embodiment, if it is determined in step S14 that reverse gear is not engaged (S14: NO), the control unit 11 returns to the process of step S81 and repeats the determination of whether the vehicle is stopped and the determination of whether reverse gear is engaged. Also in this embodiment, in step S17, if the vehicle was stopped before reverse gear was engaged, the control unit 11 measures the vehicle's stopped time and, when determining whether a predetermined time (e.g., 3 seconds) has elapsed since reverse gear was engaged, also determines the stopped time. Specifically, if the vehicle was stopped before reverse gear was engaged, the control unit 11 determines whether the elapsed time from when the vehicle stopped until reverse gear was engaged and reverse driving started is equal to or greater than a predetermined time (e.g., 3 seconds). That is, in this embodiment, if the vehicle was stopped before reverse gear was engaged, the control unit 11 determines whether the total time obtained by adding the vehicle's stopped time and the elapsed time from when reverse gear was engaged to when reverse driving started is equal to or greater than a predetermined time. If the total time is less than the predetermined time (less than a predetermined period), the control unit 11 determines that an event has occurred and executes the processes of step S18 and subsequent steps. This is because some drivers may check the area behind the vehicle before shifting into reverse gear and starting to back up. Therefore, by determining whether a predetermined time has passed since the vehicle stopped until the driver started to back up, it becomes possible to make an appropriate determination taking into account the time the vehicle was stopped before shifting into reverse gear. Note that at this time, the control unit 11 may be configured to use a learning model such as that shown in Fig. 13 to determine the driver's behavior from the video of the driver captured by the in-vehicle camera 19, determine whether the driver is checking the area around the vehicle, and measure the time the driver is checking.

[0084] In this embodiment, if it is determined in step S26 that the vehicle speed during backing is equal to or greater than the predetermined speed (S26: YES), the control unit 11 determines whether a vehicle speed (reverse speed) less than the predetermined speed has been detected for a predetermined time (e.g., 2 seconds) or more (S83). If it is determined that a vehicle speed less than the predetermined speed has been detected for a predetermined time or more (S83: YES), the control unit 11 skips steps S27 to S31 and proceeds to step S35. That is, even if excessive speeding is detected during backing, if the vehicle subsequently remains below the predetermined speed for a predetermined time, it is not considered to be subject to speeding judgment. This is because, even if the vehicle temporarily exceeds the speed limit, if the vehicle subsequently remains below the predetermined speed for a predetermined time, it is considered to be reversed at a speed less than the predetermined speed from the driver's perspective. Therefore, even if the vehicle temporarily exceeds the speed limit, if the vehicle subsequently remains below the predetermined speed for a predetermined time, it is not considered to be subject to speeding judgment during backing, thereby excluding driving conditions that are unlikely to lead to an accident from those subject to an alert.

[0085] If it is determined that a vehicle speed below the predetermined speed has not been detected for a predetermined period of time (S83: NO), that is, if the vehicle is speeding while backing up, the control unit 11 executes the processes from step S27 onwards. As a result, the control unit 11 can output an alert to the driver regarding speeding while backing up, and can also transmit event information regarding speeding while backing up to the server 30.

[0086] In the above-described process, the process of determining whether an event (dangerous driving) has occurred while backing up may be started, for example, after a predetermined time (e.g., 2 seconds) has elapsed since the reverse gear was engaged, or after detecting that the vehicle has stopped (vehicle speed is 0) since the reverse gear was engaged. Specifically, the control unit 11 of the drive recorder 10 may be configured to determine whether a predetermined time (e.g., 2 seconds) has elapsed since the reverse gear was engaged after step S15 in FIG. 16, wait if it determines that the predetermined time has not elapsed, and execute the process from step S16 onwards if it determines that the predetermined time has elapsed. Alternatively, the control unit 11 may be configured to determine whether the vehicle has stopped after step S15 in FIG. 16, wait if it determines that the vehicle has not stopped, and execute the process from step S16 onwards if it determines that the vehicle has stopped. When performing such a process, the control unit 11 may be controlled so that the process of determining whether an event (insufficient confirmation while backing up) has occurred is not performed for a certain period of time after the reverse gear was engaged (the predetermined period of time or the time until the vehicle stops). For example, if the vehicle is shifted into reverse gear before coming to a stop from a forward driving state, it is possible that an event of insufficient confirmation while reversing may be detected based on the vehicle speed while driving forward. However, with the above-described configuration, it is possible to prevent an event of insufficient confirmation while reversing from being detected based on the vehicle speed while driving forward.

[0087] Furthermore, when parking in a parking space, etc., the driver repeatedly moves forward and backward (backing) while turning the steering wheel. At this time, each time the driver shifts into reverse gear, a process for determining an event of insufficient confirmation while backing up is performed, which may result in continuous output of alerts for insufficient confirmation while backing up. To avoid this situation, for example, after the reverse gear is released, the control unit 11 of the drive recorder 10 may be configured not to detect the reverse gear until a predetermined time (e.g., 10 seconds) has elapsed. Specifically, after detecting the reverse gear in step S14 of FIG. 16, the control unit 11 of the drive recorder 10 may be configured to perform the processes of steps S15 to S22 while determining whether the reverse gear has been released. If it determines that the reverse gear has not been released, the control unit 11 continues the processes of steps S15 to S22. If it determines that the reverse gear has been released, the control unit 11 may be configured not to perform the processes of steps S15 to S22 for a predetermined time (e.g., 10 seconds). In this case, even if the reverse gear is detected within the predetermined time after the reverse gear is released, the occurrence of an event (dangerous driving) is not detected based on the reverse gear. When performing this type of processing, when repeatedly turning the steering wheel while moving forward and backward, it is possible to avoid performing a judgment process to determine whether there is insufficient confirmation when reversing each time the reverse gear is engaged, thereby preventing unnecessary alerts from being output continuously.

[0088] In each of the above-described embodiments, the drive recorder 10 may be configured to switch between displaying a front image captured in front of the vehicle and a rear image captured in rear of the vehicle on the display unit 15 when the vehicle is moving forward and when moving backward (backing up). In this case, the exterior camera 18 of the drive recorder 10 is configured to capture images of the front and rear of the vehicle, and sequentially stores the captured image data (front image data and rear image data) in the storage medium 16a. Furthermore, when the drive recorder 10 is in a gear other than reverse gear, the drive recorder 10 displays, on the display unit 15, front image data captured in front of the vehicle or map data being guided by the navigation device. When the drive recorder 10 is in reverse gear, the drive recorder 10 displays, on the display unit 15, rear image data captured in rear of the vehicle. When the drive recorder 10 is in reverse gear, the rear image data is displayed on the display unit 15. Since an image of the rear of the vehicle is displayed on the display unit 15 in this way, the drive recorder 10 can be used as a backup monitor, allowing the driver to check the rear of the vehicle from the displayed image. Furthermore, the drive recorder 10 may be configured to output a message from the speaker 20, after switching to the display of rearward video data, to notify the driver that backing up can begin. In this case, for example, a message such as "Please back up while paying attention to what is behind you" can be output to the driver, urging them to check the surroundings of the vehicle before starting backing up. This can alert the driver when backing up, and is expected to prevent accidents from occurring while backing up.

[0089] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0090] 10. Drive Recorder 11 Control section 12 Storage section 13 Communications Department 15 Display section 16 Memory reading section 18 Exterior camera 19 In-car camera 20 speakers 21 In-vehicle communication unit 30 servers 31 Control Unit 32 Storage section 33 Communications Department 40 Operator terminal 41 Control Unit 45 Display section 16a Storage medium 32b driver DB

Claims

1. Detects the vehicle's reverse gear input, After detecting the input of the reverse gear, a determination process is started to determine whether or not dangerous driving related to reverse driving is occurring; In the determination process, if reverse movement of the vehicle is detected within a predetermined period after input of reverse gear is detected, it is determined that dangerous driving related to insufficient confirmation while backing up is occurring, obtaining a reverse speed of the vehicle; In the determination process, it is determined whether the acquired reverse speed is equal to or greater than a predetermined speed, and if the time during which the reverse speed is determined to be less than the predetermined speed continues for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is not determined that dangerous driving related to speeding while backing has occurred, and if the time during which the reverse speed is determined to be less than the predetermined speed does not continue for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is determined that dangerous driving related to speeding has occurred. A program that causes a computer to perform a process.

2. Obtain the specification of any period within a preset period, Set the specified period to the predetermined period The program according to claim 1 , which causes the computer to execute a process.

3. If the vehicle is detected as stopped before the input of reverse gear is detected, a time during which the vehicle is stopped is measured; In the determination process, if the total time of the stop time measured until the input of the reverse gear is detected and the time from the input of the reverse gear to the detection of the reverse movement of the vehicle is less than the predetermined period, it is determined that dangerous driving related to insufficient confirmation while backing up is occurring.

3. The program according to claim 1, which causes the computer to execute processing.

4. The determination process is started when a predetermined time has elapsed since the input of reverse gear is detected, or when the vehicle is detected to be stopped after the input of reverse gear is detected.

4. The program according to claim 1, which causes the computer to execute a process.

5. If a release of the reverse gear is detected after the reverse gear is detected, the determination process is not executed even if the reverse gear is detected within a predetermined time thereafter.

5. The program according to claim 1.

6. When it is determined that the dangerous driving is occurring, an alert is output to the driver of the vehicle.

6. The program according to claim 1, which causes the computer to execute a process.

7. Acquire image data of the driver of the vehicle; extracting image data for a predetermined period of time including the timing of occurrence of the dangerous driving from the acquired image data; The extracted image data is associated with information indicating the details of the detected dangerous driving, and the information is output to a predetermined terminal.

7. The program according to claim 1, which causes the computer to execute a process.

8. Acquire facial image data of the driver of the vehicle; Based on the acquired face image data, it is determined whether the driver is checking a monitor or whether the driver is visually checking a rear area of ​​the vehicle.

8. The program according to claim 1, which causes the computer to execute a process.

9. Detects the vehicle's reverse gear input, After detecting the input of the reverse gear, a determination process is started to determine whether or not dangerous driving related to reverse driving is occurring; In the determination process, if reverse movement of the vehicle is detected within a predetermined period after input of reverse gear is detected, it is determined that dangerous driving related to insufficient confirmation while backing up is occurring, obtaining a reverse speed of the vehicle; In the determination process, it is determined whether the acquired reverse speed is equal to or greater than a predetermined speed, and if the time during which the reverse speed is determined to be less than the predetermined speed continues for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is not determined that dangerous driving related to speeding while backing has occurred, and if the time during which the reverse speed is determined to be less than the predetermined speed does not continue for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is determined that dangerous driving related to speeding has occurred. An information processing method in which processing is performed by a computer.

10. In a drive recorder equipped with a control unit, The control unit Detects the vehicle's reverse gear input, After detecting the input of the reverse gear, a determination process is started to determine whether or not dangerous driving related to reverse driving is occurring; In the determination process, if reverse movement of the vehicle is detected within a predetermined period after input of reverse gear is detected, it is determined that dangerous driving related to insufficient confirmation while backing up is occurring, obtaining a reverse speed of the vehicle; In the determination process, it is determined whether the acquired reverse speed is equal to or greater than a predetermined speed, and if the time during which the reverse speed is determined to be less than the predetermined speed continues for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is not determined that dangerous driving related to speeding while backing has occurred, and if the time during which the reverse speed is determined to be less than the predetermined speed does not continue for a predetermined period of time or more after it is determined that the reverse speed is equal to or greater than the predetermined speed, it is determined that dangerous driving related to speeding has occurred. Drive recorder.

11. A drive recorder having a control unit and a server that communicates with the drive recorder, The control unit of the drive recorder Detects the vehicle's reverse gear input, After detecting the input of the reverse gear, a determination process is started to determine whether or not dangerous driving related to reverse driving is occurring; In the determination process, if reverse movement of the vehicle is detected within a predetermined period after input of reverse gear is detected, it is determined that dangerous driving related to insufficient confirmation while backing up is occurring, obtaining a reverse speed of the vehicle; In the determination process, it is determined whether the acquired reverse speed is equal to or greater than a predetermined speed, and if, after determining that the reverse speed is equal to or greater than the predetermined speed, the time period during which the reverse speed is determined to be less than the predetermined speed continues for a predetermined period of time or more, it is not determined that dangerous driving related to speeding while backing is occurring, and if, after determining that the reverse speed is equal to or greater than the predetermined speed, the time period during which the reverse speed is determined to be less than the predetermined speed does not continue for a predetermined period of time or more, it is determined that dangerous driving related to speeding is occurring, outputting image data of the driver of the vehicle taken at a predetermined time including the timing of the occurrence of the dangerous driving, rear image data of the rear of the vehicle taken, and driving information including information on the dangerous driving; The server has an output unit that outputs the image data, rear image data, and information about the dangerous driving output by the drive recorder to a terminal associated with the vehicle. Information processing system.

Images