Center device, safe driving education system, and safe driving education method

Abstract

To efficiently provide learning opportunities using an educational content, to further reinforce learning for trainees.SOLUTION: A center device includes a controller. The controller is configured to: receive vehicle data which is data on a situation of a vehicle, from the vehicle; generate a teaching material for additional learning based on a hazardous driving situation indicated by the received vehicle data or learning situation of an educational content that a driver attended in the past; and distribute the teaching material to the driver while changing distribution timing in accordance with the situation of the vehicle indicated by the vehicle data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The disclosed embodiments relate to a center device, a safe driving education system, and a safe driving education method. [Background technology]

[0002] BACKGROUND ART Conventionally, video images captured by an in-vehicle device such as a drive recorder are sometimes used as teaching materials for e-learning, i.e., educational content, for safe driving education within a specific group, for example, within a company.

[0003] In such cases, for example, dangerous driving footage actually taken in a company car driven by an employee is often used. For example, when the on-board device of a company car driven by an employee detects a so-called near miss scene, the on-board device transmits the vehicle data, including the video and location information, taken at that time, to the central device of the safe driving education system.

[0004] The center device then analyzes the vehicle data received from the in-vehicle device and generates educational materials based on the analysis results. For example, if the analysis reveals that the near miss was caused by exceeding the legal speed limit, the center device generates educational materials about complying with the legal speed limit.

[0005] The generated teaching materials are distributed to devices such as smartphones and personal computers (PCs) used by employees within the company, including the people who were actually driving the vehicles in the scenes that served as the source material for the teaching materials. Each employee can then take e-learning courses using the distributed teaching materials via these devices.

[0006] However, in such safe driving education, the learning through e-learning is often not retained, as trainees often make the same mistakes repeatedly on the same questions. Possible reasons for this include trainees not being able to study efficiently due to work commitments, or the learning being so desk-based that it is difficult to link it to real-life situations.

[0007] In order to achieve efficient learning, an information providing device has been proposed that acquires dangerous driver behavior such as sudden braking, sudden acceleration, and ignoring traffic lights based on images taken in the vehicle, and determines whether driver education is necessary based on this information (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2022-186332 Summary of the Invention [Problem to be solved by the invention]

[0009] However, even if students take e-learning courses based on information provided using the above-mentioned conventional technologies, it is difficult to get students who are bored with desk-based learning and have low motivation to continue learning.

[0010] One aspect of the embodiment has been made in consideration of the above, and aims to provide a center device, a safe driving education system, and a safe driving education method that can more efficiently provide learning opportunities through educational content and further solidify the learning in participants. [Means for solving the problem]

[0011] According to one aspect of the embodiment, the center device includes a controller that receives vehicle data from a vehicle, which is data relating to the vehicle's status, generates additional learning materials based on the unsafe driving situation indicated by the received vehicle data or the driver's learning status of educational content that the driver has previously attended, and delivers the learning materials to the driver by changing the delivery timing according to the vehicle's status indicated by the vehicle data. [Effects of the Invention]

[0012] According to one aspect of the embodiment, the controller generates supplementary learning materials, which can be considered supplementary, based on the unsafe driving situation indicated by the vehicle data or the driver's learning status of educational content that the driver has previously attended. The controller then transmits the supplementary learning materials to the driver, i.e., the in-vehicle device, while the vehicle is operating. To avoid interfering with the driver's driving, the controller adjusts the timing of delivery depending on the vehicle's situation, delivering the supplementary learning materials while the vehicle is stopped, parked, or traveling on a straight road. This allows for more efficient provision of learning opportunities using educational content, further solidifying the learning experience for the trainee. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram (part 1) outlining a safe driving education method according to an embodiment. [Figure 2] FIG. 2 is a schematic explanatory diagram (part 2) of the safe driving education method according to the embodiment. [Figure 3] FIG. 3 is a diagram (part 1) showing an example of additional learning materials to be distributed to the drive recorder. [Figure 4] FIG. 4 is a diagram (part 2) showing an example of additional learning materials to be distributed to the drive recorder. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a safe driving education system according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of a drive recorder according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the event condition information. [Figure 8] FIG. 8 is a diagram illustrating an example of the configuration of a center device according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the configuration of a lecture attendance device according to the embodiment. [Figure 10] FIG. 10 is a diagram (part 1) showing a processing sequence executed by the safe driving education system according to the embodiment. [Figure 11]FIG. 11 is a diagram (part 2) showing a processing sequence executed by the safe driving education system according to the embodiment. [Figure 12] FIG. 12 is a supplementary explanatory diagram (part 1) of the control of distribution timing. [Figure 13] FIG. 13 is a supplementary explanatory diagram (part 2) of the control of distribution timing. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the center device, the safe driving education system, and the safe driving education method disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[0015] In the following, a safe driving education system according to the embodiment will be mainly described as a safe driving education system 1 (see FIG. 1). The safe driving education system 1 is a system that generates e-learning teaching materials for safe driving education and distributes them to participants. E-learning is an example of "educational content."

[0016] In the following description, the center device according to the embodiment is assumed to be the center device 100 (see FIG. 1) included in the safe driving education system 1. The safe driving education method according to the embodiment is assumed to be a safe driving education method executed by the controller 103 (see FIG. 8) of the center device 100.

[0017] Furthermore, the expressions "specific," "predetermined," and "constant" in the following description may be read as "predetermined."

[0018] First, an outline of the safe driving education method according to the embodiment will be described with reference to Fig. 1 to Fig. 4. Fig. 1 is a diagram (part 1) outlining the safe driving education method according to the embodiment. Fig. 2 is a diagram (part 2) outlining the safe driving education method according to the embodiment.

[0019] 3 is a diagram (part 1) showing an example of additional learning materials to be distributed to the drive recorder 10. FIG. 4 is a diagram (part 2) showing an example of additional learning materials to be distributed to the drive recorder 10.

[0020] 1, the safe driving education system 1 includes a drive recorder 10, a center device 100, and student devices 200 (200-1, 200-2, ...). The student devices 200 correspond to an example of a "terminal device."

[0021] The drive recorder 10 is a video recording device mounted on a vehicle. The drive recorder 10 according to the embodiment has an in-vehicle camera 12a and an outside-vehicle camera 12b. The in-vehicle camera 12a and the outside-vehicle camera 12b are examples of "cameras." The in-vehicle camera 12a is provided so as to be able to capture video of the inside of the vehicle. The outside-vehicle camera 12b is provided so as to be able to capture video of the outside of the vehicle surroundings.

[0022] While the vehicle is running, the drive recorder 10 records vehicle data, including the interior and exterior images captured by the interior camera 12a and exterior camera 12b, in a ring buffer memory in an overwritable manner for a certain period of time. The certain period is, for example, 24 hours. The vehicle data may include various data indicating the vehicle's status, such as date and time information, location information, vehicle speed, and G-force, in addition to the interior and exterior images.

[0023] The drive recorder 10 is also configured to be able to detect specific events that satisfy preset event conditions. For example, when detecting dangerous driving, the drive recorder 10 detects a specific event when a change in vehicle speed or G-value satisfies an event condition corresponding to the occurrence of an accident or a near miss.

[0024] When the drive recorder 10 detects this specific event, it sets the vehicle data for a certain period of time before and after the detection time to be overwritten. Alternatively, the drive recorder 10 records the vehicle data for a certain period of time before and after the detection time to another recording medium. Note that this overwriting prevention process or the process of recording to another recording medium may be performed in response to an instruction from the center device 100.

[0025] Furthermore, when the drive recorder 10 detects a specific event, it transmits to the center device 100 the vehicle data that is set to be overwrite-prohibited.

[0026] The center device 100 can analyze the vehicle status when a specific event is detected based on the vehicle data transmitted from the vehicle, and can generate e-learning materials based on the analysis results.

[0027] The center device 100 is also configured to be able to provide a service of distributing the generated teaching materials to the student devices 200. The student devices 200 are terminal devices used by students (equivalent to an example of a "user") taking e-learning courses. The student devices 200 are realized, for example, by a PC (Personal Computer) such as the student device 200-1, or a smartphone such as the student device 200-2.

[0028] In such a safe driving education system 1, it is desirable to provide learning opportunities through e-learning more efficiently and further solidify learning among participants. Therefore, in the safe driving education method according to the embodiment, the controller 103 of the center device 100 receives vehicle data, which is data relating to the vehicle's status, from the vehicle. The controller 103 also generates additional learning materials based on the dangerous driving situation indicated by the received vehicle data or the learning status of e-learning courses taken by the driver in the past. The controller 103 also distributes the additional learning materials to the driver by changing the distribution timing depending on the vehicle's status indicated by the vehicle data.

[0029] 1, when the drive recorder 10 detects a specific event based on a preset event condition (step S1), it transmits vehicle data for a certain period of time before and after the event detection to the center device 100 (step S2). As already mentioned, the vehicle data includes in-vehicle video, out-vehicle video, date and time information (date and time of event occurrence), location information, vehicle speed, G value, etc.

[0030] Then, the controller 103 of the center device 100 generates e-learning teaching materials based on the received vehicle data (step S3).The controller 103 then distributes the generated teaching materials to each student device 200 (step S4), and the student receives the teaching materials distributed to the student device 200.

[0031] Next, the controller 103 receives the answers from the students from the student devices 200 (step S5). Then, the controller 103 generates additional learning materials based on the learning status of each student including the answers (step S6).

[0032] For example, the controller 103 determines that questions that students repeatedly answer incorrectly or questions with a high error rate during the learning situation are questions that require further learning opportunities, and generates additional learning materials, which can be considered supplementary learning materials, for these questions.

[0033] Then, the controller 103 generates learning event conditions according to the generated additional learning materials, and transmits the learning event conditions to the drive recorder 10 to be set in the drive recorder 10 (step S7).

[0034] The learning event condition is an event condition that triggers control of the timing of distribution of each additional learning material. For example, the learning event condition is a variety of conditions that indicate the arrival of a situation that is at least similar to the situation corresponding to the question that formed the basis of the additional learning material. The learning event condition is configured, for example, by conditions such as location information. Specific examples will be described later using FIG. 7.

[0035] The drive recorder 10 for which the learning event condition has been set becomes capable of detecting a learning event. As shown in Fig. 2, when the drive recorder 10 detects a learning event (step S8), it transmits vehicle data to the center device 100 (step S9). At this time, the drive recorder 10 transmits the vehicle data to the center device 100 not for a fixed period of time, but continuously until, for example, the distribution of the additional learning material to be distributed is completed.

[0036] This allows the controller 103 of the center device 100 to constantly acquire the vehicle status while controlling the timing of distribution of the learning material. Then, when distributing learning materials for additional learning to the drive recorder 10 or the student device 200-2, the controller 103 changes the distribution timing according to the vehicle status (step S10).

[0037] In other words, the controller 103 changes the timing of delivery according to the vehicle's situation so as not to interfere with the driving of the trainee driver by the delivered learning materials, and delivers additional learning materials when the vehicle is stopped, parked, or driving on a straight road. That is, the controller 103 delivers additional learning materials when it detects that the driver is in a safe situation (step S11). Note that the same applies when delivering to the trainee device 200-2 such as a smartphone, as it is likely that the driver is carrying it, so as not to interfere with the driver's driving. By delivering additional learning materials when it detects a safe situation, it is possible to prevent the driver from being distracted by the learning materials and causing a dangerous situation.

[0038] Specifically, the controller 103 distributes educational materials in the form of audio information to the drive recorder 10 while the vehicle is moving or stopped, as shown in Fig. 3. Educational material ex1 provides audio guidance to the driver on the points to check when entering an intersection, which the driver learned in e-learning. Educational material ex2 provides audio guidance to the driver on the "No Parking" sign, which the driver learned in e-learning, by actually looking at it.

[0039] Furthermore, the teaching materials ex3-1 and ex3-2 shown in Fig. 4 are interactive, allowing the driver to respond by voice. In this case, the controller 103 determines the timing of distribution when the dialogue will not interfere with driving, such as when the vehicle is parked or at the end of a drive, as shown in Fig. 4. Note that although Figs. 3 and 4 both show examples of teaching materials using audio information, teaching materials may also be provided using a touch panel mounted on the drive recorder 10 or an in-vehicle display, or other various user interfaces.

[0040] As described above, in the safe driving education method according to the embodiment, the controller 103 of the center device 100 receives vehicle data relating to the vehicle's status from the vehicle. The controller 103 generates additional learning materials based on the dangerous driving status indicated by the received vehicle data or the learning status of e-learning courses taken by the driver in the past. The controller 103 also distributes the additional learning materials to the driver, changing the distribution timing depending on the vehicle's status indicated by the vehicle data.

[0041] Therefore, according to the safe driving education method of the embodiment, the controller 103 generates additional learning materials, which can be considered supplementary, based on the dangerous driving situation indicated by the vehicle data or the learning situation of e-learning courses the driver has taken in the past. The controller 103 then transmits the additional learning materials to the driver, i.e., the in-vehicle device, while the driver is driving the vehicle. In this case, the controller 103 changes the timing of delivery depending on the vehicle's situation, delivering the additional learning materials while the vehicle is stopped, parked, or traveling on a straight road, so as not to interfere with the driver's driving. This makes it possible to provide e-learning opportunities more efficiently and further solidify the learning for the trainee.

[0042] An example of the configuration of the safe driving education system 1 including the center device 100 to which the safe driving education method according to the above-described embodiment is applied will be described in more detail below.

[0043] Fig. 5 is a diagram showing an example of the configuration of a safe driving education system 1 according to an embodiment. As shown in Fig. 5, the safe driving education system 1 includes drive recorders 10-1, 10-2, ... 10-m (m is a natural number equal to or greater than 1), a center device 100, and participant devices 200-1, 200-2, ... 200-n (n is a natural number equal to or greater than 1).

[0044] Each drive recorder 10, the center device 100, and each participant device 200 are connected to each other so that they can communicate with each other via a network N, which may be the Internet, a mobile phone network, a C-V2X (Cellular Vehicle to Everything) communication network, or the like.

[0045] As described above, the drive recorder 10 records vehicle data including interior and exterior images captured by the interior camera 12a and exterior camera 12b, as well as various data indicating the vehicle's status, in a ring buffer memory in an overwritable manner for a certain period of time.

[0046] Furthermore, if the drive recorder 10 detects a specific event such as an accident or a near miss while the vehicle is running, the drive recorder 10 sets the vehicle data for a certain period of time before and after the detection time to be prohibited from being overwritten, or records the vehicle data for a certain period of time before and after the detection time to another recording medium.

[0047] Furthermore, when the drive recorder 10 detects a specific event, it transmits to the center device 100 the vehicle data that is set to be overwrite-prohibited.

[0048] The center device 100 is realized as, for example, a cloud server, and is managed by a business operator that operates the safe driving education system 1. The center device 100 collects vehicle data transmitted from each drive recorder 10.

[0049] The center device 100 also generates educational materials based on the collected vehicle data, stores and manages the generated educational materials, and provides a service for distributing educational materials to each student device 200.

[0050] The center device 100 also receives answer results from each student device 200 and manages them as the learning status of each student. The center device 100 also analyzes the level of understanding of each student based on the learning status and generates learning materials for additional learning according to the level of understanding.

[0051] The center device 100 also generates a learning event condition that serves as a trigger for changing the timing of distribution of additional learning materials, and sets the learning event condition in the drive recorder 10. When the drive recorder 10 detects a learning event, the center device 100 acquires vehicle data from the drive recorder 10.

[0052] Furthermore, the center device 100 changes the timing of delivery of additional learning materials based on the vehicle status indicated by the vehicle data based on the learning event, and delivers each learning material to the student device 200.

[0053] The attending device 200 is a terminal device used by the attendees, and is realized by a PC, a smartphone, etc. In addition to these, the attending device 200 may also be realized by, for example, a tablet terminal, a wearable device, etc.

[0054] Next, a configuration example of the drive recorder 10 will be described. Fig. 6 is a diagram showing a configuration example of the drive recorder 10 according to the embodiment. As shown in Fig. 6, the drive recorder 10 has an HMI (Human Machine Interface) unit 11, a sensor unit 12, a communication unit 13, a storage unit 14, and a controller 15.

[0055] The HMI unit 11 is a component that provides interface components related to input and output to a user who operates the drive recorder 10. The HMI unit 11 includes an input interface that accepts input operations from the user. The input interface is realized by, for example, a touch panel. The input interface may also be realized by a microphone or the like. The input interface may also be realized by software components.

[0056] The HMI unit 11 also includes an output interface that presents visual and audio information to the user. The output interface is realized by, for example, a display, a speaker, etc. The HMI unit 11 may also provide the user with an input interface and an output interface integrated into one, for example, by a touch panel display.

[0057] The sensor unit 12 is a group of various sensors mounted on the drive recorder 10. The sensor unit 12 includes, for example, an in-vehicle camera 12a, an out-of-vehicle camera 12b, a GPS (Global Positioning System) sensor 12c, and a G sensor 12d.

[0058] In-vehicle camera 12a is provided so as to be able to capture images inside the vehicle. In-vehicle camera 12a is attached near the windshield, dashboard, or the like so that at least the driver's face is included in the capture range.

[0059] Exterior camera 12b is installed so that it can capture images of the outside of the vehicle. Exterior camera 12b is attached near the windshield, the dashboard, the rear window, etc. Note that interior camera 12a and exterior camera 12b do not necessarily need to be separate and may be integrated into one camera, for example, a 360-degree camera.

[0060] The GPS sensor 12c measures the GPS position of the vehicle. The G sensor 12d measures the G value, which is the acceleration value applied to the vehicle.

[0061] In addition to the sensor unit 12, the drive recorder 10 is also connected to an in-vehicle sensor 5, which is a group of various sensors mounted on the vehicle. The in-vehicle sensor 5 includes, for example, a vehicle speed sensor, an accelerator sensor, a brake sensor, etc. The in-vehicle sensor 5 is connected to the drive recorder 10 via an in-vehicle network such as a CAN (Controller Area Network).

[0062] The communication unit 13 is realized by a network adapter etc. The communication unit 13 is connected to the network N wirelessly, and transmits and receives information to and from the center device 100 via the network N.

[0063] The storage unit 14 is realized by a storage device such as a read-only memory (ROM), a random access memory (RAM), a flash memory, etc. In the example of Fig. 6, the storage unit 14 stores a vehicle data DB 14a, event condition information 14b, an image recognition model 14c, and a teaching material DB 14d.

[0064] The vehicle data DB 14a is a database of vehicle data recorded by the drive recorder 10. The event condition information 14b is information in which predetermined event conditions for detecting the above-mentioned specific events are set. The event conditions are transmitted as appropriate from, for example, the center device 100 and stored in the event condition information 14b.

[0065] An example of the event condition information 14b will now be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of the event condition information 14b. As shown in FIG. 7, the event condition information 14b has one or more event conditions set therein for detecting a specific event. "Event ID" is an identification ID for each event condition. "Type" is the type of each event condition. An event condition with a type of "learning" is the learning event condition described above.

[0066] An event condition with a type of "normal" corresponds to the occurrence of an accident, a near miss, or the passing of a specific point. In FIG. 7, for example, the event condition for event ID "001" is "G-value ≧ threshold Th1." In this case, when the drive recorder 10 detects an impact corresponding to a G-value equal to or greater than a predetermined threshold Th1, it detects it as a specific event.

[0067] Similarly, for example, the event condition for event ID "002" is "within ±100 m of point P1 and scheduled to pass point P1." In this case, the drive recorder 10 detects a specific event when, for example, the vehicle reaches a range of ±100 m from point P1 and is scheduled to pass point P1.

[0068] 7 shows an example in which the learning event condition for the event ID "101" is "within ±100 m of point Pa that is similar (matches) the situation in question A and is scheduled to pass point Pa." In this case, the drive recorder 10 detects it as a specific learning event when, for example, the vehicle arrives within ±100 m of point Pa that is similar to the situation in question A and is scheduled to pass point Pa.

[0069] Similarly, for example, the learning event condition for event ID "102" is "a point Pb that is similar (matches) the situation in question B within ±50 m and is scheduled to pass point Pb." In this case, the drive recorder 10 detects it as a specific learning event when, for example, the vehicle reaches a range of ±50 m from point Pb that is similar to the situation in question B and is scheduled to pass point Pb.

[0070] In this way, by using situations that are at least similar to the situations in each question as learning events and providing additional learning materials, it is possible to provide learning opportunities that are linked to real-life situations, making a strong impression on participants and helping them to further solidify their learning.

[0071] Returning to the description of Figure 6, the image recognition model 14c is an AI (Artificial Intelligence) model for image recognition. The image recognition model 14c is, for example, a DNN (Deep Neural Network) model trained using a deep learning algorithm.

[0072] The image recognition model 14c is read into the controller 15 as a DNN model, and is then configured to be able to detect various objects included in each frame image when each frame image of an in-vehicle video or an outside-vehicle video is input to the controller 15. For example, when each frame image of an outside-vehicle video is input, the image recognition model 14c is configured to be able to detect pedestrians, vehicles, traffic lights, vehicle license plates, the lighting colors of traffic lights, and the like that appear in each frame image.

[0073] Furthermore, the image recognition model 14c is configured to be able to detect, for example, the faces of people, including the driver, that appear in each frame image when each frame image of the in-vehicle video is input. Furthermore, the image recognition model 14c is configured to be able to estimate, for example, the driver's line of sight, etc., based on a group of facial feature points. Furthermore, the image recognition model 14c is configured to be able to detect objects other than faces.

[0074] The learning material DB 14d is a database in which each learning material for additional learning that the controller 15 receives from the center device 100 via the communication unit 13 is stored.

[0075] The controller 15 corresponds to a so-called processor. The controller 15 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), or the like. The controller 15 executes a program according to an embodiment (not shown) stored in the storage unit 14, using RAM as a work area. The controller 15 can also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0076] The controller 15 executes information processing by the drive recorder 10 in the processing sequence shown in Figures 10 and 11. The description using Figures 10 and 11 will be given later.

[0077] Next, a configuration example of the center device 100 will be described. Fig. 8 is a diagram showing a configuration example of the center device 100 according to the embodiment. As shown in Fig. 8, the center device 100 has a communication unit 101, a storage unit 102, and a controller 103. In addition, an HMI unit 50 is connected to the center device 100.

[0078] The HMI unit 50 is a component that provides interface components related to input and output to an operator or the like who operates the center device 100. The HMI unit 50 includes an input interface that accepts input operations from an operator or the like. The input interface is realized by, for example, a touch panel. The input interface may also be realized by a keyboard, a mouse, a pen tablet, a microphone, or the like. The input interface may also be realized by software components.

[0079] The HMI unit 50 also includes an output interface that presents visual information and audio information to the operator, etc. The output interface is realized by, for example, a display, a speaker, etc. The HMI unit 50 may also be configured to provide the operator, etc. with an input interface and an output interface as a single unit by, for example, a touch panel display.

[0080] The communication unit 101 is realized by a network adapter etc. The communication unit 101 is connected to the network N by wire or wirelessly, and transmits and receives information between the drive recorder 10 and the student attending device 200 via the network N.

[0081] The storage unit 102 is realized by a storage device such as a ROM, a RAM, a flash memory, an HDD (Hard Disk Drive), etc. In the example of Fig. 8, the storage unit 102 stores a collected information DB 102a, an image recognition model 102b, learning material generation information 102c, a learning material DB 102d, and a student information DB 102e.

[0082] The collected information DB 102a is a database that stores vehicle data collected from each drive recorder 10. The image recognition model 102b is an AI model for image recognition. Like the image recognition model 14c described above, the image recognition model 102b is a DNN model trained using, for example, a deep learning algorithm.

[0083] The image recognition model 102b is loaded into the controller 103 as a DNN model, and is configured to be able to detect various objects contained in each frame image when each frame image of an in-vehicle image or an outside-vehicle image is input to the controller 103.

[0084] Similar to the image recognition model 14c described above, the image recognition model 102b is configured to be able to detect, for example, the faces of people, including the driver, that appear in each frame image when each frame image of the in-vehicle video is input. Furthermore, the image recognition model 102b is configured to be able to estimate, for example, the driver's line of sight, etc., based on a group of facial feature points. Furthermore, the image recognition model 102b is configured to be able to detect objects other than faces.

[0085] In addition, when each frame image of the outside-of-vehicle video is input, the image recognition model 102b is configured to be able to detect, for example, pedestrians, vehicles, traffic lights, vehicle license plates, and the color of traffic lights that appear in each frame image.

[0086] The teaching material generation information 102c is information in which various parameters are set and used when the controller 103 generates teaching materials. The various parameters include, for example, parameters relating to the screen layout of the teaching material.

[0087] The teaching material DB 102d is a database that stores teaching materials generated by the controller 103. The student information DB 102e is a database that stores information about students of e-learning courses that use teaching materials distributed by the center device 100. The student information DB 102e includes the learning status of each student. The learning status includes the student's answers to each question. The learning status includes at least one of the correct answer rate, incorrect answer rate, number of consecutive correct answers, and number of consecutive incorrect answers based on the answer results. This makes it possible to analyze the learning status using these parameters, and based on the analysis results, it becomes possible to generate teaching materials suitable for supplementary lessons to solidify learning.

[0088] The controller 103 corresponds to a so-called processor. The controller 103 is realized by a CPU, an MPU, a GPU, or the like. The controller 103 executes a program according to an embodiment (not shown) stored in the storage unit 102, using RAM as a work area. The controller 103 can also be realized by an integrated circuit such as an ASIC or an FPGA.

[0089] The controller 103, like the above-described controller 15, executes information processing by the center device 100 in the processing sequence shown in Figures 10 and 11. The explanation using Figures 10 and 11 will be given later.

[0090] Next, we will explain a configuration example of the attendance device 200. Fig. 9 is a diagram showing a configuration example of the attendance device 200 according to the embodiment. As shown in Fig. 9, the attendance device 200 has an HMI unit 201, a communication unit 202, a storage unit 203, and a controller 204.

[0091] The HMI unit 201 is a component that provides interface components related to input and output for students. The HMI unit 201 is a component similar to the HMI units 11 and 50 already described, and therefore further description will be omitted.

[0092] The communication unit 202 is realized by a network adapter etc. The communication unit 202 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the center device 100 via the network N.

[0093] The storage unit 203 is realized by a storage device such as a ROM, a RAM, a flash memory, a HDD, etc. In the example of Fig. 9, the storage unit 203 stores a teaching material DB 203a.

[0094] The educational material DB 203a is a database in which educational materials received by the controller 204 from the center device 100 via the communication unit 202 are stored.

[0095] The controller 204 corresponds to a so-called processor. The controller 204 is realized by a CPU, an MPU, a GPU, or the like. The controller 204 executes a program according to an embodiment (not shown) stored in the storage unit 203, using RAM as a work area. The controller 204 can also be realized by an integrated circuit such as an ASIC or an FPGA.

[0096] The controller 204, like the above-mentioned controller 15 and controller 103, executes information processing by the student receiving device 200 in the processing sequence shown in FIGS.

[0097] Next, information processing according to this processing sequence will be described. Fig. 10 is a diagram (part 1) showing a processing sequence executed by the safe driving education system 1 according to the embodiment. Fig. 11 is a diagram (part 2) showing a processing sequence executed by the safe driving education system 1 according to the embodiment. Fig. 10 corresponds to the processing flow in the schematic diagram shown in Fig. 1. Fig. 11 corresponds to the processing flow in the schematic diagram shown in Fig. 2.

[0098] 10, in the drive recorder 10, the controller 15 records vehicle data (step S101). In addition, the controller 15 determines whether or not a specific event whose type is set in the event condition information 14b as "normal" (see FIG. 7) has been detected (step S102).

[0099] If an event is detected (step S102, Yes), the controller 15 transmits vehicle data for a certain period of time before and after the event detection time to the center device 100 (step S103). If no event is detected (step S102, No), the controller 15 repeats the process from step S101.

[0100] The controller 103 of the center device 100 generates educational materials based on the vehicle data of step S103 (step S104). Then, the controller 103 distributes the educational materials to the student receiving device 200 based on, for example, an automatic distribution scheduler (not shown) (step S105). Then, the controller 204 of the student receiving device 200 presents the distributed educational materials to the HMI unit 201 (step S106).

[0101] In the student device 200, the controller 204 accepts the student's answers via the HMI unit 201 and transmits the answer results to the center device 100 (step S107). The controller 103 of the center device 100 generates additional learning materials based on the learning situation including the received answer results (step S108). At this time, the controller 103 analyzes the learning results based on the answer results and generates additional learning materials based on the analysis results. For example, if a student repeatedly answers questions incorrectly, it may determine that additional learning is necessary and generate additional learning materials with content related to the relevant questions. This makes it possible to identify areas in which the student is weak and to generate effective learning materials to compensate for those weaknesses.

[0102] Additionally, the controller 103 generates a learning event condition that triggers timing control of distribution of additional learning materials and transmits it to the drive recorder 10 (step S109). The controller 15 of the drive recorder 10 sets the learning event condition received from the center device 100 as an event condition of type "learning" in the event condition information 14b (step S110).

[0103] 11, when the learning event condition is set, the controller 15 records vehicle data in the drive recorder 10 (step S201). In addition, the controller 15 determines whether or not a learning event of the type "learning" set in the event condition information 14b has been detected (step S202).

[0104] Incidentally, the processing of steps S101 to S110, which starts upon detecting a specific event of type "normal" shown in FIG. 10, can be executed in parallel with the execution of the processing sequence of FIG.

[0105] Next, if a learning event is detected (step S202, Yes), the controller 15 continues to transmit vehicle data from the time the learning event was detected to the center device 100 (step S203). If a learning event is not detected (step S202, No), the controller 15 repeats the process from step S201.

[0106] The controller 103 of the center device 100 changes the timing of delivery based on the vehicle status indicated by the vehicle data in step S203 (step S204). At this time, the controller 103 can control the timing of delivery by further taking into account the learning situation. Specifically, the controller 103 controls the timing of delivery differently depending on the answer results included in the learning situation of the driver's past lessons, for example, whether the additional learning material corresponds to questions with a high rate of incorrect answers or questions with a high rate of correct answers. A specific example of this will be described later using Figures 12 and 13.

[0107] Then, the controller 103 determines whether or not the distribution timing has arrived under the control of the distribution timing (step S205). If the distribution timing has arrived (step S205, Yes), the controller 103 transmits the additional learning learning material to be distributed to the drive recorder 10 (step S206). Then, the controller 15 of the drive recorder 10 presents the distributed learning material to the HMI unit 201 (step S207), and repeats steps S206 to S207 until receiving the end notification of step S209.

[0108] If it is determined in step S205 that the distribution timing has not arrived (step S205, No), the controller 103 of the center device 100 repeats the process from step S204.

[0109] After step S206, controller 103 determines whether the distribution has ended (step S208). If the distribution has ended, this means that, for example, all of the additional learning materials corresponding to the learning event detected in step S202 have been distributed.

[0110] If the distribution has ended (step S208, Yes), the controller 103 transmits an end notification to the drive recorder 10 (step S209). If the distribution has not ended (step S208, No), the controller 103 repeats the process from step S204.

[0111] On the other hand, when the controller 15 of the drive recorder 10 receives the end notification of step S209, it stops transmitting the vehicle data to the center device 100, which has been continuing since step S203 (step S210). Then, the controller 15 repeats the process from step S201 in preparation for detecting the next learning event.

[0112] Here, the control of delivery timing executed by the controller 103 will be further explained with reference to Fig. 12 and Fig. 13. Fig. 12 is a supplementary explanatory diagram (part 1) of the control of delivery timing. Fig. 13 is a supplementary explanatory diagram (part 2) of the control of delivery timing.

[0113] As described above, the controller 103 controls the timing of delivery depending on the answer results included in the learning situations that the driver has taken in the past, for example, depending on whether the additional learning materials correspond to questions that the driver has a high rate of answering incorrectly or questions that the driver has a high rate of answering correctly.

[0114] First, a case where additional learning materials correspond to questions for which drivers have a high rate of incorrect answers is shown in Fig. 12. As shown in Fig. 12, it is assumed that additional learning materials corresponding to a learning event correspond to question A about no-parking laws that the driver has taken several times in the past, and that the rate of incorrect answers to question A is equal to or greater than a threshold.

[0115] In this case, when the drive recorder 10 detects an approach to a point Pa similar to the situation of question A at time t1, the controller 103 starts receiving vehicle data from the drive recorder 10.

[0116] Then, if the controller 103 detects a safe situation based on the vehicle data at time t2, which is before time t3 when the drive recorder 10 detects that the vehicle has reached point Pa, which is similar to the situation in question A, the controller 103 distributes educational material ex2 regarding no parking, which is also shown in Figure 3.

[0117] Then, after the drive recorder 10 detects arrival at point Pa, which is similar to the situation in question A, at time t3, if the controller 103 detects a safe situation based on the vehicle data at time t4, it distributes educational material ex3-1 regarding no parking, which is also shown in Figure 3.

[0118] That is, the controller 103 distributes additional learning material ex2 (an example of "first learning material") before the vehicle reaches a location corresponding to a situation in a question where the driver's error rate is higher than a threshold in the answer results. Furthermore, the controller 103 distributes additional learning material ex3-1 (an example of "second learning material") when the vehicle reaches a location corresponding to this question. In other words, the controller 103 provides additional learning material corresponding to questions that the driver repeatedly gets wrong in stages in accordance with changes in the vehicle situation. This makes it possible to provide learning opportunities that are linked to real-world situations, thereby more efficiently providing e-learning learning opportunities and further solidifying the learning for the student.

[0119] When the distribution of all additional learning materials corresponding to question A has been completed, the controller 103 ends the reception of vehicle data at time t5.

[0120] Next, a case where the additional learning material corresponds to a question for which the driver has a high rate of correct answers is shown in Fig. 13. As shown in Fig. 13, the additional learning material according to the learning event corresponds to question B on collision prevention confirmation, which the driver has taken several times in the past, and the rate of correct answers for question B is equal to or greater than a threshold.

[0121] In this case, when the drive recorder 10 detects an approach to a point Pb similar to the situation in question B at time t11, the controller 103 starts receiving vehicle data from the drive recorder 10.

[0122] Then, even if the drive recorder 10 detects at time t12 that the vehicle has reached point Pb that is similar to the situation in question B, the controller 103 does not distribute additional learning materials. However, if the controller 103 detects that the driver's check to prevent collisions at point Pb is insufficient based on the vehicle data from the drive recorder 10, the controller 103 distributes, for example, learning material ex4 that points out this insufficiency at time t14 when a safe situation is detected.

[0123] That is, when the vehicle reaches a location corresponding to a situation in a question for which the correct answer rate is higher than a threshold in the answer results and when a dangerous driving situation corresponding to an incorrect answer to the question is detected, the controller 103 distributes additional learning materials. In other words, when the controller 103 finds that the driver has given a high correct answer rate in the e-learning course but is actually behaving in the opposite way, it points this out and encourages reflection. This makes a strong impression on the driver, thereby further solidifying the learning.

[0124] When the distribution of all additional learning materials corresponding to question B has been completed, the controller 103 ends the reception of vehicle data at time t15.

[0125] As described above, the center device according to the embodiment includes the controller 103. The controller 103 receives vehicle data, which is data relating to the vehicle status, from the vehicle, generates additional learning materials based on the dangerous driving status indicated by the received vehicle data or the learning status of e-learning courses (corresponding to an example of "educational content") that the driver has taken in the past, and distributes the additional learning materials to the driver by changing the distribution timing according to the vehicle status indicated by the vehicle data.

[0126] Therefore, according to the safe driving education method of the embodiment, the controller 103 generates additional learning materials, which can be considered supplementary, based on the dangerous driving situation indicated by the vehicle data or the learning situation of e-learning courses the driver has taken in the past. The controller 103 then transmits the additional learning materials to the driver, i.e., the in-vehicle device, while the driver is driving the vehicle. In this case, the controller 103 changes the timing of delivery depending on the vehicle's situation, delivering the additional learning materials while the vehicle is stopped, parked, or traveling on a straight road, so as not to interfere with the driver's driving. This makes it possible to provide e-learning opportunities more efficiently and further solidify the learning for the trainee.

[0127] While the above-described embodiment primarily assumes that the trainees are company employees or the like, the trainees may also be overseas travelers who travel from overseas and rent a car in Japan. In this case, the trainees take educational content for safe driving education aimed at Japan on their smartphones, tablet devices, PCs, etc. before renting a car. The controller 103 generates driving assistance information as additional learning materials based on the trainee's answers. While the trainee is renting a car, the controller 103 distributes educational materials to assist with driving if it detects, for example, based on the route information and current location information set by the trainee, a situation similar to a question answered incorrectly by the trainee. This allows overseas travelers who are unfamiliar with driving in Japan to receive driving assistance based on their answers to the educational content they have previously attended. In other words, this embodiment also makes it possible to provide educational content for inbound tourists. In this case, the controller 103 may provide information tailored to the trainee's language region, for example, based on the rental car reservation information.

[0128] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents. [Explanation of symbols]

[0129] 1. Safe driving education system 5. In-vehicle sensors 10 Drive Recorder 11 HMI section 12 Sensor section 12a In-car camera 12b Exterior camera 12c GPS sensor 12d G sensor 13 Communications Department 14 Storage section 14a Vehicle data DB 14b Event Condition Information 14c Image Recognition Model 14d Teaching material DB 15 Controller 50 HMI section 100 Center Device 101 Communications Department 102 Storage section 102a Collected Information DB 102b Image Recognition Model 102c Teaching material generation information 102d Teaching material DB 102e Participant Information DB 103 Controller 200 Learning Device 201 HMI Department 202 Communications Department 203 Storage section 203a Teaching material DB 204 Controller

Claims

1. receiving vehicle data from a vehicle, the vehicle data being data relating to the vehicle's status; generating additional learning materials based on the dangerous driving situation indicated by the received vehicle data or the learning status of educational content that the driver has previously attended; a controller that changes a timing of delivery according to the vehicle status indicated by the vehicle data and delivers the additional learning material to the driver; A center device comprising:

2. The controller generating the additional learning material based on the answer results of the driver included in the learning situation; The center device according to claim 1 .

3. The controller changing the distribution timing based on the vehicle data when a situation at least similar to a situation in the question corresponding to the answer result occurs in the vehicle; The center device according to claim 2 .

4. The controller When it is detected that the driver is in a safe situation based on the vehicle data, the additional learning material is delivered. The center device according to claim 3 .

5. The controller delivering the first learning material for additional learning before the vehicle reaches a point corresponding to a situation in the question where the driver's error rate is higher than a threshold in the answer result; The center device according to claim 4.

6. The controller When the vehicle reaches a location corresponding to the question, the second learning material for additional learning is delivered. The center device according to claim 5 .

7. The controller When the vehicle reaches a location corresponding to a situation in the question for which the correct answer rate is higher than a threshold in the answer result and the dangerous driving situation corresponding to an incorrect answer to the question is detected, the additional learning material is delivered.

7. The center device according to claim 5 or 6.

8. The learning situation is: The answer results include at least one of a correct answer rate, an incorrect answer rate, a number of consecutive correct answers, and a number of consecutive incorrect answers. The center device according to claim 2 .

9. The system comprises an in-vehicle device, a center device, and a terminal device used by a driver, The in-vehicle device Transmitting vehicle data relating to the vehicle status to the center device; The center device receiving the vehicle data from the in-vehicle device; generating additional learning materials based on the dangerous driving situation indicated by the received vehicle data or the learning status of educational content that the driver has previously attended; changing a distribution timing according to the vehicle status indicated by the vehicle data and distributing the educational material to the in-vehicle device or the terminal device; The in-vehicle device or the terminal device receiving the educational material from the center device; Safe driving education system.

10. receiving vehicle data from a vehicle, the vehicle data being data relating to a status of the vehicle; generating additional learning materials based on the dangerous driving situation indicated by the received vehicle data or the learning status of the educational content that the driver has previously attended; delivering the educational material to the driver while changing the delivery timing according to the vehicle status indicated by the vehicle data; Safe driving education methods, including:

Images