Educational material providing device, in-vehicle device, educational material providing method, and educational material providing program
The teaching material providing device addresses the issue of uniform educational videos by personalizing content based on drivers' attributes, improving educational effectiveness through tailored traffic safety training.
Patent Information
- Application Number
- JP2021207520
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-21
- Publication Date
- 2025-11-12
- Estimated Expiration
- 2041-12-21
AI Technical Summary
Conventional educational videos for traffic safety education are uniformly provided to all students, reducing their effectiveness as they may not align with individual drivers' tendencies and habits.
A teaching material providing device that detects attribute information of the training recipient, such as driving tendencies, and provides personalized educational videos corresponding to the detected attributes, using in-vehicle devices to capture and analyze driving scenarios.
Enhances educational effectiveness by providing videos that resonate with individual drivers' habits, making the training more relevant and impactful.
Smart Images

Figure 0007768752000001 
Figure 0007768752000002 
Figure 0007768752000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a teaching material providing device, an in-vehicle device, a teaching material providing method, and a teaching material providing program. [Background technology]
[0002] BACKGROUND ART Various techniques have been proposed in the past for using video images of vehicle driving captured by a camera as teaching materials for traffic safety education (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-219497 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the conventional technology, the educational video generated by the administrator is uniformly provided to all the students, which may reduce the educational effectiveness of the educational video depending on the student. In other words, the conventional technology has room for improvement in terms of providing educational video with high educational effectiveness.
[0005] The present invention has been made in consideration of the above, and aims to provide a teaching material providing device, an in-vehicle device, a teaching material providing method, and a teaching material providing program that can provide teaching material images with high educational effectiveness. [Means for solving the problem]
[0006] In order to solve the above problems and achieve the object, the present invention provides a teaching material providing device having a control unit that detects attribute information indicating attributes of a training recipient, and provides a video corresponding to the detected attribute information, which is captured by an in-vehicle device, as a teaching material video to the training recipient. [Effects of the Invention]
[0007] According to the present invention, it is possible to provide educational video with high educational effectiveness. [Brief explanation of the drawings]
[0008] [Figure 1A] FIG. 1A is a diagram showing an overview of a learning material providing system including a learning material providing device according to an embodiment. [Figure 1B] FIG. 1B is a diagram showing an overview of a learning material providing system including a learning material providing device according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of the teaching material providing system according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the video DB. [Figure 4] FIG. 4 is a diagram showing an example of the teaching material DB. [Figure 5] FIG. 5 is a diagram illustrating an example of the driver DB. [Figure 6] FIG. 6 is a diagram showing the display of a terminal device to which educational video is provided. [Figure 7] FIG. 7 is a flowchart showing the processing procedure executed by the learning material providing device. DETAILED DESCRIPTION OF THE INVENTION
[0009] Hereinafter, embodiments of a teaching material providing device, an in-vehicle device, a teaching material providing method, and a teaching material providing program disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.
[0010] <Outline of the teaching material provision system> First, an overview of a learning material providing system including a learning material providing device according to an embodiment will be described with reference to Figures 1A and 1B. Figures 1A and 1B are diagrams showing an overview of a learning material providing system including a learning material providing device according to an embodiment.
[0011] The educational material providing system 1 according to the embodiment is a system that generates and provides educational material videos related to traffic safety using driving videos collected from vehicles, for example. The educational material providing system 1 can collect driving videos from a plurality of vehicles, including transportation vehicles in the transportation industry and commercial vehicles, and generate and provide educational material videos for in-house traffic safety education.
[0012] 1A, the educational material providing system 1 according to this embodiment includes an educational material providing device 10, in-vehicle devices 100-1, 100-2... mounted on vehicles V-1, V-2..., respectively, and a terminal device 200 (see FIG. 1B). In the following description, when the vehicles V-1, V-2 and the in-vehicle devices 100-1, 100-2 are not particularly distinguished from each other, they will be referred to as "vehicle V" and "in-vehicle device 100," respectively.
[0013] The learning material providing device 10 is a server that executes various processes such as a process of providing learning material videos, etc. For example, the learning material providing device 10 is configured as a cloud server that provides cloud services via a network such as the Internet or a mobile phone network.
[0014] The in-vehicle device 100 is a device that includes various sensors, such as a camera sensor, an acceleration sensor, and a GPS (Global Positioning System) sensor, a storage device, a microcomputer, etc. The in-vehicle device 100 has a communication function for communicating via a network. Note that the in-vehicle device 100 may be, for example, a drive recorder.
[0015] The camera sensor described above can capture, for example, images of the surroundings of the vehicle V and output video data. Note that video data is an example of video data. Video data is not limited to video data and may include still image data, etc. Furthermore, the acceleration sensor detects the acceleration acting on the vehicle V, and the GPS sensor detects the position of the vehicle V.
[0016] The terminal device 200 (see FIG. 1B) is a device used by the driver A, who is the training recipient. The terminal device 200 has a communication function for communicating via a network. The terminal device 200 may be, for example, a notebook PC (Personal Computer), a desktop PC, a smartphone, a tablet terminal, or the like, but is not limited to these. Driver A is an example of a training recipient.
[0017] Incidentally, for example, as part of in-house training at a company or the like, there is an effort to provide education on traffic safety by using dangerous driving videos captured by the in-vehicle device 100 (drive recorder) as educational videos. The dangerous videos include, for example, videos of near misses and videos of traffic accidents.
[0018] Note that near-miss footage is footage of an event that may be a precursor to a traffic accident, for example. For example, near-miss footage may be footage of a situation where the vehicle in front suddenly stops while the vehicle is traveling with insufficient distance between the vehicle in front and the host vehicle, causing the host vehicle to suddenly approach the vehicle in front, or footage of a situation where the vehicle enters an intersection at an excessively high speed and the distance between the vehicle in front and another vehicle (such as an oncoming vehicle or a vehicle in front) becomes extremely short.
[0019] The traffic accident video is, for example, a video of a traffic accident occurring. For example, the traffic accident video may be a video of a situation where the vehicle in front suddenly stops while the vehicle is traveling with insufficient distance between the vehicle in front and the host vehicle, causing the host vehicle to collide with the vehicle in front, or a video of a situation where the host vehicle enters an intersection at an excessive speed and collide with another vehicle.
[0020] However, if the above-mentioned dangerous video were provided as a training video to multiple trainees (drivers), the educational effectiveness of the video could be reduced depending on the trainee (driver). For example, suppose Driver A tends to maintain a sufficient distance from the vehicle ahead, and is provided with the above-mentioned training video (dangerous video) of an incident that occurred while driving with an insufficient distance from the vehicle ahead. In this case, the trainee (driver) rarely encounters situations where he or she does not maintain a sufficient distance from the vehicle ahead, resulting in a lot of wasted training. Furthermore, if a driver (trainee) tends to maintain a sufficient distance from the vehicle ahead, Driver A may perceive the above-mentioned training video (dangerous video) of an incident that occurred while driving with an insufficient distance from the vehicle ahead as something that does not concern him or her because it is different from his or her usual driving style, resulting in a reduced educational effectiveness of the video for Driver A. Conversely, for example, if Driver A tends to frequently enter intersections at excessive speeds, Driver A will perceive the footage of the incident (dangerous footage) that occurred when entering an intersection at excessive speeds as something that could happen to him, and as a result, the educational effect of the educational video for Driver A will be high.
[0021] Therefore, the educational material providing device 10 according to this embodiment is configured to be able to provide educational material videos with high educational effectiveness according to the driver to be trained.
[0022] 1A and 1B, the specific processing in the learning material providing device 10 will be described. Note that the learning material providing device 10 performs processing to generate learning material videos in addition to processing to provide learning material videos. In this example, it is assumed that a driver A to be trained drives a vehicle V-1.
[0023] As shown in FIG. 1A, the learning material providing device 10 first collects video captured by an in-vehicle device 100 such as a drive recorder mounted on a vehicle V (step S1). For example, the learning material providing device 10 collects video (video data) from a plurality of in-vehicle devices 100-1, 100-2, ... Here, the learning material providing device 10 collects dangerous video captured by the in-vehicle device 100, but the invention is not limited to this, and the learning material providing device 10 may also collect video other than dangerous video.
[0024] Next, the learning material providing device 10 analyzes each of the collected videos and assigns a tag (tag information) to each piece of video data based on the analysis results (step S2). Here, the tag is information corresponding to the content of the video and indicates the characteristics of the video content. Note that, since the learning material providing device 10 collects dangerous videos, the processing of step S2 can also be said to be processing of analyzing the collected dangerous videos and assigning tags corresponding to the content of the dangerous videos obtained as a result of the analysis.
[0025] Examples of tags include situation information tags, near miss tags, and traffic accident tags. Situation information tags are tags for situation information that indicate the driving situation (situation), and examples of tags include phrases such as "insufficient distance from the vehicle ahead," "speeding," "sudden braking," "sudden acceleration," "abrupt steering," and "running a red light." Situation information tags may also include tags that indicate the driving situation, such as the date and time of driving, the location, and the weather (for example, sunny, rainy, snowy, etc.). Near miss tags are tags that indicate the content of events that may be precursors to traffic accidents (so-called near misses), and examples of tags include phrases such as "rapidly approaching a vehicle ahead," "rapidly approaching another vehicle at an intersection," and "rapidly approaching a pedestrian at an intersection." Traffic accident tags are tags that indicate the content of traffic accidents, and examples of tags include phrases such as "contact with a vehicle ahead," "contact with another vehicle at an intersection," and "contact with a pedestrian at an intersection." Note that, although specific examples of tag content have been given above, these are merely examples and are not limiting. Furthermore, the tags do not need to include all of the situation information tags, near miss tags, and traffic accident tags described above, but may include some of them, or may include tags other than those described above.
[0026] Next, the learning material providing device 10 generates a learning material video using the tagged video data (step S3). For example, the learning material providing device 10 generates the learning material video by combining the tagged video data with question information including a question statement and options corresponding to the question statement.
[0027] The question is a question about the corresponding video, in other words, a sentence that asks the trainee what they can read from the video (here, dangerous video) in traffic safety education. The options are multiple options, each with at least one correct answer, and are selected by the trainee.
[0028] For example, the learning material providing device 10 can generate question information based on tags attached to video data. As an example, if the situation information tag of the video data is "insufficient distance between the vehicle and the vehicle ahead" and the near-miss tag is "rapid approach to the vehicle ahead," the learning material providing device 10 generates a question sentence including the content of the tag (here, the near-miss tag), such as "What is the cause of the 'rapid approach to the vehicle ahead' in the video?" The learning material providing device 10 also generates options consisting of a correct answer including the content of the tag (here, the situation information tag), such as "The cause is 'insufficient distance between the vehicle ahead'," and an arbitrarily set incorrect answer. The learning material providing device 10 then combines the generated question sentence and options with the video as question information to generate a learning material video. The learning material providing device 10 registers the generated learning material video in a learning material DB (database) 12b (see FIG. 2).
[0029] In this way, the learning material providing device 10 according to this embodiment generates learning material videos in advance. Note that, although the learning material providing device 10 generates the question information in the above description, the present invention is not limited to this, and the question information may be generated by, for example, an input operation by an administrator of the learning material providing device 10.
[0030] Next, the learning material providing device 10 detects attribute information of the training target (here, driver A) (step S4). The attribute information includes, for example, a driving tendency attribute that indicates the driving tendency of driver A. Details of the attribute information will be described later with reference to FIG. 5.
[0031] The teaching material providing device 10 detects attribute information (for example, driving tendency attributes) based on a video image captured by an in-vehicle device 100-1 mounted on a vehicle V-1 driven by a driver A, for example.
[0032] Specifically, a tag is assigned to the video data collected from the in-vehicle device 100-1 by the processing of step S2. The learning material providing device 10 detects the attribute information (driving tendency attribute) of driver A based on the tag. As an example, if a tag (situation information tag) of "speeding" is assigned to the video data of the in-vehicle device 100-1, the learning material providing device 10 detects that the attribute information (driving tendency attribute) of driver A is "driving tendency attribute that tends to speed". Similarly, if a tag (near miss tag) of "rapidly approaching another vehicle at an intersection" is assigned to the video data of the in-vehicle device 100-1, the learning material providing device 10 detects that the attribute information (driving tendency attribute) of driver A is "driving tendency attribute that tends to quickly approach another vehicle at an intersection".
[0033] Next, the educational material providing device 10 selects and provides, as educational material video for the driver A, video that corresponds to the detected attribute information and that has been captured by the in-vehicle device 100 (step S5). That is, the educational material providing device 10 provides, to the driver A (more precisely, to the terminal device 200 of the driver A), educational material video that corresponds to the attribute information of the driver A.
[0034] As an example, when the attribute information (driving tendency attribute) of driver A is a "driving tendency attribute that tends to exceed the speed limit," the educational material providing device 10 selects and provides educational material videos tagged with "speeding" (situation information tag) from educational material videos registered in educational material DB 12b (see FIG. 2). Similarly, when the attribute information (driving tendency attribute) of driver A is a "driving tendency attribute that tends to quickly approach other vehicles at intersections," the educational material providing device 10 selects and provides educational material videos tagged with "suddenly approaching other vehicles at intersections" (near miss tag) from educational material videos registered in educational material DB 12b (see FIG. 2). Note that the video provided as educational material video may be video captured by driver A's in-vehicle device 100-1 or may be video captured by another in-vehicle device 100-2.
[0035] Then, when an input operation to start traffic safety education is performed on the terminal device 200 to which the educational video has been provided, the educational video is displayed on the display 201, and traffic safety education is provided to driver A by having driver A answer the above-mentioned question information, etc.
[0036] In this way, the educational material providing device 10 according to the present embodiment provides, as educational material video, video of the in-vehicle device 100 according to the attribute information of the driver A who is the training target. As a result, in this embodiment, educational material video with high educational effectiveness according to the driver A who is the training target can be provided. In other words, by being provided with educational material video according to the attribute information, driver A is more likely to experience the content of the educational material video happening to him / her, and as a result, the educational effectiveness of the educational material video for driver A can be improved.
[0037] Specifically, the educational material providing device 10 according to this embodiment uses attribute information (driving tendency attributes) for each driver, and can provide a relatively large number of educational material videos relating to situations in which driver A is likely to fall into or things that he or she is not careful about. This makes it possible to effectively educate driver A about dangers that he or she should be particularly careful about.
[0038] In the above description, the educational material providing device 10 provides educational material videos to the terminal device 200, but the present invention is not limited to this. That is, if the in-vehicle device 100 (in-vehicle device 100-1) has a display, the educational material providing device 10 may provide educational material videos to the in-vehicle device 100 (in-vehicle device 100-1). This makes it possible to provide traffic safety education to the driver A in the vehicle V-1 before (or after) driving, for example.
[0039] <Overall configuration of the teaching material provision system> Fig. 2 is a block diagram showing an example of the configuration of the educational material providing system 1 according to the embodiment. Note that Fig. 2 shows only the components necessary to explain the features of the embodiment, and omits the description of general components.
[0040] In other words, the components shown in Figure 2 are conceptual functional components and do not necessarily have to be physically configured as shown. For example, the specific form of distribution and integration of each block is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.
[0041] In addition, in the description using FIG. 2, the description of components that have already been described may be simplified or omitted.
[0042] As shown in Fig. 2, the teaching material providing system 1 according to the embodiment includes a teaching material providing device 10, an in-vehicle device 100, and a terminal device 200. For the sake of simplicity, Fig. 2 shows one in-vehicle device 100 and one terminal device 200, but there may be a plurality of in-vehicle devices 100 and a plurality of terminal devices 200.
[0043] <Configuration of in-vehicle device> The in-vehicle device 100 includes a communication unit 101, various sensors 102, a display 103, a storage unit 104, and a control unit 105. The control unit 105 is an example of an in-vehicle device control unit.
[0044] The communication unit 101 is a communication interface that is connected to the communication network N so as to enable two-way communication, and transmits and receives information between the learning material providing device 10 and the terminal device 200, etc.
[0045] As described above, the various sensors 102 include, for example, a camera sensor, an acceleration sensor, a GPS sensor, etc. The camera sensor outputs captured video data to the control unit 105. The acceleration sensor outputs a signal indicating the acceleration acting on the vehicle V, and the GPS sensor outputs a signal indicating the position of the vehicle V to the control unit 105. Note that the various sensors 102 are not limited to the camera sensor and acceleration sensor described above, and may include other types of sensors, such as a microphone sensor, in addition to or instead of the camera sensor, etc.
[0046] The display 103 displays images captured by a camera sensor, etc. Furthermore, when a teaching material image is provided from the teaching material providing device 10 as described above, the display 103 displays the provided teaching material image.
[0047] The storage unit 104 is a storage unit configured with a storage device such as a non-volatile memory, a data flash, or a hard disk drive. The storage unit 104 stores video data 104a captured by a camera sensor, various programs, and the like. Note that the video data 104a may or may not include dangerous video.
[0048] The control unit 105 includes an acquisition unit 105a, a processing unit 105b, and an output unit 105c, and includes, for example, a computer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), input / output ports, etc., and various circuits.
[0049] The CPU of the computer functions as the acquisition unit 105a, the processing unit 105b, and the output unit 105c of the control unit 105, for example, by reading and executing a program stored in the ROM.
[0050] Furthermore, at least some or all of the acquisition unit 105a, processing unit 105b, and output unit 105c of the control unit 105 can be configured with hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0051] The acquisition unit 105a of the control unit 105 acquires outputs from the various sensors 102. For example, the acquisition unit 105a acquires video data captured by a camera sensor and registers the video data 104a in the storage unit 104. The acquisition unit 105a acquires a signal indicating the acceleration acting on the vehicle from an acceleration sensor and outputs the signal to the processing unit 105b. The acquisition unit 105a acquires a signal indicating the vehicle's position from a GPS sensor and outputs the signal to the processing unit 105b.
[0052] When the processing unit 105b detects, for example, sudden braking, sudden acceleration, sudden steering (abrupt maneuvering) of the vehicle, or an impact due to a collision accident from the output of the acceleration sensor, the processing unit 105b stores information indicating the detected content in the memory unit 104, linking it to the video data captured at the time of detection as event information.
[0053] The processing unit 105b associates, for example, vehicle position information with video data based on the output of the GPS sensor and stores the associated information in the storage unit 104. Furthermore, when the processing unit 105b detects excessive vehicle speed based on the output of the GPS sensor, the processing unit 105b associates information indicating the detected speed (here, excessive speed) with the video data captured at the time of the detection as event information and stores the associated information in the storage unit 104. Specifically, the processing unit 105b calculates the travel distance of the vehicle in a predetermined travel time based on the vehicle position information output from the GPS sensor, and calculates the vehicle speed by dividing the calculated travel distance by the predetermined travel time. The processing unit 105b then compares the calculated vehicle speed with the speed limit included in map information for the location (place) where the vehicle is traveling, and detects excessive speeding if the vehicle speed exceeds the speed limit. The map information may be information previously stored in the storage unit 104 or may be information acquired from an external server (not shown). Furthermore, the processing unit 105b may perform a process of prohibiting overwriting of video data for a predetermined period of time before and after the detection of sudden braking, speeding, or the like.
[0054] For example, when a signal (vehicle signal) from a sensor mounted on the vehicle, such as a brake sensor, is input to the in-vehicle device 100, the processing unit 105b may detect sudden braking of the vehicle, etc., based on the vehicle signal. In more detail, the vehicle signal may be, for example, an output from a brake sensor, an accelerator sensor, a steering angle sensor, a vehicle speed sensor, etc., and the processing unit 105b may detect sudden braking, sudden acceleration, abrupt steering, speeding, etc., of the vehicle based on the vehicle signal.
[0055] The output unit 105c transmits the captured video (video data) to the learning material providing device 10 via the communication unit 101. For example, the output unit 105c may transmit video data to which event information such as sudden braking is linked to the learning material providing device 10. That is, video data to which event information such as sudden braking or speeding is linked is presumed to be data of dangerous video, including near-miss video and traffic accident video. Therefore, when the output unit 105c transmits video data to which event information is linked, the learning material providing device 10 can collect dangerous video. Note that the timing of transmitting the video data may be, for example, the timing when the event information is linked to the video data, the timing when a request to transmit the video data is received from the learning material providing device 10, or may be set to any timing.
[0056] Furthermore, when a teaching material video is provided (transmitted) from the teaching material providing device 10, the output unit 105c receives the teaching material video via the communication unit 101. Then, the output unit 105c outputs and displays the received teaching material video on the display 103 to provide it to the driver. As described above, this allows traffic safety education to be provided inside the vehicle V.
[0057] <Configuration of the teaching material providing device> Next, a description will be given of the configuration of the learning material providing device 10. As shown in FIG.
[0058] The communication unit 11 is a communication interface that is connected to the communication network N so as to enable two-way communication, and transmits and receives information to and from the in-vehicle device 100, the terminal device 200, and the like.
[0059] The storage unit 12 is configured with a storage device such as a nonvolatile memory, a data flash, a hard disk drive, etc. The storage unit 12 includes a video DB 12a, a learning material DB 12b, and a driver DB 12c.
[0060] The video DB 12a stores information related to videos. Here, the video DB 12a will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the video DB 12a.
[0061] 3, the video DB 12a includes items such as "video ID," "driver ID," "video," "date and time," "location," and "event," and data for each item is associated with the "video ID." In other words, corresponding data such as "video" and "date and time" is stored in a data record identified by the "video ID."
[0062] "Video ID" is identification information that identifies video data. "Driver ID" is identification information that identifies a driver. For example, "Driver ID" includes information about the driver of the vehicle V that is equipped with the in-vehicle device 100 that captured the corresponding video data.
[0063] "Video" is data of video captured by the in-vehicle device 100. In the example shown in FIG. 3, for convenience, "video" is abstractly described as "C1," but "C1" stores specific information. Hereinafter, other information may also be abstractly described.
[0064] "Date and time" is information indicating the date and time when the corresponding video was captured. "Location" is information indicating the location (place) where the corresponding video was captured.
[0065] "Event" is information related to an event that occurred in the corresponding video, and more specifically, is event information related to an event (phenomenon) that occurred while the video was being captured. As described above, the event information is event information linked to the video data by the in-vehicle device 100. Therefore, information indicating, for example, sudden braking, sudden acceleration, abrupt steering, a collision, speeding, etc. is registered in "Event."
[0066] In the example shown in Figure 3, the video data identified by video ID "A01" is video data captured while a driver identified by driver ID "B01" was driving, and indicates that the video is "C1," the date and time is "D1," the location is "E1," and the event is "F1."
[0067] Returning to the explanation of Fig. 2, the teaching material DB 12b stores information related to teaching material videos. Here, the teaching material DB 12b will be explained using Fig. 4. Fig. 4 is a diagram showing an example of the teaching material DB 12b.
[0068] 4, the educational material DB 12b includes items such as "educational material ID," "video ID," "driver ID," "situation information tag," "near miss tag," "traffic accident tag," and "problem information," and data for each item is associated with a "educational material ID." In other words, corresponding data such as "situation information tag" and "near miss tag" is stored in a data record identified by a "educational material ID."
[0069] The "teaching material ID" is identification information that identifies the teaching material video. The "video ID" is identification information that identifies video data, more specifically, identification information that identifies video data set as the teaching material video. In this way, by registering the "video ID" in the teaching material DB 12b, the teaching material video identified by the "teaching material ID" is linked (associated) with the video data in the video DB 12a by the "video ID."
[0070] The "driver ID" is identification information for identifying a driver, and more specifically, is identification information for the driver of the vehicle V (more precisely, the in-vehicle device 100) that captured the video data set as the educational video. In this way, by registering the "driver ID" in the educational video DB 12b, the educational video identified by the "educational video ID" is linked (associated) with the driver data in the video DB 12a and the driver DB 12c by the "driver ID."
[0071] The "situation information tag" is information related to the situation information tag described above, and more specifically, information related to the tag of the driving situation when the video set as the educational video was captured (the tag of the situation information). For example, tags such as "insufficient distance from the vehicle ahead," "excessive speed," "sudden braking," "sudden acceleration," "abrupt steering," and "running a red light" are registered in the "situation information tag." The number of tags registered in the "situation information tag" may be one or more.
[0072] "Near miss tag" is information related to the near miss tag described above, and more specifically, information related to the tag of a near miss that occurred while driving when the video set as the educational video was captured. For example, tags such as "rapidly approaching a vehicle ahead," "rapidly approaching another vehicle at an intersection," and "rapidly approaching a pedestrian at an intersection" are registered in the "Near miss tag." The number of tags registered in the "Near miss tag" may be one or more.
[0073] "Traffic accident tag" is information related to the traffic accident tag described above, and more specifically, information related to the tag of a traffic accident that occurred while driving and resulted in the video set as the educational video. For example, tags such as "contact with a vehicle ahead," "contact with another vehicle at an intersection," and "contact with a pedestrian at an intersection" are registered in the "traffic accident tag." The number of tags registered in the "traffic accident tag" may be one or more. Furthermore, since a near miss is an event that may be a precursor to a traffic accident, either a "near miss tag" or a "traffic accident tag" will be registered in one educational video, but this is not limited to this.
[0074] Using these "near miss tags" and "traffic accident tags," the educational videos in the video DB 12a are classified according to the degree of danger involved in driving a vehicle. In other words, because near misses are events that are precursors to traffic accidents, the degree of danger involved in driving a vehicle is lower than the degree of danger involved in traffic accidents. Conversely, the degree of danger involved in traffic accidents is higher than the degree of danger involved in near misses. Therefore, by assigning "near miss tags" and "traffic accident tags" to educational videos, it can be said that the educational videos are classified according to the degree of danger involved in driving a vehicle.
[0075] "Question information" is information about questions provided to the training target (driver), and more specifically, information about questions that are combined with the video set as the educational video. "Question information" includes information indicating the question statement and information indicating the options corresponding to the question statement.
[0076] In the example shown in Figure 4, the educational video data identified by educational video ID "J01" is video data identified by video ID "A01" that has been set as educational video, and indicates that this educational video is video captured while the driver identified by driver ID "B01" was driving. Also, the educational video data identified by educational video ID "J01" indicates that the situation information tag is "K1", the near-miss tag is "L1", and the problem information is "N1".
[0077] In addition, the educational material video data identified by the educational material ID "J02" has a corresponding video ID of "A02", a corresponding driver ID of "B02", a situation information tag of "K2", a traffic accident tag of "M2", and problem information of "N2".
[0078] Returning to the description of FIG. 2, the driver DB 12c stores information about the driver. For example, the driver DB 12c stores attribute information about the driver. Here, the driver DB 12c will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the driver DB 12c.
[0079] 5, the driver DB 12c includes items such as "driver ID," "driving tendency attribute," "driving area attribute," "age attribute," and "affiliation attribute," and data for each item is associated with the "driver ID." In other words, corresponding data such as "driving tendency attribute" and "driving area attribute" is stored in a data record identified by the "driver ID."
[0080] The "driver ID" is identification information for identifying the driver. The "driving tendency attribute" is attribute information that indicates the driving tendency of the driver. The driving tendency may include the experience of near misses and accidents.
[0081] The "driving tendency attribute" registers attribute information of driving tendencies such as "tends to keep insufficient distance from the vehicle ahead," "tends to exceed the speed limit," "tends to brake suddenly," "tends to accelerate suddenly," "tends to steer sharply," and "tends to ignore traffic lights." If the driver has experienced a near miss, the "driving tendency attribute" registers attribute information of driving tendencies such as "tends to quickly approach the vehicle ahead," "tends to quickly approach other vehicles at intersections," and "tends to quickly approach pedestrians at intersections." If the driver has experienced an accident, the "driving tendency attribute" registers attribute information of driving tendencies such as "collided with the vehicle ahead," "collided with other vehicles at intersections," and "collided with pedestrians at intersections." The attribute information of driving tendencies described above is registered, for example, from information (event information) included in the video data of the in-vehicle device 100 or detected by video analysis (more precisely, detected based on tags), which will be described later.
[0082] "Driving area attributes" are information indicating attributes related to the area in which the driver drives the vehicle. The driving area includes, for example, routes and regions where the vehicle driven by the driver often drives, but is not limited to these. The "driving area attributes" may be registered based on information (location information) included in the video data of the in-vehicle device 100, or may be registered by an input operation by the driver, a manager, or the like.
[0083] The "age attribute" is information indicating an attribute that indicates the age of the driver. For example, the "age attribute" may register information that classifies the driver's age by age group, such as "20s" or "30s," but is not limited to this.
[0084] The "affiliation attribute" is information indicating an attribute that indicates the affiliation of the driver. For example, the "affiliation attribute" may include, but is not limited to, information such as the company to which the driver belongs, the group to which the driver belongs, or the school to which the driver belongs. Furthermore, the above-mentioned "age attribute" and "affiliation attribute" are registered by input operations by the driver, manager, etc., but are not limited to these.
[0085] In the example shown in FIG. 5, the data of the driver identified by the driver ID "B01" indicates that the driving tendency attribute is "P1", the driving area attribute is "Q1", the age attribute is "R1", and the affiliation attribute is "T1". Note that in the example shown in FIG. 5, the data of the driver identified by the driver ID "B03" does not have registered information on the driving tendency attribute. This indicates that information on the driving tendency attribute was not detected for the driver with the driver ID "B03", in other words, it was not possible to detect information on the driving tendency attribute, which will be described later.
[0086] Returning to the explanation of Figure 2, the control unit 13 includes a collection unit 13a, an analysis unit 13b, a generation unit 13c, a detection unit 13d, and a provision unit 13e, and includes, for example, a computer having a CPU, ROM, RAM, a hard disk drive, an input / output port, and various other circuits. The CPU of the computer functions as the collection unit 13a, the analysis unit 13b, the generation unit 13c, the detection unit 13d, and the provision unit 13e of the control unit 13, for example, by reading and executing various programs stored in the ROM. The various programs include the teaching material provision program according to this embodiment.
[0087] Furthermore, at least some or all of the collection unit 13a, analysis unit 13b, generation unit 13c, detection unit 13d, and provision unit 13e of the control unit 13 can be configured with hardware such as ASIC or FPGA.
[0088] The collection unit 13a collects images (including dangerous images) captured by the in-vehicle devices 100 and registers the collected images (image data) in the image DB 12a. Furthermore, if the image data includes information on the date and time when the image was captured, location information, and event information, the collection unit 13a registers this information in the image DB 12a. Furthermore, the collection unit 13a collects images from each of the multiple in-vehicle devices 100, that is, collects multiple images, but this is not limited to this.
[0089] The analysis unit 13b analyzes the collected and input video and assigns tags to the video data based on the analysis results. The tags assigned here include the above-mentioned situation information tag, near miss tag, and traffic accident tag.
[0090] Specifically, for example, if the collected video data includes event information such as "sudden braking," "sudden acceleration," "abrupt steering," or "speeding," the analysis unit 13b assigns the event information as a situation information tag. Furthermore, for example, if the video analysis detects "insufficient distance from the vehicle ahead" or "running a red light," the analysis unit 13b assigns the detected content as a situation information tag. Furthermore, for example, if the video data includes information such as "date and time" or "location," the analysis unit 13b assigns the content of such information as a situation information tag. Furthermore, for example, if the video analysis detects the weather during driving, the analysis unit 13b assigns the detected content (for example, sunny, rainy, snowy, etc.) as a situation information tag. Furthermore, for example, if the video analysis detects "sudden approach to a vehicle ahead," "sudden approach to another vehicle at an intersection," "sudden approach to a pedestrian at an intersection," etc., the analysis unit 13b assigns the detected content as a near miss tag. Furthermore, when the analysis unit 13b detects, for example, "contact with a vehicle ahead," "contact with another vehicle at an intersection," or "contact with a pedestrian at an intersection" based on the event information of the video data or the video analysis, the analysis unit 13b assigns the detected content as a traffic accident tag. Then, the analysis unit 13b associates the tag with the video data to which the tag is assigned and registers it in the teaching material DB 12b.
[0091] The generation unit 13c generates a teaching material video using the video data to which the tags have been added. Specifically, the generation unit 13c generates question information using the tags, and combines the question information with the video to generate the teaching material video. The generation unit 13c associates the question information with the video data corresponding to the question information and registers them in the teaching material DB 12b.
[0092] For example, the generation unit 13c generates question information based on tags. Specifically, the generation unit 13c generates question sentences and options using content (wording) included in the situation information tag, near-miss tag, and traffic accident tag of the video data. Then, the generation unit 13c combines the question information including the question sentences and options with the video to generate a learning material video.
[0093] In this way, the educational material providing device 10 according to this embodiment collects a plurality of videos, including dangerous videos, from the in-vehicle device 100, generates a plurality of educational material videos using the collected videos, and stores the generated plurality of educational material videos in advance in the educational material DB 12b. As a result, this embodiment can handle cases where, for example, the attribute information of the driver who is the training target is diverse, that is, it becomes possible to provide educational material videos according to the attribute information.
[0094] The detection unit 13d detects attribute information of the driver who is the training target. For example, the detection unit 13d detects driving tendency attribute information that indicates the driving tendency of the driver as the attribute information. Note that the driving tendency attribute information is an example of driving tendency information.
[0095] Specifically, the detection unit 13d searches the educational material DB 12b for video captured by the in-vehicle device 100 of the vehicle V driven by the driver (trainee), for example, and checks the tag attached to the corresponding video data. Then, the detection unit 13d detects driving tendency attribute information based on the tag attached to the video data corresponding to the driver (trainee). As an example, if a tag (situation information tag) of "insufficient distance from preceding vehicle" is attached to the video data corresponding to the driver, the detection unit 13d detects that the driver's driving tendency attribute is "driving tendency attribute of prone to insufficient distance from preceding vehicle." The detection unit 13d registers the detected driving tendency attribute information in the "driving tendency attribute" of the driver DB 12c.
[0096] The number of pieces of attribute information detected here may be one or more. That is, if multiple tags are attached to video data, the number of pieces of attribute information will be multiple according to the tags.
[0097] In addition, the detection unit 13d detects (identifies) the driving area of the corresponding driver based on the location information included in the video data, and registers information indicating the detected driving area (driving area attribute information) in the ``driving area attribute'' of the driver DB 12c.
[0098] In this way, the detection unit 13d according to this embodiment detects attribute information based on the video captured by the in-vehicle device 100 mounted on the vehicle V driven by the driver. This makes it possible to easily and accurately detect the attribute information of the driver.
[0099] Here, there is a case where the video data of the driver (trainee) is not registered in the teaching material DB 12b. That is, there is a case where the video data is not registered in the teaching material DB 12b for reasons such as the absence of dangerous video in the in-vehicle device 100 of the vehicle V driven by the driver (trainee), and therefore the video data is not collected, or the video data is not collected because the trainee has not driven during a predetermined video collection period. In such a case, the detection unit 13d cannot detect the driving tendency attribute from the video data, and therefore does not register the "driving tendency attribute information" in the driver DB 12c. In other words, the detection unit 13d processes the case as if the detection of the driving tendency attribute information of the driver (trainee) was not possible.
[0100] The providing unit 13e provides the educational video to the driver (trainee) based on the attribute information of the driver. For example, the providing unit 13e provides the driver with a video that corresponds to the detected attribute information of the driver and that is captured by the in-vehicle device 100 as the educational video. That is, the providing unit 13e provides the driver with an educational video that is in line with the attribute information of the driver.
[0101] As a result, in this embodiment, it is possible to provide educational videos with a high educational effect that are tailored to the driver (the person being educated). That is, by being provided with educational videos tailored to the driver's attributes, the driver is more likely to perceive the content of the educational video as something that could possibly happen to them, and as a result, the educational effect of the educational video on the driver can be improved.
[0102] Specifically, the providing unit 13e provides, as the educational video, a video corresponding to the driving tendency information, which is one of the attribute information. For example, the providing unit 13e searches the educational video DB 12b based on the driver's driving tendency attribute information, and selects and provides the educational video corresponding to the driving tendency attribute information. As an example, if the driver's driving tendency attribute is a "driving tendency attribute that tends to keep a short distance from the vehicle ahead," the providing unit 13e searches the educational video DB 12b based on the driving tendency attribute, and selects and provides the educational video to which a tag (situation information tag) of "short distance from the vehicle ahead" is attached. In this way, the providing unit 13e can provide educational video with high educational effectiveness that is in line with the driving tendency of the driver (the person being trained).
[0103] Here, the educational video provided to the driver (trainee) will be described with reference to Fig. 6. Fig. 6 is a diagram showing the display 201 of the terminal device 200 to which the educational video has been provided.
[0104] 6, the providing unit 13e provides the educational video to the terminal device 200, and causes it to be displayed in the display field 300 of the display 201. The educational video includes an image (dangerous image) 310 captured by the in-vehicle device 100 and question information 320. The question information 320 includes a display field 321 in which a question sentence is displayed and a display field 322 in which options are displayed. Then, the driver (the person being educated) selects an option and answers the question, thereby providing traffic safety education to the driver.
[0105] Continuing with the explanation of FIG. 2, as described above, the providing unit 13e provides, as educational video, video to which tag information (e.g., situation information tag, near miss tag, traffic accident tag) corresponding to attribute information (e.g., driving tendency attribute information) has been assigned. Specifically, tags are assigned in advance to the video in the in-vehicle device 100, and the providing unit 13e selects and provides educational video from the educational video DB 12b based on the attribute information and the tag corresponding to the attribute information. More specifically, the providing unit 13e selects and provides educational video in which the attribute information matches the tag corresponding to the attribute information. This allows the providing unit 13e to reliably and accurately select and provide video in accordance with the driver's attribute information.
[0106] Furthermore, the providing unit 13e provides educational video with a risk level corresponding to the attribute information. That is, the educational video includes videos of near misses and videos of traffic accidents, and the educational video is classified according to the risk level of vehicle driving as described above. When the attribute information (e.g., driving tendency attribute information) includes information with a lower risk level than traffic accidents (e.g., information related to near misses, such as "prone to suddenly approach a vehicle ahead"), the providing unit 13e selects and provides educational video with a risk level corresponding to the attribute information (i.e., educational video with a near miss tag attached). Similarly, when the attribute information (driving tendency attribute information) includes information with a higher risk level than near misses (e.g., information related to traffic accidents, such as "collided with a vehicle ahead"), the providing unit 13e selects and provides educational video with a risk level corresponding to the attribute information (i.e., educational video with a traffic accident tag attached).
[0107] As a result, in this embodiment, it is possible to provide educational video that is in line with the driving risk level contained in the driver's attribute information, thereby further improving the educational effect of the educational video on the driver.
[0108] The providing unit 13e may also provide, as the educational video, a video according to situation information indicating the driving situation of the vehicle of the driver (trainee). Note that, as the situation information, for example, information such as the vehicle position, weather, speed, date and time during driving can be used, but is not limited to these.
[0109] For example, when the situation information tag of the video data corresponding to the driver (trainee) includes situation information such as the vehicle position, weather, speed, date and time, the providing unit 13e provides the video according to such situation information as the educational video. In detail, when the video data of the driver (trainee) includes situation information, the providing unit 13e selects and provides the educational video to which the situation information tag corresponding to such situation information is also attached (for example, video (dangerous video) captured by a driver other than the driver (trainee)).
[0110] As a result, in this embodiment, educational video can be provided that corresponds to the situation in which the driver (trainee) drove in the past and the video (dangerous video) was captured, thereby further improving the educational effect of the educational video on the driver.
[0111] As described above, there are cases where it is impossible to detect driving tendency attribute information of a driver (trainee). In such cases, the providing unit 13e provides, as the educational video, a video selected in correspondence with a similar driver having attribute information similar to that of the driver (trainee).
[0112] For example, for a driver whose driving tendency attribute information has not been detected, the providing unit 13e identifies a similar driver who is similar in at least one of the "driving area attribute," "age attribute," and "affiliation attribute" of the driver's attribute information. Then, the providing unit 13e selects a video (dangerous video) of the in-vehicle device 100 of the identified similar driver and provides it as a learning video. Note that the similarity of the attribute information mentioned above includes, but is not limited to, a case where the entire content of the attribute information matches, a case where only a part of the content matches, or a case where the content of the attribute information is within a predetermined tolerance range. The predetermined tolerance range can be set arbitrarily.
[0113] As a result, in this embodiment, even if driving tendency attribute information is not detected, it is possible to provide educational video with a high educational effect tailored to the driver (trainee). In other words, educational video (dangerous video) of a similar driver with relatively similar attribute information (for example, driving area, age, affiliation, etc.) is provided to a driver (trainee) for whom driving tendency attribute information has not been detected, so that the driver (trainee) will likely recognize that the content of the educational video is likely to happen to him / her, and as a result, the educational effect of the educational video for the driver can be improved.
[0114] Note that the providing unit 13e provides the educational video to the terminal device 200, but is not limited to this. That is, the providing unit 13e may provide the educational video to the in-vehicle device 100 of the driver (trainee).
[0115] <Control process of the teaching material providing device> Next, an example of a specific processing procedure in the educational material providing device 10 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the processing procedure executed by the educational material providing device 10. Note that, in the following, an example will be described in which the number of educational material videos (hereinafter referred to as "prescribed number") provided to the driver is three (three types), but the present invention is not limited to this, and the prescribed number can be set arbitrarily.
[0116] 7, the control unit 13 of the educational material providing device 10 collects video from the in-vehicle device 100 of the vehicle V (step S10). Next, the control unit 13 analyzes the collected video and assigns tags to the video data based on the analysis results (step S11).
[0117] Next, the control unit 13 generates a teaching material video using the tagged video data (step S12). For example, the control unit 13 generates the teaching material video by combining the tagged video data with question information. The control unit 13 registers the generated teaching material video in the teaching material DB 12b.
[0118] Next, the control unit 13 detects attribute information of the driver to be trained (step S13). For example, the control unit 13 detects attribute information (e.g., driving tendency attributes) based on a video image captured by the in-vehicle device 100 of the vehicle V driven by the driver (trainee).
[0119] Next, the control unit 13 determines whether or not there is a learning material video corresponding to the attribute information of the driver (trainee) (step S14). In other words, the processing of step S14 is processing in which driving tendency attribute information is detected in the attribute information of the driver, and whether or not there is a learning material video corresponding to the detected driving tendency attribute information is determined.
[0120] If it is determined that there is no educational video corresponding to the attribute information (for example, driving tendency attribute) (step S14, No), in other words, if it is not possible to detect driving tendency attribute information, the control unit 13 selects educational videos corresponding to similar drivers who have attribute information similar to that of the driver (trainee) for the number that is insufficient compared to the specified number (step S15). As described above, since the specified number is three, three educational videos are selected here.
[0121] On the other hand, if the control unit 13 determines that there is educational video corresponding to the attribute information (e.g., driving tendency attribute) (step S14, Yes), in other words, if the driving tendency attribute information is detected, it selects as the educational video the video that corresponds to the detected attribute information (driving tendency attribute) and that was captured by the in-vehicle device 100 (step S16).
[0122] When selecting the educational video, the control unit 13 may select the educational video in descending order of the number of detected attribute information (driving tendency attributes) (i.e., the number of detections). As an example, if information indicating attribute contents a, b, c, and d are detected five times, three times, two times, and once respectively in the attribute information, the video corresponding to attribute contents a, b, and c may be selected as the educational video in descending order of the number of detections. The above-mentioned attribute contents a, b, c, and d are, for example, "tends to keep insufficient distance from the vehicle ahead," "tends to suddenly approach the vehicle ahead," "collisions with the vehicle ahead," etc.
[0123] Next, the control unit 13 determines whether or not a specified number of educational videos have been selected (step S17). If the control unit 13 determines that a specified number of educational videos have not been selected (step S17, No), the control unit 13 proceeds to step S15 and selects educational videos corresponding to similar drivers for the number that is insufficient for the specified number. That is, for example, the control unit 13 selects one educational video corresponding to a similar driver when one video is missing from the specified number, and selects two educational videos corresponding to similar drivers when two video are missing from the specified number.
[0124] Then, the control unit 13 provides the educational video selected in step S15 and step S16 to the driver (step S18). On the other hand, if the control unit 13 determines that the specified number of educational video has been selected (step S17, Yes), the control unit 13 proceeds to step S18 and provides the educational video selected in step S16 to the driver.
[0125] As described above, the teaching material providing device 10 according to the embodiment has the control unit 13. The control unit 13 detects attribute information indicating the attributes of the education recipient, and provides the education recipient with a video that corresponds to the detected attribute information and that has been captured by the in-vehicle device 100 as a teaching material video. This makes it possible to provide a teaching material video that has a high educational effect.
[0126] The educational video generated in the above-described embodiment may be subjected to a masking process to conceal vehicle license plates, people, and the like that are captured in the video, for example, for the purpose of protecting personal information. Masking is a process in which areas of vehicle license plates or people in the video are filled in or pixelated. This makes it possible, for example, to repurpose the generated educational video for use as educational video for other companies, thereby improving the versatility of the educational video.
[0127] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents. [Explanation of symbols]
[0128] 1. Teaching material provision system 10 Teaching material provision device 13 Control Unit 100 In-vehicle equipment 105 Control Unit
Claims
1. A teaching material providing device that provides a training subject with vehicle driving video captured by an in-vehicle device, Detecting a driving risk level from attribute information of the training recipient; providing the training subject with a training video corresponding to the detected driving risk level from among a plurality of training video clips obtained by classifying the vehicle driving video clips according to driving risk levels; A teaching material providing device having a control unit.
2. The control unit detecting the attribute information based on an image captured by an in-vehicle device mounted on a vehicle driven by the training target person; The teaching material providing device according to claim 1 .
3. The control unit detecting driving tendency information indicating the driving tendency of the training recipient as the attribute information; providing a video according to the detected driving tendency information as the educational video; 3. The teaching material providing device according to claim 1.
4. The control unit If the driving tendency information of the training target cannot be detected, a video selected corresponding to a similar driver having the attribute information similar to that of the training target is provided as the training video.
4. The teaching material providing device according to claim 3.
5. The control unit providing, as the educational video, a video corresponding to situation information indicating a driving situation of the vehicle; 5. The teaching material providing device according to claim 1.
6. The control unit Add tag information to the input video according to the content of the video, providing a video to which the tag information corresponding to the attribute information is assigned as the teaching material video; 6. The teaching material providing device according to claim 1.
7. An in-vehicle device having an in-vehicle device control unit, The in-vehicle device control unit The captured image is transmitted to the educational material providing device, receiving, from the educational material providing device, a video corresponding to the driving risk level detected from the attribute information of the training recipient as a training material video for the training recipient and providing the video to the training recipient; In-vehicle device.
8. A teaching material providing method executed by a teaching material providing device, Detect driving risk from the attribute information of the training target, providing the training subject with a training video corresponding to the detected driving risk level from among a plurality of training video images obtained by classifying vehicle driving videos captured by an in-vehicle device according to driving risk level; Method of providing teaching materials.
9. On the computer, Detect driving risk from the attribute information of the training target, providing the training subject with a training video corresponding to the detected driving risk level from among a plurality of training video images obtained by classifying vehicle driving videos captured by an in-vehicle device according to driving risk level; A program that provides instructional materials to help you carry out the steps.
Citation Information
Patent Citations
Vehicle training system
JP2015219497A
Driving support system, driving support method, and server computer for driving support system
JP2019046079A
Generation device, generation system, and generation method
JP2020201434A
Question providing system, question providing method, question providing program, and storage medium
JP2021071644A
Drive support device, drive support method and drive support program
JP2021178633A