Information provision device and information provision system

Abstract

To provide an information providing device and an information providing system by which a video with a high education effect regarding traffic can be efficiently obtained.SOLUTION: An information providing device 20 comprises a collection unit 231, an analysis unit 232, and an insertion unit 233. The collection unit collects a video photographed by an on-vehicle device. The analysis unit analyzes the video collected by the collection unit. The insertion unit inserts a predetermined message to the video according to information regarding dangerous driving shown by an analysis result by the analysis unit.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information providing device and Information provision system To Regarding. [Background technology]

[0002] A technology is known that associates images captured by an in-vehicle device with danger patterns. In addition, images of traffic violations and near-misses captured by a drive recorder installed in a company vehicle are sometimes used as educational materials for accident prevention education within a company. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-52634 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, with conventional technology, it may be difficult to efficiently obtain video that is highly effective for traffic education. For example, a user may not be able to understand what they should pay attention to in terms of traffic safety just by looking at video footage from a drive recorder.

[0005] The present invention has been made in view of the above, and has an object to efficiently obtain video that is highly effective for traffic education. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the information providing device according to the present invention has a collection unit, an analysis unit, and an insertion unit. The collection unit collects video captured by an in-vehicle device. The analysis unit analyzes the video collected by the collection unit. The insertion unit inserts a predetermined message into the video according to information on dangerous driving indicated by an analysis result by the analysis unit. Effect of the Invention

[0007] According to the present invention, it is possible to efficiently obtain video that is highly effective for traffic education. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an information providing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an information providing device according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of message information. [Figure 4] FIG. 4 is a diagram showing an example of video information. [Diagram 5] FIG. 5 is a diagram showing an example of a legal violation message. [Figure 6] FIG. 6 is a diagram showing an example of a legal violation message. [Figure 7] FIG. 7 is a flowchart illustrating a processing procedure of the information providing device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of an information providing device and an information providing system disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiment described below.

[0010] First, the configuration and processing of an information providing system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram illustrating the information providing system according to an embodiment.

[0011] 1, the information provision system 1 includes a vehicle V, an in-vehicle device 10, an information provision device 20, and a terminal 30. For example, the vehicle V is an automobile.

[0012] For example, the in-vehicle device 10 is a drive recorder installed inside the vehicle V. Also, for example, the information providing device 20 is a server. Also, for example, the terminal 30 is a personal computer, a smartphone, or the like capable of playing video files in a predetermined format.

[0013] The in-vehicle device 10 and the terminal 30 are connected to the information providing device 20 via a network N so as to be capable of data communication. For example, the network N is the Internet.

[0014] The flow of processing in the information providing system 1 will be described with reference to Fig. 1. As shown in Fig. 1, first, the in-vehicle device 10 captures an image (step S1).

[0015] The in-vehicle device 10 may capture video at all times, or may capture video when an impact is detected based on the sensor value of a G sensor (acceleration sensor). The in-vehicle device 10 may also capture video when a traffic violation or near miss occurs.

[0016] Near misses are events that could lead to traffic violations or accidents. For example, sudden acceleration or deceleration by vehicle V or surrounding vehicles, sudden steering, or abnormal closeness to pedestrians or objects are examples of near misses.

[0017] Next, the vehicle-mounted device 10 transmits the captured video to the information providing device 20 (step S2). The vehicle-mounted device 10 has a transmission unit that transmits the video to the information providing device 20. The vehicle-mounted device 10 may transmit all captured videos, or may transmit videos when a traffic violation or near miss occurs.

[0018] In addition, the in-vehicle device 10 may automatically transmit the video at a predetermined timing, or may transmit the video in response to an instruction from the information providing device 20.

[0019] Furthermore, the in-vehicle device 10 can transmit sensor values ​​such as a G sensor to the information providing device 20 together with the image.

[0020] Here, the information providing device 20 analyzes the video acquired from the in-vehicle device 10 (step S3). The information providing device 20 can use image recognition technology to recognize what kind of traffic accident, traffic violation, or near miss is shown in the video.

[0021] Furthermore, the information providing device 20 can use not only the video but also sensor values ​​such as a G sensor for analysis.

[0022] Then, the information providing device 20 inserts a message according to the analysis result into the video (step S4). For example, if the analysis shows that the vehicle V accelerated when the traffic light was yellow or red, the information providing device 20 determines that a traffic light violation occurred and inserts a message according to the traffic light violation.

[0023] As shown in Fig. 1, the information providing device 20 inserts a message into a video as, for example, a subtitle (telop). In the example of Fig. 1, the information providing device 20 inserts a message, "Stop at yellow lights," into the video.

[0024] The information providing device 20 provides the video with the message inserted therein to the terminal 30 (step S5). Then, the terminal 30 plays the provided video (step S6). The terminal 30 has a playback unit that plays the provided video.

[0025] The configuration of the information providing device 20 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the information providing device according to the embodiment.

[0026] As shown in FIG. 2, the information providing device 20 includes an interface unit 21, a storage unit 22, and a control unit .

[0027] The interface unit 21 is an interface for inputting and outputting data. For example, the interface unit 21 is a network interface card (NIC). The interface unit 21 can transmit and receive data to and from other devices.

[0028] The interface unit 21 may also be connected to input devices such as a mouse, a keyboard, etc. The interface unit 21 may also be connected to output devices such as a display and a speaker.

[0029] The control unit 23 and the memory unit 22 of the information providing device 20 are realized by a computer having, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, an input / output port, etc., or various circuits.

[0030] The storage unit 22 stores message information 221 , video information 222 , and video data 223 .

[0031] The message information 221 is information about a message to be inserted into a video image. Fig. 3 is a diagram showing an example of the message information.

[0032] 3, the message information 221 includes items such as an event, a basic message, a legal violation message (weak), and a legal violation message (strong). The items shown in FIG. 3 are examples, and the message information 221 may include other items.

[0033] An event is a specific content of a traffic accident, a traffic violation, or a near miss. Figure 3 shows "ignoring traffic signals" and "frequent sudden deceleration" as examples of events.

[0034] The basic message is a message for education or to raise awareness in response to an event. The legal violation message (weak) and the legal violation message (strong) are messages about laws related to an event.

[0035] In the example of Figure 3, "Stop when the light is yellow" is shown as an example of a basic message corresponding to the event "ignoring a traffic light."

[0036] Figure 3 also shows an example of a weak legal violation message corresponding to the event "ignoring traffic signals," which reads, "Driving in this manner violates Article XX of the Road Traffic Act! Fine: △ yen, imprisonment: □ years."

[0037] Figure 3 also shows an example of a strong legal violation message corresponding to the event "ignoring traffic signals," which reads, "This type of driving violates Article XX of the Road Traffic Act! Fine: △ yen, imprisonment: □ years."

[0038] In this case, the legal violation message (weak) and the legal violation message (strong) are messages about the same legal violation, but because the endings are different, the impression the user receives is thought to be different.

[0039] By using a weak legal violation message and a strong legal violation message, different educational or warning effects can be achieved. For example, a strong legal violation message gives a harsher impression than a weak legal violation message.

[0040] The video information 222 is information relating to video. The video information 222 can be said to be metadata for a video file. Fig. 4 is a diagram showing an example of the video information.

[0041] As shown in Fig. 4, the video information 222 includes items such as a file path, a tag, a location, etc. The items shown in Fig. 4 are an example, and the video information 222 may include other items.

[0042] The file path is information for identifying a video file, and is composed of, for example, a relative path and a file name of the video file.

[0043] The tag is a tag added to the video file. The tag is added based on information obtained, for example, when analyzing the video and inserting a message. The location is the location where the video was shot.

[0044] In the example of Figure 4, the video identified by the file path " / 001.mp4" is tagged with "ignoring traffic lights" and is shown to have been filmed at a location called "X traffic light."

[0045] The video data 223 is actual data of the video in which the message has been inserted. For example, the video data 223 is a collection of video files, and each file is specified by the file path of the video information 222.

[0046] The control unit 23 includes a collection unit 231 , an analysis unit 232 , an insertion unit 233 , a provision unit 234 , and a notification unit 235 .

[0047] The collection unit 231 collects images captured by the in-vehicle device. Although only the in-vehicle device 10 is illustrated in Fig. 1, the collection unit 231 can collect images from a plurality of in-vehicle devices having the same functions as the in-vehicle device 10.

[0048] The analysis unit 232 analyzes the video collected by the collection unit 231 .

[0049] The insertion unit 233 inserts a predetermined message into the video in accordance with the information on dangerous driving indicated by the analysis result by the analysis unit 232.

[0050] The information on dangerous driving corresponds to, for example, the event of the message information 221. The insertion unit 233 can insert into the video a message corresponding to the event of the message information 221. In this way, the information providing device 20 can efficiently obtain a video that is highly effective for traffic education.

[0051] In the example of FIG. 1, the insertion unit 233 inserts a basic message "Stop at a yellow light" corresponding to the event "ignoring a traffic light" into the video.

[0052] In addition, the insertion unit 233 can insert a message according to the driving characteristics of the driver based on the analysis result. For example, if the driver who was driving the vehicle when the video was captured has driving characteristics that involve frequent sudden deceleration, the insertion unit 233 inserts a message corresponding to the event "frequent sudden decelerations" into the video.

[0053] This allows more appropriate messages to be inserted into the video, taking into account driving characteristics.

[0054] Furthermore, the insertion unit 233 inserts a message regarding a violation of law corresponding to the type of dangerous driving indicated by the analysis result.

[0055] In the example of Fig. 5, the insertion unit 233 inserts a legal violation message (weak) corresponding to the event "ignoring traffic signals" into the video, "Driving like this leads to violation of Article 〇 of the Road Traffic Act! Fine of △ yen, imprisonment of □ years." Fig. 5 is a diagram showing an example of a legal violation message.

[0056] The insertion unit 233 may insert the message as a subtitle as in FIG. 1, or may insert the message over the entire screen as in FIG.

[0057] This makes it possible to inform the user of the specific risks posed by a traffic violation.

[0058] Furthermore, the insertion unit 233 inserts a message according to the degree of risk of dangerous driving based on the analysis result.

[0059] In the example of Fig. 6, the insertion unit 233 inserts a legal violation message (strong) corresponding to the event "ignoring a traffic signal" into the video, "Driving in this manner violates Article XX of the Road Traffic Act! Fine △ yen, imprisonment □ years." Fig. 6 is a diagram showing an example of a legal violation message.

[0060] For example, the insertion unit 233 inserts a legal violation message (weak) if the degree of danger is equal to or lower than a predetermined degree, and inserts a legal violation message (strong) if the degree of danger exceeds the predetermined degree.

[0061] This makes it possible to provide a strong warning about events that pose a particularly high degree of danger.

[0062] The insertion unit 233 may calculate the degree of danger based on, for example, the speed exceeded, the frequency of ignoring traffic signals, the acceleration during sudden acceleration and deceleration, and the like.

[0063] The insertion unit 233 converts the video with the message inserted into data in a predetermined format and stores it in the video data 223 .

[0064] The providing unit 234 acquires the video in which the message is inserted from the video data 223 and provides it to the terminal 30.

[0065] Furthermore, the providing unit 234 may provide an image that matches the driving characteristics of the user who is watching the image on the terminal 30.

[0066] For example, if the user watching the video has a driving characteristic of “frequent sudden deceleration,” the providing unit 234 refers to the video information 222 , acquires a video file with the file path “ / 002.mp4,” and provides it to the terminal 30 .

[0067] The notification unit 235 can use the message information 221 and the video information 222 to give a notification to alert the driver who is driving the vehicle.

[0068] For example, the notification unit 235 notifies the contents of the message to a vehicle driven by a driver having the same driving characteristics as the driving characteristics linked to the video into which the message is inserted by the insertion unit 233.

[0069] For example, if the driver has a driving characteristic of "frequent sudden deceleration," the notification unit 235 refers to the message information 221 and acquires a message saying "Stop at yellow traffic lights."

[0070] Then, the notification unit 235 notifies the vehicle driven by the driver to stop at the yellow light.

[0071] This makes it possible to provide accurate warnings that are tailored to the driver's driving characteristics.

[0072] Furthermore, the notification unit 235 notifies the content of the message to a vehicle traveling in a location associated with the video into which the message has been inserted by the insertion unit 233.

[0073] For example, when the vehicle driven by the driver is traveling near "Y intersection", the notification unit 235 refers to the video information 222 and acquires the tags "frequent sudden deceleration" and "speeding".

[0074] Furthermore, the notification unit 235 acquires messages corresponding to the events "frequent sudden deceleration" and "excessive speeding" from the message information 221, and notifies the vehicle of the contents of the acquired messages.

[0075] This makes it possible to provide accurate warnings tailored to the location where the vehicle is traveling.

[0076] 7 is a flowchart showing a processing procedure of the information providing device according to the embodiment. As shown in FIG. 7, first, the information providing device 20 collects video from an in-vehicle device (step S101). Next, the information providing device 20 analyzes the collected video (step S102).

[0077] Next, the information providing device 20 inserts a message according to the analysis result into the video (step S103), and provides the video with the message inserted therein to the terminal (step S104).

[0078] As described above, the information providing device 20 has the collection unit 231, the analysis unit 232, and the insertion unit 233. The collection unit 231 collects video captured by an in-vehicle device. The analysis unit 232 analyzes the video collected by the collection unit 231. The insertion unit 233 inserts a predetermined message into the video according to information on dangerous driving indicated by the analysis result by the analysis unit 232.

[0079] In this way, the information providing device 20 automatically inserts messages corresponding to traffic violations and near misses based on the analysis results of the video. As a result, according to this embodiment, it is possible to efficiently obtain video that is highly effective for traffic education.

[0080] Each function of the information providing device 20 is realized by a computer having, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, an input / output port, and various other circuits.

[0081] The information providing device 20 may also acquire the above-mentioned programs and various information via other computers or portable recording media connected via a wired or wireless network.

[0082] The CPU of the computer functions as a collection unit 231, an analysis unit 232, an insertion unit 233, a provision unit 234, and a notification unit 235 by, for example, reading and executing a program stored in the ROM.

[0083] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0084] N Network V Vehicle 1 Information provision system 10 Onboard equipment 20 Information provision device 21 Interface section 22 Memory section 23 Control Unit 30 Terminals 221 Message Information 222 Video Information 223 Video Data 231 Collection Department 232 Analysis Department 233 Insertion 234 Provision Department 235 Notification Department

Claims

1. An information providing device having a control unit, The control unit is Analyze the video captured from the in-vehicle device to obtain information about traffic signal violations, Inserting a message for education or a warning regarding the violation of the traffic signal into the video at a location where the violation occurred; a message regarding violation of law selected from two types of messages regarding violation of law having different strengths of warning depending on the frequency of the driver's violation of the traffic signal is inserted on the entire screen after the portion in the video where the traffic signal was ignored; Information provision device.

2. The control unit is For other vehicles traveling in the area where the driver ran the traffic light, notifying the driver of a message for education or warning in response to the violation of a traffic signal; 2. The information providing device according to claim 1.

3. An information provision system having an in-vehicle device, an information provision device, and a terminal, The in-vehicle device includes: Transmitting the captured image to the information providing device; The information providing device includes: Analyzing the video acquired from the in-vehicle device to acquire information regarding traffic signal violations; Inserting a message for education or a warning regarding the violation of the traffic signal into the video at a location where the violation occurred; a message regarding violation of law selected from two types of messages regarding violation of law having different strengths of attention depending on the frequency of the driver's violation of the traffic signal is inserted on the entire screen after the portion in the video where the traffic signal was ignored; providing the video to the terminal; The terminal includes: reproducing the video provided by the information providing device; Information provision system.

4. An information providing device having a control unit, The control unit is Analyzes vehicle driving footage acquired from in-vehicle equipment to extract scenes of traffic lights being ignored, Inserting an education or warning message corresponding to the signal violation into the signal violation scene; selecting one of a plurality of warning messages having different degrees of attention for pointing out violation of laws and regulations in accordance with the frequency of the driver ignoring the traffic signal, and further inserting the selected warning message in full screen display following the scene of the driver ignoring the traffic signal; Information provision device.

Images