Information provision device, information provision method, and information provision system

Abstract

To fully upgrade driver's safe driving consciousness.SOLUTION: An information provision device includes a controller. The controller acquires video taken by a camera installed in a vehicle which a driver drives. Video captured during a predesignated period and showing the highest degree of driving risk by the driver is selected from among acquired videos. The selected video is displayed on a terminal together with a result of diagnosis conducted on the driver's driving.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an information providing apparatus, an information providing method, and an information providing system.

Background Art

[0002] Conventionally, an apparatus for searching and displaying information related to driving recorded on a recording medium has been known (see, for example, Patent Document 1). Further, Patent Document 1 describes that drivers are displayed in a ranking format according to the evaluation points for each driver.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, the safe driving awareness of drivers cannot be sufficiently improved. For example, in the technology described in Patent Document 1, since information is displayed by numbers, drivers may not be able to understand the meaning of the displayed numbers and may not be able to grasp the necessary information. In particular, when a driver cannot grasp information related to his / her own dangerous driving, the safe driving awareness cannot be improved.

[0005] The present invention has been made in view of the above, and an object thereof is to provide an information providing apparatus, an information providing method, and an information providing program capable of sufficiently improving the safe driving awareness of drivers.

Means for Solving the Problems

[0006] The information providing apparatus according to the present invention includes a controller. The controller acquires an image captured by a camera mounted on a vehicle driven by a driver, selects an image captured during a predetermined period and having the highest driving risk level among the acquired images, and causes the selected image to be displayed on a terminal together with a diagnosis result regarding the driver's driving.

Effect of the Invention

[0007] The present invention provides, to a driver, an image related to dangerous driving by the driver together with a diagnosis result of driving. Therefore, the driver can intuitively grasp information regarding dangerous driving from the image. As a result, the driver's awareness of safe driving is improved.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of an information providing apparatus, an information providing method, and an information providing system disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited by the embodiments shown below.

[0010] First, the configuration of the information providing system will be described with reference to FIG. 1. FIG. 1 is a diagram showing a configuration example of the information providing system according to the embodiment.

[0011] As shown in FIG. 1, the information providing system 1 includes an information providing device 10, an in-vehicle device 20, and a terminal 30. The information providing device 10 is connected to the in-vehicle device 20 and the terminal 30 via a network N. The information providing device 10 is, for example, a server.

[0012] The in-vehicle device 20 is mounted on the vehicle V. The in-vehicle device 20 is, for example, a drive recorder. The in-vehicle device 20 includes a camera. The in-vehicle device 20 transmits an image captured by the camera and information about the vehicle V to the information providing device 10.

[0013] The terminal 30 displays a screen according to the control of the information providing device 10. For example, the terminal 30 is a personal computer or a smartphone, etc.

[0014] The configuration of the information providing device 10 will be described with reference to FIG. 2. FIG. 2 is a diagram showing a configuration example of the information providing device according to the embodiment. As shown in FIG. 2, the information providing device 10 includes a communication unit 11, a controller 12, and a memory 13.

[0015] The communication unit 11 is a communication module for performing wired or wireless communication. For example, the communication unit 11 is a NIC (Network Interface Card).

[0016] The controller 12 reads and executes a program stored in the memory 13. The controller 12 is a CPU (Central Processing Unit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), GPU (Graphics Processing Unit), SoC (System on a Chip), etc.

[0017] The controller 12 may be a single processor. The controller 12 may have a multi-processor configuration. Further, the controller 12 may have a multi-core configuration in which a plurality of cores are included in a single chip connected by a single socket.

[0018] The memory 13 is a storage medium such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory. The memory 13 functions as a ROM (Read Only Memory) or a RAM (Random Access Memory).

[0019] The configuration of the in-vehicle device 20 will be described with reference to FIG. 3. FIG. 3 is a diagram showing a configuration example of the in-vehicle device according to the embodiment. As shown in FIG. 3, the in-vehicle device 20 includes an interface 21, a communication unit 22, a camera 23, a controller 24, and a memory 25.

[0020] The interface 21 inputs and outputs data to and from devices provided in the vehicle V. For example, the interface 21 is a port corresponding to USB (Universal Serial Bus), CAN (Controller Area Network), Ethernet (registered trademark), or the like.

[0021] The interface 21 is connected to a sensor group provided in the vehicle V or an ECU (Electronic Control Unit) or the like.

[0022] The communication unit 22 is a communication module for performing wired or wireless communication. For example, the communication unit 22 is a NIC or a WiFi (registered trademark) module or the like.

[0023] The controller 24 reads and executes a program stored in the memory 25. The controller 24 is a CPU, a DSP, an FPGA, a GPU, an SoC, or the like.

[0024] The controller 24 may be a single processor. The controller 24 may have a multi-processor configuration. Further, the controller 24 may have a multi-core configuration in which a plurality of cores are included in a single chip connected by a single socket.

[0025] The controller 24 acquires information regarding the vehicle V via the interface 21. For example, the information regarding the vehicle V includes the position information of the vehicle V, speed, acceleration (G value), amount of accelerator operation, amount of steering operation (steering angle), amount of braking operation, lighting state of lights, fuel consumption, battery remaining amount, and the like.

[0026] The memory 25 is a storage medium such as an HDD, an SSD, or a flash memory. The memory 25 functions as a ROM or a RAM.

[0027] The configuration of the terminal 30 will be described with reference to FIG. 4. FIG. 4 is a diagram showing a configuration example of the in-vehicle device according to the embodiment. As shown in FIG. 4, the terminal 30 includes a communication unit 31, a display unit 32, a controller 33, and a memory 34.

[0028] The communication unit 31 is a communication module for performing wired or wireless communication. For example, the communication unit 31 is a NIC or a WiFi (registered trademark) module or the like.

[0029] The display unit 32 is a display device such as a display or a touch panel. The display unit 32 displays a screen in accordance with the control of the controller 33.

[0030] The controller 33 reads and executes a program stored in the memory 34. The controller 33 is a CPU, a DSP, an FPGA, a GPU, an SoC, or the like.

[0031] The controller 33 may be a single processor. The controller 33 may have a multi-processor configuration. Further, the controller 33 may have a multi-core configuration in which a plurality of cores are included in a single chip connected by a single socket.

[0032] The memory 34 is a storage medium such as an HDD, an SSD, or a flash memory. The memory 34 functions as a ROM or a RAM.

[0033] Using FIGS. 5 and 6, the details of the processing of the information providing apparatus 10 will be described. FIGS. 5 and 6 are flowcharts showing the processing procedures of the information providing apparatus.

[0034] FIG. 5 shows the flow of the process in which the controller 12 of the information providing apparatus 10 prepares the information provided via the terminal 30. As shown in FIG. 5, first, the controller 12 acquires video (moving image) and related information from the in-vehicle device 20 (step S101). At this time, the controller 12 acquires the video captured by the camera 23 mounted on the vehicle V driven by the driver.

[0035] The related information is information about the vehicle V acquired by the in-vehicle device 20 via the interface 21. The related information is, for example, information about the vehicle V, such as the position information, speed, acceleration (G value), amount of accelerator operation, amount of steering operation (steering angle), amount of braking operation, lighting state of the lights, fuel consumption, battery remaining amount, etc.

[0036] Next, the controller 12 calculates the risk level based on the video and the related information (step S102).

[0037] The controller 12 identifies the date and time when a dangerous driving (near miss) occurred based on the video and the related information. Further, the controller 12 calculates the degree of dangerous driving (hereinafter, the risk level) at the identified date and time. Here, the risk level at the date and time when no dangerous driving has occurred is set to 0.

[0038] For example, the controller 12 identifies the speed limit from the signs shown in the video. Then, if the speed of the vehicle V exceeds the speed limit, the controller 12 determines that a dangerous driving has occurred. The controller 12 calculates the risk level so that it increases as the value obtained by subtracting the speed limit from the speed of the vehicle V increases.

[0039] Further, for example, when the speed of the vehicle V is equal to or higher than a certain value and the distance to the vehicle ahead shown in the video is less than the threshold value, the controller 12 determines that a dangerous driving has occurred. The controller 12 calculates the degree of danger so that it increases as the distance to the vehicle ahead becomes shorter.

[0040] Also, for example, when the amount of accelerator operation, the amount of steering operation, or the amount of braking operation per unit time exceeds the threshold value, the controller 12 determines that a dangerous driving has occurred. The controller 12 calculates the degree of danger so that it increases as the amount of each operation increases.

[0041] Also, for example, when the G value generated in the vehicle V exceeds the threshold value, the controller 12 determines that a dangerous driving has occurred. The controller 12 calculates the degree of danger so that it increases as the G value increases.

[0042] When the degree of danger is greater than 0 (step S103, Yes), the controller 12 stores the video and related information together with the degree of danger in the memory 13 (step S104). For example, the controller 12 stores the video, the date and time when the video was captured, the position information of the vehicle V when the video was captured, and the calculated degree of danger in association with each other in the memory 13.

[0043] On the other hand, when the degree of danger is not greater than 0 (step S103, No), that is, when it is determined that no dangerous driving has occurred, the controller 12 determines excellent driving based on the video and related information (step S105). Note that in this embodiment, since the degree of danger does not become negative, the fact that the degree of danger is not greater than 0 means that the degree of danger is 0.

[0044] The controller 12 determines whether the conditions for excellent driving are satisfied based on the video and related information. The conditions for excellent driving are as follows, for example.

[0045] (Condition 1: Yield driving) When the speed of the vehicle V is equal to or lower than the threshold value and an interruption by another vehicle is detected by image recognition from the video in front of the vehicle V, the controller 12 determines that the driver of the vehicle V has performed a courtesy driving.

[0046] (Condition 2: Considerate driving (inter-vehicle distance)) When the controller 12 detects from the video in front of the vehicle V that the vehicle in front is marked with a novice driver sign or an elderly driver sign, and the inter-vehicle distance between the vehicle V and the vehicle in front is longer than normal, the controller 12 determines that the driver of the vehicle V has performed a considerate driving. Note that the normal inter-vehicle distance of the driver (for example, the average over the entire period) is assumed to be stored in advance in the memory 13 or another cloud server or the like.

[0047] (Condition 3: Considerate driving (specific facilities)) When the controller 12 determines from the position information of the vehicle V that there is a school, a hospital, or a nursing facility in the vicinity, and the speed of the vehicle V is lower than the legal speed (or lower than the legal speed by a predetermined speed (for example, 10 km / h)), the controller 12 determines that the driver of the vehicle V has performed a considerate driving.

[0048] (Condition 4: Considerate driving (pedestrians)) When the controller 12 detects a crosswalk, a pedestrian, or a bicycle by image recognition from the video in front of the vehicle V, does not detect a signal, and the speed of the vehicle V becomes 0 km / h (stopped), the controller 12 determines that the driver of the vehicle V has performed a considerate driving.

[0049] (Condition 5: Polite driving (oncoming vehicle)) When the controller 12 determines from the position information of the vehicle V that it is traveling on a one-lane road, detects an oncoming vehicle by image recognition from the video in front, and the speed of the vehicle V becomes 0 km / h (stopped), the controller 12 determines that the driver of the vehicle V has yielded the road.

[0050] (Condition 6: Polite driving (securing an entrance / exit)) The controller 12 detects the entrance / exit of a facility (such as a restaurant or a store) and a red signal from the front video by image recognition. When the speed of the vehicle V becomes 0 km / h (stopped), the controller 12 determines that the driver of the vehicle V has stopped at the red signal so as not to block the entrance / exit. Note that the detection of the entrance / exit by image recognition means that the entrance / exit is located in front of the vehicle V, that is, the vehicle V is not blocking the entrance / exit (other vehicles can pass through for entry / exit).

[0051] In this way, the controller 12 can determine whether the conditions for excellent driving are satisfied based on the signs, other vehicles, pedestrians, lanes, or facilities shown in the acquired video. In this way, the controller 12 can efficiently determine excellent driving by diverting the information used for determining dangerous driving.

[0052] When any of the conditions for excellent driving is satisfied (step S106, Yes), the controller 12 stores the information related to excellent driving in the memory 13 (step S107). For example, the controller 12 stores in the memory 13 by associating the video, the date and time when the video was captured, the position information of the vehicle V when the video was captured, and the information specifying the satisfied condition for excellent driving.

[0053] FIG. 6 shows the flow of the process in which the controller 12 of the information providing device 10 provides information via the terminal 30. As shown in FIG. 6, first, the controller 12 receives a video display request from the terminal 30 (step S201). For example, the controller 12 receives a request from the terminal 30 via a web browser and provides a web page as a response to the request. The terminal 30 displays the provided web page as a screen. Note that the screen displayed on the terminal 30 is viewed by the driver of the vehicle V.

[0054] Next, the controller 12 searches the memory 13 for videos within the period and having a risk level greater than 0 (step S202). That is, the controller 12 searches the videos already stored in the memory 13 in the process of step S104 in FIG. 5.

[0055] When there is a video that meets the search criteria (when the search hits a video) (step S203, Yes), the controller 12 causes the terminal 30 to display the video together with the related information (step S204).

[0056] At this time, the controller 12 selects a video for display. The controller 12 can select a video that was captured within a predetermined period (for example, the most recent one week or one month) and has the highest degree of driving risk by the driver. Note that the video selected by the controller 12 is not limited to one video with a maximum risk level of 1. For example, the controller 12 may select a plurality of videos in descending order of risk level.

[0057] FIG. 7 is a diagram showing an example of a screen. As shown in FIG. 7, the controller 12 causes the terminal 30 to display the selected video together with the diagnosis result for the driver's driving. Thereby, the controller 12 can prompt the driver to grasp information regarding dangerous driving and improve the awareness of safe driving.

[0058] The screen 51 in FIG. 7 includes a summary display area 511, a detailed display area 512, a video display area 514, a seek bar 516, a playback speed button 517, and a delete button 518.

[0059] In the summary display area 511, a summary of the diagnosis result for the driver's driving is displayed. In the summary display area 511, the total evaluation score is displayed. Also, in the summary display area 511, the score for each item and a radar chart are displayed. Also, in the summary display area 511, a comment about the diagnosis result is displayed.

[0060] For example, the diagnosis result may be based on the risk levels calculated for each item such as speed overrun, sudden acceleration, sudden deceleration, sudden steering, idling, long-time driving, and dangerous inter-vehicle distance. The score for each item becomes larger as the risk level calculated by the controller 12 is smaller (for example, the score when the risk level is 0 is 100 points).

[0061] In the detailed display area 512, the driver's overall ranking, the number of violations and near misses, etc. are displayed. The number of near misses is the number of times the controller 12 has determined that a dangerous driving degree has occurred.

[0062] In the video display area 514, the video selected by the controller 12 is displayed. In the video display area 514, the video captured by the camera 23 at the date and time determined to be dangerous driving is displayed.

[0063] Also, the controller 12 acquires the position information of the vehicle V together with the video. Then, the controller 12 causes the terminal 30 to display an image 515 of a map indicating the position information of the vehicle V when the selected video was captured, together with the diagnosis result. The image 515 is displayed in a state embedded in the video in the video display area 514. Thereby, the controller 12 can provide the driver with a lot of information regarding dangerous driving including not only the video but also the position information. Note that the controller 12 may display a still image cut out from one frame of the video, or the image 515 instead of displaying the video.

[0064] The video in the video display area 514 is displayed on the screen 51 and playback is started. Also, deletion of the video is prohibited until the playback of the video is completed. That is, when the controller 12 causes the terminal 30 to display the selected video together with the diagnosis result, the operation of deleting the video is prohibited before the playback of the video is completed, and the operation of deleting the video is permitted after the playback of the video is completed. Thereby, the driver is encouraged to view the video from the beginning to the end at the normal speed. As a result, the driver can surely grasp the information of dangerous driving.

[0065] Here, the deletion of the video may be to erase the video from the memory 13, or may be to make the video non-displayed on the screen 51.

[0066] For example, when the delete button 518 is pressed, the controller 12 performs a process of deleting the video. The controller 12 makes the delete button 518 non-displayed or inoperable until the playback of the video is completed.

[0067] Also, when the playback speed button 517 is pressed, the playback speed of the video is increased (for example, 1.2 times speed, 2 times speed). Also, when the seek bar 516 is operated, the playback position of the video changes. The controller 12 permits an operation of deleting the video when the playback of the video is completed without an operation of the playback speed button 517 or the seek bar 516.

[0068] Returning to FIG. 6, when there is no video that meets the search conditions (when no video is found in the search) (step S203, No), the controller 12 searches the memory 13 for information on excellent driving (step S205). That is, the controller 12 searches for the videos stored in the memory 13 in the process of step S107 in FIG. 5.

[0069] FIG. 8 is a diagram showing an example of a screen. As shown in FIG. 8, when there is information on excellent driving in the memory 13 (step S206, Yes), the controller 12 causes the information on excellent driving to be displayed on the screen 51 together with the diagnosis result (step S207).

[0070] Specifically, when there is no video that was captured within a predetermined period and to which a driving risk level by the driver is associated among the acquired videos (step S203, No), the controller 12 selects a video that satisfies the conditions related to excellent driving from among the acquired videos. Then, the controller 12 causes the selected video to be displayed on the terminal 30 together with a comment that praises the driver (steps S205, S206, S207).

[0071] The screen 51 in FIG. 8 includes a summary display area 511 and a detailed display area 512. The display contents of the summary display area 511 and the detailed display area 512 are as described in FIG. 7.

[0072] Furthermore, on the screen 51 of FIG. 8, an image 521 of a map showing the position information of the vehicle V when excellent driving is performed and a comment 522 containing praise for the driver are displayed. In the example of FIG. 8 as well, the video captured by the camera 23 may be displayed on the screen 51.

[0073] In this way, the controller 12 can provide not only information on dangerous driving but also information on excellent driving. In addition, when there is excellent driving, the controller 12 provides a comment containing praise for the driver. This improves the driver's motivation for excellent driving.

[0074] Also, the controller 12 may provide information on the excellent driving of other users (drivers) to users for whom there is no diagnosis result. For example, the controller 12 causes a screen similar to that of FIG. 8 to be displayed on the terminal of a user for whom there is no diagnosis result. For example, a user for whom there is no diagnosis result is a user who has not driven a vehicle as a driver within a certain period or a user who does not perform driving itself.

[0075] Further effects and modifications can be easily derived by those skilled in the art. Therefore, the broader aspects of the present invention are not limited to the specific details and representative embodiments represented and described as above. Accordingly, various changes can be made without departing from the spirit or scope of the general inventive concept defined by the appended claims and their equivalents.

Description of Reference Numerals

[0076] 1 Information providing system 10 Information providing device 11, 22, 31 Communication unit 12, 24, 33 Controller 13, 25, 34 Memory 20 Vehicle-mounted device 21 Interface 23 Camera 30 Terminal 32 Display unit 51 Screen 511 Summary display area 512 Detailed display area 514 Video display area 515, 521 Images 516 Seek bar 517 Playback speed button 518 Delete button 522 Comment

Claims

1. An information providing device for providing information, comprising: a controller; The controller: Acquires video captured by a camera mounted on a vehicle driven by a driver, Among the acquired images, an image captured during a predetermined period and showing the highest degree of danger of driving by the driver is selected; The selected image is displayed on a terminal together with a diagnosis result for the driving of the driver. Information provision device.

2. The controller: Acquire location information of the vehicle together with the image; A map image showing the position information of the vehicle at the time when the selected image was captured is displayed on the terminal together with the diagnosis result.

2. The information providing device according to claim 1.

3. The controller: When the selected image is displayed on the terminal together with the diagnosis result, an operation to delete the image is prohibited before the playback of the image is completed, and an operation to delete the image is permitted after the playback of the image is completed.

2. The information providing device according to claim 1.

4. The controller: If there is no video among the acquired videos that was taken during a predetermined period and is associated with a degree of risk of the driving by the driver, select a video from the acquired videos that satisfies a condition related to good driving, The selected video is displayed on the terminal together with a comment praising the driver.

2. The information providing device according to claim 1.

5. The controller: Based on the signs, other vehicles, pedestrians, lanes, or facilities shown in the acquired image, it is determined whether the conditions for good driving are met.

5. The information providing device according to claim 4.

6. An information providing method executed by an information providing device that provides information, comprising: Acquires video captured by a camera mounted on a vehicle driven by a driver, Among the acquired images, an image captured during a predetermined period and showing the highest degree of danger of driving by the driver is selected; The selected image is displayed on a terminal together with a diagnosis result for the driving of the driver. Information provision method.

7. An information provision system including an information provision device that provides information, a terminal, and an in-vehicle device equipped with a camera, The in-vehicle device transmits the captured image to the information providing device, The controller of the information providing device Acquire an image from the in-vehicle device; Among the acquired images, an image that was captured during a predetermined period and that indicates the highest degree of danger of driving by a driver of the vehicle equipped with the in-vehicle device is selected; The selected image is displayed on the terminal together with a diagnosis result for the driving of the driver. Information provision system.

Images