Terminal device, management system and in-vehicle terminal device

Abstract

To provide persons under education with educational videos with high educational effect.SOLUTION: A terminal device comprises a generation unit and upload unit. The generation unit generates search tags associated with capture time of driving video captured by a camera. The upload unit uploads a video clip obtained by clipping a portion of the driving image corresponding to a specified capture time based on the search tags generated by the generation unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a terminal device, a management system, and In-vehicle terminal device Regarding. [Background technology]

[0002] Conventionally, there is an information collection system that uploads images captured by an on-board camera to a center every time a vehicle passes a preset point. In such an information system, for example, when an accident occurs, the uploaded images are used for accident investigation (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-237945 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, all the images taken by each vehicle are uploaded, which means that unnecessary videos are also uploaded, which is not efficient. Therefore, in the conventional technology, there is room for improvement in terms of efficiently managing the images taken by the vehicle.

[0005] The present invention has been made in view of the above, and has an object to provide a terminal device, a management system, and a video management method that can efficiently manage videos captured by a vehicle. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the terminal device according to the present invention includes a generation unit and an upload unit. The generation unit generates a search tag associated with an imaging time of a driving video captured by a camera. The upload unit uploads a cut-out video obtained by cutting out the driving video at the imaging time specified based on the search tag generated by the generation unit. Effect of the Invention

[0007] According to the present invention, video images captured by a vehicle can be efficiently managed. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an overview of the management system. [Diagram 2] FIG. 2 is a block diagram of the in-vehicle device. [Diagram 3] FIG. 3 is a block diagram of the management device. [Figure 4] FIG. 4 is a diagram showing an example of a display mode of the search tags. [Diagram 5] FIG. 5 is a diagram showing an example of a playback screen of a cut-out video. [Figure 6] FIG. 6 is a flowchart showing a processing procedure executed by the in-vehicle device. [Figure 7] FIG. 7 is a flowchart showing a processing procedure executed by the management device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of a terminal device, a management system, and a video management method disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0010] First, an overview of a terminal device, a management system, and a video management method according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an overview of the video management method. Note that the video management method according to the embodiment is executed by an in-vehicle device 1 shown in Fig. 1.

[0011] In the example shown in FIG. 1, the in-vehicle device 1 is a drive recorder equipped with a communication function mounted on each vehicle, and captures driving footage while the vehicle is traveling. The in-vehicle device 1 is an example of a terminal device, and the terminal device may be, for example, a portable communication device having a camera, such as a smartphone or a tablet terminal, and may be a terminal that can be removed from the vehicle. The management device 100 is a device that aggregates driving footage captured by each in-vehicle device 1. For example, when an accident occurs, the management device 100 extracts and provides footage of the accident from the aggregated driving footage.

[0012] For example, a typical drive recorder has a system that uploads driving footage before and after a vehicle collision to a server device when a vehicle collision is detected. On the other hand, in such a system, when a collision is not detected, for example, when the vehicle scrapes against something, the driving footage is not uploaded to the server.

[0013] For this reason, for example, a driver would upload driving footage from a few minutes before and after a time specified by the driver based on his or her own memory, and the footage would be checked on the server side. However, it is rare for a driver to directly recall a time, making this task difficult.

[0014] In the video management method according to the embodiment, a search tag associated with a time is generated for each driving video, and the driving video is managed based on the search tag. Specifically, as shown in Fig. 1, the in-car device 1 generates a search tag for the driving video Ia (step S1).

[0015] Here, the search tag is information indicating a specific event that occurred at the corresponding image capture time, and for example, information regarding a passed or stopped-in point is used as the search tag. Note that the example shown in Fig. 1 shows a case where search tags Ta, Tb, and Tc are generated for a driving video Ia.

[0016] Information about the generated search tags is transmitted to the management device 100. As shown in Fig. 1, the management device 100 displays the vehicle's travel route on the map M by arranging the above-mentioned search tags in chronological order and superimposing them on the map M.

[0017] For example, the administrator can specify a driving video of a search tag corresponding to an icon displayed on the map M by specifying the icon. For example, the administrator asks the driver about a location where the vehicle may have been scraped, and selects the corresponding icon displayed on the map M. This causes the corresponding tag to be selected, and specification information related to the specified search tag is transmitted from the management device 100 to the in-vehicle device 1.

[0018] When the in-car device 1 receives the specification information (step S2), it generates a cut image Ic by cutting out an image at the capture time specified by the specification information from the driving image Ia, and uploads the generated cut image (step S3).

[0019] This allows the administrator to check the driving video of the specified search tag. In this manner, in the management system S according to the embodiment, a search tag is generated using information that indirectly evokes the image capture time, and the specified cut video Ic is uploaded based on the generated search tag.

[0020] As a result, in the management system S according to the embodiment, even if the image capture time is not directly known, the corresponding driving video can be confirmed by using other information linked to the image capture time.

[0021] Furthermore, in the management system S according to the embodiment, by uploading a part of the driving video designated by the search tag, the management device 100 can efficiently manage the driving video.

[0022] Therefore, according to the management system S of the embodiment, it is possible to efficiently manage the video captured by the vehicle.

[0023] Next, a configuration example of the in-vehicle device 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram of the in-vehicle device 1. As shown in Fig. 2, the in-vehicle device 1 includes an in-vehicle camera 10, a communication unit 11, a storage unit 20, and a control unit 30.

[0024] The vehicle-mounted camera 10 is equipped with various imaging elements and generates driving images by capturing images of the surroundings of the vehicle. The communication unit 11 is realized, for example, by a NIC (Network Interface Card) or the like. The communication unit 11 is connected to a predetermined communication network so as to be capable of two-way communication, and transmits and receives information to and from the management device 100 and the like.

[0025] The storage unit 20 is a storage unit configured with a storage device such as a non-volatile memory, a data flash, a hard disk drive, etc. As shown in FIG.

[0026] The driving image storage unit 21 is a storage area for storing driving images captured by the vehicle-mounted camera 10. The search tag storage unit 22 is a storage unit for storing information related to the above-mentioned search tags.

[0027] The control unit 30 includes a generation unit 31 and an upload unit 32, and includes, for example, a computer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, input / output ports, etc., and various other circuits.

[0028] The CPU of the computer functions as the generating unit 31 and the uploading unit 32 of the control unit 30, for example, by reading and executing a program stored in the ROM.

[0029] Also, at least a part or the whole of the generating unit 31 and the uploading unit 32 of the control unit 30 can be configured with hardware such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0030] The generating unit 31 generates a search tag associated with the imaging time of the driving video. For example, the generating unit 31 generates, as a search tag, information on an event that occurred at the corresponding imaging time.

[0031] For example, the generation unit 31 can generate, as a search tag, information about the imaging location linked to the imaging time, such as information about surrounding facilities that the vehicle has passed through, or information about stop-off points that the vehicle has stopped at.

[0032] For example, the generation unit 31 generates a search tag related to an image capture position based on a current location and a destination acquired from a car navigation device (not shown) and image recognition of a driving video. In this way, by using information about an image capture position as a search tag, it is possible to specify an image capture time by a location, thereby improving searchability for a driving video.

[0033] When generating search tags by image recognition, the generating unit 31 may use information that indirectly evokes location information as a search tag. Specifically, for example, when passing an impressive car or passing an impressive pedestrian, a search tag may be generated from the result of image recognition as an event. In this case, voices inside the car may also be used in combination. For example, the result of image recognition may be generated as a search tag based on a voice inside the car saying, "What's that?"

[0034] Furthermore, the generating unit 31 may generate a search tag based on operation information for a vehicle. For example, the generating unit 31 obtains information related to the operation information from various sensors (not shown) and generates a search tag.

[0035] As a specific example, information such as right turns, left turns, lane changes, slowing down, etc. may be generated as search tags. In this way, by generating search tags based on operation information, the searchability of driving videos can also be improved.

[0036] When the generating unit 31 generates a search tag, the generating unit 31 transmits the generated search tag to the management device 100 while linking the generated search tag with the image capturing time, and also writes the generated search tag in the search tag storage unit 22 .

[0037] The uploading unit 32 uploads a cut-out video obtained by cutting out a driving video at a shooting time specified based on the search tag generated by the generating unit 31. For example, the uploading unit 32 generates a cut-out video obtained by cutting out a part of the driving video based on the shooting time specified by the management device 100, and uploads the cut-out video to the management device 100.

[0038] Next, a configuration example of the management device 100 will be described with reference to Fig. 3. Fig. 3 is a block diagram of the management device 100. In addition to the management device 100, Fig. 3 also shows a display unit 150 and an operation unit 151.

[0039] The display unit 150 is a so-called display, and displays information input from the management device 100. The operation unit 151 accepts various operations by the administrator, and outputs to the management device 100 information related to the accepted operations.

[0040] The management device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. The communication unit 110 is realized, for example, by a network interface card (NIC) or the like. The communication unit 110 is connected to a predetermined communication network so as to be capable of two-way communication, and transmits and receives information to and from the in-vehicle device 1 and the like.

[0041] The storage unit 120 is a storage unit configured with a storage device such as a non-volatile memory, a data flash, a hard disk drive, etc. As shown in FIG.

[0042] The search tag database 121 is a database that stores information related to search tags received from each of the car-mounted devices 1. The cut video database 122 is a database that stores information related to cut videos received from each of the car-mounted devices 1.

[0043] The control unit 130 includes a display control unit 131 and an instruction unit 132, and includes, for example, a computer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, an input / output port, and various other circuits.

[0044] The CPU of the computer functions as a display control unit 131 and an instruction unit 132 of the control unit 130, for example, by reading and executing a program stored in the ROM.

[0045] At least a part or the whole of the display control unit 131 and the instruction unit 132 of the control unit 130 can be configured with hardware such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0046] The display control unit 131 controls various information to be displayed on the display unit 150. For example, the display control unit 131 performs various processes for displaying search tags. For example, the display control unit 131 reads out search tags from the search tag database 121 and displays them on the display unit 150.

[0047] Fig. 4 is a diagram showing an example of a display mode of search tags. For example, as shown in Fig. 4, a list of search tags displayed in chronological order is displayed. At this time, for example, the display control unit 131 may display only those related to a predetermined reason based on an operation on the operation unit 151.

[0048] That is, for example, if "convenience store" is specified, only search tags that include "convenience store" can be displayed in a list. By displaying search tags in a list in this way, the administrator can grasp the search tags at a glance, making it easy to grasp the search tags.

[0049] 1, the display control unit 131 may superimpose the search tag on the map M. In this case, the administrator can easily understand the relationship between the search tag and the location information, and even in this case, the administrator can easily understand the search tag.

[0050] Furthermore, the display control unit 131 may display the search tag as a chapter when playing back the cut video. Fig. 5 is a diagram showing an example of a playback screen for the cut video. For example, as shown in Fig. 5, the display control unit 131 displays the search tag in text in accordance with the seek bar.

[0051] That is, the display control unit 131 controls the screen so that when the seek bar is moved, the search tag of the moved playback position is displayed in text form. This allows the administrator to easily understand the relationship between the actual cut video and the search tag.

[0052] Returning to the description of Fig. 3, the instruction unit 132 will be described. The instruction unit 132 instructs the vehicle-mounted device 1 to upload a cut video image based on a predetermined operation by the administrator on the search tag displayed on the display unit 150.

[0053] For example, the predetermined operation may be an operation of selecting a search tag, or an operation of specifying an image capture time based on a search tag (for example, 10 minutes after the search tag). When an operation of selecting a search tag is performed, the instruction unit 132 instructs the in-car device 1 to upload driving footage for, for example, three minutes before and after the search tag. In response to an instruction from the instruction unit 132, the in-car device 1 generates and uploads the cut-out footage.

[0054] Next, a process procedure executed by the in-vehicle device 1 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the process procedure executed by the in-vehicle device 1. The process procedure shown below is executed by the control unit 30.

[0055] 6, when the vehicle-mounted device 1 acquires a driving video (step S101), it generates a search tag (step S102). Next, the vehicle-mounted device 1 uploads the generated search tag (step S103), and then acquires instruction information from the management device 100 (step S104).

[0056] Next, the car-mounted device 1 uploads the cut video designated based on the instruction information, and ends the process (step S105).

[0057] Next, a process procedure executed by the management device 100 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the process procedure executed by the management device 100. Note that the process procedure shown below is executed by the control unit 130.

[0058] As shown in FIG. 7, the management device 100 displays the search tag received from the vehicle-mounted device 1 (step S201), and transmits instruction information to the vehicle-mounted device 1 based on an operation by the administrator (step S202).

[0059] Next, the management device 100 receives the cut video from the vehicle-mounted device 1 (step S203), plays back the received cut video (step S204), and ends the process.

[0060] As described above, the in-vehicle device 1 (an example of a terminal device) according to the embodiment includes the generation unit 31 and the upload unit 32. The generation unit 31 generates a search tag linked to the capture time of the driving video captured by the in-vehicle camera 10 (an example of a camera). The upload unit 32 uploads a cut video obtained by cutting out the driving video at the capture time specified based on the search tag generated by the generation unit 31. Therefore, the in-vehicle device 1 according to the embodiment can efficiently manage the video captured by the vehicle.

[0061] In the above embodiment, the case where the in-car device 1 uploads search tags as a first step has been described, but the present invention is not limited to this. For example, in addition to the search tags, videos and still images may also be uploaded. In this case, the videos and still images may also be displayed on the map M (see FIG. 1).

[0062] In the above embodiment, a case where a search tag is generated for a driving video has been described, but the present invention is not limited to this. That is, the present invention may be applied to generate search tags for various types of video other than a driving video.

[0063] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0064] 1. Vehicle-mounted device (an example of a terminal device) 31 Generation part 32 Upload Section 100 Management device (an example of a server device) 131 Display control unit 132 Instruction section S Management System

Claims

1. The names of facilities in the vicinity of the vehicle that have passed through are converted into text and generated as search tags, which are then linked to driving footage outside the vehicle captured by an onboard camera and stored. Sending the search tag to an external server; A control unit is provided for uploading a driving video associated with a search tag specified by the external server to the external server. Terminal device.

2. The control unit: generating the search tag by performing image recognition processing on the driving video outside the vehicle captured by the in-vehicle camera; The terminal device according to claim 1 .

3. A management system comprising a terminal device and an external server, The terminal device The names of the facilities in the vicinity that the vehicle has passed through are converted into text and generated as search tags, which are then linked to the driving video outside the vehicle captured by the onboard camera and stored. Sending the search tag to an external server; uploading the driving video associated with the search tag specified by the external server to the external server; The external server When playing an uploaded driving video, a search tag corresponding to the driving video is displayed in text at the position of the seek bar. Management system.

4. The terminal device, generating the search tag by performing image recognition processing on the driving video outside the vehicle captured by the in-vehicle camera; The management system according to claim 3.

5. Generating text data of facility names for a plurality of facilities on a route traveled by a vehicle; A driving video captured by an in-vehicle camera is stored in association with a search tag including a time when the vehicle passed through the facility and the text data; Transmitting the search tag to an external server; A control unit is provided for uploading a driving video associated with the selected search tag from the external server to the external server. In-vehicle terminal device.

Images