Management device, management method, management system, and program

Abstract

To provide a management device capable of acquiring and controlling video data, etc., stored in an apparatus, etc., by communicating with the apparatus, etc., on a condition determined correspondingly to a utilization purpose of the video data, etc.SOLUTION: A management server 100 comprises: an area table 102 for storing a detection condition including information on an acquisition object area determined correspondingly to a utilization purpose of specific data; an area video operation setting table 103 for storing an operation condition based on at least a place of a detection object and the utilization purpose with respect to the acquisition object area; and a data processing unit 101 which segments a predetermined range corresponding to the utilization purpose from data as the specific data and controls a specific apparatus (drive recorder 200a) satisfying the detection condition and the operation condition so as to acquire the specific data in accordance with a communication state in the acquisition object area and the utilization purpose on the basis of positional information of a mobile (vehicle 200).SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a management device, a management method, a management system, and a program for managing data of devices associated with a moving body.

Background Art

[0002] Patent Document 1 discloses an image recording device, so-called a drive recorder, which installs a camera in a vehicle, takes a picture of the surrounding of the vehicle when an event occurs, and verifies the acquired image afterwards. For example, it is described that when it is determined that the vehicle is running at a position where an object to be photographed enters the shooting range of the camera of the drive recorder as an event occurrence, the object is photographed by the camera of the drive recorder.

[0003] Further, Patent Document 2 discloses a management server that specifies acquisition target data that needs to be managed based on key information corresponding to an identifier and reservation information included in an access request requested from a manager terminal, makes a communication connection based on the communication status with the device and the reservation information, and transmits and receives target data corresponding to the access request.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technique disclosed in Patent Document 1, the shooting setting of the image is made based on a specific position where an object to be photographed enters the shooting range of the camera installed in the vehicle, and the use of data other than the image and the intention of the administrator according to the use purpose of the data after shooting are not considered at all.

[0006] Also, in the technology disclosed in Patent Document 2, among the acquisition target data such as images that are continuously stored in the storage unit in the drive recorder, it is possible to identify data that requires management based on various behaviors of the vehicle or the like and store it in the management server. However, for the data in the time period when various behaviors of the vehicle or the like do not occur, new data continuously overwrites the old data, and even if there is data required in that time period, the desired data cannot be appropriately acquired.

[0007] Therefore, in order to solve the above-described problems, the present invention can perform operations such as acquiring data stored in a device associated with a detection target according to detection conditions determined according to the purpose of using the data, for example, to prevent traffic accidents and disasters. An object of the present invention is to provide a management device, a management method, a management system, and a program that enable further utilization of data.

Means for Solving the Problems

[0008] The management device of the present invention is a management device for managing video data stored in a device arranged in a moving body. From the video data that is continuously stored in the device, based on the detection criteria of the video data to be acquired in a specific event, a data processing unit that controls the device to acquire specific video data, and a communication unit that communicates regarding the specific video data stored in the device.

[0009] With this configuration, it is possible to identify a device associated with a detection target that satisfies the detection conditions and operation conditions according to the purpose of using the data, acquire data such as images stored in the device, and execute and / or plan a necessary predetermined operation.

Effects of the Invention

[0010] According to the present invention, from among acquisition target data such as images that are constantly stored in a storage unit within a device under the management of a plurality of users, based on detection conditions and operation conditions determined according to the usage purpose of the administrator, data that requires management is specified, and processing such as data acquisition can be performed under desired operation conditions.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Mode for Carrying Out the Invention

[0012] Embodiments of the present invention will be described with reference to the accompanying drawings. If possible, the same parts will be denoted by the same reference numerals and duplicate descriptions will be omitted.

[0013] FIG. 1 is a diagram showing the configuration of a video data management system imaged by a drive recorder, which is an optimal embodiment of the present invention. As shown in FIG. 1, the system of the present disclosure includes a management server 100 and a vehicle 200. The vehicle 200 is a moving body such as an automobile or a train, and is provided with a plurality of devices. One of the plurality of devices includes a drive recorder 200a as a device. The drive recorder 200a is a photographing device that photographs and stores still images or moving images in a predetermined range inside and outside the vehicle 200 as the vehicle 200 moves. In the present embodiment, a drive recorder arranged in a moving body such as a vehicle is exemplified, but any other detection target may be used as long as it is a moving body, for example, a moving body such as a ship or an aircraft. Further, it may be a device (moving body) that can be wirelessly operated or autonomously moved, such as a drone. In the case of a drone or the like, the photographed image may be an image photographed in all directions of 360° without being limited to the front or rear.

[0014] Furthermore, although the detection target has been described as a device arranged on a moving object, it is not limited to a moving object. For example, as a device to be communicated with, a fixed camera installed at a specific location may be targeted. In that case, the detection targets are people or other moving objects, and even when the relative movement relationship of the devices is not coordinated and they are detected independently, it may be acceptable. Also, it is not limited to only the acquisition of video data, but includes the execution of all operations assumed in future data processing such as data acquisition, control, acquisition reservation, transfer to image analysis processing, and operation planning based on transfer results, as well as a plan including operation control at the video acquisition reservation time. Needless to say, it encompasses such a plan.

[0015] The management server 100 is a management server for managing data stored in a drive recorder 200a, which is a device among the devices respectively arranged in a plurality of vehicles 200. The management server 100 acquires videos that meet the acquisition conditions set by the administrator terminal 110 from the drive recorder 200a.

[0016] Note that the vehicle 200 is assumed to be, for example, a business vehicle such as a transport vehicle used by a transportation company, a bus used by a bus company, or a taxi used by a taxi company, and is used by the same company and the same operator. The videos to be grasped are different depending on the company and the operator. Note that the purpose of using the vehicle is not limited to business use. For example, it can also be applied to vehicles for end users of lease companies or damage insurance companies that have a contractual relationship with each other in the case of BtoBtoC. Also, without being limited to a contractual relationship, it can be applied to vehicles for individuals, such as vehicles that have a contractual relationship with a certain parking lot or temporarily use that parking lot. In short, the drive recorder 200a may be installed with the management program of the present invention (such as firmware including a management table in the drive recorder) in a general personal drive recorder to enable communication with the management server 100 side. Also, it is not limited to a drive recorder and may be installed in a moving object itself such as a drone, or needless to say, it may be installed in a device associated with a moving object, that is, a device such as a smartphone owned by a person.

[0017] Next, the functional configuration of the management server 100 will be described. FIG. 2 is a block diagram showing the functional configuration of the management server. As shown in FIG. 2, the management server 100 includes a data processing unit 101, an area table 102, an area operation setting table 103, an area detection record table 104, a video key information storage table 105, a video data table 106, and a communication unit 107.

[0018] The data processing unit 101 is a part that acquires, by communicating with the drive recorder via the communication unit 107, video data stored in the drive recorder 200a that satisfies the area operation conditions, which are the acquisition conditions stored in the area operation setting table 103, among the video data stored in the drive recorder 200a. For example, acquiring camera video at accident-prone locations is not considered, and video is acquired according to the moving speed of the vehicle, the type of location (highway, general road, loading / unloading and pick-up / drop-off location, parking lot, etc.), the installation position and shooting direction of the camera, and the purpose of entry / exit of the vehicle, in accordance with the criteria of the administrator.

[0019] The area table 102 is a table that stores information regarding the video acquisition target area, and consists of an area master area, an area area, and an area terminal setting area. A specific example thereof is shown in FIG. 3. FIG. 3(a) shows a specific example of the area master area. As shown in the figure, the area master area stores information associating the area master ID, the area master name, and the content of the area master. The area master ID is an ID for identifying areas composed of predetermined conditions defined as area masters. The area master name is the name of the area master. The content of the area master describes, for example, common content associated with the area ID associated with the area master ID, so that the administrator or user who set the area master later can confirm the content. As will be described later, the area master is, for example, a large area that bundles and manages geographical small areas and is composed of at least one or more areas.

[0020] Note that the area master mentioned here does not necessarily have an inclusion relationship with the areas it constitutes. For example, based on some management criteria such as the common purpose of using data such as area images captured during area detection, the area master ID and multiple area IDs may be flexibly associated. Specifically, for example, for each management target such as toll roads, train lines, bus line stations, interchanges, bridges, branch points, and bus stops, in order to monitor the safety of vehicle and passenger boarding and alighting, area image data is acquired. An area master ID may be assigned for each line, and an area ID may be assigned for each station or bus stop on that line and associated.

[0021] Also, it goes without saying that the area master ID and the area ID do not necessarily have a one-to-many relationship, and may be managed in a many-to-one or many-to-many manner according to the purpose of using video data and the like captured in the target area. The key point is that the area ID and the area master ID can be flexibly utilized for the administrator to obtain the necessary video data and the like, and it goes without saying that it can be used especially to enable efficient setting when setting search conditions. Also, in the area region described later, it goes without saying that it is possible to collectively set and change the operation conditions of multiple area IDs using the area master ID.

[0022] Figure 3(b) shows a specific example of the area region. As shown in the figure, the area region stores information associating the area master ID, the area ID, the area name, and the area range. The area master includes multiple areas. The area ID is an ID for identifying the area. The area name is the name of that area. The area range is information defining the range, and is defined by coordinate information such as GPS information, for example.

[0023] In addition to the coordinate information that can be specified as the absolute position, it may also be indicated by position information that is specified by combining with other information as the relative position. Further, in the present embodiment, the area is defined and explained starting from the position information as the literal meaning. However, it is not necessarily limited to this. Starting from some information to be detected, in addition to area identification using the position information at the time of change, the detection range may be flexibly determined according to the purpose of data use, and it may be defined by the position information at the time of detection that is indirectly derived.

[0024] Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behaviors, cautionary behaviors, behaviors at level crossings or temporary stops at temporary stop positions, signal violation behaviors, speed violation behaviors, etc. An area that should give more consideration to the safety of vehicles or the like is set as an area either autonomously or under the control of an administrator, and used for area detection of the present invention, and it goes without saying that it may be utilized for the safety of other vehicles or the like.

[0025] Furthermore, data on maintenance events of the vehicle itself, changes in data related to surrounding vehicles such as tailgating and traffic jams, crosswinds, road freezing, obstacles on roads or flight paths, etc., which are not specified in the event video acquisition patent of Patent Document 2, are detected based on the analysis result of the front video, or detected based on the comparative analysis result of the front and rear videos of snow removal vehicles or cleaning vehicles, etc. It goes without saying that an area may be set based on the detected position information, used for area detection, and utilized for the safety of other vehicles or the like.

[0026] FIG. 3(c) shows the area terminal setting area. As shown in the figure, the area terminal setting area stores information associating the device ID and the area ID. The device ID is an ID for identifying the drive recorder 200a or the like. Using this information, it is possible to acquire the video when the video of the drive recorder 200a indicated by the device ID enters the area of the area ID.

[0027] Incidentally, although the embodiments of the present invention are described as a drive recorder, it is not necessarily limited to a drive recorder installed in a vehicle or the like. As long as it is a moving body, in addition to a vehicle, it may be a device related to a device that can be wirelessly operated or autonomously moved, such as a ship, an aircraft, or a drone. It may also be a device such as a portable terminal or a smartphone held by a person, and it goes without saying that it is not necessarily limited to a device to which a camera is connected. In addition, for example, for the purpose of animal protection and breeding, a small device installed on a collar or a belt may be used to obtain an image seen from the pet side or manage position information.

[0028] In addition, it may be a device fixedly installed at a specific location, such as a fixed camera or an environmental sensor other than a moving body. In this case, it goes without saying that the movement of a relatively associated moving body can be detected and data or the like can be acquired.

[0029] The area table 102 may store a plurality of areas (area IDs) whose video usage purposes match, in association with the area master ID. And the area operation conditions of the area operation setting table 103 may be defined for each area master ID. Thereby, using one ID, namely the area master ID, the area operation conditions for a plurality of areas can be defined. For example, assume that a plurality of areas including a bridge are associated with the area master ID. By associating the area master ID with the area operation conditions, it is possible to obtain a video for collectively observing the aging deterioration of a bridge or the like.

[0030] The area operation setting table 103 is a part that stores area operation conditions which are acquisition conditions of videos shot by the drive recorder 200a. FIG. 4 is a diagram showing a specific example of the area operation setting table 103. As shown in the figure, the area operation setting table 103 stores information associating an area ID, an operation timing, video UPLOAD (operation type), a target camera, a video cut-out time, a video UPLOAD count (operation upper limit count), a detection speed band, a detection temperature band, and a management notification, etc. The area ID in the area operation setting table 103 corresponds to a detection condition, and the operation timing, video UPLOAD, target camera, video cut-out time, video UPLOAD count, detection speed band, detection temperature band, and management notification correspond to operation conditions. Among them, the video cut-out time corresponds to operation reservation information. In addition, although not illustrated here, the time when the video is acquired (detection time or operation time), that is, the operation reservation information, may be information related to some time. For example, in order to operate a fixed camera periodically, traffic volume, typhoon, and heavy rain are detected by various sensors, and the camera is operated during the time band detected by the sensors, or based on the transfer result to the image analysis process, the video is operated during the time band when a video analysis result that causes some traffic accident or disaster is detected. In order to prevent traffic accidents and disasters, the video may be utilized based on the detection result assumed by data processing. Note that the utilization of the video depends on the purpose of use, and various uses may be assumed, and the state information of the detection target may widely include sensor information related to a vehicle such as a vehicle speed.

[0031] Note that as described above, the area ID may be an area master ID, and it is only necessary to set the operation with at least one item. Needless to say, as the configuration of the table, the operation at the time of area detection can be set without itemizing all items.

[0032] This area operation setting table 103 is set from the administrator terminal 110, and operation conditions corresponding to the purpose of use of the video that the administrator wants to acquire are set.

[0033] Here, the operation timing will be described with reference to FIG. 7, which will be described later for the video cut-out process. It indicates whether to cut out the video for a predetermined time starting from when the vehicle 200 enters the specified range (Area IN), cut out the video for a predetermined time back from when it exits (Area OUT), or cut out the video from when it enters until it exits (Area IN-OUT).

[0034] Note that, to facilitate the understanding of the present invention, the above operation timing is described as an example of an area, but it is not necessarily limited to an area. It may also be a detection criterion according to the purpose of use of data such as video to be acquired in a certain event, which was described when managing the area master and the area. For example, detecting a change in the maintenance event data of the vehicle itself that is not defined in the event video acquisition patent of Patent Document 2, detecting a change in data related to the approach distance to the following vehicle such as tailgating or traffic jams, detecting crosswinds, road freezing, obstacles on the road or airway, etc. based on the analysis result of the front video, detecting based on the comparative analysis result of the front and rear videos of a snowplow vehicle or a cleaning vehicle, and needless to say, it may also be a change in data that can be detected by the moving body itself such as a vehicle or equipment associated with the moving body. In that case, similar to the tables called the area master area, area area, and area terminal setting area, another condition table is provided, and a condition name and a range satisfying the condition defined by information other than the position information are set. Although the detection conditions based on the information to be detected will be described later, it goes without saying that the detection conditions may similarly be defined by information other than the position information.

[0035] The method of the video UPLOAD is set to perform video acquisition either upon a request (including an acquisition request, an access request, and an acquisition reservation) from the administrator of the management server 100 or automatically by the management server 100. This video UPLOAD is used to determine whether to acquire the video immediately. Here, although the explanation focuses on the UPLOAD of video data, it is not necessarily limited to video data. Needless to say, it may also be possible to perform the operation of the target device by UPLOADing data related to the moving body itself such as a vehicle or a device associated with the moving body or DOWNLOADing a control signal that defines the operation of the device. Regarding the automatic process, regardless of whether the entity that determines the detection and operation conditions described later is the management server or the drive recorder, when the video UPLOAD is set, the drive recorder 200a immediately transmits video data, and in addition to the management server 100 acquiring the video, when an event such as a dangerous behavior is detected, when communication with the drive recorder 200a is not possible, or when a video acquisition reservation has been made, it goes without saying that the management server 100 automatically acquires the video.

[0036] The target camera indicates the type of camera whose video is to be acquired, such as the video of the front camera, the video of the in-vehicle camera, or the videos of both cameras. Note that it is not limited to the front or in-vehicle cameras. Any number of cameras can be installed in any direction or position inside or outside the vehicle, and it goes without saying that the rear camera may also be included. In that case, a method of acquiring the video of the rear camera or the video of the rearview mirror with a camera installed outside the vehicle through a control device managed by the vehicle side may be adopted. Communication with related devices (in this case, cameras) only needs to be connected by some means such as proximity communication and is not limited in any way. Note that in the case of video, information for identifying the target camera is useful. However, it goes without saying that, for example, from the vibration period of the vehicle, the amplitude of the vertical vibration, or the inclination of the vehicle based on gyro data when one of the vehicle's tires has a puncture or the like, it may be detected which part of the front, rear, left, or right wheels has a puncture or the like and provided as useful information to the administrator or the like. This is just an example, and it goes without saying that vehicle abnormal information can enable the acquisition and detection of various video data, especially in relation to safe driving.

[0037] The video cut-out time indicates the time when the video to be acquired is cut out. The video to be cut out starts from the operation timing. In this column, "Area ALL" may be set. When "Area ALL" is set and the operation timing is set to "Area IN / OUT", it indicates that the video from when the vehicle 200 enters the target area for video acquisition until it exits is cut out.

[0038] Note that in any case, it goes without saying that, for example, in order to surely acquire a video scene essential for the purpose of using video data, the cutting out of the video may be started or ended several seconds before or after the operation timing.

[0039] The number of video uploads indicates the upper limit of the number of video uploads per day. This is set because it is meaningless to upload videos multiple times a day when observing the aging of roads, etc. When observing the aging of roads, tunnel walls and ceilings, bridges, etc., in some cases, a higher resolution for a single video may be required than the number of video acquisitions. In this case, depending on the installation location and specifications of the connected camera, for example, when installed on the ceiling, wall, or road, it is installed upward, horizontally, or downward outside the vehicle, and the imaging range of the camera is moved parallel to the moving direction of the vehicle to reduce the dynamic speed of the target video or adopt a shooting method (zooming in) to improve the resolution. Needless to say, various operating conditions can be considered.

[0040] The detection speed range indicates the moving speed of the vehicle 200, which is a video acquisition condition. Videos are acquired by the vehicle 200 moving within the speed range set here, and videos by the vehicle 200 moving at speeds outside this range are not acquisition targets. As described in the above modification example, it is not necessarily limited to detecting the moving speed of a device that moves integrally with a moving object such as a person or a vehicle. For a fixed camera installed at a specific position, etc., the speed when a person appears in the imaging range may be detected. Needless to say, the detection speed may be the speed of a moving object associated with an aircraft such as a drone, a ship, or other devices in addition to the vehicle.

[0041] The detection temperature range indicates, for example, one of the conditions for monitoring the influence on shooting targets such as food or animals placed on the vehicle or the cargo bed during transportation by a moving object, or for the purpose of safe driving of the vehicle, setting some operating conditions with the temperature of the engine, radiator, etc. as the detected temperature. It is not necessarily required to set conditions. Needless to say, in the above example, the temperature ranges that are operating conditions are different for each monitoring target such as food, animals, engine, radiator, etc., and it is also not limited to acquiring videos shot within the set temperature range.

[0042] The administrator notification is indicated by ON / OFF, and it is set whether to notify the administrator when acquiring video. The administrator notification is set as to its presence or absence based on usage purposes such as when the administrator wants to send videos collectively, or when the number of areas to be acquired is large, to distinguish devices or data that satisfy the operation conditions with the highest priority.

[0043] The area detection record table 104 stores area detection information acquired from devices such as the drive recorder 200a, a moving object such as a vehicle to be detected, or a fixed camera installed in the area. FIG. 5 shows a specific example of the area detection record table 104. As shown in the figure, the area detection record table 104 stores a device ID, an area ID (or, if necessary, an area master ID), an area entry date and time (or, if necessary, an area exit date and time), a speed, and a temperature. The device ID is the ID of the drive recorder 200a that captured the video. The area ID is the ID of the area that was captured. The area entry date and time is the date and time when the vehicle 200 entered the area. The speed is the speed of the vehicle 200 at the time of shooting. The temperature is the temperature at the time of shooting by the drive recorder 200a. These pieces of information are information regarding the area at the time of shooting or the state information of the vehicle 200.

[0044] The video key information storage table 105 is a table that stores key information for searching videos to be acquired from the drive recorder 200a. FIG. 6 is a diagram showing a specific example thereof. This video key information storage table 105 is generated by the data processing unit 101 by associating the device ID, area ID, area entry date and time (or area exit date and time), speed, temperature, and presence or absence of video acquisition in the area detection information (area detection recording table 104) with the video ID of the cut-out video. Also, the organization ID and driver ID are retrieved based on a driver DB (not shown) or recorded in an external memory as information detected by an IC card reader before driving. These pieces of information are associated with the device ID, and the device ID is associated with the vehicle. The driving area is derived from an area DB (not shown) and the area ID. The administrator terminal 110 can use this video key information storage table 105 to search for videos using the video key. Needless to say, when the administrator wants to later acquire a video that has once been assigned a video key, just like the event video data, the administrator terminal receives an access request using this video key and transmits the target video data file.

[0045] The video data table 106 is a table that stores videos captured by the drive recorder 200a. This video data table 106 stores the video ID and video data in association with each other. The video ID is assigned when the video is acquired in the management server 100. The video data table 106 is linked with the video key information storage table 105 by the video ID.

[0046] The communication unit 107 is a part that communicates with the drive recorder 200a.

[0047] Next, the functional configuration of the drive recorder 200a of the present disclosure is shown. FIG. 9 is a block diagram showing the functional configuration of the drive recorder 200a. As shown in the figure, the drive recorder 200a includes a communication module 201, a GPS module 202, an IC card reader 203, a recording unit 204, a camera 205, a camera 206, a microphone 207, a speaker 208, a display unit 209, a G sensor 210, a control unit 211, various behavior detection units 212, a power / ignition input unit 213, a vehicle data input unit 214, and an I / O input unit 215.

[0048] The communication module 201 is a part that communicates with the management server 100, and performs communication using, for example, a mobile communication network.

[0049] The GPS module 202 is a part that performs position measurement. Note that, as a configuration for performing position measurement, depending on the area of the target area (GPS if it is a macro area with a good view and a position measurement sensor if it is a micro area with a poor view), various sensors may perform proximity communication with each other in addition to GPS, and a method of specifying a relative position may also be used.

[0050] The IC card reader 203 is a part that reads an IC card.

[0051] The recording unit 204 is a part that records information in an external memory such as an SD card. In the present disclosure, the videos captured by the cameras 205 and 206 are recorded in an external memory such as an SD card by the recording unit 204. The recording unit 204 continuously records the position information of the vehicle 200 at that time together with the video. In addition, in Patterns 2 to 4 described later, various tables corresponding to the area table 102, the area operation setting table 103, and the area detection record table 104 are stored in the external memory.

[0052] Cameras 205 and 206 are parts for taking images. They take still images or moving images. Camera 205 takes images in the traveling direction of vehicle 200, and camera 206 takes images inside the vehicle 200. In addition, a rear camera for taking images of the rear of the vehicle may be provided. Note that the installation position and number of cameras are not limited to this drawing or the embodiment, nor are they limited to the front or inside. Any number of cameras can be installed in any direction and position inside or outside the vehicle, and it goes without saying that a rear camera may be included. In that case, a method of acquiring images of a rear camera or a camera-equipped rearview mirror outside the vehicle via a control device managed by the vehicle side may be adopted. Communication with related devices (in this case, cameras) only needs to be connected by some means such as proximity communication and is not limited in any way.

[0053] Microphone 207 and speaker 208 are parts for inputting and outputting sound.

[0054] Display unit 209 is a part for displaying setting information for drive recorder 200a.

[0055] G-sensor 210 is a sensor for detecting gravity.

[0056] Control unit 211 is a part for controlling communication modules 201 to I / O input unit 215.

[0057] Various behavior detection units 212 are parts for detecting various behaviors in vehicle 200. For example, various behavior detection units 212 are parts for detecting various states based on position information measured by GPS module 202, gravity information detected by G-sensor 210, and vehicle speed pulses and temperature input from vehicle data input unit 214. For example, in Patterns 2 to 4 described later, it is detected whether vehicle 200 has entered or exited a predetermined area, or its state (information related to the vehicle itself such as speed and angular velocity of the steering wheel, and information related to the surrounding environment of the vehicle such as temperature).

[0058] The power supply and ignition input unit 213 is an input unit for supplying power to the drive recorder 200a.

[0059] The vehicle data input unit 214 is a part for inputting vehicle data such as vehicle speed pulses. For example, temperature is measured by a temperature sensor (not shown) and input via the vehicle data input unit 214.

[0060] The I / O input unit 215 is an interface part for external devices. Therefore, it goes without saying that information regarding various sensors mounted on the vehicle may be communicated with and acquired from a vehicle control device or the like.

[0061] The operations of the management server 100 and the drive recorder 200a configured as described above will be described. FIG. 10 is a sequence diagram showing the operation when the administrator terminal 110 sets an area table, which is the definition of an area and the acquisition conditions of video, for the management server 100.

[0062] The administrator terminal 110 inputs information for creating an area master (including other area information and area terminal setting information) according to the operation by the administrator, etc., and transmits it to the management server 100 (S11). The management server 100 stores the area master information in the area table 102. Further, the administrator terminal 110 sets area operation conditions according to the operation by the administrator and transmits them to the management server 100 (S12). In the management server 100, the data processing unit 101 stores the received area operation conditions in the area operation setting table 103. Note that the description in this embodiment is given by taking an example of setting dominant operation conditions by the administrator, but it is not limited thereto, and it is also possible to perform operation setting autonomously according to the information of the detection target.

[0063] Specifically, as described in Patent Document 2, data is acquired in advance from other devices such as dangerous behaviors, cautionary behaviors, behaviors at level crossings and temporary stops at temporary stop positions, signal violation behaviors, speed violation behaviors, etc., and an area that should give more consideration to the safety of vehicles and the like is set autonomously or dominantly by an administrator, and is used for area detection of the present invention and may be utilized for the safety of other vehicles and the like. Needless to say, maintenance event data of the vehicle itself, changes in data related to surrounding vehicles such as tailgating and traffic jams, crosswinds, road freezing, obstacles on roads and flight paths, etc., which are not specified in the event video acquisition patent of Patent Document 2, may be detected based on the analysis result of the front video, or detected based on the comparative analysis result of the front and rear videos of snow removal vehicles and cleaning vehicles, etc., and the detected position information is indirectly set as an area and used for area detection and may be utilized for the safety of other vehicles and the like.

[0064] This area master information, etc. is set by an administrator based on, for example, the shooting location of the video that the user wants to acquire among the videos of the drive recorder 200a. Examples of the shooting location of the video that the user wants to acquire include intersections with frequent accidents and school zones with many claims. In addition, in order to examine the aging deterioration of roads, bridges, tunnels, etc., such locations may be defined as acquisition target areas.

[0065] Also, for railway operators, in order to check the status of forests and rivers along the line, a drive recorder 200a may be installed in the train and such areas may be defined for use in checking the track and other facilities along the line and for checking river flooding.

[0066] Also, for care providers or their users and their families, in order to determine whether the users are being treated appropriately, pick-up and drop-off locations, etc. may be set as acquisition target areas, and the camera types may be indoor cameras, rear cameras, or fixed cameras installed at pick-up and drop-off locations.

[0067] In addition, it can also be applied to the transportation business of pets and racehorses. By defining the loading platform at the loading location and transportation time as the acquisition target area, it is possible to check whether the loading and unloading and transportation are properly handled. Also, by defining an arbitrary area on the transportation route, it is possible to check whether the transportation is properly carried out from the perspective of pets etc. rather than the vehicle, for example, at sharp curves or steep slopes.

[0068] In addition, for snow removal operators, area settings for grasping the site and work progress situation, area settings for traffic jam prediction for highway operators, area settings for the general loading and unloading operations of freight by transportation operators, area settings (and indoor cameras) for checking the loading platform (confirming the empty space) of transportation operators, etc. can be considered.

[0069] In addition, accident-prone locations, as well as bridges, tunnels, and other locations that are prone to aging over time, may be automatically defined based on their position information, for example, taken from a separately prepared map database. For example, accident-prone locations are database-ized by the police etc., and the definition of the area is made possible by using this database. Also, the construction years of bridges and tunnels are database-ized by government agencies etc., and information on bridges etc. that have passed a predetermined number of construction years can be taken out, and the area can be defined based on their positions.

[0070] Next, the operation when the management server 100 acquires video from the drive recorder 200a will be described. FIG. 11 is a sequence diagram showing a specific example (pattern 1) of the operation.

[0071] In the drive recorder 200a, when the engine of the vehicle 200 is started and power is supplied, the GPS module 202 starts acquiring position information (S201). Also, the camera 205 and the camera 206 start video shooting, and the recording unit 204 starts video recording (S202). The recorded video is recorded by the recording unit 204 in an external memory such as an SD card. The communication module 201 transmits the position information to the management server 100 at a predetermined cycle (S203). In addition to this position information, status information including vehicle speed, event detection video information, and sensor information such as the temperature installed in various vehicles may be transmitted.

[0072] In the management server 100, the data processing unit 101 acquires the position information from the drive recorder 200a via the communication unit 107, and stores the device ID, position information, and time of the drive recorder 200a in a position information buffer (not shown) (S101). The data processing unit 101 refers to the acquired position information and the area table 102, and determines whether the vehicle has entered or / and exited the video acquisition target area (S102). Note that when position information within the area is received after position information outside the area has been received until now, it can be determined that the vehicle 200 has entered the area. Conversely, when position information outside the area is received after it has been determined that the vehicle has entered the area, it can be determined that the vehicle 200 has exited the area.

[0073] When it is determined that the vehicle has entered and / or exited the acquisition target area (S102: Entry / Exit), the data processing unit 101 acquires the corresponding area ID from the area table 102. The data processing unit 101 refers to the area operation setting table 103 to determine whether the state information such as the vehicle speed received together with the position information conforms to the area operation conditions associated with that area (S103). That is, the data processing unit 101 determines whether the state information of the vehicle 200 satisfies the area operation conditions (state information such as a predetermined vehicle speed and a predetermined temperature). Also, it is determined whether the number of video uploads has reached the upper limit. Whether the upper limit of the number of video uploads has been reached is determined based on the number of times the vehicle 200 has entered or exited that area. For example, in S102, the number of times of entry or exit for each area is stored. The vehicle 200 of the drive recorder 200a that transmits the video may be the same or different. These area operation conditions are the acquisition conditions corresponding to the area ID defined in the area operation setting table 103.

[0074] Furthermore, the data processing unit 101 determines whether the video that satisfies those area operation conditions is to be immediately acquired (S104). That is, the data processing unit 101 refers to the area operation setting table 103 and, if the video upload information is automatically set, determines that it is a target for immediate video acquisition and performs the immediate acquisition process.

[0075] When it is determined that it is a target for immediate video acquisition, the data processing unit 101 sends a video acquisition command to the drive recorder 200a (S105). This video acquisition command includes the operation timing (the timing of entering the area, the timing of exiting, etc.) and the video cut-out time. The operation timing and the video cut-out time are extracted from the operation conditions corresponding to the area ID acquired in S102 in the area operation setting table 103.

[0076] In the drive recorder 200a, based on a video acquisition command, the control unit 211 performs a video cut-out process, and transmits the cut-out video together with the device ID to the management server 100 (S204). In the video shot by the drive recorder 200a, position information and the like are recorded at a predetermined timing. The control unit 211 performs a cut-out process of the video recorded in the external memory based on the operation timing included in the video acquisition command and the video cut-out time.

[0077] In the management server 100, the data processing unit 101 assigns a video ID to the video transmitted from the drive recorder 200a and stores it in the video data table 106 (S106). Further, the data processing unit 101 stores the device ID sent together with the video in the area detection record table 104 in association with the area ID, the area entry date and time, the speed, and the temperature (S106). Further, the data processing unit 101 extracts key information for the video key information storage table 105 from the area detection record table 104 and the like, and stores it in the video key information storage table 105 in association with the video ID of the previously acquired video (S106). Then, the data processing unit 101 determines whether or not a manager notification is necessary (S107). The presence or absence of a manager notification is set in the area operation setting table 103.

[0078] If it is determined that it is necessary here, the data processing unit 101 performs a notification process to the effect that the video has been acquired to the manager terminal 110 (S107: Yes). If it is unnecessary, the process ends and waits for the next position information.

[0079] In step S104 above, when the immediate video acquisition is "No", the data processing unit 101 obtains area detection information from the drive recorder 200a without acquiring video, and generates an area detection record table 104 and a video key information storage table 105. At this time, similar to the video acquisition data including the key information regarding the event video disclosed in Patent Document 2, the data processing unit 101 assigns a video ID for performing at the time set by the administrator's access request or operating conditions. Then, together with the periodic position information transmission, information indicating that the video corresponding to the video ID has not been acquired is transmitted to the management server.

[0080] In steps S102 and S103 above, when each is "No", the process is terminated once.

[0081] Here, the video extraction process S204 will be described. FIG. 7 is an explanatory diagram for explaining the relationship between the operation timing and the video extraction process. As shown in the figure, it is assumed that the vehicle 200 moves from area IN to area OUT. Here, in the area operation command (S105) of FIG. 13, when it is specified to extract backward from area IN described in FIG. 4, for example, when the operation timing: area IN and the video extraction time: 10 seconds are specified, the control unit 211 extracts the video from the time 10 seconds before the detection time of area IN to the detection time of area IN from the video stored moment by moment in the external memory. It is desirable to manage using the same time by GPS time correction or the like so that there is no deviation in the internal time between the management server 100 and the drive recorder 200a. Needless to say, the video at a time about x seconds earlier may be extracted in consideration of control delay and time lag of the detection time. Needless to say, it is not limited to 10 seconds, and it can be arbitrarily determined by an administrator or the like.

[0082] Similar to the event video, the video is recorded in the recording unit 204 of the drive recorder 200a moment by moment, including at least the position information at the detection time. Therefore, based on the position information stored in S101, the control unit 211 can identify the time zone for cutting out the video from the time when entry and / or exit to / from the area was detected and the video cut-out time set in the area operation setting table, and cut out the video in the specified time zone from the videos recorded moment by moment. Also, since the drive recorder 200a periodically receives signals for identifying the position from GPS, sensors, etc. and can associate the position information with the video information, it goes without saying that based on the detected position information, the video up to the required position can be inferred based on the known position information, and the video can be cut out based on multiple position information.

[0083] Note that the operation timing is not unique. It is set by the administrator according to the usage purpose of the video to be acquired. For example, when wanting to view the driving situation of the driver, a timing suitable for that is good. For example, it is the video at the timing of area IN or area OUT. When wanting to view the aging of roads, etc., the video from area IN to area OUT is good. As described above, needless to say, the detection criteria are not limited to the area, and it can also be any information to be detected, for example, the timing when drowsiness or glancing of the driver detected as an event video. At that time, it goes without saying that the surrounding environmental information of the vehicle etc. that caused drowsiness (for example, vehicle speed, distance between the front and rear vehicles, etc.) may be acquired together with the video.

[0084] Also, in the area operation command, when it is specified to cut out retroactively from area OUT, for example, when the operation timing: area OUT and the video cut-out time: 10 seconds are specified, the control unit 211 cuts out the video from the time 10 seconds before the detection time of area OUT to the detection time of area OUT from the videos recorded moment by moment in the recording unit 204 of the drive recorder 200a. The identification of the cut-out position is the same as above.

[0085] Needless to say, in this case as well, considering control delay and detection time lag, video images from around x seconds before may also be cut out.

[0086] Also, in the area operation command, when it is specified to cut out video images of all areas from area IN to area OUT, that is, when the operation timing: area IN / OUT and the video cut-out time: area ALL are specified, the control unit 211 refers to the storage time of the video images stored moment by moment in the external memory and cuts out the video images covering all areas from area IN to area OUT. In the area operation setting table 103, when the operation timing: area IN / OUT and the video cut-out time: 15 seconds are defined, the data processing unit 101 generates an area operation command to synthesize, as video data, video images including a plurality of timings for which video images are to be acquired, from the time 15 seconds back from the timing when area IN was detected to the time when area IN was detected and from the time 15 seconds back from the timing when area OUT was detected to the time when area OUT was detected, into 30-second video data. Needless to say, video IDs may be assigned to each without synthesis for management.

[0087] In this way, it is possible to cut out video images immediately before entering the area, immediately before exiting the area, or during passing through the area. Note that, as described above, the length of the cut-out video images may be set to a fixed number of seconds, or the cut-out seconds may be set according to the traveling speed or the like. For example, it may be set to 10 seconds up to 30 km / h and 5 seconds up to 60 km / h. Depending on the purpose of using the video images, the faster the speed, the shorter the cut-out video images may be. Also, it may be dynamically set by the number of seconds of the difference between the area OUT time and the area IN time. These methods for determining the cut-out time are set in the video cut-out time of the area operation setting table 103, and based on this, the cut-out time is calculated. Needless to say, in order to surely acquire video scenes essential for the purpose of using the video data, the cut-out time may be determined based on various information.

[0088] FIG. 8 is a diagram for explaining the movement of the vehicle 200 and the video cut out at that time. FIG. 8(a) shows the video traced back from the area IN and the video traced back from the area OUT. Here, the video by the in-vehicle camera 206 of the drive recorder 200a is specified as the acquisition target.

[0089] As shown in the figure, when the area is set as the site such as a factory and the camera is set as the in-vehicle camera, the management server 100 can acquire the video of the driver when the vehicle 200 enters the site from the road. Similarly, the management server 100 can acquire the video of the driver when the vehicle 200 exits the site. By acquiring the video in this way, the driving situation of the driver can be grasped.

[0090] Also, as shown in FIG. 8(b), video acquisition may be performed to grasp the aging deterioration situation of the road. In FIG. 8(b), a bridge is designated as the area, and the front camera 205 is set as the camera for video acquisition. In FIG. 8(b), the management server 100 can acquire the video of the entire area from the area IN to the area OUT.

[0091] These video cut-out processes can be similarly applied to the modification examples (patterns 2 to 4) described later.

[0092] Next, the operations in the modification examples of the management server 100 and the drive recorder 200a in the present disclosure will be described. FIGS. 12 and 13 are sequence diagrams showing the processes in the modification example (pattern 2). The process in this pattern 2 is different from the process in pattern 1 in that the drive recorder 200a detects entry / exit from the area and transmits area detection information to the management server 100 based on this. For this reason, the area master definition process is performed on the drive recorder 200a. Here, the description will focus on the different processes.

[0093] In FIG. 12, the administrator terminal 110 performs area master creation and area operation condition setting processing (S11, S12). The management server 100 stores the area operation conditions in the area operation setting table 103 (S13).

[0094] Also, in the management server 100, the data processing unit 101 transmits a write command for the area master information acquired by area master creation to the drive recorder 200a (S14).

[0095] In the drive recorder 200a, the control unit 211 stores the area master information in the external memory by the recording unit 204 (S21). The external memory has a table equivalent to the area table 102 and stores area information.

[0096] In this way, the drive recorder 200a can store area information indicating the video acquisition target area and transmit the area detection information to the management server 100 when entering and / or exiting the acquisition target area. The area detection information includes the device ID, area ID, area entry date and time (or area exit date and time), speed, and temperature.

[0097] Next, the video acquisition process shown in pattern 2 will be described with reference to FIG. 13. Note that step S203a is a process corresponding to S102 in FIG. 11, and the processing content is the same. In the drive recorder 200a, position information acquisition and video recording are started (S201, S202), and the various behavior detection unit 212 determines whether the position information detected by the GPS module 202 is included in the range defined by the area master information stored in the external memory (equivalent to the area table 102) (S203a). When it is determined that the position information is included in the range, the control unit 211 transmits the area detection information to the management server 100 via the communication module 201 (S203b). The area detection information includes the device ID, area ID, area entry date and time (or area exit date and time), vehicle speed, and temperature. Needless to say, the position information is not limited to GPS as in pattern 1.

[0098] In the management server 100, the data processing unit 101 determines whether the status information (such as speed and temperature) of the area detection information satisfies the area operation conditions corresponding to the area ID defined in the area operation setting table 103 (S103). Then, when the data processing unit 101 determines that the area operation conditions are satisfied and further the conditions for immediate video acquisition are satisfied, it transmits an area operation command to the drive recorder 200a (S105). Subsequently, the processes of S106 to S107 and S204 are performed.

[0099] In this way, the drive recorder 200a can automatically detect that it has entered or / and exited the predetermined video acquisition target area, and transmit the area detection information indicating this to the management server 100. In the drive recorder 200a, there is no need to regularly transmit the position information for area determination in order for the management server side to perform area determination. Also, in the management server 100, since a notification comes when entering the target area, the load of the video acquisition process can be reduced.

[0100] Next, pattern 3 in the video acquisition process will be described. In pattern 3, the drive recorder 200a further determines whether the video satisfies the acquisition conditions.

[0101] FIG. 14 is a sequence diagram showing the preset process in pattern 3. As shown in FIG. 14, when the management server 100 receives the area master information and the area operation conditions from the administrator terminal 110 (S11 and S12), it transmits a write command for the area master information and the area operation conditions to the drive recorder 200a. In the drive recorder 200a, the communication module 201 receives it, and the control unit 211 stores it in the recording unit 204 such as an external memory (S21a). Information corresponding to the area table 102 and the area operation setting table 103 is stored in the external memory. Thereby, in the drive recorder 200a, area detection and determination of area operation conditions can be performed.

[0102] Note that in the management server 100, all area operation conditions may be stored, or only the video UPLOAD information (indicating manual acquisition or automatic acquisition) included in the area operation conditions may be stored to determine the video immediate acquisition process.

[0103] Next, the specific process in Pattern 3 will be described. FIG. 15 is a sequence diagram showing the process. As shown in the figure, steps S203a to S203b in the drive recorder 200a are different processes. Therefore, the description will focus on this process. Note that steps S203a to S203c correspond to processes S102 to S103 in FIG. 11, and the process contents are the same.

[0104] In the drive recorder 200a, position information acquisition and video recording are started (S201 to S202), and the various behavior detection units 212 detect that the vehicle has entered or exited the area (S203a). The control unit 211 acquires area detection information including the area ID of the detected area, the area entry date and time (or the area exit date and time as required), and other status information such as vehicle speed and temperature.

[0105] Based on the area detection information, the control unit 211 determines whether the area operation conditions stored in the external memory are satisfied (S203c). If not, the process ends. If satisfied, the control unit 211 transmits the area detection information via the communication module 201 (S203b).

[0106] In the management server 100, when the data processing unit 101 receives the area video detection information, it determines whether the area is a target for immediate video acquisition based on the area ID, and performs a video acquisition request (S105), generation of the area detection record table 104, storage process of video data, generation of the video key information storage table 105 (S106), and administrator notification process (S107).

[0107] As a result, in the drive recorder 200a, it is possible to detect an area and determine area operation conditions.

[0108] Next, the processing of Pattern 4 will be described. FIG. 16 is a sequence diagram showing the operation of Pattern 4. In Pattern 4, the preset shown in FIG. 14 is made. In this Pattern 4, compared with Pattern 3, it is different in that step S203d is performed in the drive recorder 200a.

[0109] In the drive recorder 200a, information corresponding to the area table 102 and the area operation setting table 103 is stored by presetting.

[0110] Then, in the drive recorder 200a, position information acquisition and video recording are started (S201, S202), and determination of area entry etc. and determination of area operation condition conformity are made (S203c). And when these determinations are "yes", the control unit 211 determines whether to immediately transmit the video (S203d). This is determined based on whether the video is manually transmitted or automatically transmitted by the administrator terminal 110.

[0111] Then, when it is determined that the video is to be immediately transmitted, the control unit 211 cuts out the specified video from the video stored in the external memory based on the operation timing and video cut-out time set in the drive recorder 200a. The control unit 211 uses the communication module 201 to transmit the cut-out video together with the area detection information (S204).

[0112] Then, in the management server 100, the data processing unit 101 acquires the cut-out video data and stores it in the video data table 106, and also acquires the area detection information and stores it in the area detection record table 104 (S106a). Also, a video key information storage table 105 is generated. On the other hand, when the data processing unit 101 receives only the area detection information, it stores it in the area detection record table 104. When generating the video key information storage table 105, it is stored that the video has not been acquired.

[0113] Next, the video search process using the video key information storage table 105 will be described. FIG. 17 is a diagram showing an example of the search screen of the administrator terminal 110. The administrator can search for the video captured in the vehicle 200 by operating the administrator terminal 110. As shown in FIG. 17, the search screen is composed of a narrowing search condition setting part, a search button, a search list, and a video screen. As shown in FIG. 17, the administrator can search for the video using the organization ID, driver ID, device ID, area master ID, area ID, driving area, driving time zone, speed zone, and temperature zone as search keys. The administrator terminal 110 enables video search by referring to the video key information storage table 105 of the management server 100.

[0114] FIG. 18 is a hardware configuration diagram of the management server 100. The management server 100 shown in FIG. 2 is physically configured as a computer system including one or more CPUs 11, a RAM 12 and a ROM 13 which are main storage devices, an input device 14 such as a keyboard and a mouse, an output device 15 such as a display, a communication module 16 which is a data transmission / reception device such as a network card, an auxiliary storage device 17 such as a hard disk or a semiconductor memory, etc., as shown in FIG. 18. Each function in FIG. 2 is realized by loading a predetermined computer software (program) onto the hardware such as the CPU 11, RAM 12, etc. shown in FIG. 18, and operating the input device 14, output device 15, and communication module 16 under the control of the CPU 11, and by reading and writing data in the RAM 12 and the auxiliary storage device 17.

[0115] Next, the operation and effect of the management server 100 and the drive recorder 200a in the present disclosure will be described. The management system in the present disclosure includes the management server 100 and the drive recorder 200a. This management system manages the video (data) stored in the drive recorder 200a (device), which is one of the devices respectively arranged in a plurality of vehicles 200 (mobile objects). Here, the drive recorder 200a is a specific device, but it is not necessarily limited to the drive recorder 200a. Among all the devices with which the management server 100 communicates, the device that satisfies the detection conditions stored in the area shown in FIGS. 3(b) and (c) is the specific device.

[0116] Also, if the mobile object is a drone, it corresponds to the camera control device of the drone, and if the mobile object is a person, it corresponds to the smartphone held by that person.

[0117] In addition, not only the example where the position information of the moving object and the device necessarily matches, but also the example where only the moving object moves is included as a modification example. Various changes in the vicinity of the position of the fixed camera, such as a person or a vehicle crossing the shooting area of the fixed camera, can be defined as detection conditions. In that case, the fixed camera corresponds to the specific device.

[0118] This management system includes an area operation setting table 103 that stores, for each area ID, acquisition conditions (data acquisition conditions) of video images, including at least the operation timing of the entry and / or exit of a moving body to / from a target area specified based on one or more area IDs and position information determined according to the usage purpose of the video images, and the data acquisition range (clipping time) corresponding to the operation timing.

[0119] And the management system includes a data processing unit that communicates with a drive recorder 200a (device) to acquire video images (data) stored in the drive recorder 200a (device) that satisfy the acquisition conditions (data acquisition conditions) of the video images.

[0120] In Patterns 1 and 2 of the present disclosure, the area operation setting table 103 is mainly provided in the management server 100. However, like in Patterns 3 and 4, the drive recorder 200a may be provided with the area operation setting table 103, and a management system including the drive recorder 200a may be constructed. This pattern is a difference in implementation to enable flexible response according to the processing capabilities of the management server and devices, the communication environment between the management server and devices, etc. Functionally, it is a difference in whether it is provided in the management server or in the device. Needless to say, the management server can flexibly respond according to the processing capabilities of the devices, the functional differences between new and old terminals, etc., and can compensate for the differences in capabilities and functions.

[0121] According to this disclosure, the management server 100 can acquire the video of the drive recorder 200a based on the acquisition conditions of the video including the operation timing when the vehicle 200 enters the target area for video acquisition and the video acquisition range (video cut-out time). These video acquisition conditions can be determined according to the administrator's criteria according to the purpose of using the video. Therefore, the administrator can acquire the video corresponding to the purpose of use. For example, not only the shooting target and the latitude and longitude of the drive recorder 200a, but also the moving speed of the vehicle 200, the type of the place to be shot (highway, general road, loading & unloading and pick-up / drop-off location, parking lot, etc.), the type of camera (front, indoor), and the imaging pattern according to the purpose of entry / exit of the vehicle, etc., the image can be acquired.

[0122] In this disclosure, the area operation setting table 103 further stores the acquisition timing of the video as the acquisition conditions (data acquisition conditions) of the video. The data processing unit 101 further performs data acquisition based on the acquisition timing. This acquisition timing is determined by whether to automatically acquire the video of the drive recorder 200a (that is, acquire it immediately after receiving the notification (or even after a predetermined time has elapsed)) or to manually acquire it by the administrator's operation. Depending on the purpose of using the video, there are some cases where it is not necessary to automatically acquire the video immediately. Therefore, it can be set according to the administrator's perspective whether to do so.

[0123] Also, the area operation setting table 103 further stores the camera type of the drive recorder 200a (device) as the acquisition conditions of the video. This camera type indicates whether it is a front camera that shoots the traveling direction of the vehicle 200 or an indoor camera that shoots the interior. The data processing unit 101 acquires the video shot by the camera corresponding to the camera type of the drive recorder 200a (device).

[0124] Depending on the purpose of using the video, there are cases where it is desired to manage the road in the traveling direction (or the place passed) of the vehicle 200, other videos, or the driving state of the driver. By setting the camera type as the acquisition conditions, it is possible to acquire the video according to the administrator's purpose of use.

[0125] In addition, the area operation setting table 103 further stores, as video acquisition conditions (data acquisition conditions), state information when the vehicle 200 (mobile object) acquires video. The state information is, for example, the speed of the vehicle 200 and the temperature (indoor or outdoor) detected by the sensors of the vehicle 200. The data processing unit 101 further performs data acquisition based on the state information.

[0126] Depending on the purpose of using the video, it may be desired to acquire a video corresponding to the state information of the vehicle 200. For example, by acquiring a video corresponding to the speed of the vehicle 200, the driving situation of the driver corresponding to that speed can be grasped. Also, by acquiring a video corresponding to the temperature, the transportation state of the animals during animal transportation can be grasped.

[0127] In addition, the area operation setting table 103 further stores, as a video acquisition condition, an upper limit on the number of times of video acquisition. The data processing unit 101 performs video acquisition based on the number of acquisitions. Depending on the purpose of using the video by the administrator, a plurality of videos may not be necessary. In the present disclosure, video acquisition can be restricted.

[0128] In the management system of the present disclosure, the data processing unit 101 receives area detection information, which is information related to video acquisition, from the drive recorder 200a (device). Then, based on the area detection information, a key information table used for searching the acquired video is generated. For example, the area detection information is the date and time of entry into the area, the date and time of exit, the speed of the vehicle 200, and the temperature. By associating these pieces of information as key information for searching with the video, video search becomes possible. Note that this association only needs to be searchable based on video key information including area detection information, video ID, recording date and time, etc. when immediate video acquisition is not performed. Needless to say, the video data itself only needs to perform a video acquisition request or the like after the search.

[0129] The area table 102 stores, in association with an area master ID, a plurality of area IDs that match the usage purpose of video (data). For each area master ID, the acquisition conditions of the video in the area operation setting table 103 are set.

[0130] According to this disclosure, it is possible to collectively determine the acquisition conditions of video for each area master ID.

[0131] Also, in the management system of this disclosure, when the data processing unit 101 of the management server 100 receives area detection information, which is information regarding video acquisition, from the drive recorder 200a, it determines whether the drive recorder 200a stores a video that satisfies the acquisition conditions according to the area detection information.

[0132] According to this disclosure, when the drive recorder 200a has a configuration for area detection as shown in the above pattern 2, it is possible to use the area detection information to extract a video that satisfies the acquisition conditions.

[0133] Also, in this disclosure, the data processing unit 101 of the management server 100 enables video acquisition by causing the drive recorder 200a to perform video extraction processing by transmitting the operation timing and the data acquisition range to the drive recorder 200a.

[0134] According to this disclosure, it is possible to acquire a video that satisfies the acquisition conditions according to the control of the management server 100.

[0135] In the management system in the above pattern 1, the drive recorder 200a includes a communication module 201 that periodically transmits the position information of the vehicle 200 to the management server 100.

[0136] The management server 100 includes a data processing unit 101 that detects entry into and / or exit from an image acquisition target area based on an area table 102 including at least one or more area IDs and coordinate information for specifying the image acquisition target area, and the position information of the vehicle 200. This functions as an area detection unit. And it has an area operation setting table 103 that stores, for each area ID, at least a data acquisition condition including an operation timing for the image acquisition target area determined according to the purpose of using the image, and an image acquisition range corresponding to the operation timing. The data processing unit 101 communicates with the drive recorder 200a to acquire data that satisfies the data acquisition condition among the data stored in the drive recorder 200a.

[0137] In the disclosure of this Pattern 1, by periodically transmitting the position information from the drive recorder 200a, there is no need to perform area detection on the drive recorder 200a side. Therefore, its configuration can be made simple.

[0138] Also, in Pattern 3, in the drive recorder 200a, the control unit 211 functions as an area detection unit and detects entry into and / or exit from the acquisition target area based on an area table (corresponding to the area table 102) including at least one or more area IDs and coordinate information for specifying the image acquisition target area, and the position information of the vehicle 200. And the control unit 211 functions as an acquisition condition determination unit and determines whether the image acquisition condition is satisfied based on an area operation setting table (corresponding to the area operation setting table 103) that stores, for each area ID, at least a data acquisition condition including an operation timing for entry into and / or exit from the vehicle 200 determined according to the purpose of using the image, and a data acquisition range (image cut-out time) corresponding to the operation timing.

[0139] When the communication module 201 determines that the image acquisition condition is satisfied by the control unit 211, it transmits the area detection information detected by the control unit 211 to the management server 100.

[0140] In the management server 100, when the data processing unit 101 acquires the area detection information, it communicates with the drive recorder 200a to acquire data that satisfies the video acquisition conditions among the videos stored in the drive recorder 200a.

[0141] In the disclosure according to this pattern 3, in the drive recorder 200a, area detection and determination of operating conditions are performed. Therefore, it has tables corresponding to the area table 102 and the area operation setting table 103. According to this disclosure, by performing many processes on the drive recorder 200a side, the processes on the management server 100 side are made simple.

[0142] Also, in pattern 4, in addition to pattern 3, the control unit 211 stores, for each area ID, acquisition conditions of videos including at least the operation timing of entry and / or exit for 200 areas of the vehicle determined according to the usage purpose of the video and the data acquisition range (video cut-out time) corresponding to the operation timing. Based on the area operation setting table, the control unit 211 extracts videos that satisfy the data acquisition conditions from the external memory.

[0143] In particular, when the vehicle is outside the range of a mobile phone network or GPS, such as in an underground parking lot, even when the management server 100 side cannot determine the detection conditions and operation conditions according to patterns 1 and 2, the drive recorder 200a side detects the position of the vehicle based on information from environmental sensors such as vehicle sensors, and determines whether the detection conditions and operation conditions are satisfied. Then, when the communication module 201 is to immediately and automatically transmit a video that satisfies the data acquisition conditions according to the operation conditions, it stores the transmission to the management server 100 side in a reservation information table on the drive recorder 200a side (not shown), and transmits it when communication becomes possible.

[0144] Also, when manually transmitting video data from the administrator side, when the drive recorder 200a receives an access request (not shown), it transmits video data as a response to the access request. Also, in areas with good visibility and even in areas where GPS information is received, for example, when high accuracy is required for the location where video of driving skills spots (such as S-curves, parallel parking, centering, once-stop positions, uphill once-stop positions, etc.) at a driving school is to be acquired, there are limitations to detection based on GPS signals and it is easily affected by scrambling information. Even in such a case, if detection is performed based on relative positions, a person who wants to obtain a driver's license or a driving instructor can confirm the result of driving skills in the acquired video.

[0145] According to this disclosure, most of the processing will be performed on the drive recorder 200a side. Therefore, the processing in the management server 100 can be made simpler.

[0146] Here, in any pattern, there may be a situation where the management server 100 cannot acquire data such as video for some reason with the drive recorder 200a, or transmitting the video data itself to the management server 100 places a load on communication traffic and also incurs communication costs. Therefore, in order to reduce the amount of transmitted data, the control unit 211 may transmit the video identifier and information (such as position or time information) that serves as key information for other video data without transmitting the video data itself.

[0147] In that case, by applying the relationship between the video key information storage table in FIG. 6, the vehicle management table 105 described in Patent Document 2, the vehicle management table 215 on the device side, and the embodiment described in the reservation information table 104, management and acquisition processing of video data in a specific area is performed. The following is an explanation of an embodiment in which the vehicle management table disclosed in Patent Document 2 is managed on the management server and the device side, and later, when the management server acquires a video based on the video key information.

[0148] First, key information and video files of video identifiers and video data are recorded in the vehicle management table 215 on the device side stored in a plurality of the devices under the management of the user. Then, the key information, etc. is spontaneously transmitted from the plurality of the devices to the management server 100, or in response to an access request from the management server 100, the key information, etc. is actively transmitted, and the key information, etc. stored in the plurality of devices is recorded in the vehicle management table 105 on the management server 100 side.

[0149] In the vehicle management table 105 on the management server 100 side, in order to distinguish the information of the vehicle management table 215 on the device side, the device identifier is required as a table item that does not exist in the vehicle management table 215. In this regard, the reservation information table in FIG. 3 of Patent Document 2 also has the same for specifying which video identifier of the plurality of the devices is reserved.

[0150] On the other hand, in the video data storage area of the vehicle management table 215 on the device side, the video data associated with the video identifier is stored moment by moment, so the video data is generally complete. However, in the vehicle management table 105 on the management server 100 side, in order to generally reduce the amount of transmitted data, instead of sending the video data itself, the video identifier and information (for example, position or time information) serving as key information of the other video data are transmitted. Then, the video data is transmitted based on a predetermined condition, and the acquisition status flag is updated to acquired.

[0151] Therefore, in the video data storage area of the vehicle management table 105, the video data is generally not complete. Therefore, in order to distinguish whether the video data has been acquired, an acquisition status flag is required as a table item that does not exist in the vehicle management table 215, and it distinguishes the states of acquired, not acquired, reserved, and unobtainable.

[0152] Also, in the video data storage area of the vehicle management table 215, video data associated with video identifiers is recorded regardless of the communication availability status with the management server 100. However, in the video data storage area of the vehicle management table 105, when communication between the management server 100 and the target device is not possible, video data cannot be acquired. Therefore, in order to distinguish whether video data can be acquired, an acquisition availability flag is required as a table item that does not exist in the vehicle management table 215, which differentiates between the communication available and communication unavailable states.

[0153] Then, when making an access request or playback request for video data on the management screen of the administrator terminal 300 described later, a list of key information and the like stored in a plurality of devices under management is displayed based on the vehicle management table 105. The video acquisition status is iconified for each key information and the like, and an access request or playback request can be easily made by clicking on the icon. When the acquisition is completed, the acquisition status flag is changed to acquired, and the icon display on the management screen is also changed to acquired.

[0154] Also, in the video list frame within the filtering search condition setting screen of FIG. 17, for example, the recording date and time of the video, vehicle name, status, and video acquisition status flag extracted by filtering search conditions such as (1) organization ID, (2) driver ID (may be name), (3) device ID, (4) area master ID, (5) area ID, (6) driving area, (7) driving time zone, (8) speed zone, (9) temperature zone, etc. are displayed. By clicking on the video acquisition status, it is possible to easily acquire data by making an access request for unacquired videos.

[0155] Note that, regarding these inventions, although the description has centered around the management server 100 acquiring video data from the drive recorder 200a, this invention is not limited to the management server 100 transmitting and receiving target data to and from devices that may collide with a vehicle or an aircraft. For example, it is possible to control an aircraft or the like to autonomously avoid obstacles and move based on real-time video obtained from it. Thus, it goes without saying that, based on the detection conditions and operation conditions described above, it is possible to detect a target area and cause a desired operation to be performed or plan for it with respect to the target data that needs to be transmitted and received between the management server and the target device.

[0156] Needless to say, these inventions can be used in various application scenarios. In such cases, the following terms used in the above description should be read as follows: "video data" as "target data", "acquire video" as "execute or plan a desired operation", "data transmission" as "data transmission or control of the target device", "acquisition process" as "acquisition or control process, or operation reservation", "area detection notification" as "detection notification", "acquisition target device" as "transmission / reception target device", "acquisition reservation completion notification" as "transmission / reception reservation completion notification". Also, the category of the invention is not limited to "management system", and it goes without saying that it can be easily adapted to a detailed description of the invention regarding the category of "management device", "management method", or "program" that realizes these "management methods".

[0157] In the above embodiment, application examples in a drive recorder or a drone mounted on a vehicle were described, but the invention is also applicable to devices that perform photography using a camera such as a smartphone. For example, when a user enters or exits a predetermined area while holding a smartphone, it can also be applied to the process of extracting only the video taken in that area.

[0158] Also, when attempting to apply it to a drone, it can be applied not only to shooting processing but also to remote control. For example, when the drone enters or exits a predetermined area, a predetermined operation is performed. Examples of the predetermined operation include an obstacle avoidance operation by analyzing the video captured by the drone's camera. By activating the video analysis function when entering the predetermined area, more detailed processing can be performed. In addition, when the drone is used for delivery, it can also be used for recognition processing of the delivery destination and the like.

Explanation of Signs

[0159] 100… Management server, 200… Vehicle, 200a… Drive recorder, 110… Administrator terminal, 101… Data processing unit, 102… Area table, 103… Area operation setting table, 104… Area detection record table, 105… Video key information storage table, 106… Video data table, 107… Communication unit.

Claims

1. A management device for managing video data stored in a device disposed in a mobile object, comprising: a data processing unit that controls the device to acquire specific video data from the video data stored in the device on the basis of a detection criterion for video data to be acquired in a specific event; a communication unit that performs communication regarding the specific video data stored in the device; A management device comprising:

2. The management device according to claim 1 , wherein the detection criteria for the video data to be acquired during the specific event are criteria for detecting a change in data detectable by the mobile object itself or a device associated with the mobile object.

3. The management device of claim 1, wherein changes in data detectable by the mobile body itself or equipment associated with the mobile body include changes in maintenance event data for the mobile body, changes in data regarding the approach distance to other vehicles, changes in the results of analysis of forward images, or changes due to comparative analysis of front and rear images of snow removal vehicles or cleaning vehicles.

4. The management device according to claim 1 , wherein the data processing unit performs an image extraction process to extract a predetermined range of image data as the specific image data.

5. The management device according to claim 4 , wherein the data processing unit operates the device by transmitting at least one of an operation timing and / or a data acquisition range as the predetermined range to the device.

6. The management device of claim 1, wherein the data processing unit extracts the specific video data by either extracting video of a predetermined time period starting from when the moving body entered the designated range (Area IN), extracting video of a predetermined time period going back from when the moving body left the designated range (Area OUT), or extracting video of the period from when the moving body entered the designated range to when it left the designated range (Area IN-OUT).

7. A management method for managing video data stored in a device disposed in a mobile object, comprising: Controlling the device so as to acquire specific video data from the video data stored in the device on the basis of a detection criterion for video data to be acquired in a specific event; performing communication regarding the specific video data stored in the device; A management method comprising:

8. A program that causes a processor to execute processing of each unit included in the management device according to claim 1 .

Images