Video management system, method, and program

Abstract

This mobile body mounting device comprises: an imaging unit for capturing a video from a mobile body; a first transmission unit for transmitting, to a video processing device, a second video that has been obtained by reducing some information from a first video which is the captured video; and an identification unit for identifying the period of the first video in accordance with a specification. The video processing device comprises: an acceptance unit for accepting a specification of time stamp information that indicates the period of a part of the second video which has been transmitted from the mobile body mounting device; and a second transmission unit for transmitting, to the mobile body mounting device, the time stamp information that has been accepted. Further, the identification unit identifies the period of the first video corresponding to the period of the second video that is indicated by the time stamp information which has been received.

Description

Video management system, method and program

[0001] The present disclosure relates to a video management system, a mobile-mounted device and a video processing device, a video management method, a video identification method and a video processing method, and a video identification program and a video processing program.

[0002] In order to obtain data on driving on distinctive roads around the world, data is saved to and played back from various recording media, enabling validation and debugging of functions such as Advanced Driver Assistance Systems (ADAS).

[0003] For example, Patent Document 1 describes a method for handling video recording data captured by a plurality of vehicles. In the method described in Patent Document 1, video images of the exterior of the vehicles captured by each of the plurality of vehicles are sequentially uploaded from a drive recorder to a service server.

[0004] International Publication No. 2019 / 078007

[0005] When transmitting video data captured by a moving object such as a vehicle in real time, even using best-effort mobile communications, it may be difficult to transmit the captured video data itself. In such cases, some information is removed from the captured video data before transmission.

[0006] It is conceivable that the information reduction from the video in this way may prevent the monitor from obtaining sufficient information about the scene that he or she needs. Therefore, it is preferable to transmit video data with some information reduced in real time, while still being able to check the captured video data itself as needed.

[0007] Therefore, the present disclosure aims to provide a video management system, a mobile body-mounted device and video processing device, a video management method, a video identification method and video processing method, and a video identification program and video processing program that can ensure real-time video transmission while also being able to check video that requires precision.

[0008] The video management system according to the present disclosure comprises a mobile body-mounted device mounted on a mobile body, and a video processing device that processes video captured by the mobile body, wherein the mobile body-mounted device includes an imaging unit that captures video from the mobile body, a first transmission unit that transmits a second video, which is a first video that is the captured video, with some information removed, to the video processing device, and an identification unit that identifies a period of the first video in accordance with a specification, and the video processing device includes a reception unit that receives a specification of timestamp information indicating a period of a portion of the second video transmitted from the mobile body-mounted device, and a second transmission unit that transmits the received timestamp information to the mobile body-mounted device, and the identification unit identifies a period of the first video that corresponds to the period of the second video indicated by the received timestamp information.

[0009] The mobile body mounted device according to the present disclosure is characterized by comprising an imaging unit that captures an image from the mobile body, a transmitting unit that transmits a second image, which is an image obtained by removing some information from the captured first image, to an image processing device, and an identifying unit that, in response to timestamp information indicating a period of a portion of the second image received from the image processing device, identifies a period of the first image that corresponds to the period of the second image indicated by the timestamp information.

[0010] The video processing device according to the present disclosure is characterized by including a reception unit that receives a second video, which is a video in which some information has been removed from a first video, which is a video captured by a mobile-mounted device mounted on a mobile body, and receives designation of timestamp information indicating a period of a portion of the second video, and a transmission unit that transmits the received timestamp information to the mobile-mounted device and causes the mobile-mounted device to identify the period of the first video that corresponds to the period of the second video indicated by the timestamp information.

[0011] The video management method according to the present disclosure is characterized in that a mobile-body-mounted device mounted on a mobile body captures video from the mobile body, the mobile-body-mounted device transmits a second video, which is a first video that has some information removed from the captured video, to a video processing device, the video processing device accepts designation of timestamp information indicating a period of a portion of the second video transmitted from the mobile-body-mounted device, the video processing device transmits the accepted timestamp information to the mobile-body-mounted device, and the mobile-body-mounted device identifies a period of the first video that corresponds to the period of the second video indicated by the received timestamp information.

[0012] The video identification method disclosed herein is characterized in that it captures video from a moving object, transmits a second video, which is a first video that has some information removed from the captured video, to a video processing device, and, in accordance with the specification of timestamp information indicating a period of a portion of the second video received from the video processing device, identifies a period of the first video that corresponds to the period of the second video indicated by the timestamp information.

[0013] The video processing method according to the present disclosure is characterized in that it receives a second video, which is a video in which some information has been removed from a first video, which is a video captured by a mobile-mounted device mounted on a mobile body, accepts a designation of timestamp information indicating a period of a portion of the second video, transmits the accepted timestamp information to the mobile-mounted device, and causes the mobile-mounted device to identify the period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0014] The video identification program according to the present disclosure is characterized in that it causes a computer to perform a transmission process of transmitting a second video, which is a first video, which is a video captured from a moving body, with some information removed, to a video processing device, and a identification process of identifying a period of the first video corresponding to the period of the second video indicated by timestamp information received from the video processing device, in accordance with the specification of timestamp information indicating a period of a portion of the second video.

[0015] The video processing program according to the present disclosure is characterized in that it causes a computer to execute a reception process of receiving a second video, which is a video in which some information has been removed from a first video, which is a video captured by a mobile-mounted device mounted on a mobile body, and receiving designation of timestamp information indicating a period of a portion of the second video, and a transmission process of transmitting the received timestamp information to the mobile-mounted device and causing the mobile-mounted device to identify the period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0016] According to the present disclosure, it is possible to check images that require precision while ensuring real-time video transmission.

[0017] Fig. 1 is a block diagram showing an example configuration of an embodiment of a video management system according to the present disclosure; Fig. 2 is a flowchart showing an example operation of the video management system; Fig. 3 is an explanatory diagram showing a specific example of a video management system; Fig. 4 is a block diagram showing an overview of a video management system according to the present disclosure; Fig. 5 is a block diagram showing an overview of a mobile-mounted device according to the present disclosure; Fig. 6 is a block diagram showing an overview of a video processing device according to the present disclosure; Fig. 7 is a schematic block diagram showing the configuration of a computer according to at least one embodiment.

[0018] First, the background of the present disclosure will be specifically described. When performing analysis or debugging using real-time data, it is necessary to perform video distribution inexpensively and effectively with best-effort performance of mobile communications.

[0019] In this case, since the captured video itself has a large capacity, a video with some information reduced may be transmitted instead of the captured video. For example, if the feature points necessary for analysis can be defined, video distribution can be more cost-effective and efficient by maintaining the resolution of the image including the feature points while reducing the image quality of unnecessary areas.

[0020] However, there are limitations to the definition of feature points and the accuracy of extracting feature points using AI (Artificial Intelligence), etc., so it is possible that the transmitted data cannot be effectively used for analysis. Therefore, the present disclosure assumes a situation in which video captured by a remote mobile object is transmitted in real time with some information removed, while allowing the monitor to separately check video of a range that the monitor wishes to monitor in more detail.

[0021] In the following description, a vehicle is used as an example of the remote moving object. However, the remote moving object is not limited to a vehicle and may be another moving object such as a drone.

[0022] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0023] 1 is a block diagram showing an example of the configuration of an embodiment of a video management system according to the present disclosure. The video management system 1 of the first embodiment includes a mobile-mounted device 100, a video processing device 200, and a storage server 300. The mobile-mounted device 100, the video processing device 200, and the storage server 300 are connected to each other via communication lines.

[0024] In addition, in this embodiment, the mobile-mounted device 100 and the video processing device 200 are connected via a narrow-bandwidth mobile line, and the mobile-mounted device 100 and the storage server 300, and the video processing device 200 and the storage server 300 are connected via a wide-bandwidth Internet line.

[0025] The mobile-body-mounted device 100 is a device mounted on a mobile body and captures images. An example of the mobile-body-mounted device 100 is a TCU (Telematics Control Unit). The mobile-body-mounted device 100 includes a storage unit 110, an imaging unit 120, a generation unit 130, a transmission unit 140, and an identification unit 150.

[0026] The storage unit 110 stores data required when the mobile-mounted device 100 performs various processes. The storage unit 110 also stores images captured by the imaging unit 120, which will be described later. The storage unit 110 is realized by, for example, a magnetic disk.

[0027] The imaging unit 120 captures an image from the moving body. In order to distinguish the image captured by the imaging unit 120 from an image processed by the generation unit 130 (described later), the image itself captured by the imaging unit 120 is referred to as a first image. That is, the imaging unit 120 captures the first image from the moving body. The imaging unit 120 is, for example, a camera. In addition, the imaging unit 120 may be realized by a device different from the moving body-mounted device 100 and connected to the moving body-mounted device 100 via a communication line.

[0028] The generating unit 130 generates a video (hereinafter referred to as a second video) in which some information has been reduced from the first video. The generating unit 130 may use any method to generate the second video from the first video as long as the method can reduce the amount of video data. For example, the generating unit 130 may generate a video in which the resolution of some images has been reduced from the first video, or may generate a video in which the frame rate has been reduced.

[0029] The information used to generate the second video (e.g., the degree to which the resolution or frame rate is reduced, etc.) may be predetermined according to the expected environment, or may be determined by receiving the necessary information from the video processing device 200 described below.

[0030] The generation unit 130 may, for example, determine information to be used to generate the second video by applying the current communication conditions to a trained model that can determine the resolution and frame rate depending on the communication conditions.

[0031] Furthermore, if an image containing important information can be identified from the first video, the generation unit 130 may generate the second video so as to maintain the resolution and frame rate of the area containing the important information (hereinafter sometimes referred to as the important area) and lower the resolution and frame rate of the other areas.

[0032] Furthermore, when identifying an image containing important information, the generation unit 130 may identify an image containing important information from the first video based on information acquired other than the video, for example, information indicating a specific state of the vehicle data. Examples of the information indicating the specific state of the vehicle data include key data such as speed, acceleration in each direction, error flags, and trouble analysis. The information indicating the specific state is, for example, determined in advance by an administrator or the like.

[0033] Alternatively, the generation unit 130 may identify important information by applying the captured video to a trained model that extracts important regions from the captured image.

[0034] The transmitting unit 140 transmits the second video to the video processing device 200. In particular, in this embodiment, the transmitting unit 140 transmits the second video to the video processing device 200 in real time. Note that the transmitting unit 140 may transmit the second video to the video processing device 200 via, for example, a server on a cloud (not shown) instead of directly transmitting the second video to the video processing device 200.

[0035] The identification unit 150 receives information indicating a period of a portion of the second video (hereinafter referred to as timestamp information) from the video processing device 200 described later, and identifies the period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0036] Then, when connected to a communication line with a bandwidth wider than a predetermined standard, the identifying unit 150 transmits the first video for the identified period to the storage server 300 and causes it to be registered.

[0037] The imaging unit 120, the generation unit 130, the transmission unit 140, and the identification unit 150 are realized by a computer processor (e.g., a CPU (Central Processing Unit), a GPU (Graphics Processing Unit)) that operates according to a program (video identification program).

[0038] For example, the program may be stored in the storage unit 110 of the mobile-mounted device 100, and the processor may read the program and operate as the imaging unit 120, the generating unit 130, the transmitting unit 140, and the identifying unit 150 in accordance with the program. Also, the functions of the mobile-mounted device 100 may be provided in a Software as a Service (SaaS) format.

[0039] Furthermore, the imaging unit 120, the generating unit 130, the transmitting unit 140, and the identifying unit 150 may each be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination thereof. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0040] Furthermore, when some or all of the components of the mobile-mounted device 100 are realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network.

[0041] The video processing device 200 includes a storage unit 210 , a receiving unit 220 , a display unit 230 , a receiving unit 240 , and a transmitting unit 250 .

[0042] The storage unit 210 stores data required when the video processing device 200 performs various processes. The storage unit 210 stores the second video received from the mobile body-mounted device 100. The storage unit 210 may also store the first video acquired from the storage server 300. The storage unit 210 is realized by, for example, a magnetic disk or the like.

[0043] The receiving unit 220 receives the second image from the moving body mounted device 100 .

[0044] The display unit 230 displays the received second video. In this embodiment, the display unit 230 displays the received second video in real time. Note that the display unit 230 may be able to change the period of the second video to be displayed, or may display the time when the first video, which is the basis of the second video, was captured.

[0045] The display unit 230 may also be configured to highlight objects that the monitor is watching. For example, an extraction model for extracting traffic-related objects (e.g., pedestrians, vehicles, traffic lights, lanes, etc.) from an image may be learned in advance, and the display unit 230 may highlight the area of ​​the object in the image that is extracted as a result of applying the video to the extraction model. This makes it possible to improve monitoring efficiency.

[0046] Additionally, the display unit 230 may display information indicating the communication environment between the mobile-mounted device 100 and the video processing device 200 (for example, line speed, etc.).

[0047] The reception unit 240 receives, from the monitor, a designation of information indicating a period of a part of the second video (i.e., timestamp information). Specifically, the reception unit 240 may receive, from the monitor, a designation of a period for the second video displayed on the display unit 230.

[0048] Furthermore, the receiving unit 240 may receive, from the observer, designation of information used to generate the second video (i.e., the degree to which the resolution or frame rate is to be reduced, etc.).

[0049] The transmitting unit 250 transmits the received timestamp information to the mobile-mounted device 100. Furthermore, if the receiving unit 240 receives designation of information to be used to generate the second video, the transmitting unit 250 may transmit that information to the mobile-mounted device 100. In this way, it can be said that the transmitting unit 250 transmits the received timestamp information to the mobile-mounted device 100, thereby specifying the period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0050] The receiving unit 220, the display unit 230, the accepting unit 240, and the transmitting unit 250 are realized by a processor of a computer that operates according to a program (video processing program).

[0051] Next, a description will be given of the operation of the video management system 1 of this embodiment. Fig. 2 is a flowchart showing an example of the operation of the video management system 1 of this embodiment.

[0052] The imaging unit 120 of the moving-object-mounted device 100 captures an image from the moving object (step S11). The transmission unit 140 transmits a second image, which is the first image with some information removed, to the image processing device 200 (step S12). The reception unit 240 of the image processing device 200 receives designation of timestamp information indicating a period of a portion of the second image (step S13). Then, the transmission unit 250 transmits the received timestamp information to the moving-object-mounted device 100 (step S14). The identification unit 150 of the moving-object-mounted device 100 identifies a period of the first image corresponding to the period of the second image indicated by the received timestamp information (step S15).

[0053] Next, a specific example of the video management system 1 of this embodiment will be described. Fig. 3 is an explanatory diagram showing a specific example of the video management system 1 of this embodiment. Here, a vehicle is assumed as the moving body.

[0054] While the vehicle is traveling, the vehicle-mounted device 100 delivers the captured video (more specifically, the second video) to the cloud in real time (step S101). The vehicle-mounted device 100 detects the line status and performs optimization of the video delivery (for example, reducing video data based on feature points). The video processing device 200 checks the second video acquired from the cloud and specifies to the vehicle-mounted device 100 the analysis focus points that the vehicle-mounted device 100 wants to check in detail later (step S102).

[0055] Then, suppose that the vehicle is connected to a wide-bandwidth Internet line while waiting, such as after the end of a trip. In this case, the vehicle-mounted device 100 transfers the video of the specified analysis focus point (i.e., the first video) to a server (e.g., storage server 300) specified by the monitor (step S103). If no particular designation is made, the vehicle-mounted device 100 may transmit the first video in the order in which it was captured. By using the first video transmitted in this manner, preparations for analysis are completed.

[0056] As described above, in this embodiment, the imaging unit 120 of the moving-body-mounted device 100 captures video from the moving body, and the transmission unit 140 transmits the second video to the video processing device 200. Thereafter, the reception unit 240 of the video processing device 200 receives designation of timestamp information indicating a partial period of the second video, and the transmission unit 250 transmits the received timestamp information to the moving-body-mounted device 100. Then, the identification unit 150 of the moving-body-mounted device 100 identifies the period of the first video corresponding to the period of the second video indicated by the received timestamp information. Thus, video transmission in real time can be ensured while video requiring accuracy can also be confirmed.

[0057] Next, an overview of the present disclosure will be described. Fig. 4 is a block diagram showing an overview of a video management system according to the present disclosure. A video management system 60 (e.g., video management system 1) according to the present disclosure includes a mobile body-mounted device 70 (e.g., mobile body-mounted device 100) mounted on a mobile body (e.g., a vehicle), and a video processing device 80 (e.g., video processing device 200) that processes video captured by the mobile body.

[0058] The mobile body mounted device 70 includes an imaging unit 71 (e.g., imaging unit 120) that captures video from the mobile body, a first transmission unit 72 (e.g., transmission unit 140) that transmits a second video, which is a first video that has some information removed from the captured video, to the video processing device 80, and an identification unit 73 (e.g., identification unit 150) that identifies the period of the first video in accordance with a specification.

[0059] The video processing device 80 includes a reception unit 81 (e.g., reception unit 240) that receives a specification of timestamp information indicating a period of a portion of the second video transmitted from the mobile body-mounted device 70, and a second transmission unit 82 (e.g., transmission unit 250) that transmits the received timestamp information to the mobile body-mounted device 70.

[0060] The identifying unit 73 then identifies the period of the first video that corresponds to the period of the second video indicated by the received time stamp information.

[0061] Such a configuration ensures real-time video transmission while also allowing for the confirmation of video that requires precision.

[0062] Furthermore, the specifying unit 73 may transmit the first video for the specified period to a storage server (for example, the storage server 300).

[0063] Specifically, the identification unit 73 may transmit the first video of the identified period to the storage server when the mobile-mounted device 70 is connected to a communication line (e.g., an Internet line) with a bandwidth wider than a predetermined standard.

[0064] The first transmitting unit 72 may also transmit the second video to the video processing device in real time.

[0065] Furthermore, the mobile-mounted device 70 may include a generating unit (e.g., the generating unit 130) that generates the second video so as to reduce information other than the important area identified from the first video. Then, the first transmitting unit 72 may transmit the generated second video to the video processing device 80.

[0066] In this case, the generating unit may generate the second video so as to lower at least one of the resolution and the frame rate of the area other than the important area identified from the first video.

[0067] Furthermore, the generation unit may identify the important region based on information acquired other than the video and indicating a specific state of the moving object.

[0068] Furthermore, the image processing device 80 may include a display unit (e.g., 230) that displays the second image. The display unit may highlight an object that the observer is gazing at in the second image.

[0069] Specifically, the display unit may highlight the area of ​​the object extracted as a result of applying the second video to an extraction model that extracts traffic-related objects from the image.

[0070] 5 is a block diagram showing an overview of a mobile-mounted device according to the present disclosure. The mobile-mounted device 70a (e.g., the mobile-mounted device 100) according to the present disclosure includes an imaging unit 71a (e.g., the imaging unit 120) that captures video from a mobile body (e.g., a vehicle), a transmission unit 72a (e.g., the transmission unit 140) that transmits a second video, which is a first video that is the captured video but has some information removed, to a video processing device (e.g., the video processing device 200), and an identification unit 73a (e.g., the identification unit 150) that, in response to timestamp information indicating a period of a portion of the second video received from the video processing device, identifies a period of the first video that corresponds to the period of the second video indicated by the timestamp information.

[0071] With such a configuration, real-time video transmission can be ensured while still allowing for the confirmation of video that requires precision.

[0072] Furthermore, the specifying unit 73a may transmit the first video for the specified period to a storage server (for example, the storage server 300).

[0073] Furthermore, when connected to a communication line (for example, an Internet line) with a bandwidth wider than a predetermined standard, the specifying unit 73a may transmit the first video for the specified period to the storage server.

[0074] The transmitting unit 72a may also transmit the second video to the video processing device in real time.

[0075] Furthermore, the mobile-mounted device 70a may include a generating unit (e.g., the generating unit 130) that generates the second video so as to reduce information other than the important area identified from the first video. Then, the transmitting unit 72a may transmit the generated second video to the video processing device.

[0076] 6 is a block diagram showing an overview of a video processing device according to the present disclosure. The video processing device 80a (e.g., video processing device 200) according to the present disclosure includes a reception unit 81a (e.g., reception unit 240) that receives a second video, which is a first video captured by a mobile-body-mounted device (e.g., mobile-body-mounted device 100) mounted on a mobile body (e.g., a vehicle) with some information removed, and receives timestamp information indicating a period of the second video, and a transmission unit 82a (e.g., transmission unit 250) that transmits the received timestamp information to the mobile-body-mounted device and causes the mobile-body-mounted device to identify a period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0077] With such a configuration, real-time video transmission can be ensured while still allowing for the confirmation of video that requires precision.

[0078] 7 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. The computer 1000 includes a processor 1001, a main memory device 1002, an auxiliary memory device 1003, and an interface 1004. The computer 1000 may also be connected to a computer that executes a mathematical programming solver, an annealing machine, a simulator, or the like.

[0079] The above-described mobile-mounted device 70a and image processing device 80a are each implemented in a computer 1000. The operations of the above-described processing units are stored in the form of programs (image identification program, image processing program) in an auxiliary storage device 1003. The processor 1001 reads the programs from the auxiliary storage device 1003, loads them into the main storage device 1002, and executes the above-described processing in accordance with the programs.

[0080] In at least one embodiment, the auxiliary storage device 1003 is an example of a non-transitory tangible medium. Other examples of non-transitory tangible media include a magnetic disk, a magneto-optical disk, a CD-ROM (Compact Disc Read-only memory), a DVD-ROM (Read-only memory), and a semiconductor memory connected via the interface 1004. In addition, when this program is distributed to the computer 1000 via a communication line, the computer 1000 that receives the program may load the program into the main storage device 1002 and execute the above-described processing.

[0081] The program may be a program for realizing part of the above-described functions. Furthermore, the program may be a so-called differential file (differential program) that realizes the above-described functions in combination with another program already stored in the auxiliary storage device 1003.

[0082] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0083] (Supplementary Note 1) A video management system comprising: a mobile body-mounted device mounted on a mobile body; and a video processing device that processes video captured by the mobile body, wherein the mobile body-mounted device includes an imaging unit that captures video from the mobile body; a first transmission unit that transmits a second video, which is a first video that is the captured video, to the video processing device, with some information removed; and an identification unit that identifies a period of the first video in accordance with a specification, wherein the video processing device includes a reception unit that receives a specification of timestamp information indicating a period of a portion of the second video transmitted from the mobile body-mounted device; and a second transmission unit that transmits the received timestamp information to the mobile body-mounted device, wherein the identification unit identifies a period of the first video that corresponds to the period of the second video indicated by the received timestamp information.

[0084] (Supplementary Note 2) The video management system according to Supplementary Note 1, wherein the specifying unit transmits the first video for the specified period to the storage server.

[0085] (Supplementary Note 3) The video management system described in Supplementary Note 1 or Supplementary Note 2, wherein the identification unit transmits the first video for the identified period to the storage server when the mobile-mounted device is connected to a communication line with a bandwidth wider than a predetermined standard.

[0086] (Supplementary Note 4) The video management system according to any one of Supplementary Note 1 to Supplementary Note 3, wherein the first transmission unit transmits the second video to the video processing device in real time.

[0087] (Appendix 5) A video management system described in any one of Appendices 1 to 4, wherein the mobile body-mounted device includes a generation unit that generates a second video so as to reduce information other than important areas identified from the first video, and the first transmission unit transmits the generated second video to the video processing device.

[0088] (Supplementary Note 6) The video management system according to Supplementary Note 5, wherein the generating unit generates the second video so as to lower at least one of the resolution and the frame rate of a region other than an important region identified from the first video.

[0089] (Supplementary Note 7) The video management system according to Supplementary Note 5 or Supplementary Note 6, wherein the generation unit identifies the important area based on information acquired other than the video and indicating a specific state of the moving object.

[0090] (Appendix 8) A video management system described in any one of Appendices 1 to 7, wherein the video processing device includes a display unit that displays the second video, and the display unit highlights an object in the second video that the monitor is gazing at.

[0091] (Supplementary Note 9) The video management system according to Supplementary Note 8, wherein the display unit highlights the area of ​​the object extracted as a result of applying the second image to an extraction model that extracts traffic-related objects from the image.

[0092] (Appendix 10) A device mounted on a moving body, comprising: an imaging unit that captures an image from a moving body; a transmission unit that transmits a second image, which is an image obtained by removing some information from the captured first image, to an image processing device; and an identification unit that, in response to timestamp information indicating a period of a portion of the second image received from the image processing device, identifies a period of the first image corresponding to the period of the second image indicated by the timestamp information.

[0093] (Supplementary Note 11) The mobile-mounted device according to Supplementary Note 10, wherein the specifying unit transmits the first video for the specified period to the storage server.

[0094] (Supplementary Note 12) The mobile-mounted device according to Supplementary Note 10 or Supplementary Note 11, wherein the specifying unit transmits the first video for the specified period to the storage server when connected to a communication line with a bandwidth wider than a predetermined standard.

[0095] (Supplementary Note 13) The moving body-mounted device according to any one of Supplementary Note 10 to Supplementary Note 12, wherein the transmission unit transmits the second video to the video processing device in real time.

[0096] (Appendix 14) A mobile body-mounted device described in any one of Appendices 10 to 13, comprising a generation unit that generates a second image so as to reduce information other than important areas identified from the first image, and a transmission unit that transmits the generated second image to an image processing device.

[0097] (Supplementary Note 15) The moving body mounted device according to Supplementary Note 14, wherein the generating unit generates the second video so as to lower at least one of the resolution and the frame rate of a region other than an important region identified from the first video.

[0098] (Supplementary Note 16) The moving body mounted device according to Supplementary Note 14 or Supplementary Note 15, wherein the generating unit identifies the important area based on information acquired other than the video and indicating a specific state of the moving body.

[0099] (Appendix 17) An image processing device comprising: a receiving unit that receives a second image, which is an image obtained by removing some information from a first image, which is an image captured by a mobile-mounted device mounted on a mobile body, and receives designation of timestamp information indicating a period of a portion of the second image; and a transmitting unit that transmits the received timestamp information to the mobile-mounted device, and causes the mobile-mounted device to identify a period of the first image corresponding to the period of the second image indicated by the timestamp information.

[0100] (Supplementary Note 18) The image processing device according to Supplementary Note 17, further comprising a display unit that displays the second image, wherein the display unit highlights an object that the observer is gazing at in the second image.

[0101] (Supplementary Note 19) The image processing device according to Supplementary Note 18, wherein the display unit highlights the area of ​​the object extracted as a result of applying the second image to an extraction model that extracts traffic-related objects from the image.

[0102] (Supplementary Note 20) A video management method characterized by the following: a mobile-mounted device mounted on a mobile body captures video from the mobile body; the mobile-mounted device transmits a second video, which is a first video that is the captured video, with some information removed, to a video processing device; the video processing device receives designation of timestamp information indicating a period of a portion of the second video transmitted from the mobile-mounted device; the video processing device transmits the received timestamp information to the mobile-mounted device; and the mobile-mounted device identifies a period of the first video that corresponds to the period of the second video indicated by the received timestamp information.

[0103] (Supplementary Note 21) The video management method according to Supplementary Note 20, wherein the mobile-mounted device transmits the first video for the specified period to the storage server.

[0104] (Appendix 22) A video identification method characterized by capturing video from a moving object, transmitting a second video, which is a first video captured by removing some information from the captured video, to a video processing device, and identifying a period of the first video corresponding to the period of the second video indicated by timestamp information received from the video processing device in accordance with the timestamp information indicating a period of a portion of the second video.

[0105] (Appendix 23) A video processing method comprising: receiving a second video, which is a video obtained by removing some information from a first video, which is a video captured by a mobile-mounted device mounted on a mobile body; accepting designation of timestamp information indicating a period of a portion of the second video; transmitting the accepted timestamp information to the mobile-mounted device; and causing the mobile-mounted device to identify a period of the first video corresponding to the period of the second video indicated by the timestamp information.

[0106] (Supplementary Note 24) A storage medium storing an image identification program for causing a computer to execute a transmission process for transmitting to an image processing device a second image, which is an image obtained by removing some information from a first image, which is an image captured from a moving object, and an identification process for identifying a period of the first image corresponding to the period of the second image indicated by timestamp information received from the image processing device, in accordance with the designation of the timestamp information indicating a period of a portion of the second image.

[0107] (Appendix 25) A storage medium storing an image processing program for causing a computer to execute a reception process for receiving a second image, which is an image obtained by removing some information from a first image captured by a mobile-mounted device mounted on a mobile body, and receiving designation of timestamp information indicating a period of a portion of the second image, and a transmission process for transmitting the received timestamp information to the mobile-mounted device, and causing the mobile-mounted device to identify the period of the first image corresponding to the period of the second image indicated by the timestamp information.

[0108] Although the present invention has been described above with reference to the embodiments and examples, the present invention is not limited to the above-described embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0109] REFERENCE SIGNS LIST 1 Video management system 100 Mobile-mounted device 110 Storage unit 120 Imaging unit 130 Generation unit 140 Transmission unit 150 Identification unit 200 Video processing device 210 Storage unit 220 Reception unit 230 Display unit 240 Reception unit 250 Transmission unit 300 Storage server

Claims

1. Mobile device mounted on a mobile vehicle, The system includes an image processing device that processes images captured by the aforementioned moving object, The aforementioned mobile body mounting device is An imaging unit that captures images from the aforementioned moving object, A first transmission unit transmits a second image, which is an image obtained by removing some information from the first image, which is an image that has been captured, to the image processing device. Includes a specifying unit that specifies the period of the first video according to the designation, The aforementioned video processing device is A receiving unit that receives a designation of timestamp information indicating a period of time of a part of the second video transmitted from the mobile device, It includes a second transmission unit that transmits the received timestamp information to the mobile device, The identification unit identifies the period of the first video that corresponds to the period of the second video indicated by the received timestamp information. A video management system characterized by the following features.

2. The specified unit transmits the first video footage for the specified period to the storage server. The video management system according to claim 1.

3. The specific unit transmits the first video for a specified period to the storage server when the mobile device is connected to a communication line with a wider bandwidth than predetermined. The video management system according to claim 1 or claim 2.

4. An imaging unit that captures images from a moving object, A transmission unit transmits a second image, which is an image obtained by removing some information from the first image, which is an image captured, to an image processing device. The system includes a specification unit that, in response to the specification of timestamp information indicating a period of a part of the second video received from the video processing device, identifies the period of the first video corresponding to the period of the second video indicated by the timestamp information. A mobile device characterized by the following features.

5. A receiving unit that receives a second video, which is a video obtained by removing some information from a first video, which is a video captured by a mobile device mounted on a mobile body, and accepts the specification of timestamp information indicating a period of time in the second video, The system includes a transmission unit that transmits the received timestamp information to the mobile device, causing the mobile device to specify the period of the first video corresponding to the period of the second video indicated by the timestamp information. A video processing device characterized by the following features.

6. A mobile device mounted on a mobile body captures images from the mobile body. The mobile device transmits a second image, which is an image obtained by removing some information from the first image, which is an image that has been captured, to the image processing device. The video processing device receives a specification of timestamp information indicating a period of time for a portion of the second video transmitted from the mobile device, The video processing device transmits the received timestamp information to the mobile device. The mobile device identifies the period of the first video that corresponds to the period of the second video indicated by the received timestamp information. A video management method characterized by the following features.

7. Capture images from a moving object, The second image, which is the first image (the captured image) with some information removed, is transmitted to the image processing device. In response to the specification of timestamp information indicating a period of a portion of the second video received from the video processing device, the period of the first video corresponding to the period of the second video indicated by the timestamp information is identified. A method for identifying video footage, characterized by the following features.

8. The system receives a second video, which is a video obtained by removing some information from the first video, which is a video captured by a mobile device mounted on a mobile body, and accepts the specification of timestamp information indicating a period of time in the second video. The received timestamp information is transmitted to the mobile device, causing the mobile device to identify the period of the first video corresponding to the period of the second video indicated by the timestamp information. A video processing method characterized by the following features.

9. On the computer, A transmission process that transmits a second image, which is an image obtained by removing some information from the first image, which is an image captured from a moving object, to an image processing device, and In response to the specification of timestamp information indicating a period of a portion of the second video received from the video processing device, a specific process is performed to identify the period of the first video corresponding to the period of the second video indicated by the timestamp information. A video identification program to execute the program.

10. On the computer, A receiving process that receives a second video, which is a video obtained by removing some information from a first video, which is a video captured by a mobile device mounted on a mobile body, and accepts the specification of timestamp information indicating a period of time in the second video, and, Transmission process: The received timestamp information is transmitted to the mobile device, causing the mobile device to identify the period of the first video corresponding to the period of the second video indicated by the timestamp information. A video processing program to execute this.