Surveillance video output system, surveillance video output method

Abstract

A monitoring video output system, a monitoring video output method. A monitoring video output system capable of displaying a monitoring video using image data captured by a camera mounted on a mobile body, and capable of displaying the monitoring video with respect to a wide range of locations. The monitoring video output system according to the present disclosure includes a plurality of cameras mounted on each of a plurality of mobile bodies, a storage device that stores image data and position data for each of the plurality of cameras, and a processor. The processor performs: a process of accepting a monitoring area as an input; an image acquisition process of selecting an image acquisition camera from the plurality of cameras for each predetermined time width, and acquiring image data within the time width of the image acquisition camera; and a process of outputting the image data acquired for each time width. In addition, when there are two or more cameras that are candidates for the image acquisition camera, the camera with the longest moving distance within the time width in the monitoring area is selected as the image acquisition camera.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a technique of outputting a monitoring image using image data captured by a camera mounted on a mobile body. BACKGROUND

[0002] In recent years, various techniques using image data captured by a camera mounted on a mobile body are considered.

[0003] In Patent Literature 1, an image monitoring system is disclosed, which includes: a vehicle-mounted information terminal that transmits a moving image obtained by capturing a predetermined range including a specific location with a vehicle-mounted camera; and an image information collecting device that acquires moving images obtained by capturing the predetermined range at different times from a plurality of vehicle-mounted information terminals, and generates a moving image that captures the specific location over time based on the moving images from the plurality of vehicle-mounted information terminals.

[0004] In addition, as examples of techniques that disclose the use of image data captured by a camera mounted on a mobile body, Patent Literature 2 and Patent Literature 3 can be given.

[0005] PRIOR ART DOCUMENTS

[0006] PATENT LITERATURE

[0007] Patent Literature 1: Japanese Patent Application Publication No. 2007-194722

[0008] Patent Literature 2: Japanese Patent Application Publication No. 2011-180693

[0009] Patent Literature 3: Japanese Patent Application Publication No. 2009-060477 SUMMARY

[0010] In recent years, an image acquisition device such as a drive recorder or a sensor camera is generally mounted on a vehicle. Therefore, as a technique for reducing infrastructure costs, a monitoring image using image data captured by a camera mounted on a mobile body is expected.

[0011] In the image monitoring system disclosed in Patent Literature 1, a specific location such as an accident site or a congestion site is accepted as a request, and a moving image that captures the specific location over time is generated. However, it is assumed that a user of the monitoring image wants to confirm the monitoring image with respect to a wider range of locations, not with respect to the specific location.

[0012] One object of the present disclosure is to provide a monitoring image output system and a monitoring image output method that can display a monitoring image using image data captured by a camera mounted on a mobile body, and can display the monitoring image with respect to a wide range of locations.

[0013] A first disclosure relates to a monitoring image output system.

[0014] The monitoring video output system according to the first disclosure includes a plurality of cameras mounted on a plurality of moving bodies, respectively, one or more storage devices, and one or more processors.

[0015] The one or more storage devices store, for each of the plurality of cameras, image data of a captured image and position data indicating a position of the camera or a position of the moving body on which the camera is mounted at each time.

[0016] The one or more processors are configured to execute: a process of accepting, as input, a monitoring area that specifies a specific area; an image acquisition process of selecting, for each predetermined time width, an image acquisition camera in which the position data within the time width is included in the monitoring area, from the plurality of cameras, acquiring the image data within the time width of the image acquisition camera, and outputting the image data acquired for each time width in chronological order, or generating an image in which the image data acquired for each time width is combined in chronological order and outputting the image; and a process of outputting the image data acquired for each time width in chronological order, or generating an image in which the image data acquired for each time width is combined in chronological order and outputting the image.

[0017] In addition, in the image acquisition process, the one or more processors are configured to execute a process of selecting, as the image acquisition camera, the camera in which the moving distance within the time width in the monitoring area is the longest, from the cameras in which the position data within the time width is included in the monitoring area, on the basis of the position data.

[0018] The second disclosure relates to a monitoring video output system according to the first disclosure, further having the following features.

[0019] The one or more processors are configured to further execute a process of accepting, as input, a direction setting that specifies a direction of an image capturing direction in the monitoring area.

[0020] In addition, in the image acquisition process, the one or more processors further select the image acquisition camera on the basis of the position data, with the condition that the moving direction of the camera or the moving body satisfies the direction setting.

[0021] The third disclosure relates to a monitoring video output system according to the first or second disclosure, further having the following features.

[0022] The specific area is one of the divided areas of a space divided by a grid.

[0023] The fourth disclosure relates to a monitoring video output method.

[0024] The monitoring image output method according to the fourth aspect includes: for each of a plurality of cameras mounted on a plurality of moving bodies, respectively, saving image data captured by the camera and position data indicating a position of the camera or a position of the moving body on which the camera is mounted at each time; accepting input of a monitoring area that specifies a specific area; for each predetermined time width, selecting, from the plurality of cameras, an image acquisition camera whose position data within the time width is included in the monitoring area, acquiring the image data of the image acquisition camera within the time width; when there are two or more cameras whose position data within the time width is included in the monitoring area, selecting, according to the position data, a camera that has the longest moving distance within the time width in the monitoring area as the image acquisition camera; and outputting the image data acquired for each time width in chronological order, or generating an image in which the image data acquired for each time width is combined in chronological order and outputting the image.

[0025] The fifth aspect relates to a monitoring image output method according to the fourth aspect, further having the following features.

[0026] Further including accepting input of a direction setting that specifies a direction of image capturing within the monitoring area.

[0027] According to the position data, further selecting the image acquisition camera as a condition that a moving direction of the camera or the moving body satisfies the direction setting.

[0028] The sixth aspect relates to a monitoring image output method according to the fourth or fifth aspect, further having the following features.

[0029] The specific area is one of divided areas of a space divided by a grid.

[0030] According to the present disclosure, a monitoring area that specifies a specific area is accepted as input. Then, for each predetermined time width, an image acquisition camera is selected from a plurality of cameras, and image data within a time width of the image acquisition camera is acquired. Furthermore, the image data acquired for each time width is output as monitoring image data in chronological order. Alternatively, an image obtained by combining the image data acquired for each time width in chronological order is output as monitoring image data.

[0031] Thus, it is possible to display a monitoring image using image data captured by a camera mounted on a moving body, and it is possible to display a monitoring image with respect to a wide range of locations.

[0032] Furthermore, when there are two or more cameras whose location data covers the monitored area within the time span, the camera with the longest movement distance within the monitored area within the time span is selected as the image acquisition camera based on the location data. This allows for the selection of a camera with a wider field of view as the image acquisition camera. Consequently, it is possible to display surveillance images that capture a wide range within the time span. Attached Figure Description

[0033] Figure 1 This is a conceptual diagram showing the outline of the structure of the surveillance image output system according to the first embodiment.

[0034] Figure 2 This is a conceptual diagram illustrating a specific area where the moving body is a vehicle traveling on a road.

[0035] Figure 3 This is a conceptual diagram used to illustrate the outline of image acquisition and processing.

[0036] Figure 4 It is a block diagram showing the general structure of the moving body.

[0037] Figure 5 This is a block diagram showing the general structure of an information processing device.

[0038] Figure 6 This is a flowchart illustrating the method for outputting surveillance images.

[0039] Figure 7 This is a flowchart illustrating the processes performed during image acquisition processing.

[0040] Figure 8 This is a conceptual diagram used to illustrate the selection of an image acquisition camera in the image acquisition processing involved in the first variation.

[0041] Figure 9 This is a conceptual diagram showing the outline of the structure of the surveillance image output system involved in the second variation.

[0042] Figure 10 This is a block diagram showing the general structure of the moving body involved in the second variation.

[0043] Figure 11 This is a conceptual diagram showing a specific example at a particular location in the second embodiment.

[0044] Figure 12 This is a conceptual diagram used to illustrate the selection of an image acquisition camera in the image acquisition processing involved in the second embodiment.

[0045] (Symbol Explanation)

[0046] 1: communication network; 2: input / output terminal; 3: division area; 4: specific place; 10: monitoring image output system; 100: mobile body; 110: camera; 120: position acquisition device; 130: communication interface; 200: storage device; 00: information processing device; 310: storage; 311: control program; 312: control information; 320: processor; 330: communication interface. DETAILED DESCRIPTION

[0047] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. However, in the case where a number, a quantity, an amount, a range, and the like of each element are mentioned in the embodiment shown below, the idea involved in the present disclosure is not limited to the mentioned number, except for the case where it is specifically mentioned or it is clearly determined in principle. In addition, the structure and the like described in the embodiment shown below are not necessarily essential in the idea involved in the present disclosure, except for the case where it is specifically mentioned or it is clearly determined in principle. Furthermore, in each drawing, the same symbol is attached to the same or equivalent portions, and the repeated description is appropriately simplified or omitted.

[0048] 1. First Embodiment

[0049] 1-1. Outline

[0050] Figure 1 is a conceptual diagram showing an outline of the structure of a monitoring image output system 10 involved in the first embodiment. The monitoring image output system 10 is provided with a plurality of cameras 110 mounted on each of a plurality of mobile bodies 100, a storage device 200, and an information processing device 300.

[0051] The mobile body 100 is typically a vehicle that travels on a road. In addition, as the mobile body 100, a bicycle, a drone, a patrol robot, and the like are exemplified. The camera 110 images an environment around the mobile body 100.

[0052] Each of the plurality of mobile bodies 100 transmits, to the storage device 200 via a communication network 1, image data imaged by the mounted camera 110 and position data indicating a position of the camera 110 at each time. In addition, the position data can also be data indicating a position of the mobile body 100 on which the camera 110 is mounted. Here, the communication network 1 is, for example, the Internet. However, it can also be another network constructed for the monitoring image output system 10. In addition, it is configured to be able to discriminate the image data and the position data as data about which of the plurality of cameras 110.

[0053] The storage device 200 is connected to the communication network 1, acquires the image data and the position data from each of the plurality of mobile bodies 100, and saves them. The storage device 200 is, for example, a database server.

[0054] The storage device 200 and the information processing device 300 are configured to be able to mutually transmit information. For example, the storage device 200 and the information processing device 300 are constituted by electric connection via a cable, connection via an optical communication line, connection using wireless communication via a wireless communication terminal, or the like. Alternatively, the information processing device 300 can also be constituted to be connected with the communication network 1, and mutually transmit information with the storage device 200 via the communication network 1. Alternatively, the storage device 200 and the information processing device 300 can also be constituted integrally. For example, the information processing device 300 is a server connected with the communication network 1, and the storage device 200 can also be a device (for example, a nonvolatile memory, a volatile memory, an HDD, an SSD, or the like) provided to the server.

[0055] Further, the storage device 200 accepts a request for data issued by the information processing device 300, and transmits data corresponding to the request to the information processing device 300. Thereby, the information processing device 300 acquires data held by the storage device 200.

[0056] The information processing device 300 is connected with the input / output terminal 2, accepts a monitoring area designating a specific area as an input, and outputs monitoring video data. The input / output terminal 2 integrally has, for example, an input section (a keyboard, a switch, a touch panel, a jog dial, or the like) and an output section (a display, a speaker, or the like). In this case, by an operation of the input section, a monitoring area is input, and information indicating the input monitoring area is transmitted to the information processing device 300. In addition, the monitoring video data output by the information processing device 300 is transmitted to the input / output terminal 2, and the monitoring video is displayed on the output section.

[0057] At the time of input of the monitoring area, as to the designation of the specific area, it is possible to designate one of the divided areas divided by the grid. Figure 2 is a conceptual diagram illustrating an example of designation of a specific area in a case where the mobile body 100 is a vehicle traveling on a road. As Figure 2 indicated, when the mobile body 100 is a vehicle traveling on a road, it is possible to consider a road map divided by a grid. Further, as to the designation of the specific area, it is possible to designate one of the divided areas of the road map divided by the grid. For example, in Figure 2 , it is possible to designate the divided area 3 as the monitoring area. In addition, the grid size can be appropriately decided according to the environment in which the monitoring video output system 10 is applied. Furthermore, it is also possible that the grid size is not the same in the entire road map. In addition, the division using the grid can also be applied to the division of a three-dimensional space.

[0058] Thus, by specifying a divided region of the divided space, the input of the monitoring region can be made easy. In particular, in the case of dividing the road map with the grid, the entire space as an object can be easily divided to provide the divided region.

[0059] Further, the specification of the specific region can take other forms. For example, a road map can be displayed on the output section of the input / output terminal 2, and any region on the road map can be specified (e.g., surrounded by a specific pattern or a freehand drawn frame line, etc.).

[0060] The monitoring video data output from the information processing apparatus 300 is constituted by the image data of each of the plurality of cameras 110 by the image acquisition processing performed in the information processing apparatus 300. Figure 3 is a conceptual diagram for explaining an outline of the image acquisition processing. In Figure 3 , in the road map divided with the grid as shown in Figure 2 , the divided region 3 is specified as the monitoring region.

[0061] In the image acquisition processing, for each predetermined time width, from the plurality of cameras 110, a camera 110 in which the position data within the time width is included in the monitoring region (hereinafter also referred to as an "image acquisition camera") is selected, and the image data within the time width of the image acquisition camera is acquired. In Figure 3 , as (A), (B), and (C), three situations for each time width (time width A, time width B, and time width C) are shown in the order of the time series. In (A), (B), and (C), the moving body 100 traveling on the road and the camera 110 provided in the moving body 100 are shown. Further, regarding the moving body 100 and the camera 110, in order to distinguish each, a symbol is added to the symbol (a, b, c). In addition, the dotted arrow indicates the change in the position data within the time width (movement of the camera 110). Further, the information processing apparatus 300 acquires the position data of the plurality of cameras 110 from the storage apparatus 200 for the execution of the image acquisition processing.

[0062] In the time width A, during the time width, the camera 110a is located in the monitoring region. The position data within the time width of the camera 110a is included in the monitoring region. Thus, in the image acquisition processing, in the time width A, the camera 110a is selected as the image acquisition camera, and the image data within the time width of the camera 110a is acquired.

[0063] In the time width B, the camera 110a and the camera 110b are located in the monitoring area during the time width. With respect to the camera 110a, the position data within the time width is not included in the monitoring area. On the other hand, with respect to the camera 110b, the position data within the time width is included in the monitoring area. Therefore, in the image acquisition processing, the camera 110b is selected as the image acquisition camera in the time width B, and the image data within the time width of the camera 110b is acquired.

[0064] In the time width C, the camera 110b and the camera 110c are located in the monitoring area during the time width. With respect to the camera 110b and the camera 110c, the position data within the time width is included in the monitoring area. In this case, in the image acquisition processing related to the first embodiment, the camera 110 having the longest moving distance within the time width in the monitoring area is selected as the image acquisition camera according to the position data. As shown in FIG. 10, in the time width C, the moving distance of the camera 110b is longer than the moving distance of the camera 110c. Therefore, in the image acquisition processing, the camera 110b is selected as the image acquisition camera in the time width C, and the image data within the time width of the camera 110b is acquired. Figure 3

[0065] Thus, by selecting the camera 110 having the longest moving distance within the time width in the monitoring area as the image acquisition camera, it is possible to select a wider range of cameras 110 as the image acquisition camera. Further, it is possible to output the monitoring image data captured in a wide range.

[0066] Further, in the image acquisition processing, the intervals of the respective time widths can also be different. For example, in the time width A, the time width B, and the time width C, the intervals can be different from each other. Figure 3

[0067] As described above, by the image acquisition processing, the image acquisition camera is selected for each predetermined time width, and the image data within the time width of the image acquisition camera is acquired. Further, the information processing apparatus 300 outputs the image data acquired for each time width in a time series as the monitoring image data. Alternatively, the information processing apparatus 300 outputs the image obtained by combining the image data acquired for each time width in a time series as the monitoring image data.

[0068] For example, in the time width A, the time width B, and the time width C, the intervals can be different from each other. Figure 3 ​​In the illustrated case, the information processing apparatus 300 first outputs the image data of the camera 110a as the monitoring image data with respect to the time width A, then outputs the image data of the camera 110b as the monitoring image data with respect to the time width B, and then outputs the image data of the camera 110b as the monitoring image data with respect to the time width C. This is, for example, a case in which the monitoring image is made to flow. In this case, the information processing apparatus 300 can acquire the position data of the plurality of cameras 110 for each time width.

[0069] Alternatively, the information processing apparatus 300 outputs the image obtained by sequentially combining the image data of the camera 110a of the time width A, the image data of the camera 110b of the time width B, and the image data of the camera 110b of the time width C as the monitoring image data. This is, for example, a case in which the monitoring image data for a monitoring time during which the display of the monitoring image is desired is output in response to an input of the monitoring time. In this case, the information processing apparatus 300 can acquire the position data of the plurality of cameras 110 with respect to the monitoring time.

[0070] Further, in a case in which there is no camera 110 whose position data within a time width is included in the monitoring area with respect to a certain time width, the monitoring image data of the time width is not output. That is, the monitoring image in the time width becomes a blank image.

[0071] 1-2. Structure

[0072] Hereinafter, the structure of the mobile body 100 and the information processing apparatus 300 provided in the monitoring image output system 10 will be described.

[0073] 1-2-1. Structure of Mobile Body

[0074] Figure 4 is a block diagram showing the schematic structure of the mobile body 100. The mobile body 100 is provided with a camera 110, a position acquisition apparatus 120, and a communication interface 130. The camera 110 and the communication interface 130 and the position acquisition apparatus 120 and the communication interface 130 are configured to be able to communicate information with each other. Typically, they are electrically connected by a wiring.

[0075] The camera 110 outputs the image data of the image captured. The image data output from the camera 110 is communicated to the communication interface 130. The image data output from the camera 110 includes information of the time of image capturing. For example, the image data is a collection of a plurality of image data each provided with the information of the time of image capturing. The camera 110 can be a camera prepared for the monitoring image output system 10, or can be a camera used for other purposes. For example, the camera 110 can be a drive recorder.

[0076] The position acquisition device 120 acquires the position of the camera 110 or the position of the mobile body 100 at each time, and outputs position data. The position data output by the position acquisition device 120 is transmitted to the communication interface 130. The position data output by the position acquisition device 120 is, for example, data that provides coordinates on a map at each time. As the position acquisition device 120, a GPS receiver, an ECU (Electronic Control Unit) that performs self-position estimation, or the like is exemplified. Further, in a case where the position acquisition device 120 acquires the position of the camera 110 at each time, the position acquisition device 120 can also be configured integrally with the camera 110.

[0077] The communication interface 130 is a device for transmitting and receiving information via the communication network 1. In particular, the image data acquired from the camera 110 and the position data acquired from the position acquisition device 120 are transmitted to the storage device 200 via the communication network 1 by the communication interface 130. As the communication interface 130, a wireless communication terminal that performs wireless communication with a base station connected to the communication network 1 is exemplified.

[0078] The information includes information capable of discriminating the image data and the position data transmitted by the communication interface 130 as data about which of the plurality of cameras 110. For example, ID information that determines each of the plurality of cameras 110 is included. In this case, the ID information can be included in the image data and the position data output by the camera 110 and the position acquisition device 120, or the ID information can be attached to the image data and the position data in the communication interface 130.

[0079] In addition, as to the form of transmitting the image data and the position data by the communication interface 130 and the form of managing the image data and the position data in the storage device 200, a suitable form can be adopted according to the environment in which the monitoring image output system 10 is applied. For example, in a case where the image data and the position data respectively include the ID information, the communication interface 130 can transmit the image data and the position data respectively, and the storage device 200 can manage the image data and the position data respectively for each of the ID information. On the other hand, in a case where the image data and the position data do not respectively include the ID information, the communication interface 130 can transmit the image data, the position data, and the ID information as one data in correspondence with each other, and the storage device 200 can manage the image data and the position data in correspondence with each other for each of the ID information. In this case, the correspondence of the image data and the position data is performed by the imaging time of the image data and each time of the position data.

[0080] 1-2-2. Structure of Information Processing Device

[0081] Figure 5is a block diagram showing a schematic configuration of the information processing apparatus 300. The information processing apparatus 300 is provided with one or a plurality of memories 310, one or a plurality of processors 320, and a communication interface 330. The one or a plurality of memories 310 and the one or a plurality of processors 320 and the communication interface 330 are configured to be able to mutually transfer information.

[0082] The communication interface 330 is a device for transmitting and receiving information with a device outside the information processing apparatus 300. In particular, via the communication interface 330, the video data and the image data are acquired from the storage apparatus 200. In addition, via the communication interface 330, the information of the monitoring area is acquired from the input-output terminal 2, and the monitoring video data is output to the input-output terminal 2. As the communication interface 330, a communication section that performs processing of generating a signal for communication is exemplified.

[0083] The one or a plurality of memories 310 hold a control program 311 executable by the one or a plurality of processors 320 and control information 312 required for processing executed by the one or a plurality of processors 320. As the one or a plurality of memories 310, a volatile memory, a non-volatile memory, an HDD, an SSD, and the like are exemplified. As the control information 312, the video data and the position data acquired from the storage apparatus 200, the information of the monitoring area acquired from the input-output terminal 2, and parameter information related to the control program 311 are exemplified. In addition, the information acquired via the communication interface 330 is held as the control information 312 to the one or a plurality of memories 310.

[0084] The one or a plurality of processors 320 read out the control program 311 and the control information 312 from the one or a plurality of memories 310, and execute processing according to the control program 311 in accordance with the control information 312. Thereby, in the information processing apparatus 300, processing of outputting the monitoring video data with the monitoring area as input is executed.

[0085] 1-3. Monitoring video output method

[0086] Hereinafter, processing executed by the one or a plurality of processors 320 and a monitoring video output method realized by the monitoring video output system 10 related to the first embodiment will be described.

[0087] Figure 6 is a flowchart showing the monitoring video output method realized by the monitoring video output system 10 related to the first embodiment. After the one or a plurality of processors 320 execute processing of accepting input of the monitoring area, the flowchart shown in Figure 6 is started. However, in a case where the monitoring video is streamed, the flowchart shown in Figure 6 is repeatedly executed for each predetermined period. In addition, Figure 6The processes of the flowchart shown are executed at predetermined control cycles.

[0088] In step S100, the one or more processors 320 execute a process of acquiring position data of the plurality of cameras 110 from the storage device 200. Here, regarding the acquisition of the position data, it can be performed with respect to a predetermined time in the past from a current time point, or it can be performed with respect to a specific time in the past. The former exemplifies a case where the monitoring video is streamed, and the latter exemplifies a case where the monitoring video of a specific time in the past is displayed. In the latter, the specific time is a monitoring time at which display of the monitoring video is desired.

[0089] After step S100, the process proceeds to step S200.

[0090] In step S200, the one or more processors 320 execute an image acquisition process. The details of the process executed by the one or more processors 320 in the image acquisition process will be described later. Through the image acquisition process, image data of an image acquisition camera selected for each predetermined time width is acquired.

[0091] After step S200, the process proceeds to step S300.

[0092] In step S300, the one or more processors 320 output, as monitoring video data, the image data acquired for each predetermined time width in step S200 in chronological order, or generate an image in which the image data acquired for each time width is combined in chronological order and output as monitoring video data. Thereby, in the input / output terminal 2, display of the monitoring video is realized.

[0093] After step S300, the process ends.

[0094] Hereinafter, the process executed by the one or more processors 320 in the image acquisition process will be described in detail. Figure 7 is a flowchart showing the process executed by the one or more processors 320 in the image acquisition process.

[0095] In step S210, the one or more processors 320 set a time width in which image data is acquired. Here, the set time width is a part of a predetermined time that is an object of display of the monitoring video. The interval of the set time width can be provided in advance as the control program 311 or the control information 312.

[0096] After step S210, the process proceeds to step S220.

[0097] In step S220, the one or more processors 320 determine whether the position data within the time width set in step S210 is included in the camera 110 of the monitoring area. This can be determined from the position data of the plurality of cameras 110.

[0098] In a case where the position data within the time width is included in the camera 110 of the monitoring area (step S220; "Yes"), the process proceeds to step S230. In a case where the position data within the time width is not included in the camera 110 of the monitoring area (step S220; "No"), it is considered that there is no image data within the time width (step S242), and the process proceeds to step S250.

[0099] In step S230, the one or more processors 320 select an image acquisition camera. Here, in a case where the camera 110 of which the position data within the time width is included in the monitoring area is one, this one camera 110 is selected as the image acquisition camera. On the other hand, in a case where the camera 110 of which the position data within the time width is included in the monitoring area is two or more, the camera 110 of which the moving distance within the time width in the monitoring area is the longest according to the position data is selected as the image acquisition camera.

[0100] After step S230, the process proceeds to step S241.

[0101] In step S241, the one or more processors 320 acquire the image data within the time width of the image acquisition camera selected in step S230.

[0102] After step S241, the process proceeds to step S250.

[0103] In step S250, the one or more processors 320 determine whether the image data of a predetermined time that is the target of display of the monitoring image is acquired.

[0104] In a case where the image data of the predetermined time is acquired (step S250; "Yes"), the image acquisition process is completed. In a case where the image data of the predetermined time is not acquired (step S250; "No"), the process returns to step S210 again, and the process is repeated. Here, in the process again, a time width different from the time width set last time is set with respect to the time width set in step S210. Typically, a time width that is continuous in the front and back direction of the time axis from the time width set last time is set.

[0105] Further, in a case where it is configured to sequentially output the image data acquired for each time width, the process related to step S250 can not be performed.

[0106] Further, the one or more processors 320 can also be configured to perform the process of resetting the time width in a case where the position data within the time width is not included in the camera 110 of the monitoring area (step S220; "No"). For example, in a case where there is the camera 110 located in the monitoring area during the time width, the time width is reset for any one of the cameras 110 in such a manner that the position data within the time width is included in the monitoring area. Typically, this is performed in such a manner that the reset time width becomes the longest. In this case, the camera 110 located in the monitoring area for the longest time within the time width is selected as the image acquisition camera. In a case where the process of resetting the time width is performed, the process related to step S242 is performed in a case where there is no camera 110 located in the monitoring area during the time width. By thus performing the process of resetting the time width, it is possible to reduce the time width during which the image data cannot be acquired. Further, it is possible to display the monitoring image for a longer time with respect to the monitoring area.

[0107] 1-4. Effects

[0108] As explained above, in the monitoring image output system 10 and the monitoring image output method according to the first embodiment, the monitoring area that specifies a specific area is accepted as input. Thereafter, the image acquisition process of selecting the image acquisition camera from the plurality of cameras 110 for each predetermined time width, and acquiring the image data within the time width of the image acquisition camera is performed. Then, the image data acquired for each time width is output as the monitoring image data in the time series. Alternatively, the image obtained by combining the image data acquired for each time width in the time series is output as the monitoring image data.

[0109] Thus, it is possible to display the monitoring image using the image data imaged by the camera 110 mounted on the mobile body 100, and it is possible to display the monitoring image with respect to a wide range of locations. Further, it is possible to configure such that the specification of the specific area as the monitoring area is performed by specifying one of the divided areas of the divided space. Thus, it is possible to make the input of the monitoring area easy, and it is possible to configure the system with high convenience. Further, in this case, it is possible to provide the division of the space by the grid. Thus, it is possible to easily provide the divided area by dividing the entire of the space as the object.

[0110] Further, in the monitoring image output system 10 according to the first embodiment, in the image acquisition process, in a case where there are two or more cameras 110 of which the position data within the time width is included in the monitoring area, the camera 110 of which the moving distance within the time width in the monitoring area is the longest is selected as the image acquisition camera on the basis of the position data. Thus, it is possible to select the camera 110 that images a wider range as the image acquisition camera, and it is possible to display the monitoring image that captures a wide range within the time width.

[0111] 1-5. Modification

[0112] The monitoring video output system 10 according to the first embodiment can also be modified as follows. In the following description, matters overlapping with the above are appropriately omitted.

[0113] 1-5-1. First Modification

[0114] The one or more processors 320 can also be configured to accept processing in which a direction setting that specifies a direction of imaging in the prescribed monitoring area is input. Also, in the image acquisition processing, the one or more processors 320 can also be configured to select the image acquisition camera so that the moving direction of the camera 110 (or the mobile body 100) satisfies the direction setting as a condition in accordance with the position data. Here, input of the direction setting is achieved by operation of the input / output terminal 2. As a form of input of the direction setting, for example, the following can be given: designation of a direction (east direction, west direction, etc.), designation of the orientation of the mobile body 100, and designation of a lane direction (left lane, right lane, etc.) that determines the shape of the road. However, input of the direction setting can also be performed by other forms.

[0115] Figure 8 is a conceptual diagram for explaining selection of the image acquisition camera in the image acquisition processing according to the first modification. In Figure 8 , as in the case shown in Figure 3 , the divided area 3 is designated as the monitoring area, and with respect to the mobile body 100 and the cameras 110, marks (a, b, c) are added to the symbols in order to distinguish them respectively. Also, Figure 8 shows a case in which the left direction in the drawing is designated as the direction setting.

[0116] In Figure 8 , with respect to the camera 110a, the camera 110b, and the camera 110c, the position data within the time width is included in the monitoring area. Also, the moving distance within the time width in the monitoring area is long in the order of the camera 110a, the camera 110c, and the camera 110b. On the other hand, the moving direction of the camera 110a is the right direction in the drawing, and does not satisfy the direction setting. Therefore, in the case shown in Figure 8 , in the image acquisition processing according to the first modification, the camera 110c is selected as the image acquisition camera.

[0117] By modifying in this way, it is possible to display the monitoring video in such a way that a specific direction is captured. Furthermore, it is possible to improve convenience.

[0118] 1-5-2. Second Modification

[0119] The information processing apparatus 300 can also be configured to acquire image data from a plurality of mobile bodies 100. Figure 9 is a conceptual diagram showing an outline of the structure of the monitoring image output system 10 according to the second modification example.

[0120] As shown in Figure 9 , in the monitoring image output system 10 according to the second modification example, the storage apparatus 200 saves and manages the position data, and on the other hand, does not perform management of the image data. In the monitoring image output system 10 according to the second modification example, the management of the image data is performed in each of the plurality of mobile bodies 100.

[0121] The information processing apparatus 300 is connected to the communication network 1, and acquires the position data from the storage apparatus 200 via the communication network 1. Further, the information processing apparatus 300 is configured to make a request for the image data via the communication network 1 with respect to the mobile body that has the image acquisition camera selected in the image acquisition processing, and acquire the image data of the image acquisition camera.

[0122] Figure 10 shows the outline of the mobile body 100 according to the second modification example. In the monitoring image output system 10 according to the second modification example, the image data output from the camera 110 is saved and managed in the storage apparatus 140. Further, the image data is transmitted in accordance with a request from the information processing apparatus 300 via the communication interface 130.

[0123] Even if the monitoring image output system 10 according to the second modification example is employed, the one or more processors 320 can be configured to perform the same processing as the above-described processing. Further, the same effects as the monitoring image output system and the monitoring image output method according to the first embodiment can be exerted.

[0124] 2. Second Embodiment

[0125] Hereinafter, the second embodiment will be described. Further, in the following description, matters repeated with the first embodiment will be appropriately omitted.

[0126] The second embodiment is characterized by the processing of the selection of the image acquisition camera in the image acquisition processing (step S230 shown in Figure 7 ). In the monitoring image output system 10 according to the second embodiment, the one or more processors 320 perform the processing of accepting the input of the specified position that specifies a specific place within the monitoring region in addition to the input of the monitoring region. Figure 11 is a conceptual diagram showing an example of the specification of the specific place. Figure 11 is the same as Figure 2 , in which the divided region 3 is specified as the monitoring region. AsFigure 11 As shown in FIG. 2, a specific place 4 within the monitoring area is designated as the designated position. The form of input regarding the designated position can also be in a form appropriate to the environment in which the monitoring video output system 10 to which the second embodiment is applied is used. For example, the monitoring video output system 10 can be configured to display a road map on the input / output terminal 2 and arbitrarily designate a specific place within the monitoring area, or the monitoring video output system 10 can be configured to select one from a plurality of candidates that provide specific places within the monitoring area.

[0127] Further, in the monitoring video output system 10 to which the second embodiment is applied, in the image acquisition processing, when there are two or more cameras 110 whose position data within the time width is included in the monitoring area, the camera 110 whose time average of the distance within the time width from the designated position is the shortest is selected as the image acquisition camera on the basis of the position data.

[0128] Figure 12 is a conceptual diagram for explaining the selection of the image acquisition camera in the image acquisition processing to which the second embodiment is applied. In Figure 12 , the divided area 3 is designated as the monitoring area, and the specific place 4 is designated as the designated position. In addition, regarding the mobile body 100 and the cameras 110, marks (a, b) are added to the symbols in order to distinguish them.

[0129] In Figure 12 , regarding the camera 110a and the camera 110b, the position data within the time width is included in the monitoring area. On the other hand, regarding the time average of the distance within the time width from the designated position, the camera 110a is shorter than the camera 110b. Therefore, in the case shown in Figure 12 , in the image acquisition processing to which the second embodiment is applied, the camera 110a is selected as the image acquisition camera.

[0130] Thus, in the second embodiment, when there are two or more cameras 110 whose position data within the time width is included in the monitoring area, the camera 110 whose time average of the distance within the time width from the designated position is the shortest is selected as the image acquisition camera on the basis of the position data. Thereby, it is possible to display the monitoring video in which the designated place is taken to the center. Further, other structures and processing of the second embodiment can be the same as those of the first embodiment. In addition, the above first and second modified examples can also be applied to the second embodiment.

Claims

1. A monitoring video output system, characterized by, Possessing: a plurality of cameras mounted on a plurality of mobile bodies respectively different mobile bodies; one or more storage devices; and one or more processors, the one or more storage devices, regarding each of the plurality of cameras, save the imaged image data and position data indicating the position of the camera at each time or the position of the mobile body on which the camera is mounted, the one or more processors configured to perform: processing that accepts as input a monitoring area that designates a specific area; image acquisition processing that, for each predetermined time width, selects, from the plurality of cameras, an image acquisition camera whose position data within the time width is included in the monitoring area, acquires the image data within the time width of the image acquisition camera; and processing that outputs the image data acquired for each time width in chronological order, or generates and outputs an image that combines the image data acquired for each time width in chronological order, in the image acquisition processing, the one or more processors are configured to perform processing that, when there are two or more cameras whose position data within the time width is included in the monitoring area, selects, according to the position data, the camera that has the longest moving distance within the time width in the monitoring area as the image acquisition camera.

2. The monitoring image output system according to claim 1, characterized in that, the one or more processors are configured to further perform processing that accepts as input a direction setting that specifies a direction of imaging within the monitoring area, in the image acquisition processing, the one or more processors further select the image acquisition camera according to the position data, with the condition that the moving direction of the camera or the mobile body satisfies the direction setting.

3. The monitoring image output system according to claim 1 or 2, characterized in that, the specific area is a divided area of a space divided with a grid.

4. A method of monitoring video output, characterized by: including: saving, to one or more storage devices, the imaged image data and position data indicating the position of the camera at each time or the position of the mobile body on which the camera is mounted, regarding each of a plurality of cameras mounted on a plurality of mobile bodies respectively different mobile bodies; accepting as input a monitoring area that designates a specific area; for each predetermined time width, selecting, from the plurality of cameras, an image acquisition camera whose position data within the time width is included in the monitoring area, acquiring the image data within the time width of the image acquisition camera; when there are two or more cameras whose position data within the time width is included in the monitoring area, selecting, according to the position data, the camera that has the longest moving distance within the time width in the monitoring area as the image acquisition camera; and ​ The image data acquired for each of the time widths is output in a time series, or an image in which the image data acquired for each of the time widths is combined in a time series is generated and output.

5. The monitoring image output method according to claim 4, wherein the direction setting that specifies the imaging direction within the monitoring area is further accepted as input, the image-acquiring camera is selected further based on the position data, with the condition that the moving direction of the camera or the moving body satisfies the direction setting.

6. The monitoring image output method according to claim 4 or 5, wherein the specific area is a divided area of a space divided by a grid.

Images