Surveillance video processing device, program, surveillance video processing system, and surveillance video processing method

Abstract

To provide a monitoring video processing device, a program, a monitoring video processing system, and a monitoring video processing method that facilitate visual monitoring of a plurality of monitoring videos.SOLUTION: A monitoring video processing device includes a video acquisition unit that acquires a monitoring video of a road from each of a plurality of imaging devices that capture videos of the road, and a synthesizing unit that transparently superimposes two or more monitoring videos out of the plurality of monitoring video acquired by the video acquisition unit.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a surveillance video processing device, a program, a surveillance video processing system, and a surveillance video processing method. [Background technology]

[0002] In recent years, various mechanisms for detecting abnormalities on roads have been studied to ensure road traffic safety. Generally, road monitoring uses various sensors to detect abnormalities, but because of the significant social impact of accidents and road surface abnormalities, visual confirmation by monitors is also performed in parallel. Visual monitoring uses a system in which multiple image capture devices capture images of the road, transmit the captured images over a network, and display them on a remotely installed monitor. In road monitoring, images from multiple locations are often monitored using a limited number of monitors, so a method is adopted in which multiple images are displayed on the same screen.

[0003] For example, Patent Document 1 discloses a method for monitoring multiple images on the same monitor by switching the image displayed on the screen from images captured by multiple imaging devices, or a method for simultaneously displaying multiple images on a single screen by reducing the display size of each of the multiple images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-345489 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when switching between multiple images to display on the screen, there are times when each image is not displayed, which impairs the real-time nature of monitoring and makes it take time to identify abnormalities.Furthermore, when reducing the display size of each image and displaying it on the same screen, the display size of each image becomes small, making it difficult to check the situation in detail and making it easy to overlook abnormalities.

[0006] Therefore, the present invention has been made in consideration of the above problems, and an object of the present invention is to provide a new and improved surveillance video processing device, program, surveillance video processing system, and surveillance video processing method that facilitates visual monitoring of multiple surveillance videos. [Means for solving the problem]

[0007] In order to solve the above problem, according to one aspect of the present invention, an image acquisition unit acquires monitoring images of a road from each of a plurality of image capture devices that capture images of the road; Complex Of the numerous surveillance footage 2 The present invention is provided with an analysis unit that determines a plurality of groups including the above-mentioned surveillance images, a synthesis unit that creates a superimposed image for each of the plurality of groups by transparently superimposing the two or more surveillance images in the same group, and a display unit that simultaneously displays the superimposed image created for each of the plurality of groups by the synthesis unit, The analysis unit analyzes each of the plurality of surveillance videos acquired by the video acquisition unit as a first process, determines a degree of similarity between the plurality of surveillance videos based on a result of the analysis as a second process, and determines the plurality of groups based on a result of the determination as a third process. A surveillance video processing system is provided.

[0009] As a second process, the analysis unit may determine a degree of similarity between road shapes or structures included in each of the plurality of surveillance videos based on a result of the analysis.

[0010] The synthesizing unit may set the transmittance of each of the two or more monitoring videos to the same value.

[0011] Based on the result of the judgment, the synthesis unit may set the transmittance of each of the two or more surveillance videos, for which the degree of similarity is relatively high among the surveillance videos in the same group, to be higher than that of the surveillance videos in the same group that have a relatively low degree of similarity.

[0012] The synthesizing unit may set an offset of an overlapping position or angle for each of the two or more surveillance videos, and then overlap the two or more surveillance videos.

[0013] The analysis unit may sequentially perform the first process, the second process, and the third process again when a predetermined time has elapsed since the most recent group determination.

[0014] The image acquisition unit may acquire a surveillance image of the road from a storage unit or an external storage device.

[0015] In order to solve the above-mentioned problems, according to another aspect of the present invention, a computer includes an image acquisition unit that acquires surveillance images of a road from each of a plurality of imaging devices that capture images of the road, an analysis unit that determines a plurality of groups each including two or more surveillance images from the plurality of surveillance images, and a superimposed image generation unit that generates a superimposed image by transparently superimposing the two or more surveillance images in the same group for each of the plurality of groups. And before The superimposed images created for each of the plurality of groups are simultaneously a display screen generation unit for displaying the image on the display unit; In the program, the analysis unit functions as follows: as a first process, analyzes each of the plurality of surveillance videos acquired by the video acquisition unit; as a second process, determines the degree of similarity between the plurality of surveillance videos based on the results of the analysis; and as a third process, determines the plurality of groups based on the results of the determination.

[0016] In order to solve the above-mentioned problems, according to another aspect of the present invention, there is provided a road monitoring system including: an image acquisition unit that acquires monitoring images of a road from each of a plurality of image capture devices that capture images of the road; ComplexOf the numerous surveillance footage 2 The present invention includes an analysis unit that determines a plurality of groups including the above-mentioned surveillance images, a synthesis unit that creates a superimposed image for each of the plurality of groups by transparently superimposing the two or more surveillance images in the same group, and a display unit that simultaneously displays the superimposed image created for each of the plurality of groups by the synthesis unit, The analysis unit analyzes each of the plurality of surveillance videos acquired by the video acquisition unit as a first process, determines a degree of similarity between the plurality of surveillance videos based on a result of the analysis as a second process, and determines the plurality of groups based on a result of the determination as a third process. A surveillance video processing system is provided.

[0017] Further, in order to solve the above-mentioned problems, according to another aspect of the present invention, a method for obtaining a monitoring image of a road from each of a plurality of imaging devices that captures an image of the road, determining a plurality of groups each including two or more monitoring images from the plurality of monitoring images, and creating a superimposed image for each of the plurality of groups by transparently superimposing the two or more monitoring images in the same group, and simultaneously displaying the superimposed image created for each of the plurality of groups. Display on the display and determining the groups includes, as a first process, analyzing each of the plurality of surveillance videos, as a second process, determining a degree of similarity between the plurality of surveillance videos based on a result of the analysis, and as a third process, determining the plurality of groups based on a result of the determination. [Effects of the Invention]

[0018] According to the present invention as described above, it is possible to easily visually monitor a plurality of surveillance images. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is an explanatory diagram illustrating an example of a surveillance video processing system according to an embodiment of the present invention; [Figure 2] 1 is an explanatory diagram illustrating an example of the functional configuration of a surveillance video processing device 10 according to an embodiment of the present invention. [Figure 3]FIG. 2 is an explanatory diagram illustrating an example of a screen displayed on a display unit 160 according to an embodiment of the present invention. [Figure 4] 4 is a flowchart showing the operation of the surveillance video processing device 10. [Figure 5] 1 is a block diagram showing a hardware configuration of a surveillance video processing device 10 according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0020] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant explanations will be omitted.

[0021] Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different letters after the same reference numeral. For example, multiple components having substantially the same functional configuration or logical significance may be distinguished as necessary, such as surveillance video display areas 50A and 50B. However, if there is no need to particularly distinguish between multiple components having substantially the same functional configuration, only the same reference numeral is used for each of the multiple components. For example, if there is no need to particularly distinguish between surveillance video display areas 50A and 50B, each surveillance video display area will simply be referred to as surveillance video display area 50.

[0022] <1. Overview of the surveillance video processing system> An embodiment of the present invention relates to a surveillance video processing system that captures images of a road using multiple imaging devices installed in remote locations, analyzes the captured surveillance images, and synthesizes the analyzed surveillance images to create a superimposed image for visual surveillance. This surveillance video processing system is applicable, for example, to monitoring road conditions such as those on expressways or in tunnels for abnormalities. The configuration of a surveillance video processing system according to one embodiment of the present invention will be described below with reference to FIG. 1.

[0023] 1 is an explanatory diagram showing the configuration of a surveillance video processing system according to an embodiment of the present invention. As shown in FIG. 1, the surveillance video processing system according to an embodiment of the present invention includes a surveillance video processing device 10 and a plurality of imaging devices 20.

[0024] Multiple imaging devices 20 are installed in remote locations to be monitored. In the example shown in Fig. 1, multiple imaging devices 20 are installed at intervals inside a tunnel 30, and each imaging device 20 captures images of the road conditions inside the tunnel. Each imaging device 20 transmits the captured surveillance video to a surveillance video processing device 10 via a network 1.

[0025] The surveillance video processing device 10 is an information processing terminal that receives surveillance videos transmitted from a plurality of imaging devices 20, analyzes and synthesizes the received surveillance videos, and creates a superimposed video for visual surveillance.

[0026] As shown in FIG. 1, a surveillance video processing device 10 and a plurality of imaging devices 20 are configured to be able to communicate with each other via a network 1.

[0027] (Identifying issues) When monitoring surveillance images received from multiple imaging devices visually, one possible method is to display multiple surveillance images on a monitoring screen. For example, multiple surveillance images can be monitored on the same screen by switching the surveillance images displayed on the screen at regular intervals or by switching the displayed surveillance images in response to a monitor's operation. Alternatively, one possible method is to simultaneously display multiple surveillance images by reducing the display size of each surveillance image and dividing the display screen.

[0028] However, when switching between surveillance images displayed on a screen, there are times when each surveillance image is not displayed on the screen, which can delay the detection of an abnormality through visual monitoring. Also, when reducing the display size of each surveillance image, the display size of each image becomes small, making it difficult to check the details of the situation, and making it easy to overlook an abnormality.

[0029] The inventors of the present invention have devised an embodiment of the present invention with the above-mentioned circumstances in mind. According to the embodiment of the present invention, it is possible to easily visually monitor multiple surveillance videos. The configuration and operation of a surveillance video processing device 10 according to the embodiment of the present invention will be described in detail below.

[0030] 2. Configuration of a surveillance video processing device according to one embodiment of the present invention 2 is an explanatory diagram showing an example of the functional configuration of a surveillance video processing device 10 according to an embodiment of the present invention. As shown in FIG. 2, the surveillance video processing device 10 according to this embodiment has a video acquisition unit 120, an analysis unit 130, a display screen generation unit 140, a storage unit 150, a display unit 160, and an operation unit 170.

[0031] (Video acquisition section) The video acquisition unit 120 acquires monitoring video. For example, the video acquisition unit 120 receives monitoring video transmitted from a plurality of image capture devices 20 via the network 1.

[0032] (Analysis Department) As a first process, the analysis unit 130 analyzes the surveillance videos to distinguish between surveillance videos that contain similar road shapes or compositions, and as a second process, calculates the degree of similarity between each surveillance video. The analysis unit 130 calculates the degree of similarity between each surveillance video based on the degree of similarity between background images created from each surveillance video.

[0033] More specifically, in a first process, the analysis unit 130 uses an average background method, which is a background model generation method, to create a background image from the multiple surveillance videos, removing moving objects such as vehicles. Furthermore, in a second process, the analysis unit 130 calculates the degree of similarity between the background images. In this case, the analysis unit 130 may particularly calculate the degree of similarity between road shapes or structures included in the background images. The degree of similarity may be calculated by calculating the distribution of brightness histograms, edge amounts, or distances between feature points, and multiplying each value by a predetermined coefficient. Alternatively, the calculation method may use machine learning or deep learning to calculate the degree of similarity between the background images.

[0034] Furthermore, the analysis unit 130 calculates the degree of similarity between each surveillance video based on the degree of similarity between the background images, and then, as a third process, determines groups for each of the two or more surveillance videos so that two or more surveillance videos with a high degree of similarity are grouped together. For example, the analysis unit 130 uses a cluster analysis method to group the surveillance videos with a high degree of similarity together. The cluster analysis method may be the K-means method or another method. In this case, the number of groups may be set in advance according to the screen configuration displayed on the display unit 160. Alternatively, the number of groups may be dynamically determined according to the calculation result of the degree of similarity.

[0035] (Display screen generator) The display screen generation unit 140 generates a monitoring screen and displays the monitoring screen on the display unit 160. As shown in FIG. 2, the display screen generation unit 140 functions as a synthesis unit 141. The synthesis unit 141 creates a superimposed image in which two or more monitoring images are synthesized. The monitoring screen includes the superimposed image created by the synthesis unit 141. However, the image included in the monitoring screen may be switched between the superimposed image and the monitoring image before superimposition acquired from the image acquisition unit 120 based on an operation by a monitor.

[0036] Here, the function of the composition unit 141 will be described in more detail. The composition unit 141 acquires multiple surveillance videos from the video acquisition unit 120, and creates a superimposed video by transparently superimposing two or more of the acquired surveillance videos. When creating the superimposed video, the composition unit 141 creates a superimposed video of two or more surveillance videos for each group in accordance with the groups determined by the analysis unit 130.

[0037] When performing the above-mentioned transparency process, the synthesis unit 141 sets the transparency of each surveillance video to an equal value. Alternatively, if there are multiple surveillance videos that are particularly similar among the two or more surveillance videos classified into the same group by the above-mentioned group determination, the synthesis unit 141 may set the transparency of the multiple surveillance videos to a relatively high value to improve visibility on the superimposed video.

[0038] Generally, surveillance footage used to monitor road conditions often contains similar road shapes or compositions. In particular, surveillance footage from inside tunnels often contains similar compositions due to limitations on the installation location or height of the imaging device. When images with similar road shapes or compositions are superimposed, the normal movements in the images are similar. If an abnormality occurs on one of the monitored roads, the movement in the surveillance footage at the location of the abnormality is significantly different from the movement in the other surveillance footage, allowing a monitor to easily recognize the abnormality even from a video in which multiple surveillance footage are superimposed. Therefore, the synthesis unit 141 creates a superimposed video of surveillance footage with a high degree of similarity based on the group determined by the analysis unit 130, enabling monitoring by consolidating a large number of surveillance footage into a smaller number of videos than the number of surveillance footage before superimposition.

[0039] (Storage part) The storage unit 150 stores information used in the operation of the surveillance video processing device 10. For example, the storage unit 150 stores pre-set layout information for screen display, which is referenced when the display screen generation unit 140 generates a surveillance screen.

[0040] (Display) The display unit 160 displays various screens under the control of the display screen generation unit 140. For example, the display unit 160 displays a monitoring screen generated by the display screen generation unit 140.

[0041] 3 is an explanatory diagram showing an example of a monitoring screen displayed on display unit 160. As shown in FIG. 3, the monitoring screen includes a monitoring video display area 50, group information 51, and an imaging device position map 53. In monitoring video display area 50, a superimposed video created by composition unit 141 or a monitoring video before superimposition is displayed. In the example shown in FIG. 3, each of monitoring video display areas 50A to 50C displays a superimposed video of monitoring videos belonging to different groups.

[0042] The group information 51 is information indicating to which group the superimposed video arranged in the corresponding monitoring video display area 50 belongs. In the example shown in Fig. 3, the group information 51 is an icon resembling an imaging device, and the color of the icon indicates the group.

[0043] The imaging device position map 53 indicates where each of the multiple imaging devices 20 is located on the road to be monitored and to which group the imaging device 20 corresponds. In the example shown in Fig. 3, the imaging device position map 53 is composed of two stages, with the upper stage having multiple imaging device icons U1 to U11 corresponding to the multiple imaging devices 20 that capture images of roads in the uphill direction, and the lower stage having multiple imaging device icons D1 to D11 corresponding to the multiple imaging devices 20 that capture images of roads in the downhill direction. The position of each imaging device icon is set based on the actual installation position of the imaging device.

[0044] Furthermore, each imaging device icon is given a color that indicates to which group the surveillance video captured by the corresponding imaging device 20 belongs. In the example shown in Fig. 3, imaging device icons U1 to U3, U9, U10, D2, D3, D7, D9, and D10 are given the same color as the icons in group information 51A. Therefore, it can be seen that the surveillance video display area 50A corresponding to group information 51A displays superimposed videos of surveillance videos captured by the imaging devices 20 corresponding to imaging device icons U1 to U3, U9, U10, D2, D3, D7, D9, and D10.

[0045] Similarly, the imaging device icons U4 to U6, D8, and D11 are colored the same as the icons in the group information 51B. Therefore, it can be seen that the monitoring video display area 50B corresponding to the group information 51B displays superimposed images of the monitoring videos captured by the imaging devices 20 corresponding to the imaging device icons U4 to U6, D8, and D11. Furthermore, the imaging device icons U7, U8, U11, D1, D4 to D6 are colored the same as the icons in the group information 51C. Therefore, it can be seen that the monitoring video display area 50C corresponding to the group information 51C displays superimposed images of the monitoring videos captured by the imaging devices 20 corresponding to the imaging device icons U7, U8, U11, D1, D4 to D6.

[0046] Furthermore, the monitor may operate the operation unit 170 to specify one of the imaging devices 20, and the display unit 160 may display the surveillance video captured by that imaging device 20, instead of the superimposed video. The specification may be made by selecting, from the imaging device icons 52, an imaging device icon 52 corresponding to the imaging device 20 for which the monitor wishes to display the surveillance video.

[0047] (Operation unit) The operation unit 170 is configured to be operated by a monitor or an operator of the surveillance video processing device 10 to input instructions or information to the surveillance video processing device 10. For example, if an abnormality is found in the superimposed video displayed on the display unit 160, the operator may operate the operation unit 170 to switch the displayed surveillance video in order to identify the location where the abnormality occurred.

[0048] The above-mentioned identification method may use, for example, the concept of a binary search algorithm, or other methods. As an example of using the concept of a binary search algorithm, a method can be considered in which a monitor repeatedly selects an image in which an abnormality is found from superimposed images displayed on a screen, thereby identifying the surveillance image of the point where an abnormality has occurred.

[0049] Specifically, when a monitor finds an abnormality in the superimposed video displayed in the monitoring video display area 50A, the monitor operates the operation unit 170 to select the monitoring video display area 50A. The display screen generation unit 140 divides two or more monitoring videos included in the superimposed video displayed in the selected monitoring video display area 50A into two groups. The synthesis unit 141 then creates a superimposed video of the monitoring videos belonging to each group. The display screen generation unit 140 displays the two created superimposed videos on the screen of the display unit 160. The monitoring video processing device 10 repeats this process of dividing the groups based on the monitor's selection of the superimposed video and creating the superimposed video until only one monitoring video belongs to each group, thereby enabling the monitoring video of the location where the abnormality is occurring to be quickly identified.

[0050] <3.Operation> The configuration of the surveillance video processing device 10 according to one embodiment of the present invention has been described above. Next, the operation of the surveillance video processing device 10 according to one embodiment of the present invention will be summarized with reference to FIG.

[0051] 4 is a flowchart showing the operation of the surveillance video processing device 10. First, the video acquisition unit 120 receives surveillance videos transmitted from the multiple image capture devices 20 via the network 1 (S410).

[0052] The analysis unit 130 creates a background image for each of the plurality of monitoring videos acquired by the video acquisition unit 120 (S420).

[0053] Next, the analysis unit 130 calculates the degree of similarity between the created background images (S430).

[0054] Furthermore, the analysis unit 130 determines groups of each surveillance video, each group including two or more surveillance videos, based on the calculated degree of similarity between the background images of each surveillance video (S440).

[0055] The synthesis unit 141 performs transparency processing on each of the multiple monitoring videos acquired by the video acquisition unit 120 (S450).

[0056] The composition unit 141 creates a superimposed image by superimposing the plurality of monitoring images that have been subjected to transparency processing for each of the determined groups (S460). The display screen generation unit 140 updates the superimposed image included on the monitoring screen displayed on the display unit 160 to the content of the superimposed image created by the composition unit 141 in S460 (S470).

[0057] The surveillance video processing device 10 ends surveillance video processing when the surveillance person operates the operation unit 170 to issue an instruction to end the processing (S480 / Yes). Alternatively, the processing may be set to end at a preset time. If there is no instruction to end the processing, the surveillance video processing device 10 continues surveillance video processing (S480 / No).

[0058] The display screen generating unit 140 determines whether a predetermined time has elapsed since the most recent group determination was performed by the analyzing unit 130. If the result of the determination is that the predetermined time has elapsed, the surveillance video processing device 10 again sequentially performs the processes of S410 to S480 (S490 / Yes).

[0059] If the display screen generation unit 140 determines that the predetermined time has not yet elapsed (S490 / No), the image acquisition unit 120 acquires the surveillance image (S500), and the surveillance image processing device 10 sequentially repeats the processes of S450 to S480 again. In this manner, the analysis unit 130 creates a background image, calculates the degree of similarity, and determines the group at predetermined intervals, thereby periodically updating the group. By periodically updating the group, the visibility of the superimposed image can be maintained without degradation even when changes occur on the monitored road, such as changes in sunlight conditions or the installation of road construction vehicles or signs.

[0060] <4. Action and Effects> According to the embodiment of the present invention described above, a variety of operational effects can be obtained. For example, according to the embodiment of the present invention, the synthesis unit 141 performs transparency processing on each of the multiple surveillance videos acquired by the video acquisition unit 120, and then overlays the videos to create a superimposed video. This processing makes it possible to consolidate multiple surveillance videos into a smaller number of videos than the surveillance videos before overlay. When the multiple surveillance videos are displayed on the same screen, the use of the superimposed video reduces the degree to which the display size of each surveillance video is reduced. Therefore, it becomes easier for a surveillance officer visually monitoring multiple surveillance videos on the same screen to check the details that occur in the surveillance videos.

[0061] Furthermore, according to one embodiment of the present invention, the synthesis unit 141 creates a superimposed image of two or more surveillance videos for each group determined by the analysis unit 130 so that two or more surveillance videos with a high degree of similarity are grouped together. Surveillance videos with a high degree of similarity tend to show similar movements under normal circumstances. Therefore, it becomes easier for a surveillance officer to recognize that an abnormality has occurred, even from the superimposed image.

[0062] <5. Hardware Configuration> The above describes one embodiment of the present invention. The above-described information processing, such as analysis and composition of surveillance video, is realized by cooperation between software and the hardware of the surveillance video processing device 10, which will be described below.

[0063] 5 is a block diagram showing the hardware configuration of the surveillance video processing device 10 according to this embodiment. The surveillance video processing device 10 may include a CPU (Central Processing Unit) 102, a ROM (Read Only Memory) 104, a RAM (Random Access Memory) 106, an internal bus 108, an input / output interface 110, a display device 112, an input device 113, an audio output unit 114, a storage device 115, a drive 116, a network interface 117, and an external interface 118.

[0064] The CPU 102 functions as an arithmetic processing unit and a control unit, and controls the overall operation of the surveillance video processing device 10 in accordance with various programs. The CPU 102 cooperates with the ROM 104, RAM 106, and software described below to realize functions such as the video acquisition unit 120, the analysis unit 130, and the display screen generation unit 140.

[0065] The ROM 104 stores programs and calculation parameters used by the CPU 102. The RAM 106 temporarily stores programs used in the execution of the CPU 102, and parameters that change as appropriate during the execution of the programs.

[0066] The CPU 102, ROM 104, and RAM 106 are interconnected by an internal bus 108, and are further connected via an input / output interface 110 to a display device 112, an input device 113, an audio output unit 114, a storage device 115, a drive 116, a network interface 117, and an external interface 118, which will be described later.

[0067] The display device 112 is, for example, a display device such as a CRT display device, a liquid crystal display (LCD), or an OLED device, and converts video data into video and outputs it. The input device 113 may be composed of a mouse, a keyboard, a touch panel, buttons, a microphone, a sensor, a switch, a control circuit, etc. The audio output unit 114 is an audio output device such as a speaker or headphones, and converts audio data and the like into audio and outputs it.

[0068] The storage device 115 is a data storage device configured as an example of the storage unit 150 according to this embodiment. The storage device 115 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, and a deleting device that deletes data recorded on the storage medium. The storage device 115 is configured, for example, by an HDD (Hard Disk Drive) or an SSD (Solid Storage Drive), or a memory having equivalent functions. The storage device 115 drives storage and stores programs executed by the CPU 102 or various data.

[0069] The drive 116 is a reader / writer for a storage medium, and is either built into the surveillance video processing device 10 or attached externally. The drive 116 reads information stored on a removable storage medium, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 106. The drive 116 is also capable of writing information to the removable storage medium.

[0070] The network interface 117 is a communication interface configured with devices for connecting to a communication network such as the Internet, etc. The network interface 117 may be a communication device compatible with a wired LAN (Local Area Network) or a wireless LAN, or may be a wired communication device that performs wired communication.

[0071] The external interface 118 is a connection interface consisting of connection ports for connecting external devices, such as a USB (Universal Serial Bus) port, an IEEE1394 port, a SCSI (Small Computer System Interface) port, an RS-232C port, or an optical audio terminal.

[0072] <6. Supplementary Information> Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

[0073] For example, in the above embodiment, an example was described in which the video acquisition unit 120 acquires surveillance video from multiple imaging devices 20 via the network 1, but the video acquisition unit 120 may acquire surveillance video that has been stored in advance in the memory unit 150, or may read the surveillance video from an external storage device.

[0074] In the above embodiment, the analysis unit 130 determines two or more groups of surveillance footage, but the present invention is not limited to such an example. For example, a surveillance officer may visually determine surveillance locations with similar road shapes or compositions in advance, and group the locations based on that determination. The synthesis unit 141 may create a superimposed video based on the grouping results. If the grouping is performed in advance, the results of the grouping may be stored in the storage unit 150, the display screen generation unit 140 may read the results from the storage unit 150, and the synthesis unit 141 may create a superimposed video based on the results. Furthermore, the analysis unit 130 may calculate the similarities between multiple surveillance footage and store the grouping results in the storage unit 150. The display screen generation unit 140 may read the results from the storage unit 150, and the synthesis unit 141 may create a superimposed video based on the results.

[0075] In the above embodiment, the combining unit 141 creates a superimposed image by simply superimposing each of the multiple surveillance videos and making each of the surveillance videos transparent, but the present invention is not limited to such an example. For example, when creating a superimposed image, a process may be performed in which an offset of the superimposition position or angle is set in the surveillance videos, and similar road shapes or compositions included in each of the surveillance videos are aligned so as to overlap.

[0076] Furthermore, the steps in the processing of the operation of the surveillance video processing device 10 according to this embodiment do not necessarily have to be processed in chronological order according to the order shown in the explanatory diagrams. For example, the steps in the processing of the operation of the surveillance video processing device 10 may be processed in an order different from the order shown in the explanatory diagrams, or may be processed in parallel.

[0077] It is also possible to create a computer program that causes the hardware, such as the CPU, ROM, and RAM, built into the surveillance video processing device 10 to perform functions equivalent to those of the components of the surveillance video processing device 10 described above.

[0078] Furthermore, the surveillance video processing device 10 according to this embodiment may be provided as a surveillance video processing system including a plurality of information processing devices. For example, the above-described analysis unit 130 and display screen generation unit 140 may be provided separately in a plurality of information processing devices. [Industrial Applicability]

[0079] The present invention is applicable to road traffic where road conditions are monitored using a plurality of imaging devices installed in remote locations, and is particularly applicable to visual monitoring of road surface abnormalities in tunnels. [Explanation of symbols]

[0080] 10 Surveillance image processing device 20 Imaging device 120 Video acquisition unit 130 Analysis Department 140 Display screen generation section 141 Synthesis Department 150 Memory Department 160 Display unit 170 Operation Department

Claims

1. an image acquisition unit that acquires monitoring images of the road from each of a plurality of imaging devices that capture images of the road; an analysis unit that determines a plurality of groups each including two or more surveillance videos from the plurality of surveillance videos; a synthesis unit that creates a superimposed image by transparently superimposing the two or more surveillance images in the same group for each of the plurality of groups; a display unit that simultaneously displays the superimposed images created for each of the plurality of groups by the synthesis unit, The analysis unit As a first process, each of the plurality of surveillance videos acquired by the video acquisition unit is analyzed; As a second process, a degree of similarity between the plurality of surveillance videos is determined based on the results of the analysis; As a third process, the surveillance video processing device determines the plurality of groups based on the result of the determination.

2. The analysis unit As a second process, based on the results of the analysis, a degree of similarity between road shapes or structures included in each of the plurality of surveillance videos is determined. The surveillance video processing device according to claim 1 .

3. the combining unit sets the transmittance of each of the two or more monitoring videos to an equal value.

3. The surveillance video processing device according to claim 1 or 2.

4. Based on the result of the determination, the synthesis unit sets a higher transmittance for a surveillance video having a relatively high degree of similarity among the two or more surveillance videos in the same group than for a surveillance video having a relatively low degree of similarity among the surveillance videos in the same group.

3. The surveillance video processing device according to claim 1 or 2.

5. the combining unit sets an offset of a superposition position or an angle for each of the two or more surveillance videos, and superimposes the two or more surveillance videos; The surveillance video processing device according to any one of claims 1 to 4.

6. the analysis unit sequentially performs the first process, the second process, and the third process again when a predetermined time has elapsed since the most recent group determination. The surveillance video processing device according to any one of claims 1 to 5.

7. 7. The surveillance video processing device according to claim 1, wherein said video acquisition unit acquires the surveillance video of the road from a storage unit or an external storage device.

8. Computer, an image acquisition unit that acquires monitoring images of the road from each of a plurality of imaging devices that capture images of the road; an analysis unit that determines a plurality of groups each including two or more surveillance videos from the plurality of surveillance videos; a display screen generation unit that creates a superimposed image for each of the plurality of groups by transparently superimposing the two or more monitoring images within the same group, and simultaneously displays the superimposed images created for each of the plurality of groups on a display unit; It functions as The analysis unit As a first process, each of the plurality of surveillance videos acquired by the video acquisition unit is analyzed; As a second process, a degree of similarity between the plurality of surveillance videos is determined based on the results of the analysis; As a third process, the program determines the plurality of groups based on a result of the determination.

9. an image acquisition unit that acquires monitoring images of the road from each of a plurality of imaging devices that capture images of the road; an analysis unit that determines a plurality of groups each including two or more surveillance videos from the plurality of surveillance videos; a synthesis unit that creates a superimposed image by transparently superimposing the two or more surveillance images in the same group for each of the plurality of groups; a display unit that simultaneously displays the superimposed images created for each of the plurality of groups by the synthesis unit, The analysis unit As a first process, each of the plurality of surveillance videos acquired by the video acquisition unit is analyzed; As a second process, a degree of similarity between the plurality of surveillance videos is determined based on the results of the analysis; As a third process, the surveillance video processing system determines the plurality of groups based on the result of the determination.

10. acquiring a monitoring image of the road from each of a plurality of imaging devices that capture images of the road; determining a plurality of groups including two or more surveillance videos of the plurality of surveillance videos; For each of the plurality of groups, creating a superimposed image by transparently superimposing the two or more surveillance images in the same group; simultaneously displaying the superimposed images created for each of the plurality of groups on a display unit; Including, determining the group As a first process, each of the plurality of surveillance videos is analyzed; As a second process, a degree of similarity between the plurality of surveillance videos is determined based on the results of the analysis; A computer-implemented surveillance video processing method including, as a third process, determining the plurality of groups based on a result of the determination.

Images