Instruction information output device, instruction information output method, and instruction information output program

Abstract

To enable a single construction worker to adjust the imaging direction of each surveillance camera with neither time nor effort even when a plurality of surveillance cameras (imaging devices) are installed.SOLUTION: A maximum imaging range identifying unit 312 identifies a maximum imaging range of each imaging device. A connection portion identifying unit 314 identifies a connection portion from a captured image from an imaging device which has been subjected to imaging direction adjustment, and a maximum imaging range of a target imaging device. A positional relationship identifying unit 316 identifies a positional relationship for a captured image of the target imaging device to configure the connection portion identified by the connection portion identifying unit 314 from the captured image of the target imaging device and the maximum imaging range of the target imaging device. A command information forming unit 317 creates command information based on the positional relationship identified by the positional relationship identifying unit 316, and a command information output unit 318 outputs the command information.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an apparatus, method, and program for outputting instruction information for adjusting the imaging directions (orientations of the imaging devices) of a plurality of imaging devices, for example, surveillance cameras that capture images of a continuous surveillance area. [Background technology]

[0002] When installing a surveillance camera, the imaging direction (direction of the surveillance camera) is adjusted so that an image containing an object to be monitored is output, and an image of the desired imaging range is captured. In general, the imaging direction is adjusted by two people: one person who instructs the direction of moving the surveillance camera while visually checking the image captured by the surveillance camera, and another person who changes the direction of the surveillance camera. For this reason, there has been a demand for a system that allows one construction worker to adjust the imaging direction. In order to meet such demands, Patent Document 1 described later discloses an invention relating to an information output device and the like.

[0003] The invention disclosed in Patent Document 1, simply put, provides an image captured by a surveillance camera to an information output device, and also specifies a target part that should be the center of the captured image via a mobile terminal. The information output device forms sound information that instructs the surveillance camera to orient itself so that the specified target part is positioned at the center of the image captured by the surveillance camera, and provides the sound information to the mobile terminal. This allows a single construction worker to adjust the imaging direction of the surveillance camera by relying on the sound information emitted from the mobile terminal he or she owns. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6819403 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when the monitoring area is wide, for example, for the purpose of tracking a target, it is necessary to install multiple monitoring cameras. Even in such a case, it is possible to adjust the imaging range by specifying the center position for each monitoring camera using the invention disclosed in Patent Document 1. However, since each monitoring camera functions independently and the captured images are not linked between the monitoring cameras, blind spots may occur or the images captured by adjacent monitoring cameras may overlap significantly.

[0006] For this reason, the imaging range of the first surveillance camera can be adjusted using the invention disclosed in Patent Document 1, but the imaging range of the second and subsequent surveillance cameras must be adjusted while actually checking the captured images. In this case, the imaging range of the second and subsequent surveillance cameras must be adjusted by two construction workers as in the past. Also, the imaging range must be adjusted based on the intuition of the construction workers, which may be time-consuming and laborious.

[0007] In view of the above, an object of the present invention is to enable a single construction worker to adjust the imaging direction of each surveillance camera without time or effort, even when installing multiple surveillance cameras (imaging devices). [Means for solving the problem]

[0008] In order to solve the above problem, the instruction information output device of the invention described in claim 1 comprises: An instruction information output device that outputs instruction information for adjusting imaging directions of a plurality of imaging devices that are installed so as to image different parts of a continuous monitoring area, a first image acquisition means for acquiring captured images from each of the plurality of image capture devices when the image capture direction is changed up to a maximum angle adjustable for each of a plurality of predetermined directions; a maximum imaging range specifying means for specifying a maximum imaging range for each of the plurality of imaging devices based on captured images acquired from the plurality of imaging devices through the first image acquisition means; A second image acquisition means for acquiring a captured image from one of the plurality of imaging devices; a connection portion specifying means for specifying a connection portion of an image captured by the first imaging device within the maximum imaging range of the other imaging device, based on the captured image acquired through the second image acquisition means and the maximum imaging range of the other imaging device adjacent to the first imaging device; a third image acquisition means for acquiring a captured image from the other imaging device; a positional relationship specifying means for specifying a positional relationship of the captured image from the other imaging device for forming the connection portion specified by the connection portion specifying means, based on the captured image acquired through the third image acquisition means and the maximum imaging range of the other imaging device; an instruction information generating means for generating instruction information for adjusting an imaging direction of the other imaging device based on the positional relationship specified by the positional relationship specifying means; an instruction information output means for outputting the instruction information formed by the instruction information forming means; The present invention is characterized by comprising:

[0009] According to the instruction information output device of the invention described in claim 1, the first image acquisition means and the maximum imaging range specification means function to specify the maximum imaging range of each imaging device. The second image acquisition means and the connection part specification means function to specify a connection part from an image captured by one imaging device and the maximum imaging range of an imaging device adjacent to the one imaging device. Next, the third image acquisition means and the positional relationship specification means function. In this case, a positional relationship between the image captured by the adjacent imaging device for forming the connection part specified by the connection part specification means is specified from the image captured by the adjacent imaging device and the maximum imaging range of the adjacent imaging device. Based on the positional relationship specified by the positional relationship specification means, instruction information is formed by the instruction information formation means, and this is output by the instruction information output means. Effect of the Invention

[0010] According to the present invention, even when a plurality of imaging devices are installed, a single worker can adjust the imaging direction of each imaging device without taking time or effort. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram for explaining a configuration example of an instruction information output system according to an embodiment; [Diagram 2] 1 is a diagram for explaining an example of a monitoring area in which a plurality of imaging devices (monitoring cameras) are installed, and an example of an imaging range imaged by the imaging devices. [Diagram 3] 1 is a block diagram illustrating an example of a configuration of an imaging device according to an embodiment. [Figure 4] 1 is a block diagram illustrating a configuration example of a portable communication terminal according to an embodiment. [Diagram 5] 1 is a block diagram illustrating a configuration example of an instruction information output device according to an embodiment. [Figure 6] FIG. 2 is a diagram for explaining a maximum imaging range of the imaging device. [Figure 7] 11A and 11B are diagrams for explaining how to specify the maximum imaging range and how to adjust the imaging direction. [Figure 8] 8 is a diagram for explaining how to adjust the imaging direction following FIG. 7. FIG. [Figure 9] 1A and 1B are diagrams for explaining an example of a monitoring area in which a plurality of imaging devices (monitoring cameras) are installed, and an example of an imaging range captured by the imaging devices after adjusting the imaging direction. [Figure 10] FIG. 11 is a sequence diagram for explaining advance preparations for adjusting the imaging direction of the imaging device. [Figure 11] 11 is a sequence diagram for explaining a process for adjusting the imaging direction of the imaging device. FIG. [Figure 12] 10 is a flowchart illustrating a process performed by the instruction information output device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the device, method, and program according to the present invention will be described with reference to the drawings. In the embodiment described below, an example will be described in which three imaging devices are installed to monitor a continuous monitoring area (monitoring region) that covers a relatively wide range. Note that the number of imaging devices installed is just an example, and the device, method, and program of the present invention can be used when two or more imaging devices are installed.

[0013] [Example of configuration of instruction information output system] Fig. 1 is a diagram for explaining a configuration example of an instruction information output system according to an embodiment. Fig. 2 is a diagram for explaining an example of a monitoring area in which a plurality of imaging devices (monitoring cameras) are installed, and an example of an imaging range imaged by the imaging devices. As shown in Fig. 1, in the instruction information output system according to this embodiment, three imaging devices 1(1), 1(2), and 1(3) are installed in a monitoring area (monitoring region) Ar. As shown in Fig. 2(A), the monitoring area Ar is a continuous region covering a relatively wide range, and the monitoring area Ar is imaged and monitored by the imaging devices 1(1), 1(2), and 1(3).

[0014] The monitoring area Ar may be indoors or outdoors. When the monitoring area is indoors, the imaging devices 1(1), 1(2), and 1(3) are attached to the interior walls or ceilings of a building using dedicated mounting fixtures, and when the monitoring area is outdoors, they are attached to the exterior walls of a building or to poles installed outdoors using dedicated mounting fixtures. In this case, the imaging directions (orientations of the imaging devices) of the attached imaging devices 1(1), 1(2), and 1(3) can be manually adjusted slightly up, down, left, and right.

[0015] The mobile communication terminal 2 is a smartphone or a tablet PC (Personal Computer) carried by a construction worker who installs the imaging devices 1(1), 1(2), and 1(3) in the monitoring area. The server device 3 realizes the function of an instruction information output device. In FIG. 1, the base station BS5(1) corresponds to a base station of a mobile phone network or an access point of a LAN (Local Area Network). The network 4 may be a wide area network or a local network.

[0016] In the case of a wide area network, the network 4 is mainly the Internet, but also includes connection paths such as a telephone network, a mobile phone network, and a LAN that are paths through which the imaging devices 1(1), 1(2), and 1(3), the mobile communication terminal 2, and the server device 3 are connected to the Internet. In the case of a local network, the network 4 is a LAN or a short-range communication network that enables mutual communication in accordance with a short-range wireless communication standard such as the Bluetooth (registered trademark) standard.

[0017] Fig. 2(B) is a diagram showing the imaging ranges of the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) when the monitoring area Ar is viewed from above (from the top side indicated by the arrow Up) in Fig. 2(A). Also, Fig. 2(C) is a diagram showing the imaging ranges of the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) when the monitoring area Ar is viewed from the side (from the front side indicated by the arrow Fr, i.e., from the side facing the imaging devices).

[0018] The size of the monitoring area, the zoom performance and the angle of view of the imaging devices used as the monitoring cameras, etc. are known in advance. Therefore, it is possible to know in advance how many imaging devices are required and how far apart the imaging devices should be installed depending on the size of the monitoring area. In this embodiment, it is assumed that three imaging devices 1(1), 1(2), and 1(3) are required to monitor the entire monitoring area Ar, and it is known that the maximum distance between each imaging device is X meters.

[0019] In this case, imaging devices 1(1), 1(2), and 1(3) are installed in the monitoring area Ar so that the distance between each imaging device is within X meters at most, but it is difficult to appropriately determine the imaging direction. In this case, consider a case where the imaging direction of each of the imaging devices 1(1), 1(2), and 1(3) is adjusted using the technology disclosed in the above-mentioned Patent Document 1.

[0020] Each of the imaging devices 1(1), 1(2), and 1(3) functions independently, and the captured images are not linked between the surveillance cameras. For this reason, as shown in Fig. 2(B) and (C), a blind spot may occur between the captured image P1 of the imaging device 1(1) and the captured image P2 of the imaging device 1(2), or a large image overlap may occur between the captured image P2 of the imaging device 1(2) and the captured image P3 of the imaging device 1(3). Note that the image overlap is indicated by diagonal lines in Fig. 2(B) and (C). In such a case, two people must work together to adjust the imaging direction: a construction worker who monitors the captured images from each imaging device and issues an instruction to adjust the imaging direction of the imaging device, and a construction worker who adjusts the imaging direction of the imaging device in response to the instruction.

[0021] 1, in the instruction information output system of this embodiment, the server device 3 acquires captured images from the imaging devices 1(1), 1(2), and 1(3), grasps the imageable area, and specifies the imaging range (monitoring range) in accordance with the range specified by the mobile communication terminal 2. Furthermore, the server device 3 identifies a connection portion of the captured images, grasps the positional relationship of the captured image from the imaging device that is the target (target) for adjusting the imaging direction relative to this connection portion, and forms instruction information using this information.

[0022] The instruction information is instruction information for adjusting the imaging direction of the target imaging device, and is sound information or display information output through the mobile communication terminal 2. This allows the construction worker to adjust the imaging direction of the target imaging device according to the sound information emitted from the mobile communication terminal 2 that the construction worker owns and the display information displayed on the display unit of the mobile communication terminal 2. That is, the mobile communication terminal 2 and the server device 3 work together to perform the work of a construction worker who conventionally issues an instruction to adjust the imaging direction of the imaging device while viewing a captured image.

[0023] The following describes an example of the configuration and operation of each device that constitutes the instruction information output system of this embodiment. Since the imaging devices 1(1), 1(2), and 1(3) basically have the same configuration, they will be collectively referred to as imaging device 1 unless there is a need to distinguish them. In the following, for the sake of simplicity, the network 4 will be described as a wide area network (mainly the Internet).

[0024] In the following description, it is assumed that the imaging direction of the imaging device 1(1) has already been adjusted by using the invention disclosed in the above-mentioned Patent Document 1 (Japanese Patent No. 6819403). For this reason, the instruction information output system of this embodiment realizes adjustment of the imaging directions of the imaging devices 1(2) and 1(3).

[0025] [Configuration example of imaging device 1] 3 is a block diagram for explaining a configuration example of the imaging device 1 according to the embodiment. The imaging unit 101 includes an optical system portion including an imaging lens and an imaging element that receives light incident through the imaging lens in a light receiving portion and converts the light into an electrical signal, and is a portion that forms a captured image by capturing an image of a subject as an electrical signal. The control unit 102 is a microprocessor including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory, and the like, and realizes a function of controlling each portion of the imaging device 1.

[0026] The ROM of the control unit 102 stores programs executed by the CPU and data required for processing. The RAM of the control unit 102 is mainly used as a work area. The non-volatile memory of the control unit 102 stores upgrade programs provided later via the network 4 and highly important data that needs to be retained even when the power is turned off.

[0027] The storage unit 103 is a device unit consisting of, for example, a semiconductor memory with a relatively large capacity and its driver, and is used as a work area for storing intermediate results in various processes in addition to storing images captured through the imaging unit 101. The operation unit 104 is a part configured with several operation buttons operated by construction personnel, such as a zoom setting button, a field angle adjustment button, and a shutter button.

[0028] The communication unit 105 and the communication antenna 105A are a communication interface that enables communication through the network 4. Therefore, when an image captured by the imaging device 1 is transmitted to the server device 3, the image is converted into data for transmission in the communication unit 105 and transmitted through the communication antenna 105A. Also, for example, control information from the server device 3 is received by the communication antenna 105A, and converted into data in a format that can be processed by the communication unit 105 before being imported.

[0029] The imaging device 1 having such a configuration realizes the function of a surveillance camera, and sequentially generates captured images at a predetermined imaging rate. The generated captured images can be stored in the storage unit 103, or provided to an external device such as the server device 3 via the communication unit 105 and the communication antenna 105A for accumulation. Also, captured images can be generated and provided to the server device 3 in response to a shutter operation of the operation unit 104 by a construction worker.

[0030] [Example of configuration of mobile communication device 2] 4 is a block diagram for explaining a configuration example of a mobile communication terminal according to an embodiment. Communication antenna 201A and communication unit 201 are a communication interface that enables communication through network 4. Therefore, data to be transmitted from mobile communication terminal 2 is converted into data for transmission in communication unit 201 and transmitted through communication antenna 201A. Also, for example, data from server device 3 is received by communication antenna 201A, converted into data in a format that can be processed by the device itself in communication unit 201, and then taken in.

[0031] The control unit 202 is a microprocessor including a CPU, a ROM, a RAM, a non-volatile memory, and the like, and realizes the function of controlling each unit of the mobile communication terminal 2. The ROM of the control unit 202 stores programs executed by the CPU and data required for processing. The RAM of the control unit 202 is mainly used as a working area. The non-volatile memory of the control unit 202 stores upgrade programs provided later via the network 4, highly important data that needs to be retained even when the power is turned off, and the like.

[0032] The storage unit 203 is a device unit consisting of, for example, a semiconductor memory with a relatively large capacity and its driver, and is used as a work area for storing intermediate results in various processes in addition to storing various data. The operation unit 204 is configured with several operation buttons, for example, a power button, a volume adjustment button, etc. Also, it is equipped with a touch panel 207 consisting of a thin display unit (display element) 205 such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display, and a touch sensor 206. The touch panel 207 is a user interface that realizes the functions of displaying information and inputting information.

[0033] Audio output unit 208 and speaker 209 realize a function of outputting sound information. Specifically, digital audio data to be output from control unit 202 is supplied to audio output unit 208, where it is converted into an analog audio signal and supplied to speaker 209. As a result, audio corresponding to the digital audio data to be output is emitted from speaker 209. Note that in the mobile communication terminal 2 shown in FIG. 4, descriptions of functional units that are not used in this embodiment, such as a call function unit and a GPS function unit, are omitted.

[0034] The mobile communication terminal 2 configured as above realizes a function of transmitting an instruction on the imaging range to the server device 3, and also of receiving and outputting sound information and display information provided from the server device 3 as an instruction to adjust the imaging direction of the imaging device 1. Therefore, a construction worker who installs the imaging device 1 can adjust the imaging direction of the imaging device 1 by using the sound information emitted from the speaker 209 of the mobile communication terminal 2 and the display information displayed on the display unit 205 as guide information (guidance information).

[0035] [Example of configuration of server device (instruction information output device) 3] 5 is a block diagram for explaining a configuration example of a server device (instruction information output device) 3 according to an embodiment. The server device 3 is realized as a computer device (information processing device) such as a personal computer. The connection end 301T and the communication unit 301 are communication interfaces that enable communication through the network 4. Therefore, data to be transmitted from the server device 3 is converted into data for transmission in the communication unit 301 and transmitted through the connection end 301T. Also, for example, data from the server device 3 is received through the connection end 301T, converted into data in a format that can be processed by the device itself in the communication unit 301, and then taken in.

[0036] The control unit 302 is a microprocessor including a CPU, a ROM, a RAM, a non-volatile memory, and the like, and realizes the function of controlling each unit of the server device 3. The ROM of the control unit 302 stores programs executed by the CPU and data required for processing. The RAM of the control unit 302 is mainly used as a working area. The non-volatile memory of the control unit 302 stores upgrade programs provided later via the network 4, highly important data that needs to be retained even when the power is turned off, and the like.

[0037] The storage unit 303 is a device unit consisting of a large-capacity recording medium such as an SSD (Solid State Drive) and its driver, and is used as a working area for storing intermediate results in various processes in addition to storing various data, etc. The captured image storage unit 304, like the storage unit 303, is a device unit consisting of a large-capacity recording medium such as an SSD and its driver, and realizes the function of storing and storing captured images from the imaging devices 1(1), 1(2), and 1(3).

[0038] The first image acquisition unit 311 acquires captured images when the imaging direction is changed to the maximum adjustable angle for each of a plurality of predetermined directions from each of the imaging devices 1(1), 1(2), and 1(3). Fig. 6 is a diagram for explaining the maximum imaging range of the imaging device. As shown in Fig. 6(A), the captured image from the imaging device 1 when the imaging direction is in a state where it is adjustable up, down, left, and right is the captured image P, and the imaging device 1 in this state is the reference state.

[0039] 6A, the captured image when the imaging direction of the imaging device 1 in the reference state is oriented maximally upward and further maximally leftward is the captured image PUL. The captured image when the imaging device 1 is oriented maximally rightward from this point is the captured image PUR. The captured image when the imaging device is oriented maximally downward from this point is the captured image PDR, and the captured image when the imaging device 1 is oriented maximally leftward from this point is the captured image PDL.

[0040] Therefore, in Fig. 6(A), the range of the captured images PUL, PUR, PDL, and PDR shown by dotted lines is the maximum imaging range. That is, in this example, as shown in Fig. 6(B), if the captured image P in the reference state is a quadrangular area with vertices Pa, Pb, Pc, and Pd, the maximum imaging range is the quadrangular area with vertices a, b, c, and d. In this way, the first image acquisition unit 311 acquires captured images when the imaging direction is changed to the maximum adjustable angle for each of a plurality of predetermined directions provided sequentially from each of the imaging devices 1(1), 1(2), and 1(3), and records the captured images in the captured image storage unit 304 while maintaining the positional relationship.

[0041] The maximum imaging range specification unit 312 specifies the maximum imaging range for each of the imaging devices 1(1), 1(2), and 1(3) based on the captured images acquired from the imaging devices 1(1), 1(2), and 1(3) through the first image acquisition unit 311 and stored in the captured image storage unit 304. FIG. 7 is a diagram for explaining how to specify the maximum imaging range and how to adjust the imaging direction of the imaging device. FIG. 8 is a diagram for explaining how to adjust the imaging direction of the imaging device following FIG. 7. In FIG. 7(A), the captured images P1, P2, and P3 of the imaging devices 1(1), 1(2), and 1(3) and the maximum imaging ranges R1, R2, and R3 are shown slightly shifted in the vertical direction of the figure in order to clearly show the ranges.

[0042] As described above, the first image acquisition unit 311 records the captured images PUL, PUR, PDL, and PDR from each of the imaging devices 1(1), 1(2), and 1(3) while maintaining their positional relationship in the captured image storage unit 304. The maximum imaging range determination unit 312 forms one panoramic image in the captured image storage unit 304 by imaging the overlapping portions of the images of the maximum imaging range formed in the captured images PUL, PUR, PDL, and PDR from each of the imaging devices 1(1), 1(2), and 1(3).

[0043] The panoramic image is a combination of an image of the maximum imaging range R1 of the imaging device 1(1), an image of the maximum imaging range R2 of the imaging device 1(2), and an image of the maximum imaging range R3 of the imaging device 1(3), as shown by the dotted line in Fig. 7(A). Also, as shown in Fig. 7(A), the image of the maximum imaging range R1 of the imaging device 1(1) includes an image P1 captured by the imaging device 1(1) at an initial position before capturing an image for identifying the maximum imaging range. Similarly, the image of the maximum imaging range R2 of the imaging device 1(2) includes an image P2 captured by the imaging device 1(2) at an initial position before capturing an image for identifying the maximum imaging range. Similarly, the image of the maximum imaging range R3 of the imaging device 1(3) includes an image P3 captured by the imaging device 1(3) at an initial position before capturing an image for identifying the maximum imaging range.

[0044] The size of the captured images of the imaging devices 1(1), 1(2), and 1(3) is predetermined according to the adopted standard. For example, the size is 1920 pixels x 1080 pixels for the full HD standard, 1440 pixels x 1080 pixels for the HDV1080i standard, and 120 pixels x 720 pixels for the HD70p standard. Therefore, the coordinate positions of the four corners of the maximum imaging ranges R1, R2, and R3 can be specified according to the size of the captured images of the imaging devices 1(1), 1(2), and 1(3) and the positions of the captured images P1, P2, and P3 in the maximum imaging ranges R1, R2, and R3.

[0045] In Fig. 7(A), the coordinates of the four corners of the maximum imaging range R1 of the imaging device 1(1) can be specified as points a1, b1, c1, and d1, and the coordinates of the four corners of the maximum imaging range R2 of the imaging device 1(2) can be specified as points a2, b2, c2, and d2. The coordinates of the four corners of the maximum imaging range R3 of the imaging device 1(3) can be specified as points a3, b3, c3, and d3. Therefore, in this example, the maximum imaging range of the three imaging devices, imaging devices 1(1), 1(2), and 1(3), is a quadrilateral range with the four vertices being points a1, b3, c3, and d1.

[0046] In this way, maximum imaging range specifying unit 312 specifies the size of the maximum imaging range of the three imaging devices, imaging devices 1(1), 1(2), and 1(3). Furthermore, maximum imaging range specifying unit 312 specifies the position and size of each of the maximum imaging ranges R1, R2, and R3 of imaging devices 1(1), 1(2), and 1(3) within the maximum imaging range of the three imaging devices, imaging devices 1(1), 1(2), and 1(3).

[0047] In this embodiment, the panoramic image of maximum imaging ranges R1, R2, and R3 formed in captured image storage unit 304 as shown in Fig. 7(A) is sent to network 4 via communication unit 301 and connection terminal 301T, and provided to mobile communication terminal 2. Mobile communication terminal 2 displays the panoramic image on display unit 205, specifies the desired imaging range via touch panel 207, and returns this information to server device 3. As a result, as shown by points Ga, Gb, Gc, and Gd in Fig. 7(A), the construction worker carrying mobile communication terminal 2 can specify the desired imaging range to server device 3, and server device 3 can grasp this.

[0048] The second image acquisition unit 313 acquires a captured image from the imaging device 1, whose imaging direction has been adjusted for the latest image capture and whose imaging direction has been determined. As described above, at this stage, the imaging direction of the imaging device 1(1) has been determined using the invention disclosed in Patent Document 1, etc. For this reason, in this case, the second image acquisition unit 313 acquires a captured image P1 from the imaging device 1(1) and arranges it within the panoramic image shown in FIG. 7(A).

[0049] The connection part identification unit 314 performs a process of identifying a connection part using the captured image P1 from the imaging device 1(1) acquired through the second image acquisition unit 313 and the maximum imaging range R2 of the imaging device 1(2), which is another imaging device adjacent to the imaging device 1(1). In this case, the imaging device 1(2) is the adjustment target of the imaging direction. As shown in FIG. 7(B), the connection part identification unit 314 identifies a connection part of the captured image P2 of the imaging device 1(2) to the captured image P1 within the maximum imaging range R2 based on the positional relationship between the captured image P1 from the imaging device 1(1) and the maximum imaging range R2 of the imaging device 1(2).

[0050] The connection portion specifying unit 314 specifies, as a connection portion X1, the end position of the captured image P2 on the captured image P1 side when the captured image P1 from the imaging device 1(1) and the captured image P2 from the imaging device 1(2) are overlapped within the maximum imaging range R2 of the imaging device 1(2). The connection portion X1 is a position where the captured image P1 from the imaging device 1(1) and the captured image P2 from the imaging device 1(2) overlap to a predetermined extent. The predetermined extent is specifically determined, for example, to be about 10 percent of the horizontal width of the captured image. It is also possible to make the right end of the captured image P1 and the left end of the captured image P2 connect exactly without overlapping.

[0051] The third image acquisition unit 315 acquires the captured image P2 from the imaging device to be adjusted in the imaging direction, in this case the imaging device 1(2), and arranges it in the panoramic image shown in FIG. 7(A). The positional relationship specification unit 316 specifies the positional relationship of the captured image P2 for constituting the connection part X1 specified by the connection part specification unit 314, based on the captured image P2 acquired through the third image acquisition unit 315 and the maximum imaging range R2 of the imaging device 1(2). This positional relationship corresponds to the arrow M1 in FIG. 7(B). In other words, the positional relationship specification unit 316 specifies in which direction and how much the imaging direction of the imaging device 1(2) should be moved in order to position the left end of the captured image P2 at the connection part X1. Specifically, in the case of the example shown in FIG. 7(B), the content of the arrow M1 in FIG. 7(B) is specified, for example, to tilt 10 degrees to the left (toward the imaging device 1(1)).

[0052] The instruction information forming unit 317 forms instruction information for adjusting the imaging direction of the imaging device to be adjusted, in this case imaging device 1(2), based on the positional relationship specified by the positional relationship specifying unit 316. For example, it forms sound information saying "Tilt 10 degrees to the left (toward imaging device 1(1))" and sound information according to the distance to the connection part X1 of the left end of the captured image sequentially provided from imaging device 1(2). The sound information according to the distance is sound information whose period becomes shorter as the distance between the left end of the captured image sequentially provided from imaging device 1(2) and the connection part X1 becomes shorter.

[0053] Specifically, when the distance between the left end of the captured image sequentially provided from the imaging device 1(2) and the connection portion X1 is far, discrete sound information with a long period, such as "beep, beep...", is formed. As the distance between the left end of the captured image sequentially provided from the imaging device 1(2) and the connection portion X1 becomes closer, discrete sound information with a short period, such as "beep, beep...", is formed. When the left end of the captured image sequentially provided from the imaging device 1(2) coincides with the connection portion X1, continuous sound information such as "beep" is formed.

[0054] The instruction information forming unit 317 may form display information in the form shown in Fig. 7(B), for example. In this case, display information that changes so as to move the image P2 toward the image P1 may be formed. The instruction information to be formed may be either the sound information or the display information, or both the sound information and the display information.

[0055] The instruction information output unit 318 performs processing to transmit the instruction information formed by the instruction information formation unit 317 to the network 4 via the communication unit 301 and the connection terminal 301T and provide it to the mobile communication terminal 2. As a result, one or both of the sound information and the display information as the instruction information are output through the speaker 209 and the display unit 205 of the mobile communication terminal 2. In response to one or both of the sound information and the display information as the output instruction information, the construction worker performs the adjustment work of the imaging direction of the imaging device 1 (2).

[0056] As a result, as shown in Fig. 7(C), the imaging direction of the imaging device 1(2) (the orientation of the imaging device 1(2)) can be adjusted so that the captured image P1 of the imaging device 1(1) and the captured image P2 of the imaging device 1(2) overlap each other by a predetermined amount at their end portions. That is, in Fig. 7(C), the captured image P1 is a quadrangular area with vertices P1a, P1b, P1c, and P1d, and the captured image P2 is a quadrangular area with vertices P2a, P2b, P2c, and P2d. In this case, the quadrangular areas with vertices P2a, P1b, P1c, and P2d indicated by diagonal lines are the overlapping areas.

[0057] When the adjustment of the imaging direction for the imaging device 1(2) is completed in this manner, the control unit 302 controls each unit from the second image acquisition unit 313 onwards to perform an adjustment process of the imaging direction for the imaging device 1(3). That is, the second image acquisition unit 313 acquires a captured image from the imaging device 1 whose imaging direction adjustment for the latest imaging has been completed and whose imaging direction has been confirmed. In this case, the second image acquisition unit 313 acquires a captured image P2 from the imaging device 1(2) and arranges it in the panoramic image shown in Fig. 7(A).

[0058] The connection part identification unit 314 performs a process of identifying a connection part using the captured image P2 from the imaging device 1(2) acquired through the second image acquisition unit 313 and the maximum imaging range R3 of the imaging device 1(3), which is another imaging device adjacent to the imaging device 1(2). In this case, the imaging device 1(3) is the adjustment target of the imaging direction. As shown in FIG. 8(A), the connection part identification unit 314 identifies a connection part of the captured image P3 of the imaging device 1(3) to the captured image P2 within the maximum imaging range R3 based on the positional relationship between the captured image P1 from the imaging device 1(2) and the maximum imaging range R3 of the imaging device 1(3).

[0059] The connection portion specifying unit 314 specifies, as a connection portion X2, the end position of the captured image P3 on the captured image P3 side when the captured image P3 from the imaging device 1(3) and the captured image P3 from the imaging device 1(3) overlap within the maximum imaging range R3 of the imaging device 1(3). The connection portion X2 is a position where the captured image P2 from the imaging device 1(2) and the captured image P3 from the imaging device 1(3) overlap to a predetermined extent. The predetermined extent is specifically determined, for example, to be about 10 percent of the horizontal width of the captured image. It is also possible to make the right end of the captured image P2 and the left end of the captured image P3 connect exactly without overlapping.

[0060] The third image acquisition unit 315 acquires the captured image P3 from the imaging device to be adjusted in the imaging direction, in this case the imaging device 1(3), and arranges it in the panoramic image shown in FIG. 7(A). The positional relationship specification unit 316 specifies the positional relationship of the captured image P3 for constituting the connection part X2 specified by the connection part specification unit 314, based on the captured image P3 acquired through the third image acquisition unit 315 and the maximum imaging range R3 of the imaging device 1(3). This positional relationship corresponds to the arrow M2 in FIG. 8(A). In other words, the positional relationship specification unit 316 specifies in which direction and how much the imaging direction of the imaging device 1(3) should be moved in order to position the left end of the captured image P3 at the connection part X2. Specifically, in the case of the example shown in FIG. 8(A), the content of the arrow M2 in FIG. 8(A) is specified, for example, to tilt it 5 degrees to the right (the opposite direction to the imaging device 1(2)).

[0061] The instruction information forming unit 317 forms instruction information for adjusting the imaging direction of the imaging device to be adjusted, in this case imaging device 1(3), based on the positional relationship identified by the positional relationship identifying unit 316. For example, it forms sound information such as "Tilt 5 degrees to the right (the opposite direction to imaging device 1(2))" and sound information according to the distance to the connection part X2 of the left end of the captured images sequentially provided from imaging device 1(3) as described above.

[0062] The instruction information forming unit 317 may form display information in the form shown in Fig. 8(A), for example. In this case, display information that changes so as to move the image P3 in the opposite direction to the image P2 may be formed. The instruction information to be formed may be either the sound information or the display information, or both the sound information and the display information.

[0063] The instruction information output unit 318 performs processing to transmit the instruction information formed by the instruction information formation unit 317 to the network 4 via the communication unit 301 and the connection terminal 301T and provide it to the mobile communication terminal 2. As a result, one or both of the sound information and the display information as the instruction information are output through the speaker 209 and the display unit 205 of the mobile communication terminal 2. In response to one or both of the sound information and the display information as the output instruction information, the construction worker performs the adjustment work of the imaging direction of the imaging device 1 (3).

[0064] As a result, as shown in Fig. 8(B), the imaging direction of the imaging device 1(3) (the orientation of the imaging device 1(3)) can be adjusted so that the captured image P2 of the imaging device 1(2) and the captured image P3 of the imaging device 1(3) overlap at their end portions by a predetermined amount. That is, in Fig. 8(B), the captured image P2 is a quadrangular area with vertices P2a, P2b, P2c, and P2d, and the captured image P3 is a quadrangular area with vertices P3a, P3b, P3c, and P3d. In this case, the quadrangular areas with vertices P3a, P2b, P2c, and P3d indicated by diagonal lines are the overlapping areas.

[0065] 9 is a diagram for explaining an example of a monitoring area in which multiple imaging devices (monitoring cameras) are installed, and an example of an imaging range captured by the imaging devices after adjusting the imaging direction. By the adjustment process of the imaging direction for the imaging devices 1(2) and 1(3) described above, the imaging directions of the imaging devices 1(1), 1(2), and 1(3) installed in the monitoring area Ar are adjusted as shown in FIG. 9(A).

[0066] Fig. 9(B) is a diagram showing the imaging ranges of the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) when the monitoring area Ar is viewed from above (from the upper surface side indicated by the arrow Up) in Fig. 9(A). Also, Fig. 9(C) is a diagram showing the imaging ranges of the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) when the monitoring area Ar is viewed from the side (from the front side indicated by the arrow Fr, i.e., from the side facing the imaging devices).

[0067] As can be seen from Fig. 9(B) and (C), the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) do not have blind spots. In addition, the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) do not have large overlapping areas. It can be seen that the captured images P1, P2, and P3 captured by the imaging devices 1(1), 1(2), and 1(3) can capture the entire monitored area of ​​the monitoring area Ar. In this way, the imaging directions of the multiple imaging devices 1(1), 1(2), and 1(3) can be appropriately adjusted.

[0068] [Operation of instruction information output system] <Advance preparation> The following describes the operation of the instruction information output system that is configured by the imaging devices 1(1), 1(2), and 1(3) configured as described above, the mobile communication terminal 2, and the server device 3. Fig. 10 is a sequence diagram for explaining advance preparations for adjusting the imaging direction of the imaging devices. Before the adjustment process of the imaging direction of the imaging devices 1(1), 1(2), and 1(3), the advance preparations shown in Fig. 10 are executed.

[0069] 10, in reality, the construction worker starts a predetermined application (application for adjusting the imaging direction of the imaging device) on the mobile communication terminal 2 that he / she owns, and instructs the server device 3 to execute advance preparations for adjusting the imaging direction. As a result, in the server device 3, under the control of the control unit 302, the first image acquisition unit 311 becomes in an operating state, and the server device 3 becomes in a standby state for acquisition of captured images from the imaging devices 1(1), 1(2), and 1(3).

[0070] 6, the construction worker captures captured images PUL, PUR, PDL, and PDR when the imaging direction of the imaging device 1(1) is changed to the maximum adjustable angle for each of a plurality of predetermined directions, and transmits the captured images to the server device 3 (steps S11 to S14). As a result, the server device 3 acquires the captured images from the imaging device 1(1) through the connection terminal 301T and the communication unit 301, generates an image of the maximum imaging range R1, and stores it in the captured image storage unit 304 (step S15).

[0071] Next, in the same manner as in the case of the imaging device 1(1), the construction worker captures captured images PUL, PUR, PDL, and PDR for the imaging device 1(2) when the imaging direction is changed to the maximum adjustable angle for each of a plurality of predetermined directions, and transmits the captured images to the server device 3 (steps S21 to S24). As a result, the server device 3 acquires the captured images from the imaging device 1(2) through the connection terminal 301T and the communication unit 301, generates an image of the maximum imaging range R2, and stores it in the captured image storage unit 304 (step S25).

[0072] Next, similarly to the case of the imaging devices 1(1) and 1(2), the construction worker captures captured images PUL, PUR, PDL, and PDR for the imaging device 1(3) when the imaging direction is changed to the maximum adjustable angle for each of a plurality of predetermined directions, and transmits the captured images to the server device 3 (steps S31 to S34). As a result, the server device 3 acquires the captured images from the imaging device 1(3) through the connection terminal 301T and the communication unit 301, generates an image of the maximum imaging range R3, and stores it in the captured image storage unit 304 (step S35).

[0073] Thereafter, in the server device 3, under the control of the control unit 302, the maximum imaging range determination unit 312 functions to generate a panoramic image PM of the maximum imaging range in the captured image storage unit 304 as described with reference to Fig. 7(A) (step S41). This makes it possible to grasp the position and size of the maximum imaging range for each of the imaging devices 1(1), 1(2), and 1(3), as well as the position and size of the maximum imaging range using the imaging devices 1(1), 1(2), and 1(3).

[0074] Thereafter, maximum imaging range specifying unit 312 provides the generated panoramic image PM to mobile communication terminal 2 carried by the construction worker (step S42). As described above, mobile communication terminal 2 starts a predetermined application to instruct server device 3 to execute advance preparations for adjusting the imaging direction, so that server device 3 can specify mobile communication terminal 2. Mobile communication terminal 2 displays panoramic image PM from server device 3 on display unit 205, accepts designation of the actual imaging range (step S43), and transmits information designating the imaging range to server device 3 (step S44).

[0075] As a result, in the server device 3, as described with reference to Fig. 7(A), the actual imaging range (a rectangular range with vertices Ga, Gb, Gc, and Gd) can be specified, and the imaging range is also stored in the captured image storage unit 304 (step S45). Therefore, the captured image storage unit 304 stores and grasps the panoramic image shown in Fig. 7(A), the maximum imaging ranges R1, R2, and R3 of the imaging devices 1(1), 1(2), and 1(3), and the actual imaging range (a rectangular range with vertices Ga, Gb, Gc, and Gd). The process of the sequence diagram shown in Fig. 10 is a preliminary preparation for the adjustment process of the imaging direction.

[0076] <Adjustment of the imaging direction of the imaging device 1(1)> Next, the imaging direction is adjusted for each of the imaging devices 1(1), 1(2), and 1(3). However, for the first imaging device 1(1), there is no imaging device for which the adjustment of the imaging direction has already been completed, and there is no need to consider the relationship with the other imaging devices. For this reason, the imaging direction of the first imaging device 1(1) is adjusted using the invention disclosed in Patent Document 1 (Japanese Patent No. 6819403). In this case, the construction worker issues an instruction to start the adjustment process of the imaging direction for the first imaging device 1(1) through a predetermined application on the mobile communication terminal 2.

[0077] As a result, the image capture direction adjustment process is started using the method described in paragraphs

[0036] to

[0040] of Patent Document 1 using Figure 6 of Patent Document 1, and the adjustment of the image capture direction for the image capture device 1(1) is completed. Note that the adjustment of the image capture direction for the image capture device 1(1) does not necessarily have to use the invention disclosed in Patent Document 1. Any appropriate method may be used for adjustment.

[0078] After this, since there exists an imaging device 1(1) whose adjustment of the imaging direction has already been completed, the imaging direction adjustment process is performed for the imaging device 1(2) in consideration of its positional relationship with the imaging device 1(1). Furthermore, the imaging direction adjustment process is performed for the imaging device 1(3) in consideration of its positional relationship with the imaging device 1(2).

[0079] <Adjustment of the imaging direction of the imaging devices 1(2) and 1(3)> Fig. 11 is a sequence diagram for explaining the process of adjusting the imaging direction of the imaging device. Although not shown in Fig. 11, in this case too, the construction worker issues an instruction to start the adjustment process of the imaging direction for the second and subsequent imaging devices 1(2) and 1(3) through a predetermined application of the mobile communication terminal 2. As a result, the necessary instructions are sent from the server device 3 to the mobile communication terminal 2, and the construction worker performs the work according to the instructions, and the process shown in Fig. 11 proceeds.

[0080] First, the construction worker presses the shutter button of the imaging device 1(1) whose imaging direction has been adjusted to capture an image, and transmits the captured image P1 to the server device 3 (step S51). The server device 3 receives the captured image P1, and under the control of the control unit 302, the second image acquisition unit 313 functions to acquire the captured image P1 from the imaging device 1(1), and arranges the captured image P1 in the panoramic image, as described with reference to Fig. 7(A). After that, the connection part identification unit 314 functions to identify the connection part X1 from the captured image P1 and the maximum imaging range R2 of the imaging device 1(2), as described with reference to Fig. 7(B) (step S52).

[0081] Next, the construction worker presses the shutter button of the imaging device 1(2) that is the target for adjusting the imaging direction to capture an image, and transmits the captured image P2 to the server device 3 (step S53). The server device 3 receives the captured image P2, and under the control of the control unit 302, the third image acquisition unit 315 functions to acquire the captured image P2 from the imaging device 1(2), and arranges the captured image P2 within the panoramic image, as described with reference to Fig. 7(A). After that, the positional relationship specification unit 316 functions to specify the positional relationship of the captured image P2 with respect to the connection part X1, using the captured image P2 and the maximum imaging range R2 of the imaging device 1(2) (step S54).

[0082] This positional relationship corresponds to the arrow M1 described with reference to Fig. 7(B). That is, the positional relationship specifying unit 316 specifies in which direction and by how much the imaging direction of the imaging device 1(2) should be moved in order to position the left end of the captured image P2 at the connection part X1. Specifically, in the case of the example shown in Fig. 7(B), the content of the arrow M1 in Fig. 7(B) is specified, such as tilting by 10 degrees to the left (towards the imaging device 1(1)).

[0083] Thereafter, under the control of control unit 302, instruction information forming unit 317 functions to form instruction information (sound information) to be provided to mobile communication terminal 2 based on the positional relationship identified by positional relationship identifying unit 316 (step S55), and transmits this to mobile communication terminal 2 (step S56). Mobile communication terminal 2 outputs the sound information from server device 3 (step S57), which is provided to the construction worker (step S58), and the construction worker adjusts the imaging direction of imaging device 1 (2) according to the sound information (step S59).

[0084] Here, the instruction information is described as being sound information, but is not limited thereto. As described above, the instruction information may be either sound information or display information, or both. In this way, the imaging direction of the imaging device 1(2) can be adjusted in consideration of the relationship with the imaging device 1(1) whose imaging direction adjustment has been completed (more precisely, the relationship with the captured image P1 of the imaging device 1(1)).

[0085] Thereafter, in the same manner as in the process described with reference to Fig. 11, the imaging direction of the imaging device 1(3) is adjusted in consideration of the relationship with the imaging device 1(2) whose imaging direction has been adjusted. Specifically, in step S51, imaging is performed by the imaging device 1(2) and the captured image P2 is transmitted to the server device 3. In step S52, the connection part X2 is identified as described with reference to Fig. 8(A) using the captured image P2 and the maximum imaging range R3 of the imaging device 1(3). In step S53, imaging is performed by the imaging device 1(3) and the captured image P3 is transmitted to the server device 3.

[0086] In step S54, the positional relationship of the captured image P3 with respect to the connection part X2 is identified using the captured image P3 from the imaging device 1(3) and the maximum imaging range R3 of the imaging device 1(3). In step S55, under the control of the control unit 302, the instruction information forming unit 317 functions to form instruction information (sound information) to be provided to the mobile communication terminal 2 based on the positional relationship M2 identified by the positional relationship identifying unit 316. In step S56, the instruction information (sound information) formed by the instruction information forming unit 317 is transmitted to the mobile communication terminal 2.

[0087] As a result, in step S57, the mobile communication terminal 2 outputs the sound information from the server device 3, and in step S58, the sound information is provided to the construction worker, who in step S59 adjusts the imaging direction of the imaging device 1(3) in accordance with the sound information. In this way, for the imaging devices 1(2) and 1(3) following the first imaging device 1(1), the imaging direction can be adjusted in consideration of the relationship with the other imaging devices that have just completed adjustment of their imaging directions.

[0088] In this embodiment, the case where three imaging devices 1(1), 1(2), and 1(3) are used has been described. However, even if there are four or more imaging devices, the process described using FIG. 11 is similarly performed between the imaging device whose imaging direction adjustment has just been completed and the imaging device whose imaging direction is the target of adjustment.

[0089] [Summary of processing performed on server device 3] FIG. 12 is a flowchart for explaining the process performed by the server device (instruction information output device) 3, which is a process for adjusting the imaging direction of the second and subsequent imaging devices, which adjusts the imaging direction in consideration of the relationship with the other imaging devices. Therefore, it is assumed that the advance preparation described with reference to FIG. 10 and the adjustment of the imaging direction for the first imaging device 1(1) have already been completed before the process of FIG. 12 is performed. It is also assumed that the server device 3 knows how many imaging devices the imaging direction of which is to be adjusted (the maximum number of imaging devices) through a predetermined application executed on the mobile communication terminal 2. The process of the flowchart shown in FIG. 12 is executed by the control unit 302, and is carried out by the control unit 302 controlling each unit.

[0090] As described above, when the advance preparation (FIG. 10) and the adjustment of the imaging direction for the first imaging device 1(1) are completed, the control unit 302 of the server device 3 executes the process shown in FIG. 12. The control unit 302 first sets (substitutes) an initial value 2 into a variable n (step S101). Next, the control unit 302 controls the second image acquisition unit 313 to acquire a captured image Pn-1 transmitted from an imaging device 1(n-1) whose imaging direction has been adjusted (orientation has been adjusted) (step S102).

[0091] Thereafter, the control unit 302 controls the connection part identification unit 314 to identify the connection part Xn-1 from the captured image Pn-1 from the imaging device 1(n-1) and the maximum imaging range Rn of the imaging device 1(n) whose imaging direction is to be adjusted (step S103). Next, the control unit 302 acquires the captured image Pn transmitted from the imaging device 1(n) whose imaging direction is to be adjusted (step S104). Next, the control unit 302 uses the acquired captured image Pn and the maximum imaging range Rn of the imaging device 1(n) whose imaging direction is to be adjusted to identify the positional relationship Mn-1 with respect to the connection part Xn-1 (step S105).

[0092] The control unit 302 determines whether the connection part Xn-1 identified in step S103 matches the left end of the captured image Pn from the imaging device 1(n) that is the target of the imaging direction adjustment obtained in step S104 (step S106). If it is determined in the determination process of step S106 that they do not match, the control unit 302 controls the instruction information forming unit 317 to perform a process of forming and outputting sound information for adjustment and transmitting it to the mobile communication terminal 2 (step S107). Thereafter, the control unit 302 repeats the processes from step S104.

[0093] Furthermore, when it is determined in the determination process of step S106 that there is a match, the control unit 302 controls the instruction information forming unit 317 to form and output sound information indicating a match state, and transmits the sound information to the mobile communication terminal 2 (step S108). After that, the control unit 302 adds the value 1 to the variable n (step S109), and determines whether or not the variable n is greater than the maximum value of the number of imaging devices (step S110).

[0094] In the determination process of step S110, when it is determined that the variable n is not greater than the maximum number of imaging devices (is equal to or less than the maximum number), the control unit 302 repeats the process from step S102. In addition, in the determination process of step S110, when it is determined that the variable n is greater than the maximum number of imaging devices, the adjustment of the imaging direction for all imaging devices 1 installed in the monitoring area Ar is completed, so the process of the flowchart shown in FIG.

[0095] [Effects of the embodiment] As a result, the construction worker can output the instruction information (sound information, display information) from the server device 3 from the mobile communication terminal 2 that he / she owns, and use this as guide information to adjust the imaging direction of the multiple imaging devices 1 arranged in the monitoring area Ar by himself / herself. Moreover, it is possible to prevent blind spots from occurring between the images captured by the multiple imaging devices, and to prevent large overlapping areas from occurring between the images captured by the multiple imaging devices. Therefore, when preparing an environment for monitoring by arranging multiple imaging devices in a relatively wide monitoring area, it is possible to appropriately adjust the imaging direction of the imaging devices without the need for multiple construction workers.

[0096] [Variations] <Selection of connection pattern> In the above-described embodiment, as described with reference to Figs. 7 and 8, the connection portion between the captured image P1 and the captured image P2 and the connection portion X1, X2 between the captured image P2 and the captured image P3 are specified so that, for example, about 10% of the width of the captured images overlap. However, this is not limited to this. The overlapping degree can be specified, for example, by having a person actually walk in the monitoring area Ar, so that the width is set to a width that can fit the entire body of the person, a width that can fit half of the person's body, or no overlap and the ends of both captured images are perfectly aligned. The specification can be made to the server device 3 through the mobile communication terminal 2, and can be made available in the connection portion specification unit 314 of the server device 3.

[0097] Also, by having a person actually walk without specifying an imaging subject with the first imaging device 1(1), from when the person enters the captured image until when they disappear, notification is made through the mobile communication terminal 2 using sound information and display information. The imaging direction of the imaging device 1 is adjusted so that, for example, a person walking is captured from the left end to the right end in the captured image P1 of the first imaging device 1(1). During this adjustment process, it may be determined how much of the person is captured at the left and right ends of the captured image P1 of the first imaging device 1(1) to be the connection portion, and this may be set in the server device 3 via the mobile communication terminal 2, for example.

[0098] In this way, it is possible to generate information such as the width of overlapping images to be used for the other imaging devices 1(2) and 1(3) depending on the movement of the person who is the subject of the first imaging device 1(1).In this case, if the width is set to be large enough to include the entire person, the width of the overlapping portion will be wide if the person walks fast, and narrow if the person walks slowly, so it is necessary to select an appropriate speed for the person's walking speed as well.

[0099] <Types of sound information as instruction information> The sound information as instruction information may be different for each of the imaging devices 1(1), 1(2), and 1(3). This allows the construction worker to know which imaging device is currently undergoing adjustment of the imaging direction by the sound information, which helps prevent mistakes in the workplace.

[0100] <When adjusting the imaging direction by directly controlling the imaging device> Also, the imaging devices 1(1), 1(2), and 1(3) themselves may be provided with actuators to adjust the direction of the optical axis, zoom settings, and angle of view settings, and the actuators may be configured to be controllable by the control unit 302. In such a case, the instruction information forming unit 317 of the server device 3 described above forms instruction information (control information) instructing at least in which direction and by how much the direction of the optical axis should be changed, instead of sound information or display information as instruction information, and supplies this to the target imaging device 1. As a result, the control unit 302 controls the actuator to change the direction of the optical axis in response to the instruction information, thereby adjusting the imaging direction. In this case, there is no need for a construction worker to perform the work of changing the imaging direction of the imaging device 1.

[0101] <Use of the mobile communication terminal 2 as the server device 3> In recent years, the functions of the mobile communication terminal 2 have also improved. For example, many of them have a storage capacity of 500 GB (gigabytes) or more, and the processing speed is high, making it possible to easily perform complex image processing. Therefore, the configuration of the server device 3 shown in FIG. 5 can be added to the mobile communication terminal 2 shown in FIG. 4, so that the mobile communication terminal 2 also functions as the server device 3. In this case, each of the imaging devices 1(1), 1(2), and 1(3) communicates with the mobile communication terminal 2, and the mobile communication terminal 2 forms instruction information and outputs it from the mobile communication terminal 2, so that the imaging direction can be adjusted in the same manner as in the above-mentioned embodiment.

[0102] [others] In the above embodiment, the case where three imaging devices 1(1), 1(2), and 1(3) are used has been described as an example, but the present invention is not limited to this. If the number of imaging devices is two or more, the imaging directions of the second and subsequent imaging devices can be adjusted by applying the present invention.

[0103] Furthermore, when the monitoring area Ar is an area that spreads horizontally as shown in Fig. 2, the captured images do not generally deviate significantly from each other in the vertical direction. However, when the captured images are deviated from each other in the vertical direction, it is possible to adjust the orientation of the imaging device 1, the imaging direction of which is to be adjusted, in the vertical direction, for example, according to the similarity of the overlapping portions.

[0104] Furthermore, even when multiple imaging devices are arranged in a monitoring area that extends vertically, such as a staircase or ladder section, the imaging direction can be adjusted in the same manner by simply changing the connection part of the captured images from the horizontal direction to the vertical direction.

[0105] Moreover, the process executed by the server device 3 described with reference to Figures 10, 11 and 12 is an application of an embodiment of the instruction information output method according to the present invention. Moreover, the process executed by the server device 3 described with reference to Figures 10, 11 and 12 is an application of an embodiment of the instruction information output program according to the present invention. Moreover, in the server device 3 shown in Figure 5, the functions of each unit in the 310 range can also be realized as functions of the control unit 302 by a program executed by the control unit 302. [Explanation of symbols]

[0106] 1, 1(1), 1(2), 1(3)...imaging device, 101...imaging unit, 102...control unit, 103...storage unit, 104...operation unit, 105...communication unit, 105A...communication antenna, 2...mobile communication terminal, 201A...communication antenna, 201...communication unit, 202...control unit, 203...storage unit, 204...operation unit, 205...display unit, 206...touch sensor, 207...touch panel, 208...audio output unit, 209...s Peaker, 3... server device, 301T... connection end, 301... communication unit, 302... control unit, 303... storage unit, 304... captured image holding unit, 311... first image acquisition unit, 312... maximum captured area determination unit, 313... second image acquisition unit, 314... connection portion determination unit, 315... third image acquisition unit, 316... positional relationship determination unit, 317... instruction information formation unit, 318... instruction information output unit, 4... network, 5(1)... base station

Claims

1. An instruction information output device that outputs instruction information for adjusting imaging directions of a plurality of imaging devices that are installed so as to image different parts of a continuous monitoring area, a first image acquisition means for acquiring captured images from each of the plurality of image capture devices when the image capture direction is changed up to a maximum angle adjustable for each of a plurality of predetermined directions; a maximum imaging range specifying means for specifying a maximum imaging range for each of the plurality of imaging devices based on captured images acquired from the plurality of imaging devices through the first image acquisition means; A second image acquisition means for acquiring a captured image from one of the plurality of image acquisition devices; a connection portion specifying means for specifying a connection portion of an image captured by the first imaging device within the maximum imaging range of the other imaging device relative to the image captured by the first imaging device, based on the captured image acquired through the second image acquisition means and the maximum imaging range of the other imaging device adjacent to the first imaging device; a third image acquisition means for acquiring a captured image from the other imaging device; a positional relationship specifying means for specifying a positional relationship of the captured image from the other imaging device for forming the connection portion specified by the connection portion specifying means, based on the captured image acquired through the third image acquisition means and the maximum imaging range of the other imaging device; an instruction information generating means for generating instruction information for adjusting an imaging direction of the other imaging device based on the positional relationship specified by the positional relationship specifying means; an instruction information output means for outputting the instruction information formed by the instruction information forming means; An instruction information output device comprising:

2. The instruction information formed by the instruction information forming means according to claim 1 is at least one of sound information and display information, which includes information according to a distance of an end portion serving as a reference for an image captured by the other imaging device from the connection portion.

13. An instruction information output device comprising:

3. 2. The instruction information output device according to claim 1, a determination unit that determines whether or not the captured image acquired by the third image acquisition unit has reached the positional relationship specified by the positional relationship specification unit, The processing of the third image acquisition means, the positional relationship specification means, the instruction information formation means, and the instruction information output means is repeated until it is determined in the determination means that the captured image acquired by the third image acquisition means has reached the positional relationship specified by the positional relationship specification means.

13. An instruction information output device comprising:

4. 2. The instruction information output device according to claim 1, a selection means for selecting, when a predetermined subject is moved at a predetermined speed in the array direction of the plurality of imaging devices in the continuous monitoring area, an image overlapping portion including the entire subject, an image overlapping portion including half of the subject, or no overlapping of captured images, as the connection portion specified by the connection portion specifying means; An instruction information output device comprising:

5. 1. An instruction information output method for use in an apparatus that outputs instruction information for adjusting imaging directions of a plurality of imaging devices that are installed so as to image different parts of a continuous monitoring area, comprising: a first image acquiring step in which a first image acquiring means acquires an image captured by each of the plurality of image capturing devices when the image capturing direction is changed up to a maximum angle adjustable for each of a plurality of predetermined directions; a maximum imaging range specifying step of specifying a maximum imaging range for each of the plurality of imaging devices based on captured images acquired from the plurality of imaging devices through the first image acquisition step; a second image acquiring step in which a second image acquiring means acquires an image from one of the plurality of image acquiring devices; a connection part specifying step of specifying a connection part of an image captured by the first imaging device within the maximum imaging range of the other imaging device to an image captured by the other imaging device, based on the captured image acquired through the second image acquisition means and the maximum imaging range of the other imaging device adjacent to the first imaging device; a third image acquiring step in which a third image acquiring means acquires an image from the other imaging device; a positional relationship specifying step in which a positional relationship specifying means specifies a positional relationship of the captured image from the other imaging device for forming the connection portion specified in the connection portion specifying step, based on the captured image acquired through the third image acquisition means and the maximum imaging range of the other imaging device; an instruction information forming step of forming instruction information for adjusting an imaging direction of the other imaging device by an instruction information forming means based on the positional relationship specified in the positional relationship specifying step; an instruction information output step in which an instruction information output means outputs the instruction information formed in the instruction information forming step; 13. A method for outputting instruction information comprising the steps of:

6. An instruction information output program executed by a computer that outputs instruction information for adjusting imaging directions of a plurality of imaging devices installed so as to image different parts of a continuous monitoring area, a first image acquisition step of acquiring captured images from each of the plurality of image capture devices when the image capture direction is changed up to a maximum angle adjustable for each of a plurality of predetermined directions; a maximum imaging range specifying step of specifying a maximum imaging range for each of the plurality of imaging devices based on the captured images acquired from the plurality of imaging devices in the first image acquisition step; a second image acquisition step of acquiring an image from one of the plurality of image acquisition devices; a connection portion specifying step of specifying a connection portion of an image captured by the first imaging device within the maximum imaging range of the other imaging device relative to the image captured by the first imaging device, based on the captured image acquired in the second image acquiring step and the maximum imaging range of the other imaging device adjacent to the first imaging device; a third image acquisition step of acquiring a captured image from the other imaging device; a positional relationship specifying step of specifying a positional relationship of the captured image from the other imaging device for forming the connection portion specified in the connection portion specifying step, based on the captured image acquired in the third image acquiring step and the maximum imaging range of the other imaging device; an instruction information forming step of forming instruction information for adjusting an imaging direction of the other imaging device based on the positional relationship specified in the positional relationship specifying step; an instruction information output step of outputting the instruction information formed in the instruction information forming step; An instruction information output program characterized by executing the above.

Images