Processing device

Abstract

Provided is a processing device which allows the settings of each camera to be easily confirmed when images are captured with a plurality of cameras. This processing device for processing images captured by a plurality of cameras comprises a processor. The processor sets a plurality of independent image display areas in correspondence to the plurality of cameras on a first screen for outputting images to a display destination. The processor causes the plurality of image display areas to display the images of the plurality of cameras in a state where it is possible to identify a first range where images of adjacent cameras overlap, and a second range where the images do not overlap.

Description

Processing equipment

[0001] The present invention relates to a processing device, and more particularly to a processing device that processes images captured by a plurality of cameras.

[0002] BACKGROUND ART There is known a technique for detecting damage (such as cracks) occurring in the wall surface of a structure such as a tunnel by photographing the wall surface of the structure with a camera and analyzing the obtained image.

[0003] Patent documents 1 to 5 describe a method of acquiring high-resolution images by mounting multiple cameras on a vehicle, capturing images with adjacent cameras partially overlapping each other, and synthesizing the resulting images into a panorama.

[0004] Furthermore, Patent Document 6 describes a method of photographing the surface of a structure while shifting the photographing position by hand or by a drone, etc. Patent Document 6 also describes that when displaying a photographed image, areas that overlap with adjacent images are deleted before displaying the image.

[0005] Japanese Patent Application Laid-Open No. 2016-218555 Japanese Patent Application Laid-Open No. 2016-57579 Japanese Patent Application Laid-Open No. 2004-12152 Japanese Patent Application Laid-Open No. 2001-141660 Japanese Patent Application Laid-Open No. 9-161068 Japanese Patent Application Laid-Open No. 2020-5186

[0006] One embodiment of the technique of the present disclosure provides a processing device that allows easy confirmation of the settings of each camera when taking pictures with multiple cameras.

[0007] (1) A processing device that processes images captured by multiple cameras, comprising a processor, which sets multiple independent image display areas corresponding to the multiple cameras on a first screen output to a display destination, and displays the images from the multiple cameras in the multiple image display areas in a state in which a first range in which images overlap with images from adjacent cameras and a second range in which images do not overlap can be distinguished.

[0008] (2) The processing device of (1), wherein the plurality of cameras includes a pair of cameras whose imaging areas overlap.

[0009] (3) The processing device of (1) or (2), wherein the processor sets a plurality of image display areas in a layout corresponding to the arrangement of the plurality of cameras.

[0010] (4) A processing device according to any one of (1) to (3), wherein the processor processes images from the multiple cameras to detect the first range and / or the second range.

[0011] (5) A processing device according to any one of (1) to (3), in which the processor acquires information about the subject and information about the multiple cameras, and detects the first range and / or the second range based on the acquired information.

[0012] (6) A processing device according to any one of (1) to (5), wherein the processor calculates the overlap rate of the image to be displayed in the image display area based on the first range and / or the second range, and displays the overlap rate on the first screen.

[0013] (7) The processing device of (6), wherein the processor determines whether the settings of the multiple cameras are appropriate based on the overlap rate and displays the determination result on the first screen.

[0014] (8) The processing device of (6), wherein the processor determines correction conditions for the settings of the plurality of cameras based on the overlap rate and displays the correction conditions on the first screen.

[0015] (9) Any one of the processing devices (1) to (8) in which the processor displays images captured in time series by a plurality of cameras in the image display area in chronological order.

[0016] (10) A processing device according to any one of (1) to (9), wherein the processor acquires information from a plurality of cameras and displays the information from the plurality of cameras on a second screen different from the first screen.

[0017] (11) A processing device according to (10), in which the processor acquires information about the subject, estimates the shooting parameters of multiple cameras to be set when photographing the subject based on the acquired information, and sets the shooting parameters of the multiple cameras according to the estimation results.

[0018] (12) The processing device of (10) or (11), wherein the camera information includes at least one of information about shooting parameters, information about the image storage capacity, and information about the battery.

[0019] (13) A processing device according to any one of (10) to (12), in which the processor accepts changes to the shooting parameters of multiple cameras individually or collectively on the second screen, and changes the shooting parameters of the cameras individually or collectively in accordance with the accepted content.

[0020] (14) The processing device of any one of (10) to (13), wherein the processor determines whether the status of the multiple cameras is appropriate based on the information from the multiple cameras, and displays the determination result on the second screen.

[0021] (15) A processing device according to any one of (1) to (14), wherein the processor displays recorded images from a plurality of cameras on a third screen different from the first screen.

[0022] (16) The processing device of (15), wherein the processor synthesizes recorded images from a plurality of cameras into a panorama and displays the panorama-synthesized image on the third screen.

[0023] (17) A processing device according to (15) or (16), in which the processor determines whether or not a photograph is appropriate for a plurality of recorded camera images based on the images and / or information attached to the images, and displays the determination result on the third screen.

[0024] (18) The processing device of (17), wherein the processor determines whether or not the image is suitable for photography based on the histogram of the image.

[0025] (19) The processing device of (17), wherein the processor determines whether or not the image is appropriate to be captured based on information about the image capturing parameters added to the image.

[0026] (20) The processing device of any one of (15) to (19), wherein the processor accepts the selection of an image on the third screen and displays the shooting parameters of the selected image on the third screen.

[0027] (21) The processing device of (20), wherein the processor displays on the third screen the photographing parameters of the selected image and the photographing parameters of the camera when the selected image was photographed in a comparative manner.

[0028] 1. Diagram showing the schematic configuration of the photography system; 2. Perspective view showing the configuration of the multi-eye photography device; 3. Front view showing the configuration of the multi-eye photography device; 4. Side view showing the configuration of the multi-eye photography device; 5. Front view showing the mounting state of the camera and lighting device on the front panel; 6. Rear view showing the mounting state of the camera and lighting device on the front panel; 7. Front view showing the mounting state of the camera and lighting device on the rear panel; 8. Rear view showing the mounting state of the camera and lighting device on the rear panel; 9. Block diagram showing the electrical configuration of the multi-eye photography device; 10. Diagram showing an example of the hardware configuration of the control device; 11. Functional block diagram of the photography control function of the control device; 12. Functional block diagram of the live view function of the control device; 13. Diagram showing an example of the live view display screen; 14. Conceptual diagram of image display in the image display area; 15. Calculating the overlap range FIG. 1 is a functional block diagram of functions possessed by the control device when the above is obtained by the above method. FIG. 2 is a functional block diagram of functions possessed by the control device when the above method is obtained by the above method. FIG. 3 is a functional block diagram of the control device when the above method is obtained by the above method. FIG. 4 is a functional block diagram of the control device when the above method is obtained by the above method. FIG. 5 is a functional block diagram of the control device when the above method is obtained by the above method. FIG. 6 is a functional block diagram of the control device when the above method is obtained by the above method. FIG. 7 is a functional block diagram of the control device when the above method is obtained by the above method.

[0029] Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0030] First Embodiment Here, an example will be described in which the present invention is applied to a system for photographing the inner wall surface of a tunnel structure.

[0031] Tunnel structures such as water conduits for hydroelectric power plants and subway tunnels are inspected periodically to ensure their safety. Recently, visual inspections have been replaced by image-based inspections. Image-based inspections involve photographing the surface of the tunnel structure with a camera and then visually or by image processing to detect damage such as cracks in the resulting images.

[0032] The photography is usually carried out using a dedicated photography device that can photograph the entire circumference of the tunnel. This photography device is composed of multiple cameras. The multiple cameras are arranged to match the cross-sectional shape of the tunnel structure, and are set so that the photography areas of adjacent cameras partially overlap.

[0033] Tunnel structures come in a variety of cross-sectional shapes. Therefore, the imaging device requires the layout of multiple cameras according to the target and the setting of imaging conditions for each camera. If this work were to be done on-site, it would take a significant amount of time. Furthermore, if there is a setting error in even one camera, re-imaging would be required, so it is necessary to ensure that the correct imaging conditions are set before starting imaging.

[0034] The photographing system of this embodiment provides a photographing system in which the settings of each camera can be easily checked in a system in which photographing is performed using a plurality of cameras.

[0035] [Configuration of Imaging System] FIG. 1 is a diagram showing a schematic configuration of an imaging system.

[0036] As described above, the photography system 1 of this embodiment is configured as a system for photographing the inner wall surface of a tunnel structure TS. The tunnel structure TS, which is the subject of photography, has an arc-shaped cross section (semicircular).

[0037] As shown in Figure 1, the photography system 1 of this embodiment includes a multi-eye photography device 10 that uses multiple cameras to photograph the inner wall surface of a tunnel structure TS, and a control device 100 that controls the multi-eye photography device 10 and processes images photographed by the multi-eye photography device 10.

[0038] The multi-eye imaging device 10 is mounted on, for example, a carriage Tr and photographs while moving within a tunnel structure TS. If rails Ra are laid within the tunnel structure TS, the carriage Tr travels on the rails Ra. The carriage Tr may be equipped with an electric assist function as needed.

[0039] [Multi-eye Photography Apparatus] FIG. 2 is a perspective view showing the configuration of the multi-eye photography apparatus. FIG. 3 is a front view showing the configuration of the multi-eye photography apparatus. FIG. 4 is a side view showing the configuration of the multi-eye photography apparatus. In FIGS. 2 to 4, x, y, and z are three mutually orthogonal axes. The plane including the x-axis and y-axis is the horizontal plane, and the z-axis is the vertical direction. The x-axis direction is the traveling direction of the dolly Tr, and the positive direction of the x-axis (rightward in FIG. 4) is the traveling direction during photography. Therefore, the positive direction of the x-axis (leftward in FIG. 4) is the forward direction (forward direction) of the dolly Tr and the multi-eye photography apparatus 10, and the negative direction (leftward in FIG. 4) is the backward direction (rearward direction) of the dolly Tr and the multi-eye photography apparatus 10.

[0040] The multi-eye photography device 10 is configured using multiple cameras and multiple lighting devices. The number of cameras and lighting devices can be increased or decreased as needed depending on the subject being photographed. Here, we will explain an example in which the multi-eye photography device 10 is configured using nine cameras C1 to C9 and nine lighting devices L1 to L9.

[0041] The multi-eye photographing device 10 has a frame 11 on which a plurality of cameras C1 to C9 and lighting devices L1 to L9 are attached.

[0042] The frame 11 includes a base 12, a front column 13F, a rear column 13R, a front panel 14F, a rear panel 14R, and the like.

[0043] The base 12 has a rectangular, flat plate shape. A front column 13F and a rear column 13R are installed on the base 12.

[0044] The front column 13F and the rear column 13R have a rectangular column shape. The front column 13F and the rear column 13R are arranged at a predetermined distance in the front-to-rear direction (the direction of the x-axis) relative to the base 12. The front column 13F and the rear column 13R are also arranged perpendicular to the base 12. A front panel 14FF is attached to the front column 13F, and a rear panel 14R is attached to the rear column 13R.

[0045] The front panel 14F and the rear panel 14R are disk-shaped and arranged orthogonal to the front-to-rear direction (the direction of the x-axis) of the base 12 and are arranged coaxially. An axis passing through the center of the front panel 14F and the rear panel 14R and parallel to the x-axis is defined as the axis of the multi-eye photography device 10.

[0046] Cameras C1 to C9 and lighting devices L1 to L9 are attached to the front panel 14F or rear panel 14R via brackets B1 to B9. Hereinafter, cameras C1 to C9 will be distinguished from one another as necessary by referring to camera C1 as the "first camera C1," camera C2 as the "second camera C2," camera C3 as the "third camera C3," camera C4 as the "fourth camera C4," camera C5 as the "fifth camera C5," camera C6 as the "sixth camera C6," camera C7 as the "seventh camera C7," camera C8 as the "eighth camera C8," and camera C9 as the "ninth camera C9." Furthermore, the lighting devices L1 to L9 are distinguished from one another by referring to lighting device L1 as the "first lighting device L1," lighting device L2 as the "second lighting device L2," lighting device L3 as the "third lighting device L3," lighting device L4 as the "fourth lighting device L4," lighting device L5 as the "fifth lighting device L5," lighting device L6 as the "sixth lighting device L6," lighting device L7 as the "seventh lighting device L7," lighting device L8 as the "eighth lighting device L8," and lighting device L9 as the "ninth lighting device L9." Furthermore, bracket B1 will be referred to as the "first bracket B1," bracket B2 as the "second bracket B2," bracket B3 as the "third bracket B3," bracket B4 as the "fourth bracket B4," bracket B5 as the "fifth bracket B5," bracket B6 as the "sixth bracket B6," bracket B7 as the "seventh bracket B7," bracket B8 as the "eighth bracket B8," and bracket B9 as the "ninth bracket B9" to distinguish between brackets B1 to B9.

[0047] The first camera C1 and the first lighting device L1 are attached to the front panel 14F via a first bracket B1. The second camera C2 and the second lighting device L2 are attached to the rear panel 14R via a second bracket B2. The third camera C3 and the third lighting device L3 are attached to the front panel 14F via a third bracket B3. The fourth camera C4 and the fourth lighting device L4 are attached to the rear panel 14R via a fourth bracket B4. The fifth camera C5 and the fifth lighting device L5 are attached to the front panel 14F via a fifth bracket B5. The sixth camera C6 and the sixth lighting device L6 are attached to the rear panel 14R via a sixth bracket B6. The seventh camera C7 and the seventh lighting device L7 are attached to the front panel 14F via a seventh bracket B7. The eighth camera C8 and the eighth lighting device L8 are attached to the rear panel 14R via an eighth bracket B8. The ninth camera C9 and the ninth lighting device L9 are attached to the front panel 14F via a ninth bracket B9.

[0048] That is, odd-numbered cameras C1, C3, C5, C7, and C9 and lighting devices L1, L3, L5, L7, and L9 are attached to the front panel 14F, and even-numbered cameras C2, C4, C6, and C8 and lighting devices L2, L4, L6, and L8 are attached to the rear panel 14R.

[0049] The combination of the cameras C1 to C9 and the lighting device L1 attached to the brackets B1 to B9 constitutes the individual photographing units U1 to U9. Hereinafter, as necessary, the set of the first camera C1 and the first lighting device L1 will be referred to as the "first photographing unit U1," the set of the second camera C2 and the second lighting device L2 will be referred to as the "second photographing unit U2," the set of the third camera C3 and the third lighting device L3 will be referred to as the "third photographing unit U3," the set of the fourth camera C4 and the fourth lighting device L4 will be referred to as the "fourth photographing unit U4," the set of the fifth camera C5 and the fifth lighting device L5 will be referred to as the "fifth photographing unit U5," the set of the sixth camera C6 and the sixth lighting device L6 will be referred to as the "sixth photographing unit U6," the set of the seventh camera C7 and the seventh lighting device L7 will be referred to as the "seventh photographing unit U7," the set of the eighth camera C8 and the eighth lighting device L8 will be referred to as the "eighth photographing unit U8," and the set of the ninth camera C9 and the ninth lighting device L9 will be referred to as the "ninth photographing unit U9," in order to distinguish between the photographing units U1 to U9.

[0050] Fig. 5 is a front view showing the state in which the camera and the lighting device are attached to the front panel, and Fig. 6 is a rear view showing the state in which the camera and the lighting device are attached to the front panel.

[0051] Brackets B1, B3, B5, B7, and B9 are arranged on the same circumference with respect to the front panel 14F. Each bracket B1, B3, B5, B7, and B9 is attached to the front panel 14F so that it can move circumferentially within a predetermined angular range (e.g., 30°). Each bracket B1, B3, B5, B7, and B9 is fixed to the front panel 14F with a clamp (e.g., a toggle clamp) CL. Therefore, the position can be easily adjusted by loosening the clamp CL.

[0052] The cameras C1, C3, C5, C7, and C9 are attached to the camera mounting portions provided on the brackets B1, B3, B5, B7, and B9. The lighting devices L1, L3, L5, L7, and L9 are attached to the lighting mounting portions provided on the brackets B1, B3, B5, B7, and B9. The cameras C1, C3, C5, C7, and C9 are attached to the camera mounting portions using, for example, tripod screw holes. The lighting devices L1, L3, L5, L7, and L9 are attached to the lighting mounting portions by fixing the arm portions with bolts.

[0053] The cameras C1, C3, C5, C7, and C9 and the lighting devices L1, L3, L5, L7, and L9 are mounted on the front panel 14F via brackets B1, B3, B5, B7, and B9 and are arranged on the frame 11 in a predetermined orientation. Specifically, the cameras are arranged in a plane (Zy plane) perpendicular to the axis of the multi-eye imaging device 10, facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. More specifically, the cameras C1, C3, C5, C7, and C9 are arranged with their imaging optical axes facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. The cameras C1, C3, C5, C7, and C9 are mounted with the bottom surfaces of their camera bodies parallel to the front panel 14F (parallel to the zy plane) (the bottom sides of the image sensors are mounted parallel to the zy plane). As a result, the cameras C1, C3, C5, C7, and C9 are arranged at predetermined intervals in the circumferential direction in the zy plane, centered on the axis of the multi-eye imaging device 10. The illumination devices L1, L3, L5, L7, and L9 are arranged with their irradiation directions facing outward in the radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. As a result, the cameras C1, C3, C5, C7, and C9 and the illumination devices L1, L3, L5, L7, and L9 are arranged radially in the zy plane, centered on the axis of the multi-eye imaging device 10.

[0054] As described above, the brackets B1, B3, B5, B7, and B9 are attached to the front panel 14F so as to be movable circumferentially within a predetermined angular range. Figures 5 and 6 show the brackets B1, B3, B5, B7, and B9 fixed at their reference positions. By fixing the brackets B1, B3, B5, B7, and B9 at their reference positions, the first camera C1 and the first lighting device L1 are positioned at 330° (-30°) in a front view (Figure 5). The third camera C3 and the third lighting device L3 are positioned at 30°. The fifth camera C5 and the fifth lighting device L5 are positioned at 90°. The seventh camera C7 and the seventh lighting device L7 are positioned at 150°. The ninth camera C9 and the ninth lighting device L9 are positioned at 210°.

[0055] Each bracket B1, B3, B5, B7, and B9 is attached so as to be movable in a circumferential direction within a range of ±15° from a reference position, and therefore each camera C1, C3, C5, C7, and C9 and lighting device L1, L3, L5, L7, and L9 can be adjusted in a circumferential direction within a range of ±15° from the reference position.

[0056] Fig. 7 is a front view showing the state in which the camera and the lighting device are attached to the rear panel, and Fig. 8 is a rear view showing the state in which the camera and the lighting device are attached to the rear panel.

[0057] Brackets B2, B4, B6, and B8 are arranged on the same circumference with respect to the rear panel 14R. Each bracket B2, B4, B6, and B8 is attached to the rear panel 14R so that it can move circumferentially within a predetermined angular range (e.g., 30°). Each bracket B2, B4, B6, and B8 is fixed to the rear panel 14R with a clamp CL. Therefore, the position can be easily adjusted by loosening the clamp CL.

[0058] Cameras C2, C4, C6, and C8 are attached to camera mounting portions provided on brackets B2, B4, B6, and B8. Lighting devices L2, L4, L6, and L8 are attached to lighting mounting portions provided on brackets B2, B4, B6, and B8. Cameras C2, C4, C6, and C8 are attached to the camera mounting portions using, for example, tripod screw holes. Lighting devices L2, L4, L6, and L8 are attached to the lighting mounting portions by fixing their arm portions with bolts.

[0059] The cameras C2, C4, C6, and C8 and the lighting devices L2, L4, L6, and L8 are attached to the rear panel 14R via brackets B2, B4, B6, and B8 and are disposed on the frame 11 in a predetermined orientation. Specifically, they are disposed within a plane (Zy plane) perpendicular to the axis of the multi-eye imaging device 10, facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. More specifically, the cameras C2, C4, C6, and C8 are disposed with their imaging optical axes facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. Furthermore, the cameras C2, C4, C6, and C8 are attached with the bottom surfaces of their camera bodies parallel to the rear panel 14R (parallel to the zy plane) (the bottom sides of the image sensors are attached parallel to the zy plane). As a result, cameras C2, C4, C6, and C8 are arranged at predetermined intervals in the circumferential direction in the zy plane, centered on the axis of multi-eye imaging device 10. Illumination devices L2, L4, L6, and L8 are arranged with their irradiation directions facing outward in the radial direction (normal direction) centered on the axis of multi-eye imaging device 10. As a result, cameras C2, C4, C6, and C8 and illumination devices L2, L4, L6, and L8 are arranged radially in the zy plane, centered on the axis of multi-eye imaging device 10.

[0060] As described above, the brackets B2, B4, B6, and B8 are attached to the rear panel 14R so as to be movable in the circumferential direction within a predetermined angular range. Figures 7 and 8 show the brackets B2, B4, B6, and B8 fixed at their reference positions. By fixing the brackets B2, B4, B6, and B8 at their reference positions, the second camera C2 and the second lighting device L2 are positioned at a 0° angle in a front view (Figure 7). The fourth camera C4 and the fourth lighting device L4 are positioned at a 60° angle. The sixth camera C6 and the sixth lighting device L6 are positioned at a 120° angle. The eighth camera C8 and the eighth lighting device L8 are positioned at a 180° angle. Therefore, the second camera C2 is positioned between the first camera C1 and the third camera C3 in the circumferential direction. The fourth camera C4 is positioned between the third camera C3 and the fifth camera C5 in the circumferential direction. The sixth camera C6 is disposed between the fifth camera C5 and the seventh camera C7 in the circumferential direction. The eighth camera C8 is disposed between the seventh camera C7 and the ninth camera C9 in the circumferential direction. Similarly, the second lighting device L2 is disposed between the first lighting device L1 and the third lighting device L3 in the circumferential direction. The fourth lighting device L4 is disposed between the third lighting device L3 and the fifth lighting device L5 in the circumferential direction. The sixth lighting device L6 is disposed between the fifth lighting device L5 and the seventh lighting device L7 in the circumferential direction. The eighth lighting device L8 is disposed between the seventh lighting device L7 and the ninth lighting device L9 in the circumferential direction.

[0061] Each bracket B2, B4, B6, and B8 is attached so as to be movable within a range of ±15° in the circumferential direction from a reference position, and therefore each camera C2, C4, C6, and C8 and lighting device L2, L4, L6, and L8 can be adjusted in position within a range of ±15° in the circumferential direction from the reference position.

[0062] In the multi-eye photography device 10 configured as described above, nine cameras C1 to C9 and lighting devices L1 to L9 are arranged at predetermined intervals on an arc centered on the axis of the device. Adjacent cameras form pairs whose photography areas overlap.

[0063] The tunnel structure TS to be photographed has an arc-shaped cross section (semicircular). Therefore, the cameras C1 to C9 and the lighting devices L1 to L9 are arranged at predetermined intervals in the circumferential direction on the cross section of the tunnel structure TS.

[0064] When the brackets B1 to B9 are fixed at the reference positions, the cameras C1 to C9 and the lighting devices L1 to L are arranged at 30° intervals. Furthermore, the cameras C1 to C1 and the lighting devices L1 to L are attached so that their positions can be adjusted within a range of ±15° in the circumferential direction.

[0065] The cameras C1 to C9 used are digital cameras. There are no particular limitations on the type of digital camera, as long as it has the function of electrically recording images (still images or moving images). As an example, a digital camera with an interchangeable lens is used. In this embodiment, the cameras C1 to C9 each have storage (storage media) and store captured images in the storage. The storage may be a built-in memory or an exchangeable memory card.

[0066] The lighting devices L1 to L9 used are not particularly limited. As an example, a halogen lamp is used. Other lighting devices such as LED (light emitting diode) lamps and xenon lamps can also be used. In this embodiment, lighting devices with an adjustment function for the illumination angle (illumination direction) are used. Each lighting device L1 to L9 rotates (swings back and forth) around an axis perpendicular to the optical axis of the cameras C1 to C9 to adjust the illumination angle (illumination direction). The lighting devices L1 to L9 have an illumination range that can cover the shooting range of the cameras C1 to C9.

[0067] [Relay Device] FIG. 9 is a block diagram showing the electrical configuration of the camera array.

[0068] As shown in the figure, the multi-eye photographing device 10 has a relay device 20, and is connected to the control device 100 via the relay device 20 so as to be able to communicate with each other.

[0069] The relay device 20 is configured, for example, by a computer equipped with a communication function. The cameras C1 to C9 and the lighting devices L1 to L9 are connected to the relay device 20. The connection between the cameras C1 to C9 and the relay device 20 is not particularly limited. They may be connected via a wired connection to enable communication, or may be connected wirelessly to enable communication.

[0070] The form of communication between the control device 100 and the relay device 20 is not particularly limited. Communication may be wired or wireless. As an example, in this embodiment, the control device 100 and the relay device 20 are connected via a wireless local area network (LAN).

[0071] [Control Device] FIG. 10 is a diagram illustrating an example of the hardware configuration of the control device.

[0072] As shown in the figure, the control device 100 includes a CPU (central processing unit) 111, a ROM (read only memory) 112, a RAM (random access memory) 113, an auxiliary storage device 114, an input device 115, a display device 116, and a communication interface (I / F) 117. Generally, this type of configuration can be realized by a computer. As an example, in this embodiment, the control device 100 is configured as a notebook personal computer. The control device 100 is an example of a processing device.

[0073] The control device 100 functions as a control device when a CPU 111, which is a processor, executes a predetermined program. The program executed by the CPU 111 is stored in the ROM 112 or the auxiliary storage device 114.

[0074] The auxiliary storage device 114 constitutes a storage unit of the control device 100. The auxiliary storage device 114 is constituted by, for example, a hard disk drive (HDD), a solid state drive (SSD), or the like.

[0075] The input device 115 constitutes an operation unit of the control device 100. The input device 115 is constituted by, for example, a keyboard, a mouse, a touch panel, and the like.

[0076] The display device 116 constitutes a display unit of the control device 100. The display device 116 is constituted by, for example, an LCD (liquid crystal display), an OLED (organic light-emitting diode) display, or the like.

[0077] The communication interface 117 constitutes a communication unit of the control device 100. The communication interface 117 is configured to be able to communicate with at least the relay device 20 using a predetermined communication method. As an example, in this embodiment, the communication interface 117 is configured to be able to communicate using a wireless LAN.

[0078] [Functions of the Control Device] The control device 100 has a function to control the multi-eye photography device 10 and a function to process images captured by the multi-eye photography device 10. The function to control the multi-eye photography device 10 includes a function to control photography by the multi-eye photography device 10 (photography control function). The function to process images captured by the multi-eye photography device 10 includes a function to process live view images (live view function).

[0079] [Photography Control Function] FIG. 11 is a functional block diagram of the photography control function of the control device.

[0080] As shown in the figure, the control device 100 has, as its photographing control functions, functions such as a camera control unit 111A and an illumination control unit 111B. The functions of the camera control unit 111A and the illumination control unit 111B are realized by the CPU 111 executing a predetermined program.

[0081] The camera control unit 111A controls the cameras C1 to C9 mounted on the multi-eye photography device 10, causing each of the cameras C1 to C9 to take photographs. Photography includes both still images and moving images. Still image photography also includes so-called interval photography. Interval photography is a function that repeatedly takes still images at regular intervals. The camera control unit 111A causes each of the cameras C1 to C9 to take photographs based on operation input (instructions to take photographs) from the input device 115. In the case of moving image photography and interval photography, photography is started in response to an instruction to start photography, and ended in response to an instruction to end photography.

[0082] The illumination control unit 111B controls the illumination devices L1 to L9 installed in the multi-eye imaging apparatus 10. In other words, it controls the on / off of the illumination light emitted from the illumination devices L1 to L9. The illumination control unit 111B emits the illumination light based on operation input (on command and off command) from the input device 115.

[0083] [Live View Function] Live view is a function that displays images captured by an image sensor in real time. The control device 100 displays live view images from the cameras C1 to C9 mounted on the multi-eye photographing device 10 on the display device 116 in a predetermined format.

[0084] FIG. 12 is a functional block diagram of the live view function of the control device.

[0085] As shown in the figure, the control device 100 has, as a live view function, functions such as an image acquisition unit 111C, an overlap range detection unit 111D, an overlap rate calculation unit 111E, a setting determination unit 111F, and a display control unit 111G.

[0086] The image acquisition unit 111C acquires live view images from the cameras C1 to C9 mounted on the multi-eye imaging device 10. Each of the cameras C1 to C9 outputs a live view image to the control device 100 under the control of the camera control unit 100A. In other words, the images captured by the image sensor are output sequentially in chronological order. The live view images are an example of images captured by the cameras in chronological order.

[0087] The overlap area detection unit 111D processes the images acquired from each of the cameras C1 to C9 and detects the overlap area between the images of adjacent cameras. Specifically, it detects the overlap area between the first camera C1 and the second camera C2, between the second camera C2 and the third camera C3, between the third camera C3 and the fourth camera C4, between the fourth camera C4 and the fifth camera C5, between the fifth camera C5 and the sixth camera C6, between the sixth camera C6 and the seventh camera C7, between the seventh camera C7 and the eighth camera C8, and between the eighth camera C8 and the ninth camera C9.

[0088] A known method is used to detect the overlapping area through image processing. For example, the overlapping area detection unit 111D detects feature points of objects in each of the two images and detects the overlapping area between the two images based on the detected feature points. The detection result is output to the display control unit 111G and the overlapping rate calculation unit 111E.

[0089] The overlap rate calculation unit 111E calculates the image overlap rate (also called the side overlap rate) between images from adjacent cameras C1 to C9. The overlap rate is calculated as the proportion of overlap between images from adjacent cameras relative to the entire image. Therefore, for example, if the area of ​​the entire image is Sa and the area of ​​the region of the entire image that overlaps with images from adjacent cameras is Sb, the overlap rate OLR is calculated as OLR = Sb / Sa.

[0090] The overlap rate of images is calculated by calculating the overlap rate between the image of the first camera C1 and the image of the second camera C2. Also, the overlap rate between the image of the second camera C2 and the image of the third camera C3 is calculated. That is, the overlap rate between the image of the nth camera and the image of the n+1th camera is calculated (n=1, 2, ..., 8).

[0091] The overlap rate calculation unit 111E calculates the overlap rate between the images based on the detection result of the overlap range detection unit 111D. The calculation result is output to the display control unit 111G and the setting determination unit 111F.

[0092] The setting determination unit 111F determines whether the settings of each camera C1 to C9 are appropriate (OK or NG) based on the overlap rate calculated by the overlap rate calculation unit 111E. The images captured by each camera C1 to C9 are panoramic-composite-composite for later use. In order to reliably combine the images captured by each camera C1 to C9 into a panoramic image, a certain overlap rate or higher is required between adjacent images. Furthermore, even if panoramic composition is not performed, it is necessary to capture the entire circumference without omission. The setting determination unit 111F acquires the overlap rate calculated by the overlap rate calculation unit 111E and compares it with a threshold value to determine whether the settings of each camera C1 to C9 are appropriate. That is, if the overlap rate is equal to or greater than the threshold value, it is determined that images suitable for panoramic composition can be captured with the current settings, and the setting is determined to be OK. On the other hand, if the overlap rate is less than the threshold value, it is determined that images suitable for panoramic composition cannot be captured with the current settings, and the setting is determined to be NG. For example, if the overlap rate between the image of the nth camera and the image of the n+1th camera is less than a threshold, the settings of the nth camera and the n+1th camera are determined to be NG. As an example, the threshold is 20%.

[0093] The display control unit 111G controls the screen display on the display device 116. In the live view function, the display of the live view images from each of the cameras C1 to C9 is controlled based on the detection result of the overlap range and the calculation result of the overlap rate.

[0094] [Live View Display] Live view images from each of the cameras C1 to C9 are displayed on the screen of the display device 116 in a predetermined display format.

[0095] FIG. 13 is a diagram showing an example of a live view display screen.

[0096] As shown in the figure, the live view display screen DS1 displays (1) live view images from each camera, (2) overlap rate information, and (3) information on the appropriateness of the settings for each camera. The live view display screen DS1 is an example of the first screen.

[0097] (1) Live View Images of Each Camera Live view images of each camera C1 to C9 are individually displayed in a plurality of image display areas DA1 to DA2 set within the screen.

[0098] Each of the image display areas DA1 to DA9 is set independently within the screen, where "independently" means that the image display areas DA1 to DA9 do not overlap with one another.

[0099] Furthermore, each image display area DA1-DA9 is arranged on the screen in a layout corresponding to the arrangement of each camera C1-C9 in the multi-eye imaging device 10. Note that "corresponding layout" does not require an exact same layout, but rather includes a range that is considered to be approximately the same. In other words, it is sufficient for the layout to be roughly equivalent. In the multi-eye imaging device 10 of this embodiment, each camera C1-C9 is arranged approximately equally spaced on the same circumference (approximately 30° apart). Therefore, each camera is arranged equally spaced on the same circumference (30° apart). In this embodiment, a cross-sectional view CS of the tunnel structure TS, which is the subject of imaging, is displayed on the screen, and each image display area DA1-DA9 is set around it. This allows the approximate imaging positions of each camera C1-C9 to be grasped. Note that the cross-sectional view CS is not a strict cross-sectional view of the tunnel structure TS, but an approximate cross-sectional view. In other words, it is a view that allows the approximate cross-sectional shape to be understood.

[0100] Hereinafter, as necessary, image display area DA1 will be referred to as the "first image display area DA1," image display area DA2 as the "second image display area DA2," image display area DA3 as the "third image display area DA3," image display area DA4 as the "fourth image display area DA4," image display area DA5 as the "fifth image display area DA5," image display area DA6 as the "sixth image display area DA6," image display area DA7 as the "seventh image display area DA7," image display area DA8 as the "eighth image display area DA8," and image display area DA9 as the "ninth image display area DA9," to distinguish between each of the image display areas DA1 to DA9.

[0101] The first image display area DA1 displays an image from the first camera C1. The number "1" is displayed adjacent to the first image display area DA1, indicating that the image from the first camera C1 is displayed. The second image display area DA2 displays an image from the second camera C2. The number "2" is displayed adjacent to the second image display area DA2, indicating that the image from the second camera C2 is displayed. The third image display area DA3 displays an image from the third camera C3. The number "3" is displayed adjacent to the third image display area DA3, indicating that the image from the third camera C3 is displayed. The fourth image display area DA4 displays an image from the fourth camera C4. The number "4" is displayed adjacent to the fourth image display area DA4, indicating that the image from the fourth camera C4 is displayed. The fifth image display area DA5 displays an image from the fifth camera C5. The fifth image display area DA5 displays a number "5" adjacent to the fifth image display area DA5, indicating that the image from the fifth camera C5 is displayed. The sixth image display area DA6 displays an image from the sixth camera C6. The number "6" is displayed adjacent to the sixth image display area DA6, indicating that an image from the sixth camera C6 is displayed. The seventh image display area DA7 displays an image from the seventh camera C7. The number "7" is displayed adjacent to the seventh image display area DA7, indicating that an image from the seventh camera C7 is displayed. The eighth image display area DA8 displays an image from the eighth camera C8. The number "8" is displayed adjacent to the eighth image display area DA8, indicating that an image from the eighth camera C8 is displayed. The ninth image display area DA9 displays an image from the ninth camera C9. The ninth image display area DA9 displays a number "9" adjacent to the ninth image display area DA9, indicating that an image from the ninth camera C9 is displayed.

[0102] In each of the image display areas DA1 to DA9, the images from each of the cameras C1 to C2 are displayed so that the overlapping range between the images from the adjacent cameras can be identified.

[0103] 14 is a conceptual diagram of image display in the image display area, showing an example in which an image IM1 captured by a first camera C1 and an image IM2 captured by a second camera C2 are displayed.

[0104] The first camera C1 and the second camera C2 form a pair of cameras whose shooting areas overlap. In Fig. 14, the area where the images IM1 and IM2 overlap (the shaded area) is the image overlap range OL1-2.

[0105] The images IM2 and IM2 are displayed in the first image display area DA1 and the second image display area DA2 so that the overlapping range OL1-2 can be distinguished. In the example shown in Fig. 14, in each of the image display areas DA1 and DA2, the overlapping range OL1-2 is enclosed by a frame F and the brightness of the image within the overlapping range OL1-2 is reduced, thereby making the overlapping range OL1-2 distinguishable.

[0106] In this way, by displaying the overlapping range in a distinguishable manner, it is possible to easily grasp the overlapping state of images between adjacent cameras, even when images from each camera C1 to C9 are displayed in independent image display areas DA1 to DA9.

[0107] In this example, in addition to the frame F, the brightness of the image within the overlapping range is changed for distinguishable display, but a configuration in which only the frame F is displayed may also be used. Alternatively, a configuration in which only the brightness is changed may also be used. In addition, the overlapping range may be masked to display the overlapping range in a distinguishable manner. Various modes can be used for distinguishable display.

[0108] In addition, in this example, for the image IM2 of the second camera C2, only the overlapping range with the image of the first camera C1 is shown, but the image IM2 of the second camera C2 also shows the overlapping range with the image of the third camera C3.

[0109] In this way, the images of each camera C1 to C9 are displayed in the image display areas DA1 to DA9 in such a way that the overlapping ranges between the images of adjacent cameras can be distinguished. That is, the overlapping ranges (first ranges) of the images and the non-overlapping ranges (second ranges) of the images are displayed in a manner that allows for distinction. In Fig. 14, the hatched areas of the images displayed in each image display area are examples of the first ranges (overlapping ranges of the images), and the non-hatched areas are examples of the second ranges (non-overlapping areas).

[0110] (2) Information on Overlap Rate As shown in FIG. 13, information on overlap rate is displayed in overlap rate display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 set on the screen.

[0111] The overlap rate display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 are set as rectangular frames and are set between the image display areas DA1 to DA2. In this embodiment, the image display areas DA1 to DA2 are arranged in an arc shape at regular intervals, and therefore the overlap rate display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 are also arranged in an arc shape at regular intervals. In the example shown in FIG. 13, they are arranged at regular intervals in areas outside the image display areas DA1 to DA2.

[0112] The overlap rate display area OR1-2 is an area that displays the overlap rate of the area between the image of the first camera C1 and the image of the second camera C2, and is set in the area between the first image display area DA1 and the second image display area DA2. The overlap rate display area OR2-3 is an area that displays the overlap rate of the image of the second camera C2 and the image of the third camera C3, and is set in the area between the second image display area DA2 and the third image display area DA3. The overlap rate display area OR3-4 is an area that displays the overlap rate of the image of the third camera C3 and the image of the fourth camera C4, and is set in the area between the third image display area DA3 and the fourth image display area DA4. The overlap rate display area OR4-5 is an area that displays the overlap rate of the image of the fourth camera C4 and the image of the fifth camera C5, and is set in the area between the fourth image display area DA4 and the fifth image display area DA5. The overlap rate display area OR5-6 is an area that displays the overlap rate between the image from the fifth camera C5 and the image from the sixth camera C6, and is set in the area between the fifth image display area DA5 and the sixth image display area DA6. The overlap rate display area OR6-7 is an area that displays the overlap rate between the image from the sixth camera C6 and the image from the seventh camera C7, and is set in the area between the sixth image display area DA6 and the seventh image display area DA7. The overlap rate display area OR7-8 is an area that displays the overlap rate between the image from the seventh camera C7 and the image from the eighth camera C8, and is set in the area between the seventh image display area DA7 and the eighth image display area DA8. The overlap rate display area OR8-9 is an area that displays the overlap rate between the image from the eighth camera C8 and the image from the ninth camera C9, and is set in the area between the eighth image display area DA8 and the ninth image display area DA9.

[0113] Information on the overlap rate between each image is displayed within overlap rate display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9, which are configured as frames. Additionally, overlap rates below a threshold are highlighted. For example, the background color and text color are displayed inverted. FIG. 13 shows an example in which the overlap rate between the image from the seventh camera C7 and the image from the eighth camera C8 is below a threshold. Additionally, FIG. 13 shows an example in which the overlap rate is highlighted by inverting the display. By highlighting the images in this way, it is possible to see at a glance which images have an overlap rate below the threshold.

[0114] The highlighting method is not limited to inversion, and other methods can also be used, such as changing the color of the text, changing the color of the frame, blinking the display, or displaying a predetermined mark near the frame.

[0115] (3) Information on the appropriateness of the settings of each camera As shown in Fig. 13, information on the appropriateness of the settings of each camera is displayed in a camera information display area CI set within the screen. In the camera information display area CI, information on the appropriateness of the settings is displayed in a list.

[0116] In the camera information display area CI, information on the judgment results of the appropriateness of the settings of each camera C1 to C9 is displayed in a cell separated by camera. Cameras with a judgment result of NG are highlighted. For example, the background color and the text color are displayed in reverse. Fig. 13 shows an example where the judgment results of the seventh camera C7 and the eighth camera C8 are NG. Fig. 13 also shows an example where the results are highlighted by inverting the display. By highlighting the settings in this way, it is possible to see at a glance which cameras have NG settings.

[0117] [Operation of the Photography System] Photography of the tunnel structure TS using the photography system 1 of this embodiment is performed as follows.

[0118] First, the multi-eye photography device 10 is mounted on a cart Tr and positioned at the photography start position of the tunnel structure TS. Next, the multi-eye photography device 10 and the control device 100 are connected so that they can communicate with each other. This makes it possible for the control device 100 to control the multi-eye photography device 10.

[0119] First, the user instructs the control device 100 to display a live view image. In response to this instruction, the control device 100 instructs each of the cameras C1 to C9 of the multi-eye imaging device 10 to output a live view image. In response to this instruction, each of the cameras C1 to C9 outputs a live view image to the control device 100.

[0120] The control device 100 acquires live view images from the cameras C1 to C9 and displays them on the display device 116 in a predetermined display format.

[0121] On the live view display screen DS1, in addition to the live view images from each of the cameras C1 to C9, information on the overlap rate between images from adjacent cameras and information on the appropriateness of the settings for each of the cameras C1 to C9 are displayed, as shown in Fig. 13. The live view images from each of the cameras C1 to C9 are displayed so that the overlapping range between the images from adjacent cameras can be identified.

[0122] The user checks the live view display screen DS1 to confirm whether the settings of cameras C1 to C9 are appropriate. In the example of FIG. 13 , it can be seen that the settings of the seventh camera C7 and the eighth camera C8 are incorrect. The user then makes the necessary adjustments based on the results of the check. In the example of FIG. 13 , the image overlap rate between the sixth camera C6 and the seventh camera C7 (35%) is greater than the image overlap rate between the seventh camera C7 and the eighth camera C8 (10%), confirming that there is an error in the settings of the seventh camera C7 (it is shifted toward the sixth camera C6). Therefore, in this case, the position of the seventh camera C7 is adjusted. Specifically, the position of the seventh camera C7 is fine-tuned closer to the eighth camera C8.

[0123] When the positions of cameras C1 to C9 are adjusted during live view display, the display on the display screen DS1 also changes. That is, the adjustment results are reflected. The user checks the live view display screen DS1 and adjusts the positions of cameras C1 to C9 so that the setting judgment results for all cameras C1 to C9 are OK. That is, the positions are adjusted so that the image overlap rate between adjacent cameras is equal to or greater than a threshold.

[0124] After the adjustment is complete, shooting begins. That is, the cart Tr is driven to move within the tunnel structure TS, and the multi-eye photography device 10 photographs the inner wall surface of the tunnel structure TS. When shooting moving images, the user instructs the multi-eye photography device 10 to start shooting, and shooting begins. When manually shooting still images, the user instructs the multi-eye photography device 10 to start shooting via the control device 100. When performing interval shooting, the user specifies the shooting interval and instructs the multi-eye photography device 10 to start shooting.

[0125] As described above, with the photography system of this embodiment, the photography status and setting status of the cameras C1 to C9 mounted on the multi-eye photography device 10 can be easily confirmed from the live view display screen DS1. This makes it easy to check whether the photography conditions are correct. Furthermore, even if adjustments are necessary, they can be easily made based on the screen display. This significantly reduces the amount of work required on-site.

[0126] [Modifications] [Method of Detecting Overlapping Areas] In the above embodiment, the overlapping area is detected by image processing, but the method of detecting the overlapping area is not limited to this. If the required information regarding the subject and the camera can be obtained, the overlapping area can be found by calculation from this information. For example, if information on the angle of view of each camera C1 to C9 and information on the distance from each camera C1 to C9 to the inner wall surface of the tunnel (information on the subject distance) can be obtained, the shooting range of each camera C1 to C9 can be found. Furthermore, if information on the positional relationship and shooting direction of each camera C1 to C2 can be obtained, the range of overlap between the shooting areas of adjacent cameras can be calculated (estimated) from this information.

[0127] FIG. 15 is a functional block diagram of the functions of the control device when the overlapping range is determined by calculation.

[0128] As shown in the figure, the control device 100 has the functions of a camera information acquisition unit 111H that acquires information about cameras C1 to C9, and a subject information acquisition unit 111I that acquires information about the subject. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0129] The camera information acquisition unit 111H acquires information necessary for calculating the overlap range from each of the cameras C1 to C9. This information includes at least information on the angle of view of each of the cameras C1 to C9. The angle of view can be calculated from information on the focal length and sensor size. Therefore, instead of directly acquiring information on the angle of view, information on the focal length and sensor size can also be acquired. Information on the positional relationship between the cameras and information on the shooting direction is assumed to be previously stored in the control device 100 as known information. For example, information on the positional relationship between the cameras and information on the shooting direction when each of the brackets B1 to B9 is positioned at a reference position is stored.

[0130] The subject information acquisition unit 111I acquires information on the distance from each of the cameras C1 to C9 to the tunnel inner wall (subject distance information). If each of the cameras C1 to C9 has a distance measurement function, this information is acquired from each of the cameras C1 to C9. Alternatively, if the camera array 10 is equipped with a distance measurement sensor or distance measurement means such as LIDAR (light detection and ranging, laser imaging detection and ranging), the information can also be acquired from the distance measurement sensor or distance measurement means. Furthermore, if design data of the subject (e.g., CAD (computer-aided design) data) exists, the design data can also be acquired. If the design data of the subject can be acquired, the subject distance can be calculated in advance from the installation position of the camera array 10. The design data can also be acquired, for example, via a network.

[0131] The overlap range detection unit 111D calculates the shooting area (shooting range) of each camera C1 to C9 based on the information acquired by the camera information acquisition unit 111H and the subject information acquisition unit 111I, and also calculates the range in which the shooting ranges of adjacent cameras overlap.

[0132] If information about the camera to be used is already known, the information may be stored in advance in the control device 100. In this case, only information about the subject is acquired from outside.

[0133] Also, instead of the overlapping range (first range), a non-overlapping range (second range) may be detected, or both may be detected.

[0134] [Live View Display Screen] FIG. 16 is a diagram showing another example of a live view display screen.

[0135] This figure shows an example in which the images from each camera are displayed without tilt. In this case, each image display area DA1 to DA9 is set without tilt. That is, the bottom side of each image display area DA1 to DA9, which is formed by a rectangular frame, is set parallel to the bottom side of the screen of the display device 116.

[0136] In this way, each of the image display areas DA1 to DA9 is only required to be able to independently display the image from each camera, and the orientation thereof can be set appropriately taking into consideration the ease of viewing the image, etc.

[0137] FIG. 17 is a diagram showing another example of the live view display screen.

[0138] This figure shows an example of photographing a tunnel structure with a horseshoe-shaped cross section. A cross-sectional view CS of the tunnel structure to be photographed is displayed on the screen, and image display areas DA1 to DA9 are set around it. In this case, too, the image display areas DA1 to DA9 are set in a layout that roughly corresponds to the placement of cameras C1 to C9.

[0139] FIG. 18 is a diagram showing another example of the live view display screen.

[0140] This figure shows an example in which a cross-sectional view of the tunnel structure is not displayed. As shown in this example, it is not necessary to display a cross-sectional view of the tunnel structure. In this example, too, the image display areas DA1 to DA9 are set in a layout that roughly corresponds to the arrangement of the cameras C1 to C9. In other words, the image display areas DA1 to DA9 are set at approximately regular intervals in the circumferential direction for the cameras C1 to C9, which are arranged at approximately regular intervals in the circumferential direction.

[0141] [Other Modifications] In the above embodiment, a case where a live view image is displayed has been described as an example, but captured images can also be displayed in a similar format.

[0142] [Second Embodiment] As described above, if there is an error in the camera settings, the settings need to be revised. The photography system of this embodiment is a photography system that further includes a function for automatically calculating correction conditions and presenting the results to the user when there is an error in the camera settings. Since the basic configuration of the system is the same, only the function related to the calculation and presentation of correction conditions will be described here.

[0143] FIG. 19 is a functional block diagram of the control device of this embodiment.

[0144] As shown in the figure, the control device 100 of this embodiment has functions related to the calculation and presentation of correction conditions, such as a camera information acquisition unit 111H, a subject information acquisition unit 111I, and a correction condition calculation unit 111J. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0145] As described above, the camera information acquisition unit 111H acquires information necessary for calculating the overlapping range from each of the cameras C1 to C9, and the subject information acquisition unit 111I acquires information on the distance from each of the cameras C1 to C9 to the inner wall surface of the tunnel (subject distance information).

[0146] If there is a camera with an inappropriate setting, the correction condition calculation unit 111J calculates the correction conditions. That is, it calculates the correction conditions for shooting at a specified overlap rate (for example, 20% or more). The correction condition calculation unit 111J calculates the necessary correction conditions based on the overlap rate information calculated by the overlap rate calculation unit 111E, the information acquired by the camera information acquisition unit 111H, and the information acquired by the subject information acquisition unit 111I. Specifically, it calculates the adjustment direction and adjustment amount. The adjustment direction is specified by specifying a counterclockwise direction as a positive direction and a clockwise direction as a negative direction when viewed from the front of the multi-eye photography device 10. The adjustment amount is specified by an angle. The calculation results of the correction condition calculation unit 111J are output to the display control unit 111G. The display control unit 111G displays the correction information on the live view display screen DS1.

[0147] FIG. 20 is a diagram showing an example of a live view display screen.

[0148] The display control unit 111G displays correction information in the camera information display area CI together with information on whether the settings of each camera are appropriate.

[0149] Furthermore, the display control unit 111G highlights and displays the image display area of ​​the camera to be adjusted. Fig. 20 shows an example in which the seventh camera C7 is the camera to be adjusted. The highlighting method is not particularly limited. For example, the image display area can be highlighted by changing the thickness of the frame, changing the color, or blinking. Fig. 20 shows an example in which the image display area is highlighted by thickening the frame.

[0150] The user looks at the live view display screen DS1 and makes any necessary adjustments. In the example of Fig. 20, the seventh camera C7 is tilted 5° clockwise (negative direction).

[0151] As described above, according to the photography system of this embodiment, if there is an error in the camera settings, the necessary adjustment amount is automatically calculated and displayed, which makes on-site work easier.

[0152] [Modification] In the above embodiment, the camera correction direction and correction amount are calculated as correction conditions, but it is also possible to calculate only the correction direction or only the correction amount.

[0153] In the above embodiment, the overlap rate is corrected by adjusting the camera orientation (photographing direction). However, the overlap rate can also be corrected by adjusting the focal length (zoom magnification). In this case, for example, a focal length correction value is calculated. Alternatively, the focal length correction direction (telephoto direction or wide angle direction) is calculated.

[0154] The correction conditions may be calculated using only the camera information and the subject information, or may be calculated using only the overlap rate information.

[0155] [Third Embodiment] As described above, when taking pictures using multiple cameras, if there is an error in the settings of even one camera, the picture must be taken again. However, checking the settings for each camera is time-consuming. The photography system of this embodiment is a photography system that also has a function for managing multiple cameras in an integrated manner. Since the basic configuration of the system is the same, only the function for managing multiple cameras in an integrated manner will be described here.

[0156] FIG. 21 is a functional block diagram of the control device of this embodiment.

[0157] As shown in the figure, the control device 100 of this embodiment has functions related to the overall management of multiple cameras, such as a camera information acquisition unit 111H, a display control unit 111G, a setting change acceptance unit 111K, and a camera control unit 111A. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0158] The camera information acquisition unit 111H acquires various types of information from each of the cameras C1 to C9 mounted on the multi-eye imaging device 10. As an example, information such as the set shutter speed, aperture value (F-number), ISO sensitivity (ISO: International Organization for Standardization), focal length, remaining battery power, and free space in the storage medium (storage) is acquired. Information such as the shutter speed, aperture value, ISO sensitivity, and focal length are examples of information related to imaging parameters. Information related to the remaining battery power is an example of information related to the battery. Information related to the free space in the storage medium is an example of information related to the available storage capacity of images.

[0159] The display control unit 111G displays the information (camera information) of each of the cameras C1 to C2 acquired by the camera information acquisition unit 111H in a predetermined display format on the screen of the display device 116. This screen is configured as a screen different from the live view display screen.

[0160] FIG. 22 is a diagram showing an example of a display screen of camera information.

[0161] As shown in the figure, the camera information display screen DS2A displays a list of various information acquired from each of the cameras C1 to C9 on the same screen. The camera information display screen DS2A is an example of the second screen.

[0162] FIG. 22 shows an example of displaying information such as shutter speed, aperture value, ISO sensitivity, focal length, remaining battery capacity, and free space on the storage medium.

[0163] The first row of the matrix displays camera information XA1, the second column displays shutter speed (SS) information XA2, the third column displays aperture value (F-number) information XA3, the fourth column displays ISO sensitivity information XA4, the fifth column displays focal length f information XA5, the sixth column displays remaining battery capacity XA6, the seventh column displays free space information XA7 on the storage media, and the eighth column displays information XA8 on the storage media free space status determination result. The remaining battery capacity is displayed as a percentage, with a fully charged state being 100. The storage media free space status determination result is displayed, with free space equal to or greater than a threshold being OK and free space less than the threshold being NG. The determination result on the storage media free space status is an example of a determination result on the suitability of the camera status.

[0164] In this way, by displaying a list of information about each of the cameras C1 to C9 mounted on the camera array 10, the setting status of each of the cameras C1 to C2 can be grasped all at once.

[0165] The setting change acceptance unit 111K accepts changes to the settings of each of the cameras C1 to C9 from the user. The acceptance of setting changes is performed via the camera information display screen DS2A. In other words, the setting changes are accepted for the items displayed in the list on the camera information display screen DS2A (excluding the remaining battery power and the free space on the storage media).

[0166] In the example shown in FIG. 22, the settings of the shutter speed, aperture value, ISO sensitivity, and focal length can be changed.

[0167] FIG. 23 is a diagram showing an example of a method for accepting a setting change.

[0168] As shown in the figure, a pull-down menu (also called a drop-down menu) PM is displayed to accept changes to settings. The pull-down menu PM is displayed by moving the mouse over the item whose setting you want to change and clicking it. The pull-down menu PM displays a list of selectable items. Figure 23 shows an example of changing the aperture value (F-number) of the second camera (CAMERA 2).

[0169] When a setting change is made, a setting reflect button BT1 is displayed on the screen. To reflect the setting change, click the setting reflect button BT1. This completes the acceptance of the setting change.

[0170] The camera control unit 111A changes the settings of the corresponding camera in accordance with the content of the setting change received by the setting change receiving unit 111K.

[0171] As described above, according to the photography system of this embodiment, the setting status of the cameras C1 to C9 mounted on the multi-eye photography device 10 can be checked collectively on the control device 100. This makes it easy to manage the settings of each of the cameras C1 to C9. Furthermore, the settings of each of the cameras C1 to C9 can be changed on the control device 100 side as needed. This reduces the effort required for setting.

[0172] [Modifications] In the above embodiment, the configuration accepts changes to the settings of each camera individually, but it is also possible to change the settings collectively. For example, clicking the title of each item displays a pull-down menu, and the selected setting is reflected in all cameras. Alternatively, a configuration may be adopted in which changing the settings of one camera automatically switches the settings of the other cameras to the same setting. In this case, it is preferable to allow the user to select whether to change the settings individually or collectively. For example, a configuration may be adopted in which a predetermined checkbox is provided, and the settings are changed collectively only when the checkbox is checked.

[0173] Furthermore, in the above embodiment, the configuration is such that the change in the settings is reflected in response to an execution instruction using the setting reflection button BT1, but the configuration may be such that the change is reflected in the camera immediately.

[0174] Furthermore, in the above embodiment, the settings are changed using a pull-down menu, but it is also possible to change the settings by inputting numerical values, for example.

[0175] [Fourth embodiment] The photographing system of this embodiment is a photographing system further equipped with a function of presenting camera settings suitable for a subject to a user. Since the basic configuration of the system is the same as that of the fourth embodiment, only the function of presenting camera settings suitable for a subject will be described here.

[0176] FIG. 24 is a functional block diagram of the control device of this embodiment.

[0177] As shown in the figure, the control device 100 of this embodiment has functions related to the function of presenting camera settings suitable for a subject, such as a camera information acquisition unit 111H, a subject information acquisition unit 111I, a camera setting calculation unit 111L, a display control unit 111G, a setting change acceptance unit 111K, and a camera control unit 111A. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0178] The camera information acquisition unit 111H acquires information necessary for calculating the camera settings from each of the cameras C1 to C9. This information includes at least information on the angle of view of each of the cameras C1 to C9, or information that allows the angle of view to be calculated (focal length information and sensor size information). Note that information on the positional relationship between the cameras and information on the shooting direction are assumed to be known information and are stored in advance in the control device 100.

[0179] The subject information acquisition unit 111I acquires information about the subject. The information about the subject includes at least information that can be used to calculate subject distance information (information about the distance from each of the cameras C1 to C9 to the inner wall surface of the tunnel). As an example, the subject information acquisition unit 111I acquires design data of the subject.

[0180] The camera setting calculation unit 111L calculates (estimates) recommended camera settings suitable for photographing a subject based on information acquired by the camera information acquisition unit 111H and the subject information acquisition unit 111I. Specifically, it calculates the shooting parameters suitable for photographing the subject and the installation position of each camera. The calculated shooting parameters include, for example, shutter speed, aperture value, ISO sensitivity, and focal length. The shutter speed, aperture value, and ISO sensitivity settings are calculated based on, for example, information on the subject distance and information on the brightness of the lighting devices L1 to L9. The focal length is calculated to be a setting that allows the wall surface to be photographed at a specified resolution. The brightness information of the lighting devices L1 to L9 is assumed to be previously stored in the control device 100 as known information. The installation position of each camera is calculated, for example, by calculating the adjustment direction and amount of adjustment of the bracket from a reference position. The installation position of each camera is set so that the image overlap rate between adjacent cameras satisfies a predetermined condition (for example, 20%).

[0181] The display control unit 111G causes the information (estimated results) of the recommended settings calculated by the camera setting calculation unit 111L to be displayed on the screen of the display device 116 in a predetermined display format.

[0182] FIG. 25 is a diagram showing an example of a display screen for the recommended settings of the camera.

[0183] As shown in the figure, the camera recommended setting display screen DS2B displays information on the estimated recommended settings for each camera.

[0184] 25 shows an example of displaying recommended settings for the shutter speed, aperture value, ISO sensitivity, and focal length as shooting parameters. As shown in the figure, recommended settings information for shutter speed, aperture value, ISO sensitivity, and focal length is displayed for each camera. Also, recommended installation position information (information on the bracket adjustment direction and adjustment amount from the reference position) is displayed for each camera.

[0185] If the user accepts the recommended settings for the shooting parameters, the user clicks the setting reflection button BT1 displayed on the screen. This accepts the reflection of the settings. Upon accepting the reflection of the settings, the camera control unit 111A sets the shooting parameters of each camera according to the conditions of the recommended settings.

[0186] To change the settings, proceed as in the third embodiment. Simply move the mouse over the item whose settings you wish to change and click. This will display a pull-down menu, allowing you to change the recommended settings (see FIG. 23).

[0187] If the camera positions need to be corrected, the user corrects the positions of the cameras C1 to C9 based on the display on the screen.

[0188] In this way, with the photography system of this embodiment, it is possible to know the camera settings (recommended settings) suitable for the subject simply by inputting the required information into the control device 100. This makes it easy to perform various settings.

[0189] In the above embodiment, the settings are reflected by pressing the setting reflection button BT1. However, the settings may be calculated and then automatically reflected.

[0190] Fifth Embodiment The photography system of this embodiment is a photography system further equipped with a function for displaying images (photographed images) captured by the multi-eye photography device 10. Note that the "photographed images" here refer to images that have been captured in response to a user's instruction for actual photography (photography for the purpose of recording) and recorded in storage (storage media). In other words, they are recorded images. The basic configuration of the system is the same, so only the function for displaying photographed images will be described here.

[0191] FIG. 26 is a functional block diagram of the control device of this embodiment.

[0192] As shown in the figure, the control device 100 of this embodiment has functions related to the function of displaying a captured image, such as an image acquisition unit 111C, a recording control unit 111M, an image processing unit 111N, and a display control unit 111G. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0193] The image acquisition unit 111C acquires captured images from each of the cameras C1 to C9 mounted on the multi-eye photographing device 10. Each of the cameras C1 to C9 captures images in response to an instruction for actual photographing from the control device 100, and outputs the images recorded on storage media to the control device 100.

[0194] The recording control unit 111M records the captured images acquired from each of the cameras C1 to C9 in the auxiliary storage device 114. The images are recorded in a manner that allows identification of information about the recording source (information about the camera that captured the image) and information about the recording order (for example, information about the date and time). As an example, images are recorded in separate directories for each capture (image of one tunnel), and then each directory is further divided into separate directories for each camera.

[0195] The image processing unit 111N performs predetermined image processing on the captured image in response to an instruction from the user, for example, panoramic synthesis processing.

[0196] The display control unit 111G displays the captured image on the screen of the display device 116 in a predetermined display format in response to an instruction from the user.

[0197] FIG. 27 is a diagram showing an example of a display screen for a captured image.

[0198] As shown in the figure, the captured image display screen DS3A displays images captured by each of the cameras C1 to C9 in chronological order. The images in each column are chronologically captured images captured by each of the cameras C1 to C9, and are displayed in chronological order from top to bottom. The images in each row are captured at the same time by each of the cameras C1 to C9. The captured image display screen DS3A is an example of a third screen.

[0199] As shown in FIG. 27, a capture button BT2, a delete button BT3, and a combine button BT4 are displayed on the captured image display screen DS3A.

[0200] The shooting button BT2 is a button that instructs the multi-eye photographing device 10 to perform actual photographing. Pressing this shooting button BT2 instructs the multi-eye photographing device 10 to perform actual photographing of a still image (capture a still image for recording) via the camera control unit 111A (see FIG. 11). Then, when the actual photographing is performed, the images (photographed images) captured by each of the cameras C1 to C9 are output to the control device 100 and displayed on the screen.

[0201] The delete button BT3 is a button for instructing the deletion of an image. When the image to be deleted is selected from the images displayed on the screen and the delete button BT3 is pressed, the selected image is deleted. Note that image deletion may be performed by both the cameras C1 to C9 and the control device 100, or may be performed by the control device 100 alone.

[0202] The combine button BT4 is a button for instructing panoramic composition. When the combine button BT4 is pressed, images taken by the cameras C1 to C9 at the same time are combined into a panoramic composition and displayed on the screen of the display device 116.

[0203] FIG. 28 is a diagram showing an example of a display screen of a panoramic composite image.

[0204] As shown in the figure, the panoramic composite image is displayed on the display screen DS3B of the display device 116. The images are displayed in chronological order from top to bottom of the screen. The display screen DS3B is another example of the third screen.

[0205] In this way, according to the photography system of this embodiment, images photographed by the multiple-eye photography device 10 (recorded images) can be confirmed.

[0206] As with live view images, captured images may also be displayed so that overlapping areas between adjacent images can be distinguished.

[0207] [Modification] It is preferable to be able to check whether a captured image has been captured correctly under set conditions (capturing parameters), and therefore it is preferable to have a configuration in which the capturing parameters can be displayed.

[0208] FIG. 29 is a diagram showing an example of a display of imaging parameters.

[0209] This figure shows an example in which information on the shutter speed, aperture value, ISO sensitivity, and focal length of a selected image is displayed.

[0210] When an image is selected with the cursor Cu and the EXIF ​​button BT5 on the screen is pressed, information (shooting parameters) about the selected image, such as shutter speed, aperture value, ISO sensitivity, and focal length, is displayed in a pop-up on the screen.

[0211] Generally, images captured with a digital camera are recorded with various information, including shooting parameters, added as additional information (metadata). For example, images recorded in the EXIF ​​(exchangeable image file format) format are recorded with various information added. The display control unit 111G reads the information added to the images and displays the shooting parameters of the selected image on the screen.

[0212] FIG. 30 is a diagram showing another example of the display of the imaging parameters.

[0213] This figure shows an example of a case where information on the shooting parameters set for the camera (Value in camera) and information on the shooting parameters of an actually captured image (Value in image) are displayed so as to be comparable.

[0214] In this way, by displaying the shooting parameters set for the camera and the shooting parameters of the image that was actually taken in a manner that allows comparison, it is possible to easily check whether the image was taken correctly.

[0215] As shown in the figure, if there are any differences between the shooting parameters set for the camera and the shooting parameters of the image actually captured, it is preferable to highlight them. Figure 30 shows an example in which the ISO sensitivity differs from the setting, and the text and background colors are highlighted.

[0216] Furthermore, when displaying images in a comparative manner as in this example, the control device 100 must store information about the shooting parameters that have been set for the camera in advance. If the control device 100 has a function for calculating (estimating) the shooting parameters (fourth embodiment), the calculated information can be used. Alternatively, a method in which the user inputs the information in advance can be employed.

[0217] Sixth Embodiment The photography system of this embodiment is a photography system further equipped with a function for determining whether or not the image (photographed image) captured by the multiple-eye photography device 10 is appropriate for photography. Since the basic configuration of the system is the same, only the function for determining whether or not the image is appropriate will be described here.

[0218] FIG. 31 is a functional block diagram of the control device of this embodiment.

[0219] As shown in the figure, the control device 100 of this embodiment has functions for determining whether or not photography is appropriate, such as an image acquisition unit 111C, a photography determination unit 111P, and a display control unit 111G. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0220] The image acquisition unit 111C acquires images captured by the cameras C1 to C9 mounted on the camera array imaging device 10.

[0221] The photography determination unit 111P analyzes the captured image and determines whether the image is suitable for photography (OK or NG). As an example, it analyzes the histogram of the image and determines whether the image was taken with a specified image quality. Images taken with the specified image quality are determined as "OK," and images not taken with the specified image quality are determined as "NG."

[0222] The display control unit 111G causes the captured image to be displayed on the screen of the display device 116 in a predetermined display format together with the determination result.

[0223] FIG. 32 is a diagram showing an example of a display screen for a captured image.

[0224] As shown in the figure, the captured image display screen DS3C displays the images captured by each camera C1 to C9 in chronological order. Furthermore, images that are judged as NG in the judgment of the appropriateness of the photograph are displayed with a mark MA. The example shown in Fig. 32 shows a case where all images captured by the first camera C1 are NG. The captured image display screen DS3 is another example of the third screen.

[0225] In this way, according to the photography system of this embodiment, it is possible to easily check whether each photographed image is appropriate for photography.

[0226] [Modification] In the above embodiment, the suitability of photography (quality of image quality) is determined based on the histogram of the image, but the method for determining the suitability of photography is not limited to this. Alternatively, for example, the suitability of photography can be determined using a trained model that has learned to determine the quality of image quality. Furthermore, the suitability of photography can also be determined using information added to the image (for example, EXIF ​​information). In this case, the suitability of photography is determined, for example, by determining whether the image was taken using preset photography parameters.

[0227] [Other Embodiments] [Subject] In the above embodiment, the tunnel structure TS is photographed as an example, but the subject is not limited to this. The cameras are arranged in a layout according to the subject, and a configuration including a pair of cameras whose photographing areas overlap is adopted.

[0228] [System Configuration] The multi-eye photographing device 10 and the control device 100 can also be configured to be communicably connected via a network such as the Internet.

[0229] The functions of the control device can also be realized by a so-called cloud computer, in which case, for example, a user's own terminal (personal computer, smartphone, tablet, etc.) can be used as an input device and the terminal's display can be used as a display destination.

[0230] [Hardware Configuration of Processing Device] The functions of the processing device are realized by various processors. The various processors include CPUs and / or GPUs (Graphic Processing Units), which are general-purpose processors that execute programs and function as various processing units, programmable logic devices (PLDs), such as FPGAs (Field Programmable Gate Arrays), whose circuit configuration can be changed after manufacture, and dedicated electrical circuits, such as ASICs (Application Specific Integrated Circuits), which are processors with circuit configurations designed specifically to execute specific processes. A program is synonymous with software.

[0231] A single processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same or different types. For example, a single processing unit may be composed of multiple FPGAs, or a combination of a CPU and an FPGA. Furthermore, multiple processing units may be composed of a single processor. Examples of multiple processing units composed of a single processor include: a first configuration, as typified by computers used as clients or servers, in which a single processor is composed of a combination of one or more CPUs and software, and this processor functions as multiple processing units; a second configuration, as typified by system-on-chip (SoC), in which a processor is used to realize the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip; and a hardware structure, in which the various processing units are composed of one or more of the above-mentioned various processors.

[0232] 1 Photography system 10 Multi-eye photography device 11 Frame 12 Base 13F Front column 13R Rear column 14F Front panel 14FF Front panel 14R Rear panel 20 Relay device 100 Control device 100A Camera control unit 111 CPU 111A Camera control unit 111B Lighting control unit 111C Image acquisition unit 111D Overlap range detection unit 111E Overlap rate calculation unit 111F Setting determination unit 111G Display control unit 111H Camera information acquisition unit 111I Subject information acquisition unit 111J Correction condition calculation unit 111K Setting change acceptance unit 111L Camera setting calculation unit 111M Recording control unit 111N Image processing unit 111P Photography determination unit 112 ROM 113 RAM 114 Auxiliary storage device 115 Input device 116 Display device 117 Communication interface B1 Bracket (first bracket) B2 Bracket (second bracket) B3 Bracket (third bracket) B4 Bracket (fourth bracket) B5 Bracket (fifth bracket) B6 Bracket (sixth bracket) B7 Bracket (seventh bracket) B8 Bracket (eighth bracket) B9 Bracket (ninth bracket) BT1 Setting reflection button BT2 Shooting button BT3 Delete button BT4 Composite button BT5 EXIF ​​button C1 Camera (first camera) C2 Camera (second camera) C3 Camera (third camera) C4 Camera (fourth camera) C5 Camera (fifth camera) C6 Camera (sixth camera) C7 Camera (seventh camera) C8 Camera (eighth camera) C9 Camera (ninth camera) CI Camera information display area CL Clamp CS Cross section Cu Cursor DA1 Image display area (first image display area) DA2 Image display area (second image display area) DA3 Image display area (third image display area) DA4 Image display area (fourth image display area) DA5 Image display area (fifth image display area) DA6 Image display area (sixth image display area) DA7 Image display area (seventh image display area) DA8 Image display area (eighth image display area) DA9 Image display area (ninth image display area) DS1 Live view display screen DS2A Camera information display screen DS2B Camera recommended settings display screenDS3A Display screen for photographed images DS3B Display screen for panoramic composite photographed images DS3C Display screen for photographed images F Frame IM1 Image IM2 Image L1 First lighting device L2 Second lighting device L3 Third lighting device L4 Fourth lighting device L5 Fifth lighting device L6 Sixth lighting device L7 Seventh lighting device L8 Eighth lighting device L9 Ninth lighting device MA Mark OL1-2 Overlap range OR1-2 Overlap rate display area OR2-3 Overlap rate display area OR3-4 Overlap rate display area OR4-5 Overlap rate display area OR5-6 Overlap rate display area OR6-7 Overlap rate display area OR7-8 Overlap rate display area OR8-9 Overlap rate display area PM Pull-down menu Ra Rail TS Tunnel structure Tr Bogie U1 First photography unit U2 Second camera unit U3 Third camera unit U4 Fourth camera unit U5 Fifth camera unit U6 Sixth camera unit U7 Seventh camera unit U8 Eighth camera unit U9 Ninth camera unit XA1 Camera information XA2 Shutter speed information XA3 Aperture value (F-number) information XA4 ISO sensitivity information XA5 Focal length (f) information XA6 Remaining battery charge information XA7 Information on free space on storage media XA8 Information on the result of determining the free space status of storage media

Claims

1. A processing device for processing images taken by multiple cameras, comprising: a processor which sets multiple independent image display areas corresponding to the multiple cameras on a first screen which is output to a display destination; and displays the images from the multiple cameras in the multiple image display areas in a state in which a first range where images overlap between images from adjacent cameras and a second range where images do not overlap can be distinguished.

2. The processing device according to claim 1, wherein the plurality of cameras includes a pair of cameras whose shooting areas overlap.

3. The processing device according to claim 1, wherein the processor sets the multiple image display areas in a layout corresponding to an arrangement of the multiple cameras.

4. The processing device according to claim 3, wherein the processor processes images from a plurality of the cameras to detect the first range and / or the second range.

5. The processing device according to claim 3, wherein the processor acquires information about the subject and information about the plurality of cameras, and detects the first range and / or the second range based on the acquired information.

6. The processing device according to claim 4 or 5, wherein the processor calculates an overlap rate of the image to be displayed in the image display area based on the first range and / or the second range, and displays the overlap rate on the first screen.

7. The processing device according to claim 6, wherein the processor determines whether the settings of the multiple cameras are appropriate based on the overlap rate, and causes the result of the determination to be displayed on the first screen.

8. The processing device according to claim 6, wherein the processor determines correction conditions for the settings of the plurality of cameras based on the overlap rate, and causes the correction conditions to be displayed on the first screen.

9. The processing device according to claim 1, wherein the processor causes images captured in time series by the plurality of cameras to be displayed in chronological order in the image display area.

10. A processing device according to any one of claims 1 to 5, wherein the processor acquires information from a plurality of the cameras and displays the information from the plurality of the cameras on a second screen different from the first screen.

11. The processing device according to claim 10, wherein the processor acquires information relating to a subject, estimates shooting parameters of the multiple cameras to be set when photographing the subject based on the acquired information, and sets the shooting parameters of the multiple cameras according to the estimation results.

12. The processing device according to claim 10, wherein the camera information includes at least one of information on shooting parameters, information on available image storage capacity, and information on a battery.

13. The processing device according to claim 12, wherein the processor accepts changes to the shooting parameters of the multiple cameras individually or collectively on the second screen, and changes the shooting parameters of the cameras individually or collectively in accordance with the accepted content.

14. The processing device according to claim 12, wherein the processor determines whether the states of the multiple cameras are appropriate based on information from the multiple cameras, and displays the determination result on the second screen.

15. The processing device according to any one of claims 1 to 5, wherein the processor displays a plurality of recorded images from the camera on a third screen different from the first screen.

16. The processing device according to claim 15, wherein said processor synthesizes a panorama of the recorded images from the plurality of cameras, and displays the panorama-synthesized image on said third screen.

17. The processing device according to claim 15, wherein the processor determines whether or not shooting is appropriate for a plurality of recorded images from the camera based on the images and / or information added to the images, and displays the determination result on the third screen.

18. The processing device according to claim 17, wherein the processor determines whether or not shooting is appropriate based on a histogram of the image.

19. The processing device according to claim 17, wherein the processor determines whether or not shooting is appropriate based on shooting parameter information added to the image.

20. The processing device according to claim 15, wherein the processor accepts a selection of an image on the third screen, and causes shooting parameters of the selected image to be displayed on the third screen.

21. The processing device according to claim 20, wherein said processor displays on said third screen the shooting parameters of the selected image and the shooting parameters of said camera when the selected image was shot in a comparative state.

Images