Processing apparatus

Abstract

The invention provides a processing device which can easily confirm the setting of each camera when a plurality of cameras are used for shooting. A processing device for processing images captured by a plurality of cameras is provided with a processor. The processor sets a plurality of independent image display regions corresponding to the plurality of cameras on a first screen output to the display end. The processor displays the images of the plurality of cameras in the plurality of image display regions in a state in which a first range in which the images overlap between the images of the adjacent cameras and a second range in which the images do not overlap can be recognized.

Description

Technical Field

[0001] The present invention relates to a processing device, and in particular to a processing device for processing images taken by multiple cameras. Background Art

[0002] There is known a technique for detecting damage (cracks, etc.) generated on the wall surface of a structure such as a tunnel by imaging the wall surface of the structure with a camera and analyzing the obtained image.

[0003] Patent Documents 1 to 5 describe a method of mounting a plurality of cameras on a vehicle, capturing images with adjacent cameras overlapping a portion of their capturing areas, and performing panoramic synthesis of the obtained images to obtain a high-resolution image.

[0004] Patent Document 6 also describes a method for photographing the surface of a structure while shifting the photographing positions manually or with a drone. Patent Document 6 also describes displaying the photographed image while deleting the area that overlaps with adjacent images.

[0005] Previous technical literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2016-218555

[0008] Patent Document 2: Japanese Patent Application Laid-Open No. 2016-57579

[0009] Patent Document 3: Japanese Patent Application Laid-Open No. 2004-12152

[0010] Patent Document 4: Japanese Patent Application Laid-Open No. 2001-141660

[0011] Patent Document 5: Japanese Patent Application Laid-Open No. 9-161068

[0012] Patent Document 6: Japanese Patent Application Laid-Open No. 2020-5186 Summary of the Invention

[0013] One embodiment of the technology according to the present invention provides a processing device that can easily confirm the settings of each camera when capturing images using multiple cameras.

[0014] Means for solving technical problems

[0015] (1) A processing device that processes images captured by multiple cameras, wherein:

[0016] The processing device includes a processor,

[0017] The processor performs the following processing:

[0018] Setting a plurality of independent image display areas corresponding to the plurality of cameras on a first screen output to a display terminal; and

[0019] Images from a plurality of cameras are displayed in a plurality of image display areas in a state where a first range where images from adjacent cameras overlap and a second range where images do not overlap can be distinguished.

[0020] (2) The processing device according to (1), wherein

[0021] The multiple cameras include a pair of cameras whose photographic areas overlap.

[0022] (3) The processing device according to (1) or (2), wherein

[0023] The processor sets a plurality of image display areas in a layout corresponding to the arrangement of the plurality of cameras.

[0024] (4) The processing device according to any one of (1) to (3), wherein

[0025] The processor processes the images from the plurality of cameras to detect the first range and / or the second range.

[0026] (5) The processing device according to any one of (1) to (3), wherein

[0027] The processor performs the following processing: acquires information about the subject and information about the plurality of cameras, and detects the first range and / or the second range based on the acquired information.

[0028] (6) The processing device according to any one of (1) to (5), wherein

[0029] The processor performs the following processing: calculating an overlapping ratio of images displayed in the image display area based on the first range and / or the second range; and displaying the overlapping ratio on the first screen.

[0030] (7) The processing device according to (6), wherein

[0031] The processor performs the following processing: judging whether the settings of the plurality of cameras are appropriate based on the overlap ratio; and displaying the judgment result on the first screen.

[0032] (8) The processing device according to (6), wherein

[0033] The processor performs the following processing: determining correction conditions for the installation of the plurality of cameras based on the overlap ratio; and displaying the correction conditions on the first screen.

[0034] (9) The processing device according to any one of (1) to (8), wherein

[0035] The processor causes the images captured by the plurality of cameras in time series to be displayed in the image display area in time series order.

[0036] (10) The processing device according to any one of (1) to (9), wherein

[0037] The processor performs the following processing: acquiring information of the plurality of cameras; and displaying the information of the plurality of cameras on a second screen different from the first screen.

[0038] (11) The processing device according to (10), wherein

[0039] The processor performs the following processing: acquiring information related to the subject, and inferring shooting parameters of multiple cameras set when shooting the subject based on the acquired information; and setting the shooting parameters of the multiple cameras based on the inference result.

[0040] (12) The processing device according to (10) or (11), wherein

[0041] The camera information includes at least one of information related to shooting parameters, information related to image storability, and information related to a battery.

[0042] (13) The processing device according to any one of (10) to (12), wherein

[0043] The processor performs the following processing: receiving changes to the shooting parameters of the plurality of cameras individually or collectively on the second screen; and changing the shooting parameters of the cameras individually or collectively according to the received contents.

[0044] (14) The processing device according to any one of (10) to (13), wherein

[0045] The processor performs the following processing: judging whether the states of the plurality of cameras are appropriate based on the information of the plurality of cameras; and displaying the judgment result on the second screen.

[0046] (15) The processing device according to any one of (1) to (14), wherein

[0047] The processor displays the images of the plurality of cameras that have completed recording on a third screen that is different from the first screen.

[0048] (16) The processing device according to (15), wherein

[0049] The processor performs the following processing: performing panoramic synthesis on the images captured by the plurality of cameras that have been recorded; and displaying the panoramic synthesised images on the third screen.

[0050] (17) A processing device according to (15) or (16), wherein the processor performs the following processing: determining whether the images taken by multiple cameras that have completed recording are appropriate based on the images and / or information attached to the images; and displaying the determination result on the third screen.

[0051] (18) The processing device according to (17), wherein

[0052] The processor determines whether the shooting is appropriate based on the histogram of the image.

[0053] (19) The processing device according to (17), wherein

[0054] The processor determines whether the photographing is appropriate based on the photographing parameter information added to the image.

[0055] (20) The processing device according to any one of (15) to (19), wherein

[0056] The processor performs the following processing: receiving a selection of an image on a third screen; and displaying shooting parameters of the selected image on the third screen.

[0057] (21) The processing device according to (20), wherein

[0058] The processor displays the shooting parameters of the selected image and the shooting parameters of the camera when the selected image was shot on the third screen in a comparable state. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 It is a diagram showing a schematic configuration of an imaging system.

[0060] Figure 2 It is a perspective view showing the structure of a multi-eye camera device.

[0061] Figure 3 It is a front view showing the structure of the multi-eye camera device.

[0062] Figure 4 It is a side view showing the structure of a multi-eye camera.

[0063] Figure 5 This is a front view showing the installation status of the camera and lighting device on the front panel.

[0064] Figure 6 This is a rear view showing the camera and lighting unit installed on the front panel.

[0065] Figure 7 This is a front view showing the camera and lighting device installed on the rear panel.

[0066] Figure 8 This is a rear view showing the camera and lighting unit installed on the rear panel.

[0067] Figure 9 This is a block diagram showing the electrical structure of a multi-eye camera.

[0068] Figure 10 This is a diagram showing an example of the hardware configuration of the control device.

[0069] Figure 11 This is a functional block diagram of the shooting control function of the control device.

[0070] Figure 12 This is a functional block diagram of the instant preview function of the control device.

[0071] Figure 13 This is a diagram showing an example of a live preview display screen.

[0072] Figure 14 This is a conceptual diagram of displaying an image in the image display area.

[0073] Figure 15 This is a functional block diagram of the functions of the control device when calculating the overlap range.

[0074] Figure 16 This is a diagram showing another example of the live preview display screen.

[0075] Figure 17 This is a diagram showing another example of the live preview display screen.

[0076] Figure 18 This is a diagram showing another example of the live preview display screen.

[0077] Figure 19 This is a functional block diagram of the control device.

[0078] Figure 20 This is a diagram showing an example of a live preview display screen.

[0079] Figure 21 This is a functional block diagram of the control device.

[0080] Figure 22 This is a diagram showing an example of a display screen showing camera information.

[0081] Figure 23 This is a diagram showing an example of a method for receiving a setting change.

[0082] Figure 24 This is a functional block diagram of the control device.

[0083] Figure 25This is a diagram showing an example of a display screen showing recommended camera settings.

[0084] Figure 26 This is a functional block diagram of the control device.

[0085] Figure 27 This is a diagram showing an example of a display screen of a captured image.

[0086] Figure 28 FIG. 1 is a diagram showing an example of a display screen of a panoramically synthesized image.

[0087] Figure 29 This is a diagram showing an example of display of shooting parameters.

[0088] Figure 30 It is a diagram showing another example of display of shooting parameters.

[0089] Figure 31 This is a functional block diagram of the control device.

[0090] Figure 32 This is a diagram showing an example of a display screen of a captured image. DETAILED DESCRIPTION

[0091] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0092] [First embodiment]

[0093] Here, a case where the present invention is applied to a system for imaging the inner wall surface of a tunnel structure will be described as an example.

[0094] Tunnel structures, such as waterways at hydroelectric power plants and subway tunnels, are regularly inspected to ensure their safety. In recent years, visual inspections have been gradually replaced by image-based inspections. Image-based inspections use a camera to capture the surface of the tunnel structure and detect cracks and other damage from the resulting images, either visually or through image processing.

[0095] Photography is usually performed using a dedicated imaging device capable of capturing the entire circumference of the tunnel. This imaging device is composed of multiple cameras. The multiple cameras are arranged according to the cross-sectional shape of the tunnel structure and are set so that the imaging areas of adjacent cameras partially overlap.

[0096] However, tunnel structures have a variety of cross-sectional shapes. Therefore, the imaging system requires multiple cameras arranged according to the target and the imaging conditions for each camera set. This process requires a significant amount of time on-site. Furthermore, even a single camera setting error requires reshooting, necessitating accurate settings before filming begins.

[0097] The imaging system of this embodiment provides an imaging system that can easily confirm the settings of each camera in an imaging system using multiple cameras.

[0098] [Structure of the shooting system]

[0099] Figure 1 It is a diagram showing a schematic configuration of an imaging system.

[0100] As described above, the imaging system 1 of this embodiment is configured as a system for imaging the inner wall surface of the tunnel structure TS. The tunnel structure TS as an imaging target has an arc-shaped cross-section (semicircular).

[0101] like Figure 1 As shown, the imaging system 1 of this embodiment includes a multi-lens imaging device 10 that uses a plurality of cameras to image the inner wall surface of a tunnel structure TS, and a control device 100 that controls the multi-lens imaging device 10 and processes images captured by the multi-lens imaging device 10 .

[0102] The multi-eye imaging device 10 is mounted on a trolley Tr, for example, and performs imaging while moving within a tunnel structure TS. When a track Ra is laid on the tunnel structure TS, the trolley Tr travels on the track Ra. The trolley Tr may be equipped with an electric assist function as needed.

[0103] [Multi-eye camera]

[0104] Figure 2 It is a perspective view showing the structure of a multi-eye camera device. Figure 3 It is a front view showing the structure of the multi-eye camera device. Figure 4 : is a side view showing the structure of the multi-eye camera. Figures 2 to 4 In the equation, x, y, and z are three axes that are orthogonal to each other. The plane containing the x-axis and the y-axis is considered a horizontal plane, and the direction of the z-axis is considered a vertical direction. Furthermore, the direction of the x-axis is considered the traveling direction of the trolley Tr, and the + direction of the x-axis ( Figure 4 The right direction of the x-axis is set as the direction of travel when shooting. Therefore, the + direction of the x-axis ( Figure 4 The left direction) is the front direction (forward direction) of the trolley Tr and the multi-eye imaging device 10, and the - direction ( Figure 4 The left direction) is the rear direction (backward direction) of the carriage Tr and the multi-eye camera 10.

[0105] The multi-eye camera 10 is composed of multiple cameras and multiple lighting devices. The number of cameras and lighting devices can be increased or decreased as appropriate depending on the subject. Here, the multi-eye camera 10 is described as an example using nine cameras C1 to C9 and nine lighting devices L1 to L9.

[0106] The multi-eye imaging device 10 includes a frame 11 on which a plurality of cameras C1 to C9 and lighting devices L1 to L9 are mounted.

[0107] The frame 11 includes a base 12 , a front column 13F, a rear column 13R, a front panel 14F, a rear panel 14R, and the like.

[0108] The base 12 has a rectangular flat plate shape and is provided with a front column 13F and a rear column 13R.

[0109] The front pillars 13F and rear pillars 13R have prismatic shapes. They are arranged with a predetermined distance between them in the front-to-back direction (the x-axis direction) relative to the base 12. Furthermore, the front pillars 13F and rear pillars 13R are arranged perpendicular to the base 12. A front panel 14FF is attached to the front pillars 13F, and a rear panel 14R is attached to the rear pillars 13R.

[0110] The front panel 14F and the rear panel 14R have a circular plate shape. The front panel 14F and the rear panel 14R are arranged orthogonally to the front-to-back direction (the x-axis direction) of the base 12 and are arranged coaxially. The axis passing through the centers of the front panel 14F and the rear panel 14R and parallel to the x-axis is used as the axis of the multi-eye camera 10.

[0111] Cameras C1 to C9 and lighting devices L1 to L9 are mounted on the front panel 14F or the rear panel 14R via brackets B1 to B9. Hereinafter, as needed, camera C1 will be referred to as "first camera C1," camera C2 as "second camera C2," camera C3 as "third camera C3," camera C4 as "fourth camera C4," camera C5 as "fifth camera C5," camera C6 as "sixth camera C6," camera C7 as "seventh camera C7," camera C8 as "eighth camera C8," and camera C9 as "ninth camera C9" to distinguish between cameras C1 to C9. In addition, the lighting device L1 is called the "first lighting device L1", the lighting device L2 is called the "second lighting device L2", the lighting device L3 is called the "third lighting device L3", the lighting device L4 is called the "fourth lighting device L4", the lighting device L5 is called the "fifth lighting device L5", the lighting device L6 is called the "sixth lighting device L6", the lighting device L7 is called the "seventh lighting device L7", the lighting device L8 is called the "eighth lighting device L8", and the lighting device L9 is called the "9th lighting device L9" to distinguish the lighting devices L1 to L9. In addition, bracket B1 is called "1st bracket B1", bracket B2 is called "2nd bracket B2", bracket B3 is called "3rd bracket B3", bracket B4 is called "4th bracket B4", bracket B5 is called "5th bracket B5", bracket B6 is called "6th bracket B6", bracket B7 is called "7th bracket B7", bracket B8 is called "8th bracket B8", and bracket B9 is called "9th bracket B9" to distinguish each bracket B1 to B9.

[0112] The first camera C1 and the first lighting device L1 are mounted on the front panel 14F via the first bracket B1. The second camera C2 and the second lighting device L2 are mounted on the rear panel 14R via the second bracket B2. The third camera C3 and the third lighting device L3 are mounted on the front panel 14F via the third bracket B3. The fourth camera C4 and the fourth lighting device L4 are mounted on the rear panel 14R via the fourth bracket B4. The fifth camera C5 and the fifth lighting device L5 are mounted on the front panel 14F via the fifth bracket B5. The sixth camera C6 and the sixth lighting device L6 are mounted on the rear panel 14R via the sixth bracket B6. The seventh camera C7 and the seventh lighting device L7 are mounted on the front panel 14F via the seventh bracket B7. The eighth camera C8 and the eighth lighting device L8 are mounted on the rear panel 14R via the eighth bracket B8. The ninth camera C9 and the ninth lighting device L9 are mounted on the front panel 14F via the ninth bracket B9.

[0113] That is, odd-numbered cameras C1, C3, C5, C7, C9 and lighting devices L1, L3, L5, L7, L9 are installed on the front panel 14F, and even-numbered cameras C2, C4, C6, C8 and lighting devices L2, L4, L6, L8 are installed on the rear panel 14R.

[0114] The sets of cameras C1 to C9 and lighting device L1 attached to the respective brackets B1 to B9 constitute imaging units U1 to U9 , respectively. Hereinafter, as needed, the group of the 1st camera C1 and the 1st lighting device L1 will be referred to as the "1st shooting unit U1", the group of the 2nd camera C2 and the 2nd lighting device L2 will be referred to as the "2nd shooting unit U2", the group of the 3rd camera C3 and the 3rd lighting device L3 will be referred to as the "3rd shooting unit U3", the group of the 4th camera C4 and the 4th lighting device L4 will be referred to as the "4th shooting unit U4", the group of the 5th camera C5 and the 5th lighting device L5 will be referred to as the "5th shooting unit U5", the group of the 6th camera C6 and the 6th lighting device L6 will be referred to as the "6th shooting unit U6", the group of the 7th camera C7 and the 7th lighting device L7 will be referred to as the "7th shooting unit U7", the group of the 8th camera C8 and the 8th lighting device L8 will be referred to as the "8th shooting unit U8", and the group of the 9th camera C9 and the 9th lighting device L9 will be referred to as the "9th shooting unit U9" to distinguish the shooting units U1 to U9.

[0115] Figure 5 This is a front view showing the camera and lighting device installed on the front panel. Figure 6 This is a rear view showing the camera and lighting unit installed on the front panel.

[0116] Each bracket B1, B3, B5, B7, and B9 is arranged on the same circumference relative to the front panel 14F. Furthermore, each bracket B1, B3, B5, B7, and B9 is mounted so that it can move circumferentially within a predetermined angular range (e.g., 30°) relative to the front panel 14F. Furthermore, each bracket B1, B3, B5, B7, and B9 is secured to the front panel 14F via a clamp (e.g., a toggle clamp) CL. Therefore, the position can be easily adjusted by loosening the clamp CL.

[0117] Cameras C1, C3, C5, C7, and C9 are mounted on the camera mounts of brackets B1, B3, B5, B7, and B9. Furthermore, lighting devices L1, L3, L5, L7, and L9 are mounted on the lighting mounts of brackets B1, B3, B5, B7, and B9. Cameras C1, C3, C5, C7, and C9 are mounted on the camera mounts using, for example, tripod threaded holes. Lighting devices L1, L3, L5, L7, and L9 are fixed to the lighting mounts by bolts.

[0118] The cameras C1, C3, C5, C7, and C9, and the lighting devices L1, L3, L5, L7, and L9, mounted on the front panel 14F via brackets B1, B3, B5, B7, and B9, are positioned on the frame 11 in a predetermined orientation. Specifically, they are positioned in a plane perpendicular to the axis of the multi-eye imaging device 10 (in the Zy plane), facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. More specifically, the cameras C1, C3, C5, C7, and C9 are positioned so that their imaging optical axes face outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. Furthermore, the cameras C1, C3, C5, C7, and C9 are mounted so that the bottom surfaces of their camera bodies are parallel to the front panel 14F (parallel to the Zy plane) (with the bottom edges of their image sensors parallel to the Zy plane). Thus, the cameras C1, C3, C5, C7, and C9 are arranged at predetermined intervals along the circumference of the multi-eye imaging device 10 in the zy plane. The lighting devices L1, L3, L5, L7, and L9 are arranged so that their illumination directions face outward in the radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. As a result, the cameras C1, C3, C5, C7, and C9 and the lighting devices L1, L3, L5, L7, and L9 are arranged in a radial pattern in the zy plane, centered on the axis of the multi-eye imaging device 10.

[0119] Here, as described above, the brackets B1 , B3 , B5 , B7 , and B9 are attached to the front panel 14F so as to be movable in the circumferential direction within a predetermined angular range. Figure 5 and Figure 6 The state where each bracket B1, B3, B5, B7, and B9 are fixed at the reference position is shown. By fixing each bracket B1, B3, B5, B7, and B9 at the reference position, the first camera C1 and the first lighting device L1 are in the main view ( Figure 5 ) are arranged at a position of 330° (-30°). Furthermore, the third camera C3 and the third lighting device L3 are arranged at a position of 30°. Furthermore, the fifth camera C5 and the fifth lighting device L5 are arranged at a position of 90°. Furthermore, the seventh camera C7 and the seventh lighting device L7 are arranged at a position of 150°. Furthermore, the ninth camera C9 and the ninth lighting device L9 are arranged at a position of 210°.

[0120] Each bracket B1, B3, B5, B7, and B9 is mounted so that it can move within a range of ±15° circumferentially from its reference position. Therefore, each camera C1, C3, C5, C7, and C9 and lighting device L1, L3, L5, L7, and L9 can be adjusted within a range of ±15° circumferentially from its reference position.

[0121] Figure 7 This is a front view showing the camera and lighting device installed on the rear panel. Figure 8This is a rear view showing the camera and lighting unit installed on the rear panel.

[0122] Each bracket B2, B4, B6, and B8 is arranged on the same circumference relative to the rear panel 14R. Furthermore, each bracket B2, B4, B6, and B8 is mounted so that it can move circumferentially within a predetermined angular range (e.g., 30°) relative to the rear panel 14R. Furthermore, each bracket B2, B4, B6, and B8 is secured to the rear panel 14R by a clamp CL. Therefore, the position can be easily adjusted by loosening the clamp CL.

[0123] Cameras C2, C4, C6, and C8 are mounted on the camera mounts of brackets B2, B4, B6, and B8. Furthermore, lighting devices L2, L4, L6, and L8 are mounted on the lighting mounts of brackets B2, B4, B6, and B8. Cameras C2, C4, C6, and C8 are mounted on the camera mounts using, for example, tripod threaded holes. Lighting devices L2, L4, L6, and L8 are fixed to the lighting mounts by bolts.

[0124] The cameras C2, C4, C6, and C8, and the lighting devices L2, L4, L6, and L8, mounted on the rear panel 14R via brackets B2, B4, B6, and B8, are arranged on the frame 11 in a predetermined posture. Specifically, they are positioned in a plane perpendicular to the axis of the multi-eye imaging device 10 (in the Zy plane), facing outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. More specifically, the cameras C2, C4, C6, and C8 are positioned so that their imaging optical axes face outward in a radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. Furthermore, the cameras C2, C4, C6, and C8 are mounted so that the bottom surfaces of their camera bodies are parallel to the rear panel 14R (parallel to the Zy plane) (the bottom edges of their image sensors are mounted parallel to the Zy plane). Thus, the cameras C2, C4, C6, and C8 are arranged at predetermined intervals circumferentially in the Zy plane, centered on the axis of the multi-eye imaging device 10. The lighting devices L2, L4, L6, and L8 are arranged so that their illumination directions face outward in the radial direction (normal direction) centered on the axis of the multi-eye imaging device 10. As a result, the cameras C2, C4, C6, and C8 and the lighting devices L2, L4, L6, and L8 are arranged radially in the zy plane centered on the axis of the multi-eye imaging device 10.

[0125] Here, as described above, the brackets B2 , B4 , B6 , and B8 are attached to the rear panel 14R so as to be movable in the circumferential direction within a predetermined angular range. Figure 7 and Figure 8The state where each bracket B2, B4, B6, and B8 are fixed at the reference position is shown. By fixing each bracket B2, B4, B6, and B8 at the reference position, the second camera C2 and the second lighting device L2 are in the main view ( Figure 7 ) is arranged at a position of 0°. Furthermore, the 4th camera C4 and the 4th lighting device L4 are arranged at a position of 60°. Furthermore, the 6th camera C6 and the 6th lighting device L6 are arranged at a position of 120°. Furthermore, the 8th camera C8 and the 8th lighting device L8 are arranged at a position of 180°. Therefore, the 2nd camera C2 is arranged between the 1st camera C1 and the 3rd camera C3 in the circumferential direction. Furthermore, the 4th camera C4 is arranged between the 3rd camera C3 and the 5th camera C5 in the circumferential direction. Furthermore, the 6th camera C6 is arranged between the 5th camera C5 and the 7th camera C7 in the circumferential direction. Furthermore, the 8th camera C8 is arranged between the 7th camera C7 and the 9th camera C9 in the circumferential direction. Similarly, the 2nd lighting device L2 is arranged between the 1st lighting device L1 and the 3rd lighting device L3 in the circumferential direction. Furthermore, the 4th lighting device L4 is arranged between the 3rd lighting device L3 and the 5th lighting device L5 in the circumferential direction. Furthermore, the sixth lighting device L6 is disposed between the fifth lighting device L5 and the seventh lighting device L7 in the circumferential direction. Furthermore, the eighth lighting device L8 is disposed between the seventh lighting device L7 and the ninth lighting device L9 in the circumferential direction.

[0126] Each bracket B2, B4, B6, and B8 is mounted so as to be movable within a range of ±15° circumferentially from a reference position. Therefore, each camera C2, C4, C6, and C8 and lighting device L2, L4, L6, and L8 can be adjusted within a range of ±15° circumferentially from a reference position.

[0127] The multi-eye imaging device 10 configured as described above has nine cameras C1 to C9 and lighting devices L1 to L9 arranged at predetermined intervals on an arc centered on the axis of the device. Adjacent cameras form a camera pair whose imaging areas overlap.

[0128] Here, the tunnel structure TS as the imaging target has an arcuate cross-sectional shape (semicircular). Therefore, the cameras C1 to C9 and the lighting devices L1 to L9 are arranged at predetermined intervals in the circumferential direction of the cross section of the tunnel structure TS.

[0129] When the brackets B1 to B9 are fixed at the reference position, the cameras C1 to C9 and the lighting devices L1 to L are arranged at 30° intervals. Furthermore, the cameras C1 to C1 and the lighting devices L1 to L are mounted so as to be positionally adjustable within a range of ±15° in the circumferential direction.

[0130] Cameras C1 to C9 are digital cameras. The type of digital camera is not particularly limited. Any camera can be used as long as it has the function of electronically recording images (still or moving images). For example, a lens-interchangeable digital camera is used. In this embodiment, cameras C1 to C9 include a storage device (storage medium) and store captured images in the storage device. The storage device can be a built-in memory or a removable memory card.

[0131] The lighting devices L1 to L9 used are not particularly limited. As an example, a halogen lamp is used. In addition, for example, an LED (light emitting diode) lamp, a xenon lamp, etc. can be used. In this embodiment, a lighting device with an irradiation angle (irradiation direction) adjustment function is used. Each lighting device L1 to L9 adjusts the irradiation angle (irradiation direction) by rotating around an axis orthogonal to the optical axis of the cameras C1 to C9 (shaking forward and backward). The lighting devices L1 to L9 have an irradiation range that can cover the shooting range of the cameras C1 to C9.

[0132] [Relay device]

[0133] Figure 9 This is a block diagram showing the electrical structure of a multi-eye camera.

[0134] like Figure 9 As shown, the multi-eye camera 10 includes a relay device 20 and is communicably connected to the control device 100 via the relay device 20 .

[0135] The relay device 20 is comprised of, for example, a computer equipped with communication capabilities. Each of the cameras C1 to C9 and the lighting devices L1 to L9 is connected to the relay device 20. The connection method between each of the cameras C1 to C9 and the relay device 20 is not particularly limited. The connection can be wired or wireless.

[0136] The communication method between the control device 100 and the relay device 20 is not particularly limited. It can be wired communication or wireless communication. As an example, in this embodiment, the control device 100 and the relay device 20 are connected via a wireless LAN (local area network).

[0137] [Control device]

[0138] Figure 10 This is a diagram showing an example of the hardware configuration of the control device.

[0139] like Figure 10As shown, the control device 100 includes a CPU (central processing unit) 111, a ROM (read only memory) 112, a RAM (random access memory) 113, an auxiliary storage device 114, an input device 115, a display device 116, and a communication interface (I / F) 117. Typically, this configuration can be implemented using a computer. As an example, in this embodiment, the control device 100 is configured as a notebook personal computer. The control device 100 is an example of a processing device.

[0140] The control device 100 functions as a control device when the CPU 111 as a processor executes a predetermined program. The program executed by the CPU 111 is stored in the ROM 112 or the auxiliary storage device 114.

[0141] The auxiliary storage device 114 constitutes a storage unit of the control device 100. The auxiliary storage device 114 is constituted by, for example, a HDD (hard disk drive) or an SSD (solid state drive).

[0142] The input device 115 constitutes an operation unit of the control device 100. The input device 115 is constituted by, for example, a keyboard, a mouse, a touch panel, and the like.

[0143] The display device 116 constitutes a display unit of the control device 100. The display device 116 is constituted by, for example, an LCD (liquid crystal display) or an OLED (organic light-emitting diode) display.

[0144] The communication interface 117 constitutes a communication unit of the control device 100. The communication interface 117 is configured to be able to communicate with at least the relay device 20 using a predetermined communication method. As an example, in this embodiment, the communication interface 117 is configured to be able to communicate via a wireless LAN.

[0145] [Functions of the control device]

[0146] The control device 100 has the function of controlling the multi-eye camera 10 and processing images captured by the multi-eye camera 10. The function of controlling the multi-eye camera 10 includes a function of controlling photography by the multi-eye camera 10 (photography control function). The function of processing images captured by the multi-eye camera 10 includes a function of processing live preview images (live preview function).

[0147] [Shooting control function]

[0148] Figure 11 This is a functional block diagram of the shooting control function of the control device.

[0149] like Figure 11 As shown, the control device 100 includes functions such as a camera control unit 111A and an illumination control unit 111B as imaging control functions. The functions of the camera control unit 111A and the illumination control unit 111B are implemented by the CPU 111 executing a predetermined program.

[0150] The camera control unit 111A controls the cameras C1 to C9 mounted on the multi-eye camera 10, causing each camera C1 to C9 to perform photography. Photography includes both still and moving images. Furthermore, still image photography includes so-called interval photography. Interval photography is a function that repeatedly captures still images at regular intervals. The camera control unit 111A causes each camera C1 to C9 to perform photography based on an operation input (an instruction to perform photography) from the input device 115. In the case of moving image photography and interval photography, photography starts in response to an instruction to start photography and ends in response to an instruction to end photography.

[0151] The lighting control unit 111B controls the lighting devices L1 to L9 mounted on the multi-eye camera 10. Specifically, it controls the on / off switching of the illumination light emitted by the lighting devices L1 to L9. The lighting control unit 111B activates the illumination light in response to operational input (lighting-on and light-off instructions) from the input device 115.

[0152] [Instant preview function]

[0153] Live preview is a function that displays images captured by an image sensor in real time. The control device 100 displays live preview images of the cameras C1 to C9 mounted on the multi-eye imaging device 10 on the display device 116 in a predetermined format.

[0154] Figure 12 This is a functional block diagram of the instant preview function of the control device.

[0155] like Figure 12 As shown, the control device 100 includes functions such as an image acquisition unit 111C, an overlapping range detection unit 111D, an overlapping ratio calculation unit 111E, a placement determination unit 111F, and a display control unit 111G as a live preview function.

[0156] The image acquisition unit 111C acquires live preview images from cameras C1 to C9 mounted on the multi-eye camera 10. Each camera C1 to C9 outputs a live preview image to the control device 100 under the control of the camera control unit 100A. Specifically, the live preview image is sequentially output in a time-series order, capturing images captured by the image sensor. Live preview images are an example of images captured by a camera in a time-series order.

[0157] The overlapping range detection unit 111D processes the images acquired from each of the cameras C1 to C9 to detect the range of image overlap between adjacent cameras. Specifically, the overlapping range is detected between the first camera C1 and the second camera C2, between the second camera C2 and the third camera C3, between the third camera C3 and the fourth camera C4, between the fourth camera C4 and the fifth camera C5, between the fifth camera C5 and the sixth camera C6, between the sixth camera C6 and the seventh camera C7, between the seventh camera C7 and the eighth camera C8, and between the eighth camera C8 and the ninth camera C9.

[0158] When detecting the overlapping range through image processing, known methods can be used. For example, the overlapping range detection unit 111D detects feature points of an object in each of the two images and detects the overlapping range of the two images based on the detected feature points. The detection results are output to the display control unit 111G and the overlapping ratio calculation unit 111E.

[0159] The overlap ratio calculation unit 111E calculates the image overlap ratio (also called the lateral overlap ratio) between the images of adjacent cameras C1 to C9. The overlap ratio is calculated as the ratio of the images of adjacent cameras to the overall overlap. For example, if the area of ​​the entire image is Sa and the area of ​​the region of overlap with the images of adjacent cameras is Sb, the overlap ratio OLR is calculated as OLR = Sb / Sa.

[0160] Regarding the image overlap ratio, the overlap ratio between the image from the first camera C1 and the image from the second camera C2 is calculated. Furthermore, the overlap ratio between the image from the second camera C2 and the image from the third camera C3 is calculated. In other words, the overlap ratio between the image from the nth camera and the image from the n+1th camera is calculated (n = 1, 2, ..., 8).

[0161] The overlapping ratio calculation unit 111E calculates the overlapping ratio between the images based on the detection result of the overlapping range detection unit 111D, and outputs the calculation result to the display control unit 111G and the installation determination unit 111F.

[0162] The setup determination unit 111F determines whether the setup of each camera C1 to C9 is appropriate (OK or NG) based on the overlap ratio calculated by the overlap ratio calculation unit 111E. The images captured by each camera C1 to C9 are panorama-synthesized for subsequent use. To reliably panorama-synthesize the images captured by each camera C1 to C9, a certain overlap ratio must be maintained between adjacent images. Furthermore, even when panorama-synthesis is not performed, the entire circumference must be captured without missing any images. The setup determination unit 111F obtains the overlap ratio calculated by the overlap ratio calculation unit 111E and compares it with a threshold to determine whether the setup of each camera C1 to C9 is appropriate. Specifically, if the overlap ratio is above the threshold, the setup is determined to be OK, indicating that the current setup can capture an image suitable for panorama synthesis. On the other hand, if the overlap ratio is below the threshold, the setup is determined to be unsuitable, indicating that the current setup cannot capture an image suitable for panorama synthesis. For example, if the overlap ratio between the image captured by the nth camera and the image captured by the (n+1)th camera is below a threshold, the setup of both the nth and (n+1)th cameras is determined to be NG. For example, the threshold is 20%.

[0163] The display control unit 111G controls screen display on the display device 116. In the live preview function, the display of the live preview images of the cameras C1 to C9 is controlled based on the detection results of the overlap range and the calculation results of the overlap ratio.

[0164] [Instant preview display]

[0165] The live preview images of the cameras C1 to C9 are displayed on the screen of the display device 116 in a predetermined display format.

[0166] Figure 13 This is a diagram showing an example of a live preview display screen.

[0167] like Figure 13 As shown, the live preview display screen DS1 displays (1) live preview images of each camera, (2) information on the overlap ratio, and (3) information on whether the settings of each camera are appropriate. The live preview display screen DS1 is an example of the first screen.

[0168] (1) Live preview images of each camera

[0169] The live preview images of the cameras C1 to C9 are displayed in a plurality of image display areas DA1 to DA2 set in the screen, respectively.

[0170] Each of the image display areas DA1 to DA9 is independently set within the screen. Here, "independently" means that the image display areas DA1 to DA9 do not overlap with each other.

[0171] Furthermore, each image display area DA1-DA9 is arranged within the screen in a layout corresponding to the arrangement of each camera C1-C9 in the multi-eye imaging device 10. The "corresponding layout" here does not require an identical arrangement, but rather encompasses a range of arrangements that are considered to be substantially the same. In other words, any arrangement that allows for a rough correspondence is sufficient. In the multi-eye imaging device 10 of this embodiment, each camera C1-C9 is arranged at approximately equal intervals on the same circumference (approximately 30° intervals). Therefore, they are arranged at equal intervals on the same circumference (30° intervals). In this embodiment, a cross-sectional view CS of the tunnel structure TS, the imaging target, is displayed within the screen, and each image display area DA1-DA9 is defined around it. This allows the approximate imaging position of each camera C1-C9 to be understood. Furthermore, the cross-sectional view CS is not a strict cross-sectional view of the tunnel structure TS, the imaging target, but rather a rough cross-sectional view. In other words, it is a view that allows for the general cross-sectional shape to be understood.

[0172] Hereinafter, as needed, the image display area DA1 will be referred to as the "1st image display area DA1", the image display area DA2 will be referred to as the "2nd image display area DA2", the image display area DA3 will be referred to as the "3rd image display area DA3", the image display area DA4 will be referred to as the "4th image display area DA4", the image display area DA5 will be referred to as the "5th image display area DA5", the image display area DA6 will be referred to as the "6th image display area DA6", the image display area DA7 will be referred to as the "7th image display area DA7", the image display area DA8 will be referred to as the "8th image display area DA8", and the image display area DA9 will be referred to as the "9th image display area DA9" to distinguish the image display areas DA1 to DA9.

[0173] The image of the first camera C1 is displayed in the first image display area DA1. The number "1" is displayed adjacent to the first image display area DA1, indicating that the image of the first camera C1 is being displayed. The image of the second camera C2 is displayed in the second image display area DA2. The number "2" is displayed adjacent to the second image display area DA2, indicating that the image of the second camera C2 is being displayed. The image of the third camera C3 is displayed in the third image display area DA3. The number "3" is displayed adjacent to the third image display area DA3, indicating that the image of the third camera C3 is being displayed. The image of the fourth camera C4 is displayed in the fourth image display area DA4. The number "4" is displayed adjacent to the fourth image display area DA4, indicating that the image of the fourth camera C4 is being displayed. The image of the fifth camera C5 is displayed in the fifth image display area DA5. The number "5" is displayed adjacent to the fifth image display area DA5, indicating that the image of the fifth camera C5 is being displayed. The image of the sixth camera C6 is displayed in the sixth image display area DA6. The number "6" is displayed adjacent to the sixth image display area DA6, indicating that the image of the sixth camera C6 is being displayed. The image of the 7th camera C7 is displayed in the 7th image display area DA7. The number "7" is displayed adjacent to the 7th image display area DA7, indicating that the image of the 7th camera C7 is displayed. The image of the 8th camera C8 is displayed in the 8th image display area DA8. The number "8" is displayed adjacent to the 8th image display area DA8, indicating that the image of the 8th camera C8 is displayed. The image of the 9th camera C9 is displayed in the 9th image display area DA9. The number "9" is displayed adjacent to the 9th image display area DA9, indicating that the image of the 9th camera C9 is displayed.

[0174] In each of the image display areas DA1 to DA9 , the images of the cameras C1 to C2 are displayed so that the range in which the images of adjacent cameras overlap can be recognized.

[0175] Figure 14 This is a conceptual diagram of displaying an image in the image display area. Figure 14 An example is shown in which an image IM1 captured by the first camera C1 and an image IM2 captured by the second camera C2 are displayed.

[0176] The first camera C1 and the second camera C2 form a camera pair whose imaging areas overlap. Figure 14 In FIG, the area where the image IM1 and the image IM2 overlap (the shaded area) is the image overlapping range OL1 - 2 .

[0177] The image IM2 and the image IM2 are displayed in the first image display area DA1 and the second image display area DA2 so that the overlapping range OL1-2 can be recognized. Figure 14In the example shown, in each of the image display areas DA1 and DA2 , the overlapping range OL1 - 2 is surrounded by a frame F and the brightness of the image within the overlapping range OL1 - 2 is reduced, thereby displaying the overlapping range OL1 - 2 so that the overlapping range OL1 - 2 can be recognized.

[0178] By displaying the overlapping range in this manner so as to be recognizable, even when the images of the cameras C1 to C9 are displayed in the independent image display areas DA1 to DA9 , the overlapping state of the images between adjacent cameras can be easily grasped.

[0179] In this example, the brightness of the image within the overlapping range is changed in addition to the frame F for identifiable display. However, a configuration in which only the frame F is displayed is also possible. Alternatively, a configuration in which only the brightness is changed is also possible. Furthermore, the overlapping range can be masked and displayed in a manner in which the overlapping range is identifiable. Various methods can be used for identifiable display.

[0180] Furthermore, in this example, the image IM2 of the second camera C2 shows only the overlapping range with the image of the first camera C1 , but the image IM2 of the second camera C2 also shows the overlapping range with the image of the third camera C3 .

[0181] Thus, in the image display areas DA1 to DA9, the images of the cameras C1 to C9 are displayed in such a manner that the range where the images overlap with the images of the adjacent cameras can be distinguished. In other words, the images are displayed in such a manner that the range where the images overlap (first range) and the range where they do not overlap (second range) can be distinguished. Figure 14 , the area indicated by diagonal lines in the image displayed in each image display area is an example of a first range (a range where images overlap), and the area other than the diagonal lines is an example of a second range (a non-overlapping area).

[0182] (2) Overlap rate information

[0183] like Figure 13 As shown, information on the overlapping ratio is displayed in overlapping ratio display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 set in the screen.

[0184] The overlap ratio display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 are set as rectangular frames and are set between the image display areas DA1 and DA2. In this embodiment, the image display areas DA1 and DA2 are arranged in an arc shape at regular intervals, so the overlap ratio display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9 are also arranged in an arc shape at regular intervals. Figure 13 In the example shown, the regions outside the image display areas DA1 to DA2 are arranged at regular intervals.

[0185] The overlap ratio display area OR1-2 displays the overlap ratio between the image from the first camera C1 and the image from the second camera C2, and is located between the first image display area DA1 and the second image display area DA2. The overlap ratio display area OR2-3 displays the overlap ratio between the image from the second camera C2 and the image from the third camera C3, and is located between the second image display area DA2 and the third image display area DA3. The overlap ratio display area OR3-4 displays the overlap ratio between the image from the third camera C3 and the image from the fourth camera C4, and is located between the third image display area DA3 and the fourth image display area DA4. The overlap ratio display area OR4-5 displays the overlap ratio between the image from the fourth camera C4 and the image from the fifth camera C5, and is located between the fourth image display area DA4 and the fifth image display area DA5. The overlap ratio display area OR5-6 displays the overlap ratio between the image from the fifth camera C5 and the image from the sixth camera C6, and is located between the fifth image display area DA5 and the sixth image display area DA6. The overlap ratio display area OR6-7 displays the overlap ratio between the image from the sixth camera C6 and the image from the seventh camera C7, and is located between the sixth image display area DA6 and the seventh image display area DA7. The overlap ratio display area OR7-8 displays the overlap ratio between the image from the seventh camera C7 and the image from the eighth camera C8, and is located between the seventh image display area DA7 and the eighth image display area DA8. The overlap ratio display area OR8-9 displays the overlap ratio between the image from the eighth camera C8 and the image from the ninth camera C9, and is located between the eighth image display area DA8 and the ninth image display area DA9.

[0186] Information on the overlap ratios between images is displayed within the overlapping ratio display areas OR1-2, OR2-3, OR3-4, OR4-5, OR5-6, OR6-7, OR7-8, and OR8-9, each formed by a frame. Overlap ratios below a threshold are highlighted, for example, by inverting the background and text colors. Figure 13 This shows an example where the overlap ratio between the image of the seventh camera C7 and the image of the eighth camera C8 is less than a threshold value. Figure 13 An example of highlighting the image by inverting the image is shown. By highlighting the image in this way, it is possible to understand at a glance the image whose overlap ratio is less than the threshold value.

[0187] The method of emphasizing the display is not limited to inversion, and other methods may be used, such as changing the color of the characters, changing the color of the frame, flashing the display, or displaying a predetermined mark near the frame.

[0188] (3) Information on whether each camera's settings are appropriate

[0189] like Figure 13 As shown in FIG, information on whether the settings of each camera are appropriate is displayed in a camera information display area CI set in the screen. The camera information display area CI displays information on whether the settings are appropriate at a glance.

[0190] In the camera information display area CI, information on the determination results of whether the installation of each camera C1 to C9 is appropriate is displayed in a unit divided by each camera. In addition, cameras with an NG determination result are highlighted. For example, the background color and the text color are reversed. Figure 13 An example is shown when the judgment results of the seventh camera C7 and the eighth camera C8 are NG. Figure 13 An example of highlighting the reverse display is shown. By highlighting the display in this way, it is possible to identify at a glance which camera has failed to set up properly.

[0191] [The role of the shooting system]

[0192] As follows, imaging of the tunnel structure TS is performed using the imaging system 1 of this embodiment.

[0193] First, the multi-eye camera 10 is mounted on the trolley Tr and positioned at the imaging start position of the tunnel structure TS. Next, the multi-eye camera 10 is communicatively connected to the control device 100. This allows the control device 100 to control the multi-eye camera 10.

[0194] First, the user instructs the control device 100 to display a live preview image. In response to the instruction, the control device 100 instructs each camera C1 to C9 of the multi-eye imaging device 10 to output the live preview image. In response to the instruction, each camera C1 to C9 outputs the live preview image to the control device 100.

[0195] The control device 100 acquires live preview images from each of the cameras C1 to C9 and displays them on the display device 116 in a predetermined display format.

[0196] like Figure 13 As shown, in addition to displaying the live preview images of each camera C1 to C9, the live preview display screen DS1 also displays information on the overlap ratio between adjacent camera images and whether the settings of each camera C1 to C9 are appropriate. The live preview images of each camera C1 to C9 are displayed in a manner that allows identification of the extent to which images overlap between adjacent camera images.

[0197] The user observes the live preview display screen DS1 and confirms whether the settings of cameras C1 to C9 are appropriate. Figure 13 In the example, it is known that the settings of the 7th camera C7 and the 8th camera C8 are NG. The user makes the necessary adjustments based on the confirmed results. Figure 13 In the example above, the overlap ratio between the images of the sixth and seventh cameras C6 and C7 (35%) is greater than the overlap ratio between the images of the seventh and eighth cameras C7 and C8 (10%). Therefore, it can be confirmed that the setting of the seventh camera C7 is incorrect (it is offset toward the sixth camera C6). Therefore, the position of the seventh camera C7 is adjusted. Specifically, the position of the seventh camera C7 is fine-tuned to bring it closer to the position of the eighth camera C8.

[0198] When adjusting the positions of cameras C1-C9 during the live preview display, the display on screen DS1 also switches. That is, the adjustment results are reflected. The user confirms the live preview display screen DS1 and adjusts the positions of cameras C1-C9 so that the settings of all cameras C1-C9 are judged as OK. In other words, the positions are adjusted so that the overlap ratio of images between adjacent cameras exceeds a threshold.

[0199] After adjustments are complete, imaging begins. Specifically, the trolley Tr is driven, moving within the tunnel structure TS while the multi-lens imaging device 10 captures the inner wall surface of the tunnel structure TS. To capture moving images, the multi-lens imaging device 10 is instructed to start capturing, and then begins capturing. To manually capture still images, the user instructs the multi-lens imaging device 10 to capture via the control device 100. For interval photography, the user specifies the capture interval and then instructs the multi-lens imaging device 10 to start capturing.

[0200] Thus, according to the imaging system of this embodiment, the shooting status and settings of the cameras C1 to C9 mounted on the multi-eye imaging device 10 can be easily confirmed from the live preview display screen DS1. This makes it easy to confirm whether the shooting conditions are correct. Moreover, if adjustments are necessary, they can be easily made based on the on-screen display. This significantly reduces on-site work.

[0201] [Modification]

[0202] [Overlapping range detection method]

[0203] In the above embodiment, the overlapping range is detected by image processing, but the method of detecting the overlapping range is not limited to this. As long as the required information about the subject and the camera can be obtained, it can be calculated based on this information. For example, as long as the information about the viewing angle of each camera C1 to C9 and the distance from each camera C1 to C9 to the inner wall of the tunnel (information about the subject distance) can be obtained, the shooting range of each camera C1 to C9 can be obtained. In addition, as long as the information about the positional relationship and the shooting direction of each camera C1 to C2 can be obtained, the range of overlapping shooting areas between adjacent cameras can be calculated (inferred) based on this information.

[0204] Figure 15 This is a functional block diagram of the functions of the control device when calculating the overlap range.

[0205] like Figure 15 As shown, the control device 100 includes a camera information acquisition unit 111H that acquires information about cameras C1 to C9 and a subject information acquisition unit 111I that acquires information about a subject. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0206] The camera information acquisition unit 111H acquires the information necessary to calculate the overlap range from each camera C1-C9. This information includes at least the angle of view of each camera C1-C9. Furthermore, the angle of view can be determined from information on the focal length and sensor size. Therefore, instead of directly acquiring the angle of view information, information on the focal length and sensor size can also be acquired. Furthermore, the control device 100 pre-stores information on the positional relationship between each camera and the shooting direction as known information. For example, information on the positional relationship between each camera and the shooting direction when each bracket B1-B9 is in the reference position is stored.

[0207] The subject information acquisition unit 111I acquires information on the distance from each camera C1 to C9 to the inner wall of the tunnel (information on the subject distance). When each camera C1 to C9 has a distance measurement function, this information is acquired from each camera C1 to C9. In addition, for example, when the multi-eye camera 10 is equipped with a distance measurement sensor or a distance measurement mechanism such as LIDAR (light detection and ranging, laser imaging detection and ranging), it can also be acquired from these distance measurement sensors or distance measurement mechanisms. In addition, when there is design data of the subject (for example, CAD (computer aided design) data), the design data can also be acquired. If the design data of the subject can be acquired, the subject distance can be calculated in advance from the location where the multi-eye camera 10 is installed. The design data can also be acquired via a network, for example.

[0208] The overlapping range detection unit 111D calculates the imaging area (imaging range) of each of the cameras C1 to C9 based on the information acquired by the camera information acquisition unit 111H and the subject information acquisition unit 111I, and calculates the range where the imaging ranges of adjacent cameras overlap.

[0209] In addition, when the information about the camera to be used is known, the control device 100 may be configured to store the information in advance. In this case, only the information about the subject is acquired from the outside.

[0210] Furthermore, a configuration may be adopted in which a non-overlapping range (second range) is detected instead of the overlapping range (first range).

[0211] [Instant preview display]

[0212] Figure 16 This is a diagram showing another example of the live preview display screen.

[0213] Figure 16 This is an example of displaying images from each camera without tilt. In this case, each image display area DA1 to DA9 is set to be without tilt. Specifically, the bottom edge of each rectangular frame of each image display area DA1 to DA9 is set parallel to the bottom edge of the screen of display device 116.

[0214] As described above, each of the image display areas DA1 to DA9 only needs to be able to independently display the images of the respective cameras, and the orientation thereof can be appropriately set in consideration of image visibility.

[0215] Figure 17 This is a diagram showing another example of the live preview display screen.

[0216] Figure 17 The figure shows an example of capturing a tunnel structure with a so-called horseshoe-shaped cross-section. A cross-sectional view CS of the tunnel structure being captured is displayed on the screen, with image display areas DA1 to DA9 defined around it. In this case, each image display area DA1 to DA9 is also configured in a layout that roughly corresponds to the arrangement of cameras C1 to C9.

[0217] Figure 18 This is a diagram showing another example of the live preview display screen.

[0218] Figure 18 This example shows a case where a cross-sectional view of a tunnel structure is not displayed. As shown in this example, displaying a cross-sectional view of a tunnel structure is not essential. Furthermore, in this example, the image display areas DA1 to DA9 are set in a layout that roughly corresponds to the arrangement of cameras C1 to C9. That is, the image display areas DA1 to DA9 are set at roughly regular intervals in the circumferential direction relative to the cameras C1 to C9, which are arranged at roughly regular intervals in the circumferential direction.

[0219] [Other Modifications]

[0220] In the above embodiment, the case of displaying a live preview image is described as an example, but the same method can be used when displaying a captured image.

[0221] [Second embodiment]

[0222] As mentioned above, if the camera settings are incorrect, it is necessary to recheck them. The imaging system of this embodiment also has the function of automatically calculating correction conditions when camera settings are incorrect and presenting the results to the user. The basic structure of the system remains the same, so only the functions related to calculating and presenting correction conditions will be described here.

[0223] Figure 19 This is a functional block diagram of the control device according to this embodiment.

[0224] like Figure 19 As shown, regarding the calculation and presentation of correction conditions, the control device 100 of this embodiment includes functions such as a camera information acquisition unit 111H, a subject information acquisition unit 111I, and a correction condition calculation unit 111J. The functions of each unit are implemented by the CPU 111 executing a predetermined program.

[0225] As described above, the camera information acquisition unit 111H acquires information necessary for calculating the overlapping range from each of the cameras C1 to C9 . Furthermore, the subject information acquisition unit 111I acquires information on the distance from each of the cameras C1 to C9 to the tunnel inner wall (subject distance information).

[0226] When there is a camera with setting NG, the correction condition calculation unit 111J calculates the correction condition. That is, the correction condition for shooting with a specified overlap rate (for example, 20% or more) is calculated. The correction condition calculation unit 111J calculates the required correction condition based on the overlap rate information calculated by the overlap rate calculation unit 111E, the information obtained by the camera information acquisition unit 111H, and the information obtained by the subject information acquisition unit 111I. Specifically, the adjustment direction and adjustment amount are calculated. Regarding the adjustment direction, the counterclockwise direction when observing the multi-eye camera 10 from the front is designated as the positive direction, and the clockwise direction is designated as the negative direction. The adjustment amount is designated as an angle. The calculation result of the correction condition calculation unit 111J is output to the display control unit 111G. The display control unit 111G displays the correction information on the live preview display screen DS1.

[0227] Figure 20 This is a diagram showing an example of a live preview display screen.

[0228] The display control unit 111G displays information on whether the settings of each camera are appropriate together with the correction information in the camera information display area CI.

[0229] Then, the display control unit 111G emphasizes and displays the image display area of ​​the camera to be adjusted. Figure 20 The example in which the seventh camera C7 is the adjustment target is shown. The method of highlighting is not particularly limited. For example, the frame of the image display area can be emphasized by changing its thickness, color, or flashing. Figure 20 An example is shown in which the frame of the image display area is emphasized by making it thicker.

[0230] The user observes the real-time preview display DS1 and makes the necessary adjustments. Figure 20 In the example, the 7th camera C7 is tilted 5° in the clockwise direction (negative direction).

[0231] Thus, according to the imaging system of this embodiment, when there is an error in the camera setting, the required adjustment amount is automatically calculated and presented, thereby facilitating on-site work.

[0232] [Modification]

[0233] In the above embodiment, the correction direction and correction amount of the camera are calculated as correction conditions. However, only the correction direction or only the correction amount may be calculated.

[0234] Furthermore, while the overlap ratio is corrected by adjusting the camera's orientation (shooting direction) in the above embodiment, it is also possible to correct the overlap ratio by adjusting the focal length (zoom factor). In this case, for example, a correction value for the focal length is calculated. Alternatively, the correction direction for the focal length (telephoto or wide-angle) is calculated.

[0235] Furthermore, the correction conditions may be calculated using only the camera information and the subject information, or may be calculated using only the overlap ratio information.

[0236] [Third embodiment]

[0237] As mentioned above, when capturing images using multiple cameras, even a single setting error requires reshooting. However, confirming the settings for each camera is time-consuming. The imaging system of this embodiment also features centralized management of multiple cameras. Since the basic structure of the systems remains the same, only the centralized management function will be described here.

[0238] Figure 21 This is a functional block diagram of the control device according to this embodiment.

[0239] like Figure 21 As shown, the control device 100 of this embodiment includes a camera information acquisition unit 111H, a display control unit 111G, a setting change reception unit 111K, and a camera control unit 111A for centrally managing multiple cameras. The functions of each unit are implemented by the CPU 111 executing a predetermined program.

[0240] The camera information acquisition unit 111H acquires various information from each camera C1 to C9 mounted on the multi-eye camera 10. For example, the camera acquires information such as the set shutter speed, aperture value (F value), ISO sensitivity (ISO: International Organization for Standardization), focal length, remaining battery level, and available capacity of a storage medium (storage device). Information such as shutter speed, aperture value, ISO sensitivity, and focal length is an example of information related to shooting parameters. Information about the remaining battery level is an example of information related to the battery. Information about the available capacity of a storage medium is an example of information related to the capacity of images that can be stored.

[0241] The display control unit 111G displays the information (camera information) of each camera C1 to C2 acquired by the camera information acquisition unit 111H in a predetermined display format on the screen of the display device 116. This screen is composed of a screen different from the live preview display screen.

[0242] Figure 22 This is a diagram showing an example of a display screen showing camera information.

[0243] like Figure 22 As shown in FIG. 2 , on the camera information display screen DS2A, various information acquired from the cameras C1 to C9 are displayed in a list on the same screen. The camera information display screen DS2A is an example of a second screen.

[0244] Figure 22 An example is shown in which information such as shutter speed, aperture value, ISO sensitivity, focal length, remaining battery level, and free capacity of a storage medium is displayed.

[0245] The first row displays camera information XA1, the second column displays shutter speed (SS) information XA2, the third column displays aperture value (F-number) information XA3, the fourth column displays ISO sensitivity information XA4, the fifth column displays focal length f information XA5, the sixth column displays battery remaining capacity information XA6, the seventh column displays storage medium free capacity information XA7, and the eighth column displays storage medium free status determination results XA8. The remaining battery capacity is displayed as a percentage, with a fully charged state as 100. The storage medium free status determination results are displayed, with free capacity above a threshold being considered OK and free capacity below the threshold being considered NG. The storage medium free status determination results are an example of whether the camera's status is appropriate.

[0246] In this manner, by displaying a list of information on the cameras C1 to C9 mounted on the multi-eye imaging device 10 , it is possible to simultaneously grasp the setting status of the cameras C1 to C9 .

[0247] The setting change receiving unit 111K receives user-initiated setting changes for each of the cameras C1 to C9. This setting change is received via the camera information display screen DS2A. Specifically, setting changes are received for items listed on the camera information display screen DS2A (excluding the remaining battery charge and available storage capacity).

[0248] exist Figure 22 In the illustrated case, the shutter speed, aperture value, ISO sensitivity, and focal length can be set and changed.

[0249] Figure 23 This is a diagram showing an example of a method for receiving a setting change.

[0250] like Figure 23 As shown, a pull-down menu (also called a pull-down menu) PM is displayed to receive setting changes. The pull-down menu PM is displayed by pointing the mouse at the item to be changed and clicking it. The pull-down menu PM displays a list of selectable items. Figure 23 An example is shown in which the aperture value (F value) of the second camera (CAMERA 2) is changed.

[0251] When a setting change is made, a setting reflection button BT1 is displayed on the screen. When the setting change is reflected, the setting reflection button BT1 is clicked. This completes the reception of the setting change.

[0252] The camera control unit 111A changes the corresponding camera settings according to the contents of the setting change received by the setting change receiving unit 111K.

[0253] Thus, according to the imaging system of this embodiment, the control device 100 can simultaneously confirm the settings of the cameras C1 to C9 mounted on the multi-eye imaging device 10. This makes it easy to manage the settings of each camera C1 to C9. Furthermore, the settings of each camera C1 to C9 can be changed on the control device 100 as needed, thus reducing the time and effort required for setting settings.

[0254] [Modification]

[0255] While the above embodiment allows for individual changes to camera settings, it is also possible to allow for collective changes. For example, clicking the title of each item displays a drop-down menu, and the selected setting is reflected across all cameras. Alternatively, changing the settings of one camera automatically switches the settings of the other cameras to the same settings. In this case, it is preferable to allow the user to choose between individual changes and collective changes. For example, a configuration could be used in which a predetermined checkbox is provided, and only when the checkbox is checked will the settings be collectively changed.

[0256] Furthermore, in the above-described embodiment, a configuration is adopted in which a setting change is reflected by an execution instruction using the setting reflection button BT1 . However, a configuration may be adopted in which the change is immediately reflected in the camera.

[0257] Furthermore, in the above-described embodiment, a configuration is adopted in which settings are changed by a pull-down menu. However, for example, a configuration in which settings are changed by inputting a numerical value may also be adopted.

[0258] [Fourth embodiment]

[0259] The imaging system of this embodiment is a imaging system that further includes a function of presenting the user with camera settings suitable for the subject. The basic structure of the system is the same, so only the function of presenting camera settings suitable for the subject will be described here.

[0260] Figure 24 This is a functional block diagram of the control device according to this embodiment.

[0261] like Figure 24 As shown, the control device 100 of this embodiment includes functions such as a camera information acquisition unit 111H, a subject information acquisition unit 111I, a camera setting calculation unit 111L, a display control unit 111G, a setting change reception unit 111K, and a camera control unit 111A to provide a function for presenting camera settings suitable for a subject. The functions of each unit are implemented by the CPU 111 executing a predetermined program.

[0262] The camera information acquisition unit 111H acquires information necessary for calculating camera settings from each of the cameras C1-C9. This information includes at least information about the angle of view of each camera C1-C9, or information that enables the calculation of the angle of view (focal length information and sensor size information). Furthermore, the control device 100 pre-stores information about the positional relationship between the cameras and the shooting direction as known information.

[0263] The subject information acquisition unit 111I acquires information related to the subject. The subject information includes at least information that can be used to calculate the subject distance (information about the distance from each camera C1 to C9 to the tunnel wall). As an example, the subject information acquisition unit 111I acquires design data for the subject.

[0264] The camera setting calculation unit 111L calculates (infers) recommended camera settings suitable for photographing the subject based on the information acquired by the camera information acquisition unit 111H and the subject information acquisition unit 111I. Specifically, the camera settings calculation unit 111L calculates shooting parameters suitable for photographing the subject and the installation position of each camera. The calculated shooting parameters include, for example, information such as shutter speed, aperture value, ISO sensitivity, and focal length. The shutter speed, aperture value, and ISO sensitivity settings are calculated based on, for example, information about the distance to the subject and information about the brightness of the lighting devices L1 to L9. Regarding the focal length, the settings that can capture the wall surface at a specified resolution are calculated. The information about the brightness of the lighting devices L1 to L9 is pre-stored as known information by the control device 100. Regarding the installation position of each camera, for example, the adjustment direction and amount of the bracket from the reference position are calculated. The installation position of each camera is set so that the image overlap rate between adjacent cameras meets a predetermined condition (for example, 20%).

[0265] The display control unit 111G displays the information of the recommended settings (the estimation result) calculated by the camera setting calculation unit 111L on the screen of the display device 116 in a predetermined display format.

[0266] Figure 25 This is a diagram showing an example of a display screen showing recommended camera settings.

[0267] like Figure 25 As shown, the information of the inferred recommended settings of each camera is displayed on the display screen DS2B of the recommended settings of the camera.

[0268] Figure 25 An example is shown in which recommended settings for shutter speed, aperture value, ISO sensitivity, and focal length are displayed as shooting parameters. Figure 25As shown, recommended settings for shutter speed, aperture value, ISO sensitivity, and focal length are displayed for each camera. In addition, recommended setting information for the installation position (information on the bracket adjustment direction and adjustment amount from the reference position) is displayed for each camera.

[0269] When the user receives the recommended settings for the shooting parameters, he clicks the settings reflection button BT1 displayed on the screen. In this way, the settings are reflected. When the settings are reflected, the camera control unit 111A sets the shooting parameters of each camera according to the recommended settings.

[0270] When changing the settings, it is the same as the case of the third embodiment described above. Point the mouse at the item you want to change the settings and click it. This will display a drop-down menu and you can change the recommended settings (see Figure 23 ).

[0271] When the camera position needs to be corrected, the user corrects the position of each camera C1 to C9 according to the screen display.

[0272] As described above, according to the imaging system of this embodiment, camera settings (recommended settings) suitable for the subject can be known simply by inputting necessary information into the control device 100. This makes it possible to easily perform various settings.

[0273] Furthermore, in the above-described embodiment, the configuration is adopted in which the setting is reflected by the execution instruction of the setting reflection button BT1 , but the setting may be automatically set after the setting is calculated.

[0274] [Fifth embodiment]

[0275] The imaging system of this embodiment also features a function for displaying images captured by the multi-eye imaging device 10 (captured images). The term "captured images" here refers to images captured in response to a user's instruction for formal capture (capture for recording purposes) and recorded in a storage device (storage medium). In other words, these are images that have already been recorded. The basic structure of the system remains the same, so only the function for displaying captured images will be described here.

[0276] Figure 26 This is a functional block diagram of the control device according to this embodiment.

[0277] like Figure 26 As shown, the control device 100 of this embodiment includes an image acquisition unit 111C, a recording control unit 111M, an image processing unit 111N, and a display control unit 111G for displaying captured images. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0278] The image acquisition unit 111C acquires captured images from the cameras C1 to C9 mounted on the multi-eye imaging device 10. The cameras C1 to C9 perform imaging in response to a main imaging instruction from the control device 100 and output the images recorded in a storage medium to the control device 100.

[0279] The recording control unit 111M records images captured by each of the cameras C1 to C9 in the auxiliary storage device 114. The images are recorded with information identifying the recording source (the camera that captured the image) and the order of recording (e.g., date and time). For example, the images are recorded in directories divided into separate directories for each capture (i.e., a single capture of a tunnel). Within each directory, the images are also divided into separate directories for each camera.

[0280] The image processing unit 111N performs predetermined image processing on the captured image in accordance with an instruction from the user, and performs panoramic synthesis processing as an example.

[0281] The display control unit 111G displays the captured image on the screen of the display device 116 in a predetermined display format in accordance with an instruction from the user.

[0282] Figure 27 This is a diagram showing an example of a display screen of a captured image.

[0283] like Figure 27 As shown, the captured image display screen DS3A displays images captured by each camera C1 to C9 in chronological order. The images in each column are time-series images captured by each camera C1 to C9, and are displayed in chronological order from top to bottom. Furthermore, the images in each row are images captured by each camera C1 to C9 at the same time. The captured image display screen DS3A is an example of the third screen.

[0284] like Figure 27 As shown, a capture button BT2, a delete button BT3, and a synthesize button BT4 are displayed on the captured image display screen DS3A.

[0285] The shooting button BT2 is a button for instructing the multi-eye camera 10 to execute the actual shooting. By pressing the shooting button BT2, the camera control unit 111A (see FIG. Figure 11 ), instructing the multi-eye imaging device 10 to perform the actual shooting of a still image (shooting of a still image for recording). When performing the actual shooting, the images shot by each camera C1 to C9 (shot images) are output to the control device 100 and displayed on the screen.

[0286] The delete button BT3 is a button for instructing to delete an image. Selecting an image to be deleted from the images displayed on the screen and pressing the delete button BT3 deletes the selected image. Image deletion can be performed by both the cameras C1 to C9 and the control device 100, or by the control device 100 alone.

[0287] The synthesis button BT4 is a button for instructing panoramic synthesis. When the synthesis button BT4 is pressed, the images captured by the cameras C1 to C9 at the same time are synthesized into a panoramic view and displayed on the screen of the display device 116.

[0288] Figure 28 FIG. 1 is a diagram showing an example of a display screen of a panoramically synthesized image.

[0289] like Figure 28 As shown, the panoramically synthesized image is displayed on the display screen DS3B of the display device 116. The images are displayed in time series from the top to the bottom of the screen. The display screen DS3B is another example of the third screen.

[0290] As described above, according to the imaging system of this embodiment, it is possible to confirm the images captured by the multi-eye imaging device 10 (the images that have been recorded).

[0291] Furthermore, similarly to the live preview images, the captured images may be displayed so that the overlapping range between adjacent images can be recognized.

[0292] [Modification]

[0293] It is desirable to be able to confirm whether a captured image can be accurately captured under the set conditions (capturing parameters). Therefore, it is desirable to have a configuration that can display the capturing parameters.

[0294] Figure 29 This is a diagram showing an example of display of shooting parameters.

[0295] Figure 29 An example is shown in which information on the shutter speed, aperture value, ISO sensitivity, and focal length of a selected image is displayed.

[0296] When you select an image with the cursor Cu and press the EXIF ​​button BT5 on the screen, the shutter speed, aperture value, ISO sensitivity, and focal length information (shooting parameters) of the selected image are displayed on the pop-up screen.

[0297] Typically, various information, including shooting parameters, is recorded as additional information (metadata) with images captured by digital cameras. For example, various information is recorded with images recorded in the EXIF ​​(Exchangeable Image File Format) format. The display control unit 111G reads the information attached to the image and displays the shooting parameters of the selected image on the screen.

[0298] Figure 30 It is a diagram showing another example of display of shooting parameters.

[0299] Figure 30 This is an example of displaying the shooting parameter information set for the camera (Value in camera) and the shooting parameter information of the actually captured image (Value in image) in a comparable manner.

[0300] In this way, by displaying the shooting parameters set for the camera and the shooting parameters of the actually captured image in a comparable manner, it is possible to easily confirm whether the image has been accurately captured.

[0301] In addition, if Figure 30 As shown, when there are different items between the shooting parameters set for the camera and the shooting parameters of the actually captured image, it is preferable to highlight them. Figure 30 This is an example of when the ISO sensitivity is different from the setting, and the text and background colors are inverted for emphasis.

[0302] Furthermore, as in this example, when displaying in a comparable manner, the control device 100 must store information about the shooting parameters pre-set for the camera. If the control device 100 has a function for calculating (estimating) shooting parameters (the fourth embodiment), the calculated information can be used. Alternatively, methods such as user pre-entry can be employed.

[0303] [Sixth embodiment]

[0304] The imaging system of this embodiment is further equipped with a function for determining whether images (captured images) captured by the multi-eye imaging device 10 are properly captured. Since the basic configuration of the systems is the same, only the function for determining whether images are properly captured will be described here.

[0305] Figure 31 This is a functional block diagram of the control device according to this embodiment.

[0306] like Figure 31As shown, the control device 100 of this embodiment has functions such as an image acquisition unit 111C, a photographing determination unit 111P, and a display control unit 111G to determine whether photographing is appropriate. The functions of each unit are realized by the CPU 111 executing a predetermined program.

[0307] The image acquisition unit 111C acquires captured images from the cameras C1 to C9 mounted on the multi-eye imaging device 10 .

[0308] The image capture determination unit 111P analyzes the captured image and determines whether the image capture is appropriate (OK or NG). For example, it analyzes the image histogram to determine whether the image was captured with a specified image quality. Images captured with the specified image quality are determined to be "OK," while images not captured with the specified image quality are determined to be "NG."

[0309] The display control unit 111G displays the captured image together with the determination result on the screen of the display device 116 in a predetermined display format.

[0310] Figure 32 This is a diagram showing an example of a display screen of a captured image.

[0311] like Figure 32 As shown in FIG3 , the images captured by the cameras C1 to C9 are displayed in a time-series order on the captured image display screen DS3C. When determining whether the image capture is appropriate, images that are determined to be NG are marked with a mark MA and displayed. Figure 32 In the example shown, all images captured by the first camera C1 are NG. The captured image display screen DS3 is another example of the third screen.

[0312] As described above, according to the imaging system of this embodiment, it is possible to easily confirm whether the imaging of each captured image is appropriate.

[0313] [Modification]

[0314] In the above embodiment, the structure is set to determine whether the shooting is appropriate (the quality of the image) based on the histogram of the image, but the method of determining whether the shooting is appropriate is not limited to this. In addition, for example, it is also possible to use a learned model that has learned to determine the quality of the image to determine whether the shooting is appropriate. In addition, it is also possible to use information attached to the image (for example, EXIF ​​information) to determine whether the shooting is appropriate. In this case, for example, it is determined whether the shooting was performed with pre-set shooting parameters to determine whether the shooting is appropriate.

[0315] [Other embodiments]

[0316] [Subject]

[0317] The above embodiment has been described by taking the case of imaging a tunnel structure TS as an example, but the subject is not limited thereto. In addition, the cameras are arranged in a layout corresponding to the subject and are configured to include a camera pair whose imaging areas overlap.

[0318] [System Structure]

[0319] The multi-eye camera 10 and the control device 100 may be communicatively connected via a network such as the Internet.

[0320] Furthermore, the function of the control device can also be realized by a so-called cloud computer. At this time, for example, a terminal (personal computer, smart phone, tablet computer, etc.) held by the user can be used as an input device and the display of the terminal can be used as a display terminal.

[0321] [Hardware Structure of Processing Device]

[0322] The functions of a processing device are implemented by various processors. These include general-purpose processors such as CPUs and / or GPUs (Graphic Processing Units) that execute programs and function as various processing units, FPGAs (Field Programmable Gate Arrays), and processors with circuit structures that can be modified after manufacturing, such as Programmable Logic Devices (PLDs) and ASICs (Application Specific Integrated Circuits), which are processors with circuit structures specifically designed to perform specific processing, such as dedicated circuits. Programs and software have the same meaning.

[0323] One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same or different types. For example, one processing unit may be composed of multiple FPGAs or a combination of a CPU and an FPGA. In addition, multiple processing units may be composed of one processor. As an example of a plurality of processing units composed of one processor, there is the following method: as represented by a computer used for a client and a server, one processor is composed of a combination of one or more CPUs and software, and the processor functions as a plurality of processing units. Second, there is the following method: as represented by a system on chip (SoC), a processor that implements the functions of the entire system including a plurality of processing units using one IC (Integrated Circuit) chip is used. In this way, the various processing units are composed of one or more of the above-mentioned various processors as a hardware structure.

[0324] Explanation of symbols

[0325] 1- Imaging system, 10- Multi-lens imaging device, 11- Frame, 12- Base, 13F- Front column, 13R- Rear column, 14F- Front panel, 14FF- Front panel, 14R- Rear panel, 20- Relay device, 100- Control device, 100A- Camera control unit, 111- CPU, 111A- Camera control unit, 111B- Lighting control unit, 111C- Image acquisition unit, 111D- Overlap range detection unit, 111E- Overlap ratio calculation unit, 111F- Setting determination unit, 111G- Display control unit, 111H- Camera information acquisition unit, 111I- Subject information acquisition unit, 111J- Correction condition calculation unit, 111K- Setting change reception unit, 111L- Camera setting calculation unit 111M-recording control unit, 111N-image processing unit, 111P-shooting determination unit, 112-ROM, 113-RAM, 114-auxiliary storage device, 115-input device, 116-display device, 117-communication interface, B1-bracket (1st bracket), B2-bracket (2nd bracket), B3-bracket (3rd bracket), B4-bracket (4th bracket), B5-bracket (5th bracket), B6-bracket (6th bracket), B7-bracket (7th bracket), B8-bracket (8th bracket), B9-bracket (9th bracket), BT1-setting reflection button, BT2-shooting button, BT3-delete button, BT4-synthesis button, BT5-EXIF button, C1-phase Camera (1st camera), C2-Camera (2nd camera), C3-Camera (3rd camera), C4-Camera (4th camera), C5-Camera (5th camera), C6-Camera (6th camera), C7-Camera (7th camera), C8-Camera (8th camera), C9-Camera (9th camera), CI-Camera information display area, CL-Clamp, CS-Sectional view, Cu-Cursor, DA1-Image display area (1st image display area), DA2-Image display area (2nd image display area), DA3-Image display area (3rd image display area), DA4-Image display area (4th image display area), DA5-Image display area (5th image display area), DA6-Image display area (6th image display area), DA7-image display area (7th image display area), DA8-image display area (8th image display area), DA9-image display area (9th image display area), DS1-live preview display screen, DS2A-camera information display screen, DS2B-camera recommended settings display screen, DS3A-captured image display screen, DS3B-panoramic synthesis captured image display screen, DS3C-captured image display screen, F-frame, IM1-image, IM2-image, L1-1st lighting device, L2-2nd lighting device, L3-3rd lighting device, L4-4th lighting device, L5-5th lighting device, L6-6th lighting device,L7-7th lighting device, L8-8th lighting device, L9-9th lighting device, MA-marker, OL1-2-overlapping range, OR1-2-overlapping rate display area, OR2-3-overlapping rate display area, OR3-4-overlapping rate display area, OR4-5-overlapping rate display area, OR5-6-overlapping rate display area, OR6-7-overlapping rate display area, OR7-8-overlapping rate display area, OR8-9-overlapping rate display area, PM-pull-down menu, Ra-track, TS-tunnel structure, Tr-trolley, U1-1st shot Unit, U2 - 2nd imaging unit, U3 - 3rd imaging unit, U4 - 4th imaging unit, U5 - 5th imaging unit, U6 - 6th imaging unit, U7 - 7th imaging unit, U8 - 8th imaging unit, U9 - 9th imaging unit, XA1 - Camera information, XA2 - Shutter speed information, XA3 - Aperture value (F value) information, XA4 - ISO sensitivity information, XA5 - Focal length f information, XA6 - Battery level information, XA7 - Storage medium free capacity information, XA8 - Storage medium free state determination result information.

Claims

1. A processing device for processing images captured by multiple cameras, wherein: The processing device includes a processor, The processor performs the following processing: Setting a plurality of independent image display areas corresponding to the plurality of cameras on a first screen output to a display terminal; and The images of the plurality of cameras are displayed in the plurality of image display areas in a state where a first range where images of adjacent cameras overlap and a second range where images do not overlap can be distinguished.

2. The processing device according to claim 1, wherein The plurality of cameras include a camera pair whose photographing areas overlap.

3. The processing device according to claim 1, wherein The processor sets the plurality of image display areas in a layout corresponding to the arrangement of the plurality of cameras.

4. The processing device according to claim 3, wherein The processor processes images from the plurality of cameras to detect the first range and / or the second range.

5. The processing device according to claim 3, wherein The processor performs the following processing: Information related to the subject and information related to the plurality of cameras is acquired, and the first range and / or the second range is detected based on the acquired information.

6. The processing device according to claim 4 or 5, wherein: The processor performs the following processing: Calculating an overlapping ratio of images displayed in the image display area based on the first range and / or the second range; and The overlapping ratio is displayed on the first screen.

7. The processing device according to claim 6, wherein: The processor performs the following processing: determining whether the settings of the plurality of cameras are appropriate based on the overlap ratio; and The determination result is displayed on the first screen.

8. The processing device according to claim 6, wherein The processor performs the following processing: Determining correction conditions for the settings of the plurality of cameras based on the overlap ratio; and The correction condition is displayed on the first screen.

9. The processing device according to any one of claims 1 to 5, wherein: The processor causes images captured by the plurality of cameras in time series to be displayed in the image display area in a time series order.

10. The processing device according to any one of claims 1 to 5, wherein The processor performs the following processing: Acquiring information of the plurality of cameras; and Information on the plurality of cameras is displayed on a second screen different from the first screen.

11. The processing device according to claim 10, wherein The processor performs the following processing: Acquiring information related to the subject, and inferring, based on the acquired information, shooting parameters of the plurality of cameras set when photographing the subject; and According to the inference result, the shooting parameters of the plurality of cameras are set.

12. The processing device according to claim 10, wherein The camera information includes at least one of information related to shooting parameters, information related to image storage capacity, and information related to a battery.

13. The processing device according to claim 12, wherein: The processor performs the following processing: On the second screen, receiving changes to the shooting parameters of the plurality of cameras individually or collectively; and According to the received content, the shooting parameters of the camera are changed individually or collectively.

14. The processing device according to claim 12, wherein The processor performs the following processing: determining whether the states of the plurality of cameras are appropriate based on the information of the plurality of cameras; and The determination result is displayed on the second screen.

15. The processing device according to any one of claims 1 to 5, wherein The processor displays the plurality of camera images that have been recorded on a third screen that is different from the first screen.

16. The processing device according to claim 15, wherein The processor performs the following processing: Performing panoramic synthesis on the images recorded by the plurality of cameras; and The panoramically synthesized image is displayed on the third screen.

17. The processing device according to claim 15, wherein The processor performs the following processing: Determining whether the recording of the plurality of camera images completed is appropriate based on the image and / or information attached to the image; and The determination result is displayed on the third screen.

18. The processing device according to claim 17, wherein The processor determines whether the shooting is appropriate based on the histogram of the image.

19. The processing device according to claim 17, wherein The processor determines whether the photographing is appropriate based on photographing parameter information added to the image.

20. The processing device according to claim 15, wherein The processor performs the following processing: receiving a selection of an image on the third screen; and The shooting parameters of the selected image are displayed on the third screen.

21. The processing device according to claim 20, wherein The processor displays the shooting parameters of the selected image and the shooting parameters of the camera when the selected image was shot on the third screen in a comparable state.

Images