Information processing device, information processing method, and program

Abstract

To group photographed images for each photographing object in detecting structural deformation.SOLUTION: An information processing device has: first acquisition means for acquiring positional relations between multiple images when photographing each of multiple objects; second acquisition means for acquiring identification information different for each object, the identification information being transmitted by radio waves from communication devices provided at boundaries of shapes of each of the multiple objects, when photographing the objects; linking means for linking the identification information acquired by the second acquisition means to the positional relations between the multiple images; and generation means for generating an image group for each object from the multiple images on the basis of the positional relations and the identification information linked by the linking means.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention particularly relates to a technique for managing images used in the inspection of social infrastructure structures. [Background technology]

[0002] A conventional method for inspecting social infrastructure, such as bridges and tunnels, for damage caused by aging involves photographing the structure to be inspected and analyzing the resulting images. A common method for photographing is to use an imaging device mounted on a mobile vehicle such as a drone or an automatic camera platform, in which large structures are divided into multiple areas and photographed. The divided images are then synthesized to obtain a composite image showing the entire structure to be inspected.

[0003] To obtain a composite image from the segmented images, it is necessary to group the segmented images captured for each inspection target. Patent Document 1, for example, discloses a technique for grouping segmented images in which a landmark image capturing an entire image of the inspection target is captured and the landmark image is designated during grouping, automatically grouping the segmented images. Looking outside the field of infrastructure inspection, Patent Document 2, for example, discloses a technique for grouping segmented images by having the photographer read an RFID tag each time the target is changed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-124832 [Patent Document 2] Patent No. 6580286 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with the conventional technology disclosed in the above-mentioned Patent Document 1, it is necessary to change the lens that captures the entire inspection target or change the shooting settings to capture the landmark image. Also, with the conventional technology disclosed in the above-mentioned Patent Document 2, it is necessary to read the RFID tag when switching between shooting targets, which limits the order in which divided shots can be taken.

[0006] Therefore, an object of the present invention is to group captured images by the subject of the image in detecting structural abnormalities. [Means for solving the problem]

[0007] In order to achieve the above object, the present invention provides: a first acquisition means for acquiring a positional relationship between a plurality of images when photographing each of a plurality of objects; a second acquisition means for acquiring, when photographing the objects, identification information that is different for each object and is transmitted by radio waves from a communication device provided at a boundary of the shape of each of the plurality of objects; a linking means for linking the identification information acquired by the second acquisition means to a positional relationship of the plurality of images; a generating means for generating an image group for each object from the plurality of images based on the positional relationship and the identification information linked by the linking means; The present invention is characterized by having the following. [Effects of the Invention]

[0008] According to the present invention, in detecting deformation of a structure, photographed images can be grouped by photographed object. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram of an imaging system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram of an identification information processing unit according to an embodiment of the present invention. [Figure 3] FIG. 2 is a block diagram of an image processing unit according to the embodiment of the present invention. [Figure 4] 1 is an example of an inspection target in an embodiment of the present invention. [Figure 5] 1 is a flowchart of an infrastructure inspection work according to an embodiment of the present invention. [Figure 6] 10 is an example of divided photographing according to an embodiment of the present invention. [Figure 7] 10 is an example of photography path information according to an embodiment of the present invention. [Figure 8] 1 is an example of RFID installation according to an embodiment of the present invention. [Figure 9] 10 is an example of a divided image according to an embodiment of the present invention. [Figure 10] 10 is an example of identification information and position coordinates according to an embodiment of the present invention. [Figure 11] FIG. 3 is a block diagram of a group generation unit according to the embodiment of the present invention. [Figure 12] 10 is a flowchart illustrating an example of grouping according to an embodiment of the present invention. [Figure 13] 10 is an example of identification information and position coordinates after grouping according to an embodiment of the present invention. [Figure 14] 1 is an example of an inspection target in an embodiment of the present invention. [Figure 15] 10 is an example of a divided image according to an embodiment of the present invention. [Figure 16] 10 is an example of identification information and position coordinates according to an embodiment of the present invention. [Figure 17] 10 is a flowchart illustrating an example of grouping according to an embodiment of the present invention. [Figure 18] 10 is an example of identification information and position coordinates after grouping according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] A preferred embodiment of the present invention will be described in detail below with reference to the accompanying drawings. The imaging system according to this embodiment is used to photograph the surface of a structure to be inspected as part of a social infrastructure inspection and to confirm the image at the site. Examples of structures that are subject to social infrastructure inspection include bridges, tunnels, buildings, and roads.

[0011] When a bridge is the object of inspection, an imaging device is used to photograph the bridge from below and from the side, and multiple images (multiple images each capturing a different part of the bridge) are acquired in a divided area for inspection. The imaging is performed while moving appropriately in the direction of extension of the bridge and in a direction perpendicular to the direction. Note that, depending on the conditions around the bridge, it may be difficult for an inspector to move and photograph, so a mobile mechanism that can move along the bridge can be provided to perform the photographing. Note that in this embodiment, a drone is used as the mobile mechanism, but other vehicles, robots, and other flying objects may also be used. Furthermore, such a mobile mechanism may further be provided with a lifting mechanism and a rotation mechanism (a mechanism for panning and / or tilting) for the imaging device.

[0012] (First embodiment) Infrastructure inspection photography according to a first embodiment of the present invention will be described below with reference to Figures 1 to 13. Figure 1 is a block diagram of an imaging system according to the first embodiment of the present invention.

[0013] Reference numeral 100 denotes an imaging device constituting an imaging system. Reference numeral 101 denotes a system control unit that controls the imaging device 100, including control related to image capture, image processing, communication, display, and so on. Reference numeral 102 denotes an imaging unit that controls the optical system for exposing and imaging the imaging sensor, the imaging sensor, AD conversion, gain control, and correction control. Reference numeral 103 denotes an image processing unit that performs processes such as correction, development, compression, and encoding on the data captured by the imaging unit 102 to generate image data. It also performs control and processing for improving the quality of captured images, such as AF, AE, WB, image stabilization, and flash control, as well as image analysis, detection, and recognition. Reference numeral 104 denotes an internal memory and a removable external memory provided in the camera 100. The internal memory is used to temporarily store data when the imaging unit 102 acquires image data or when the image processing unit 103 processes images, and also to temporarily store data when displaying and communicating. Reference numeral 105 denotes a display unit that includes a TFT LCD panel or an organic EL panel and doubles as a user input unit with a touch panel configuration. A communication unit 106 connects to an external system of the image capturing apparatus 100 via a wireless or wired connection to transmit and receive data.

[0014] Reference numeral 110 denotes an information processing device constituting the imaging system. Reference numeral 111 denotes a system control unit that controls the information processing device 110. Reference numeral 112 denotes an identification information processing unit that acquires identification information, such as a unique ID of an object, and associates the acquired information with the captured image. Details will be described later. Reference numeral 113 denotes an image processing unit that acquires position information of input image data, sorts images, and outputs the processing results. Details will be described later. Reference numeral 114 denotes an internal memory provided in the information processing device 110, which is used to store input / output data and temporary data of the identification information processing unit 112 and the image processing unit 113, and also to temporarily store data during display and communication processing. Reference numeral 115 denotes a display unit that includes a TFT liquid crystal panel or an organic EL panel and doubles as a user input unit with a touch panel configuration. Reference numeral 116 denotes a communication unit that connects to an external system of the information processing device 110 via a wireless or wired connection, and transmits and receives data.

[0015] The communication unit 106 of the imaging device 100 and the communication unit 116 of the information processing device 110 are connected by a wireless or wired communication method.

[0016] Reference numeral 120 denotes a mobile device (unmanned aerial vehicle, drone). The mobile device 120 carries the imaging device 100 and the information processing device 110, and controls the position and attitude of the imaging device 100 to move by flight. The mobile device 120 can also input a movement direction and distance for movement. The movement control unit 121 processes information measured by various sensors (gyro sensor, acceleration sensor, barometric pressure sensor, distance sensor, etc.) to recognize a specific position on the X-axis, Y-axis, and Z-axis in space, and controls flight to maintain its position and attitude. Therefore, even if a disturbance such as a sudden gust of wind occurs, the flight control of the movement control unit 121 can return the mobile device to its original position. Furthermore, the movement control unit 121 performs flight control and moves its own position in response to a movement command from the system control unit 111. The mobile device 120 can also receive operation signals from a controller device operated by a user to control flight.

[0017] The identification information processing unit 112 will now be described with reference to Fig. 2. The identification information processing unit 112 includes an identification information acquisition unit 201 and an identification information linking unit 202. The identification information acquisition unit 201 acquires identification information of the inspection object when photographing the inspection object. The identification information linking unit 202 links the photographed image with the identification information acquired by the identification information acquisition unit 201 and records them. Details of each component will be described later.

[0018] The image processing unit 113 will now be described with reference to Fig. 3. The image processing unit 113 includes an image acquisition unit 301, an image positional relationship acquisition unit 302, an image sorting unit 303, and a group generation unit 304. The image acquisition unit 301 acquires image data captured by the imaging device 100 and stores the data. The image positional relationship acquisition unit 302 acquires positional information of the captured images. The image sorting unit 303 organizes the mutual positional relationships of the captured images based on the positional information acquired by the image positional relationship acquisition unit 302. The group generation unit 304 groups the captured images by inspection target. Details of each component will be described later.

[0019] FIG. 4 is an image diagram of an inspection target. 400a and 400b represent infrastructure structures, which are inspected separately in this embodiment. Surface 401 is the inspection and photography range of structure 400a. 402 is a defect such as a crack found in structure 400a, which is also a feature that can be detected on the surface of a structure made of concrete or the like. Similarly, a defect exists in structure 400b.

[0020] The components involved in dividing and photographing the inspection object shown in Figure 4 and grouping them will be described in reference to the flowchart showing the outline of the grouping process for divided images shown in Figure 5. In Figure 5, S represents a step.

[0021] In S501, the system control 111 receives the divided image data captured by the imaging unit 102 via the communication unit 116 and inputs the divided image data to the image acquisition unit 301. The image acquisition unit 301 stores the acquired image data internally. FIG. 6 is an image diagram of divided photography. In the divided image 600, the dotted line indicates the range of one divided photography. In this embodiment, 4 x 3 divided photography is performed for each of the structure 400a and the structure 400b.

[0022] In S502, the movement control unit 121 acquires position information by providing an inertial navigation system (INS) or the like to a mobile mechanism such as a drone. An inertial navigation system is a technology that acquires the amount of change in position by analyzing the output of an acceleration sensor installed in a location that is maintained horizontal. The amount of change in position during segmented shooting is input to the image positional relationship acquisition unit 302, thereby recording position information (shooting path information) of the segmented images. Furthermore, information measured by a global positioning system (GPS) of the mobile mechanism such as a drone may be used as the position information. The position information of the segmented images acquired by the image positional relationship acquisition unit 302 is recorded in association with the images acquired by the image acquisition unit 301. Here, FIG. 7 is an illustration of the shooting path information. Reference numerals 701 and 702 represent the position information acquired by the image positional relationship acquisition unit 302 during segmented shooting. Reference numeral 700 represents the shooting path acquired based on the amount of change in position obtained from the start of shooting to the end of shooting.

[0023] In S503, the identification information acquisition unit 201 is equipped with a directional antenna for wireless communication only with communication devices located in a specific direction, and reads identification information from the communication device installed on the object. The communication device may be an RFID (Radio Frequency Identification) or similar. The range of radio waves emitted from the antenna (the antenna's directional range) has a directivity similar to the angle of view during shooting. This antenna's directivity allows only RFID tags present within the range of the captured image to be read. The identification information acquisition unit 201 also simultaneously measures the signal strength (RSSI: Received Signal Strength Indicator) from the communication device. Figure 8 shows an illustration of RFID tag installation. 800a and 800b represent the positions of RFID tags installed on structure 400a and structure 400b, respectively. The RFID tags are placed on the boundary based on the shape of the object. In Figure 8, structure 400a is considered a rectangle, and RFID tags are installed at the four vertices of the rectangle. RFID tags must be installed in advance before inspection.

[0024] The four RFID tags installed in the structure 400a, including the RFID tag 800a, record identification information that can identify the structure 400a. For example, the following information is recorded: 00001-1, 00001-2, 00001-3, 00001-4

[0025] In the above example of identification information, the unique ID of the structure 400a is 00001, and the numbers after the hyphen (-) represent the numbers of the four RFID tags installed in the structure 400a, including the RFID tag 800a. Note that the four RFID tags can be grouped without identifying each one. The signal strength from the communication device may also be recorded at the same time.

[0026] S504 is a branching step based on whether a communication device (RFID tag) is present within the imaging range in S503. If an RFID tag is present (the directional antenna of the identification information acquisition unit 201 can read an RFID tag within the imaging range), the process proceeds to S505. Even if an RFID tag is not present within the imaging range, there is a possibility that the identification information of an RFID tag outside the imaging range may be read due to the communication distance. The identification information acquisition unit 201 simultaneously measures and records the signal strength from the RFID tag, so a threshold is set for the signal strength, and if the signal strength is above a certain value, the process proceeds to S505. Here, the threshold is calculated based on the difference in signal strength between when an RFID tag is received within the imaging range and when an RFID tag is received from outside the imaging range.

[0027] In S505, the identification information linking unit 202 links and records the position information of the image acquired by the image positional relationship acquisition unit 302 and the identification information acquired by the identification information acquisition unit 201. If the identification information acquisition unit 201 does not detect any RFID within the shooting range in S503, no identification information is linked to the divided image, and therefore the divided image is treated as an image without identification information in the grouping operation described below.

[0028] S506 is a branch to determine whether or not imaging of all of the inspection objects has been completed. In this embodiment, the process proceeds to S507 when divided imaging of all of the structures 400a and 400b has been completed.

[0029] In S507, the image rearrangement unit 303 performs image mapping based on the position coordinates of the images acquired by the image positional relationship acquisition unit 302. Specifically, position coordinates for grouping (described later in FIG. 10) are assigned to the segmented images. FIG. 9 is a diagram visualizing the mapping. 900 is a group of images captured by segmented photography. The segmented images 901 to 924 are rearranged based on the photography path 700. The numbers 901 to 924 are assigned in the order of photography based on the photography path 700. In this embodiment, each object is segmented and photographed into 4×3 (4 rows and 3 columns) images, so the entire image of each object is a 4×3 rectangle.

[0030] FIG. 10 is an illustration of the image rearrangement unit 303 assigning position coordinates for grouping to segmented images. 1000 is a group of images captured in a divided manner, and 1001 to 1024 are segmented images. The numbering of the segmented images corresponds to the numbering of the segmented images in FIG. 9. For example, segmented image 1001 corresponds to segmented image 901. Regarding position information, for example, the photographing position of segmented image 1001 is photographing position 701, and the photographing position of segmented image 1002 is photographing position 702, so position coordinates are assigned to the segmented images so as to correspond to the photographing positions. In this case, the coordinates of segmented image 1001 are used as the reference (row i = 1, column j = 1). Furthermore, among the segmented images of the photographed image group 1000, images with identification information are shown as the identification information of structure 400a (object a) or the identification information of structure 400b (object b). In the example of FIG. 10, the images with identification information of object a are segmented images 1001, 1003, 1022, and 1024. The images with identification information of the object b are the divided images 1004, 1006, 1019, and 1021.

[0031] In S508, the group generation unit 304 generates a group of images (images) of the same object based on the relative positions of the images linked by the identification information linking unit 202, the presence or absence of identification information for each image, and the content of the identification information. In this embodiment, since the images to which identification information is assigned are located at the vertices of a rectangle, the images included in the area connecting the four vertices are assigned the same identification information as the vertices. Then, a group of images (images) with the same identification information is created.

[0032] The group generation unit 304 will now be described with reference to Fig. 11. The group generation unit 304 includes an identification information reading unit 1101, an identification information setting unit 1102, an identification information writing unit 1103, and an image sorting unit 1104.

[0033] The grouping process of divided images in group generation unit 304 will be explained using a flowchart in Fig. 12. In Fig. 12, S represents a step. In Fig. 12, i and j represent the position coordinates (i is row, j is column) of the divided image in Fig. 10. Also, k and m are variables used in the flowchart. Group generation unit 304 holds variables i, j, k, and m internally.

[0034] First, in S1202, the identification information reading unit 1101 reads the identification information of the image (divided image 1001) at coordinates i=1, j=1.

[0035] In S1203, the identification information reading unit 1101 inputs the read identification information to the identification information setting unit 1102, and the identification information setting unit 1102 stores the read identification information as identification information X internally.

[0036] For example, since the unique identification ID of the structure 400a is 00001, X=00001 is obtained in S1203.

[0037] In S1204, the identification information reading unit 1101 shifts the column coordinate to read the column-wise image. That is, to read the column-wise images (1002, 1003, 1004, ...) in order from 1001, the column coordinate j is incremented by 1 to advance the column coordinate of the image to be read.

[0038] In S1205, the identification information reading unit 1101 reads the identification information of the image at coordinates (i, j). In S1206, a branch is made to determine whether identification information exists in the image. If the identification information reading unit 1101 cannot read the identification information of the image at coordinates (i, j) in S1205 (identification information does not exist), the process proceeds to S1207. In S1207, the identification information writing unit 1103 assigns the identification information X set by the identification information setting unit 1102 to the image at coordinates (i, j). For example, when X=00001, 00001 is written as the identification information of the image, and the image is treated as an image capturing the structure 400a. In S1208, in order to read an image in the column direction, the identification information reading unit 1101 advances the column coordinate of the image to be read by incrementing j, which is the column coordinate, by 1.

[0039] If identification information is found in S1206, the process proceeds to S1209. In S1209, the identification information reading unit 1101 shifts the row coordinate to read the next row-oriented image. That is, to read row-oriented images (1012, 1013, 1024, ...) in order from 1001, the row coordinate i is incremented by 1 to advance the row coordinate of the image to be read. The identification information reading unit 1101 also records the number of times images have been read since S1202 in a variable m.

[0040] In S1210, the identification information reading unit 1101 reads the identification information of the image at coordinates (i, j). In S1211, the identification information writing unit 1103 assigns the identification information X set by the identification information setting unit 1102 to the image at coordinates (i, j). In S1212, the variable j representing the column coordinate is compared with the variable m held by the identification information reading unit 1101 in S1209, and if the variables j and m are not equal, the process proceeds to S1213. In S1210 to S1211, identification information is written the number of times identification information was read between S1202 and S1209. If the variables j and m are equal in S1212, the process proceeds to S1214. In S1214, a branch is made as to whether the identification information reading unit 1101 was able to read the identification information in S1210, and if no identification information exists in the image at coordinates (i, j), the process proceeds to S1215. Steps S1210 to S1214 are repeated until the identification information writing unit 1103 writes the same identification information to all divided images of the same object. When the identification information writing unit 1103 has written the same identification information to all divided images of the same object, the process proceeds from step S1214 to step S1216.

[0041] In S1216, the identification information reading unit 1101 checks whether identification information has been assigned to all divided images in the captured image group 1000. If there is an image to which identification information has not been assigned, the process proceeds to S1217. In S1217, the identification information reading unit 1101 shifts the row coordinates and column coordinates and repeats the process from S1202. If identification information has been assigned to all divided images in the captured image group 1000, the process proceeds to S1218.

[0042] In S1218, the identification information reading unit 1101 sequentially reads the identification images of the divided images of the captured image group 1000. The image sorting unit 1104 generates an image group having the same identification information based on the identification information acquired by the identification information reading unit 1101 (sorts the image group into folders, etc.).

[0043] FIG. 13 is an example of groups generated for each object by the group generation unit 304. 1301 to 1324 are divided images, and the numbering of the divided images in FIG. 13 corresponds to the numbering of the divided images in FIG. 9. For example, divided image 1301 represents the identification information and position coordinates of divided image 901. 1300a and 1300b are groups for each object, and group 1300a groups together divided images of structure 400a (stored in a folder). Similarly, group 1300b groups together divided images of structure 400b.

[0044] As described above, according to this embodiment, the image processing unit 113 acquires the positional information of the divided images, and the identification information processing unit 112 links the positional information to the identification information, thereby making it possible to group the divided images by object.

[0045] (Second embodiment) Infrastructure inspection photography according to a second embodiment of the present invention will be described below with reference to Figures 14 to 18. In the first embodiment, the inspection object was divided into multiple rows and multiple columns when being photographed in a segmented manner, but photography that satisfies the resolution required to inspect for abnormalities, etc., may be one row and multiple columns or multiple rows and one row (hereinafter referred to as I-type). An embodiment of the present invention for I-type column segmented photography will be described below.

[0046] FIG. 14 is an image diagram of an inspection target when I-type photography is used. 1400a and 1400b represent infrastructure structures, and in this embodiment, they are inspected separately. Surface 1401 is the inspection photography range of structure 1400a. 1402 is a defect such as a crack found in structure 1400a, and is also a feature that can be detected on the surface of a structure made of concrete or the like. Similarly, a defect exists in structure 1400b.

[0047] The procedure for dividing and photographing the inspection object and grouping it, shown in Fig. 14, is the same as the flowchart shown in Fig. 5, which has been explained in the first embodiment of the present invention. Therefore, the procedure of the second embodiment will be explained only when it differs from the procedure or conditions explained in the first embodiment.

[0048] In FIG. 14, the dotted lines in the divided image 1403 indicate the range of one divided image. In this embodiment, 4×1 divided images are taken of each of the structures 1400a and 1400b. 1404a and 1404b indicate the positions of RFID tags installed in the structures 1400a and 1400b, respectively. The RFID tags are placed at the boundary based on the shape of the object. In FIG. 14, the structure 1400a is considered to have a linear shape (I-shape), and RFID tags are placed at the two top and bottom edges. The RFID tags must be installed in advance before inspection.

[0049] FIG. 15 is a diagram visualizing the mapping of images by the image sorting unit 303. Reference numeral 1500 denotes a group of images obtained by segmented shooting, and 1501 to 1508 are segmented images. The segmented images 1501 to 1508 are sorted according to shooting path information. This is the shooting path in which images are taken row by row. The numbers 1501 to 1508 of the segmented images are assigned in the shooting order based on the shooting path. In this embodiment, each object is segmented and photographed into 4×1 (4 rows and 1 column) images, so the entire image of each object is an I-shaped image of 4×1 images.

[0050] FIG. 16 is an illustration of the divided images assigned position coordinates for grouping by the image sorting unit 303. The numbering of the divided images corresponds to the numbering of the divided images in FIG. 5. For example, 1601 represents the position coordinates of divided image 1501. The position coordinates are based on the coordinates of divided image 1601 (row i=1, column j=1). Furthermore, among the divided images in the captured image group 1600, images with identification information indicate the identification information of structure 1400a (object a) or the identification information of structure 1400b (object b). In the example of FIG. 16, these are divided images 1601 and 1608. Images with identification information of object b are divided images 1602 and 1607.

[0051] Fig. 17 is a flowchart of grouping of divided images in the group generation unit 304 of this embodiment. In Fig. 17, S represents a step. In Fig. 17, i and j represent the position coordinates (i is row, j is column) of the divided image in Fig. 16. The group generation unit 304 holds variables i and j internally.

[0052] First, coordinates are initialized in S1701. In S1702, the identification information reading unit 1101 reads the identification information of the image (divided image 1601) at coordinates i=1, j=1.

[0053] In S1703, the identification information reading unit 1101 inputs the read identification information to the identification information setting unit 1102, which stores the identification information as identification information X. In S1704, in order to read an image in the row direction, the identification information reading unit 1101 increments i, which is the row coordinate, by +1, thereby advancing the row coordinate of the image to be read.

[0054] In S1705, the identification information reading unit 1101 reads the identification information of the image at coordinates (i, j). In S1706, the identification information reading unit 1101 branches to determine whether identification information exists, and if not, the process proceeds to S1707. In S1707, the identification information writing unit 1103 assigns the identification information X set by the identification information setting unit 1102 to the image at coordinates (i, j). In S1708, in order to read an image in the row direction, the identification information reading unit 1101 advances the row coordinate of the image to be read by incrementing i, which is the row coordinate, by 1. If identification information exists in S1706, the process proceeds to S1709.

[0055] In S1709, the identification information reading unit 1101 checks whether identification information has been assigned to all divided images in the captured image group 1600. If there are any images to which identification information has not been assigned, the process proceeds to S1710. In S1710, the identification information reading unit 1101 shifts the row coordinates and column coordinates and repeats the process from S1702. If identification information has been assigned to all divided images in the captured image group 1600, the process proceeds to S1711.

[0056] In S1711, the identification information reading unit 1101 sequentially reads the identification images of the divided images of the captured image group 1600. The image sorting unit 1104 generates an image group having the same identification information based on the identification information acquired by the identification information reading unit 1101 (sorts the image group into folders, etc.).

[0057] FIG. 18 is an example of groups generated for each object by the group generation unit 304. 1801 to 1808 are divided images, and the numbering of the divided images in FIG. 18 corresponds to the numbering of the divided images in FIG. 5. For example, divided image 1801 represents the identification information and position coordinates of divided image 1501. 1800a and 1800b are groups for each object, and group 1800a is a group of divided images of structure 1400a (stored in a folder). Similarly, group 1800b is a group of divided images of structure 1400b.

[0058] As described above, according to this embodiment, even in I-type photography, the image processing unit 113 acquires the positional information of the divided images, and the identification information processing unit 112 links them to the identification information, making it possible to group the divided images by object.

[0059] In this embodiment, an example of I-type column imaging with multiple rows and one column has been described, but it is also possible to implement I-type column imaging with one row and multiple rows. Also, it is possible to combine this with the multiple row by multiple row segmented imaging described in the first embodiment and group it.

[0060] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0061] <Configuration 1> a first acquisition means for acquiring a positional relationship between a plurality of images when photographing each of a plurality of objects; a second acquisition means for acquiring, when photographing the objects, identification information that is different for each object and is transmitted by radio waves from a communication device provided at a boundary of the shape of each of the plurality of objects; a linking means for linking the identification information acquired by the second acquisition means to a positional relationship of the plurality of images; a generating means for generating an image group for each object from the plurality of images based on the positional relationship and the identification information linked by the linking means; An information processing device comprising:

[0062] <Configuration 2> 2. The information processing device according to configuration 1, which is mounted on a moving body and has imaging means for imaging the plurality of objects.

[0063] <Configuration 3> 3. The information processing apparatus according to configuration 2, wherein the first acquisition means acquires the positional relationship of the plurality of images based on a shooting path of the moving object.

[0064] <Configuration 4> 3. The information processing apparatus according to configuration 2, wherein the first acquisition means acquires the positional relationship of a plurality of captured images based on position information of the moving object.

[0065] <Configuration 5> 2. The information processing device according to configuration 1, wherein the second acquisition means acquires the identification information from the communication device using RFID.

[0066] <Configuration 6> The generating means identifies an image captured within a predetermined area including a position where an image having the identification information of a predetermined object was captured as an image of the predetermined object. 2. The information processing device according to configuration 1,

[0067] <Method 1> a first acquisition step of acquiring a positional relationship between a plurality of images when photographing each of a plurality of objects; a second acquisition step of acquiring, when photographing the objects, identification information that is different for each object and is transmitted by radio waves from a communication device provided at a boundary of the shape of each of the plurality of objects; a linking step of linking the identification information acquired in the second acquisition step to a positional relationship of the plurality of images; a generating step of generating an image group for each object from the plurality of images based on the positional relationship and the identification information linked in the linking step; An information processing method comprising:

[0068] <Program 1> A computer program for controlling each means of the image processing system according to any one of configurations 1 to 6 by a computer. [Explanation of symbols]

[0069] 100 Imaging device 101 System Control 102 Imaging unit 103 Image processing section 106 Communications Department 110 Information processing equipment 111 System Control 112 Identification information processing section 113 Image Processing Unit 116 Communications Department 120 Mobile Device 121 Movement control unit

Claims

1. An imaging means for taking separate images of multiple objects, A first acquisition means that acquires the location information of an image in response to taking a photograph, Identification information is acquired by radio waves from a communication unit provided at the boundary of the shape of each of the aforementioned plurality of objects, and the identification information is different for each object, and a second acquisition means acquires this information when photographing the area including the boundary, Association means for associating the acquired identification information with the acquired location information, A generation means that generates a group for each object from the plurality of images based on the location information and the identification information, An information processing device characterized by having the following features.

2. Having further means of transportation, The first acquisition means acquires the position information based on the movement path of the movement means. The information processing apparatus according to feature 1.

3. The information processing apparatus according to Claim 1, characterized in that the second acquisition means acquires the identification information from the communication unit using an antenna having directionality in a direction corresponding to the shooting direction of the shooting means.

4. The information processing apparatus according to claim 1, characterized in that the first acquisition means acquires the position information by GNSS.

5. The communication unit is RFID, The information processing apparatus according to claim 1, characterized in that the second acquisition means receives identification information from the RFID.

6. The generation means assigns identification information corresponding to the same object to an image located within a range enclosed by a plurality of images associated with the identification information corresponding to the same object. The information processing apparatus according to feature 1.

7. The information processing apparatus according to claim 1, characterized in that the second acquisition means determines that the identification information has been acquired when the signal strength of the acquired radio waves is equal to or greater than a predetermined threshold.

8. The image rearrangement means further comprises assigning row and column position coordinates to the plurality of images based on the positional relationship of the plurality of images, The information processing apparatus according to claim 1, characterized in that the generation means generates a group for each object based on the position coordinates and the identification information.

9. The information processing device according to claim 1, characterized in that the object is a structure that is subject to inspection.

10. The information processing apparatus according to claim 1, wherein the generation means stores the group for each object in a different storage area or folder for each object.

11. A shooting step of taking separate images of multiple objects, The process involves a first acquisition step to obtain location information of the image in response to the capture, Identification information is acquired by radio waves from a communication unit provided at the boundary of the shape of each of the aforementioned plurality of objects, and different identification information is acquired for each object when the area including the boundary is photographed. A correlation step of associating the acquired identification information with the acquired location information, A generation step of generating a group for each object from the plurality of images based on the position information and the identification information, An information processing method characterized by having the following features.

12. A computer program for controlling each means of the information processing apparatus described in any one of claims 1 to 10 by a computer.

Images