Information processing device, information processing device control method, and program

Abstract

To enable a user to more properly grasp the states of photographic images.SOLUTION: An information processing device acquires a plurality of photographic images obtained by photographing photographic target objects, causes display means to display the photographic images in a display mode corresponding to a determination result of image quality of each of the photographic images, and sets the layout of the photographic images in the display means. The information processing device receives designation of the photographing start positions of the photographic target objects and designation of the photographing order of the photographic target objects.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to a technique for determining the quality of a captured image. [Background technology]

[0002] In recent years, inspections using images of infrastructure structures have been conducted. In inspections using captured images, the captured images must meet a certain image quality (be in focus and clear) to detect defects such as cracks. If the captured images do not meet the quality, they may need to be re-taken. Since a great deal of effort is required to re-take the image at a later date, there is a demand for a technology that can quickly determine whether the captured image meets a certain image quality (i.e., whether re-taking the image is necessary) at the time of the first capture. Patent Document 1 discloses a method that determines whether the captured image meets a certain image quality based on the focus level, frequency analysis results, and capture resolution, and classifies and stores the captured images into an OK directory or an NG directory depending on the determination result. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-75510 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology disclosed in the above-mentioned Patent Document 1 only indicates that the captured image stored in the NG directory is an image that needs to be re-captured, making it difficult for the user to properly understand which part of the structure the captured image determined to be NG represents.

[0005] The present disclosure has been made in consideration of such problems, and has an object to provide a technique that enables a user to more appropriately grasp the state of a captured image. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the information processing device according to the present disclosure has the following configuration: That is, the information processing device has an acquisition means for acquiring a plurality of captured images of a target object, a display control means for displaying the plurality of captured images on a display means in a display mode according to a determination result of the image quality of each of the plurality of captured images, and a setting means for setting an arrangement of the plurality of captured images on the display means, the setting means having a first reception means for receiving a designation of a capture start position of the target object, and a second reception means for receiving a designation of a capture order of the target object. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a technique that enables a user to more appropriately grasp the state of a captured image. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a configuration of an imaging system and each device. [Diagram 2] 11 is a flowchart illustrating an operation of the information processing device. [Diagram 3] FIG. 13 is a diagram for explaining imaging control when imaging a structure. [Figure 4] 13 is a detailed flowchart of the photographing process (S201). [Diagram 5] 13 is a detailed flowchart of the image quality determination process (S205). [Figure 6] FIG. 13 is a diagram showing a GUI screen of image quality judgment results. [Figure 7] FIG. 13 is a diagram showing an example of a shooting order panel. [Figure 8] FIG. 13 is a diagram showing an example of a GUI screen for setting a judgment parameter. [Figure 9] FIG. 13 is a diagram showing another example of a superimposed image. [Figure 10] 11 is a flowchart illustrating an operation of the information processing device (variation 1). [Figure 11] FIG. 13 is a diagram showing an example of a list display of NG results. [Figure 12] 13 is a flowchart illustrating an operation of the information processing device (Modification 2). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] (First embodiment) As a first embodiment of an information processing device according to the present disclosure, an information processing device that controls an imaging device to capture an image of a target object (structure) will be described below as an example.

[0011] <System configuration and device configuration> FIG. 1 is a diagram showing the configuration of an imaging system and the hardware configuration of each device. The imaging system is a system for inspecting a structure (also called image inspection) based on an image of the structure. In particular, the system judges the quality of the captured image (necessity of re-shooting) and presents the judgment result to a user. Examples of structures include bridges, tunnels, roads, buildings, dams, embankments, and electrical equipment. The imaging system includes an information processing device 100, a photography assistant device 150, and a photography device 180, which are communicatively connected.

[0012] The information processing device 100 is a device for controlling the entire photographing process of the imaging system. The information processing device 100 has a central processing unit (CPU) 101, a read-only memory (ROM) 102, a random access memory (RAM) 103, and a hard disk drive (HDD) 104. The information processing device 100 further has a display unit 105, an operation unit 106, and a communication unit 107.

[0013] CPU 101 executes programs to perform calculations and logical decisions for various processes and controls each component connected to system bus 110. ROM 102 is a program memory that stores programs for control by CPU 101, including various processing procedures described below. RAM 103 is used as a temporary storage area such as the main memory and work area of ​​CPU 101. Note that a program memory may be realized by loading a program into RAM 103 from an external storage device connected to information processing device 100.

[0014] The HDD 104 is a storage device for storing electronic data such as image data and programs according to this embodiment. An external storage device may be used to fulfill a similar role. Here, the external storage device may be realized, for example, by a medium (recording medium) and an external storage drive for realizing access to the medium. Known examples of such media include flexible disks (FDs), CD-ROMs, DVDs, USB memories, MOs, and flash memories. The external storage device may also be a server device connected via a network.

[0015] The display unit 105 is, for example, a liquid crystal display (LCD) or an organic light emitting display (OLED), and is a device that outputs an image on a display screen. The display unit 105 may be an external device connected to the information processing device 100 by wire or wirelessly. The operation unit 106 is a device such as a keyboard or a mouse, and accepts various operations by a user.

[0016] The communication unit 107 performs wired or wireless two-way communication with other information processing devices, communication devices, external storage devices, etc., using known communication techniques. The communication unit 107 may be configured, for example, with a chip or antenna for performing wireless communication, and performs communication using public wireless such as 4G / 5G, wireless LAN, Bluetooth (registered trademark), or other wireless communication methods.

[0017] The photographing assistant device 150 is a camera platform device that can change the photographing position and the photographing direction based on the control of the information processing device 100. The photographing device 180, which will be described later, is mounted on the photographing assistant device 150. The photographing assistant device 150 also has a communication unit 151, an operation unit 152, a posture control unit 153, and a photographing instruction unit 154.

[0018] The communication unit 151 communicates with the information processing device 100 wirelessly or wiredly, and controls the position and orientation (imaging direction and position) and issues imaging instructions according to instructions from the information processing device. The communication unit 151 may be configured, for example, with a chip or antenna for wireless communication, and communicates by public wireless such as 4G / 5G, wireless LAN, Bluetooth (registered trademark), or other wireless communication method.

[0019] The operation unit 152 has a touch panel and buttons, and accepts various operations by the user. The attitude control unit 153 changes the attitude (imaging direction and position) of the camera platform device so that the designated imaging area of ​​the subject to be inspected can be imaged. The imaging instruction unit 154 controls the imaging device 180 set to the imaging direction and position changed by the attitude control unit 153 so as to perform imaging.

[0020] The photographing device 180 is a device that photographs based on photographing instruction information received from the information processing device 100 via the photographing auxiliary device 150. For example, the photographing device 180 has a photographing unit 181 including a photographing optical system and an imaging element. The imaging element has, for example, a full-field phase-difference imaging sensor, and also records focus degree information (defocus value) at each pixel position in the photographed image. The focus degree information will be described later with reference to FIG. 9. Here, the focus degree information is data that represents a spatial (two-dimensional) distribution of defocus values ​​in the photographing range. In the following description, the data that represents the spatial distribution of defocus values ​​is also referred to as a defocus map. The defocus value is the amount of focus deviation from the distance at which the optical system of the photographing device 180 is in focus. In other words, the defocus map shows the defocus value for each pixel of the image as a spatial distribution.

[0021] Each pixel of the full-field phase-difference imaging sensor of the imaging device 180 has two photoelectric conversion units, which are referred to as divided pixel A and divided pixel B. In the full-field phase-difference imaging sensor, images A and B are output as parallax images from divided pixels A and B that are regularly arranged two-dimensionally. An image A+B obtained by adding images A and B is recorded as a recorded still image. A defocus value is calculated based on the phase difference between these parallax images. Note that, although a configuration in which the defocus value is derived on a pixel-by-pixel basis will be described as an example here, the defocus value may be derived for each predetermined region, such as a block unit having a plurality of pixels (e.g., 5 pixels x 5 pixels).

[0022] <Overall operation of the device> 2 is a flowchart illustrating the operation of the information processing device 100. This flowchart starts when the CPU 101 of the information processing device 100 executes a program.

[0023] In S201, the CPU 101 performs a photographing process. The photographing process is a process in which the information processing device 100 controls the photographing assistant device 150 and the photographing device 180 to perform photographing.

[0024] Fig. 3 is a diagram for explaining the photographing control when photographing a structure. In the photographing process in S201, as shown in Fig. 3(a), a structure 300 (shown by halftone dots) to be photographed is photographed by moving sequentially along a moving path 311 (given moving pattern) in the photographing direction shown by an arrow. Specifically, photographing is started from a photographing start position 310 (shown by a black diamond), and photographing is performed sequentially at a plurality of photographing positions 312 (shown by a white diamond) along the moving path 311. Then, when photographing is completed at a photographing end position 313, the photographing process ends.

[0025] In FIG. 3(a), the shooting range 314 of each captured image is shown by a broken line, and it is assumed that the shooting is performed so that the shooting ranges of adjacent captured images overlap to some extent. FIG. 3(b) shows a plurality of captured images 320 captured by the above-mentioned method, arranged in a tiled manner in a positional relationship that is approximately corresponding to that of FIG. 3(a). For example, it is possible to easily arrange the images in a tiled manner by arranging them in chronological order, shooting time order, or file name order. Note that the tiled arrangement includes two-dimensional arrangement along the orthogonal row direction and column direction. However, it is also possible to arrange the images in a two-dimensional manner along only one of the row direction and the column direction. For example, when the images are captured as shown in FIG. 3(a), the images are arranged in a tiled manner along the horizontal direction (row direction), but not necessarily along the vertical direction (column direction).

[0026] In S202, the CPU 101 acquires a captured image. Specifically, the CPU 101 acquires one or more captured images to be processed in the following steps S203 to S205.

[0027] In S203 to S205, a process is performed to determine whether or not each of the one or more captured images acquired in S202 satisfies the shooting conditions and image quality.

[0028] In S203, the CPU 101 acquires image information of the input image and stores it in the HDD 104. Then, the CPU 101 performs a shooting condition determination process for determining the shooting conditions when the captured image was captured, from the acquired image information.

[0029] In the photographing condition determination process (S203), if the photographing conditions of the determined photographed image do not match the predetermined photographing conditions (do not satisfy the predetermined photographing conditions), the photographed image currently being processed is recorded in the HDD 104 as being "outside the photographing conditions". That is, it is possible to determine whether or not re-shooting is required according to the photographing conditions of the photographed image. By performing the determination process using the photographing conditions, it is possible to determine the photographed image that requires re-shooting without performing the image quality determination process of S205 described later. In addition, by performing the photographing condition determination process of S203, which has a lower load than the image quality determination process of S205 described later, at an earlier stage, it is possible to shorten the processing time.

[0030] As an example of the shooting condition used for the judgment in S203, the aperture value (F value) can be used. It is desirable that the image used for image inspection has a deep depth of field and is less affected by blurring due to diffraction. For this reason, a condition range is set for the aperture value value when the image is captured. In other words, it is determined that an image captured with an aperture value outside a predetermined range or value should not be used for image inspection and needs to be re-captured.

[0031] As another example of the shooting condition used for the judgment in S203, the ISO value (sensitivity) which indicates the ability to capture light can be used. If the image contains noise, the abnormality will be buried in the noise, so it is desirable for the image used for image inspection to be an image with little noise. For this reason, a condition is set for the ISO value when the image was captured. In other words, it is determined that an image captured with an ISO value outside a specified range or value should not be used for image inspection, and re-capture is required.

[0032] As another example of the photographing condition used for the judgment in S203, the subject distance can be used. If the distance to the subject is too far, the image resolution becomes relatively low, and there is a possibility that small abnormalities cannot be detected. Therefore, a condition is set for the subject distance when the image is photographed. That is, it is determined that the photographed image taken at a subject distance outside a predetermined range or value should not be used for image inspection, and re-photographing is required.

[0033] Note that a configuration may be made in which a plurality of shooting conditions are used for the determination in S203, and a condition may be set for each of a plurality of attributes.

[0034] In S204, the CPU 101 determines whether to proceed to the process of S205 for the image to be processed based on the determination result of S203. If it is determined that the captured image matches the predetermined shooting conditions (Yes), the process proceeds to S205, and if it is determined that it does not match (No), the process proceeds to S203. If the process proceeds to S203, an unprocessed captured image to be the next processing target is selected.

[0035] In S205, CPU 101 performs image quality judgment processing to judge the image quality of the captured image, and stores the judgment result in HDD 104. Here, image quality means the degree of focus and the degree of blurring in the captured image (the lower the degree of blurring, the higher the image quality). Details of the image quality judgment processing will be described later with reference to FIG. 5. In the image quality judgment processing in S205, image quality is judged, for example, using focus level information indicating the degree of focus for each partial area in the captured image. For example, CPU 101 outputs information "OK" indicating that the image quality meets the conditions, or information "NG" indicating that the image quality does not meet the conditions, in association with the captured image to be judged.

[0036] The focus degree information is used because an image that is not properly focused on the inspection surface is likely not to be used for the inspection because it is highly likely that image processing required for the inspection, such as detection of abnormalities and synthesis, cannot be performed properly. The shift in focus position may occur, for example, when a gust of wind occurs during the shooting process, causing the shooting auxiliary device 150 or the shooting device 180 to move. In addition, it may occur when an obstruction (such as another worker or a bird) enters the ranging point of the shooting device between the shooting device and the inspection target surface, causing autofocus control to be performed on the obstruction. Note that, although an example of determining image quality using focus degree information has been shown here, it may also be determined based on the resolution indicated by the number of pixels per unit length of the inspection surface. The synthesis here refers to a process of combining multiple images by aligning their respective positions so as to reproduce the positional relationship in the physical coordinates in a pseudo manner. In other words, the image generated by synthesis is an image that represents the entire inspection target, and is performed using multiple images. For example, the synthesis here may be a process of joining multiple images together. Alternatively, compositing may be the process of replacing an area of ​​one image with an area of ​​another image that overlaps with that area, or it may be the process of blending (e.g., averaging) the overlapping portions of two images, or it may be a combination of these processes.

[0037] In S206, the CPU 101 determines whether or not the processes of S203 to S205 have been completed for all captured images input in S202. If the processes have been completed for all captured images (Yes), the process proceeds to S207, and if not (No), the process proceeds to S203. If the process proceeds to S203, an unprocessed captured image to be the next processing target is selected.

[0038] In S207, the CPU 101 determines whether or not the shooting condition determination result is "out of shooting condition" or the image quality determination result is "NG" in the determination information stored in the HDD 104. If it is included (Yes), the process proceeds to S208, and if it is not included (No), the process ends.

[0039] In S208, the CPU 101 performs display control to display a list of the determination results on the display unit 105. The list of the determination results is displayed so that the user can easily understand the positions of the captured images that require re-capture relative to the structures. In addition, the reason why re-capture is required is also presented to the user based on the shooting conditions and image quality determination results stored in S203 and S205. Details of the list of the determination results will be described later with reference to FIG. 6.

[0040] <Details of the shooting process (S201)> FIG. 4 is a detailed flowchart of the shooting process.

[0041] In S401, the information processing device 100 receives from the user a specification of the entire shooting range (a range including the structure 300 in FIG. 3(a)). For example, the information processing device 100 receives from the user a specification of two diagonal points of the structure 300 (for example, the upper left vertex position and the lower right vertex position of the structure 300) and a movement pattern of the shooting direction. The movement pattern will be described later with reference to FIG. 7. Then, based on the received information, the information processing device 100 calculates the number of captured images (total number of times captured), the number of turns (number of times each row (= horizontal direction) was captured), and the shooting position of each captured image.

[0042] For example, assume that the structure to be inspected is 3.0 m wide x 3.0 m long, and the area that can be captured in one captured image is 1.2 m wide x 0.8 m long. Also, as shown in FIG. 3(a), the capture start position 310 is the upper left of the structure, and the capture end position 313 is the lower right of the structure (diagonal position of the capture start position). In this case, taking into account the overlapping area of ​​each captured image, 12 captured images of 3 columns x 4 rows are required, and the number of turns is calculated to be "3". The moving path 311 is captured in the horizontal direction, and when the number of captures reaches the number of turns "3", the column is lowered by one step and capture is performed again in the horizontal direction. The above-mentioned information at the time of capture and the calculation results can be stored in the HDD 104 and used for the capture control in S402 described later and the list display of the judgment results in S208.

[0043] In S402, the information processing device 100 controls the photographing assistant device 150 (camera head device) and the photographing device 180 to perform photographing based on the information at the time of photographing stored in the HDD 104 and the calculation result. Specifically, the information processing device 100 controls the change of the attitude (direction and position) of the photographing assistant device 150. Then, the information processing device 100 controls the photographing device 180 to focus by an autofocus (AF) function that uses the center part of the photographing range as a distance measuring point, for example, and transmits a photographing instruction to the photographing device 180 so that photographing is performed upon completion of AF. The information processing device 100 starts photographing control at the next photographing position in response to the control of the photographing assistant device 150 or a photographing completion notification at each photographing position transmitted from the photographing device 180. The information processing device 100 repeats such processing until photographing is completed at all photographing positions. When photographing is completed at all photographing positions, the photographing process ends. In this embodiment, the processes in S301 and S302 are performed by the information processing device 100. However, the photographing assistant device 150 may receive instructions from the user and perform the processes described above.

[0044] In S403, the information processing device 100 creates a storage area for storing images for which the subsequent determination process (S203 to S205) has been completed. For example, a subdirectory named "OK" and a subdirectory named "NG" are created in the directory in which the captured image obtained by shooting in S402 is stored.

[0045] <Details of image quality judgment process (S205)> 5 is a detailed flowchart of the image quality determination process (S205). Here, it is assumed that image quality determination is performed in the following order: "imaging resolution determination," "focus level determination," and "blur determination."

[0046] In S501, CPU 101 acquires information regarding the imaging resolution of the captured image. Here, imaging resolution is the length (for example, in mm) on the surface of a structure per pixel of the captured image (the smaller the imaging resolution value, the higher the resolution and the more minute abnormalities (such as cracks) can be detected during image inspection). For example, imaging resolution is calculated from the image size (number of pixels in both length and width) of the captured image, the size of the imaging sensor, and the distance from the imaging surface (distance from imaging unit 181 to the structure). The distance from the imaging surface can be obtained by acquiring the distance to the subject when focusing at the position of the subject's ranging point.

[0047] In S502, CPU 101 judges whether the value of the shooting resolution acquired in S501 is equal to or less than a predetermined threshold (i.e., high resolution). If it is equal to or less than the threshold (Yes), the process proceeds to S503, and if it is greater than the threshold (i.e., low resolution) (No), the process proceeds to S511. This makes it possible to judge whether the inspection image satisfies the shooting resolution required for image inspection. Here, if the shooting resolution is greater than the threshold, even if the image quality is good (in focus and not blurred), the image is judged to be NG because it is unsuitable for image inspection. Setting the threshold for judging the shooting resolution will be described later with reference to FIG. 8.

[0048] In S503, the CPU 101 judges whether or not to continue the processing after the shooting resolution determination (i.e., the focus level determination and the blur determination). If it is to be continued (Yes), the process proceeds to S504, and if it is not to be continued (No), the process proceeds to S510. The setting of whether or not to continue the processing after the shooting resolution determination will be described later with reference to FIG.

[0049] In S504, the CPU 101 acquires focus level information included in the image to be processed. Here, the focus level information is a defocus map (information in which a defocus value for each region of a captured image is recorded) that is information acquired together with an image captured by an imaging device having a full-field phase-difference imaging sensor. Note that other known techniques can also be used to acquire the defocus value. For example, a configuration may be used in which the defocus value is acquired using parallax images captured by a stereo camera or the like.

[0050] In S505, CPU 101 calculates the area ratio of the in-focus area (area in focus) to the entire area of ​​the captured image using the focus level information acquired in S504. For example, the defocus value is a numerical value (a positive value when the focus is shifted forward and a negative value when the focus is shifted backward) of the amount of focus shifted forward and backward with respect to the target object for each pixel (or each partial area) of the image. Then, the area ratio of the area where the absolute value of the defocus value is less than a predetermined value is calculated.

[0051] In S506, CPU 101 determines whether the area ratio calculated in S505 is equal to or greater than a predetermined threshold. If the area ratio is equal to or greater than the predetermined threshold (Yes), the process proceeds to S507, and if the area ratio is less than the threshold (No), the process proceeds to S511. Setting the threshold for determining the focus degree will be described later with reference to FIG.

[0052] In S507, CPU 101 determines whether or not to continue the process after the focus level determination (i.e., blur determination). If it is to be continued (Yes), the process proceeds to S508, and if it is not to be continued (No), the process proceeds to S510. The setting of whether or not to continue the process other than the shooting resolution determination will be described later with reference to FIG.

[0053] In S508, the CPU 101 performs frequency analysis processing on the captured image to obtain frequency component values. For example, the CPU 101 calculates horizontal and vertical frequency components using wavelet transform. Then, the CPU 101 calculates the average value of the obtained frequency components in the two directions to obtain the frequency component value.

[0054] In S509, CPU 101 judges whether the frequency component value calculated in S508 is equal to or greater than a predetermined threshold value. If it is equal to or greater than the threshold value (Yes), the process proceeds to S510, and if it is less than the threshold value (No), the process proceeds to S511. That is, if the frequency component value is equal to or greater than the threshold value, the captured image being processed indicates that there are many high frequency components (= many edge areas), and it is judged that there are few blurred areas. On the other hand, if the frequency component value is less than the threshold value, it is judged that there are many blurred areas. In the flow of FIG. 5, since the focus degree judgment (S505) has already been performed, it can be judged that the blur is caused by the occurrence of a shake and not by a lack of focus. The threshold value for the shake judgment will be described later with reference to FIG. 8.

[0055] In this way, by performing blur determination using frequency analysis after focus determination, it is possible to determine the occurrence of blur due to blur, and more appropriately determine whether the captured image is suitable as an inspection image. An example of a situation in which blur occurs even when the image is in focus is a situation in which a camera is mounted on an aircraft such as a drone to take a picture. In this case, the drone may shake due to the influence of wind during shooting, which may cause blur.

[0056] In S510, the CPU 101 determines that the captured image currently being processed is an "OK image" that does not require re-capture (can be used for image inspection). Then, in S512, the captured image determined to be an OK image is moved into the "OK directory" created in S303.

[0057] In S511, the CPU 101 determines that the captured image currently being processed is an "NG image" that needs to be re-captured (cannot be used for image inspection). Then, in S513, the captured image determined to be an NG image is moved into the "NG directory" created in S303.

[0058] In S514, the CPU 101 uses information on the results of the shooting resolution determination (S502), the focus level determination (S506), and the blur determination (S509) to generate a determination result image on which the image quality determination result is superimposed, and stores the generated determination result image in the HDD 104. The generated determination result image will be described later with reference to FIG.

[0059] In addition, in Fig. 5, an example in which the processing is performed in the order of shooting resolution determination, focus level determination, and blur determination has been described, but the processing may be performed in a different order. However, by performing the processing in the order of Fig. 5, the effect of reducing the processing load can be obtained. That is, the processing load of the three determinations is relatively small for shooting resolution determination and relatively large for blur determination. Therefore, by performing the determinations in the order of decreasing processing load, it is possible to reduce the number of captured images that undergo determination processing with a large processing load, and it becomes possible to reduce the overall processing load.

[0060] <GUI display of image quality assessment results> 6 is a diagram showing a graphical user interface (GUI) screen of image quality judgment results, that is, an example of a list display of the judgment results in S208 of FIG.

[0061] A screen 601 displaying a list of the determination results is a screen that is displayed on a PC, a smartphone, a tablet terminal, etc. The screen 601 is made up of a title display section 602, a shooting control setting section 603, and a determination result display section 604. The shooting control setting section 603 includes three sections: a shooting start position setting section 610, a shooting order setting section 620, and a number of laps setting section 630.

[0062] The shooting start position setting section 610 is a UI component that allows the user to select the shooting start position using a radio button. Here, an example is shown in which four shooting start positions, "upper left", "upper right", "lower left", and "lower right" of the structure 300 are displayed as selectable shooting start positions.

[0063] The shooting sequence setting unit 620 is a UI component that allows the user to select a movement pattern for the shooting direction by, for example, clicking the mouse. Here, an example is shown in which four movement patterns, "horizontal single direction", "vertical single direction", "horizontal snake", and "vertical snake", are displayed as selectable patterns. The number of turns setting unit 630 is a UI component that accepts the specification of the number of turns. Here, an example is shown in which an input of an integer value is accepted from the user. As described above, the number of turns is the number of times each row is shot when shooting in the horizontal direction is repeated, and the number of times each column is shot when shooting in the vertical direction is repeated.

[0064] The judgment result display section 604 is a display area in which judgment results for a plurality of photographed images are arranged in tiles and displayed. The arrangement is set based on the information at the time of photographing set in the photographing control setting section 603. When the screen 601 is displayed, the information at the time of shooting stored in S401 may be set as an initial value for the shooting control setting unit 603. Also, setting input may be accepted by a mouse operation, touch operation, keyboard operation, or the like from the user via the operation unit 106. Based on the setting in the shooting control setting unit 603, the arrangement of the determination result image in the determination result display unit 604 can be controlled.

[0065] Screen 601 shows an example of a captured image obtained when the same shooting control as in Fig. 3 is performed. Specifically, an example is shown in which "upper left" is selected as the shooting start position, "horizontal, single direction" is selected as the shooting sequence, and "3" is set as the number of folds.

[0066] 7 is a diagram showing an example of a shooting order panel defined by the settings of the shooting start position and the shooting order. Depending on the shooting start position selected in the shooting start position setting section 610, four panels in a corresponding row are displayed as selection candidates in the shooting order setting section 620. For example, since "upper left" is selected as the shooting start position in FIG. 6, four panels in a row corresponding to "upper left" in FIG. 7 are displayed. In this way, the display of the shooting order setting section 620 is appropriately switched according to the setting of the shooting start position setting section 610. Therefore, the user can specify one pattern from a total of 16 existing movement patterns by simply selecting two settings.

[0067] The number of images to be captured per row (or column) before the image capture moves to the next row (or column) is input in the turn count setting unit 630. For example, in FIG. 6, "3" is input as the turn count calculated in S401.

[0068] The judgment result display unit 604 displays the judgment result stored in the HDD 104 in S514 as a character string image on each captured image in an emphasized manner. For example, the word "OK" is superimposed on the image 605 in FIG. 6, so that the user can easily understand that the image quality judgment result is OK. Similarly, the word "resolution NG" is superimposed on the image 606, so that the user can easily understand that the image quality judgment result is NG because the resolution is below the threshold. Moreover, the word "focus degree NG" is superimposed on the image 607, so that the user can easily understand that the image quality judgment result is NG because the focus degree is below the threshold. Moreover, the word "blur NG" is superimposed on the image 608, so that the user can easily understand that the image quality judgment result is NG because the frequency component is below the threshold and blur is suspected.

[0069] In addition, the judgment result display unit 604 highlights each captured image by filling the captured image with a color image corresponding to each judgment result (superimposing and displaying using transparency processing). For example, image 606 is a "light gray image" corresponding to resolution NG, image 607 is a "dark gray image" corresponding to focus degree NG, and image 608 is a "black image" corresponding to blur NG, each of which is composited with a transparency of 50%. These highlighting displays enable the user to more easily grasp the reason why each captured image is NG (the reason why re-shooting is required). The composition referred to here is different from the composition described above, and is a process of applying an image effect such as transparency processing to the captured image. In other words, this composition is a process performed on one captured image. This composition may be a process of superimposing information that is not captured information on the captured image, such as the above-mentioned superimposition of a character string. Furthermore, this composition may be a process of superimposing information that is not captured information on the captured image in addition to the application of an image effect.

[0070] Furthermore, in the determination result display unit 604, each captured image is arranged based on the setting in the capture control setting unit 603 (i.e., the capture order at the time of capture). Therefore, the user can easily grasp the capture position (capture range) of each captured image in the structure 300. This enables the user to more appropriately capture images again and set threshold values.

[0071] Furthermore, the word "Read NG" is superimposed on the image 609. This indicates that the image has failed to be read due to an illegal image file (a defective photographed image that cannot be displayed). In this case, a black image is generated as the dummy image 609, and the word "Read NG" is superimposed and displayed. The reason for displaying the dummy image 609 is to prevent the image captured subsequently from being misaligned in the judgment result display unit 604, causing the entire image of the structure 400 to be displayed in a distorted manner. In other words, by displaying the dummy image 609, it is possible to display the entire image of the structure 400 without distorting it. In addition, the user can easily understand that the image quality judgment result is not NG, but that the image reading itself has failed.

[0072] In addition, since it would be excessive to display each captured image at its original resolution in the determination result display unit 604, the image may be reduced in size beforehand before displaying it. By doing so, even if a large number of images are arranged, it becomes possible to quickly switch the display arrangement in response to the selection made by the shooting control setting unit 603.

[0073] <Setting parameters for image quality judgment processing> 8 is a diagram showing a GUI screen for setting judgment parameters in the image quality judgment process. That is, this is a GUI screen for making settings related to "shooting resolution judgment," "focus level judgment," and "blur judgment" in the image quality judgment process (S205). In addition, this screen also makes it possible to set whether or not to generate and save a superimposed image, which will be described later, and whether or not to display a list of image quality judgment results.

[0074] The setting screen 801 is composed of UI widgets 811-826 related to judgment pattern settings, a superimposed image save setting section 830, and a list display setting section 831. The UI widgets 811-826 related to judgment pattern settings are used to perform settings related to roughly three judgments (shooting resolution judgment, focus level judgment, and blur judgment). The superimposed image save setting section 830 is a UI widget that accepts a designation as to whether or not to save superimposed images (captured images with characters of the judgment results superimposed) such as images 605-608 shown in Fig. 6. The list display setting section 831 is a UI widget that accepts a designation as to whether or not to display a list of the judgment results in S208.

[0075] The judgment name labels 815, 816, and 817 are label displays corresponding to the shooting resolution judgment, the focus level judgment, and the blur judgment. The judgment name labels 816 and 817 have check boxes arranged therein, and when the user checks them, the corresponding judgment process is performed. For example, the setting screen 801 in FIG. 8 shows a state in which execution of the shooting resolution judgment and the focus level judgment is specified, and non-execution of the blur judgment is specified. Note that, although it is assumed here that the shooting resolution judgment is always executed, a check box may be provided in a similar manner to allow specification of non-execution.

[0076] The judgment symbols 818, 819, and 820 are symbol displays (icons) corresponding to the shooting resolution judgment, the focus level judgment, and the blur judgment. The input areas 812, 813, and 814 are input areas that accept the designation of thresholds corresponding to the shooting resolution judgment, the focus level judgment, and the blur judgment. In the setting screen 801 of FIG. 8, since the blur judgment is designated not to be executed, the input area 814 is grayed out, indicating that input is not possible. This allows the user to focus only on inputting values ​​related to the judgment to be executed. Such an arrangement and display of UI parts allows the user to intuitively understand which judgment process the input area relates to. In addition, the user can intuitively understand that the three judgments (shooting resolution judgment, focus level judgment, and blur judgment) are performed in the order of the settings on the setting screen 801 according to the order of the settings.

[0077] The setting screen 801 is a screen displayed on a PC, a smartphone, a tablet terminal, or the like, and accepts setting input from the user via the operation unit 106 through mouse operation, touch operation, keyboard operation, or the like.

[0078] The CPU 101 determines whether to continue the processing in S503 and S507 based on the state of the focus level determination and blur determination determination name labels 816 and 817. This allows the latter processing to be omitted in a situation where the latter determination processing (focus level determination and blur determination) is not necessary. For example, blur determination can be performed when a drone is used in a shooting mode where blur is likely to occur, and blur determination can be omitted when a tripod is used in a shooting mode where blur is unlikely to occur. In addition, when only the shooting resolution determination is performed, both the focus level determination and blur determination check boxes are turned off. With such settings, when performing a determination process on a large number of captured images, the process can be terminated according to the purpose or purpose, and an effect such as a reduction in processing time can be expected.

[0079] The value input in the input area 821 represents the resolution threshold used in the judgment process of S502. The value input in the input area 822 represents the defocus value threshold used in the judgment process of S505. The value input in the input area 823 represents the area ratio threshold used in the judgment process of S506. The value input in the input area 824 is for setting the target range for calculating the area ratio in S506. Specifically, it represents the area percentage of the target range to be judged when the entire captured image to be processed is taken as 100%. For example, when "75" is specified in the input area 824, 75% of the area located in the center of the captured image is judged (i.e., the 25% area located in the outer periphery is excluded). By making the judgment target smaller (narrowing the area), the amount of calculation processing is reduced, and the processing speed is expected to improve.

[0080] Furthermore, by setting the value entered in the input area 824 to less than "100" (for example, "50"), when creating a composite image (stitched image), only the central part of the image that will be included in the composite image can be the subject of judgment. In other words, the outer periphery of the captured image that will become the overlap can be excluded from the judgment target, and this makes it possible to determine that the outer periphery can be used for stitching even if it is out of focus.

[0081] The value input in input area 825 represents the frequency component value threshold used in the judgment process in S509. The value input in input area 826 is for setting the target range for calculating the frequency component value in S509. Specifically, it represents the area percentage of the target range to be judged when the entire captured image to be processed is taken as 100%. In addition to the same effect as in the case of input area 824 (target area for focus degree judgment) described above, in blur judgment, the effect of suppressing the mixing of high frequency components caused by objects (such as plants) that are not the target of image inspection and are reflected in the image background (backside of a structure) can be obtained.

[0082] Superimposed image save setting section 830 is a UI widget that accepts a designation as to whether or not to save a superimposed image. The generated superimposed image may be an image such as images 605 to 608, or an image such as that shown in FIG. 9, which will be described later. In the first embodiment, an example is described in which superimposed images are generated and saved regardless of whether the judgment result is OK or NG, but superimposed images may be generated only for targets that are judged as NG. Also, by creating a list of judgment results, it is possible to shorten the processing time without generating superimposed images.

[0083] When "NG only" is selected in superimposed image save setting section 830, an image with the image quality judgment result superimposed as shown in Fig. 9 is stored in the "NG directory" together with the captured image. When "Save all" is selected, an image with the image quality judgment result superimposed as shown in Fig. 9 is stored in each of the "OK directory" and "NG directory" together with the captured image. By adopting such settings, it becomes possible to generate only the necessary images according to the user's requests while also shortening the processing time.

[0084] 9A to 9C are diagrams showing other examples of superimposed images on which the judgment results are superimposed. The images shown in Fig. 9A to 9C are detailed information that is displayed when the user selects (for example, by accepting a click operation or a touch operation) one of the images arranged in the judgment result display section 604 in the list display of the judgment results in Fig. 6, and are called result images. The result images can be displayed on a screen separate from the screen 601.

[0085] Fig. 9(a) is a result image 900 of a captured image that has been determined to be NG in the blur determination, and is displayed when image 608 is selected. Fig. 9(b) is a result image 950 of a captured image that has been determined to be NG in the focus determination, and is displayed when image 607 is selected. Fig. 9(c) is a result image 970 of a captured image that has not been determined to be NG in all three determinations (shooting resolution determination, focus determination, and blur determination) and has been determined to be OK, and is displayed when image 605 is selected.

[0086] The resultant image 900 is composed of defocused regions 901-903 and frame regions 911-912. The defocused region 901 indicates a region where the defocus amount is "0" (in focus), the defocused region 902 indicates a region where the defocus amount is "1", and the defocused region 903 indicates a region where the defocus amount is "2". A different color (e.g., JIS safety colors) may be superimposed on each defocused region. For example, blue or green indicating safety may be used for regions where the defocus amount is smaller than a predetermined value, and yellow or red indicating a warning may be used for regions where the defocus amount is equal to or greater than the predetermined value. This makes it easier for the user to visually recognize regions where the defocus amount is large and re-imaging is required.

[0087] The left frame area 911 is an area for displaying the executed judgment out of three judgments (shooting resolution judgment, focus level judgment, and blur judgment). Here, all three judgments are executed, and therefore, it includes a display area 931 for displaying that the shooting resolution judgment has been executed, a display area 932 for displaying that the focus level judgment has been executed, and a display area 933 for displaying that the blur judgment has been executed. The display areas 931 to 933 are displayed in different colors. Here, for example, corresponding to FIG. 6, the display area 931 is displayed in "light gray" indicating the resolution judgment, the display area 932 is displayed in "dark gray" indicating the focus level judgment, and the display area 933 is displayed in "black" indicating the blur judgment. In addition, the value of the shooting resolution "0.5" acquired in S501 is also displayed in the display area 921.

[0088] Meanwhile, the frame area 912 on the right side is an area for displaying the type of judgment that resulted in an NG judgment. Since the resultant image 900 is a captured image that resulted in an NG judgment in the blur judgment, the display area 941 displays it in "black" indicating a blur judgment to show that the blur judgment was NG. In other words, it is displayed in the same color as the display area 933. This display enables the user to intuitively grasp which judgment process resulted in an NG judgment.

[0089] Since the resultant image 950 corresponds to a captured image that was determined to be NG in the focus level determination, the capturing resolution determination and the focus level determination were performed, but the blur determination was not performed (since the result is No in S506). Therefore, the frame area 911 on the left side of the resultant image 950 displays two items: a display area 931 that displays that the capturing resolution determination was performed, and a display area 932 that displays that the focus level determination was performed. In addition, the display area 921 also displays the value of the capturing resolution obtained in S501, "0.5". Meanwhile, the display area 941 of the frame area 912 on the right side is displayed in "dark gray" indicating the focus level determination, to indicate that the focus level determination was determined to be NG. In other words, it is displayed in the same color as the display area 932.

[0090] The resultant image 970 corresponds to a captured image that has been judged as OK without being judged as NG in all three judgments. Therefore, the frame area 911 on the left side of the resultant image 970 displays three items: a display area 931 that displays that a shooting resolution judgment has been performed, a display area 932 that displays that a focus level judgment has been performed, and a display area 933 that displays that a blur judgment has been performed. In addition, the display area 921 also displays the shooting resolution value "0.5" acquired in S501. Meanwhile, the frame area 912 on the right side of the resultant image 970 does not display the display area 941 (unlike the resultant images 900 and 950).

[0091] Although not shown, if the shooting resolution judgment is NG, a display area 931 indicating that the shooting resolution judgment has been performed is displayed in the left frame area 911. A value exceeding the resolution threshold (e.g., "1.5") is displayed in the display area 921. A "light gray" display area 941 indicating the shooting resolution judgment is displayed in the right frame area 912 to show that the shooting resolution judgment has been NG.

[0092] Such a result image allows the user to intuitively confirm information about the shooting resolution, the type of judgment that was made, and the type of judgment that was unsuccessful.

[0093] As described above, the result image shown in FIG. 9 can be displayed on a screen (window) other than the screen 601 when the user selects one of the images arranged in the judgment result display section 604 of the screen 601. This allows the user to analyze the cause of the judgment result being NG based on the result image. For example, when the image 607 with "Focus level NG" is selected on the screen 601, a result image 950 is displayed. This allows the user to analyze the cause of the focus level being NG by checking the defocus areas 901 to 903 in the result image 950. Similarly, when the image 606 with "Resolution NG" is selected on the screen 601, a corresponding result image (not shown) is displayed, and the user can check the value of the shooting resolution displayed in the display area 921.

[0094] As described above, according to the first embodiment, the image quality of each of a plurality of captured images obtained by capturing partial regions of a target object (structure) is judged. Then, the captured images with the judgment results superimposed are displayed and arranged so as to substantially correspond to the positions of the structures. This allows the user to more appropriately grasp the state of the plurality of captured images. For example, it becomes easy to grasp which partial region of the structure corresponds to a captured image that does not satisfy the required quality.

[0095] (Variation 1) In the first modification, another form of the list display (S208) will be described. Specifically, a form in which only images determined to be NG are displayed in a list will be described.

[0096] Fig. 10 is a flowchart for explaining the operation of the information processing device in Modification 1. Fig. 10 shows that some of the processes in the first embodiment (Fig. 2) have been replaced with other processes. Note that the processes from S201 to S207 in Fig. 10 are similar to those explained in the first embodiment (Fig. 2), and therefore will not be explained.

[0097] In S1001, the CPU 101 displays on the display unit 105 a list of only the captured images that have been determined to be NG by the determination process.

[0098] 11 is a diagram showing an example of a list display of photographed images that have been determined to be NG. A screen 1101 in FIG. 11 replaces a part of the screen 601 in FIG.

[0099] A screen 1101 is composed of a title display 602, a shooting control setting section 603, and a judgment result display section 1102. In the shooting control setting section 603, only a shooting start position setting section 610 is arranged. In the judgment result display section 1102, only the shot images that have been judged as NG are displayed. In the judgment result display section 1102 of FIG. 11, an image 1103 with "resolution NG", an image 1104 with "focus level NG", an image 1105 with "blur NG", and an image 1106 with "reading NG" are displayed. As with images 606 to 609 in FIG. 6, the reason for the NG judgment (type of judgment) is superimposed on each image.

[0100] As shown in screen 1101, by displaying only the captured images that have been judged as NG in the list display of the judgment results, if a common problem occurs in these captured images, the user can easily identify the problem.

[0101] (Variation 2) In Modification 2, a form in which the display timing of the list display (S208) is changed will be described. In the first embodiment, after the shooting of the object to be shot (structure), the shooting condition determination process (S203) and the image quality determination process (S205) are performed, but in Modification 2, the main difference is that these determination processes are performed in parallel with the shooting process.

[0102] Fig. 12 is a flowchart for explaining the operation of the information processing device in Modification 2. Fig. 12 shows that some of the processes in the first embodiment (Fig. 2) have been replaced with other processes. Note that the processes from S201 to S205 in Fig. 12 are similar to those explained in the first embodiment (Fig. 2), and therefore will not be explained.

[0103] In S1201, the CPU 101 displays a list of the determination results on the display unit 105. As in the first embodiment (S208), the list of the determination results is displayed so that the user can easily grasp the positions of the captured images that need to be re-captured relative to the structures. In addition, based on the shooting conditions and image quality determination results saved in S203 and S205, the reason why re-capture is necessary is also presented to the user. However, in the second modification, the list is displayed for the captured images acquired up to the point in time when the list is displayed. That is, in the Nth time of the loop processing (S201 to S1202), N captured images are displayed.

[0104] In S1202, CPU 101 determines whether or not all of the photographing processes (S201) and the determination processes (S203, S205) for the multiple partial regions (FIG. 3(a)) of the photographing target object (structure) have been completed. If completed (Yes), the flow ends, and if not completed (No), the flow proceeds to S201. If the flow proceeds to S201, an unphotographed partial region is selected.

[0105] In this way, these judgment processes are performed in parallel with the photographing process, and the list display is updated each time the photographing process and judgment process for one partial area are completed. This allows the user to immediately notice if a problem occurs in the photographed image. Another advantage is that if a common problem occurs in the photographed images, the user can easily identify the problem.

[0106] The disclosure of this specification includes the following information processing device, control method, and program. (Item 1) An acquisition means for acquiring a plurality of captured images of a target object; a display control means for causing a display means to display the plurality of captured images in a display mode corresponding to a result of the judgment of the image quality of each of the plurality of captured images; a setting means for setting an arrangement of the plurality of photographed images on the display means; having The setting means includes a first receiving means for receiving a designation of a photographing start position of the photographing target object, and a second receiving means for receiving a designation of a photographing order of the photographing target object. 23. An information processing apparatus comprising: (Item 2) The setting means arranges the plurality of captured images two-dimensionally along a row direction and a column direction which are perpendicular to each other. 2. The information processing device according to item 1, (Item 3) When the plurality of photographed images includes a defective photographed image that cannot be displayed, the display control means displays a dummy image instead of the defective photographed image. 3. The information processing device according to item 1 or 2. (Item 4) The display control means displays a determination result image indicating each of the determination results on each of the plurality of captured images in a superimposed manner. 4. The information processing device according to any one of items 1 to 3. (Item 5) The determining means determines image quality by using a plurality of different determination processes. 5. The information processing device according to item 4, (Item 6) The plurality of determination processes include: A first determination process regarding a shooting resolution of a captured image; A second determination process regarding a focus degree in the captured image; a third determination process for determining a degree of blur occurring in the captured image; Includes 6. The information processing device according to item 5, (Item 7) The determination result image is a character string image and / or a color image indicating a determination result by at least one of the plurality of determination processes. 7. The information processing device according to item 5 or 6. (Item 8) the plurality of captured images are captured images obtained by sequentially moving a partial area of ​​the object to be photographed along a given movement pattern and photographing the partial area, The setting means arranges the plurality of photographed images based on a photographing start position when the plurality of photographed images are photographed and the given movement pattern. 8. The information processing device according to any one of items 1 to 7, (Item 9) The setting means further includes a third receiving means for receiving a designation of the number of captured images arranged in the row direction or the number of captured images arranged in the column direction of the plurality of captured images arranged two-dimensionally along orthogonal row and column directions. 9. The information processing device according to any one of items 1 to 8, (Item 10) a fourth reception means for receiving a selection of one of the plurality of photographed images displayed on the display unit, When the fourth reception means receives a selection of a photographed image, the display control means further displays detailed information related to the determination result corresponding to the photographed image for which the selection has been received. 10. The information processing device according to any one of items 1 to 9. (Item 11) The detailed information includes information on one or more determination processes used to derive a determination result corresponding to the captured image for which the selection was accepted, and / or a defocus map corresponding to the captured image for which the selection was accepted. 11. The information processing device according to item 10, (Item 12) A method for controlling an information processing device, comprising: An acquisition step of acquiring a plurality of captured images of a target object; a display control step of displaying the plurality of captured images on a display means in a display mode corresponding to a result of the judgment of the image quality of each of the plurality of captured images; having In the display control step, a designation of a shooting start position of the shooting target object is accepted, and a designation of a shooting order of the shooting target object is accepted. A control method comprising: (Item 13) Item 13. A program for causing a computer to execute the control method according to item 12.

[0107] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0108] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0109] 100 Information processing device; 101 CPU; 102 ROM; 103 RAM; 104 HDD; 105 Display unit; 106 Operation unit; 107 Communication unit; 110 System bus; 150 Shooting auxiliary device; 151 Communication unit; 152 Operation unit; 153 Attitude control unit; 154 Shooting instruction unit; 180 Shooting device; 181 Shooting unit

Claims

1. An acquisition means for acquiring a plurality of captured images of a target object; a display control means for causing a display means to display the plurality of captured images in a display mode corresponding to a result of the judgment of the image quality of each of the plurality of captured images; a setting means for setting an arrangement of the plurality of photographed images on the display means; having The setting means includes a first receiving means for receiving a designation of a shooting start position of the shooting target object, and a second receiving means for receiving a designation of a shooting order of the shooting target object.

23. An information processing apparatus comprising:

2. The setting means arranges the plurality of photographed images two-dimensionally along a row direction and a column direction which are perpendicular to each other.

2. The information processing apparatus according to claim 1,

3. When the plurality of photographed images includes a defective photographed image that cannot be displayed, the display control means displays a dummy image instead of the defective photographed image.

2. The information processing apparatus according to claim 1,

4. The display control means displays a determination result image indicating each of the determination results on each of the plurality of captured images in a superimposed manner.

2. The information processing apparatus according to claim 1,

5. The determining means determines image quality by using a plurality of different determination processes.

5. The information processing apparatus according to claim 4.

6. The plurality of determination processes include: A first determination process regarding a shooting resolution of a captured image; A second determination process regarding a focus degree in the captured image; a third determination process for determining a degree of blur occurring in the captured image; Includes 6. The information processing apparatus according to claim 5,

7. The determination result image is a character string image and / or a color image indicating a determination result by at least one of the plurality of determination processes.

7. The information processing apparatus according to claim 5, wherein the information processing apparatus is a computer.

8. the plurality of captured images are captured images obtained by sequentially moving a partial region of the object to be photographed along a given movement pattern and photographing the partial region, The setting means arranges the plurality of photographed images based on a photographing start position when the plurality of photographed images are photographed and the given movement pattern.

2. The information processing apparatus according to claim 1,

9. The setting means further includes a third receiving means for receiving a designation of the number of captured images arranged in the row direction or the number of captured images arranged in the column direction of the plurality of captured images arranged two-dimensionally along orthogonal row and column directions.

2. The information processing apparatus according to claim 1,

10. a fourth reception means for receiving a selection of one of the plurality of photographed images displayed on the display unit, When the fourth reception means receives a selection of a photographed image, the display control means further displays detailed information related to the determination result corresponding to the photographed image for which the selection has been received.

2. The information processing apparatus according to claim 1,

11. The detailed information includes information on one or more determination processes used to derive a determination result corresponding to the captured image for which the selection has been accepted, and / or a defocus map corresponding to the captured image for which the selection has been accepted.

11. The information processing apparatus according to claim 10,

12. A method for controlling an information processing device, comprising: An acquisition step of acquiring a plurality of captured images of a target object; a display control step of displaying the plurality of captured images on a display means in a display mode corresponding to a result of the judgment of the image quality of each of the plurality of captured images; having In the display control step, a designation of a shooting start position of the shooting target object is accepted, and a designation of a shooting order of the shooting target object is accepted. A control method comprising:

13. A program for causing a computer to execute the control method according to claim 12.

Images