Information processing device, information processing method, and program

Abstract

To make a list of captured images easier to view.SOLUTION: An information processing device 3 comprises: an acquisition unit 331 which acquires a plurality of captured images taken while changing an imaging area with respect to an object to be captured, which is a subject defined as the object to be captured by a camera of a flying object, and arrangement identification information for identifying a two-dimensional array of an imaging area of each of the plurality of captured images; an image processing unit 333 which determines the positions at which each of reduced images is arranged in a list display area for listing a plurality of reduced images, each of which is a reduced version of the plurality of captured images on the basis of the arrangement identification information; and a display processing unit 334 which displays the plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Conventionally, a technique for displaying a list of captured images captured by an aircraft equipped with a camera has been known (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above technique, a plurality of captured images are arranged and displayed on a display screen in an order using the ID (identification) of the captured image or the capture date and time, but it may be difficult for the user to view.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to make it easier to view a list of captured images.

Means for Solving the Problems

[0006] The information processing apparatus according to the first aspect of the present invention includes an acquisition unit that acquires a plurality of captured images captured while changing an imaging region with respect to an imaging object that is a subject defined as an imaging target of a camera included in an aircraft, and array identification information for identifying a two-dimensional array of the imaging regions of the plurality of captured images; an image processing unit that determines positions at which to arrange the plurality of reduced images in a list display region for displaying a list of the plurality of reduced images obtained by reducing each of the plurality of captured images based on the array identification information; and a display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display region.

[0007] The acquisition unit may further acquire position information indicating the position of the aircraft when the captured image was captured and orientation information indicating the orientation of the camera when the captured image was captured, and the display processing unit may refer to map information and further display information indicating the imaging region specified by the position information and the orientation information in the list display region.

[0008] The acquisition unit may acquire a plurality of first captured images that are the plurality of captured images captured in a first time period and a plurality of second captured images that are the plurality of captured images captured in a second time period different from the first time period, and when generating the plurality of reduced images, the image processing unit may select the captured image with high display quality of the imaging object from among the first captured images and the second captured images arranged at the same position and generate a reduced image corresponding to the selected captured image.

[0009] The acquisition unit may acquire the plurality of first captured images and the plurality of second captured images captured under different imaging conditions. The acquisition unit may acquire, as the array identification information, position identification information for identifying positions of two-dimensional arrays of the imaging regions of the plurality of captured images.

[0010] The acquisition unit may acquire a group of images including the plurality of captured images, which are a plurality of groups of images captured at different time zones. Further, the display processing unit may further display information indicating the number of the reduced images arranged at the same position as the reduced image for each reduced image.

[0011] The acquisition unit may further acquire type information indicating the type of change of the imaging region when the plurality of captured images are captured. Further, the image processing unit may further determine positions at which the plurality of reduced images are arranged in the list display area based on the type information.

[0012] The acquisition unit may further acquire position information indicating the position of the aircraft when the captured image is captured and orientation information indicating the orientation of the camera when the captured image is captured. Further, when one of the reduced images is selected in the list display area, the display processing unit may display information regarding another reduced image including a part of the imaging object included in the selected reduced image and specified based on the position information and the orientation information.

[0013] The display processing unit may display at least any one of the other reduced image, the number of the other reduced images, and identification information for identifying the other reduced image as information regarding the other reduced image.

[0014] The imaging object may be a three-dimensional object. When the plurality of captured images are captured images of one surface of the plurality of surfaces of the imaging object as the imaging region, the image processing unit determines positions at which the plurality of reduced images are two-dimensionally arranged in the list display area. When the plurality of captured images are captured images of the plurality of surfaces of the imaging object as the imaging region, the image processing unit may determine positions at which the plurality of reduced images are three-dimensionally arranged in the list display area.

[0015] When generating the plurality of reduced images, the image processing unit may generate the reduced images having different shapes depending on whether the plurality of reduced images are arranged in a two-dimensional array or a three-dimensional array.

[0016] An information processing method according to a second aspect of the present invention includes steps of: a computer acquiring a plurality of captured images captured while changing an imaging region with respect to an imaging object which is a subject defined as an imaging target of a camera included in an aircraft, and array specifying information for specifying a two-dimensional array of the imaging regions of the plurality of captured images; determining, based on the array specifying information, positions where the plurality of reduced images obtained by reducing each of the plurality of captured images are to be arranged in a list display region for displaying a list of the plurality of reduced images; and displaying the plurality of reduced images arranged at the positions determined in the list display region.

[0017] A program according to a third aspect of the present invention causes a computer to function as an acquisition unit that acquires a plurality of captured images captured while changing an imaging region with respect to an imaging object which is a subject defined as an imaging target of a camera included in an aircraft, and array specifying information for specifying a two-dimensional array of the imaging regions of the plurality of captured images; an image processing unit that determines, based on the array specifying information, positions where the plurality of reduced images obtained by reducing each of the plurality of captured images are to be arranged in a list display region for displaying a list of the plurality of reduced images; and a display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display region.

Advantages of the Invention

[0018] According to the present invention, there is an effect that a list of captured images can be made easier to view.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0020] [Overview of Information Processing System S] FIG. 1 is a diagram for explaining the overview of an information processing system S. The information processing system S is a system used for managing captured images. The information processing system S includes an aircraft 1, a user terminal 2, and an information processing apparatus 3.

[0021] The aircraft 1 is an aircraft that flies unmanned, so-called a drone. The aircraft 1 has a camera C for capturing an image. The aircraft 1 is used to capture an imaging object T. The imaging object T is a subject defined as an imaging target of the camera C, and is, for example, a three-dimensional object such as a structure such as a tower or a building such as a building. Note that the imaging object T is not limited to a three-dimensional object and may be a two-dimensional object.

[0022] A predetermined imaging mode is set in the aircraft 1. The predetermined imaging mode is a mode in which imaging is performed while changing the imaging area with respect to the imaging object T. Specifically, the predetermined imaging mode is a mode in which the entire imaging range is imaged by imaging while changing an imaging area that is a part of the imaging range including the imaging object T in accordance with the movement of the aircraft 1 or the change in the orientation of the camera C.

[0023] The imaging modes include, for example, a grid imaging mode and a spiral imaging mode. The grid imaging mode is a mode in which one of the plurality of surfaces of the imaging object T is used as an imaging region for imaging. Specifically, it is a mode in which the entire imaging range is imaged by changing the imaging region in the vertical and horizontal directions with respect to the planar imaging range. The spiral imaging mode is a mode in which a plurality of surfaces of the imaging object T are used as an imaging region for imaging. Specifically, it is a mode in which the entire imaging range is imaged by the aircraft 1 moving in a spiral around the imaging object T while imaging. It is desirable that the imaging region of the captured image is a region that does not overlap with the imaging regions of other captured images, but it is not limited to this, and a part of the imaging region of the captured image may be a region that overlaps with the imaging regions of other captured images.

[0024] The user terminal 2 is a terminal used by the user, such as a smartphone, a tablet terminal, a personal computer, etc. The user is a person who views the captured images captured by the aircraft 1.

[0025] The information processing device 3 is a device that manages the captured images captured by the aircraft 1, such as a server. The user terminal 2 and the information processing device 3 are different terminals and devices respectively, but it is not limited to this. For example, the user terminal 2 may have the functions of the information processing device 3 and manage the captured images captured by the aircraft 1.

[0026] In each of the captured images captured by the aircraft 1, only a part of the imaging object T is shown, not the entire imaging object T. Therefore, for example, when a plurality of captured images captured by the aircraft 1 are displayed in the order using the ID of the captured image or the imaging date and time when the captured image was captured, it may be difficult for the user to know which part of the imaging object T the part of the imaging object T shown in a certain captured image is. Therefore, the information processing system S causes the plurality of captured images captured by the aircraft 1 to be displayed in an arrangement according to a predetermined imaging mode in which the aircraft 1 captures the imaging object T.

[0027] First, when the flying object 1 captures an imaging target T in a predetermined imaging mode, it transmits image data to the information processing device 3 ((1) in FIG. 1). The image data includes a plurality of captured images and array identification information. Although details will be described later, the array identification information is information for identifying the two-dimensional array of the imaging regions of each of the plurality of captured images. When the information processing device 3 acquires the image data from the flying object 1, it stores the image data.

[0028] Subsequently, when the user accesses the information processing device 3 using the user terminal 2 and performs an operation to display a list of captured images, the user terminal 2 transmits a display request for the list of captured images to the information processing device 3 ((2) in FIG. 1). When the information processing device 3 receives the display request from the user terminal 2, based on the array identification information included in the image data, it determines the positions at which to arrange each of the plurality of reduced images obtained by reducing each of the plurality of captured images included in the image data in the list display area ((3) in FIG. 1). The list display area is an area for displaying a list of a plurality of reduced images. The size of the list display area may be predetermined or may be determined according to the user's settings.

[0029] Then, the information processing device 3 causes the user terminal 2 to display a display screen including the list display area in which the plurality of reduced images arranged at the determined positions are displayed ((4) in FIG. 1).

[0030] FIG. 2 is a diagram schematically showing the display of a plurality of reduced images. FIG. 2(a) is a diagram schematically showing the locus of changes in the imaging region when the flying object 1 captures the imaging target T in the grid imaging mode. The arrow A shown in FIG. 2(a) indicates the locus of changes in the imaging region when capturing the imaging target T. In the example shown in FIG. 2(a), the flying object 1 captures the imaging target T while changing the imaging region along the arrow A in the grid imaging mode.

[0031] Fig. 2(b) is a diagram schematically showing the list display area. In the example shown in Fig. 2(b), in the list display area, a plurality of images P which are reduced images are arranged and displayed at positions determined based on the arrangement specifying information. In Fig. 2(b), they are arranged at positions where the respective reduced images do not overlap, but it is not limited to this, and they may be arranged at positions where a part of each reduced image overlaps.

[0032] By doing so, the information processing system S can make it easy to understand which part of the imaging object T the part of the imaging object T shown in a certain reduced image (captured image) is. As a result, the information processing system S can make the list of the captured images easy to view. Hereinafter, the configuration of the information processing apparatus 3 will be described.

[0033] [Configuration of Information Processing Apparatus 3] Fig. 3 is a diagram schematically showing the functional configuration of the information processing apparatus 3. The information processing apparatus 3 includes a communication unit 31, a storage unit 32, and a control unit 33. In Fig. 3, the arrows indicate the main data flow, and there may be a data flow not shown in Fig. 3. In Fig. 3, each functional block shows a configuration in terms of function units, not in terms of hardware (device) units. Therefore, the functional blocks shown in Fig. 3 may be implemented in a single device, or may be divided and implemented in a plurality of devices. The data exchange between the functional blocks may be performed via any means such as a data bus, a network, a portable storage medium, etc.

[0034] The communication unit 31 is a communication interface for connecting to a network and has a communication controller for receiving data from an external terminal and an external server.

[0035] The storage unit 32 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) etc. of the computer that realizes the information processing apparatus 3, a RAM (Random Access Memory) that serves as the working area of the information processing apparatus 3, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores an OS (Operating System), application programs, and various information referred to during the execution of the application programs. The storage unit 32 is, for example, at least one of a built-in storage device and an external storage device (for example, an SD memory card or a USB (Universal Serial Bus) flash memory etc.).

[0036] The control unit 33 is a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) of the information processing apparatus 3, and functions as an acquisition unit 331, a reception unit 332, an image processing unit 333, and a display processing unit 334 by executing the programs stored in the storage unit 32.

[0037] The acquisition unit 331 acquires image data including a plurality of captured images captured while changing the imaging region for an imaging target object T which is a subject determined as the imaging target of the camera C of the aircraft 1, and array specification information. As described above, the array specification information is information for specifying a two-dimensional array of the imaging regions of the plurality of captured images with respect to the imaging range, and specifically, is information for identifying the positions of the two-dimensional arrays of the imaging regions of the plurality of captured images with respect to the imaging range. The array specification information is, for example, a list in which the ID of the captured image and the column number and row number of the imaging region of the captured image with respect to the imaging range are associated for each captured image.

[0038] The image data may further include various types of information, not limited to a plurality of captured images and array specification information. For example, the image data may include type information. The type information is information indicating the type of change in the imaging area when a plurality of captured images are captured. For example, it is information indicating either a grid imaging mode or a spiral imaging mode.

[0039] In addition, the image data may include position information and orientation information. The position information is information indicating the position of the aircraft 1 (e.g., two-dimensional coordinates, three-dimensional coordinates, etc.) when the captured image is captured. The orientation information is information indicating the orientation of the camera C when the captured image is captured. Further, the image data may include information indicating the position of the imaging object T.

[0040] In addition, the image data may include data identification information (e.g., management number, title, etc.) for identifying the image data. The data identification information may be information generated by the aircraft 1, or may be information input by a user using the control terminal of the aircraft 1. Note that the data identification information may be information generated by the information processing apparatus 3.

[0041] For example, when the title of the image data is a name including the orientation of the camera C when the captured image is captured, such as "north side", the acquisition unit 331 generates the title (data identification information) of the image data based on the orientation information included in the image data.

[0042] The acquisition unit 331 may directly acquire the image data from the aircraft 1 via the communication unit 31, or may acquire the image data from a control terminal (not shown) that controls the aircraft 1. Further, the acquisition unit 331 acquires the image data by reading the image data stored in the external storage device included in the storage unit 32. The acquisition unit 331 stores the acquired image data in the built-in storage device included in the storage unit 32. Note that the image data stored in the built-in storage device included in the storage unit 32 may be image data transferred from the external storage device to the built-in storage device by the user using the functions of the OS.

[0043] The reception unit 332 receives a display request for a list of captured images. The display request includes, for example, the ID of the image data. For example, when the user accesses the information processing apparatus 3 on the user terminal 2, the display processing unit 334 described later causes the user terminal 2 to display a display screen on which a list of titles of image data stored in the storage unit 32 (built-in storage device or external storage device) is displayed. Then, when the user performs an operation of selecting the title of one piece of image data on the display screen displayed on the user terminal 2, the reception unit 332 receives a display request for a list of captured images including the ID of the image data selected by the user.

[0044] Based on the array specification information included in the image data acquired by the acquisition unit 331, the image processing unit 333 determines the positions at which each of the plurality of reduced images obtained by reducing each of the plurality of captured images included in the image data acquired by the acquisition unit 331 is arranged in a list display area for displaying a list of the plurality of reduced images.

[0045] For example, first, the image processing unit 333 identifies the image data corresponding to the ID of the image data included in the display request received by the reception unit 332 from among one or more pieces of image data stored in the storage unit 32. The image processing unit 333 generates a plurality of reduced images by reducing each of the plurality of captured images included in the identified image data to a predetermined size. The predetermined size may be a predetermined size, or may be a size such that the horizontal width and the vertical width when the plurality of reduced images are arranged according to the two-dimensional array specified by the array specification information fit within the list display area. Then, the image processing unit 333 determines the positions at which each of the generated plurality of reduced images is arranged in the list display area according to the two-dimensional array specified by the array specification information included in the identified image data.

[0046] The display processing unit 334 displays a plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area displayed on the user terminal 2. For example, the display processing unit 334 transmits display data for causing the user terminal 2 to display a display screen on which a plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area are displayed, thereby causing the user terminal 2 to display the display screen.

[0047] The display processing unit 334 may display a plurality of reduced images in a manner corresponding to the imaging mode in which a plurality of captured images are captured. Specifically, the information processing apparatus 3 displays a plurality of reduced images in a manner corresponding to the imaging mode by executing the following two steps.

[0048] As a first step, the image processing unit 333 further determines the positions at which to arrange the respective reduced images in the list display area based on the type information (information indicating the type of change in the imaging area when a plurality of captured images are captured) included in the image data acquired by the acquisition unit 331. Specifically, when the type information indicates that the plurality of captured images are captured images in the grid imaging mode, the image processing unit 333 determines the positions at which to two-dimensionally arrange the respective reduced images in the list display area. Further, when the type information indicates that the plurality of captured images are captured images in the spiral imaging mode, the image processing unit 333 determines the positions at which to three-dimensionally arrange the respective reduced images in the list display area.

[0049] As a second step, the display processing unit 334 displays a plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area. Specifically, when the plurality of reduced images are images captured in the grid imaging mode, the display processing unit 334 displays each reduced image at the determined two-dimensional array position. Further, when the plurality of reduced images are images captured in the spiral imaging mode, the display processing unit 334 displays each reduced image at the determined three-dimensional array position.

[0050] FIG. 4 is a diagram schematically showing a display screen. The screen D, which is the display screen, includes a display area R1 and a display area R2. The display area R1 is an area for displaying a list of titles of the image data stored in the storage unit 32. The display area R2 is an area for displaying a list of reduced images.

[0051] In the example shown in FIG. 4(a), the image data of the "α tower" is the data of the captured image captured in the grid imaging mode. In this case, when the user performs an operation of selecting the "α tower" from the list of titles of the image data displayed in the display area R1 on the screen D displayed on the user terminal 2, the user terminal 2 displays a plurality of reduced images of the "α tower" arranged at the positions of the two-dimensional array determined by the information processing apparatus 3 in the display area R2.

[0052] In the example shown in FIG. 4(b), the image data of the "β tower" is the data of the captured image captured in the spiral imaging mode. In this case, when the user performs an operation of selecting the "β tower" from the list of titles of the image data displayed in the display area R1 on the screen D displayed on the user terminal 2, the user terminal 2 displays a plurality of reduced images of the "β tower" arranged at the positions of the three-dimensional array determined by the information processing apparatus 3 in the display area R2.

[0053] The display processing unit 334 may display the plurality of reduced images in different shapes depending on whether they are arranged in a two-dimensional array or a three-dimensional array. Specifically, first, when generating a plurality of reduced images, the image processing unit 333 generates reduced images with different shapes depending on whether the plurality of reduced images are arranged in a two-dimensional array or a three-dimensional array. For example, when arranging a plurality of reduced images on a cylinder or a sphere as a three-dimensional array, the image processing unit 333 makes a part of the shape of each reduced image into a curve. Then, the display processing unit 334 arranges and displays each reduced image with the shape generated by the image processing unit 333 at the position determined by the image processing unit 333. By doing so, the information processing apparatus 3 can display the captured image in a shape corresponding to a predetermined imaging mode when the captured image was captured.

[0054] The display processing unit 334 may display information indicating the imaging areas of a plurality of reduced images. The information indicating the imaging area is, for example, information indicating which part of the imaging object T included in the imaging area is. For example, when the camera C faces south and images the iron tower as the imaging object T, the information indicating the imaging area is "the north side of the iron tower", etc.

[0055] Specifically, the display processing unit 334 refers to the map information and further displays information indicating the imaging area specified by the position information and the orientation information in the list display area. For example, the display processing unit 334 refers to the map information, specifies the object closest to the position of the aircraft 1 indicated by the position information in the direction of the camera C indicated by the orientation information as the imaging object T, and combines the name of the imaging object T included in the map information with the name indicating the surface of the imaging object T visible from the direction of the camera C, and displays it as information indicating the imaging area.

[0056] When the map information includes information indicating the height of the object, the display processing unit 334 may further display information (for example, upper part, middle part, lower part, etc.) indicating the relationship between the altitude of the aircraft 1 when the captured image is captured and the height of the imaging object T as information indicating the imaging area. For example, the display processing unit 334 divides the height of the imaging object T into three ranges: upper part, middle part, and lower part, and displays the name of the range in which the altitude of the aircraft 1 when the captured image is captured is included as information indicating the relationship between the altitude of the aircraft 1 when the captured image is captured and the height of the imaging object T. The display processing unit 334 may display information indicating the imaging area (imaging range) corresponding to the entire plurality of reduced images, or may display information indicating the imaging area corresponding to each reduced image for each reduced image. By doing so, the information processing apparatus 3 can make it easier for the user to recognize which part of the imaging object T included in the imaging area of the reduced image is.

[0057] When the imaging processing unit 334 captures a plurality of imaging images in the same imaging range and in the same imaging mode by the flying object 1 multiple times, for each reduced image, the information indicating the number of reduced images arranged at the same position may be further displayed. Specifically, first, the acquisition unit 331 acquires image data including a plurality of image groups. The image groups include a plurality of imaging images. The plurality of image groups are image groups captured in different time zones and in the same imaging range and in the same imaging mode. The image processing unit 333 generates reduced images of each image group and determines positions for arranging the generated reduced images.

[0058] Then, the display processing unit 334 further displays, for each reduced image, information indicating the number of reduced images arranged at the same position as the reduced image. As the information indicating the number of reduced images, the display processing unit 334 may display the number of reduced images, or may display a plurality of reduced images placed at the same position by overlapping them for each position where the reduced images are placed. By doing so, the information processing apparatus 3 can make it easier for the user to recognize how many reduced images are at the position where the reduced images are placed.

[0059] When the flying object 1 captures a plurality of imaging images in the same imaging range and in the same imaging mode multiple times, the display processing unit 334 may preferentially display an image with high display quality. The display quality is, for example, the degree of focus of the imaging object T, the resolution, the degree of blur, etc. Specifically, the information processing apparatus 3 preferentially displays an image with high display quality by executing the following three steps.

[0060] As a first step, the acquisition unit 331 acquires image data including a plurality of first imaging images and a plurality of second imaging images. The first imaging images and the second imaging images are imaging images captured in different time zones. Specifically, the plurality of first imaging images are a plurality of imaging images captured in the first time zone. Also, the plurality of second imaging images are a plurality of imaging images captured in a second time zone different from the first time zone (for example, a time zone immediately after the first time zone).

[0061] The first captured image and the second captured image may be captured images captured under different imaging conditions. The imaging conditions are, for example, focal length, depth of field, light adjustment, etc.

[0062] As a second step, the image processing unit 333 generates a reduced image corresponding to a captured image with high display quality of the imaging object T. Specifically, first, when generating a plurality of reduced images, the image processing unit 333 selects a captured image with high display quality of the imaging object T from among the first captured image and the second captured image arranged at the same position. The image processing unit 333 selects a captured image with high display quality of the imaging object T by analyzing the captured image using, for example, known techniques. Then, the image processing unit 333 generates a reduced image corresponding to the selected captured image. Thereafter, the display processing unit 334 displays the plurality of reduced images generated by the image processing unit 333 in the list display area. In this way, the information processing apparatus 3 can make it easier for the user to recognize the imaging object T included in the imaging area of the reduced image by preferentially displaying an image with high display quality.

[0063] After the display processing unit 334 displays a plurality of reduced images in the list display area, when the user selects one reduced image from among the plurality of reduced images, the display processing unit 334 enlarges and displays the selected reduced image. Specifically, the display processing unit 334 displays the captured image used for reducing the reduced image selected by the user.

[0064] The display processing unit 334 may display information about other reduced images related to the reduced image selected by the user from among the plurality of reduced images displayed in the list display area. The other captured images are other reduced images including a part of the imaging object T included in the reduced image selected by the user, for example, other reduced images in which a part of the imaging object T shown in the reduced image selected by the user is captured at a different position or angle.

[0065] Specifically, when one reduced image is selected in the list display area, the display processing unit 334 displays information regarding another reduced image that includes a part of the imaging object T included in the selected reduced image and that is identified based on the position information and the orientation information. The information processing apparatus 3 displays information related to another reduced image, for example, by executing the following three steps.

[0066] As a first step, the acquisition unit 331 acquires image data including a plurality of first captured images and a plurality of second captured images captured in different imaging ranges. The acquisition unit 331 acquires, for example, image data including a plurality of first captured images captured with the north side surface of the imaging object T as the imaging range and a plurality of second captured images captured with the east side surface of the imaging object T as the imaging range. In this case, the image data includes array identification information, position information, orientation information, etc. corresponding to the first captured images and the second captured images.

[0067] As a second step, for each captured image, the image processing unit 333 identifies another captured image corresponding to another imaging range different from the imaging range corresponding to the captured image and captured at the position of the flying object 1 and the orientation of the camera C where the direction in which the camera C faces when the captured image is captured from the position of the flying object 1 intersects. The image processing unit 333, for example, for each first captured image, identifies a second captured image captured at the position of the flying object 1 and the orientation of the camera C where the direction in which the camera C faces when the first captured image is captured from the position of the flying object 1 intersects. The image processing unit 333 associates the first captured image (first reduced image) with the identified second captured image (second reduced image).

[0068] As a third step, when the reception unit 332 receives a user operation of selecting one reduced image in the list display area, the display processing unit 334 displays information regarding another reduced image associated with the selected reduced image. The display processing unit 334, for example, displays information regarding the second reduced image associated with the selected first reduced image.

[0069] The display processing unit 334 may display at least one of another reduced image, the number of another reduced images, and identification information for identifying another reduced image as information regarding another reduced image. The identification information is, for example, information combining information indicating an imaging area of another reduced image (e.g., the east side surface, etc.) and the ID of the reduced image.

[0070] FIG. 5 is a diagram schematically showing the display of information indicating the imaging area of another reduced image. FIG. 5(a) shows an example in which a plurality of first reduced images captured with the north side surface of the imaging object T as the imaging range are arranged based on the arrangement specifying information. Further, FIG. 5(a) shows an example in which a plurality of second reduced images captured with the east side surface of the imaging object T as the imaging range are arranged based on the arrangement specifying information. For example, the image P1 shown in FIG. 5(a) and the image P2 shown in FIG. 5(b) are associated with each other.

[0071] FIG. 5(c) shows an example of the screen D, in which a plurality of first reduced images are displayed. In this case, when the user selects the first reduced image corresponding to the image P1 shown in FIG. 5(a) on the screen D, the display processing unit 334 displays the display object O. In the display object O, the image P2 and the identification information of the image P2 are displayed as information regarding the image P2 associated with the image P1 shown in FIG. 5(a). By doing so, the information processing apparatus 3 can present the user with images of a part of the imaging object T imaged from various angles in the selected reduced image.

[0072] [Processing of the information processing apparatus 3] Subsequently, the processing flow of the information processing apparatus 3 will be described. FIG. 6 is a flowchart showing the flow of the information processing apparatus 3. This flowchart starts when the acquisition unit 331 acquires image data (S1). The acquisition unit 331 stores the acquired image data in the storage unit 32 (S2).

[0073] The reception unit 332 receives a display request for a list of captured images (S3). The image processing unit 333 generates a plurality of reduced images by reducing each of the plurality of captured images included in the specified image data to a predetermined size (S4).

[0074] The image processing unit 333 determines the positions at which to arrange each of the generated reduced images in the list display area according to a two-dimensional array specified by the array specification information included in the specified image data (S5). Then, the display processing unit 334 displays the plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area (S6).

[0075] [Effects of the Present Embodiment] As described above, the information processing apparatus 3 determines the positions at which to arrange each of the plurality of reduced images in the list display area based on the array specification information, and displays the plurality of reduced images arranged at the determined positions in the list display area. By doing so, the information processing apparatus 3 can make it easy to understand which part of the imaging object T is shown in a certain reduced image (captured image). As a result, the information processing apparatus 3 can make it easier to view the list of captured images.

[0076] Note that the present invention can contribute to Goal 9, "Build the infrastructure for industry and innovation," of the Sustainable Development Goals (SDGs) led by the United Nations.

[0077] Although the present invention has been described using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist. For example, all or part of the device can be functionally or physically distributed and integrated in any unit. Also, new embodiments resulting from any combination of a plurality of embodiments are included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination have the effects of the original embodiments combined.

Explanation of Reference Numerals

[0078] 1 Aircraft 2 User terminal 3 Information processing device 31 Communication unit 32 Memory unit 33 Control unit 331 Acquisition unit 332 Reception unit 333 Image processing unit 334 Display processing unit S Information processing system

Claims

1. An acquisition unit that acquires a plurality of captured images captured while changing an imaging region with respect to an imaging target that is a subject defined as an imaging target of a camera included in an aircraft, and array identification information for identifying a two-dimensional array of the imaging regions of the plurality of captured images; An image processing unit that determines positions for arranging the plurality of reduced images in a list display area for displaying a list of the plurality of reduced images obtained by reducing each of the plurality of captured images based on the array identification information; A display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display area; An information processing apparatus having the above.

2. The acquisition unit further acquires position information indicating the position of the aircraft when the captured image is captured and orientation information indicating the orientation of the camera when the captured image is captured, The display processing unit refers to map information and further displays information indicating the imaging region specified by the position information and the orientation information in the list display area. The information processing apparatus according to claim 1.

3. The acquisition unit acquires a plurality of first captured images that are the plurality of captured images captured in a first time period and a plurality of second captured images that are the plurality of captured images captured in a second time period different from the first time period, When generating the plurality of reduced images, the image processing unit selects the captured image with high display quality of the imaging target from among the first captured image and the second captured image arranged at the same position, and generates a reduced image corresponding to the selected captured image. The information processing apparatus according to claim 1.

4. The acquisition unit acquires the plurality of first captured images and the plurality of second captured images captured under different imaging conditions respectively. The information processing apparatus according to claim 3.

5. The acquisition unit acquires, as the array identification information, position identification information for identifying positions of two-dimensional arrays of the imaging regions of the plurality of captured images. The information processing apparatus according to claim 1.

6. The acquisition unit acquires a plurality of image groups including the plurality of captured images, the plurality of image groups being captured in different time periods respectively, The display processing unit further displays information indicating the number of the reduced images arranged at the same position as the reduced image for each reduced image. The information processing apparatus according to claim 1.

7. The acquisition unit further acquires type information indicating the type of change of the imaging region when the plurality of captured images are captured. The image processing unit further determines, based on the type information, positions at which the plurality of reduced images are arranged in the list display area. The information processing apparatus according to claim 1.

8. The acquisition unit further acquires position information indicating the position of the flying object when the captured image is captured and orientation information indicating the orientation of the camera when the captured image is captured. When one of the reduced images is selected in the list display area, the display processing unit displays information about another reduced image that includes a part of the imaging object included in the selected reduced image and that is specified based on the position information and the orientation information. The information processing apparatus according to claim 1.

9. The display processing unit displays at least any one of the other reduced image, the number of the other reduced images, and identification information for identifying the other reduced images as information about the other reduced image. The information processing apparatus according to claim 8.

10. The imaging object is a three-dimensional object. When the plurality of captured images are captured images of one of a plurality of surfaces of the imaging object as the imaging region, the image processing unit determines positions at which the plurality of reduced images are two-dimensionally arranged in the list display area, and when the plurality of captured images are captured images of a plurality of surfaces of the imaging object as the imaging region, the image processing unit determines positions at which the plurality of reduced images are three-dimensionally arranged in the list display area. The information processing apparatus according to claim 1.

11. When generating the plurality of reduced images, the image processing unit generates reduced images having different shapes when the plurality of reduced images are two-dimensionally arranged and when the plurality of reduced images are three-dimensionally arranged. The information processing apparatus according to claim 10.

12. Executed by a computer a step of acquiring a plurality of captured images captured while changing an imaging region with respect to an imaging object that is a subject defined as an imaging target of a camera included in a flying object, and array specifying information for specifying a two-dimensional array of the imaging regions of the plurality of captured images. a step of determining, in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images, positions for arranging each of the plurality of reduced images based on the array specifying information; a step of displaying the plurality of reduced images arranged at the positions determined in the list display area; An information processing method comprising the steps.

13. A computer, an acquisition unit that acquires a plurality of captured images captured while changing an imaging region with respect to an imaging object that is a subject defined as an imaging target of a camera included in an aircraft, and array specifying information for specifying a two-dimensional array of the imaging regions of each of the plurality of captured images; an image processing unit that determines, based on the array specifying information, positions for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images, and a display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display area, A program for causing the computer to function as the above.

Images