Information processing device, information processing method, and program

The information processing device aligns captured images with their imaging mode and positional data to facilitate easier identification of object parts within the images, addressing the challenge of image arrangement in existing systems.

JP7583198B1Active Publication Date: 2024-11-13KDDI CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024002723
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-01-11
Publication Date
2024-11-13
Estimated Expiration
2044-01-11

AI Technical Summary

Technical Problem

Existing systems struggle to effectively arrange and display captured images from an aircraft camera in a manner that allows users to easily identify the specific parts of the imaged object shown in each image.

Method used

An information processing device that acquires array specifying information for captured images, determines positions for reduced images based on this information, and displays them in a list to align with the imaging mode, including positional and orientation data to facilitate understanding of the imaged object's parts.

Benefits of technology

Enables easier viewing of captured images by aligning them with their corresponding positions and orientations, making it simpler for users to recognize which part of the object is depicted in each image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583198000001_ABST
    Figure 0007583198000001_ABST
Patent Text Reader

Abstract

To make a list of captured images easier to view. [Solution] The information processing device 3 has an acquisition unit 331 that acquires a plurality of captured images captured while changing the imaging area of ​​an imaging target, which is a subject defined as the imaging target of a camera possessed by an aircraft, and array identification information for identifying the two-dimensional array of the imaging area of ​​each of the plurality of captured images, an image processing unit 333 that determines, based on the array identification information, a position for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images, and a display processing unit 334 that displays the plurality of reduced images arranged at the positions determined by the image processing unit 333 in the list display area.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for displaying a list of captured images taken by an aircraft equipped with a camera (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-005186 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned technology, a plurality of captured images are displayed on a display screen in an order using the ID (identification) or image capture date and time of the captured images, but this may be difficult for the user to view.

[0005] The present invention has been made in consideration of these points, and has an object to make it easier to view a list of captured images. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention has an acquisition unit that acquires a plurality of captured images captured while changing the imaging area of ​​an imaging target, which is a subject defined as the imaging target of a camera possessed by an aircraft, and array identification information for identifying the two-dimensional array of the imaging area of ​​each of the plurality of captured images, an image processing unit that determines, based on the array identification information, a position for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images, and a display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display area.

[0007] The acquisition unit may further acquire location information indicating the position of the flying object when the captured image was captured and orientation information indicating the orientation of the camera when the captured image was captured, and the display processing unit may further display information indicating the imaging area identified by the location information and the orientation information in the list display area by referring to map information.

[0008] The acquisition unit may acquire a plurality of first captured images which are the plurality of captured images captured in a first time period and a plurality of second captured images which are the plurality of captured images captured in a second time period different from the first time period, and the image processing unit, when generating the plurality of reduced images, may select an captured image having a high quality of display of the object to be imaged from among the first captured image and the second captured image arranged at the same position, and generate the reduced image corresponding to the selected captured image.

[0009] The acquisition section may acquire the first captured images and the second captured images captured under different imaging conditions. The acquisition section may acquire, as the array identification information, position identification information for identifying a position of a two-dimensional array of the imaging regions in each of the plurality of captured images.

[0010] The acquisition unit may acquire an image group including the plurality of captured images, each of which was captured at a different time, and the display processing unit may further display, for each reduced image, information indicating the number of reduced images arranged in the same position as the reduced image.

[0011] The acquisition unit may further acquire type information indicating a type of change to the imaging area when the multiple captured images were captured, and the image processing unit may further determine a position for arranging each of the multiple reduced images in the list display area based on the type information.

[0012] The acquisition unit may further acquire location information indicating the position of the flying object when the captured image was captured and orientation information indicating the orientation of the camera when the captured image was captured, and the display processing unit may, when one of the reduced images is selected in the list display area, display information regarding the other reduced images that include a portion of the imaged object contained in the selected reduced image and that are identified based on the location information and the orientation information.

[0013] The display processing section may display, as the information relating to the other reduced images, at least one of the other reduced images, the number of the other reduced images, and identification information for identifying the other reduced images.

[0014] The object to be imaged may be a three-dimensional object, and when the multiple captured images are captured images of one of multiple surfaces of the object to be imaged as the imaging area, the image processing unit may determine a position for two-dimensionally arranging each of the multiple reduced images in the list display area, and when the multiple captured images are captured images of one of multiple surfaces of the object to be imaged as the imaging area, the image processing unit may determine a position for three-dimensionally arranging each of the multiple reduced images in the list display area.

[0015] The image processing unit may generate the reduced images having different shapes depending on whether the reduced images are arranged two-dimensionally or three-dimensionally.

[0016] An information processing method according to a second aspect of the present invention includes the steps of: acquiring, executed by a computer, a plurality of captured images captured while changing the imaging area of ​​an imaging target, which is a subject defined as the imaging target of a camera possessed by an aircraft, and array identification information for identifying the two-dimensional array of the imaging area of ​​each of the plurality of captured images; determining, based on the array identification information, a position for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images; and displaying the plurality of reduced images arranged at the determined positions in the list display area.

[0017] A program relating to a third aspect of the present invention causes a computer to function as an acquisition unit that acquires a plurality of captured images captured while changing the imaging area of ​​an imaging target, which is a subject defined as the imaging target of a camera possessed by an aircraft, and array identification information for identifying the two-dimensional array of the imaging area of ​​each of the plurality of captured images, an image processing unit that determines, based on the array identification information, a position for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images, and a display processing unit that displays the plurality of reduced images arranged at the positions determined by the image processing unit in the list display area. Effect of the Invention

[0018] According to the present invention, an effect is achieved in that a list of captured images can be easily viewed. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram for explaining an overview of an information processing system. [Diagram 2]FIG. 13 is a diagram illustrating a schematic display of a plurality of reduced images. [Diagram 3] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Figure 4] FIG. 2 is a diagram illustrating a display screen. [Diagram 5] 13 is a diagram showing a schematic display of information indicating an imaging area of ​​another reduced image. FIG. [Figure 6] 13 is a flowchart showing a flow of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] [Outline of Information Processing System S] 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a system used for managing captured images. The information processing system S has an aircraft 1, a user terminal 2, and an information processing device 3.

[0021] The aircraft 1 is an unmanned aircraft, a so-called drone. The aircraft 1 has a camera C that captures an image. The aircraft 1 is used to capture an image of an object T. The object T is a subject determined as an image capture target of the camera C, and is, for example, a three-dimensional object such as a structure such as a steel tower or a building. Note that the object T is not limited to a three-dimensional object, and may be a two-dimensional object.

[0022] A predetermined imaging mode is set for the flying object 1. The predetermined imaging mode is a mode in which an image is captured while changing an imaging area for an imaging target T. Specifically, the predetermined imaging mode is a mode in which an image is captured of the entire imaging range by capturing an image of an imaging area that is a part of an imaging range including the imaging target T while changing the imaging area in response to the movement of the flying object 1 or the change in the orientation of the camera C.

[0023] The imaging modes include, for example, a grid imaging mode and a spiral imaging mode. The grid imaging mode is a mode in which one of the multiple surfaces of the imaging object T is imaged as an imaging area, and specifically, a mode in which the imaging area is changed vertically and horizontally with respect to a planar imaging range, thereby imaging the entire imaging range. The spiral imaging mode is a mode in which the multiple surfaces of the imaging object T are imaged as an imaging area, and specifically, a mode in which the flying object 1 is imaged while moving in a spiral shape with the imaging object T as the center, thereby imaging the entire imaging range. It is desirable that the imaging area of ​​a captured image is an area that does not overlap with the imaging area of ​​another captured image, but this is not limited thereto, and a part of the imaging area of ​​the captured image may overlap with the imaging area of ​​another captured image.

[0024] The user terminal 2 is a terminal used by a user, and is, for example, a smartphone, a tablet terminal, a personal computer, etc. The user is a person who views the captured images captured by the flying object 1.

[0025] The information processing device 3 is a device that manages the captured images captured by the flying object 1, and is, for example, a server. The user terminal 2 and the information processing device 3 are different terminals and devices, respectively, but are not limited to this. For example, the user terminal 2 may have the function of the information processing device 3 and manage the captured images captured by the flying object 1.

[0026] Each captured image captured by the aircraft 1 captures not the entire image capture target T but a part of the image capture target T. For this reason, for example, when a plurality of captured images captured by the aircraft 1 are displayed in an order using the ID of the captured image or the capture date and time when the captured image was captured, it may be difficult for a user to know which part of the image capture target T is a part of the image capture target T captured in a certain captured image. Therefore, the information processing system S displays a plurality of captured images captured by the aircraft 1 in an arrangement that matches a predetermined imaging mode in which the aircraft 1 captured the image of the image capture target T.

[0027] First, the aircraft 1 captures an image of the imaging target T in a predetermined imaging mode and transmits the image data to the information processing device 3 ((1) in FIG. 1). The image data includes a plurality of captured images and array identification information. The array identification information is information for identifying the two-dimensional array of the imaging regions of each of the plurality of captured images, as will be described in detail later. When the information processing device 3 acquires the image data from the aircraft 1, it stores the image data.

[0028] Next, when the user accesses the information processing device 3 using the user terminal 2 and performs an operation to display a list of captured images, the user terminal 2 transmits a display request for the list of captured images to the information processing device 3 ((2) in FIG. 1). Upon receiving the display request from the user terminal 2, the information processing device 3 determines, based on the arrangement specification information included in the image data, the positions for arranging each of the multiple reduced images obtained by reducing each of the multiple captured images included in the image data in the list display area ((3) in FIG. 1). The list display area is an area for displaying a list of the multiple reduced images. The size of the list display area may be determined in advance or may be determined by a user setting.

[0029] Then, the information processing device 3 causes the user terminal 2 to display a display screen including a list display area displaying the multiple reduced images arranged in the determined positions ((4) in FIG. 1).

[0030] Fig. 2 is a diagram that shows a schematic representation of the display of multiple reduced images. Fig. 2(a) is a diagram that shows a schematic representation of a trajectory of change of the imaging area when the flying object 1 captures an image of the imaging object T in the grid imaging mode. Arrow A shown in Fig. 2(a) indicates the trajectory of change of the imaging area when the imaging object T is captured. In the example shown in Fig. 2(a), the flying object 1 captures an image of the imaging object T while changing the imaging area along arrow A in the grid imaging mode.

[0031] Fig. 2(b) is a diagram showing a schematic diagram of the list display area. In the example shown in Fig. 2(b), a plurality of images P, which are reduced images, are arranged and displayed in the list display area at positions determined based on the arrangement specification information. In Fig. 2(b), the reduced images are arranged at positions where they do not overlap, but this is not limiting, and the reduced images may be arranged at positions where they partially overlap.

[0032] In this way, the information processing system S can easily identify which part of the image capture object T is a part of the image capture object T that appears in a reduced image (captured image). As a result, the information processing system S can make the list of captured images easy to view. The configuration of the information processing device 3 will be described below.

[0033] [Configuration of information processing device 3] FIG. 3 is a diagram showing a schematic functional configuration of an information processing device 3. The information processing device 3 includes a communication unit 31, a storage unit 32, and a control unit 33. In FIG. 3, arrows indicate main data flows, and there may be data flows not shown in FIG. 3. In FIG. 3, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 3 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0034] The communication unit 31 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external terminal and an external server.

[0035] The storage unit 32 is a large-capacity storage device such as a ROM (Read Only Memory) that stores a BIOS (Basic Input Output System) of a computer that realizes the information processing device 3, a RAM (Random Access Memory) that serves as a working area for the information processing device 3, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores an OS (Operating System), application programs, and various information referenced when the application programs are executed. The storage unit 32 is, for example, at least one of an internal storage device and an external storage device (for example, an SD memory card or a USB (Universal Serial Bus) flash memory, etc.).

[0036] The control unit 33 is a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the information processing device 3, and functions as an acquisition unit 331, a reception unit 332, an image processing unit 333, and a display processing unit 334 by executing programs stored in the memory unit 32.

[0037] The acquisition unit 331 acquires image data including a plurality of captured images captured while changing the imaging area of ​​an imaging target T, which is a subject determined as an imaging target of the camera C of the flying object 1, and array identification information. As described above, the array identification information is information for identifying the two-dimensional array of the imaging areas of each of the plurality of captured images relative to the imaging range, and more specifically, information for identifying the position of the two-dimensional array of the imaging areas of each of the plurality of captured images relative to the imaging range. The array identification information is, for example, a list in which, for each captured image, the ID of the captured image is associated with the column number and row number of the imaging area of ​​the captured image relative to the imaging range.

[0038] The image data may further include various information, not limited to the multiple captured images and the array identification information. For example, the image data may include type information. The type information is information indicating the type of change of the imaging area when the multiple captured images are captured, and is, for example, information indicating either a grid imaging mode or a spiral imaging mode.

[0039] The image data may also include position information and orientation information. The position information is information indicating the position (e.g., two-dimensional coordinates or three-dimensional coordinates) of the flying object 1 when the captured image was captured. The orientation information is information indicating the orientation of the camera C when the captured image was captured. The image data may also include information indicating the position of the imaging target object T.

[0040] The image data may also include data identification information (e.g., a management number, a title, etc.) for identifying the image data. The data identification information may be information generated by the aircraft 1, or may be information input by a user who uses the control terminal of the aircraft 1. The data identification information may also be information generated by the information processing device 3.

[0041] For example, if the title of the image data is a name including the orientation of camera C when the captured image was captured, such as “North Side,” the acquisition unit 331 generates a title (data identification information) of the image data based on the orientation information included in the image data.

[0042] The acquisition unit 331 may acquire image data directly from the flying object 1 via the communication unit 31, or may acquire image data from a control terminal (not shown) that controls the flying object 1. The acquisition unit 331 acquires image data by reading the image data stored in an external storage device included in the storage unit 32. The acquisition unit 331 stores the acquired image data in an internal storage device included in the storage unit 32. The image data stored in the internal storage device included in the storage unit 32 may be image data transferred from the external storage device to the internal storage device by the user using a function of the OS.

[0043] The reception unit 332 receives a display request for a list of captured images. The display request includes, for example, the ID of the image data. For example, when a user accesses the information processing device 3 on the user terminal 2, a display processing unit 334 (described later) causes the user terminal 2 to display a display screen displaying a list of titles of image data stored in the storage unit 32 (built-in storage device or external storage device). Then, when the user performs an operation to select the title of one piece of image data on the display screen displayed on the user terminal 2, the reception unit 332 receives a display request for a list of captured images including the ID of the image data selected by the user.

[0044] Based on the arrangement-specific information contained in the image data acquired by the acquisition unit 331, the image processing unit 333 determines the position in which to arrange each of the multiple reduced images in a list display area for displaying a list of multiple reduced images obtained by reducing each of the multiple captured images contained in the image data acquired by the acquisition unit 331.

[0045] For example, first, the image processing unit 333 identifies image data corresponding to the ID of the image data included in the display request accepted by the accepting unit 332 from among one or more image data stored in the storage unit 32. The image processing unit 333 generates multiple reduced images by reducing each of the multiple captured images included in the identified image data to a predetermined size. The predetermined size may be a size determined in advance, or may be a size in which the horizontal and vertical widths of the multiple reduced images arranged according to the two-dimensional array specified by the array specifying information fit within the list display area. Then, the image processing unit 333 determines the positions at which the multiple generated reduced images are arranged in the list display area according to the two-dimensional array specified by the array specifying information included in the identified image data.

[0046] The display processing unit 334 displays the multiple reduced images arranged at the positions determined by the image processing unit 333 in the list display area displayed on the user terminal 2. The display processing unit 334 causes the user terminal 2 to display the display screen by, for example, transmitting to the user terminal 2 display data for displaying a display screen on which the multiple reduced images arranged at the positions determined by the image processing unit 333 in the list display area are displayed.

[0047] The display processing unit 334 may display the multiple reduced images in a manner corresponding to the imaging mode in which the multiple captured images were captured. Specifically, the information processing device 3 displays the multiple reduced images in a manner corresponding to the imaging mode by executing the following two steps.

[0048] As a first step, the image processing unit 333 further determines positions at which the multiple reduced images are arranged in the list display area based on type information (information indicating the type of change in the imaging area when the multiple captured images are captured) included in the image data acquired by the acquisition unit 331. Specifically, when the type information indicates that the multiple captured images are captured in the grid imaging mode, the image processing unit 333 determines positions at which the multiple reduced images are arranged two-dimensionally in the list display area. Also, when the type information indicates that the multiple captured images are captured in the spiral imaging mode, the image processing unit 333 determines positions at which the multiple reduced images are arranged three-dimensionally in the list display area.

[0049] As a second step, the display processing unit 334 displays the multiple reduced images arranged in the list display area at the positions determined by the image processing unit 333. Specifically, when the multiple reduced images are images captured in the grid imaging mode, the display processing unit 334 displays each reduced image at the positions of the determined two-dimensional array. Also, when the multiple reduced images are images captured in the spiral imaging mode, the display processing unit 334 displays each reduced image at the positions of the determined three-dimensional array.

[0050] 4 is a diagram showing a schematic representation of a display screen. Screen D, which is the display screen, includes display area R1 and display area R2. Display area R1 is an area for displaying a list of titles of image data stored in storage unit 32. Display area R2 is an area for displaying a list of reduced images.

[0051] 4(a), the image data of the "α tower" is data of an image captured in the grid imaging mode. In this case, when the user performs an operation to select "α tower" from a list of the titles of image data displayed in the display area R1 on the screen D displayed on the user terminal 2, the user terminal 2 displays multiple reduced images of the "α tower" arranged in the two-dimensional array positions determined by the information processing device 3 in the display area R2.

[0052] 4(b), the image data of the "β pylon" is data of an image captured in the spiral imaging mode. In this case, when the user performs an operation to select "β pylon" from a list of the titles of image data displayed in the display area R1 on the screen D displayed on the user terminal 2, the user terminal 2 displays multiple reduced images of the "β pylon" arranged in the three-dimensional array positions determined by the information processing device 3 in the display area R2.

[0053] The display processing unit 334 may display the multiple reduced images in different shapes depending on whether they are arranged two-dimensionally or three-dimensionally. Specifically, first, when generating multiple reduced images, the image processing unit 333 generates reduced images in different shapes depending on whether they are arranged two-dimensionally or three-dimensionally. For example, when the image processing unit 333 arranges multiple reduced images on a cylinder or a sphere as a three-dimensional arrangement, the image processing unit 333 curves a part of the shape of each reduced image. Then, the display processing unit 334 displays each reduced image in the shape generated by the image processing unit 333 in a line at a position determined by the image processing unit 333. In this way, the information processing device 3 can display the captured image in a shape corresponding to a predetermined imaging mode when the captured image was captured.

[0054] The display processing unit 334 may display information indicating the imaging areas of the multiple reduced images. The information indicating the imaging area is, for example, information indicating which part of the imaging target T is included in the imaging area. For example, when the camera C faces south and captures an image of a steel tower that is the imaging target T, the information indicating the imaging area is, for example, "the north side of the steel tower."

[0055] Specifically, the display processing unit 334 refers to the map information and further displays information indicating the imaging area specified by the position information and the orientation information in the list display area. For example, the display processing unit 334 refers to the map information, specifies an object closest to the position of the flying object 1 indicated by the position information in the orientation of the camera C indicated by the orientation information as the imaging target T, and displays a combination of the name of the imaging target T included in the map information and the name indicating the surface of the imaging target T visible from the orientation of the camera C as information indicating the imaging area.

[0056] In addition, when the map information includes information indicating the height of the object, the display processing unit 334 may display information (e.g., upper, middle, lower, etc.) further indicating the relationship between the altitude of the flying object 1 when the captured image was captured and the height of the imaging target T as information indicating the imaging area. For example, the display processing unit 334 divides the height of the imaging target T into three ranges, that is, upper, middle, and lower, and displays the name of the range including the altitude of the flying object 1 when the captured image was captured as information indicating the relationship between the altitude of the flying object 1 when the captured image was captured and the height of the imaging target T. The display processing unit 334 may display information indicating the imaging area (imaging range) corresponding to the entire plurality of reduced images, or may display information indicating the imaging area corresponding to each reduced image for each reduced image. In this way, the information processing device 3 can easily allow the user to recognize which part of the imaging target T is included in the imaging area of ​​the reduced image.

[0057] When the flying object 1 captures a plurality of images of the same imaging range in the same imaging mode multiple times, the display processing unit 334 may further display information indicating the number of reduced images arranged at the same position for each reduced image. Specifically, first, the acquisition unit 331 acquires image data including a plurality of image groups. The image groups include a plurality of captured images. The plurality of image groups are image groups captured at different time periods and of the same imaging range in the same imaging mode. The image processing unit 333 generates reduced images of each image group and determines the positions at which to arrange the generated reduced images.

[0058] Then, the display processing unit 334 further displays, for each reduced image, information indicating the number of reduced images arranged at the same position as the reduced image. The display processing unit 334 may display the number of reduced images as the information indicating the number of reduced images, or may display multiple reduced images placed at each position in an overlapping manner. In this way, the information processing device 3 can make it easier for the user to recognize how many reduced images are present at the positions where the reduced images are placed.

[0059] When the flying object 1 captures a plurality of images in the same imaging range and in the same imaging mode multiple times, the display processing unit 334 may preferentially display an image with high display quality. The display quality is, for example, the degree of focus of the imaging target T, the resolution, the degree of blur, etc. Specifically, the information processing device 3 executes the following three steps to preferentially display an image with high display quality.

[0060] As a first step, the acquisition unit 331 acquires image data including a plurality of first captured images and a plurality of second captured images. The first captured images and the second captured images are captured images captured in different time periods. Specifically, the plurality of first captured images are captured images captured in a first time period. Also, the plurality of second captured images are captured images captured in a second time period different from the first time period (for example, a time period immediately following the first time period).

[0061] The first captured image and the second captured image may be captured under different imaging conditions, such as focal length, depth of field, and dimming.

[0062] As a second step, the image processing unit 333 generates a reduced image corresponding to a captured image having a high display quality of the imaging object T. Specifically, when generating a plurality of reduced images, the image processing unit 333 first selects a captured image having a high display quality of the imaging object T from among the first captured image and the second captured image arranged at the same position. The image processing unit 333 analyzes the captured image using, for example, a known technique, and selects a captured image having a high display quality of the imaging object T. Then, the image processing unit 333 generates a reduced image corresponding to the selected captured image. After that, the display processing unit 334 displays the plurality of reduced images generated by the image processing unit 333 in the list display area. In this way, the information processing device 3 can easily make the user recognize the imaging object T included in the imaging area of ​​the reduced image by preferentially displaying an image having a high display quality.

[0063] After displaying a plurality of reduced images in the list display area, when the user selects one of the reduced images, the display processing unit 334 enlarges and displays the reduced image. Specifically, the display processing unit 334 displays the captured image used to reduce the reduced image selected by the user.

[0064] The display processing unit 334 may display information about other reduced images related to a reduced image selected by a user from among the multiple reduced images displayed in the list display area. The other captured images are other reduced images including a part of the imaging target T included in the reduced image selected by the user, for example, other reduced images in which a part of the imaging target T shown in the reduced image selected by the user is captured at a different position or angle.

[0065] Specifically, when one reduced image is selected in the list display area, the display processing unit 334 displays information about another reduced image that includes a part of the imaging target T included in the selected reduced image and that is identified based on the position information and the orientation information. The information processing device 3 displays information related to the other reduced images by executing, for example, the following three steps.

[0066] As a first step, the acquisition unit 331 acquires image data including a plurality of first captured images and a plurality of second captured images captured in different imaging ranges. For example, the acquisition unit 331 acquires image data including a plurality of first captured images captured in an imaging range of the north side of the imaging object T and a plurality of second captured images captured in an imaging range of the east side of the imaging object T. In this case, the image data includes array identification information, position information, orientation information, and the like corresponding to the first captured image and the second captured image.

[0067] As a second step, the image processing unit 333 identifies, for each captured image, another captured image corresponding to another imaging range different from the imaging range corresponding to the captured image, and captured at a position of the aircraft 1 and in a direction of the camera C that intersect with the direction in which the camera C faces when the captured image was captured from the position of the aircraft 1. For example, for each first captured image, the image processing unit 333 identifies a second captured image captured at a position of the aircraft 1 and in a direction of the camera C that intersect with the direction in which the camera C faces when the first captured image was captured from the position of the aircraft 1. The image processing unit 333 associates the first captured image (first reduced image) with the identified second captured image (second reduced image).

[0068] In a third step, when the accepting unit 332 accepts a user's operation to select one reduced image in the list display area, the display processing unit 334 displays information about other reduced images associated with the selected reduced image. For example, the display processing unit 334 displays information about a second reduced image associated with the selected first reduced image.

[0069] The display processing unit 334 may display at least one of the other reduced images, the number of other reduced images, and identification information for identifying the other reduced images, as information related to the other reduced images. The identification information is, for example, information that combines information indicating the imaging area of ​​the other reduced images (for example, the east side) and the ID of the reduced image.

[0070] FIG. 5 is a diagram showing a schematic display of information indicating the imaging area of ​​other reduced images. FIG. 5(a) shows an example in which a plurality of first reduced images captured with the north side of the imaging object T as the imaging range are arranged based on the arrangement specification information. b 5(a) shows an example in which a plurality of second reduced images captured with the east side of the imaging target T as the imaging range are arranged based on the arrangement specification information. For example, an image P1 shown in FIG. 5(a) and an image P2 shown in FIG. 5(b) are associated with each other.

[0071] FIG. 5(c) shows an example of screen D, in which a plurality of first reduced images are displayed. In this case, when the user selects a first reduced image corresponding to image P1 shown in FIG. 5(a) on screen D, display processing unit 334 displays display object O. Image P2 and identification information of image P2 are displayed on display object O as information related to image P2 shown in FIG. 5(b) associated with image P1 shown in FIG. 5(a). In this way, information processing device 3 can present to the user images in which a part of imaging target object T shown in the selected reduced image is captured from various angles.

[0072] [Processing of information processing device 3] Next, a description will be given of the flow of processing of the information processing device 3. Fig. 6 is a flowchart showing the flow of processing of the information processing device 3. This flowchart starts when the acquisition unit 331 acquires image data (S1). The acquisition unit 331 stores the acquired image data in the storage unit 32 (S2).

[0073] The receiving unit 332 receives a request to display a list of captured images (S3). The image processing unit 333 generates multiple reduced images by reducing each of the multiple captured images included in the identified image data to a predetermined size (S4).

[0074] The image processing unit 333 determines the positions at which the generated reduced images are arranged in the list display area according to the two-dimensional arrangement specified by the arrangement information included in the specified image data (S5). The display processing unit 334 then displays the reduced images arranged in the positions determined by the image processing unit 333 in the list display area (S6).

[0075] [Effects of this embodiment] As described above, the information processing device 3 determines the position for arranging each of the multiple reduced images in the list display area based on the arrangement specifying information, and displays the multiple reduced images arranged at the determined positions in the list display area. In this way, the information processing device 3 can make it easy to understand which part of the imaging object T corresponds to a part of the imaging object T shown in a reduced image (captured image). As a result, the information processing device 3 can make the list of captured images easy to view.

[0076] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0077] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0078] 1. Flying object 2. User terminal 3. Information processing equipment 31 Communications Department 32 Storage section 33 Control Unit 331 Acquisition Department 332 Reception 333 Image Processing Unit 334 Display Processing Unit S Information Processing System

Claims

1. An acquisition unit that acquires a plurality of captured images captured while changing an imaging area of ​​an imaging target that is a subject defined as an imaging target of a camera of the flying object, and array identification information for identifying a two-dimensional array of the imaging area of ​​each of the plurality of captured images; an image processing unit that determines, based on the arrangement specifying information, positions at which the plurality of reduced images are arranged in a list display area for displaying a list of a plurality of reduced images obtained by reducing the plurality of captured images, respectively; a display processing unit that displays the plurality of reduced images arranged at positions determined by the image processing unit in the list display area; An information processing device having the above configuration.

2. The acquisition unit further acquires position information indicating a position of the aircraft when the captured image was captured, and orientation information indicating a direction of the camera when the captured image was captured, the display processing unit refers to map information and further displays information indicating the imaging area specified by the position information and the orientation information in the list display area. The information processing device according to claim 1 .

3. the acquiring unit acquires a plurality of first captured images which are the plurality of captured images captured in a first time period and a plurality of second captured images which are the plurality of captured images captured in a second time period different from the first time period; the image processing unit, when generating the plurality of reduced images, selects an image having a high quality of display of the imaging object from among the first captured image and the second captured image arranged at the same position, and generates the reduced image corresponding to the selected captured image. The information processing device according to claim 1 .

4. The acquisition unit acquires the first captured images and the second captured images captured under different imaging conditions. The information processing device according to claim 3 .

5. the acquisition unit acquires, as the array identification information, position identification information for identifying a position of a two-dimensional array of the imaging regions in each of the plurality of captured images. The information processing device according to claim 1 .

6. the acquisition unit acquires a group of images including the plurality of captured images, the group of images being captured at different time periods; the display processing unit further displays, for each reduced image, information indicating the number of reduced images arranged at the same position as the reduced image. The information processing device according to claim 1 .

7. the acquiring unit further acquires type information indicating a type of change of the imaging area when the plurality of captured images are captured; the image processing unit further determines positions for arranging each of the plurality of reduced images in the list display area based on the type information. The information processing device according to claim 1 .

8. The acquisition unit further acquires position information indicating a position of the aircraft when the captured image was captured, and orientation information indicating a direction of the camera when the captured image was captured, when one of the reduced images is selected in the list display area, the display processing unit displays information about another reduced image that includes a part of the imaging object included in the selected reduced image and that is specified based on the position information and the orientation information. The information processing device according to claim 1 .

9. the display processing unit displays, as the information related to the other reduced images, at least one of the other reduced images, the number of the other reduced images, and identification information for identifying the other reduced images. The information processing device according to claim 8.

10. The imaging target object is a three-dimensional object, the image processing unit, when the plurality of captured images are captured images captured using one of a plurality of surfaces of the imaging object as the imaging area, determines positions for two-dimensionally arranging each of the plurality of reduced images in the list display area, and, when the plurality of captured images are captured images captured using a plurality of surfaces of the imaging object as the imaging area, determines positions for three-dimensionally arranging each of the plurality of reduced images in the list display area. The information processing device according to claim 1 .

11. the image processing unit, when generating the plurality of reduced images, generates the reduced images having different shapes depending on whether the plurality of reduced images are arranged two-dimensionally or three-dimensionally. The information processing device according to claim 10.

12. The computer executes acquiring a plurality of captured images captured while changing an imaging area of ​​an imaging target object that is a subject defined as an imaging target of a camera of the flying object, and array identification information for identifying a two-dimensional array of the imaging area of ​​each of the plurality of captured images; determining, based on the arrangement specifying information, positions for arranging each of the plurality of reduced images in a list display area for displaying a list of a plurality of reduced images obtained by reducing each of the plurality of captured images; displaying the plurality of thumbnail images arranged at the determined positions in the list display area; An information processing method comprising the steps of:

13. Computer, an acquisition unit that acquires a plurality of captured images captured while changing an imaging area of ​​an imaging target that is a subject defined as an imaging target of a camera of the flying object, and array identification information for identifying a two-dimensional array of the imaging area of ​​each of the plurality of captured images; an image processing unit that determines, based on the arrangement specifying information, positions at which the plurality of reduced images are arranged in a list display area for displaying a list of a plurality of reduced images obtained by reducing the plurality of captured images, respectively; and a display processing unit that displays the plurality of reduced images arranged at positions determined by the image processing unit in the list display area; A program to function as a

Citation Information

Patent Citations

  • Multi-image display device and multi-image display method

    JP2008236293A

  • Image display apparatus, image display method, program and recording medium

    JP2009192737A

  • Image processor

    JP2009246887A

  • Display controller and program

    JP2011035485A

  • Image processing device, method and program

    JP2011108253A