Management device and image display system

Abstract

To associate a plurality of captured images captured by a flying object with respective imaging positions on a flight path using no position information by GPS or the like.SOLUTION: A management device 20 for associating N (N is an integer of two or more) captured images captured by a flying object with respective imaging positions on a flight path includes a reception unit 211, a setting unit 212, a management unit 213, and a display control unit 214. The receiving unit 211 receives a user instruction. When receiving a start point and an end point of the flight path of the flying object and N captured images captured during a flight from the start point to the end point, the setting unit 212 divides the flight path at equal intervals to set N imaging positions. The management unit 213 associates the N captured images with the N imaging positions on a one-to-one basis. When the receiving unit 211 receives designation of one imaging position among the N imaging positions, the display control unit 214 causes a display device to display one captured image corresponding to the imaging position.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a management device and an image display system. [Background technology]

[0002] In recent years, flying objects such as drones and hovering cameras have been used for a variety of purposes. Patent Document 1 discloses a technology for capturing images of an inspection target such as a bridge using a hovering camera that automatically flies along a flight path indicated by flight information set using position information from a GPS (Global Positioning System or Global Positioning Satellite). In the technology disclosed in Patent Document 1, the flight information is set so that the positions at which the inspection target is captured are equidistant. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-073574 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, in an environment where GPS cannot be used, such as indoors (hereinafter referred to as a non-GPS environment), it is not possible to set the imaging position in advance using location information. In a non-GPS environment, after capturing images using an aircraft, it is necessary to associate each of the captured images with the respective imaging positions on the flight path, but this association is difficult. [Means for solving the problem]

[0005] A management device according to a preferred aspect of the present disclosure includes a reception unit, a setting unit, a management unit, and a display control unit. The reception unit receives user instructions. When the reception unit receives a start point and an end point of a flight path of an aircraft having an imaging function and N (N is an integer greater than or equal to 2) captured images captured by the aircraft while flying from the start point to the end point, the setting unit divides the flight path at equal intervals and sets N imaging positions. The management unit associates the N captured images with the N imaging positions one-to-one. When the reception unit receives designation of one imaging position of the N imaging positions, the display control unit displays one of the N captured images corresponding to the one imaging position on a display device.

[0006] An image display system according to a preferred aspect of the present disclosure includes a user device including a display device and a management device. The user device accepts user instructions and transmits instruction information representing the accepted instructions to the management device. The management device includes a reception unit, a setting unit, a management unit, and a display control unit. The reception unit accepts the instruction information transmitted from the user device. When the reception unit accepts first instruction information indicating a start point and an end point of a flight path of an aircraft having an imaging function and second instruction information indicating N (N is an integer equal to or greater than 2) captured images taken by the aircraft while flying from the start point to the end point, the setting unit divides the flight path at equal intervals and sets N imaging positions. The management unit associates the N captured images with the N imaging positions one-to-one. When the reception unit accepts designation of one of the N imaging positions, the display control unit causes the display device to display one of the N captured images corresponding to the one imaging position. [Effects of the Invention]

[0007] According to the present disclosure, N captured images taken sequentially by an aircraft flying along a flight path can be associated with N image capturing positions spaced at equal intervals along the flight path without using location information from GPS or the like, thereby enabling the display of corresponding captured images for each image capturing position even in a non-GPS environment. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example configuration of an image display system 1 according to an embodiment of the present disclosure. [Figure 2] 1 is a block diagram showing an example of the configuration of a user device 10 included in an image display system 1. FIG. [Figure 3] 2 is a block diagram showing an example of the configuration of a management device 20 included in the image display system 1. FIG. [Figure 4] 10 is a diagram showing an example of a setting support screen G displayed on the display device 130 of the user device 10. FIG. [Figure 5] 10 is a diagram showing an example of a flight path specified for a first image G1 included in a setting support screen G. FIG. [Figure 6] 10 is a diagram showing an example of an imaging position set by the management device 20. FIG. [Figure 7] FIG. 10 is a diagram showing an example of an imaging position that is reset by the management device 20 in response to movement of the start point or end point of the flight path. [Figure 8] 10 is a flowchart showing the flow of a display control method executed by the processing device 210 of the management device 20 in accordance with the program PB. [Figure 9] FIG. 10 is a diagram for explaining a modified example (2). DETAILED DESCRIPTION OF THE INVENTION

[0009] (A: Embodiment) FIG. 1 is a diagram illustrating an example configuration of an image display system 1 according to an embodiment of the present disclosure. The image display system 1 is an information system for associating each of a plurality of captured images captured by a drone 30 equipped with an imaging function with each imaging position on the flight path of the drone 30. In addition to the image display system 1, FIG. 1 also illustrates the drone 30 and an operation terminal 40 for operating the drone 30. As shown in FIG. 1, the image display system 1 includes a user device 10 and a management device 20. As shown in FIG. 1, the user device 10 and the management device 20 are connected to a communication network NW such as the Internet.

[0010] The operation terminal 40 communicates wirelessly with the drone 30. The drone 30 flies under the control of the operation terminal 40. In this embodiment, the user of the drone 30 operates the operation terminal 40 to fly the drone 30 at a constant speed along a predetermined flight path. The drone 30 flies in accordance with this operation. The drone 30 captures images using its imaging function every time a predetermined time elapses from the start of flight to the end of flight, and acquires M (M is an integer equal to or greater than 2) captured images.

[0011] A recording medium such as a memory card is detachably attached to the drone 30. The drone 30 associates captured image data representing each of the M captured images with sequence information indicating the order in which the images were captured, and records the associated captured image data on the recording medium. Specific examples of the sequence information include a character string indicating the time at which the captured image represented by the captured image data associated with the sequence information was captured, or a serial number that is counted up each time an image is captured. After completing a flight, the user of the drone 30 removes the recording medium from the drone 30. The user of the drone 30 uses the user device 10 to upload captured image data representing the images captured by the drone 30 to the management device 20. In this embodiment, the user device 10 is a device separate from the operation terminal 40, but the user device 10 may also function as the operation terminal 40.

[0012] The user device 10 is, for example, a smartphone. Fig. 2 is a block diagram showing an example configuration of the user device 10. As shown in Fig. 1, the user device 10 includes a processing device 110, a communication device 120, a display device 130, an input device 140, and a storage device 150.

[0013] The processing device 110 includes one or more central processing units (CPUs). A CPU is an example of a computer. The processing device 110 functions as a control center of the user device 10 by executing a program PA stored in the storage device 150.

[0014] The communication device 120 is wirelessly connected to the communication network NW. In this embodiment, the communication device 120 is wirelessly connected to the communication network NW, but may also be wired connected to the communication network NW. The communication device 120 is hardware (transmission / reception device) for communicating with the management device 20 via the communication network NW. The communication device 120 is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 120 receives data transmitted from the management device 20 via the communication network NW. The communication device 120 provides the data received via the communication network NW to the processing device 110. The communication device 120 also transmits the data provided from the processing device 110 to the management device 20 via the communication network NW.

[0015] The display device 130 displays various images under the control of the processing device 110. A specific example of the display device 130 is a liquid crystal display. The input device 140 accepts user operations and provides data indicating the operations to the processing device 110. A specific example of the input device 140 is a touch panel (for example, a transparent sheet-like pressure sensor) laminated on the display surface of the display device 130. The input device 140 may include multiple types of operation keys in addition to the touch panel, or may be composed of only multiple types of operation keys without including a touch panel.

[0016] The storage device 150 is a recording medium readable by the processing device 110. The storage device 150 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). The nonvolatile memory included in the storage device 150 stores a program PA in advance. The volatile memory included in the storage device 150 is used by the processing device 110 as a work area when executing the program PA.

[0017] When an instruction to execute program PA is given by operating input device 140, processing device 110 reads program PA from non-volatile memory to volatile memory. Then, processing device 110 starts executing program PA read into volatile memory. Processing device 110, operating in accordance with program PA, displays various images on display device 130 under the control of management device 20. Furthermore, processing device 110, operating in accordance with program PA, transmits instruction information indicating the instruction input to input device 140 to management device 20 via communication network NW.

[0018] The recording medium removed from the drone 30 is attached to the user device 10. The processing device 210, operating in accordance with the program PA, reads out M sets of captured image data and sequence information recorded on the recording medium attached to the user device 10, and uploads the read M sets of captured image data and sequence information to the management device 20.

[0019] The management device 20 is a server device that provides a service of associating each of a plurality of captured images taken by the drone 30 with each imaging position on the flight path of the drone 30. FIG. 3 is a block diagram showing an example configuration of the management device 20. As shown in FIG. 3, the management device 20 includes a processing device 210, a communication device 220, and a storage device 250.

[0020] The processing device 210 includes one or more central processing units (CPUs), similar to the processing device 110. The processing device 210 functions as the control center of the management device 20 by executing a program PB stored in the storage device 250.

[0021] The communication device 220 is a transmitting / receiving device similar to the communication device 120. In this embodiment, the communication device 220 is connected to the communication network NW by wire, but may also be connected to the communication network NW wirelessly. The communication device 220 receives data transmitted from the user device 10 via the communication network NW. The communication device 220 provides the data received via the communication network NW to the processing device 210. In addition, the communication device 220 transmits the data provided from the processing device 210 to the user device 10 via the communication network NW.

[0022] The storage device 250 is a recording medium readable by the processing device 210. Like the storage device 150, the storage device 250 includes a nonvolatile memory and a volatile memory. The nonvolatile memory included in the storage device 250 stores a program PB in advance. The volatile memory included in the storage device 250 is used by the processing device 210 as a work area when executing the program PB. Furthermore, the volatile memory included in the storage device 250 stores M sets of captured image data and sequence information uploaded from the user device 10.

[0023] When the processing device 210 receives M sets of captured image data and sequence information uploaded from the user device 10, it reads the program PB from the non-volatile memory to the volatile memory. The processing device 210 then starts executing the program PB read into the volatile memory. The processing device 210, operating in accordance with the program PB, functions as the reception unit 211, setting unit 212, management unit 213, display control unit 214, and resetting unit 215 shown in FIG. 3. In other words, the reception unit 211, setting unit 212, management unit 213, display control unit 214, and resetting unit 215 shown in FIG. 3 are software modules realized by operating a computer in accordance with the software. The functions of the reception unit 211, setting unit 212, management unit 213, display control unit 214, and resetting unit 215 are as follows:

[0024] The display control unit 214 generates image data representing a setting support screen for allowing the user to specify the start point and end point of the flight path of the drone 30 and the N captured images captured between the start point and the end point, and transmits the image data to the user device 10. The processing device 110 of the user device 10 causes the display device 130 to display the setting support screen in accordance with the image data.

[0025] FIG. 4 is a diagram showing an example of the setting support screen G. As shown in FIG. 4, a first image G1 and a second image G2 are arranged side by side on the setting support screen G. The first image G1 is an image for receiving an operation to specify the start point and the end point of the flight path of the drone 30. The second image G2 is an image for receiving an operation to specify N (N is an integer equal to or greater than 2 and equal to or less than M) captured images captured in the section from the start point to the end point of M captured images captured from the start to the end of the flight of the drone 30. In addition, an association button B1 is arranged on the setting support screen G. The association button B1 is a virtual operator for allowing the user to instruct the user to associate the N captured images with each imaging position on the flight path.

[0026] Specific examples of the first image G1 include a map of the area where the drone 30 flew, a schematic representation of the map, or an aerial photograph of the area. In this embodiment, the first image G1 is an image of a schematic representation of the map of the area where the drone 30 flew. If the flight path of the drone 30 is set along a structure such as a bridge, building, or ship, the first image G1 may be an image of a blueprint of the structure. Specific examples of the second image G2 include thumbnail images in which M captured images uploaded from the user device 10 are arranged in a row in the order in which they were captured. The second image G2 in FIG. 4 is an example where M=6, i.e., thumbnail images of captured images GA1, GA2, GA3, GA4, GA5, and GA6 captured sequentially by the drone 30.

[0027] As shown in FIG. 5, the user specifies the start and end points of the flight path L1 by performing an operation on the input device 140 to draw a line segment corresponding to the flight path L1 of the drone 30 on the first image G1. When the operation to specify the start and end points of the flight path L1 (the operation to draw the line segment corresponding to the flight path L1) is performed on the input device 140, the processing device 110 of the user device 10 transmits first instruction information indicating the positions of the start and end points in the first image G1 to the management device 20. Note that the line segment corresponding to the flight path L1 of the drone 30 may be a straight line segment or a curved line segment. If the line segment corresponding to the flight path of the drone 30 is curved, the first instruction information may include information indicating the curve (e.g., a radius of curvature, etc.). In this embodiment, the start point of the line segment drawn on the first image G1 corresponds to the start point S1 of the flight path L1, and the end point of the line segment corresponds to the end point E1 of the flight path.

[0028] Furthermore, the user performs an input to the input device 140 to specify a captured image corresponding to the start point of the flight path and a captured image corresponding to the end point of the flight path (a captured image captured after the captured image corresponding to the start point) in the second image G2 (i.e., the M captured images displayed as thumbnails). Hereinafter, the captured image corresponding to the start point will be referred to as the first captured image. The first captured image is an example of a first captured image in the present disclosure. Furthermore, the captured image corresponding to the end point will be referred to as the last captured image. The last captured image is an example of a second captured image in the present disclosure. When the first captured image and the last captured image are specified by operating the input device 140, the processing device 110 of the user device 10 transmits second instruction information to the management device 20, the second instruction information being information indicating the first captured image and the last captured image, in other words, information indicating the multiple captured images from the first captured image to the last captured image.

[0029] Furthermore, when the association button B1 is pressed by operating the input device 140, the processing device 110 of the user device 10 transmits third instruction information to the management device 20 instructing the execution of association. After the association is completed, the user can specify an imaging position at which the user wishes to check the captured image by operating the input device 140. When an operation to specify one of the imaging positions is performed on the input device 140, the processing device 110 of the user device 10 transmits fourth instruction information indicating the imaging position specified by the user to the management device 20. After the association is completed, the user can move the start point or end point of the flight path along the flight path by operating the input device 140. When an operation to move the start point or end point of the flight path is performed on the input device 140, the processing device 110 of the user device 10 transmits fifth instruction information indicating the flight path modified by the user to the management device 20.

[0030] The receiving unit 211 receives instruction information transmitted from the user device 10 (first instruction information, second instruction information, third instruction information, fourth instruction information, and fifth instruction information).

[0031] The setting unit 212 sets a plurality of imaging positions at equal intervals along the flight path when the receiving unit 211 receives the first instruction information and the second instruction information. First, when the last captured image indicated by the second instruction information is the Nth captured image (N is an integer of 2 or more and M or less) from the first captured image indicated by the second instruction information, the setting unit 212 receives the N captured images from the first captured image to the last captured image among the M captured images arranged in imaging order as images captured during flight along the flight path.

[0032] Next, the setting unit 212 sets N imaging positions by dividing the flight path L1, whose start point and end point are indicated by the first instruction information, at equal intervals. The first imaging position of the N imaging positions corresponds to the start point. The Nth imaging position of the N imaging positions corresponds to the end point. The setting unit 212 transmits information indicating the position of each of the N imaging positions in the first image G1 to the user device 10, thereby causing the display device 130 to display icons such as circles corresponding to each of the N imaging positions (hereinafter, imaging position icons) superimposed on the first image G1 on the setting support screen G. For example, suppose that the captured image GA2 in FIG. 4 is designated as the first captured image, and the captured image GA5 in FIG. 4 is designated as the last captured image. Since the captured image GA5 is the fourth captured image from the captured image GA2, the setting unit 212 divides the flight path L1 at equal intervals to set four imaging positions. Then, the setting unit 212 causes the display device 130 to display the imaging position icons P1 to P4 superimposed on the first image G1 as shown in FIG.

[0033] When the receiving unit 211 receives the third instruction information, the management unit 213 associates each of the N captured images from the first captured image to the last captured image with each of the N imaging positions one-to-one. Specifically, for each integer n from 1 to N, the management unit 213 associates the nth captured image among the N captured images from the first captured image to the last captured image with the nth imaging position along the flight path. For example, in the example shown in FIG. 6, the management unit 213 associates the captured image GA2 with the imaging position indicated by the imaging position icon P1, the captured image GA3 with the imaging position indicated by the imaging position icon P2, the captured image GA4 with the imaging position indicated by the imaging position icon P3, and the captured image GA5 with the imaging position indicated by the imaging position icon P4. In this way, according to the management device 20 of this embodiment, each of the N captured images captured sequentially along the flight path of the drone 30 is associated with the N imaging positions arranged at equal intervals along the flight path, one by one, without using position information from a GPS or the like.

[0034] When the display control unit 214 receives the fourth instruction information from the receiving unit 211, the display control unit 214 causes the user device 10 to display a captured image corresponding to the imaging position indicated by the fourth instruction information. For example, when the display control unit 214 receives fourth instruction information indicating an imaging position corresponding to the imaging position icon P3, the display control unit 214 transmits a command to the user device 10 instructing the display of the captured image GA4. The processing device 110 of the user device 10 causes the display device 130 to display the captured image GA4 in accordance with the command. According to the management device 20 of this embodiment, the user can display a captured image corresponding to each imaging position.

[0035] When the fifth setting information is received by the receiving unit 211, the resetter 215 resets N imaging positions at equal intervals along the corrected flight path indicated by the fifth setting information. For example, when an operation is performed to move the end point E1 along the flight path L1 in a direction approaching the start point S1 so as to shorten the flight path L1, the resetter 215 resets four imaging positions on the flight path as shown in Fig. 7. According to the management device 20 of this embodiment, the user can reset the N imaging positions by moving at least one of the start point and the end point.

[0036] Furthermore, the processing device 210, operating in accordance with the program PA, causes the display device 130 of the user device 10 to display the setting support screen G, and then executes the display control method of the present disclosure. Fig. 8 is a flowchart showing the flow of this display control method. As shown in Fig. 8, this display control method includes the processes of steps SA100 to SA170.

[0037] In step SA100, the processing device 210 functions as the reception unit 211. In step SA100, the processing device 210 receives instruction information transmitted from the user device .

[0038] In step SA110, the processing device 210 determines whether the first instruction information and the second instruction information have been received in step SA100. If the determination result in step SA110 is "Yes", the processing device 210 executes the process of step SA120. If the determination result in step SA110 is "No", the processing device 210 executes the process of step SA130.

[0039] In step SA120, the processing device 210 functions as the setting unit 212. In step SA120, the processing device 210 sets N imaging positions at equal intervals along the flight path based on the first instruction information and the second instruction information. After executing step SA120, the processing device 210 executes the process of step SA100 again.

[0040] In step SA130, the processing device 210 determines whether the instruction information received in step SA100 is third instruction information. If the determination result in step SA130 is "Yes", the processing device 210 executes the process of step SA140. If the determination result in step SA130 is "No", the processing device 210 executes the process of step SA150.

[0041] In step SA140, the processing device 210 functions as the management unit 213. In step SA140, the processing device 210 associates each of the N captured images from the first captured image to the last captured image with each of the N imaging positions in a one-to-one relationship. After executing step SA140, the processing device 210 executes the process of step SA100 again.

[0042] In step SA150, the processing device 210 determines whether the instruction information received in step SA100 is the fourth instruction information. If the determination result in step SA150 is "Yes," the processing device 210 executes the process of step SA160. If the determination result in step SA150 is "No," that is, if the instruction information received in step SA100 is the fifth instruction information, the processing device 210 executes the process of step SA170.

[0043] In step SA160, the processing device 210 functions as the display control unit 214. In step SA160, the processing device 210 causes the display device 130 to display the captured image corresponding to the imaging position indicated by the fourth instruction information. After executing step SA160, the processing device 210 executes the process of step SA100 again.

[0044] In step SA170, the processing device 210 functions as the resetting unit 215. In step SA170, the processing device 210 resets N imaging positions at equal intervals along the corrected flight path indicated by the fifth instruction information. After executing step SA170, the processing device 210 executes the process of step SA100 again.

[0045] According to the image display system 1 of this embodiment, the user can specify the start point S1 and the end point E1 of the flight path L1 by operating the first image G1 on the setting support screen G. Furthermore, the user can specify N captured images taken during flight along the flight path L1 by operating the second image G2 on the setting support screen G. Then, according to the image display system 1 of the present disclosure, the user can associate the N captured images taken sequentially along the flight path L1 with N imaging positions arranged at equal intervals on the flight path L1 by pressing the association button B1 on the setting support screen G, and can display the corresponding captured images for each imaging position.

[0046] It should be noted that in this embodiment, position information such as GPS is not required to associate N captured images sequentially taken along flight path L1 with N imaging positions spaced at equal intervals on flight path L1. That is, according to the image display system 1 of this embodiment, even in a non-GPS environment, N captured images sequentially taken by the drone 30 flying along flight path L1 can be associated with N imaging positions spaced at equal intervals on flight path L1. Furthermore, according to the image display system 1 of this embodiment, the user can reset the N imaging positions by moving at least one of the start point S1 and the end point E1.

[0047] (B: Modified Example) The present disclosure is not limited to the above-described exemplary embodiments. Specific modified aspects are as follows. Two or more aspects selected arbitrarily from the following examples may be combined. (B-1: Variation 1) The flight of the drone 30 may be automatic flight in which the drone 30 flies at a constant speed along a straight line or a curve at a constant altitude for a certain period of time. In addition, if resetting of the imaging position is not necessary, the resetting unit 215 may be omitted.

[0048] (B-2: Variation 2) 9, a start point S2 of a flight path L2 extending in a different direction from flight path L1 may be set near end point E1 of flight path L1, and multiple captured images may also be associated with flight path L2. Flight path L1 is an example of a first flight path in the present disclosure, and flight path L2 is an example of a second flight path in the present disclosure.

[0049] (B-3: Variation 3) The drone 30 may have a location information acquisition function using GPS or the like. If the drone 30 has the location information acquisition function and can acquire location information indicating the imaging position of the captured image using the location information acquisition function, the drone 30 may write the location information to a recording medium in association with the captured image data. If location information is associated with the captured image data corresponding to the imaging position indicated by the fourth instruction information, the management device 20 may display the location information on the display device 130 together with the captured image represented by the captured image data.

[0050] (B-4: Variation 4) The drone 30 may have a communication function for wireless communication with the user device 10 or the management device 20. If the drone 30 has the communication function, the drone 30 may transmit captured image data to the user device 10 or the management device 20 via the communication function each time it captures an image. In this embodiment, the order in which the captured image data is received indicates the order in which the images were captured, so sequence information is not necessary.

[0051] (B-5: Variation 5) In the above embodiment, the program PB is stored in the storage device 250 of the management device 20, but the program PB may also be manufactured or sold separately. When selling the program PB, the program PB may be provided to the purchaser by writing it to a computer-readable recording medium such as a flash ROM and distributing it, or by downloading it via a telecommunications line. Similarly, the program PA may also be manufactured or sold separately.

[0052] (B-6: Variation 6) In the above embodiment, the reception unit 211, the setting unit 212, the management unit 213, the display control unit 214, and the resetting unit 215 are software modules. However, any one, more than one, or all of the reception unit 211, the setting unit 212, the management unit 213, the display control unit 214, and the resetting unit 215 may be hardware modules. Specific examples of hardware modules include a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array).

[0053] (C:Other) (1) In the above-described embodiment, ROM and RAM are given as specific examples of the storage device 150 and the storage device 250. However, the storage device 150 and the storage device 250 may be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or other suitable storage medium. Furthermore, the program may be transmitted from a network via a telecommunications line. Furthermore, the program may be transmitted from a communication network via a telecommunications line.

[0054] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0055] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0056] (4) In the above-described embodiment, the determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a comparison of numerical values ​​(e.g., comparison with a predetermined value).

[0057] (5) The order of the process procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0058] (6) There is no particular limitation on the method of realizing each functional block illustrated in Fig. 4. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are connected directly or indirectly (for example, by wire, wirelessly, etc.) and these multiple devices. The functional block may be realized by combining the single device or the multiple devices with software.

[0059] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., regardless of whether software is called software, firmware, middleware, microcode, hardware description language, or by other names.

[0060] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0061] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0062] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0063] (10) In the above-described embodiments, the user equipment may be a mobile station (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate terminology. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0064] (11) In the above-described embodiments, the terms "connected," "coupled," or any variation thereof refers to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0065] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0066] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0067] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive or.

[0068] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include that the nouns following these articles are plural.

[0069] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0070] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0071] (D: Aspects understood from the above-mentioned embodiments or modifications) Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. The following aspects can be understood from at least one of the above-described embodiments or modifications.

[0072] The management device according to the first aspect of the present disclosure includes a reception unit 211, a setting unit 212, a management unit 213, and a display control unit 214. The reception unit 211 receives instructions from a user. When the reception unit receives a start point and an end point of a flight path of the drone 30 and N (N is an integer equal to or greater than 2) captured images captured by the drone 30 while flying from the start point to the end point, the setting unit 212 divides the flight path at equal intervals and sets N imaging positions. The drone 30 is an example of an aircraft having an imaging function. The management unit 213 associates the N captured images with the N imaging positions on a one-to-one basis. When the reception unit 211 receives a designation of one of the N imaging positions, the display control unit 214 causes the display device 130 of the user device 10 to display one of the N captured images corresponding to one of the imaging positions. The management device of this embodiment can associate N captured images taken sequentially along the flight path with N captured positions spaced equally apart along the flight path without using location information from GPS or the like, and can display the corresponding captured image for each captured position.

[0073] The management device according to the second aspect (an example of the first aspect) of the present disclosure may further include a resetter 215 that, when the receiver 211 receives a correction to move at least one of the start point and the end point along the flight path, resets the N image capture positions at equal intervals along the corrected flight path. The management device of the second aspect can reset the N image capture positions by moving at least one of the start point and the end point.

[0074] The display control unit 214 in the management device according to a third aspect (an example of the first aspect) of the present disclosure may cause the display device 130 to display, side by side, a first image for accepting designation of the start point and end point of the flight path of the drone 30 and a second image for allowing the user to designate N captured images from M (M is an integer equal to or greater than N) captured images taken by the drone 30. According to the management device of the third aspect, the user can designate the start point and end point of the flight path of the drone 30 by operating the first image, and can designate N captured images by operating the second image.

[0075] In a fourth aspect (an example of the third aspect) of the present disclosure, each of the M captured images may be assigned sequence information indicating the sequence in which they were captured. The second image in the fourth aspect may be an image in which each of the M captured images is arranged in the sequence in which they were captured. When a first captured image corresponding to a start point and a second captured image corresponding to an end point are designated by a user, the setting unit 212 in the management device of the fourth aspect may accept the first captured image to the second captured image among the M captured images arranged in the sequence in which they were captured as N captured images. According to the management device of the fourth aspect, the user can designate N captured images by designating the first captured image corresponding to the start point and the second captured image corresponding to the end point.

[0076] According to a fifth aspect of the present disclosure, an image display system includes a management device 20 and a user device 10 including a display device 130. The user device 10 accepts user instructions and transmits instruction information representing the accepted instructions to the management device 20. The management device 20 includes a reception unit 211, a setting unit 212, a management unit 213, and a display control unit 214. The reception unit 211 accepts instruction information transmitted from the user device 10. When the reception unit accepts first instruction information specifying the start point and end point of the flight path of the drone 30 and second instruction information indicating N (N is an integer equal to or greater than 2) captured images taken by the drone 30 while flying from the start point to the end point, the setting unit 212 divides the flight path at equal intervals and sets N imaging positions. The management unit 213 associates the N captured images with the N imaging positions in a one-to-one relationship. When the receiving unit 211 receives a designation of one of the N imaging positions, the display control unit 214 causes one of the N captured images corresponding to the one imaging position to be displayed on the display device 130. The image display system of this aspect can associate the N captured images captured sequentially along the flight path with the N imaging positions arranged at equal intervals on the flight path without using position information from a GPS or the like, and can display the corresponding captured image for each imaging position on the display device 130. [Explanation of symbols]

[0077] 1...image display system, 10...user device, 20...management device, 30...drone, 40...operation terminal, 110, 210...processing device, 211...reception unit, 212...setting unit, 213...management unit, 214...display control unit, 215...resetting unit, 120, 220...communication device, 130...display device, 140...input device, 150, 250...storage device, PA, PB...program.

Claims

1. a reception unit that receives instructions from a user; a setting unit that, when the receiving unit receives a start point and an end point of a flight path of an aircraft having an imaging function and N (N is an integer of 2 or more) captured images captured by the aircraft while flying from the start point to the end point, divides the flight path into equal intervals and sets N imaging positions; a management unit that associates the N captured images with the N imaging positions in one-to-one correspondence; a display control unit that, when the reception unit receives designation of one of the N imaging positions, causes a display device to display one of the N captured images that corresponds to the one imaging position; and A management device comprising:

2. a resetting unit that resets the N imaging positions at equal intervals along the corrected flight path when the receiving unit receives a correction to move at least one of the start point and the end point along the flight path, The management device according to claim 1 .

3. The display control unit causes the display device to display a first image for accepting the designation of the start point and the end point and a second image for allowing the user to designate N captured images from M (M is an integer equal to or greater than N) captured images taken by the flying object during flight, side by side. The management device according to claim 1 .

4. each of the M captured images is assigned sequence information indicating the sequence of capture, the second image is an image in which the M captured images are arranged in the order in which they were captured, when a first captured image corresponding to the start point and a second captured image corresponding to the end point are designated by the user, the setting unit accepts the first captured image to the second captured image among the M captured images arranged in image capturing order as the N captured images.

4. The management device according to claim 3.

5. a management device and a user device including a display device; The user device Accepting a user instruction and transmitting instruction information representing the accepted instruction to the management device; The management device a reception unit that receives instruction information transmitted from the user device; a setting unit that, when the receiving unit receives first instruction information indicating a start point and an end point of a flight path of an aircraft having an imaging function and second instruction information indicating N (N is an integer of 2 or more) captured images captured by the aircraft while flying from the start point to the end point, divides the flight path into equal intervals and sets N image capture positions; a management unit that associates the N captured images with the N imaging positions in one-to-one correspondence; a display control unit that, when the reception unit receives a designation of one of the N imaging positions, causes the display device to display one of the N captured images that corresponds to the one imaging position, Image display system.

Images