Processing device, processing program, processing method, and processing system

Abstract

[Problem] To provide a processing device, a processing program, a processing method, and a processing system that enable more efficient image processing. [Solution] A processing device includes at least one processor that is used for imaging by means of a spacecraft capable of imaging the earth. The at least one processor receives, from a first user terminal device available to a first user, first instruction information for instructing imaging of a first imaging object on the earth, receives, from a second user terminal device available to a second user different from the first user, second instruction information for instructing imaging of a second imaging object on the earth, and determines an imaging schedule for at least either of the first imaging object and the second imaging object on the basis of respective priorities which are set according to at least either of the first user and the second user, respectively, and the first instruction information and the second instruction information, respectively.

Description

Processing device, processing program, processing method, and processing system

[0001] The present disclosure relates to a processing device, a processing program, a processing method, and a processing system used for imaging by a spacecraft.

[0002] Systems for photographing an observation target at a pre-booked imaging time using a spacecraft have been known for some time. For example, Patent Document 1 describes an information processing device including: "a receiving unit that receives a request to acquire observation data based on the results of observing a specified range at a specified time; a specifying unit that specifies, based on orbital information of a plurality of observation satellites, an observation satellite that can observe the specified range after the specified time; and an acquiring unit that acquires the requested observation data, which is the observation data generated by the specified observation satellite and is based on the results of observing the specified range after the specified time."

[0003] International Publication No. 2021 / 192079

[0004] In light of the above-described techniques, the present disclosure aims to provide a processing device, a processing program, a processing method, and a processing system that can process image capture more efficiently in various embodiments.

[0005] According to one aspect of the present disclosure, there is provided a processing device having at least one processor used for imaging by a spacecraft capable of imaging the Earth, wherein the at least one processor is configured to receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user, receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user, and execute processing to determine an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0006] According to one aspect of the present disclosure, there is provided a processing program for causing a computer used for imaging by a spacecraft capable of imaging the Earth to receive first instruction information from a first user terminal device available to a first user for instructing the computer to image a first imaging target on the Earth, receive second instruction information from a second user terminal device available to a second user different from the first user for instructing the computer to image a second imaging target on the Earth, and execute a process for determining an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0007] According to one aspect of the present disclosure, there is provided a processing method executed by at least one processor in a computer used for imaging by a spacecraft capable of imaging the Earth, the processing method including: a step of receiving first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; a step of receiving second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and a step of determining an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0008] According to one aspect of the present disclosure, there is provided a processing system including: a spacecraft configured to be able to image the Earth; and a processing device configured to be able to control imaging by the spacecraft; and the processing system having at least one processor, wherein the at least one processor is configured to receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and execute processing to determine an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0009] According to the present disclosure, it is possible to provide a processing device, a processing program, a processing method, and a processing system that are capable of processing image capture more efficiently.

[0010] It should be noted that the above effects are merely illustrative for the sake of convenience and are not limiting. In addition to or instead of the above effects, any effect described in this disclosure or an effect obvious to a person skilled in the art may be achieved.

[0011] FIG. 1 is a block diagram showing a configuration of a processing system 1 according to an embodiment of the present disclosure. FIG. 2 is a block diagram showing a configuration of a processing device 100 according to an embodiment of the present disclosure. FIG. 3A is a perspective view showing a configuration of a spacecraft 300 according to an embodiment of the present disclosure. FIG. 3B is a block diagram showing a configuration of the spacecraft 300 according to an embodiment of the present disclosure. FIG. 4A is a diagram conceptually showing a combination management table stored in a management device 220 according to an embodiment of the present disclosure. FIG. 4B is a diagram conceptually showing an instruction management table stored in a processing device 100 according to an embodiment of the present disclosure. FIG. 4C is a diagram conceptually showing a user management table stored in a processing device 100 according to an embodiment of the present disclosure. FIG. 5A is a diagram showing a processing sequence executed in a processing system 1 according to an embodiment of the present disclosure. FIG. 5B is a diagram showing a processing sequence executed in a processing system 1 according to an embodiment of the present disclosure. FIG. 5C is a diagram showing a processing sequence executed in a processing system 1 according to an embodiment of the present disclosure. FIG. 6 is a diagram showing a processing flow executed in a processing device 100 according to an embodiment of the present disclosure. FIG. 7A is a diagram showing an example of priority processing executed in a processing device 100 according to an embodiment of the present disclosure. FIG. 7B is a diagram illustrating an example of priority processing executed in the processing device 100 according to an embodiment of the present disclosure. FIG. 7C is a diagram illustrating an example of priority processing executed in the processing device 100 according to an embodiment of the present disclosure. FIG. 7D is a diagram illustrating an example of priority processing executed in the processing device 100 according to an embodiment of the present disclosure. FIG. 8A is a diagram illustrating an example of a screen output in the user terminal device 400 according to an embodiment of the present disclosure. FIG. 8B is a diagram illustrating an example of a screen output in the user terminal device 400 according to an embodiment of the present disclosure. FIG. 8C is a diagram illustrating an example of a screen output in the user terminal device 400 according to an embodiment of the present disclosure. FIG. 9 is a block diagram illustrating a configuration of the processing system 1 according to an embodiment of the present disclosure.

[0012] Various embodiments of the present invention will be described below with reference to the accompanying drawings. Note that common components in the drawings are designated by the same reference numerals. It should also be noted that components depicted in one drawing may be omitted in another drawing for the sake of clarity. It should also be noted that the accompanying drawings are not necessarily drawn to scale.

[0013] The various systems, methods, and devices described herein should not be construed as limiting in any way. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, specific features, or combinations of such aspects with specific features, nor do the products and methods described herein require that one or more particular advantages be present or problems be solved. Furthermore, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

[0014] Although the operations of some of the various methods disclosed herein are described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations unless a particular order is required by specific text below. For example, operations described in a sequence may, in some cases, be rearranged or performed simultaneously. Moreover, for purposes of simplicity, the accompanying drawings do not show the various ways in which the various items and methods described herein can be used in conjunction with other items and methods.

[0015] Any theories of operation, scientific principles, or other theoretical descriptions presented herein in connection with the devices or methods of the present disclosure are provided for the purpose of better understanding and are not intended to limit the scope of the technology, and the devices and methods in the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

[0016] Any of the various methods disclosed herein may be implemented using computer-executable instructions stored on one or more computer-readable media and executed on a computer. The one or more media may be non-transitory computer-readable storage media, such as at least one optical media disk, volatile memory components, or non-volatile memory components. The volatile memory components may include, for example, DRAM or SRAM. The non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). The computer may include any computer available on the market, including, for example, smartphones and other mobile devices with computing hardware.

[0017] Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated or used during the implementation of various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may, for example, be executed on a single local computer (e.g., as a process running on any suitable commercially available computer) or in a networked environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

[0018] For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

[0019] Moreover, any of the various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or remotely accessed by suitable communications means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF communication, microwave communication, infrared communication), electronic communication, or other such communications means.

[0020] In this disclosure, "image data" refers to, for example, data captured by a spacecraft, and "image information" refers to, for example, information generated by processing image data by the image control device 230 so that the image data can be provided to a user terminal device. In other words, the terms "image data" and "image information" are merely terms used to distinguish between the timing of transmission and reception, and image data and image information may be essentially the same or different. Furthermore, image data and image information are not limited to a specific file format and may be in any file format that can be processed by each device. Furthermore, an image identified by image data and image information is not limited to a single still image, but may be in any form, such as a continuous image obtained by capturing multiple still images in succession or a video composed of multiple frames. Furthermore, images identified by image data and image information are typically images generated based on the strength of radio wave reception, but are not limited to this. They may also be color images, black-and-white images, or images detected by a sensor, including infrared images, ultraviolet images, and X-ray images.

[0021] Furthermore, although the present disclosure uses terms such as "first user terminal device 400-1," "second user terminal device 400-2," "first user," "second user," "first spacecraft 300-1," or "second spacecraft 300-2," these are merely names given to distinguish between each user terminal device, each user, and each spacecraft, and are not intended to limit the number or order to a specific number. Furthermore, unless otherwise specifically mentioned, the names prefixed with "first" or "second" may have different meanings or may have the same meaning.

[0022] 1. Overview of Processing System 1 The processing system 1 according to the present disclosure is a system used to determine an imaging schedule by issuing instructions to capture images of an object on Earth by a spacecraft capable of capturing images of the Earth. In particular, the processing system 1 determines the imaging schedule based on priorities set according to the imaging instructions or the user issuing the imaging instructions, in order to prevent overlapping of imaging timings specified by the imaging instructions. In this way, the processing system 1 prevents overlapping imaging instructions and enables efficient imaging.

[0023] 1 is a block diagram showing a configuration of a processing system 1 according to an embodiment of the present disclosure. According to FIG. 1, the processing system 1 includes a processing device 100, user terminal devices 400 including a first user terminal device 400-1 and a second user terminal device 400-2, an image control device 230, a management device 220, ground station communication devices including a first communication device 210-1 and a second communication device 210-2, and spacecraft including a first spacecraft 300-1 and a second spacecraft 300-2. The components are connected to each other so as to be able to communicate with each other via at least one of a wireless and a wired communication network.

[0024] In brief, the user terminal device 400 of the processing system 1 receives user input and generates search request information including at least one of location information of a location including an imaging target and a desired date and time for imaging the target. The user terminal device 400 also generates imaging instruction information by selecting a desired candidate from candidate information including candidate imaging dates and times received from the processing device 100. The processing device 100 generates one or more candidate information in response to the search request information received from the user terminal device 400 and determines imaging schedule information in response to instruction information received from the user terminal device 400. The management device 220 generates imaging instruction information for controlling the spacecraft based on the schedule information generated by the processing device 100 and manages images captured by the spacecraft and users. The image control device 230 processes image data received from the spacecraft and generates image information that can be provided to the user terminal device 400. The ground station communication device relays communications between each device on the ground station and the spacecraft. The spacecraft travels in orbit around the Earth, capturing images of objects including predetermined locations on the ground according to schedule information, and transmitting the captured image data to a ground station.

[0025] 1 is an example of the configuration of the processing system 1, and naturally other components may be added, or components shown in Fig. 1 may be omitted. Also, each component shown in Fig. 1 does not need to execute all of the processes described below, and it is possible to distribute the processes among multiple components.

[0026] 2. Configuration of the Processing Device 100 FIG. 2 is a block diagram showing the configuration of the processing device 100 according to an embodiment of the present disclosure. According to FIG. 2, the processing device 100 includes a processor 111, a memory 112, and a communication interface 113. These components are electrically connected to each other via control lines and data lines. The processing device 100 does not need to include all of the components shown in FIG. 2; some components may be omitted, or other components may be added. For example, an external memory, a database device, a server device, or the like connected in a communicative manner as memory may be used. Furthermore, the processing device 100 is typically configured as a server device installed in the cloud, but may also be any device, such as an on-premise server device, a supercomputer, a mainframe, a personal computer, a smartphone, a tablet, a workstation, or a mobile information terminal. Furthermore, the processing device 100 may execute some processing in a distributed manner with processing devices, including other server devices. In other words, the processing device 100 is not limited to a single device, but may be distributed across multiple devices depending on the information handling and processing load.

[0027] The processor 111 functions as a control unit that controls other components of the processing system 1 based on a processing program stored in the memory 112. The processor 111 executes processes related to providing imaging services based on the processing program stored in the memory 112. In particular, the processor 111 executes the following processes based on the processing program stored in the memory 112: "receiving first instruction information for instructing a first imaging target on Earth from a first user terminal device available to a first user," "receiving second instruction information for instructing a second imaging target on Earth from a second user terminal device available to a second user different from the first user," and "determining an imaging schedule for the first imaging target and the second imaging target based on priorities set according to at least one of the first user, the second user, the first instruction information, and the second instruction information." The processor 111 is primarily composed of one or more CPUs, but may also be combined with a GPU, FPGA, or the like as appropriate.

[0028] The memory 112 is composed of RAM, ROM, non-volatile memory, HDD, SSD, etc., and functions as a storage unit. The memory 112 stores instructions and commands for various control operations of the processing system 1 according to this embodiment as processing programs. Specifically, the memory 112 stores programs executed by the processor 111, such as "receiving first instruction information for instructing the first user to capture an image of a first imaging target on Earth from a first user terminal device available to a first user," "receiving second instruction information for instructing the second user to capture an image of a second imaging target on Earth from a second user terminal device available to a second user different from the first user," and "determining an imaging schedule for the first imaging target and the second imaging target based on priorities set for the first user and the second user, and for at least one of the first instruction information and the second instruction information." In addition to the programs, the memory 112 also stores various information such as a user management table and an instruction management table. Note that this information does not necessarily need to be constantly stored in the memory 112 within the processing device 100; it may be stored in a remote database device. In that case, the database device is also included in the memory 112.

[0029] The communication interface 113 functions as a notification unit for transmitting and receiving various information to and from the user terminal device 400, the management device 220, and the like connected via a wired or wireless network. Examples of the communication interface 113 include a wired communication connector such as USB or SCSI, and a wireless communication transmitting and receiving device such as a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a fixed telephone network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark).

[0030] 3. Configuration of Spacecraft 300 The processing system 1 in Fig. 1 can include at least one spacecraft 300. Although Fig. 1 illustrates a first spacecraft 300-1 and a second spacecraft 300-2, the processing system 1 may include three or more spacecraft 300. Each spacecraft 300 may be, for example, a satellite, but is not limited to this, and may include any moving body capable of navigating in space.

[0031] Fig. 3A is a perspective view showing a configuration of a spacecraft 300 according to an embodiment of the present disclosure. Fig. 3B is a block diagram showing a configuration of the spacecraft 300 according to an embodiment of the present disclosure. Note that Fig. 3A shows an example of the spacecraft 300, but the first spacecraft 300-1 and the second spacecraft 300-2 do not need to have the same configuration, and may have a different configuration from the spacecraft.

[0032] 3A and 3B, the spacecraft 300 may include a communication device 350 that transmits and receives various data to and from a ground station communication device, an imaging device 310 that images the Earth, and a control device 340 that controls the imaging operation of the imaging device 310 and the attitude of the spacecraft 300. The communication device 350, the control device 340, and the imaging device 310 may be electrically connected to each other via control lines and / or data lines.

[0033] (1) Communication Device 350 As shown in Fig. 4, the communication device 350 may include a communication interface 359. The communication interface 359 can receive control information related to the imaging operation of the imaging device 310 transmitted from the ground station communication device and transmit this control information to the imaging device 310. The communication interface 359 can also transmit and / or receive various data to and from the ground station communication device.

[0034] Furthermore, the communication interface 359 can transmit, for example, image data acquired by the control device 340 and space position information regarding the position in space of the spacecraft 300 monitored by the control device 340 to the ground station communication device. The space position information of the spacecraft 300 can be acquired at any time by a sensor 355, which will be described later.

[0035] Furthermore, the communication interface 359 can receive identification data of each communication device (such as the first communication device 210-1 and the second communication device 210-2) included in the ground station communication device and store each identification data in the memory 354 described below. As a result, when the communication interface 359 receives control information from a certain communication device, it can recognize from which of the multiple communication devices the control information was received, based on the identification data of the communication device included in the control information. Furthermore, the identification data of each of the multiple communication devices transmitted from the ground station communication device to the communication interface 359 includes the location data of each communication device. As a result, the communication interface 359 can associate the location data of each of the multiple communication devices with each ID data and store this data in the memory 354. Therefore, when control information is transmitted from a communication device to the spacecraft 300, it is not necessary to include the location data of the communication device in the control information, and it is possible to reduce the volume of the control information (in this case, if the control information includes the ID data of the communication device, the spacecraft 300 can determine the location data of the communication device related to the ID data by referring to memory 354).

[0036] The communication interface 359 uses a communication method corresponding to the S band or the X band, for example, but may of course use other communication methods. The communication interface 359 may be provided with a plurality of communication interfaces depending on the communication partner to be transmitted and received, the communication standard to be used when transmitting and receiving, etc.

[0037] Here, the selection information refers to, for example, storing in the control device 340 (memory 354 of the control device 340) a plurality of imaging modes related to imaging operations of the spacecraft 300 (imaging device 310) that are expected in advance together with encrypted data, thereby making it possible to transmit only this encrypted data from the ground station communication device to the communication interface 359. In this case, when the communication interface 359 transmits the encrypted data received from the ground station communication device to the control device 340, the control device 340 can read out the imaging mode corresponding to this encrypted data from the memory 354 and control the imaging operation of the imaging device 310 in accordance with this imaging mode.

[0038] The aforementioned multiple imaging modes may include, for example, two modes: a wide-angle imaging mode and a high-resolution imaging mode. In this case, the wide-angle imaging mode can be encrypted as "MODE 1," and the high-resolution imaging mode can be encrypted as "MODE 2" ("MODE 1" and "MODE 2" each become encrypted data). Note that the multiple imaging modes are not limited to the wide-angle imaging mode and the high-resolution imaging mode, and may include other modes.

[0039] The location information of the imaging target may be information indicating a point or region on the Earth that is to be imaged, such as data indicating the latitude and longitude corresponding to that point or region. The imaging schedule information may be data indicating the date and time when imaging should be performed (date and time when imaging, observation, etc. by the spacecraft 300 is required).

[0040] The imaging instruction information, which is an example of control information, preferably includes imaging schedule information indicating the time to image the imaging target, position information indicating the position of the imaging target, and selection information. The imaging instruction information may more preferably further include orbital information of the spacecraft 300. Examples of such orbital information include the direction in which the spacecraft 300 moves on its orbit around the Earth at the time the imaging target is imaged, the orbital position of the spacecraft 300 at that time (space position information), the imaging angle of the spacecraft 300 at that time (e.g., the nadir angle), various parameters such as the noise equivalent backscattering coefficient and the output power resolution, and combinations of these. Such orbital information is particularly important as an imaging condition when a synthetic aperture radar is used as the imaging device of the spacecraft 300. For example, information such as "January 11, 2024, 13:00 / Latitude 33.55 degrees North / Longitude 135.55 degrees East / MODE 1 / (FROM 20B TO 10A)" may be transmitted from the ground station communication device to the communication interface 359. In this case, "January 11, 2024, 13:00" corresponds to imaging schedule information, "Latitude 33.55 degrees North / Longitude 135.55 degrees East" corresponds to position information of the imaging target, and "MODE 1" corresponds to selection information. Note that this control information may also include identification data (e.g., "20B") of the communication device 3 that is the sender.

[0041] The transmission and reception of various data between the communication interface 359 and the ground station communication device may be performed using, as an example, a communication method corresponding to the S band or the X band, but is not limited to this and may be performed using various common communication methods.

[0042] (2) Control Device 340 The control device 340 can receive control information (e.g., imaging instruction information) received by the communication interface 359 from the ground station communication device, and can control the imaging operation of the imaging device 310 based on this control information (e.g., imaging instruction information). The control device 340 can also control the attitude of the spacecraft 300 in relation to the imaging operation.

[0043] The control device 340 includes, as hardware, a processor 353, a memory 354, a sensor 355, and the like, which are mutually connected by a data bus and / or a control bus, and is capable of executing various information processes, which will be described later.

[0044] The processor 353, which may be referred to as a CPU, performs various calculations based on the instructions and data stored in the memory 354, thereby generating imaging instruction information regarding the imaging operation of the imaging device 310 and the attitude of the spacecraft 300 related to the imaging operation.

[0045] The memory 354 can store instructions and data received from the communication interface 359, as well as calculation results of the processor 353. Furthermore, the memory 354 can store instructions and data (computer programs) that constitute specific applications (e.g., an application for controlling the imaging operation of the imaging device 310, an application for controlling the attitude of the spacecraft 300, etc.). The memory 354 can include, without limitation, computer-readable media such as RAM, ROM, non-volatile memory, and a hard disk drive (HDD: not shown).

[0046] Furthermore, as described above, the memory 354 can store, together with encrypted data, a plurality of imaging modes related to imaging operations anticipated in advance by the imaging device 310. For example, the memory 354 can store a wide-angle imaging mode together with encrypted data called "MODE 1," and a high-resolution imaging mode together with encrypted data called "MODE 2." Furthermore, the memory 354 can store various data, such as information relating to attitude control of the spacecraft 300 corresponding to each of the wide-area imaging mode and the high-resolution imaging mode (for example, in the wide-area imaging mode, the spacecraft 300 may be subjected to attitude control to maintain the same attitude relative to the ground surface of the imaging target. On the other hand, in the high-resolution imaging mode, the spacecraft 300 may be subjected to attitude control to track the ground surface of the imaging target), information relating to the frequency of the radio waves emitted from the imaging device 310, information relating to the irradiation time of the radio waves emitted from the imaging device 310 (for example, several seconds to several minutes in the wide-area imaging mode, whereas several seconds in the high-resolution imaging mode), information relating to conditions such as modulation and demodulation, information relating to the time required for imaging operation, and the like, as well as calculation methods thereof (computer programs, etc.). This allows the processor 353 to generate various control information relating to the imaging operation of the imaging device 310.

[0047] Furthermore, as described above, the memory 354 can store identification data for each of the plurality of ground station communication devices. For example, the memory 354 can store location information for each of the plurality of ground station communication devices and the ID data for each of the plurality of ground station communication devices in association with each of the location information and the ID data.

[0048] The sensor 355 may include, for example, a gyro sensor, an acceleration sensor, a position sensor, and / or a speed sensor, etc., used to acquire and control various data related to the progress, position and attitude in space, etc. of the spacecraft 300. Furthermore, for example, the sensor may include a temperature sensor, an illuminance sensor, and / or an infrared sensor, etc., for observing the external environment and / or the internal environment of the spacecraft 300. The various sensor data acquired by the sensor 355 may be stored in the memory 354, used for calculation processing by the processor 353, and transmitted to the ground station communication device via the communication interface 359.

[0049] (3) Imaging Device 310 The imaging device 310 receives control information generated by the control device 340 and performs imaging operations. For example, a synthetic aperture radar may be used as the imaging device 310. As shown in FIGS. 3A and 3B , the imaging device 310 includes a transmitter 360, a radiator 357, a reflector 330, and a receiver 361.

[0050] The transmitter 360 transmits a pulse signal of a predetermined frequency based on control information from the control device 340. The pulse signal is converted into a high-frequency radio frequency through processing such as modulation and / or demodulation, amplified, and radiated from the radiator 357 to the reflector 330, and then radiated into the space outside the imaging device 310. The transmitter 360 then receives radio waves reflected from the imaging target (reflected waves) at the receiver 361 via the reflector 330 and the radiator 357. The received image data can be transmitted to the ground station communication device via the aforementioned communication interface 359. The reflected waves received by the receiver 361 can also be transmitted to the ground station communication device via the communication interface 359.

[0051] 3A and 3B , the radiator 357 and the reflector 330 correspond to an antenna. The reflector 330 is disposed to face the radiator 357 at a predetermined angle and includes a secondary reflector (secondary reflecting mirror) 332 for reflecting radio waves radiated from the radiator 357 to a reflector 331 serving as a main reflecting mirror, a reflector 331 disposed to face the mirror surface of the secondary reflector 332 and further reflecting the radio waves reflected by the secondary reflector 332 to radiate the radio waves into the space outside the imaging device 310, and a support member 333 for supporting the secondary reflector 332.

[0052] The reflector 331 includes a plurality of ribs 335 and a planar body 336, and its reflecting surface can be formed in a parabolic shape to function as a main reflecting mirror.

[0053] 4. Ground Station Communication Devices (First Communication Device 210-1 and Second Communication Device 210-2) The processing system 1 may include a ground station communication device consisting of at least one communication device. For example, although two communication devices (first communication device 210-1 and second communication device 210-2) are illustrated in FIG. 1, the processing system 1 may include any number of communication devices.

[0054] Each communication device is a commonly known ground station and may include, for example, a battery (not shown) and a communication interface for transmitting and receiving various data to and from each of the multiple spacecraft 300 and the management device 220.

[0055] This allows each communication device to receive, from each spacecraft 300, captured (acquired) image data or image information generated based on this image data, and space position information regarding the position in space of the spacecraft 300 being monitored by the control device 340, and transmit the received image data (or image information) and space position information to the management device 220. Furthermore, each communication device can receive its own identification data from the management device 220 and transmit (transmit) the received identification data to each of the multiple spacecraft 300.

[0056] Furthermore, by connecting each communication device to the management device 220 via a communication line, each communication device can transmit control information to a specific spacecraft 300 based on the control information received from the management device 220.

[0057] In addition, the communication lines connecting each communication device and the management device 220 may include, but are not limited to, a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a fixed telephone network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark), etc.

[0058] 5. Management Device 220 The management device 220 receives imaging instruction information generated by the processing device 100 from the processing device 100, and can select an appropriate communication device from among the multiple communication devices and an appropriate spacecraft 300 from among the multiple spacecraft 300 in order to perform imaging based on imaging schedule information specified in the imaging instruction information. Such a management device 220 can also be configured in the same manner as the configuration of the processing device 100 illustrated in FIG. 2.

[0059] The management device 220 can be connected to a plurality of communication devices (in FIG. 1, the first communication device 210-1 and the second communication device 210-2) via communication lines. This allows the management device 220 to transmit control information to a predetermined spacecraft 300 for each of the plurality of communication devices (in FIG. 1, the first communication device 210-1 and the second communication device 210-2). In addition, the management device 220 can receive the above-mentioned identification data from each of the plurality of communication devices (in FIG. 1, the first communication device 210-1 and the second communication device 210-2).

[0060] Furthermore, the management device 220 may be connected to the processing device 100 via a communication line. In this case, the communication line may include, but is not limited to, a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a landline network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark), etc.

[0061] This allows the management device 220 to receive imaging instruction information from the processing device 100 requesting imaging of the imaging target.

[0062] The hardware configuration of the management device 220 includes a processor, a memory, and a communication interface.

[0063] The processor, for example, is called a CPU, and can perform various operations based on instructions and data stored in a memory.

[0064] The memory can store instructions and data received via the communication interface, calculation results of the processor, etc. Furthermore, the memory can store instructions and data (computer programs) that constitute specific applications (e.g., an application for determining the spacecraft 300 that will perform an imaging operation, an application for determining a communication device that will transmit control information to the spacecraft 300, an application for controlling the content of control information transmitted from the communication device to the spacecraft 300, an application for controlling transmission and reception of data with the communication device, an application for controlling transmission and reception of data with the communication device, etc.). The memory can include, but is not limited to, computer-readable media such as RAM, ROM, non-volatile memory, and a hard disk drive (HDD; not shown).

[0065] The management device 220 executes a combination determination function under the control of the processor. The combination determination function can determine, from among the multiple spacecraft 300 and the multiple communication devices, a combination of one spacecraft 300 capable of performing an imaging operation for a location identified by the location information of the imaging target at a start timing identified by the imaging schedule information and one communication device that transmits imaging instruction information to the single spacecraft 300 capable of performing the imaging operation, based on the location information of the imaging target included in the imaging instruction information, the space location information of each of the multiple spacecraft 300 previously received via the ground station 2, and the location information (identification data) of each of the multiple communication devices. Note that when multiple spacecraft 300 cooperatively perform imaging of a location corresponding to the imaging target, the combination determination function can also determine a combination of multiple spacecraft 300 capable of performing the imaging operation and multiple communication devices that transmit the above-mentioned control data to each of the multiple spacecraft 300 capable of performing the imaging operation.

[0066] Specifically, the combination determination function can refer to a table obtained by calculating the first time (T1) required from the start of transmission of control information from the communication device to the spacecraft 300 to the completion of transmission, starting from the imaging date and time specified by the imaging schedule information; the second time (T2) required from the time the spacecraft 300 completes reception of the control information until the spacecraft 300 completes the imaging operation (until all reflected waves are received); and the third time (T3) required from the time the imaging operation is completed until the spacecraft 300 completes transmission of image data to the ground station communication device.

[0067] 4A is a diagram conceptually illustrating a combination management table stored in the management device 220 according to an embodiment of the present disclosure. The combination determination function executed by the processor of the management device 220 can select a combination that minimizes the total time of "T1 + T2 + T3" by referring to this table. As an example, in the case shown in FIG. 4A , the combination determination function can determine a combination of the second spacecraft and the second communication device that results in the aforementioned total time of 90 minutes (T1: 30 minutes, T2: 20 minutes, T3: 40 minutes, total time 90 minutes).

[0068] The combination determination function generates position information of the imaging target, information indicating the determined combination of at least one spacecraft 300 and at least one communication device, and information regarding the total time (for example, in the case shown in Figure 4A, information indicating the combination of the second spacecraft and the second communication device, and information indicating the total time of 90 minutes).

[0069] The processor of the management device 220 can determine the content of control information to be transmitted to the communication device based on the information about the combination of one spacecraft 300 and one communication device generated by the combination determination function and the information about the total time. The control information includes the position information of the imaging target and imaging schedule information.

[0070] The processor of the management device 220 can also grasp the situation of the imaging target based on the position information of the imaging target and determine in which imaging mode the imaging device 310 of the spacecraft 300 should perform imaging operation. Based on the result of this determination, the processor can further generate the aforementioned selection information.

[0071] Furthermore, the processor of the management device 220 can transmit the generated control information and request information requesting one spacecraft 300 determined by the combination to transmit the control information to the communication interface. As a result, the communication interface can transmit this control information and request information to one communication device determined by the above-mentioned combination. Note that, as an example, the control information transmitted from the communication interface to the communication device may be "January 11, 2024, 13:00 / 33.55 degrees north latitude / 135.55 degrees east longitude / MODE1 / (FROM 20B TO 10B)."

[0072] 6. Image Control Device 230 The image control device 230 can receive image data acquired by the spacecraft 300 via a communication device. The image control device 230 can also generate image information based on the received image data. The image control device 230 can transmit the image information generated in this manner to the processing device 100.

[0073] Here, a brief description will be given of image data and image information generated based on this image. The spacecraft 300 can acquire image data by capturing an image of a point on Earth. Such image data may include, for example, a plurality of coordinates corresponding to the point, and a depth and time (date and time) associated with each of the coordinates. Such image data may be generated in the form of, for example, a matrix.

[0074] Here, when the spacecraft 300 performs imaging using a synthetic aperture radar, radio waves are emitted from the spacecraft 300 toward the certain point on Earth, and as a result, the spacecraft 300 can receive the radio waves that are reflected from the certain point and travel toward the spacecraft 300. By using the reception strength of such radio waves and the time (date and time) at which such radio waves are received, the spacecraft 300 can generate data including a plurality of coordinates corresponding to the certain point and the depth and time (date and time) associated with each of the coordinates included in the plurality of coordinates.

[0075] On the other hand, image information generated based on image data may be image information that represents, in the form of a map, each coordinate included in the image data and the depth and time corresponding to the coordinate. In such image information, points corresponding to each coordinate may be represented by a shade determined according to the depth corresponding to the coordinate. For example, if the depth corresponding to a certain coordinate is deep (i.e., the point corresponding to the coordinate is at a low position), the point corresponding to the certain coordinate may be represented darker, whereas if the depth corresponding to a certain coordinate is shallow (i.e., the point corresponding to the coordinate is at a high position), the point corresponding to the certain coordinate may be represented lighter.

[0076] 7. User Terminal Device 400 The configuration of the user terminal device 400 includes, for example, a processor functioning as a control unit, a memory functioning as a storage unit, an input interface functioning as an input unit, an output interface functioning as an output unit, and a communication interface functioning as a communication unit. These components are electrically connected to each other via control lines and data lines. Note that the user terminal device 400 does not need to include all of these components; it is possible to omit some of them or add other components. The user terminal device 400 may be any device capable of communicating with the processing device 100 via a wired or wireless network. Examples of the user terminal device 400 include smartphones, tablets, laptop PCs, desktop PCs, scanners, photographing devices, and multifunction peripherals. Note that when there are multiple users as described above, multiple user terminal devices 400 (e.g., a first user terminal device 400-1 and a second user terminal device 400-2) are used for each user, but each user terminal device 400 may be a different type of terminal device. Furthermore, it is not necessarily required that one user terminal device 400 exists for one user; multiple users may use one user terminal device 400, or one user may use multiple user terminal devices 400.

[0077] The processor of the user terminal device 400 receives user input via the input interface and generates position information, time information, imaging mode information, etc. of the imaging target, for example, in order to generate position information, imaging schedule information, etc. of the imaging target. Then, the processor of the user terminal device 400 transmits the generated position information, time information, imaging mode information, etc. to the processing device 100 via the communication interface.

[0078] 8. Various Information Used in Processing in the Processing System 1 Fig. 4B is a diagram conceptually illustrating an instruction management table stored in the processing device 100 according to an embodiment of the present disclosure. According to Fig. 4B, the instruction management table stores user ID information, desired period information, imaging attribute information, candidate information, imaging time information, location information, instruction attribute information, priority information, schedule information, and the like, in association with instruction ID information.

[0079] The “instruction ID information” is, for example, information specific to an image capture instruction by a user and is information for identifying each instruction. The instruction ID information is generated by the processing device 100, for example, every time the processing device 100 receives search request information for new image capture from a user.

[0080] The “user ID information” is, for example, information unique to each user and used to identify each user. The user ID information is generated by the processing device 100 each time a user transmits a request for new registration as a user of the imaging service through a user terminal device.

[0081] The "desired period information" is information indicating a period during which each user desires to capture an image of an imaging target. The desired period information includes, for example, information indicating the start date and time (e.g., "January 10, 2024, 00:00") and end date and time (e.g., "January 16, 2024, 23:59") of the desired period. The desired period information is information extracted from the search request information transmitted from the user terminal device 400.

[0082] The "imaging attribute information" is information indicating the urgency of imaging of the imaging target desired by each user. The imaging attribute information includes, for example, information indicating an emergency and information indicating normal. The information indicating an emergency is generated according to a user's selection when an emergency is required, for example, to check the situation in the area where an event such as an accident, fire, earthquake, flood, heavy rain, or windbreak occurs. In other words, the information indicating an emergency among the imaging attribute information is information indicating the period until the captured image is provided to each user. The imaging target information is information extracted from the search request information transmitted from the user terminal device 400.

[0083] "Location information" is information indicating a point or region on the Earth where each user desires to capture an image. One example of location information is information indicating the latitude and longitude of a point on the Earth, and is information set according to the user's selection. However, information indicating latitude and longitude is merely one example of location information. Examples of location information include latitude and longitude, information indicating landmarks (e.g., Tower A, City Hall B), information indicating the name of a region such as a country, prefecture, city, ward, town, or village (e.g., Fukuoka Prefecture, Fukuoka City, Tenjin), information indicating an address (e.g., the address itself or a postal code), information indicating a telephone number, and combinations thereof, as long as it indicates a location. The location information is information extracted from the search request information transmitted from the user terminal device 400.

[0084] The "candidate information" is information indicating candidates for the date and time when imaging will actually be performed within the desired imaging period specified as the desired period information. The candidate information includes, as an example, at least one piece of information indicating a specific date and time (e.g., "January 11, 2024, 13:00"). The candidate information is information generated by processing of the processing device 100 based on search request information from the user.

[0085] "Imaging time information" is information indicating the time when an image of an imaging target is to be captured. As an example, the imaging time information includes at least one piece of information indicating a specific date and time (for example, "January 11, 2024, 13:00"). The imaging time information is information generated by a user selecting from candidate information.

[0086] The "instruction attribute information" is information for identifying whether the instruction specifies a specific imaging time so that the spacecraft 300 will image the imaging target at a specific time desired by the user when imaging by the spacecraft 300, or whether the instruction specifies multiple times so that the spacecraft 300 will image the imaging target at any time selected from multiple times desired by the user.

[0087] "Priority information" is information indicating a priority for determining which instruction should be given priority when there are overlapping imaging instructions for an imaging target. One example of priority information is a specific numerical value indicating the priority. However, the specific numerical value is merely an example. Examples of priority information include a specific numerical value, a classification (e.g., "high," "medium," or "low"), an arbitrary code (e.g., "X1," "X2," or "X3"), and combinations thereof, as long as it indicates priority. The priority information is information calculated by the processing device 100 based on the user's user attribute information and information related to the imaging instructions.

[0088] The "schedule information" is information indicating the date and time when the spacecraft 300 will capture images of the imaging target. The imaging target information includes, as an example, at least one piece of information indicating a specific date and time (e.g., "January 11, 2024, 13:00"). The imaging target information is information determined by the processing device 100.

[0089] Note that the information stored in such an instruction management table is merely an example, and may naturally include other information. For example, it is possible to include imaging mode information. "Imaging mode information" is information indicating an imaging operation pattern of the spacecraft 300. Examples of imaging mode information include information indicating a wide-area imaging mode and information indicating a high-resolution imaging mode. However, information indicating a wide-area imaging mode and information indicating a high-resolution imaging mode are merely examples. Examples of imaging mode information include information indicating a wide-area imaging mode, information indicating a high-resolution imaging mode, information indicating a continuous shooting mode, information indicating a zoom mode, information indicating a video mode, information indicating a still image mode, and combinations thereof, as long as it indicates an imaging operation. The imaging mode information is information generated by receiving a user operation input on the user terminal device.

[0090] Furthermore, each piece of information stored in the instruction management table is typically stored in the memory 112 of the processing device 100, but may also be stored in other devices such as the management device 220, a server device, or a database device.

[0091] 4C is a diagram conceptually illustrating a user management table stored in the processing device 100 according to an embodiment of the present disclosure. According to FIG. 4C, the user management table stores user name information, classification information, plan information, and the like in association with user ID information.

[0092] The “user ID information” is, for example, information unique to each user and used to identify each user. The user ID information is generated by the processing device 100 each time a user transmits a request for new registration as a user of the imaging service through a user terminal device.

[0093] "Classification information" is information for classifying each user. An example of classification information is information indicating the priority of the user (e.g., "premium," "normal," etc.). However, information indicating priority is merely an example. Examples of classification information include information indicating priority, information indicating the attributes of the user (e.g., government agency, educational institution, private company, etc.), information indicating the frequency or amount of use of a service, information indicating points awarded according to the use of a service, and combinations of these, as long as it is information for classifying users. Classification information is information assigned to each user by the processing device 100.

[0094] "Plan information" is information indicating the plan each user has subscribed to for the imaging service. One example of plan information is information indicating the user's priority (e.g., "premium plan," "normal plan," etc.). Plan information is information selected based on the user's wishes.

[0095] Note that the information stored in such a user management table is merely an example, and may naturally include other information, such as the user's address, contact information, affiliation, etc. Furthermore, each piece of information stored in the user management table is typically stored in memory 112 of processing device 100, but may also be stored in other devices, such as management device 220, a server device, or a database device.

[0096] 9. Processing Sequence Executed in Processing System 1 Figures 5A to 5C are diagrams illustrating processing sequences executed in the processing system 1 according to an embodiment of the present disclosure. Specifically, Figure 5A illustrates a processing sequence executed between the first user terminal device 400-1, the processing device 100, and the management device 220 when an imaging search request is received from a first user terminal device 400-1 available to a first user. Figure 5B illustrates a processing sequence executed between the second user terminal device 400-2, the processing device 100, and the management device 220 when an imaging search request is received from a second user terminal device 400-2 available to a second user but overlaps with an imaging instruction from the first user. Figure 5C illustrates a processing sequence executed between the first user terminal device 400-1, the processing device 100, and the management device 220 when changing the determined imaging schedule information.

[0097] 5A, the processing sequence begins by receiving an input of an imaging search request in the first user terminal device 400-1. Specifically, the processor of the first user terminal device 400-1 receives a user operation input via the input interface on the imaging search screen output via the output interface, and generates first search request information by selecting the user ID information, desired period information, imaging attribute information, and location information of the first user (S11).

[0098] Here, Fig. 8A is a diagram showing an example of a screen output on the user terminal device 400 according to an embodiment of the present disclosure. Specifically, Fig. 8A is a diagram showing an example of an imaging search screen output on the first user terminal device 400-1 in S11 of Fig. 4. According to Fig. 8A, the imaging search screen includes user ID information for identifying the user, as well as map information 11, a location information selection area 13, a desired period selection area 14, an imaging attribute selection area 15, and a search button 16.

[0099] The map information 11 indicates a map displayed at an arbitrary scale according to information such as a region or location desired by the user or the current location of the first user terminal device 400-1. The user can select an imaging target by referring to the map information 11. The map information 11 includes an imaging target mark 12. The imaging target mark 12 indicates the imaging target selected by the user. The imaging target mark 12 is displayed corresponding to the coordinates at which a user's operation input (e.g., a "tap operation on a specific location") to the map information 11 is accepted via the input interface. That is, in FIG. 8A , the imaging target mark 12 is displayed in the upper right area of ​​the map information 11. However, for example, if the user performs an operation input at an arbitrary location in the lower left of the map information 11, the position of the imaging target mark 12 also moves to that location. By referring to the imaging target mark 12, the user can effectively grasp the region or location designated as the imaging target.

[0100] Note that the imaging target mark 12 is merely one example of the currently selected imaging target. For example, various displays other than the imaging target mark 12 can be used for the same purpose, such as a display showing the outline of the area selected as the imaging target, or a display enclosing an area including the area or point selected as the imaging target.

[0101] The location information selection area 13 is an area that displays information indicating the latitude and longitude of a region or point where a user's operation input (e.g., "tap operation on a specific point") to the map information 11 has been accepted via the input interface. That is, in Fig. 8A, the location information selection area 13 displays the latitude and longitude of the point corresponding to the imaging target mark 12 in the upper right area of ​​the map information 11, but if the user moves the position of the imaging target mark 12 to a point in the lower left of the map information 11, for example, the displayed information is changed to the latitude and longitude of that point.

[0102] Note that latitude and longitude are merely an example of location information displayed in location information selection area 13. Various information may be displayed as location information in location information selection area 13, such as latitude and longitude, information indicating landmarks (e.g., Tower A, City Hall B, etc.), information indicating the name of a region such as a country, prefecture, city, ward, town, or village (e.g., Fukuoka Prefecture, Fukuoka City, Tenjin, etc.), information indicating an address (e.g., the address itself or a postal code), information indicating a telephone number, and combinations of these.

[0103] The desired period selection area 14 is an area where information indicating a period during which the user desires to capture an image of the imaging target is displayed, selected by receiving a user's operational input via the input interface. The desired period selection area 14 includes a start date and time selection area for selecting a start date and time and an end date and time selection area for selecting an end date and time, and by receiving a user's operational input via the input interface in each selection area, the specific date and time selected by the user is displayed (for example, "January 10, 2024, 00:00" is displayed in the start date and time selection area, and "January 16, 2024, 23:59" is displayed in the end date and time selection area).

[0104] The imaging attribute selection area 15 is information that displays information indicating imaging attributes selected by receiving a user's operation input via the input interface. Examples of imaging attribute information include information indicating emergency and information indicating normal. As shown in Fig. 8A, the imaging attribute selection area 15 includes a display for turning the emergency mode "on" or "off," and receiving an operation input for the display via the input interface indicates that the information indicating emergency has been selected.

[0105] The search button 16 is a button that becomes operable to receive operation by the user when the input of the location information, desired period information, and imaging attribute information is completed, and by receiving the operation input, the button serves as a trigger for transmitting search request information including the input location information, desired period information, and imaging attribute information to the processing device 100. In other words, by receiving the operation input to the search button 16 via the input interface, the search request information including the above information is transmitted to the processing device 100 via the communication interface.

[0106] 5A , the processor of the first user terminal device 400-1 transmits first search request information (T11) including the user ID information of the first user as well as the location information, desired period information, and imaging attribute information generated in S11 to the processing device 100 via the communication interface. Upon receiving the first search request information via the communication interface 113, the processor 111 of the processing device 100 generates new instruction ID information and stores it in the instruction management table. Furthermore, the processor 111 of the processing device 100 stores the user ID information, location information, desired period information, and imaging attribute information of the one user included in the received search request information in the instruction management table in association with the newly generated instruction ID information (S12).

[0107] Then, the processor 111 of the processing device 100 determines whether or not imaging by the spacecraft 300 is possible under the conditions (location information, desired period information, and imaging attribute information) specified in the received first search request information (S13). Specifically, the processor 111 determines whether or not imaging by the spacecraft 300 is possible by determining whether or not the imaging target specified by the location information during the period specified by the desired period information is included in a range that can be imaged by the spacecraft 300.

[0108] Here, because the spacecraft 300 moves in orbit around the Earth, it can capture images of the target when it is positioned above the target, but it is not always possible to capture images. Therefore, the processing device 100 calculates and stores in advance the orbit of each spacecraft 300 and the range and time during which it is possible to capture images. Therefore, the processor 111 determines whether or not imaging is possible by comparing this pre-stored information with the desired period information and position information. In this way, the processor 111 of the processing device 100 determines whether or not imaging is possible based on the positional relationship between the spacecraft 300 and the target in the processing of S13, and does not make a determination based on priority at this point. This allows the first user to quickly determine whether or not imaging is possible.

[0109] If the processor 111 determines that imaging is not possible, it outputs information indicating that imaging is not possible to the first user terminal device 400-1 that transmitted the search request information via the communication interface 113. On the other hand, if the processor 111 determines that imaging is possible, it executes a process of extracting first candidate information for imaging (S14). Specifically, the processor 111 calculates a period during which imaging of the imaging target identified by the position information is possible from the desired period information and the time it takes for the spacecraft 300 to move above the imaging target. The processor 111 then selects at least one time during which imaging is possible from the period, and generates information indicating the selected time and the range that will actually be imaged at the selected time as first candidate information. The processor 111 associates the generated first candidate information with instruction ID information and stores it in the instruction management table, and transmits the generated first candidate information (T12) via the communication interface 113 to the first user terminal device 400-1 that transmitted the search request information, together with the instruction ID information.

[0110] When the processor of the first user terminal device 400-1 receives the first candidate information via the communication interface, it outputs a candidate display screen displaying the first candidate information via the output interface. Then, the processor of the first user terminal device 400-1 accepts an operation input from the first user via the input interface and generates first instruction information including at least one piece of imaging time information and instruction attribute information selected from the first candidate information (S15).

[0111] Here, imaging by the spacecraft 300 can be classified into two types: imaging in which a specific imaging time is specified by the user so that the spacecraft 300 images the imaging target at a specific time desired by the user (designation type), and imaging in which a plurality of times is specified so that the spacecraft 300 images the imaging target at any time selected from a plurality of times desired by the user (selection type). That is, in the case of designation type imaging, "designation type" is selected as the instruction attribute information, and time designation information indicating the specific time specified is input as the imaging time information. In addition, in the case of selection type imaging, "selection type" is selected as the instruction attribute information, and time candidate information indicating the plurality of times specified and their priorities are input as the imaging time information.

[0112] 8B and 8C are diagrams illustrating examples of screens output on the user terminal device 400 according to an embodiment of the present disclosure. Specifically, Fig. 8B illustrates an example of a candidate display screen when designation-type instruction attribute information is selected by the user, and Fig. 8C illustrates an example of a candidate display screen when selection-type instruction attribute information is selected by the user.

[0113] According to FIG. 8B, the candidate display screen includes user ID information for identifying the user, as well as map information 21, a candidate information selection area 24, an instruction attribute selection area 25, and an instruction button 26.

[0114] The map information 21 includes a map displayed at an arbitrary scale so as to include the area or location specified by the location information selected by the first user as the imaging target. The map information 21 includes an imaging target mark 22 superimposed on the map, corresponding to the location information indicating the area or location selected by the first user as the imaging target. The map information 21 also includes an imaging range display 23 superimposed on the map, indicating the area included in the imaging range when imaging is performed at the date and time of the currently selected candidate information. Here, the spacecraft 300 is a satellite orbiting the Earth, and its direction of movement when passing over the imaging target is not always the same. Therefore, the imaging range included in the angle of view also changes depending on the time of imaging. In other words, the imaging range indicated by the imaging range display 23 displays five candidate information items, Candidate 1 to Candidate 5, as the first candidate information, but the range also changes depending on the selected candidate information. In this way, by superimposing the imaging range display 23 on the map, it is possible to effectively grasp the angle of view captured when each candidate information item is selected.

[0115] The candidate information selection area 24 is an area for the first user to select the candidate information desired from the candidate information included in the received first candidate information. That is, the candidate information selection area 24 displays the candidate date and time for each image capture (e.g., "January 11, 2024, 13:00") and a selection area for selecting the date and time corresponding to each individual piece of candidate information included in the first candidate information ("Candidate 1" to "Candidate 5" in FIG. 8B ). By accepting a first user's operation input for at least one selection area via the input interface, the first user terminal device 400-1 selects the candidate information corresponding to the accepted selection area as the image capture time information. In FIG. 8B , the display correspondence of the selection area corresponding to candidate 1 is displayed differently from the other selection areas, indicating that the candidate information for candidate 1 has been selected. Furthermore, the map information 21 displays an imaging range display 23 indicating the imaging range associated with the candidate information for candidate 1.

[0116] The instruction attribute selection area 25 includes a selection area for the first user to select whether he or she desires designated-type imaging or selection-type imaging. In the first user terminal device 400-1, when the first user's operation input to the designated-type selection area is accepted via the input interface, designated-type imaging is selected and only one piece of candidate information can be selected in the candidate information selection area 24. Note that in FIG. 8B , the display correspondence of the selection area corresponding to the designated type is displayed in a different manner from the selection area corresponding to the selection type, which indicates that the designated type has been selected.

[0117] The instruction button 26 is a button that becomes operable to receive an operation by the user when the selection of imaging time information and instruction attribute information from among the candidate information is completed, and is a button that triggers, by receiving an operation input, transmission of first instruction information including the selected imaging time information and instruction attribute information to the processing device 100. In other words, by receiving an operation input to the instruction button 26 via the input interface, first instruction information including the above information (in the example of FIG. 8B , the date and time corresponding to candidate 1 as imaging time information and information indicating a designated type as instruction attribute information) is transmitted to the processing device 100 via the communication interface.

[0118] Next, referring to FIG. 8C , similar to FIG. 8B , the candidate display screen includes user ID information for identifying the user, as well as map information 21, a candidate information selection area 24, an instruction attribute selection area 25, and an instruction button 26. Therefore, a description of the same points as in FIG. 8B will be omitted. In FIG. 8C , in the instruction attribute selection area 25, the display correspondence of the selection area corresponding to the selection type is displayed differently from that of the selection area corresponding to the designation type, indicating that the selection type is selected. Therefore, multiple pieces of candidate information are selectable in the candidate information selection area 24 as well. Specifically, by accepting an operation input by the first user in the candidate information selection area 24 via the input interface, candidate information corresponding to candidate 1, candidate 3, and candidate 4 is selected as imaging time information. Therefore, by accepting an operation input to the instruction button 26 via the input interface, first instruction information including the dates and times corresponding to candidate 1, candidate 3, and candidate 4 as imaging time information and information indicating the selection type as instruction attribute information is transmitted to the processing device 100 via the communication interface.

[0119] Returning to FIG. 5A , the processor of the first user terminal device 400-1 transmits first instruction information (T13) including the instruction ID information as well as the imaging time information and instruction attribute information generated in S15 to the processing device 100 via the communication interface. Upon receiving the first instruction information via the communication interface 113, the processor 111 of the processing device 100 stores the imaging time information and instruction attribute information included in the first instruction information in the instruction management table in association with the instruction ID information (S16). The processor 111 of the processing device 100 then executes a priority determination process using various information stored in the instruction management table to determine whether imaging is possible at the time specified by the imaging time information (S17). Details of this process will be described with reference to FIG. 6.

[0120] As described above, this example shows a case where there is no other instruction information that overlaps with the first instruction information. Therefore, the processor 111 of the processing device 100 generates imaging schedule information based on the imaging time information specified by the first instruction information, and stores the imaging schedule information in the instruction management table in association with the instruction ID information (S18). The processor 111 reads the imaging schedule information, position information indicating the imaging target, and, in some cases, imaging mode information related to the imaging operation from the instruction management table, and generates imaging instruction information including this information (S19). The processor 111 transmits the generated imaging instruction information (T14) to the management device 220 via the communication interface 113.

[0121] When the management device 220 receives the imaging instruction information, it stores the imaging instruction information in memory (S20). Then, the management device 220 transmits the imaging instruction information as control information to the spacecraft 300 determined similarly via the communication device determined by the combination determination function. Upon receiving the imaging instruction information, the spacecraft 300 performs imaging in the imaging mode specified by the imaging mode information at the time specified by the imaging time information included in the imaging instruction information so as to include the imaging target specified by the position information. This completes the processing sequence.

[0122] (2) Processing sequence when imaging overlaps Next, as described above, Figure 5B shows the processing sequence executed between the second user terminal device 400-2, the processing device 100, and the management device 220 when an imaging search request is received from the second user terminal device 400-2 that is available to the second user but overlaps with an imaging instruction from the first user.

[0123] According to Figure 5B, the processes executed in S31 to S36 are the same as the processes executed in S11 to S16 in Figure 5A except that the second user and the second user terminal device 400-2 are the main subjects of the processes, and therefore a description thereof will be omitted. Note that in Figure 5A etc., each designation affixed with "first" shall be read as "second" as appropriate.

[0124] When the processor 111 of the processing device 100 receives the second instruction information via the communication interface 113, the processor 111 stores the imaging time information and instruction attribute information included in the second instruction information in the instruction management table in association with the instruction ID information, and executes a priority determination process using the various information stored in the table to determine whether imaging is possible at the time specified by the imaging time information (S37). Details of this process will be described with reference to FIG.

[0125] As described above, it is assumed here that the instruction specified by the second instruction information overlaps with the instruction of the first user, and the instruction specified by the second instruction information has a lower priority. Therefore, the processor 111 of the processing device 100 generates imaging impossible information indicating that imaging is impossible based on the result of the priority determination process (S38). The processor 111 transmits the generated imaging impossible information (T34) via the communication interface 113 to the second user terminal device 400-2 that transmitted the second instruction information.

[0126] When the processor of the second user terminal device 400-2 receives the imaging impossible information via the communication interface, it outputs the imaging impossible information received via the output interface (S39). This allows the second user to understand that imaging was not possible, and in some cases, enables the second user to execute processing to set a new imaging instruction. This completes the processing sequence.

[0127] (3) Processing Sequence for Changing Imaging This processing sequence shows a processing sequence for changing imaging schedule information after imaging schedule information is determined by processing such as S19 and S20 in FIG. 5A and transmitted to the spacecraft as imaging instruction information. Therefore, according to FIG. 5C , this processing sequence begins by receiving, in the first user terminal device 400-1, an input of a re-imaging search request indicating a desire to change the imaging schedule. Specifically, the processor of the first user terminal device 400-1 selects imaging schedule information to be changed from a list of determined imaging schedule information output via the output interface. Then, the processor of the first user terminal device 400-1 outputs a re-imaging search screen for the selected imaging schedule information via the output interface, and receives user input via the input interface to select desired period information, imaging attribute information, and location information, thereby generating first re-search request information (S51).

[0128] Although an example of the re-imaging search screen is not particularly shown, it has the same configuration as the imaging search screen shown in FIG. 8A, and various information is input in the same way.

[0129] The processor of the first user terminal device 400-1 transmits first re-search request information (T51) including instruction ID information corresponding to the imaging schedule information selected from the list, and the location information, desired period information, and imaging attribute information generated in S51, to the processing device 100 via the communication interface. When the processor 111 of the processing device 100 receives the first re-search request information via the communication interface 113, it stores the location information, desired period information, and imaging attribute information in the instruction management table in association with the received instruction ID information (S52).

[0130] Then, the processor 111 of the processing device 100 determines whether or not imaging by the spacecraft 300 is possible under the conditions (location information, desired period information, and imaging attribute information) specified in the received first search request information (S53). Specifically, the processor 111 determines whether or not imaging by the spacecraft 300 is possible by determining whether or not the imaging target specified by the location information during the period specified by the desired period information is included in a range that can be imaged by the spacecraft 300.

[0131] If the processor 111 determines that imaging is not possible, it outputs information indicating that imaging is not possible to the first user terminal device 400-1 that transmitted the first re-search request information via the communication interface 113. On the other hand, if the processor 111 determines that imaging is possible, it executes a process of re-extracting first candidate information for imaging (S54). Specifically, the processor 111 calculates a period during which imaging of the imaging target identified by the position information is possible from the desired period information and the time it takes for the spacecraft 300 to move above the imaging target. The processor 111 then selects at least one time during which imaging is possible from the period, and re-generates information indicating the selected time and the range that will actually be imaged at the selected time as first candidate information. The processor 111 associates the generated first candidate information with the instruction ID information and stores it in the instruction management table, and transmits the re-generated first candidate information (T12) via the communication interface 113 to the first user terminal device 400-1 that transmitted the search request information, together with the instruction ID information.

[0132] The subsequent processes from the process relating to generation of first instruction information (S55) to the process of transmitting imaging instruction information to the spacecraft (S60) are the same as S15 to S20 in FIG. 5A, and therefore description thereof will be omitted.

[0133] The management device 220 transmits the imaging instruction information as control information to the spacecraft 300 to which the original imaging schedule information has been assigned via the communication device. The spacecraft 300 then determines whether imaging is possible or not based on the time and range included in the received changeability information.

[0134] Here, since the spacecraft 300 orbits the Earth, it is usually difficult to communicate with the spacecraft 300 on a continuous basis. Therefore, imaging instruction information is transmitted to the spacecraft 300 before imaging is actually performed (for example, several days before). However, in this case, since continuous communication is not possible as described above, it is difficult to change the imaging schedule information after the imaging instruction information has been transmitted. Therefore, when making such a change, it is desirable to check in advance whether the spacecraft 300 has received change permission information and determine whether to make the change based on that information.

[0135] Therefore, as described above, when the spacecraft 300 receives the imaging instruction information and determines that a change to the imaging specified in the imaging instruction information is possible, it generates determination information indicating that the change is possible and transmits it to the management device 220 via the communication device. The spacecraft 300 also changes the imaging schedule in accordance with the imaging instruction information. When the processor of the management device 220 receives the determination information, it transmits the determination information to the processing device 100 via the communication interface as the determination information (S54).

[0136] When the processor 111 of the processing device 100 receives the determination information via the communication interface 113, it determines whether or not to confirm the change to the imaging schedule (S61). For example, if the determination information indicates that the imaging schedule information cannot be changed, the processor 111 generates, as the determination result information, change-prohibited information indicating that the imaging schedule information cannot be changed. Furthermore, if the determination information indicates that the imaging schedule has been changed, the processor 111 generates, as the determination result information, change-permitted information indicating that the imaging schedule change is permitted. The processor 111 then transmits any of the generated determination result information (T56) to the first user terminal device 400-1 via the communication interface 113. The first user terminal device 400-1 outputs the received determination result information via the output interface. This allows the first user to understand whether or not the imaging schedule information can be changed. This completes the processing flow.

[0137] 5C has been described for the case where imaging schedule information is changed, the same applies to the case where imaging specified by the imaging schedule information is canceled. That is, when an imaging cancellation request is sent to the processing device 100 in an imaging re-search request, the processes of S52 to S59 are omitted, and imaging instruction information indicating the imaging cancellation is sent to the spacecraft 300 via the management device 220. The spacecraft 300 then generates determination information depending on whether cancellation is still possible.

[0138] In this way, for the spacecraft 300 with which it is difficult to communicate constantly, changes and cancellations of imaging schedule information that has already been registered as imaging instruction information are processed after inquiring the spacecraft 300 in advance, which makes it possible to more reliably execute changes and cancellations.

[0139] 10. Processing Flow Executed by Processing Device 100 Fig. 6 is a diagram showing a processing flow executed by the processing device 100 according to an embodiment of the present disclosure. Specifically, Fig. 6 is a diagram showing a processing flow executed in S16 to S19 of Fig. 5A or S36 to S38 of Fig. 5B. This processing flow is mainly performed by the processor 111 of the processing device 100 reading and executing a program stored in the memory 112.

[0140] 6, this processing flow is initiated by receiving instruction information (e.g., second instruction information) from a user terminal device 400 (e.g., a second user terminal device 400-2). That is, upon receiving the instruction information via the communication interface 113, the processor 111 stores the imaging time information and instruction attribute information included in the instruction information in the instruction management table in association with the instruction ID information (S111). The processor 111 references the instruction management table and reads out various pieces of information associated with the instruction ID information included in the instruction information, which are used to calculate the priority (S112). Examples of such information include the following: User attribute information including at least one of classification information and plan information stored in the user management table. Imaging attribute information stored in the instruction management table indicating the urgency of imaging (i.e., the time until captured image information is provided to the user). Instruction attribute information indicating whether the instruction specifies a specific imaging time so that the spacecraft 300 captures an image of the imaging target at a specific time desired by the user in imaging by the spacecraft 300 (i.e., a specification-type instruction), or whether the instruction specifies multiple times so that the spacecraft 300 captures an image of the imaging target at any time selected from multiple times desired by the user (i.e., a selection-type instruction). Frequency information indicating the frequency with which imaging was not possible due to priority (not shown in FIG. 4B ).

[0141] When the processor 111 reads out the various types of information, it calculates a priority score as priority information (S113). Specifically, the processor 111 calculates the priority score by adding the following points-adding elements based on the various types of information that have been read out. For example, if the classification information is "Premium", the plan information is "Premium Plan", and the imaging attribute information is "Emergency", the processor 111 calculates a priority score of "16". - If the classification information in the user attribute information is "Premium", the processor 111 calculates "+3" and if it is "Normal", the processor 111 calculates "+1". - If the plan information in the user attribute information is "Premium Plan", the processor 111 calculates "+3" and if it is "Normal Plan", the processor 111 calculates "+10" and "+0", respectively.

[0142] Furthermore, the processor 111 weights the priority score calculated above based on frequency information indicating the frequency with which imaging was not possible due to the priority. Specifically, when "selection type" is selected as the instruction attribute information and imaging is not possible among multiple pieces of imaging time information selected from multiple pieces of candidate information by the priority determination process, the processor 111 weights the priority score based on the frequency (for example, in FIG. 8C , three pieces of imaging time information, candidate 1, candidate 3, and candidate 4, are selected, and if imaging is not possible among these, candidate 1 and candidate 3 by the priority determination process, the frequency is "2") and calculates the weighted priority score. For example, when the frequency is "2" as described above, the processor 111 weights the priority score "16" by a coefficient of 1.5, thereby setting the priority score to "24."

[0143] The processor 111 stores the calculated priority score in association with the instruction ID information as priority information in the instruction management table (S114).

[0144] The processor 111 reads the shooting time information included in the instruction information (e.g., the second instruction information) stored in S111 and other shooting schedule information already stored in association with other instruction ID information (e.g., other shooting schedule information including the shooting schedule information associated with the instruction ID information of the first instruction information), and determines whether there is other shooting schedule information that overlaps with the shooting time information (S115). If there is no overlapping shooting schedule information, the processor 111 determines shooting schedule information from the shooting time information included in the instruction information (e.g., the second instruction information) (S118). The processor 111 stores the determined shooting schedule information in the instruction management table in association with the instruction ID information, and proceeds to processing related to generation of shooting instruction information shown in S19 of FIG. 5A.

[0145] On the other hand, if there is other imaging schedule information that overlaps with the imaging time information, the processor 111 reads out the priority information associated with the instruction ID information of the instruction information (e.g., the second instruction information) and the priority information associated with the other overlapping imaging schedule information, and compares the priority scores. If the priority score associated with the instruction ID information of the instruction information (e.g., the second instruction information) is higher, the processor 111 determines the imaging schedule information from the imaging time information included in the instruction information (e.g., the second instruction information) (S118). At this time, for the other imaging schedule information with a lower priority score, the processor 111 generates imaging failure information indicating that imaging has been canceled due to the overlap and imaging is not possible, and transmits the imaging failure information to the user terminal device 400 of the user based on the user ID information associated with the other imaging schedule information. This allows the user to quickly understand that imaging has been canceled and imaging is not possible.

[0146] On the other hand, if the priority score associated with the instruction ID information of the instruction information (for example, the second instruction information) is lower, the processor 111 generates imaging impossible information (S117). Then, the processing flow ends.

[0147] In this way, by determining how to handle overlapping imaging in accordance with priority information, it is possible to more quickly and efficiently determine the instructions to be the subject of imaging.

[0148] In the example of Fig. 6, various coefficients are used as the priority score, but it is not necessary to use all of these coefficients. It is also possible to use coefficients other than those used in Fig. 6. For example, if the imaging attribute information is "urgent," it can be given top priority regardless of other information. Regarding the frequency used as a weighting coefficient, the weighting coefficient according to frequency may be other than the above, and weighting may be performed by any method other than multiplication, such as addition, subtraction, or division.

[0149] 6 illustrates a case where processing such as calculating the priority score is performed when instruction information is received, but these processes may be performed each time the information in either the instruction management table or the user management table is updated, which makes it possible to always process based on the latest priority information.

[0150] Here, when the priority is determined as described above, instruction information to be captured may further be selected based on instruction attribute information for the image capture. Figures 7A to 7D are diagrams illustrating an example of priority processing executed by the processing device 100 according to an embodiment of the present disclosure. That is, Figures 7A to 7C are diagrams for explaining the newly received instruction (i.e., instruction attribute information included in the instruction information received in S111 of Figure 6) by categorizing it into types depending on whether the instruction attribute information associated with the other overlapping instruction is of the designation type or the selection type.

[0151] (1) Case where a newly received instruction of designation type A overlaps with an imaging schedule of another instruction of designation type B Fig. 7A shows processing when a newly received instruction of designation type A overlaps with an imaging schedule of another instruction of designation type B. Fig. 7A shows that the imaging time information (designation type A) included in the instruction information received in S111 of Fig. 6 indicates that the instruction attribute information is of the designation type. Also, the imaging schedule information (designation type B) already stored in the instruction management table indicates that the instruction attribute information associated therewith is of the designation type. That is, this shows a case where the imaging time information of designation type A overlaps with the imaging schedule information of designation type B.

[0152] In this case, as shown in Fig. 7A(a), if the priority score corresponding to imaging of designation type A is compared with the priority score corresponding to imaging of designation type B, and the priority score of imaging of designation type A is lower, the processor 111 generates imaging disable information for imaging of designation type A. On the other hand, as shown in Fig. 7A(b), if the priority score of designation type A is higher, the processor 111 sets imaging of designation type A instead of imaging of designation type B in the imaging schedule information, and generates imaging disable information for imaging of designation type B. In other words, in the latter case, imaging of designation type B is canceled before the imaging is actually performed, even though it was previously determined in the imaging schedule information. In this way, imaging is canceled in advance before the imaging is actually performed, and the user can receive imaging disable information, which enables the user to grasp the situation more quickly.

[0153] (2) When a newly received instruction of designation type A overlaps with an imaging schedule of another instruction of selection type B1 Fig. 7B shows processing when a newly received instruction of designation type A overlaps with an imaging schedule of another instruction of selection type B1. According to Fig. 7B, the imaging time information (designation type A) included in the instruction information received in S111 of Fig. 6 indicates that the instruction attribute information is of designation type. Furthermore, the imaging schedule information (selection type B1) already stored in the instruction management table indicates that the instruction attribute information associated therewith is of selection type. In other words, a case is shown in which the imaging time information of designation type A overlaps with the imaging schedule information of selection type B1.

[0154] In this case, as shown in FIG. 7B(a), if the priority score corresponding to the imaging of the designation type A is compared with the priority score corresponding to the imaging of the selection type B1, and if the priority score of the designation type A is lower, the processor 111 generates imaging disable information for the imaging of the designation type A. On the other hand, as shown in FIG. 7B(b), if the priority score of the designation type A is higher, the processor 111 sets the imaging of the designation type A instead of the imaging of the selection type B1 in the imaging schedule information and cancels the imaging of the selection type B1. Here, as described in FIG. 8C, for example, in the case of the selection type, multiple imaging time information (imaging time information corresponding to candidate 1, candidate 3, and candidate 4 in the case of FIG. 8C) is transmitted as instruction information, and the processor 111 determines the imaging schedule information by selecting the earliest one from among them. Therefore, with regard to the imaging of the canceled selection type B1, the processor 111 refers to imaging time information other than the imaging time information of the selection type B1 and changes the imaging schedule information to imaging time information (e.g., selection type B2) that does not overlap with any of the other imaging time information.

[0155] At this time, the processor 111 assigns "1" as frequency information due to the cancellation of the imaging of selection type B1, and weights the priority score with this frequency information when determining the changed imaging schedule information. Furthermore, although not specifically illustrated in FIG. 7B(b), if the imaging time information of selection type B2 overlaps with other imaging schedule information and has a low priority score, the processor 111 determines the imaging schedule information using the imaging time information of selection type B3 (the frequency information weighted with the priority score is "2"). Furthermore, if the imaging time information of selection type B3 further overlaps with other imaging schedule information and has a low priority score, the processor 111 generates imaging disabled information because there is no remaining imaging time information. In other words, in this case, even though the imaging of selection types B1 to B3 was previously determined as imaging schedule information, it is canceled before the imaging is actually performed. In this way, the imaging is canceled in advance before the imaging is actually performed, and the user can receive the imaging disabled information, allowing the user to more quickly grasp the situation.

[0156] (3) When a selection type A1 instruction is newly received but overlaps with an imaging schedule of another instruction of designation type B Fig. 7C shows processing when a selection type A1 instruction is newly received but overlaps with an imaging schedule of another instruction of designation type B. According to Fig. 7C, the imaging time information (selection type A1) included in the instruction information received in S111 of Fig. 6 indicates that the instruction attribute information is selection type. Furthermore, the imaging schedule information (designation type B) already stored in the instruction management table indicates that the instruction attribute information associated therewith is designation type. In other words, this shows a case where the imaging time information of selection type A1 and the imaging schedule information of designation type B overlap.

[0157] In this case, as shown in FIG. 7C (a), if the priority score corresponding to the imaging of selection type A1 is compared with the priority score corresponding to the imaging of designation type B, and the priority score of the imaging of selection type A1 is found to be lower, the processor 111 cancels the imaging of selection type A1. Here, as described with reference to FIG. 8C, for example, in the case of the selection type, multiple pieces of imaging time information (in the case of FIG. 8C, imaging time information corresponding to candidate 1, candidate 3, and candidate 4) are transmitted as instruction information, and the processor 111 selects the earliest one from among them to determine the imaging schedule information. Therefore, the processor 111 refers to imaging time information other than the imaging time information of selection type A1 and determines the imaging schedule information to be imaging time information (e.g., selection type A2) that does not overlap with any of the other imaging time information. On the other hand, as shown in FIG. 7C (b), if the priority score of selection type A1 is higher, the processor 111 sets the imaging of selection type A1 instead of the imaging of designation type B in the imaging schedule information, and generates imaging disable information for the imaging of designation type B. That is, in the latter case, although the imaging of designated type B has been determined in advance as imaging schedule information, the imaging is canceled before the imaging is actually performed. In this way, the imaging is canceled before the imaging is actually performed, and the user can receive information that imaging is not possible, so that the user can grasp the situation more quickly.

[0158] Note that the processor 111 assigns "1" as frequency information due to the cancellation of the imaging of selection type A1, and weights the priority score with this frequency information when determining the changed imaging schedule information. Also, although not specifically shown in FIG. 7C (a), if the imaging time information of selection type A2 overlaps with other imaging schedule information and has a low priority score, the processor 111 determines the imaging schedule information with the imaging time information of selection type A3 (the frequency information weighted with the priority score is "2"). Furthermore, if the imaging time information of selection type A3 further overlaps with other imaging schedule information and has a low priority score, the processor 111 generates imaging unavailable information because there is no remaining imaging time information. That is, in this case, all imaging of selection types A1 to A3 is canceled.

[0159] (4) When a selection type A1 instruction is newly received but overlaps with the imaging schedule of another selection type B1 instruction Fig. 7D shows processing when a selection type A1 instruction is newly received but overlaps with the imaging schedule of another selection type B1 instruction. According to Fig. 7D, the imaging time information (selection type A1) included in the instruction information received in S111 of Fig. 6 indicates that the instruction attribute information is a selection type. Furthermore, the imaging schedule information (selection type B1) already stored in the instruction management table indicates that the instruction attribute information associated therewith is a selection type. That is, this shows a case where the imaging time information of selection type A1 and the imaging schedule information of selection type B1 overlap.

[0160] In this case, as shown in Fig. 7D(a), if the priority score corresponding to the imaging of selection type A1 is compared with the priority score corresponding to the imaging of selection type B1 and the priority score of the imaging of selection type A1 is lower, the processor 111 cancels the imaging of selection type A1. Here, as described in Fig. 8C, for example, in the case of the selection type, multiple pieces of imaging time information (imaging time information corresponding to candidate 1, candidate 3, and candidate 4 in the case of Fig. 8C) are transmitted as instruction information, and the processor 111 determines the imaging schedule information by selecting the earliest one from among them. Therefore, the processor 111 refers to imaging time information other than the imaging time information of selection type A1 and determines the imaging schedule information for imaging time information (e.g., selection type A2) that does not overlap with any of the other imaging time information.

[0161] Note that the processor 111 assigns "1" as frequency information due to the cancellation of the imaging of selection type A1, and weights the priority score with this frequency information when determining the changed imaging schedule information. Also, although not specifically shown in FIG. 7D(a), if the imaging time information of selection type A2 overlaps with other imaging schedule information and has a low priority score, the processor 111 determines the imaging schedule information with the imaging time information of selection type A3 (the frequency information weighted with the priority score is "2"). Furthermore, if the imaging time information of selection type A3 further overlaps with other imaging schedule information and has a low priority score, the processor 111 generates imaging unavailable information because there is no remaining imaging time information. That is, in this case, all imaging of selection types A1 to A3 is canceled.

[0162] On the other hand, as shown in Fig. 7D(b), if the priority score of selection type A1 is high, the processor 111 sets selection type A1 imaging in the imaging schedule information instead of selection type B1 imaging, and cancels selection type B1 imaging. Here, as described in Fig. 8C, for example, in the case of selection type, multiple pieces of imaging time information (imaging time information corresponding to candidate 1, candidate 3, and candidate 4 in the case of Fig. 8C) are transmitted as instruction information, and the processor 111 determines the imaging schedule information by selecting the earliest one from among them. Therefore, with regard to the canceled selection type B1 imaging, the processor 111 refers to imaging time information other than the imaging time information of selection type B1 and changes the imaging schedule information to imaging time information (e.g., selection type B2) that does not overlap with any of the other imaging time information.

[0163] At this time, the processor 111 assigns "1" as frequency information due to the cancellation of the imaging of selection type B1, and weights the priority score with this frequency information when determining the changed imaging schedule information. Furthermore, although not specifically illustrated in FIG. 7D(b), if the imaging time information of selection type B2 overlaps with other imaging schedule information and has a low priority score, the processor 111 determines the imaging schedule information using the imaging time information of selection type B3 (the frequency information weighted with the priority score is "2"). Furthermore, if the imaging time information of selection type B3 further overlaps with other imaging schedule information and has a low priority score, the processor 111 generates imaging disabled information because there is no remaining imaging time information. In other words, in this case, even though the imaging of selection types B1 to B3 was previously determined as imaging schedule information, it is canceled before the imaging is actually performed. In this way, the imaging is canceled in advance before the imaging is actually performed, and the user can receive the imaging disabled information, allowing the user to more quickly grasp the situation.

[0164] As shown in FIGS. 7A to 7D, the setting of priority information can be flexibly changed depending on whether the instruction attribute information is of the selection type or the designation type, thereby enabling more flexible processing to be performed.

[0165] As described above, in this embodiment, it is possible to provide a processing device, a processing program, a processing method, and a processing system that can process image pickup more efficiently.

[0166] 11. Others In FIG. 1, a ground station communication device including a first communication device 210-1 and a second communication device 210-2 is used to relay communications between the management device 220 and the spacecraft 300. However, it is also possible to use multiple small wireless devices in addition to or instead of this. Such small wireless devices are particularly suitable for transmitting control information to the spacecraft 300. Therefore, the management device 220 transmits control information to the spacecraft 300 via these small wireless devices. By using small wireless devices that are less restrictive in terms of installation and transportation, etc., to transmit control information, more flexible and efficient operation is possible.

[0167] 1, the case has been described in which the first spacecraft 300-1 is, for example, the source of the control information from the management device 220 and the image data to the image control device 230. However, instead of this, the spacecraft 300 that is the destination of the control information from the management device 220 and the source of the image data to the image control device 230 may be different from each other.

[0168] As described above, each spacecraft 300 moves around the Earth in an orbital pattern, and therefore is not always able to communicate with devices on the ground. Therefore, the control must take into account periods when communication is not possible. However, by communicating with devices on the ground via other spacecraft that can communicate with each other, more flexible communication becomes possible.

[0169] FIG. 9 is a block diagram showing a configuration of a processing system 1 according to an embodiment of the present disclosure. According to FIG. 9 , the combination determination function of the management device 220 transmits control information to the first spacecraft 300-1 when the first communication device 210-1 and the first spacecraft 300-1 are capable of communicating with each other. If the first spacecraft 300-1 is unable to transmit image data to the image control device 230 at the timing when the image data is acquired by the first spacecraft 300-1, the first spacecraft 300-1 transmits the image data via satellite communication to another first spacecraft (e.g., the second spacecraft 300-2) that is capable of inter-satellite communication with the first spacecraft 300-1 and that can communicate with the image control device 230 earlier than the first spacecraft 300-1. The second spacecraft 300-2 then transmits the received image data to the image control device 230.

[0170] Conversely, when the combination determination function of the management device 220 is unable to transmit control information (e.g., imaging instruction information) to the second spacecraft 300-2 that is determined to be most suitable for imaging, the control information (e.g., imaging instruction information) is transmitted to another spacecraft (e.g., the first spacecraft 300-1) that can communicate with the second spacecraft 300-2 and can communicate with the management device 220 earlier than the second spacecraft 300-2. The first spacecraft 300-1 then transmits the received control information to the second spacecraft 300-2 via inter-satellite communication.

[0171] This allows for more flexible communication by communicating with each device on the ground via other spacecraft that can communicate with the device.

[0172] Furthermore, in each of the processes in Figures 1 to 9, the processes performed due to the first user terminal device 400-1 and the processes performed due to the second user terminal device 400-2 can be processed in the same way in the other user terminal device and other user terminal devices.

[0173] It should be noted that the embodiments and modifications of the present disclosure are presented as examples and are not intended to limit the scope of the present disclosure. The present embodiments and modifications can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the present disclosure. These embodiments and modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as set forth in the claims.

[0174] 1 Processing system 100 Processing device 210-1 First communication device 210-2 Second communication device 220 Management device 230 Image control device 300-1 First spacecraft 300-2 Second spacecraft 400 User terminal device 400-1 First user terminal device 400-2 Second user terminal device

Claims

1. A processing device having at least one processor used for imaging by a spacecraft capable of imaging the Earth, wherein the at least one processor is configured to execute a process to: receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and determine an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

2. The processing device described in claim 1, wherein the priority is set based on at least one of user attribute information of the first user and the second user, a period until image information set for each of the first imaging target and the second imaging target is provided to the first user or the second user, and instruction attribute information of the first instruction information and the second instruction information.

3. The processing device according to claim 1, wherein the priority is weighted based on the frequency with which imaging is disabled.

4. The processing device described in claim 1, wherein the at least one processor is configured to execute processing to allow the spacecraft to cancel or change imaging based on the imaging instruction information generated based on the imaging schedule, within a predetermined period of time, even after the imaging instruction information has been transmitted to the spacecraft.

5. The processing device of claim 1, wherein the at least one processor is configured to execute processing for generating imaging instruction information including the imaging schedule, position information indicating the position of the first imaging target, and orbital information of the spacecraft.

6. The processing device according to claim 1, wherein the first instruction information includes at least one of position information indicating the position of the first imaging target and time information indicating the time for imaging the first imaging target.

7. The processing device described in claim 6, wherein the time information is either time designation information for designating a specific time desired by the first user so that the spacecraft will image the first imaging target at the specific time, or time candidate information for designating a plurality of times desired by the first user so that the spacecraft will image the first imaging target at any time selected from the plurality of times.

8. The processing device according to claim 1, wherein the at least one processor is configured to execute processing for setting a higher priority when instruction information for instructing emergency imaging is received.

9. The processing device according to claim 8, wherein the imaging instruction information generated based on the imaging schedule is transmitted to the spacecraft via inter-satellite communication with another spacecraft different from the spacecraft.

10. A processing device as described in claim 1, wherein, when imaging based on the second instruction information is canceled due to the priority, a message indicating that imaging cannot be performed is sent to the second user terminal device before imaging based on the second instruction information is performed.

11. A processing program for causing a computer used for imaging by a spacecraft capable of imaging the Earth to execute a process to receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user, receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user, and determine an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

12. A processing method executed by at least one processor in a computer used for imaging by a spacecraft capable of imaging the Earth, comprising: a step of receiving first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; a step of receiving second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and a step of determining an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

13. A processing system comprising a spacecraft configured to be able to image the Earth, and a processing device configured to be able to control imaging by the spacecraft, and having at least one processor, wherein the at least one processor is configured to execute a process to: receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and determine an imaging schedule for at least one of the first imaging target and the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

Images