Processing device, processing program, processing method, and processing system

Abstract

[Problem] To provide a processing device, a processing program, a processing method, and a processing system capable of more efficiently transmitting or processing image data captured by a spacecraft. [Solution] First instruction information for instructing imaging of a first imaging target on the earth is received from a first user terminal device that can be used by a first user, second instruction information for instructing imaging of a second imaging target on the earth is received from a second user terminal device that can be used by a second user different from the first user, and on the basis of each priority set according to at least one of the first user and the second user and each of the first instruction information and the second instruction information, a transmission schedule for transmitting first image data obtained by imaging the first imaging target and second image data obtained by imaging the second imaging target from the spacecraft is determined.

Description

Processing device, processing program, processing method, and processing system

[0001] The present disclosure relates to a processing device, a processing program, a processing method, and a processing system used for imaging by a spacecraft.

[0002] Systems for imaging an observation target at a pre-booked imaging time using a spacecraft have been known for some time. For example, Patent Document 1 describes an information processing device including: "a receiving unit that receives a request to acquire observation data based on the results of observation of a specified range at a specified time; a specifying unit that specifies, based on orbital information of a plurality of observation satellites, an observation satellite that can observe the specified range after the specified time; and an acquiring unit that acquires the requested observation data, which is the observation data generated by the specified observation satellite and is based on the results of observation of the specified range after the specified time."

[0003] International Publication No. 2021 / 192079

[0004] Therefore, in light of the above-described technologies, the present disclosure aims to provide, through various embodiments, a processing device, a processing program, a processing method, and a processing system that can more efficiently transmit or process image data captured by a spacecraft.

[0005] According to one aspect of the present disclosure, there is provided a processing device having at least one processor used for imaging by a spacecraft capable of imaging the Earth, wherein the at least one processor is configured to receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user, receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user, and execute processing to determine a transmission schedule for transmitting first image data obtained by imaging the first imaging target and second image data obtained by imaging the second imaging target from the spacecraft based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0006] According to one aspect of the present disclosure, there is provided a processing program for causing a computer used for imaging by a spacecraft capable of imaging the Earth to acquire first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth, acquire second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth, and execute a process for determining a transmission schedule for transmitting from the spacecraft the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0007] According to one aspect of the present disclosure, there is provided a processing method executed by at least one processor in a computer used for imaging by a spacecraft capable of imaging the Earth, the processing method including: acquiring first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth; acquiring second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth; and determining a transmission schedule for transmitting from the spacecraft the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

[0008] According to one aspect of the present disclosure, there is provided a processing system including: a spacecraft configured to be able to image the Earth; and a processing device configured to be able to control imaging by the spacecraft; and the processing system having at least one processor, wherein the at least one processor is configured to acquire first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth; acquire second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth; and execute processing to determine a transmission schedule for transmitting from the spacecraft the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target, based on priorities set according to at least one of each of the first user and the second user and each of the first instruction information and the second instruction information.

[0009] According to the present disclosure, it is possible to provide a processing device, a processing program, a processing method, and a processing system that can more efficiently transmit or process image data captured by a spacecraft.

[0010] It should be noted that the above effects are merely illustrative for the sake of convenience and are not limiting. In addition to or instead of the above effects, any effect described in this disclosure or an effect obvious to a person skilled in the art may be achieved.

[0011] FIG. 1A is a diagram schematically illustrating a communication state in a processing system 1 according to an embodiment of the present disclosure. FIG. 1B is a block diagram illustrating a configuration of the processing system 1 according to an embodiment of the present disclosure. FIG. 2 is a block diagram illustrating a configuration of a processing device 100 according to an embodiment of the present disclosure. FIG. 3A is a perspective view illustrating a configuration of a spacecraft 300 according to an embodiment of the present disclosure. FIG. 3B is a block diagram illustrating a configuration of the spacecraft 300 according to an embodiment of the present disclosure. FIG. 4A is a diagram conceptually illustrating a combination management table stored in a management device 220 according to an embodiment of the present disclosure. FIG. 4B is a diagram conceptually illustrating an instruction management table stored in a processing device 100 according to an embodiment of the present disclosure. FIG. 4C is a diagram conceptually illustrating a user management table stored in a processing device 100 according to an embodiment of the present disclosure. FIG. 5A is a diagram illustrating a processing sequence executed in a processing system 1 according to an embodiment of the present disclosure. FIG. 5B is a diagram illustrating a processing sequence executed in a processing system 1 according to an embodiment of the present disclosure. FIG. 6A is a diagram illustrating a processing flow executed in a processing device 100 according to an embodiment of the present disclosure. FIG. 6B is a diagram illustrating a processing flow executed in a processing device 100 according to an embodiment of the present disclosure. Fig. 7A is a diagram showing an example of transmission schedule control executed in the processing device 100 according to an embodiment of the present disclosure. Fig. 7B is a diagram showing an example of transmission schedule control executed in the processing device 100 according to an embodiment of the present disclosure. Fig. 8A is a diagram showing an example of image data control executed in the processing device 100 according to an embodiment of the present disclosure. Fig. 8B is a diagram showing an example of image data control executed in the processing device 100 according to an embodiment of the present disclosure. Fig. 9 is a diagram showing an example of a screen output on the user terminal device 400 according to an embodiment of the present disclosure. Fig. 10 is a block diagram showing a configuration of the processing system 1 according to an embodiment of the present disclosure.

[0012] Various embodiments of the present invention will be described below with reference to the accompanying drawings. Note that common components in the drawings are designated by the same reference numerals. It should also be noted that components depicted in one drawing may be omitted in another drawing for the sake of clarity. It should also be noted that the accompanying drawings are not necessarily drawn to scale.

[0013] The various systems, methods, and devices described in this disclosure should not be construed as limiting in any way. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described in this disclosure are not limited to specific aspects, specific features, or combinations of such specific aspects with specific features, nor do the products and methods described in this disclosure require that one or more particular advantages be present or problems be solved. Furthermore, various features or aspects of the various embodiments described in this disclosure, or portions of such features or aspects, may be used in combination with each other.

[0014] Although the operations of some of the various methods disclosed in this disclosure are described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations unless a particular order is required by specific text below. For example, operations described in a sequence may, in some cases, be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings do not show the various ways in which the various items and methods described in this disclosure can be used in conjunction with other items and methods.

[0015] Any theories of operation, scientific principles, or other theoretical descriptions presented in this disclosure related to the devices or methods of the present disclosure are provided for the purpose of better understanding and are not intended to limit the scope of the technology, and the devices and methods in the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

[0016] Any of the various methods disclosed in this disclosure may be implemented using computer-executable instructions stored on one or more computer-readable media and executed on a computer. The one or more media may be non-transitory computer-readable storage media, such as at least one optical media disk, volatile memory components, or non-volatile memory components. The volatile memory components may include, for example, DRAM or SRAM. The non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). The computer may include any computer available on the market, including, for example, smartphones and other mobile devices with computing hardware.

[0017] Any such computer-executable instructions for implementing the techniques disclosed in this disclosure, along with any data generated and used during the implementation of various embodiments disclosed in this disclosure, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may, for example, be executed on a single local computer (e.g., as a process running on any suitable commercially available computer) or in a networked environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

[0018] For clarity, only selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed in this disclosure are not limited to a particular computer language or program. For example, the techniques disclosed in this disclosure may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed in this disclosure are not limited to a particular computer or a particular type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail in this disclosure.

[0019] Moreover, any of the various software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed in this disclosure) may be uploaded, downloaded, or remotely accessed by suitable communications means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF communication, microwave communication, infrared communication), electronic communication, or other such communications means.

[0020] In this disclosure, "image data" refers to, for example, data captured by a spacecraft, and "image information" refers to, for example, information generated by processing image data by the image control device 230 so that the image data can be provided to a user terminal device. In other words, the terms "image data" and "image information" are merely terms used to distinguish between the timing of transmission and reception, and image data and image information may be essentially the same or different. Furthermore, image data and image information are not limited to a specific file format and may be in any file format that can be processed by each device. Furthermore, an image identified by image data and image information is not limited to a single still image, but may be in any form, such as a continuous image obtained by capturing multiple still images in succession or a video composed of multiple frames. Furthermore, images identified by image data and image information are typically images generated based on the strength of radio wave reception, but are not limited to this. They may also be color images, black-and-white images, or images detected by a sensor, including infrared images, ultraviolet images, and X-ray images.

[0021] Furthermore, although the present disclosure uses terms such as "first user terminal device 400-1," "second user terminal device 400-2," "first user," "second user," "first spacecraft 300-1," or "second spacecraft 300-2," these are merely names given to distinguish between each user terminal device, each user, and each spacecraft, and are not intended to limit the number or order to a specific number. Furthermore, unless otherwise specifically mentioned, the names prefixed with "first" or "second" may have different meanings or may have the same meaning.

[0022] 1. Overview of Processing System 1 The processing system 1 according to the present disclosure is a system used to determine a transmission schedule for transmitting image data captured by a spacecraft capable of capturing images of the Earth to, for example, a ground station. FIG. 1A is a diagram schematically illustrating a communication situation in the processing system 1 according to an embodiment of the present disclosure. FIG. 1A illustrates a spacecraft 300 moving from position (a) to position (c) via position (b), and also illustrates a ground station communication device 210 installed on the ground, functioning as part of a so-called ground station. As described above, the spacecraft 300 moves at high speed in an orbit from position (a) to position (c). On the other hand, the communication range of the ground station communication device 210 is limited by various constraints, such as radio waves and field of view, as shown as range T1 in FIG. 1A . Therefore, the spacecraft 300 can transmit image data captured by itself to the ground station communication device 210 only when the spacecraft 300 is located within range T1.

[0023] As such, the time during which the spacecraft 300 can communicate with the ground station communication device 210 is said to be approximately 10 minutes, for example, although not limited to the time exemplified below. Therefore, if image data is not transmitted appropriately within this limited time, there is a possibility that necessary image data will not be delivered to the ground station communication device 210 even though it has been captured. Therefore, in order to prevent overlapping of the timing of transmission of captured image data within the limited communication time, the processing system 1 determines the transmission schedule based on the priority set according to the image capture instruction or the user who issues the image capture instruction. In this way, the processing system 1 enables efficient image capture within the limited communication time.

[0024] 1A shows only one ground station communication device 210 and one spacecraft 300, but as will be explained in FIG. 1B etc., there may naturally be a plurality of them. That is, for example, if the spacecraft 300 passes through the communication range of a ground station communication device other than the ground station communication device 210 while moving from position (a) to position (c), it is also possible to transmit image data in a distributed manner to the other ground station communication devices in addition to the ground station communication device 210.

[0025] 1B is a block diagram showing a configuration of a processing system 1 according to an embodiment of the present disclosure. According to FIG. 1B, the processing system 1 includes a processing device 100, user terminal devices 400 including a first user terminal device 400-1 and a second user terminal device 400-2, an image control device 230, a management device 220, ground station communication devices including a first communication device 210-1 and a second communication device 210-2 (collectively referred to as ground station communication devices 210), and spacecraft including a first spacecraft 300-1 and a second spacecraft 300-2 (collectively referred to as spacecraft 300). The components are connected to each other so as to be able to communicate with each other via at least one of a wireless and a wired communication network.

[0026] In brief, the user terminal device 400 of the processing system 1 receives user input and selects location information of a location including an imaging target and a desired date and time for imaging the target, thereby generating imaging instruction information. The processing device 100 determines imaging schedule information and a transmission schedule for the captured images in response to the instruction information received from the user terminal device 400. The management device 220 generates imaging instruction information for controlling the spacecraft based on the schedule information and transmission schedule generated by the processing device 100, and manages images captured by the spacecraft and users. The image control device 230 processes image data received from the spacecraft and generates image information that can be provided to the user terminal device 400. The ground station communication device relays communications between each device on the ground station and the spacecraft. The spacecraft travels in orbit around the Earth, capturing images of the imaging target, including specific locations on the ground, according to schedule information, and transmitting the captured image data to the ground station.

[0027] 1 is an example of the configuration of the processing system 1, and naturally other components may be added, or components shown in Fig. 1 may be omitted. Also, each component shown in Fig. 1 does not need to execute all of the processes described below, and it is possible to distribute the processes among multiple components.

[0028] 2. Configuration of the Processing Device 100 FIG. 2 is a block diagram showing the configuration of the processing device 100 according to an embodiment of the present disclosure. According to FIG. 2, the processing device 100 includes a processor 111, a memory 112, and a communication interface 113. These components are electrically connected to each other via control lines and data lines. The processing device 100 does not need to include all of the components shown in FIG. 2; some components may be omitted, or other components may be added. For example, an external memory, a database device, a server device, or the like connected in a communicative manner as memory may be used. Furthermore, the processing device 100 is typically configured as a server device installed in the cloud, but may also be any device, such as an on-premise server device, a supercomputer, a mainframe, a personal computer, a smartphone, a tablet, a workstation, or a mobile information terminal. Furthermore, the processing device 100 may execute some processing in a distributed manner with processing devices, including other server devices. In other words, the processing device 100 is not limited to a single device, but may be distributed across multiple devices depending on the information handling and processing load.

[0029] The processor 111 functions as a control unit that controls other components of the processing system 1 based on a processing program stored in the memory 112. The processor 111 executes processes related to providing imaging services based on the processing program stored in the memory 112. In particular, the processor 111 executes the following processes based on the processing program stored in the memory 112: "receiving first instruction information from a first user terminal device 400-1 available to a first user, which instructs the imaging of a first imaging target on Earth; receiving second instruction information from a second user terminal device 400-2 available to a second user different from the first user, which instructs the imaging of a second imaging target on Earth;" and "determining a transmission schedule for transmitting, from the spacecraft 300, first image data obtained by imaging the first imaging target and second image data obtained by imaging the second imaging target, based on priorities set according to at least one of the first user and the second user, and the first instruction information and the second instruction information." The processor 111 is primarily composed of one or more CPUs, but may also be combined with a GPU, FPGA, or the like as appropriate.

[0030] The memory 112 is composed of RAM, ROM, non-volatile memory, HDD, SSD, etc., and functions as a storage unit. The memory 112 stores instructions and commands for various controls of the processing system 1 according to this embodiment as processing programs. Specifically, the memory 112 stores programs to be executed by the processor 111, such as "a process of receiving first instruction information for instructing the first user to capture an image of a first imaging target on Earth from a first user terminal device 400-1 available to a first user," "a process of receiving second instruction information for instructing the second user to capture an image of a second imaging target on Earth from a second user terminal device 400-2 available to a second user different from the first user," and "a process of determining a transmission schedule for transmitting, from the spacecraft 300, first image data obtained by capturing an image of the first imaging target and second image data obtained by capturing an image of the second imaging target based on priorities set according to at least one of the first user and the second user, and the first instruction information and the second instruction information." In addition to the programs, the memory 112 also stores various information such as a user management table and an instruction management table. It should be noted that this information does not need to be constantly stored in the memory 112 within the processing device 100, but may be stored in a database device installed remotely. In this case, the database device is also included in the memory 112.

[0031] The communication interface 113 functions as a notification unit for transmitting and receiving various information to and from the user terminal device 400, the management device 220, and the like connected via a wired or wireless network. Examples of the communication interface 113 include a wired communication connector such as USB or SCSI, and a wireless communication transmitting and receiving device such as a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a fixed telephone network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark).

[0032] 3. Configuration of Spacecraft 300 The processing system 1 in Fig. 1 can include at least one spacecraft 300. Although Fig. 1 illustrates a first spacecraft 300-1 and a second spacecraft 300-2, the processing system 1 may include three or more spacecraft 300. Each spacecraft 300 may be, for example, a satellite, but is not limited to this, and may include any moving body capable of navigating in space.

[0033] Fig. 3A is a perspective view showing a configuration of a spacecraft 300 according to an embodiment of the present disclosure. Fig. 3B is a block diagram showing a configuration of the spacecraft 300 according to an embodiment of the present disclosure. Note that Fig. 3A shows an example of the spacecraft 300, but the first spacecraft 300-1 and the second spacecraft 300-2 do not need to have the same configuration, and may have a different configuration from the spacecraft.

[0034] 3A and 3B, the spacecraft 300 may include a communication device 350 that transmits and receives various data to and from a ground station communication device, an imaging device 310 that images the Earth, and a control device 340 that controls the imaging operation of the imaging device 310 and the attitude of the spacecraft 300. The communication device 350, the control device 340, and the imaging device 310 may be electrically connected to each other via control lines and / or data lines.

[0035] (1) Communication Device 350 As shown in Fig. 4, the communication device 350 may include a communication interface 359. The communication interface 359 can receive control information related to the imaging operation of the imaging device 310 transmitted from the ground station communication device and transmit this control information to the imaging device 310. The communication interface 359 can also transmit and / or receive various data to and from the ground station communication device.

[0036] Furthermore, the communication interface 359 can transmit, for example, image data acquired by the control device 340 and space position information regarding the position in space of the spacecraft 300 monitored by the control device 340 to the ground station communication device. The space position information of the spacecraft 300 can be acquired at any time by a sensor 355, which will be described later.

[0037] Furthermore, the communication interface 359 can receive identification data of each communication device (such as the first communication device 210-1 and the second communication device 210-2) included in the ground station communication device and store each identification data in the memory 354 described below. As a result, when the communication interface 359 receives control information from a certain communication device, it can recognize from which of the multiple communication devices the control information was received, based on the identification data of the communication device included in the control information. Furthermore, the identification data of each of the multiple communication devices transmitted from the ground station communication device to the communication interface 359 includes the location data of each communication device. As a result, the communication interface 359 can associate the location data of each of the multiple communication devices with each ID data and store this data in the memory 354. Therefore, when control information is transmitted from a communication device to the spacecraft 300, it is not necessary to include the location data of the communication device in the control information, and it is possible to reduce the volume of the control information (in this case, if the control information includes the ID data of the communication device, the spacecraft 300 can determine the location data of the communication device related to the ID data by referring to memory 354).

[0038] The communication interface 359 uses a communication method corresponding to the S band or the X band, for example, but may of course use other communication methods. The communication interface 359 may be provided with a plurality of communication interfaces depending on the communication partner to be transmitted and received, the communication standard to be used when transmitting and receiving, etc.

[0039] The location information of the imaging target is information indicating a point or region on Earth that is the imaging target, and may be, for example, data indicating the latitude and longitude corresponding to this point or region. The imaging schedule information may be data indicating the date and time when imaging is to be performed (date and time when imaging, observation, etc. by the spacecraft 300 is required). The transmission schedule information may be data indicating the date and time when image data acquired by imaging is to be transmitted to the ground station communication device 210 and the identification data of the ground station communication device to which the image data is to be transmitted.

[0040] The imaging instruction information, which is an example of control information, preferably includes imaging schedule information indicating the time to image the imaging target, position information indicating the position of the imaging target, and transmission schedule information. In this way, the transmission schedule information indicating the time to transmit the captured image data is transmitted as control information at the same timing as the imaging schedule information, etc. Therefore, the transmission schedule information can be transmitted more efficiently.

[0041] More preferably, the imaging instruction information may further include orbital information of the spacecraft 300. Examples of such orbital information include the direction in which the spacecraft 300 moves on its orbit above the Earth at the time the imaging target is captured, the orbital position of the spacecraft 300 at that time (space position information), the imaging angle of the spacecraft 300 at that time (e.g., the nadir angle), various parameters such as the noise equivalent backscatter coefficient and the output power resolution, and combinations of these. Such orbital information is particularly important as an imaging condition when a synthetic aperture radar is used as the imaging device of the spacecraft 300. For example, information such as "January 11, 2024, 13:00 / 33.55 degrees north latitude / 135.55 degrees east longitude / (FROM 20B TO 10A) / January 13, 2024, 10:00 / first communication device 210-1" may be transmitted from the ground station communication device to the communication interface 359. In this case, "January 11, 2024, 13:00" corresponds to the imaging schedule information, "33.55 degrees north latitude / 135.55 degrees east longitude" corresponds to the location information of the imaging target, "January 13, 2024, 10:00" corresponds to the date and time of transmission in the transmission schedule information, and "first communication device 210-1" corresponds to the identification data of the destination ground station communication device 210 in the transmission schedule information. Note that this control information may include identification data (e.g., "20B") of the source ground station communication device 210.

[0042] The transmission and reception of various data between the communication interface 359 and the ground station communication device 210 may be performed using, as an example, a communication method corresponding to the S band or the X band, but is not limited to this and may be performed using various common communication methods.

[0043] (2) Control Device 340 The control device 340 receives control information (e.g., imaging instruction information including imaging schedule information and transmission schedule information) received by the communication interface 359 from the ground station communication device, and can control the imaging operation of the imaging device 310 and the transmission operation of the captured image data based on this control information (e.g., imaging instruction information including imaging schedule information and transmission schedule information). Furthermore, the control device 340 can control the attitude, etc. of the spacecraft 300 in relation to the imaging operation.

[0044] The control device 340 includes, as hardware, a processor 353, a memory 354, a sensor 355, and the like, which are mutually connected by a data bus and / or a control bus, and is capable of executing various information processing operations, which will be described later.

[0045] The processor 353, which may be referred to as a CPU, performs various calculations based on the instructions and data stored in the memory 354, thereby generating imaging instruction information regarding the imaging operation of the imaging device 310, the transmission operation of the captured image data, and the attitude of the spacecraft 300 related to these operations.

[0046] The memory 354 can store instructions and data received from the communication interface 359, as well as calculation results of the processor 353. Furthermore, the memory 354 can store instructions and data (computer programs) that constitute specific applications (e.g., applications for controlling the imaging and transmission operations of the imaging device 310, applications for controlling the attitude of the spacecraft 300, etc.). The memory 354 can include computer-readable media such as, but not limited to, RAM, ROM, non-volatile memory, and hard disk drive (HDD: not shown).

[0047] Furthermore, as described above, the memory 354 can store identification data for each of the plurality of ground station communication devices. For example, the memory 354 can store location information for each of the plurality of ground station communication devices and the ID data for each of the plurality of ground station communication devices in association with each of the location information and the ID data.

[0048] The sensor 355 may include, for example, a gyro sensor, an acceleration sensor, a position sensor, and / or a speed sensor, etc., used to acquire and control various data related to the progress, position and attitude in space, etc. of the spacecraft 300. Furthermore, for example, the sensor may include a temperature sensor, an illuminance sensor, and / or an infrared sensor, etc., for observing the external environment and / or the internal environment of the spacecraft 300. The various sensor data acquired by the sensor 355 may be stored in the memory 354, used for calculation processing by the processor 353, and transmitted to the ground station communication device via the communication interface 359.

[0049] (3) Imaging Device 310 The imaging device 310 receives control information generated by the control device 340 and performs imaging operations. For example, a synthetic aperture radar may be used as the imaging device 310. As shown in FIGS. 3A and 3B , the imaging device 310 includes a transmitter 360, a radiator 357, a reflector 330, and a receiver 361.

[0050] The transmitter 360 transmits a pulse signal of a predetermined frequency based on control information from the control device 340. The pulse signal is converted into a high-frequency radio frequency through processing such as modulation and / or demodulation, amplified, and radiated from the radiator 357 to the reflector 330, and then radiated into the space outside the imaging device 310. The transmitter 360 then receives radio waves reflected from the imaging target (reflected waves) at the receiver 361 via the reflector 330 and the radiator 357. The received image data can be transmitted to the ground station communication device via the aforementioned communication interface 359. The reflected waves received by the receiver 361 can also be transmitted to the ground station communication device via the communication interface 359.

[0051] 3A and 3B , the radiator 357 and the reflector 330 correspond to an antenna. The reflector 330 is disposed to face the radiator 357 at a predetermined angle and includes a secondary reflector (secondary reflecting mirror) 332 for reflecting radio waves radiated from the radiator 357 to a reflector 331 serving as a main reflecting mirror, a reflector 331 disposed to face the mirror surface of the secondary reflector 332 and further reflecting the radio waves reflected by the secondary reflector 332 to radiate the radio waves into the space outside the imaging device 310, and a support member 333 for supporting the secondary reflector 332.

[0052] The reflector 331 includes a plurality of ribs 335 and a planar body 336, and its reflecting surface can be formed in a parabolic shape to function as a main reflecting mirror.

[0053] 4. Ground Station Communication Device 210 (First Communication Device 210-1 and Second Communication Device 210-2) The processing system 1 may include a ground station communication device 210 configured with at least one communication device. For example, although two ground station communication devices (first communication device 210-1 and second communication device 210-2) are illustrated in FIG. 1, the processing system 1 may include any number of ground station communication devices 210.

[0054] Each ground station communication device 210 is a commonly known ground station and may include, for example, a battery (not shown) and a communication interface for transmitting and receiving various data to and from each of the multiple spacecraft 300 and the management device 220.

[0055] As a result, each ground station communication device 210 can receive, from each spacecraft 300, captured (acquired) image data or image information generated based on this image data, as well as space position information regarding the position in space of the spacecraft 300 being monitored by the control device 340, and can transmit the received image data (or image information) and space position information to the management device 220. Furthermore, each ground station communication device 210 can receive each identification data from the management device 220 and transmit (transmit) the received identification data to each of the multiple spacecraft 300.

[0056] Furthermore, by connecting each ground station communication device 210 and the management device 220 via a communication line, each ground station communication device 210 can transmit control information to a specified spacecraft 300 based on the control information received from the management device 220.

[0057] In addition, the communication lines connecting each ground station communication device 210 and the management device 220 may include, but are not limited to, a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a fixed telephone network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark), etc.

[0058] 5. Management Device 220 The management device 220 receives imaging instruction information generated by the processing device 100 from the processing device 100, and can select an appropriate communication device from among the multiple communication devices and an appropriate spacecraft 300 from among the multiple spacecraft 300 in order to perform imaging based on imaging schedule information and transmission of image data based on transmission schedule information specified in the imaging instruction information. Such a management device 220 can also be configured in the same manner as the processing device 100 illustrated in FIG. 2.

[0059] The management device 220 can be connected to a plurality of ground station communication devices 210 (in FIG. 1, the first communication device 210-1 and the second communication device 210-2) via communication lines. This allows the management device 220 to transmit control information to a predetermined spacecraft 300 for each of the plurality of ground station communication devices 210 (in FIG. 1, the first communication device 210-1 and the second communication device 210-2). In addition, the management device 220 can receive the above-mentioned identification data from each of the plurality of ground station communication devices 210 (in FIG. 1, the first communication device 210-1 and the second communication device 210-2).

[0060] Furthermore, the management device 220 may be connected to the processing device 100 via a communication line. In this case, the communication line may include, but is not limited to, a mobile phone network, a wireless network (WiFi, WiMax, cellular, etc.), a landline network, the Internet, a local area network (LAN), a wide area network (WAN), an intranet, and / or Ethernet (registered trademark), etc.

[0061] This allows the management device 220 to receive from the processing device 100 imaging instruction information requesting imaging of the imaging target and transmission of the captured image.

[0062] The hardware configuration of the management device 220 includes a processor, a memory, and a communication interface.

[0063] The processor, for example, is called a CPU, and can perform various operations based on instructions and data stored in a memory.

[0064] The memory can store instructions and data received via the communication interface, calculation results of the processor, etc. Furthermore, the memory can store instructions and data (computer programs) that constitute specific applications (e.g., an application for determining the spacecraft 300 that will perform an imaging operation, an application for determining the ground station communication device 210 that will transmit control information to the spacecraft 300, an application for controlling the content of control information transmitted from the ground station communication device 210 to the spacecraft 300, an application for controlling data transmission and reception with the ground station communication device 210, an application for controlling data transmission and reception of the ground station communication device 210, etc.). The memory can include, but is not limited to, computer-readable media such as RAM, ROM, non-volatile memory, and a hard disk drive (HDD: not shown).

[0065] The management device 220 executes a combination determination function under the control of the processor. The combination determination function can determine, from among the multiple spacecraft 300 and the multiple communication devices, a combination of one spacecraft 300 capable of performing an imaging operation for a location identified by the location information of the imaging target at a start timing identified by the imaging schedule information, and one communication device that transmits imaging instruction information to the one spacecraft 300 capable of performing the imaging operation, based on the location information of the imaging target included in the imaging instruction information, the space location information of each of the multiple spacecraft 300 previously received via the ground station communication device 210, and the location information (identification data) of each of the multiple ground station communication devices 210. Note that when multiple spacecraft 300 cooperatively perform imaging of a location corresponding to the imaging target, the combination determination function can also determine a combination of multiple spacecraft 300 capable of performing the imaging operation and multiple communication devices that transmit the above-mentioned control data to each of the multiple spacecraft 300 capable of performing the imaging operation.

[0066] Specifically, the combination determination function can refer to a table obtained by calculating the first time (T1) required from the start of transmission of control information from the ground station communication device 210 to the spacecraft 300 to the completion of transmission, starting from the imaging date and time specified by the imaging schedule information; the second time (T2) required from the time the spacecraft 300 completes reception of the control information until the spacecraft 300 completes the imaging operation (until all reflected waves are received); and the third time (T3) required from the time the imaging operation is completed until the spacecraft 300 completes transmission of image data to the ground station communication device 210.

[0067] 4A is a diagram conceptually illustrating a combination management table stored in the management device 220 according to an embodiment of the present disclosure. The combination determination function executed by the processor of the management device 220 can select a combination that minimizes the total time of "T1 + T2 + T3" by referring to this table. As an example, in the case shown in FIG. 4A , the combination determination function can determine a combination of the second spacecraft and the second communication device that results in the aforementioned total time of 90 minutes (T1: 30 minutes, T2: 20 minutes, T3: 40 minutes, total time 90 minutes).

[0068] The combination determination function generates location information of the imaging target, information indicating the determined combination of at least one spacecraft 300 and at least one ground station communication device 210, and information regarding the total time (for example, in the case shown in Figure 4A, information indicating the combination of the second spacecraft and the second communication device, and information indicating the total time of 90 minutes).

[0069] Furthermore, the processor of the management device 220 can determine the content of control information to be transmitted to the ground station communication device 210 based on information about the combination of one spacecraft 300 and one ground station communication device 210 generated by the combination determination function and information about the total time. The control information includes position information of the imaging target and imaging schedule information.

[0070] Furthermore, the processor of the management device 220 can transmit the generated control information and request information requesting one spacecraft 300 determined by the combination to transmit the control information to the communication interface. As a result, the communication interface can transmit this control information and request information to one ground station communication device 210 determined by the above-mentioned combination. Note that, as an example, the control information transmitted from the communication interface to the ground station communication device 210 may be "January 11, 2024, 13:00 / 33.55 degrees north latitude / 135.55 degrees east longitude / (FROM 20B TO 10B)."

[0071] 6. Image Control Device 230 The image control device 230 can receive image data captured by the spacecraft 300 via the ground station communication device 210. The image control device 230 can also generate image information based on the received image data. The image control device 230 can transmit the image information generated in this manner to the processing device 100.

[0072] Here, a brief description will be given of image data and image information generated based on this image. The spacecraft 300 can acquire image data by capturing an image of a point on Earth. Such image data may include, for example, a plurality of coordinates corresponding to the point, and a depth and time (date and time) associated with each of the coordinates. Such image data may be generated in the form of, for example, a matrix.

[0073] Here, when the spacecraft 300 performs imaging using a synthetic aperture radar, radio waves are emitted from the spacecraft 300 toward the certain point on Earth, and as a result, the spacecraft 300 can receive the radio waves that are reflected from the certain point and travel toward the spacecraft 300. By using the reception strength of such radio waves and the time (date and time) at which such radio waves are received, the spacecraft 300 can generate data including a plurality of coordinates corresponding to the certain point and the depth and time (date and time) associated with each of the coordinates included in the plurality of coordinates.

[0074] On the other hand, image information generated based on image data may be image information that represents, in the form of a map, each coordinate included in the image data and the depth and time corresponding to the coordinate. In such image information, points corresponding to each coordinate may be represented by a shade determined according to the depth corresponding to the coordinate. For example, if the depth corresponding to a certain coordinate is deep (i.e., the point corresponding to the coordinate is at a low position), the point corresponding to the certain coordinate may be represented darker, whereas if the depth corresponding to a certain coordinate is shallow (i.e., the point corresponding to the coordinate is at a high position), the point corresponding to the certain coordinate may be represented lighter.

[0075] 7. User Terminal Device 400 The configuration of the user terminal device 400 includes, for example, a processor functioning as a control unit, a memory functioning as a storage unit, an input interface functioning as an input unit, an output interface functioning as an output unit, and a communication interface functioning as a communication unit. These components are electrically connected to each other via control lines and data lines. Note that the user terminal device 400 does not need to include all of these components; it is possible to omit some of them or add other components. The user terminal device 400 may be any device capable of communicating with the processing device 100 via a wired or wireless network. Examples of the user terminal device 400 include smartphones, tablets, laptop PCs, desktop PCs, scanners, imaging devices, and multifunction peripherals. Note that when there are multiple users as described above, multiple user terminal devices 400 (e.g., a first user terminal device 400-1 and a second user terminal device 400-2) are used for each user, but each user terminal device 400 may be a different type of terminal device. Furthermore, it is not necessarily required that one user terminal device 400 exists for one user; multiple users may use one user terminal device 400, or one user may use multiple user terminal devices 400.

[0076] The processor of the user terminal device 400 receives user input via the input interface and generates position information, time information, etc. of the imaging target, for example, in order to generate position information, imaging schedule information, etc. Then, the processor of the user terminal device 400 transmits the generated position information, time information, etc. to the processing device 100 via the communication interface.

[0077] 8. Various Information Used in Processing in the Processing System 1 Fig. 4B is a diagram conceptually illustrating an instruction management table stored in the processing device 100 according to an embodiment of the present disclosure. According to Fig. 4B, the instruction management table stores user ID information, desired period information, imaging attribute information, candidate information, imaging time information, location information, priority information, desired delivery date information, schedule information, and the like, in association with instruction ID information.

[0078] The “instruction ID information” is, for example, information specific to an image capture instruction by a user and is information for identifying each instruction. The instruction ID information is generated by the processing device 100, for example, every time the processing device 100 receives search request information for new image capture from a user.

[0079] The “user ID information” is, for example, information unique to each user and used to identify each user. The user ID information is generated by the processing device 100 each time a user transmits a request for new registration as a user of the imaging service through a user terminal device.

[0080] The "desired period information" is information indicating a period during which each user desires to capture an image of an imaging target. The desired period information includes, for example, information indicating the start date and time (e.g., "January 10, 2024, 00:00") and end date and time (e.g., "January 16, 2024, 23:59") of the desired period. The desired period information is information extracted from the search request information transmitted from the user terminal device 400.

[0081] The "imaging attribute information" is information indicating the urgency of imaging of the imaging target desired by each user. The imaging attribute information includes, for example, information indicating an emergency and information indicating normal. The information indicating an emergency is generated according to a user's selection when an emergency is required, for example, to check the situation in the area where an event such as an accident, fire, earthquake, flood, heavy rain, or windbreak occurs. In other words, the information indicating an emergency among the imaging attribute information is information indicating the period until the captured image is provided to each user. The imaging target information is information extracted from the search request information transmitted from the user terminal device 400.

[0082] "Location information" is information indicating a point or region on the Earth where each user desires to capture an image. One example of location information is information indicating the latitude and longitude of a point on the Earth, and is information set according to the user's selection. However, information indicating latitude and longitude is merely one example of location information. Examples of location information include latitude and longitude, information indicating landmarks (e.g., Tower A, City Hall B), information indicating the name of a region such as a country, prefecture, city, ward, town, or village (e.g., Fukuoka Prefecture, Fukuoka City, Tenjin), information indicating an address (e.g., the address itself or a postal code), information indicating a telephone number, and combinations thereof, as long as it indicates a location. The location information is information extracted from the search request information transmitted from the user terminal device 400.

[0083] "Priority information" is information indicating a priority for determining which instruction to prioritize when imaging of an imaging target and transmission of the captured image overlap. An example of priority information is a specific numerical value indicating the priority. However, the specific numerical value is merely an example. Examples of priority information include a specific numerical value, a classification (e.g., "high," "medium," or "low"), an arbitrary code (e.g., "X1," "X2," or "X3"), and combinations thereof, as long as it indicates priority. Priority information is information calculated by the processing device 100 based on the user's user attribute information and information related to imaging instructions.

[0084] The "desired delivery date information" is information indicating the date and time when transmission of image information of an image capture target to each user's user terminal device 400 will be completed. The desired delivery date information includes, for example, information indicating the date and time of the desired delivery date (e.g., "January 15, 2024, 00:00"). The desired delivery date information is information extracted from the instruction information transmitted from the user terminal device 400.

[0085] The "schedule information" is information indicating the date and time when the spacecraft 300 will capture an image of the imaging target, as well as the ground station communication device 210 that will transmit the image data captured by the spacecraft 300 from the spacecraft 300 and that date and time. When the schedule information includes imaging schedule information that indicates the date and time of imaging, it may, for example, include at least one piece of information indicating a specific date and time (e.g., "January 11, 2024, 13:00"). When the schedule information includes transmission schedule information that indicates the ground station communication device 210 that will transmit the image data and that date and time, it may, for example, include identification data that identifies the ground station communication device 210 and at least one piece of information indicating a specific date and time (e.g., "January 13, 2024, 10:00"). The schedule information is information determined by the processing device 100.

[0086] Furthermore, each piece of information stored in the instruction management table is typically stored in the memory 112 of the processing device 100, but may also be stored in other devices such as the management device 220, a server device, or a database device.

[0087] 4C is a diagram conceptually illustrating a user management table stored in the processing device 100 according to an embodiment of the present disclosure. According to FIG. 4C, the user management table stores user name information, classification information, plan information, and the like in association with user ID information.

[0088] The “user ID information” is, for example, information unique to each user and used to identify each user. The user ID information is generated by the processing device 100 each time a user transmits a request for new registration as a user of the imaging service through a user terminal device.

[0089] "Classification information" is information for classifying each user. An example of classification information is information indicating the user's priority (e.g., "premium," "normal," etc.). However, information indicating priority is merely an example. Examples of classification information include information indicating priority, information indicating the user's attributes (e.g., government agency, educational institution, private company, etc.), information indicating the frequency or amount of service use, information indicating points awarded according to service use, and combinations of these, as long as it is information for classifying users. Classification information is information assigned to each user by the processing device 100.

[0090] "Plan information" is information indicating the plan each user has subscribed to for the imaging service. One example of plan information is information indicating the user's priority (e.g., "premium plan," "normal plan," etc.). Plan information is information selected based on the user's wishes.

[0091] Note that the information stored in such a user management table is merely an example, and may naturally include other information, such as the user's address, contact information, affiliation, etc. Furthermore, each piece of information stored in the user management table is typically stored in memory 112 of processing device 100, but may also be stored in other devices, such as management device 220, a server device, or a database device.

[0092] 9. Processing Sequence Executed in Processing System 1 Figures 5A to 5C are diagrams illustrating processing sequences executed in the processing system 1 according to an embodiment of the present disclosure. Specifically, Figure 5A illustrates a processing sequence executed between the first user terminal device 400-1, the processing device 100, and the management device 220 from when image capture instruction information is received from the first user terminal device 400-1 available to the first user, until when image capture instruction information including transmission schedule information is transmitted from the processing device 100 to the spacecraft. Figure 5B illustrates a processing sequence executed between the spacecraft 300, the ground station communication device 210, and the management device 220 when image data captured in the spacecraft 300 is transmitted from the spacecraft 300 to the processing device 100.

[0093] 5A, the processing sequence begins when the first user terminal device 400-1 receives an input of an imaging search request. Specifically, the processor of the first user terminal device 400-1 receives a user operation input via the input interface on the imaging search screen output via the output interface, and generates first search request information by selecting the first user's user ID information, desired period information, imaging attribute information, and location information (S11).

[0094] Here, Fig. 9A is a diagram showing an example of a screen output on the user terminal device 400 according to an embodiment of the present disclosure. Specifically, Fig. 9A is a diagram showing an example of an imaging search screen output on the first user terminal device 400-1 in S11 of Fig. 4. According to Fig. 9A, the imaging search screen includes user ID information for identifying the user, as well as map information 11, a location information selection area 13, a desired period selection area 14, an imaging attribute selection area 15, and a search button 16.

[0095] The map information 11 indicates a map displayed at an arbitrary scale according to information such as a region or location desired by the user or the current location of the first user terminal device 400-1. The user can select an imaging target by referring to the map information 11. The map information 11 includes an imaging target mark 12. The imaging target mark 12 indicates the imaging target selected by the user. The imaging target mark 12 is displayed corresponding to the coordinates at which a user's operation input (e.g., a "tap operation on a specific location") to the map information 11 is accepted via the input interface. That is, in FIG. 9A , the imaging target mark 12 is displayed in the upper right area of ​​the map information 11. However, for example, if the user inputs an operation at an arbitrary location in the lower left of the map information 11, the position of the imaging target mark 12 also moves to that location. By referring to the imaging target mark 12, the user can effectively grasp the region or location designated as the imaging target.

[0096] Note that the imaging target mark 12 is merely one example of the currently selected imaging target. For example, various displays other than the imaging target mark 12 can be used for the same purpose, such as a display showing the outline of the area selected as the imaging target, or a display enclosing an area including the area or point selected as the imaging target.

[0097] The location information selection area 13 is an area that displays information indicating the latitude and longitude of a region or point where a user's operation input (e.g., "tap operation on a specific point") to the map information 11 has been accepted via the input interface. That is, in Fig. 9A, the location information selection area 13 displays the latitude and longitude of the point corresponding to the imaging target mark 12 in the upper right area of ​​the map information 11, but if the user moves the position of the imaging target mark 12 to a point in the lower left of the map information 11, for example, the displayed information is changed to the latitude and longitude of that point.

[0098] Note that latitude and longitude are merely an example of location information displayed in location information selection area 13. Various information may be displayed as location information in location information selection area 13, such as latitude and longitude, information indicating landmarks (e.g., Tower A, City Hall B, etc.), information indicating the name of a region such as a country, prefecture, city, ward, town, or village (e.g., Fukuoka Prefecture, Fukuoka City, Tenjin, etc.), information indicating an address (e.g., the address itself or a postal code), information indicating a telephone number, and combinations of these.

[0099] The desired period selection area 14 is an area where information indicating a period during which the user desires to capture an image of the imaging target is displayed, selected by receiving a user's operational input via the input interface. The desired period selection area 14 includes a start date and time selection area for selecting a start date and time and an end date and time selection area for selecting an end date and time, and by receiving a user's operational input via the input interface in each selection area, the specific date and time selected by the user is displayed (for example, "January 10, 2024, 00:00" is displayed in the start date and time selection area, and "January 16, 2024, 23:59" is displayed in the end date and time selection area).

[0100] The imaging attribute selection area 15 is information that displays information indicating imaging attributes selected by receiving a user's operation input via the input interface. Examples of imaging attribute information include information indicating emergency and information indicating normal. As shown in Fig. 9A, the imaging attribute selection area 15 includes a display for turning the emergency mode "on" or "off," and receiving an operation input for the display via the input interface indicates that the information indicating emergency has been selected.

[0101] The search button 16 is a button that becomes operable to receive operation by the user when the input of the location information, desired period information, and imaging attribute information is completed, and by receiving the operation input, the button serves as a trigger for transmitting search request information including the input location information, desired period information, and imaging attribute information to the processing device 100. In other words, by receiving the operation input to the search button 16 via the input interface, the search request information including the above information is transmitted to the processing device 100 via the communication interface.

[0102] 5A , the processor of the first user terminal device 400-1 transmits first search request information (T11) to the processing device 100 via the communication interface. The first search request information includes the user ID information of the first user, as well as the location information (first imaging subject), desired period information, and imaging attribute information generated in S11. When the processor 111 of the processing device 100 receives the first search request information via the communication interface 113, it generates new instruction ID information and stores it in the instruction management table. Furthermore, the processor 111 of the processing device 100 stores the user ID information, location information, desired period information, and imaging attribute information of the first user included in the received search request information in the instruction management table in association with the newly generated instruction ID information (S12).

[0103] Then, the processor 111 of the processing device 100 determines whether or not imaging by the spacecraft 300 is possible under the conditions (location information, desired period information, and imaging attribute information) specified in the received first search request information (S13). Specifically, the processor 111 determines whether or not imaging by the spacecraft 300 is possible by determining whether or not the imaging target specified by the location information during the period specified by the desired period information is included in a range that can be imaged by the spacecraft 300.

[0104] Here, because the spacecraft 300 moves in orbit around the Earth, it can capture images of the target when it is positioned above the target, but it is not always possible to capture images. Therefore, the processing device 100 calculates and stores in advance the orbit of each spacecraft 300 and the range and time during which it is possible to capture images. Therefore, the processor 111 determines whether or not imaging is possible by comparing this pre-stored information with the desired period information and position information. In this way, the processor 111 of the processing device 100 determines whether or not imaging is possible based on the positional relationship between the spacecraft 300 and the target in the processing of S13, and does not make a determination based on priority at this point. This allows the first user to quickly determine whether or not imaging is possible.

[0105] If the processor 111 determines that imaging is not possible, it outputs information indicating that imaging is not possible to the first user terminal device 400-1 that transmitted the search request information via the communication interface 113. On the other hand, if the processor 111 determines that imaging is possible, it executes a process of extracting first candidate information for imaging (S14). Specifically, the processor 111 calculates a period during which imaging of the imaging target identified by the position information is possible from the desired period information and the time it takes for the spacecraft 300 to move above the imaging target. The processor 111 then selects at least one time during which imaging is possible from the period, and generates information indicating the selected time and the range that will actually be imaged at the selected time as first candidate information. The processor 111 associates the generated first candidate information with instruction ID information and stores it in the instruction management table, and transmits the generated first candidate information (T12) via the communication interface 113 to the first user terminal device 400-1 that transmitted the search request information, together with the instruction ID information.

[0106] When the processor of the first user terminal device 400-1 receives the first candidate information via the communication interface, it outputs a candidate display screen displaying the first candidate information via the output interface. Although not specifically shown, the candidate display screen includes a selection box for selecting a desired candidate from among multiple pieces of first candidate information and an input box for specifying desired delivery date information indicating the date and time when transmission of the captured image information will be completed. The processor of the first user terminal device 400-1 then accepts an operation input from the first user via the input interface and selects at least one piece of imaging time information from the first candidate information. The processor of the first user terminal device 400-1 also accepts input of desired delivery date information via the input interface. The processor of the first user terminal device 400-1 generates first instruction information including the selected or input imaging time information and desired delivery date information (S15).

[0107] The processor of the first user terminal device 400-1 transmits first instruction information (T13) including the imaging time information and desired delivery date information generated in S15 in addition to the instruction ID information to the processing device 100 via the communication interface. When the processor 111 of the processing device 100 receives the first instruction information via the communication interface 113, it stores the imaging time information and desired delivery date information included in the first instruction information in the instruction management table in association with the instruction ID information (S16).

[0108] The processor 111 of the processing device 100 executes a priority determination process using various information stored in the instruction management table to determine whether or not image capture is possible at the time specified by the image capture time information. Details of this process are described in FIG. 6A . Here, a case is illustrated in which, although there is other instruction information that overlaps with the image capture time information included in the first instruction information, the first instruction information is prioritized as a result of the priority determination process. Therefore, the processor 111 of the processing device 100 generates image capture schedule information based on the image capture time information specified by the first instruction information, associates it with the instruction ID information, and stores it in the instruction management table (S17). Although not described in detail here, other instruction information (e.g., second instruction information) that overlaps with the image capture time information of the first instruction information is also received from the second user terminal device 400-2 of the second user, similar to steps S11 to S16 of FIG. 5A.

[0109] Furthermore, the processor 111 of the processing device 100 executes a priority determination process using various information stored in the instruction management table to determine whether the captured image information can be transmitted by the time specified in the desired delivery date information. Details of this process are described in FIG. 6B . Here, a case is illustrated in which, although there is other image data whose transmission timing overlaps with that of the captured image data (first image data) between the time specified by the imaging time information determined in S17 and the time specified by the desired delivery date information included in the first instruction information, the result of the priority determination process indicates that the captured image data specified by the first instruction information is to be transmitted with priority. Therefore, the processor 111 of the processing device 100 generates transmission schedule information for the image data (date and time and identification data of the destination terrestrial station communication device 210) based on the desired delivery date information specified by the first instruction information, and stores the information in the instruction management table in association with the instruction ID information (S18).

[0110] At this time, the processor 111 of the processing device 100 determines the ground station communication device 210 that will be the transmission destination at the date and time specified by the determined transmission schedule, as described above. Then, the processor 111 of the processing device 100 stores identification data that specifies the determined ground station communication device 210 in the instruction management table in association with the instruction ID information.

[0111] The processor 111 reads the instruction ID information, the imaging schedule information, the position information indicating the imaging target, the transmission schedule information, and the identification data of the ground station communication device 210 that is the transmission destination from the instruction management table, and generates imaging instruction information including this information (S19). The processor 111 transmits the generated imaging instruction information (T14) to the management device 220 via the communication interface 113.

[0112] When the management device 220 receives the imaging instruction information, it stores the imaging instruction information in memory (S20). Then, the management device 220 transmits the imaging instruction information as control information to the spacecraft 300 determined similarly via the ground station communication device 210 determined by the combination determination function. Upon receiving the imaging instruction information, the spacecraft 300 performs imaging at the time specified by the imaging schedule information included in the imaging instruction information, so as to include the imaging target specified by the position information. This completes the processing sequence.

[0113] (2) Processing sequence when transmitting captured image data Next, as described above, Figure 5B shows the processing sequence executed between the spacecraft 300, the ground station communication device 210, and the management device 220 when image data captured in the spacecraft 300 is transmitted from the spacecraft 300 to the processing device 100.

[0114] 5A , the spacecraft 300 captures an image of the target to be captured so as to include the target to be captured, at the time specified by the imaging time information included in the imaging instruction information. Then, the control device 340 of the spacecraft 300 causes the processor 353 to associate the captured image data with the instruction ID information included in the imaging instruction information and store it in the memory 354. Furthermore, when the control device 340 of the spacecraft 300 receives, via the processor 353, the identification data of any one of the ground station communication devices 210 via the communication interface 359, the control device 340 determines that the spacecraft 300 has reached the communication range of that ground station communication device 210 (S31).

[0115] The control device 340 of the spacecraft 300 reads, by the processor 353, each piece of transmission schedule information (transmission date and time and identification data of the destination ground station communication device 210) from the multiple pieces of imaging instruction information previously received (S32). Then, by the processor 353, the control device 340 of the spacecraft 300 selects instruction ID information that has the same identification data as the identification data of the ground station communication device 210 currently within communication range and whose date and time specified by the transmission schedule information is the current date and time (S33). Then, by the processor 353, the control device 340 of the spacecraft 300 reads image data associated with the selected instruction ID information and sequentially transmits the image data (T31) and instruction ID information via the communication interface 359 to the ground station communication device 210 specified by the identification data.

[0116] When the processor of the ground station communication device 210 receives the image data and the instruction ID information, it stores the received image data in association with the instruction ID information (S34).Then, the processor of the ground station communication device 210 transmits the stored image data (T32) and instruction ID information to the connected image control device 230 via the communication interface.

[0117] When the processor of the image control device 230 receives the image data via the communication interface, it generates image information expressed in the form of a map using shades of color at each coordinate based on the coordinate, depth, and time information that constitutes the image data (S35).The processor of the image control device 230 then transmits the generated image information together with instruction ID information to the processing device 100 via the communication interface.

[0118] When the processor 111 of the processing device 100 receives the image information via the communication interface 113, it transmits the received image information to the user terminal device 400 of the user specified by the instruction ID information. This allows each user to obtain image information in which the desired imaging target has been captured by the date and time specified by the desired delivery date information. This completes the processing sequence.

[0119] 10. Processing Flow Executed by Processing Device 100 Figures 6A and 6B are diagrams showing processing flows executed by the processing device 100 according to an embodiment of the present disclosure. Specifically, Figure 6A is a diagram showing the processing flow executed in S17 of Figure 5A. Also, Figure 6B is a diagram showing the processing flow executed in S18 of Figure 5A. Each processing flow is performed mainly by the processor 111 of the processing device 100 reading and executing a program stored in the memory 112.

[0120] (1) Processing Flow for Determining Imaging Schedule Information Based on Priority According to FIG. 6A, this processing flow is initiated by receiving instruction information (e.g., first instruction information) from a user terminal device 400 (e.g., the first user terminal device 400-1). That is, upon receiving the instruction information via the communication interface 113, the processor 111 stores the imaging time information and desired delivery date information included in the instruction information in the instruction management table in association with the instruction ID information (S111). The processor 111 references the instruction management table and reads out various pieces of information associated with the instruction ID information included in the instruction information, which are used to calculate the priority (S112). Examples of such information include the following: User attribute information including at least one of classification information and plan information stored in the user management table Imaging attribute information indicating the urgency of imaging (i.e., the time until captured image information is provided to the user), which is stored in the instruction management table Frequency information indicating the frequency with which imaging was disabled due to priority (not shown in FIG. 4B).

[0121] When the processor 111 reads out the various types of information, it calculates a priority score as priority information (S113). Specifically, the processor 111 calculates the priority score by adding the following points-adding elements based on the various types of information that have been read out. For example, if the classification information is "Premium", the plan information is "Premium Plan", and the imaging attribute information is "Emergency", the processor 111 calculates a priority score of "16". - If the classification information in the user attribute information is "Premium", the processor 111 calculates "+3" and if it is "Normal", the processor 111 calculates "+1". - If the plan information in the user attribute information is "Premium Plan", the processor 111 calculates "+3" and if it is "Normal Plan", the processor 111 calculates "+10" and "+0", respectively.

[0122] Furthermore, the processor 111 weights the calculated priority score based on frequency information indicating the frequency with which imaging was not possible due to the priority. Specifically, the user can select one or more pieces of imaging time information from multiple pieces of candidate information. Therefore, if the time specified by the first selected imaging time information is determined to be unacceptable by the priority processing, the processor 111 calculates the frequency as "1." Furthermore, if both the first selected imaging time information and the time specified by the second selected imaging time information are determined to be unacceptable by the priority processing, the processor 111 calculates the frequency as "2." The processor 111 then weights the calculated frequency and calculates a weighted priority score. For example, if the frequency is "2" as described above, the processor 111 weights the priority score "16" by a coefficient of 1.5, thereby calculating the priority score as "24."

[0123] The processor 111 stores the calculated priority score in association with the instruction ID information as priority information in the instruction management table (S114).

[0124] The processor 111 reads the imaging time information included in the instruction information (e.g., the first instruction information) stored in S111 and other imaging schedule information already stored in association with other instruction ID information (e.g., other imaging schedule information including the imaging schedule information associated with the instruction ID information of the second instruction information), and determines whether there is other imaging schedule information that overlaps with the imaging time information (S115). If there is no overlapping imaging schedule information, the processor 111 determines imaging schedule information from the imaging time information included in the instruction information (e.g., the first instruction information) (S118). The processor 111 stores the determined imaging schedule information in the instruction management table in association with the instruction ID information, and proceeds to processing related to generation of a transmission schedule shown in S18 of FIG. 5A.

[0125] On the other hand, when there is other imaging schedule information that overlaps with the imaging time information, the processor 111 reads out the priority information associated with the instruction ID information of the instruction information (e.g., the first instruction information) and the priority information associated with the other overlapping imaging schedule information, and compares the priority scores (S116). Note that, although not described in detail here, the priority score is also calculated for other instruction information (e.g., the second instruction information) that overlaps with the imaging time information of the first instruction information, similarly to S111 to S114 of Fig. 6A, and is stored as priority information associated with the instruction ID information.

[0126] Then, if the priority score associated with the instruction ID information of the instruction information (e.g., first instruction information) is higher, the processor 111 determines the imaging schedule information from the imaging time information included in the instruction information (e.g., first instruction information) (S118). At this time, for other imaging schedule information with a lower priority score, the processor 111 generates imaging impossible information indicating that imaging has been canceled due to overlapping and imaging is impossible, and transmits the imaging impossible information to the user terminal device 400 of the user (e.g., second user terminal device 400-2) based on user ID information (e.g., user ID information of a second user) associated with the other imaging schedule information. This allows the user to quickly understand that imaging has been canceled and imaging is impossible.

[0127] Furthermore, if the priority score associated with the instruction ID information of the instruction information (e.g., first instruction information) is lower, the processor 111 generates imaging impossible information (S117). Then, the processor 111 transmits the imaging impossible information to the user terminal device 400 (e.g., the first user terminal device 400-1) of the user identified by the user ID information associated with the instruction ID information via the communication interface 113. This ends the processing flow.

[0128] In this way, by determining how to handle overlapping imaging in accordance with priority information, it is possible to more quickly and efficiently determine the instructions to be the subject of imaging.

[0129] In the example of FIG. 6A , various coefficients are used as the priority score, but it is not necessary to use all of these coefficients. It is also possible to use coefficients other than those used in FIG. 6A . For example, if the imaging attribute information is "urgent," it can be given top priority regardless of other information. Regarding the frequency used as a weighting coefficient, the weighting coefficient according to frequency may be other than the above, and weighting may be performed using any method other than multiplication, such as addition, subtraction, division, or an exponential function.

[0130] 6 illustrates a case where processing such as calculating the priority score is performed when instruction information is received, but these processes may be performed each time the information in either the instruction management table or the user management table is updated, which makes it possible to always process based on the latest priority information.

[0131] (2) Processing Flow for Determining Transmission Schedule Information Based on Priority According to FIG. 6B, steps S211 to S214 are the same as steps S111 to S114 in FIG. 6A. That is, when the processor 111 receives instruction information via the communication interface 113, it stores the imaging time information and desired delivery date information included in the instruction information in the instruction management table in association with the instruction ID information (S211). The processor 111 references the instruction management table and reads out various pieces of information associated with the instruction ID information included in the instruction information, which are used to calculate the priority (S212). Examples of such information include the following: User attribute information including at least one of classification information and plan information stored in the user management table; Imaging attribute information stored in the instruction management table indicating the urgency of imaging (i.e., the time until captured image information is provided to the user); and Frequency information indicating the frequency at which imaging was disabled due to priority (not shown in FIG. 4B).

[0132] When the processor 111 reads out the various types of information, it calculates a priority score as priority information (S213). Specifically, the processor 111 calculates the priority score by adding the following points-adding elements based on the various types of information that have been read out. For example, if the classification information is "Premium", the plan information is "Premium Plan", and the imaging attribute information is "Emergency", the processor 111 calculates a priority score of "16". - If the classification information in the user attribute information is "Premium", the processor 111 calculates "+3" and if it is "Normal", the processor 111 calculates "+1". - If the plan information in the user attribute information is "Premium Plan", the processor 111 calculates "+3" and if it is "Normal Plan", the processor 111 calculates "+10" and "+0", respectively.

[0133] Furthermore, the processor 111 weights the calculated priority score based on frequency information indicating the frequency with which imaging was not possible due to the priority. Specifically, the user can select one or more pieces of imaging time information from multiple pieces of candidate information. Therefore, if the time specified by the first selected imaging time information is determined to be unacceptable by the priority processing, the processor 111 calculates the frequency as "1." Furthermore, if both the first selected imaging time information and the time specified by the second selected imaging time information are determined to be unacceptable by the priority processing, the processor 111 calculates the frequency as "2." The processor 111 then weights the calculated frequency and calculates a weighted priority score. For example, if the frequency is "2" as described above, the processor 111 weights the priority score "16" by a coefficient of 1.5, thereby calculating the priority score as "24."

[0134] The processor 111 stores the calculated priority score in association with the instruction ID information in the instruction management table as priority information (S214).

[0135] Next, the processor 111 identifies a transmission timing (transmission slot) during which communication with the ground station communication device 210 is possible between the time specified by the imaging schedule information determined by S118 in Figure 6A and the time specified by the desired delivery date information included in the instruction information (S215).

[0136] 7A is a diagram illustrating an example of transmission schedule control executed by the processing device 100 according to an embodiment of the present disclosure. Specifically, FIG. 7A is a diagram conceptually illustrating a process of determining transmission schedule information based on priority by the processor 111 of the processing device 100. According to FIG. 7A, each transmission slot is identified by the time during which communication with the spacecraft 300 is possible (e.g., the time of passing through range T1 in FIG. 1A ) and the identification data of the ground station communication device 210 with which communication is possible. For example, transmission slot 1 is identified by the identification data of the first communication device 210-1 and the time during which communication is possible.

[0137] 7A shows that transmission slots 2, 3, and 4 exist between the time specified by the imaging schedule information associated with the instruction ID information of the first instruction information ("Imaging 1" in FIG. 7A) and the time specified by the desired delivery date information associated with the instruction ID information ("Imaging 1 (desired delivery date)" in FIG. 7A). Therefore, in S215 of FIG. 6B, the processor 111 specifies transmission slots 2, 3, and 4 for the first instruction information as the transmission timings at which the captured image data can be transmitted.

[0138] 6B, the processor 111 determines whether the transmission slot identified in S215 has already been filled with other transmission schedule information (e.g., transmission schedule information associated with the instruction ID information of the second instruction information) (S216). If the processor 111 determines that the transmission slot is not filled with other transmission schedule information, it assigns the earliest transmission slot (e.g., transmission slot 2) among the identified transmission slots (S218). That is, the processor 111 stores the time identified by the assigned transmission slot (e.g., transmission slot 2) and the identification data of the ground station communication device 210 identified by the assigned transmission slot as transmission schedule information. In this way, the processor 111 determines the transmission schedule information.

[0139] On the other hand, if the processor 111 determines that the transmission slot identified in S215 has already been filled with other transmission schedule information (e.g., transmission schedule information associated with the instruction ID information of the second instruction information), it reads out the priority information associated with the instruction ID information of the instruction information (e.g., the first instruction information) and the priority information associated with the other overlapping transmission schedule information, and compares the priority scores (S217). Note that, although not described in detail here, the priority scores are also calculated for the other instruction information (e.g., the second instruction information) that overlaps with the transmission slot of the first instruction information, as in S211 to S214 of FIG. 6B, and are stored as priority information associated with the instruction ID information.

[0140] If the priority score associated with the instruction ID information of the instruction information (e.g., first instruction information) is lower, the processor 111 allocates the remaining transmission slots from among the transmission slots identified for the first instruction information in S215, excluding the overlapping transmission slots (S219). The processor 111 then stores, as transmission schedule information, each time period identified by the allocated transmission slots (e.g., transmission slot 2 and transmission slot 3) and the identification data of the respective ground station communication devices 210 identified by the transmission slots. The processor 111 then determines the transmission schedule information. If it is not possible to allocate all of the transmission slots due to overlaps with other transmission schedule information, it generates imaging disabled information (S219).

[0141] 7A shows a case where, among the transmission slots for image data captured by capturing an image of the first instruction information ("Capture 1" in FIG. 7A), the earliest transmission slot 2 overlaps with other transmission schedule information (for example, transmission schedule information associated with the instruction ID information of the second instruction information, which is the transmission slot for image data B of "Capture 2" in FIG. 7A). In this case, as explained in S217 of FIG. 6B, the priority information associated with the instruction ID information of the first instruction information is lower than the priority information associated with the instruction ID information of the second instruction information, so only a portion of the image data is transmitted in the earliest transmission slot 2, and the remaining portion is transmitted in the next transmission slot (transmission slot 3).

[0142] 8A and 8B are diagrams illustrating an example of image data control executed in the processing device 100 according to an embodiment of the present disclosure. Specifically, Fig. 8A is a diagram illustrating an example of a division method when the image data A shown in Fig. 7A is divided and transmitted. Also, Fig. 8B is a diagram illustrating another example of a division method when the image data A shown in Fig. 7A is divided and transmitted.

[0143] According to FIG. 8A , as shown in FIG. 7A , the image data A is divided into divided image data A-1 and divided image data A-2 based on the priority by processing by the processor 353 of the spacecraft 300. Here, the amount of data that can be transmitted in each transmission slot is determined by the available communication time between the spacecraft 300 and the ground station communication device 210 and the communication speed between the spacecraft 300 and the ground station communication device 210. Therefore, the processor 111 of the processing device 100 calculates the amount of data that can be transmitted in transmission slot 2 based on the available communication time and communication speed in advance. The processor 111 of the processing device 100 also calculates the data amount of each image data item based on the resolution of the image data. Then, the processor 111 calculates the remaining amount of data that can be transmitted in transmission slot 2 by subtracting the data amount of image data B captured in imaging 2 from the data amount that can be transmitted in transmission slot 2. FIG. 8A illustrates a case where image data A with a data amount corresponding to this remaining data amount is transmitted as divided image data A-1.

[0144] In this way, the processor 111 of the processing device 100 determines transmission schedule information so that image data (e.g., image data A) captured based on priority is divided into multiple pieces of divided image data and transmitted. Furthermore, for each piece of divided image data (e.g., divided image data A-1) to be transmitted in a transmission slot (e.g., transmission slot 2) specified in the previous transmission schedule information, the processor 111 of the processing device 100 sets the data amount of the divided image data so that the data amount corresponds to the amount of data that can be transmitted remaining in that transmission slot, and for the remaining divided image data (e.g., divided image data A-2), the processor 111 sets the data amount of the remaining divided image data so that the data amount in the next transmission slot (e.g., transmission slot 3) is as small as possible. Therefore, the processor 111 of the processing device 100 can secure a larger data amount in the next transmission slot (e.g., transmission slot 3) as a transmission slot for other image data.

[0145] Furthermore, the processor 353 of the spacecraft 300 divides the captured image data with a low priority (e.g., image data A) into divided image data and transmits them in accordance with the schedule information determined as described above. Furthermore, the processor 353 of the spacecraft 300 generates and transmits divided image data (e.g., divided image data A-1) in accordance with the schedule information determined as described above, such that the amount of data for each divided image data is equivalent to the amount of data that can be transmitted remaining in the transmission slot (e.g., transmission slot 2) specified in the previous transmission schedule information. This makes it possible to effectively utilize the amount of data that can be communicated. Furthermore, the processor 353 of the spacecraft 300 transmits the remaining divided image data (e.g., divided image data A-2) in the next transmission slot (e.g., transmission slot 3), but can use the next transmission slot (e.g., transmission slot 3) as a transmission slot for other image data, thereby ensuring a larger amount of data.

[0146] Next, Fig. 8B shows a case in which image data A is divided into divided image data A-1 and divided image data A-2 based on the priority by processing by processor 353 of spacecraft 300, similar to Fig. 8A. However, Fig. 8B shows an example in which image data A is divided into predetermined units and divided into the divided units.

[0147] As shown in FIG. 8B, the processor 111 of the processing device 100 determines transmission schedule information so that image data (e.g., image data A) captured based on priority is divided into multiple pieces of divided image data and transmitted. At this time, the processor 111 of the processing device 100 divides the image data A into predetermined units and sets divided image data A-1 and divided image data A-2 based on one or more divided units of image data. Note that this unit can be set in any desired manner, such as: A method in which the total amount of image data A is divided equally (e.g., in half) into one unit; or A method in which the image data is divided by the type of data included in the image data A (e.g., by dividing the image data by information indicating depth and information indicating time). Therefore, the processor 111 of the processing device 100 can set the divided image data through simpler processing.

[0148] Furthermore, the processor 353 of the spacecraft 300 divides the captured image data with a low priority (for example, image data A) into divided image data and transmits the divided image data in accordance with the schedule information determined as described above. Furthermore, the processor 353 of the spacecraft 300 divides each divided image data into predetermined units in accordance with the schedule information determined as described above, and generates divided image data A-1 and divided image data A-2 from one or more divided units of image data. Therefore, the processor 353 of the spacecraft 300 can set the divided image data with simpler processing.

[0149] 6B , if the priority score associated with the instruction ID information of the instruction information (e.g., the first instruction information) is higher, the processor 111 of the processing device 100 allocates the earliest transmission slot among the transmission slots identified for the first instruction information in S215 (S220). That is, the processor 111 stores, as transmission schedule information, the time identified by the allocated transmission slot (e.g., transmission slot 2) and the identification data of the ground station communication device 210 identified by the transmission slot. In this way, the processor 111 determines the transmission schedule information.

[0150] Furthermore, the processor 111 of the processing device 100 updates the transmission schedule information previously determined for the instruction information (e.g., the second instruction information) that has a lower priority score than the instruction ID information of the instruction information (e.g., the first instruction information). That is, the processor 111 reallocates the transmission of image data for the instruction ID information of the second instruction information to another available transmission slot, and updates the transmission schedule information at a time specified by the transmission slot.

[0151] Here, FIG. 7B is a diagram illustrating an example of transmission schedule control executed by the processing device 100 according to an embodiment of the present disclosure. Specifically, similar to FIG. 7A , FIG. 7B is a diagram conceptually illustrating a process of determining transmission schedule information based on priority by the processor 111 of the processing device 100. FIG. 7B illustrates a case in which the imaging of the first instruction information ("Imaging 1" in FIG. 7B ) has a higher priority score than the imaging of the second instruction information ("Imaging 2" in FIG. 7B ) due to, for example, imaging attribute information being "urgent." Therefore, while image data B captured by imaging 2 was previously assigned transmission schedule information for transmission slot 2 according to the transmission schedule information, transmission slot 2 is now assigned to the transmission slot for image data A of imaging 1. Furthermore, image data B is divided into divided image data using the division method of FIG. 8A or FIG. 8B , and the transmission schedule information is updated so that the image data B is transmitted in transmission slots 2 and 3.

[0152] Returning to FIG. 6B again, the processing flow ends with the above processing.

[0153] In this way, by determining the transmission schedule of image data according to the priority of imaging, it is possible to determine the transmission schedule of image data more efficiently.

[0154] In the example of FIG. 6B , various coefficients are used as the priority score, but it is not necessary to use all of these coefficients. It is also possible to use coefficients other than those used in FIG. 6B . For example, if the imaging attribute information is "urgent," it can be given the highest priority regardless of other information. Regarding the frequency used as a weighting coefficient, the weighting coefficient according to frequency may be other than the above, and weighting may be performed using any method other than multiplication, such as addition, subtraction, division, or an exponential function.

[0155] 6B illustrates a case where processing such as calculating the priority score is performed when instruction information is received, but these processes may be performed each time the information in either the instruction management table or the user management table is updated, which makes it possible to always perform processing based on the latest priority information.

[0156] As described above, in this embodiment, it is possible to provide a processing device, a processing program, a processing method, and a processing system that can process image pickup more efficiently.

[0157] 11. Others In FIG. 1, a ground station communication device including a first communication device 210-1 and a second communication device 210-2 is used to relay communications between the management device 220 and the spacecraft 300. However, it is also possible to use multiple small wireless devices in addition to or instead of this. Such small wireless devices are particularly suitable for transmitting control information to the spacecraft 300. Therefore, the management device 220 transmits control information to the spacecraft 300 via these small wireless devices. By using small wireless devices that are less restrictive in terms of installation and transportation, etc., to transmit control information, more flexible and efficient operation is possible.

[0158] 1, the case has been described in which the first spacecraft 300-1 is, for example, the source of the control information from the management device 220 and the image data to the image control device 230. However, instead of this, the spacecraft 300 that is the destination of the control information from the management device 220 and the source of the image data to the image control device 230 may be different from each other.

[0159] As described above, each spacecraft 300 moves around the Earth in an orbital pattern, and therefore is not always able to communicate with devices on the ground. Therefore, the control must take into account periods when communication is not possible. However, by communicating with devices on the ground via other spacecraft that can communicate with each other, more flexible communication becomes possible.

[0160] FIG. 10 is a block diagram showing a configuration of a processing system 1 according to an embodiment of the present disclosure. According to FIG. 10 , the combination determination function of the management device 220 transmits control information to the first spacecraft 300-1 when the first communication device 210-1 and the first spacecraft 300-1 are capable of communicating with each other. If the first spacecraft 300-1 is unable to transmit image data to the image control device 230 at the timing when the image data is acquired by the first spacecraft 300-1, the first spacecraft 300-1 transmits the image data via satellite communication to another first spacecraft (e.g., the second spacecraft 300-2) that is capable of inter-satellite communication with the first spacecraft 300-1 and that can communicate with the image control device 230 earlier than the first spacecraft 300-1. The second spacecraft 300-2 then transmits the received image data to the image control device 230.

[0161] Conversely, when the combination determination function of the management device 220 is unable to transmit control information (e.g., imaging instruction information) to the second spacecraft 300-2 that is determined to be most suitable for imaging, the control information (e.g., imaging instruction information) is transmitted to another spacecraft (e.g., the first spacecraft 300-1) that can communicate with the second spacecraft 300-2 and can communicate with the management device 220 earlier than the second spacecraft 300-2. The first spacecraft 300-1 then transmits the received control information to the second spacecraft 300-2 via inter-satellite communication.

[0162] This allows for more flexible communication by communicating with each device on the ground via other spacecraft that can communicate with the device.

[0163] 5B , each piece of image data captured in accordance with predetermined transmission schedule information is transmitted from the spacecraft 300 to the ground station communication device 210. However, the spacecraft 300 may not transmit the image data normally due to, for example, a malfunction in controlling the attitude of the spacecraft 300 during image data transmission, a low battery level, or an inability to identify the ground station communication device 210 due to a malfunction in receiving location information. Thus, when the processor 111 of the processing device 100 detects that image data could not be received in accordance with the predetermined transmission schedule information, it identifies at least some of the image data that was not normally transmitted, temporarily increases the priority score associated with the instruction ID information related to the image data, and again executes processing related to allocating a transmission slot and determining transmission schedule information. Then, the processor 111 of the processing device 100 transmits a retransmission instruction including the re-determined transmission schedule information to the spacecraft 300 via the communication interface 113.

[0164] This allows flexible instruction to retransmit image data even if a problem occurs in the transmission of the image data.

[0165] Furthermore, in each of the processes in Figures 1 to 10, each process performed due to the first user terminal device 400-1 and each process performed due to the second user terminal device 400-2 can be processed in the same way in the other user terminal device and other user terminal devices.

[0166] It should be noted that the embodiments and modifications of the present disclosure are presented as examples and are not intended to limit the scope of the present disclosure. The present embodiments and modifications can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the present disclosure. These embodiments and modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as set forth in the claims.

[0167] 1 Processing system 100 Processing device 210 Ground station communication device 210-1 First communication device 210-2 Second communication device 220 Management device 230 Image control device 300-1 First spacecraft 300-2 Second spacecraft 400 User terminal device 400-1 First user terminal device 400-2 Second user terminal device

Claims

1. A processing device having at least one processor used for imaging by a spacecraft capable of imaging the Earth, wherein the at least one processor is configured to execute a process to: receive first instruction information for instructing imaging of a first imaging target on the Earth from a first user terminal device available to a first user; receive second instruction information for instructing imaging of a second imaging target on the Earth from a second user terminal device available to a second user different from the first user; and determine a transmission schedule for transmitting first image data obtained by imaging the first imaging target and second image data obtained by imaging the second imaging target from the spacecraft based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

2. The processing device according to claim 1, wherein the at least one processor calculates the amount of data that can be transmitted in the transmission schedule, and the transmission schedule is determined based on the priorities and the amount of data.

3. The processing device according to claim 2, wherein the amount of data is calculated based on the communication time between the spacecraft and the receiving device to which the data is to be transmitted, and the communication speed between the spacecraft and the receiving device.

4. The processing device described in claim 1, wherein the priority is set based on at least one of user attribute information of the first user and the second user, and the period until image information set for each of the first imaging target and the second imaging target is provided to the first user or the second user.

5. The processing device according to claim 1, wherein the priority is weighted based on the frequency with which imaging is disabled.

6. The processing device of claim 1, wherein the at least one processor transmits the determined transmission schedule to the spacecraft together with transmitting at least one of the first instruction information and the second instruction information to the spacecraft.

7. The processing device according to claim 1, wherein at least one of the first image data and the second image data is divided into a plurality of divided image data, and at least one of the plurality of divided image data is transmitted according to the transmission schedule.

8. The processing device according to claim 1, wherein one of the first image data and the second image data determined based on the priority is divided into a plurality of divided image data, and at least one of the plurality of divided image data is transmitted according to the transmission schedule.

9. The processing device of claim 1, wherein another transmission schedule different from the transmission schedule is determined so that other divided image data not transmitted in the transmission schedule is transmitted by the time specified by either the first user or the second user who specified the capture of the other divided image data.

10. A processing device as described in claim 1, wherein if transmission from the spacecraft of either the first image data or the second image data is not performed normally, an instruction to retransmit at least a portion of the first image data and the second image data that was not transmitted normally is transmitted to the spacecraft.

11. The processing device according to claim 1, wherein the at least one processor is configured to execute processing for setting a higher priority when instruction information for instructing emergency imaging is received.

12. The processing device of claim 1, wherein at least one of the first image data and the second image data is transmitted from the spacecraft via inter-satellite communication with another spacecraft different from the spacecraft.

13. A processing program for causing a computer used for imaging by a spacecraft capable of imaging the Earth to execute a process to: acquire first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth; acquire second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth; and determine a transmission schedule for transmitting the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target from the spacecraft based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

14. A processing method executed by at least one processor in a computer used for imaging by a spacecraft capable of imaging the Earth, comprising: a step of acquiring first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth; a step of acquiring second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth; and a step of determining a transmission schedule for transmitting from the spacecraft the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target, based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

15. A processing system comprising: a spacecraft configured to be able to image the Earth; and a processing device configured to be able to control imaging by the spacecraft, and having at least one processor, wherein the at least one processor is configured to execute processes to: acquire first image data based on first instruction information received from a first user terminal device available to a first user to instruct imaging of a first imaging target on the Earth; acquire second image data based on second instruction information received from a second user terminal device available to a second user different from the first user to instruct imaging of a second imaging target on the Earth; and determine a transmission schedule for transmitting the first image data obtained by imaging the first imaging target and the second image data obtained by imaging the second imaging target from the spacecraft based on priorities set according to at least one of the first user and the second user and the first instruction information and the second instruction information.

Images