Observation support device, observation support method, and program

JP7754292B2Active Publication Date: 2025-10-15NEC CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024511638
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-03-28
Filing Date
2023-03-09
Publication Date
2025-10-15
Estimated Expiration
2043-03-09

AI Technical Summary

Technical Problem

Existing imaging plan creation devices for satellites do not support the generation of satellite commands to control imaging and do not present a pseudo image corresponding to the target area that will be captured, making it difficult for inexperienced operators to plan and execute satellite imaging.

Method used

An observation support device and method that generates a target area pseudo image and corresponding control command information using moving object position and direction information, allowing operators to easily generate control commands for satellite imaging.

Benefits of technology

Enables inexperienced operators to generate control command information for satellite imaging by presenting a pseudo image and associated commands, facilitating intuitive and accurate target area selection and imaging planning.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007754292000001
    Figure 0007754292000001
  • Figure 0007754292000002
    Figure 0007754292000002
  • Figure 0007754292000003
    Figure 0007754292000003
Patent Text Reader

Abstract

An observation assistance device 10 for assisting generation of control command information used for observation of a moving object has: a target area pseudo image generating unit 11 that generates a target area pseudo image representing a target area predicted when the target area is imaged from the viewpoint of a moving object moving along a trajectory; and a control command information generation unit 12 that, when the target area pseudo image is selected by an operator, generates control command information for making the moving object observe an observation image of the actual target area corresponding to the target area pseudo image, on the basis of moving object position information representing the position of the moving object and moving object direction information representing the direction of the moving object, which were used when the selected target area pseudo image was generated.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technical field relates to an observation support device and an observation support method that support observations using a moving object that moves along an orbit, and further to a program for realizing these. Mu Regarding. [Background technology]

[0002] When an operator uses an imaging device mounted on a satellite to capture an image of a desired target area, the operator plans the imaging by imagining the image of the target area that is predicted to be actually captured.

[0003] However, in order to imagine and plan the image of the target area that is expected to be actually captured by the imaging device, it is necessary to take into account the position of the satellite in orbit, the direction (attitude) that the satellite is facing at that position, and the time that the satellite will arrive at that position.

[0004] Therefore, currently, plans are drawn up by experienced and skilled operators. In other words, it is difficult for an operator with little experience to plan an image of the target area that is predicted to be actually captured by the imaging device.

[0005] Furthermore, in order for an operator to capture an image of a target area that the operator desires, control instruction information (satellite commands) for controlling the satellite must be generated based on the imaging plan.

[0006] As a related technique, Patent Document 1 discloses an imaging plan creation device that extracts points where changes have occurred from points of interest and prioritizes imaging of the extracted points. The imaging plan creation device of Patent Document 1 compares first imaging data captured by an airborne object (artificial satellite) with second imaging data captured in the past, and sets imaging priorities based on the comparison results.

[0007] Furthermore, the imaging plan creation device of Patent Document 1 determines whether imaging is possible at the observation time. After that, the imaging plan creation device of Patent Document 1 creates an imaging plan based on the imaging priority and the imaging possibility determination, converts the imaging plan into a satellite command, and transmits the satellite command to the flying object. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-028759 Summary of the Invention [Problem to be solved by the invention]

[0009] However, the imaging plan creation device of Patent Document 1 generates an imaging plan for imaging points (observation targets) extracted from an artificial satellite, but does not support the generation of satellite commands used to control imaging by the artificial satellite.

[0010] In other words, it does not involve presenting a pseudo image corresponding to an image of the target area that is predicted to be actually captured by the imaging device to the operator in advance, and then generating satellite commands based on the presented pseudo image.

[0011] As one aspect, an observation support device and an observation support method for supporting the generation of control command information used in observations performed by a moving object, program The purpose is to provide. [Means for solving the problem]

[0012] In order to achieve the above object, an observation support device in one aspect comprises: a target area pseudo image generation unit that generates a target area pseudo image representing a target area that is predicted when the target area is imaged from the viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along a trajectory in a space above the Earth's surface; a control command information generation unit that, when the target area pseudo image is selected by an operator, generates control command information to be used to control at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, in order to have the moving object observe an observation image of the actual target area corresponding to the target area pseudo image, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object that were used when the selected target area pseudo image was generated; The present invention is characterized by having the following.

[0013] In order to achieve the above object, an observation support method in one aspect includes: a target area pseudo image generating step of generating a target area pseudo image representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; a control command information generation step, when the target area pseudo image is selected by an operator, for generating control command information to be used for controlling at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object, which were used when the selected target area pseudo image was generated; The present invention is characterized by having the following.

[0014] Furthermore, in order to achieve the above object, in one aspect program teeth, On the computer, a target area pseudo image generating step of generating a target area pseudo image representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; a control command information generation step, when the target area pseudo image is selected by an operator, for generating control command information to be used for controlling at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object, which were used when the selected target area pseudo image was generated; Run Ruko It is characterized by the following. [Effects of the Invention]

[0015] As one aspect, it can assist in generating control command information to be used for observations made by a moving body. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram illustrating an example of an observation support device. [Figure 2] FIG. 2 is a diagram illustrating an example of a system including an observation support device. [Figure 3] FIG. 3 is a diagram for explaining the generation of the target area pseudo image. [Figure 4] FIG. 4 is a diagram for explaining the generation of the target area pseudo image. [Figure 5] FIG. 5 shows a pseudo image of the target area with shadows added. [Figure 6] FIG. 6 is a diagram showing the contents of the control command information displayed in the target area pseudo image. [Figure 7] FIG. 7 is a diagram for explaining the operation of the observation support device. [Figure 8] FIG. 8 is a diagram illustrating an example of a computer that realizes the observation support device according to the embodiment and the first and second modifications. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, embodiments will be described with reference to the drawings. In the drawings described below, elements having the same or corresponding functions are denoted by the same reference numerals, and repeated description thereof may be omitted.

[0018] (Embodiment) The configuration of an observation support device in an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an example of an observation support device.

[0019] [Device configuration] The observation support device 10 shown in Fig. 1 is a device that presents a pseudo image corresponding to an image of a target area that is predicted to be actually captured by an imaging device to an operator in advance, and generates control command information based on the presented pseudo image. Also, as shown in Fig. 1, the observation support device 10 has a target area pseudo image generation unit 11 and a control command information generation unit 12.

[0020] The target area pseudo image generation unit 11 generates a target area pseudo image representing the target area that is predicted when the target area is imaged from the viewpoint of a moving body moving along an orbit in space above the earth's surface and equipped with an observation device for observing the earth's surface.

[0021] A mobile object moves in space above the earth's surface along a predetermined orbit. The mobile object is, for example, a flying object such as an artificial satellite or an unmanned aerial vehicle. When the artificial satellite is an observation satellite or the like, the orbit is, for example, a satellite orbit. In the case of an unmanned aerial vehicle, the orbit is a flight route that is predetermined by the operator.

[0022] The observation device is, for example, various sensors used for observing the Earth's surface. In the case of an observation satellite, the observation device is mission equipment such as an optical sensor such as a camera, or a synthetic aperture radar (SAR).

[0023] When a target area pseudo image is selected by the operator, the control command information generation unit 12 generates control command information to be used to control at least the time when the mobile body observes the target area, the position at which the mobile body observes, and the direction in which the mobile body observes, in order to have the mobile body observe an observation image of the actual target area corresponding to the target area pseudo image, based on mobile body position information indicating the position of the mobile body and mobile body direction information indicating the direction of the mobile body that were used when generating the selected target area pseudo image.

[0024] The mobile object position information is, for example, information such as the latitude, longitude, and altitude of the mobile object. The mobile object direction information is, for example, information such as the angle of incidence represented by the position of the target area and the position of the mobile object. The observation image is an image actually captured by the observation device.

[0025] If the moving object is an observation satellite, the control command information is control information (satellite commands) transmitted from a ground operation station (hereafter referred to as the station) to the satellite. If the moving object is an unmanned aircraft, the control command information is control information for controlling the unmanned aircraft.

[0026] In this manner, in the embodiment, when an operator plans to observe an image of a desired target area using an observation device mounted on a mobile object, the operator can automatically generate control command information including information necessary for controlling the mobile object simply by selecting a target area pseudo image of the target area that the operator wants to observe. As a result, even an operator who is not an experienced or skilled person can easily generate control command information.

[0027] [System Configuration] The configuration of the observation support device 10 in this embodiment will be described in more detail below. Fig. 2 is a diagram showing an example of a system including the observation support device.

[0028] As shown in FIG. 2, the system 100 includes an observation support device 10, a mobile object 20, a station 30, a storage device 40, a display device 50, an input device 60, and a network 70.

[0029] The observation support device 10 is, for example, an information processing device such as a CPU (Central Processing Unit), a programmable device such as an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), or a circuit equipped with one or more of these, a server computer, a personal computer, or a mobile terminal.

[0030] The mobile object 20 is a flying object such as an artificial satellite or an unmanned aerial vehicle that moves along a predetermined orbit in the space above the earth's surface. An artificial satellite is, for example, an observation satellite that observes planets such as the earth. An unmanned aerial vehicle is, for example, a drone.

[0031] In the following description, the moving body 20 is assumed to be an observation satellite, and the observation device is assumed to be an optical sensor such as a camera.

[0032] When the mobile body 20 is an observation satellite, the station 30 is a transmitting / receiving station that has the function of generating a transmission signal including a satellite command and transmitting it to the observation satellite, and the function of receiving reception information such as telemetry data and mission data from the observation satellite.

[0033] The mission data is, for example, observation data (e.g., observation images, etc.) The observation data is, for example, an image obtained when the mobile object 20 actually observes the target area, which corresponds to a pseudo image of the target area selected by the operator.

[0034] The storage device 40 is a database, a server computer, a circuit with memory, or the like. The storage device 40 stores, for example, at least information such as orbital information relating to the orbits of observation satellites and map information. In the example of Fig. 2, the storage device 40 is provided outside the observation support device 10, but it may also be provided inside the observation support device 10. Note that the map information may be obtained from a site that provides various maps via a web browser.

[0035] The display device 50 is, for example, a display device using a liquid crystal, an organic EL (Electro Luminescence), a CRT (Cathode Ray Tube), etc. The input device 60 is, for example, a device such as a mouse, a keyboard, or a touch panel.

[0036] Network 70 is a general network constructed using communication lines such as the Internet, a LAN (Local Area Network), a dedicated line, a telephone line, an in-house network, a mobile communication network, Bluetooth (registered trademark), or WiFi (Wireless Fidelity).

[0037] The observation support device 10 will now be described in detail. As shown in FIG. 2, the observation support device 10 includes a target area pseudo image generator 11, a control command information generator 12, and a communication unit 13.

[0038] The target area pseudo image generator 11 generates a target area pseudo image predicted when the target area is imaged from the viewpoint of an observation device (optical sensor) mounted on an observation satellite (mobile body 20). That is, it is possible to generate an image (pseudo image) that gives the impression that the operator is on board the observation satellite and has taken a picture of the target area using a camera.

[0039] Specifically, first, the target area pseudo image generator 11 acquires information representing the viewpoint of an optical sensor mounted on an observation satellite for capturing an image of the target area, which information is input by the operator using the display device 50 and the input device 60. The information representing the viewpoint includes moving object position information and moving object direction information.

[0040] Next, the target area pseudo image generation unit 11 receives the moving object position information, moving object direction information, and map information of the target area as input, generates a target area pseudo image using an existing simulator, for example, a simulator using a library such as CESIUM, and displays the generated target area pseudo image on the display device 50.

[0041] The simulator may be provided inside the target area pseudo image generating unit 11. Alternatively, a device having the function of a simulator may be provided outside the target area pseudo image generating unit 11, and the simulation may be performed using this device.

[0042] The map information is two-dimensional or three-dimensional map information. The map information includes two-dimensional or three-dimensional information such as buildings. The target area pseudo image is a two-dimensional or three-dimensional map image. The target area pseudo image includes not only images of the terrain but also images of buildings.

[0043] The generation of the target area pseudo image will be described with reference to Figures 3 and 4. Figures 3 and 4 are diagrams for explaining the generation of the target area pseudo image.

[0044] First, the target area pseudo image generating unit 11 uses an existing simulator, such as a simulator using a library such as CESIUM, to display an image of the whole or part of the Earth (or planet) on the display device 50 at the start of operation so that the operator can specify the target area. In the example of Fig. 3, an image 32 representing a part of the Earth is displayed on the image 31.

[0045] For example, suppose an operator refers to image 31 displayed on display device 50 and uses input device 60 such as a mouse to specify image 33 (dashed area) corresponding to the target area of ​​image 32, which represents a part of the Earth.

[0046] Then, the target area pseudo image generating unit 11 uses an existing simulator, such as a simulator using a library such as CESIUM, to enlarge the specified image 33, and displays an image 34 corresponding to the enlarged target area on the display device 50. The image 34 displays, for example, an image corresponding to the topography of the target area (e.g., rivers, mountains, roads, etc.) and images corresponding to target area structures 35a to 35f.

[0047] Next, if the image 34 displayed on the display device 50 is not the desired pseudo image of the target area, the operator moves the viewpoint using an input device 60 such as a mouse. For example, if the target building is blocked by other buildings and cannot be captured properly, the operator moves the viewpoint to a position where the target building can be captured properly.

[0048] For example, as shown in image 34 in Fig. 4, a trajectory 41 (broken line) and a viewpoint 42 (marked with an x) are displayed, and an input device 60 such as a mouse is used to move the viewpoint 42 along the trajectory 41. Then, the target area pseudo image generating unit 11 generates a new target area pseudo image seen from the viewpoint 42 using the moving object position information and moving object direction information corresponding to the viewpoint 42 and map information of the target area.

[0049] In addition to moving the viewpoint, the attitude of the observation satellite (the direction in which the target area is imaged) may be changed. If the optical sensor mounted on the observation satellite has a magnification change function (zoom), the magnification may be changed using the input device 60.

[0050] Furthermore, an image simulating an observation satellite may be displayed at the viewpoint 42. In this case, the observation direction of the observation satellite may be changed by manipulating the image of the observation satellite using an input device 60 such as a mouse.

[0051] Note that the viewpoint may be moved without displaying the trajectory 41 (broken line) and the viewpoint 42 (x mark) as shown in Fig. 4. In this case, the viewpoint may be moved based on a series of preset mouse operations using an input device 60 such as a mouse, and a new target area pseudo image may be generated.

[0052] Next, if the newly generated pseudo image of the target area displayed on the display device 50 is the pseudo image of the target area desired by the operator, the operator uses an input device 60 such as a mouse to select the newly generated pseudo image of the target area.

[0053] As mentioned above, observation satellites move in orbit and capture images of a target area from their positions on the orbit. Therefore, they cannot capture images of the target area from all directions. In other words, the directions in which the target area can be captured are limited, so it is not always possible to capture the pseudo image of the target area that the operator desires.

[0054] Therefore, the target area pseudo image generation unit 11 is used to generate a pseudo image of the target area captured from the viewpoint of the optical sensor mounted on the observation satellite, i.e., a target area pseudo image corresponding to the target area within the range that can be captured by the optical sensor, and presents it to the operator.

[0055] This allows the operator to move the viewpoint until the desired pseudo image of the target area is obtained. In other words, the pseudo image of the target area is generated in real time for each viewpoint and presented to the operator, so the operator can intuitively obtain the desired pseudo image of the target area.

[0056] When a target area pseudo image is selected by the operator, the control command information generation unit 12 generates control command information based on the moving body position information and moving body direction information used when the selected target area pseudo image was generated.

[0057] Specifically, first, the control command information generating unit 12 acquires the moving object position information and moving object direction information used when the selected target area pseudo image was generated.

[0058] Next, the control command information generation unit 12 calculates the position and direction in which the observation satellite will image the target area, to be used in the control command information, based on the moving object position information and moving object direction information used when the selected target area pseudo image was generated.

[0059] The control command information generation unit 12 also calculates the time when the observation satellite can capture an observation image corresponding to the selected target area pseudo image, which is used in the control command information. The time is calculated as the date and time when the observation satellite can capture an image based on the calculated imaging position and direction. The control command information generation unit 12 then generates control command information and outputs the control command information to the communication unit 13. Alternatively, the control command information generation unit 12 stores the control command information in the storage device 40.

[0060] The communication unit 13 acquires the generated control command information from the control command information generation unit 12 and transmits the control command information to the network. 70 The control command information is then transmitted to the station 30 via the control command information modulator 30. The station 30 then transmits the modulated signal to the observation satellite.

[0061] (Variation 1) In the first modification, a shadow is added to the target area pseudo image in order to make the target area pseudo image closer to the observed image that is actually captured.

[0062] Specifically, the target area pseudo image generating unit 11 first generates a target area pseudo image that is predicted when the target area is imaged from the viewpoint of an optical sensor mounted on an observation satellite.

[0063] Next, the target area pseudo image generation unit 11 uses an existing simulator, such as a simulator using a library such as CESIUM, to add a shadow to the generated target area pseudo image, as shown in Fig. 5. Fig. 5 is a diagram showing the target area pseudo image with a shadow added.

[0064] The simulator adds shadow images 43a to 43f (blacked out areas in Figure 5) to the target area pseudo image using the time period when the generated target area pseudo image can be observed, solar radiation information that represents the altitude and azimuth of the sun in the target area at that time, and three-dimensional map information of the target area.

[0065] The simulator may also add a shadow image to the target area pseudo image using the time period when the generated target area pseudo image can be observed, weather information representing the weather in the target area at that time period (e.g., information representing the degree of cloudiness, hours of sunshine, etc.), and three-dimensional map information of the target area.

[0066] Furthermore, the simulator may add a shadow image to the target area pseudo image using the period when the generated target area pseudo image can be observed, solar radiation information and weather information for that period, and three-dimensional map information of the target area.

[0067] Thus, according to variant example 1, by adding a shadow image to the target area pseudo image, the target area pseudo image becomes closer to the observation image that is actually captured, allowing the operator to refer to the target area pseudo image more intuitively.

[0068] (Variation 2) In the second modification, the control command information is displayed together with the target area pseudo image on the display device 50. Specifically, the target area pseudo image generation unit 11 acquires the control command information generated by the control command information generation unit 12, and displays the contents of the control command information together with the target area pseudo image on the display device 50.

[0069] 6 is a diagram showing the contents of the control command information displayed in the target area pseudo image. 50 By displaying the information on the screen, the operator can check the contents of the control command information in real time.

[0070] The contents of the control command information are not limited to the positions shown in FIG. 6, and may be displayed in other locations.

[0071] [Device operation] Next, the operation of the observation support device in the embodiment will be described with reference to FIG. 7. FIG. 7 is a diagram for explaining the operation of the observation support device. In the following description, the diagram will be referenced as appropriate. Furthermore, in the embodiment, the observation support method is implemented by operating the observation support device. Therefore, the description of the observation support method in the embodiment will be replaced by the following description of the operation of the observation support device.

[0072] As shown in FIG. 7, the target area pseudo image generation unit 11 generates a target area pseudo image that is predicted when the target area is imaged from the viewpoint of an observation device (optical sensor) mounted on an observation satellite (mobile body 20), and displays the target area pseudo image on the display device 50 (step A1).

[0073] Next, if the operator selects a target area pseudo image (step A2: Yes), the control command information generation unit 12 generates control command information based on the moving body position information and moving body direction information used when the selected target area pseudo image was generated (step A3).

[0074] In step A1, a shadow may be added to the target area pseudo image as shown in the first modification.

[0075] If the operator has not yet selected a target area pseudo image (step A2: No), for example, if the operator is moving the viewpoint using an input device 60 such as a mouse, the process of step A1 is executed to generate a target area pseudo image corresponding to the viewpoint in real time.

[0076] In step A1, the contents of the control command information may be displayed on the display device 50 together with the target area pseudo image as shown in the second modification.

[0077] [Effects of the embodiment] As described above, in the embodiment and variants 1 and 2, when an operator plans to observe an image of a desired target area using an observation device mounted on a mobile object, the operator can automatically generate control command information including information necessary for controlling the mobile object simply by selecting a target area pseudo image of the target area that the operator wants to observe. As a result, even an operator who is not an experienced or skilled person can easily generate control command information.

[0078] Since observation satellites move in orbit and capture images of a target area from their orbital positions, they cannot capture images of the target area from all directions. In other words, the directions in which they can capture images of the target area are limited, so they cannot necessarily capture the pseudo image of the target area that the operator desires.

[0079] Therefore, a pseudo image of the target area captured from the viewpoint of an optical sensor mounted on an observation satellite, i.e., a pseudo image of the target area corresponding to the target area that can be captured by the optical sensor, is generated based on mobile object position information indicating the position of the observation satellite and map information of the target area, and is presented to the operator. In addition, every time the viewpoint is moved, a pseudo image of the target area is generated and presented in real time.

[0080] As a result, the operator can intuitively obtain a desired pseudo image of the target area, so that even an operator who is not an experienced or skilled person can easily generate control command information.

[0081] [program] The program in the embodiment and modifications 1 and 2 may be any program that causes a computer to execute steps A1 to A3 shown in Fig. 7. By installing and executing this program on a computer, it is possible to realize the observation support device and observation support method in the embodiment and modifications 1 and 2. In this case, the processor of the computer functions as a target area pseudo image generator 11 and a control command information generator 12 and performs processing.

[0082] The programs in the embodiment and the first and second modifications may be executed by a computer system constructed by a plurality of computers. In this case, for example, each computer may function as either the target area pseudo image generator 11 or the control command information generator 12.

[0083] [Physical configuration] Here, a computer that realizes the observation support device by executing the program in the embodiment and modifications 1 and 2 will be described with reference to Fig. 8. Fig. 8 is a diagram illustrating an example of a computer that realizes the observation support device in the embodiment and modifications 1 and 2.

[0084] 8, the computer 110 includes a CPU (Central Processing Unit) 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These components are connected to each other via a bus 121 so as to be able to communicate data with each other. Note that the computer 110 may include a GPU or an FPGA in addition to or instead of the CPU 111.

[0085] The CPU 111 loads the programs (codes) in the embodiment and the first and second modifications stored in the storage device 113 into the main memory 112 and executes them in a predetermined order to perform various calculations. The main memory 112 is typically a volatile storage device such as a dynamic random access memory (DRAM). The programs in the embodiment and the first and second modifications are provided in a state stored in a computer-readable recording medium 120. The programs in the embodiment and the first and second modifications may be distributed over the Internet connected via the communication interface 117. The recording medium 120 is a non-volatile recording medium.

[0086] Specific examples of the storage device 113 include a hard disk drive and a semiconductor storage device such as a flash memory. The input interface 114 mediates data transmission between the CPU 111 and input devices 118 such as a keyboard and a mouse. The display controller 115 is connected to a display device 119 and controls the display on the display device 119.

[0087] The data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, reads programs from the recording medium 120, and writes processing results from the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and other computers.

[0088] Specific examples of the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash (registered trademark)) and SD (Secure Digital), magnetic recording media such as flexible disks, or optical recording media such as CD-ROMs (Compact Disk Read Only Memory).

[0089] The observation support device 10 in the embodiment and modifications 1 and 2 can also be realized by using hardware corresponding to each part, rather than a computer on which a program is installed. Furthermore, the observation support device 10 may be partially realized by a program and the remaining part by hardware.

[0090] [Note] The following supplementary notes are further disclosed regarding the above-described embodiment and modified examples 1 and 2. Some or all of the above-described embodiment and modified examples 1 and 2 can be expressed by (Supplementary Note 1) to (Supplementary Note 12) described below, but are not limited to the following descriptions.

[0091] (Appendix 1) a target area pseudo image generation unit that generates a target area pseudo image representing a target area that is predicted when the target area is imaged from the viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along a trajectory in a space above the Earth's surface; a control command information generation unit that, when the target area pseudo image is selected by an operator, generates control command information to be used to control at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, in order to have the moving object observe an observation image of the actual target area corresponding to the target area pseudo image, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object that were used when the selected target area pseudo image was generated; An observation support device having:

[0092] (Appendix 2) 10. The observation support device according to claim 1, The target area pseudo image generation unit adds a shadow image to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. Observation support equipment.

[0093] (Appendix 3) 3. The observation support device according to claim 1, The target area pseudo image generating unit adds a shadow image to the target area pseudo image using a time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. Observation support equipment.

[0094] (Appendix 4) 4. An observation support device according to any one of claims 1 to 3, The control command information is displayed on the display device together with the target area pseudo image. Observation support equipment.

[0095] (Appendix 5) a target area pseudo image generating step of generating a target area pseudo image representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; a control command information generation step, when the target area pseudo image is selected by an operator, for generating control command information to be used for controlling at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object, which were used when the selected target area pseudo image was generated; An observation support method having the above.

[0096] (Appendix 6) 6. The observation support method according to claim 5, The target area pseudo image generating step adds a shadow image to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. Observation support methods.

[0097] (Appendix 7) 7. The observation support method according to claim 5, further comprising: The target area pseudo image generating step adds a shadow image to the target area pseudo image using a time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. Observation support methods.

[0098] (Appendix 8) 8. An observation support method according to any one of Supplementary Notes 5 to 7, comprising: The control command information is displayed on the display device together with the target area pseudo image. Observation support methods.

[0099] (Appendix 9) On the computer, a target area pseudo image generating step of generating a target area pseudo image representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; a control command information generation step, when the target area pseudo image is selected by an operator, for generating control command information to be used for controlling at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object, which were used when the selected target area pseudo image was generated; Contains instructions to execute Mup Logura Hmm.

[0100] (Appendix 10) As stated in Appendix 9 program And, The target area pseudo image generating step adds a shadow image to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. program .

[0101] (Appendix 11) Supplementary Note 9 or 10 program And, The target area pseudo image generating step adds a shadow image to the target area pseudo image using a time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. program .

[0102] (Appendix 12) Any one of Appendix 9 to 11 program And, The control command information is displayed on the display device together with the target area pseudo image. program .

[0103] The invention has been described above with reference to the embodiment and modifications 1 and 2, but is not limited to the embodiment and modifications 1 and 2. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the invention within the scope of the invention.

[0104] This application claims priority based on Japanese Patent Application No. 2022-051790, filed on March 28, 2022, the disclosure of which is incorporated herein in its entirety. [Industrial Applicability]

[0105] The above description can assist in generating control command information used to control observations made by a moving object, and is useful in fields where observations using a moving object are required. [Explanation of symbols]

[0106] 10. Observation support equipment 11 Target area pseudo image generation unit 12 Control command information generation unit 13 Communications Department 20 Mobile 30 stations 40 Storage device 50 Display device 60 Input Device 70 Network 110 Computer 111 CPU 112 main memory 113 Storage device 114 Input Interface 115 Display Controller 116 Data Reader / Writer 117 Communication Interface 118 Input Devices 119 Display Device 120 Recording Media 121 Bus

Claims

1. a target area pseudo image generating means for generating a target area pseudo image representing a target area that is predicted when the target area is imaged from the viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; a control command information generating means for generating, when the target area pseudo image is selected by an operator, control command information to be used for controlling at least the time when the moving object observes the target area, the position where the moving object observes, and the direction in which the moving object observes, in order to have the moving object observe an observation image of the actual target area corresponding to the target area pseudo image, based on moving object position information indicating the position of the moving object and moving object direction information indicating the direction of the moving object, which were used when the selected target area pseudo image was generated; An observation support device having:

2. The observation support device according to claim 1, The target area pseudo image generating means adds a shadow image to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. Observation support equipment.

3. The observation support device according to claim 1, The target area pseudo image generating means adds a shadow image to the target area pseudo image using the time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. Observation support equipment.

4. The observation support device according to claim 1, The target area pseudo image and the control command information are displayed on a display device. Observation support equipment.

5. The computer generating a pseudo image of a target area representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; When the target area pseudo image is selected by the operator, control command information is generated to be used to control at least the time when the mobile unit observes the target area, the position where the mobile unit observes, and the direction in which the mobile unit observes, in order to have the mobile unit observe an observation image of the actual target area corresponding to the target area pseudo image, based on mobile unit position information indicating the position of the mobile unit and mobile unit direction information indicating the direction of the mobile unit, which were used when the selected target area pseudo image was generated. Observation support methods.

6. The observation support method according to claim 5, A shadow image is added to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. Observation support methods.

7. The observation support method according to claim 5, A shadow image is added to the target area pseudo image using the time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. Observation support methods.

8. The observation support method according to claim 5, The target area pseudo image and the control command information are displayed on a display device. Observation support methods.

9. On the computer, generating a pseudo image of a target area representing the target area that is predicted when the target area is imaged from a viewpoint of a moving body that is equipped with an observation device for observing the Earth's surface and moves along an orbit in a space above the Earth's surface; When the target area pseudo image is selected by the operator, control command information is generated based on mobile unit position information indicating the position of the mobile unit and mobile unit direction information indicating the direction of the mobile unit, which were used when the selected target area pseudo image was generated, to control at least the time when the mobile unit observes the target area, the position at which the mobile unit observes, and the direction in which the mobile unit observes, in order to have the mobile unit observe an observation image of the actual target area corresponding to the target area pseudo image. A program containing instructions.

10. 10. The program according to claim 9, The computer, A shadow image is added to the target area pseudo image using the time when the generated target area pseudo image can be observed, solar radiation information indicating the altitude and azimuth angle of the sun in the target area, and three-dimensional map information of the target area. program.

11. 10. The program according to claim 9, The computer, A shadow image is added to the target area pseudo image using the time when the generated target area pseudo image can be observed, weather information indicating the weather in the target area, and three-dimensional map information of the target area. program.

12. 10. The program according to claim 9, The computer, The target area pseudo image and the control command information are displayed on a display device. program.

Citation Information

Patent Citations

  • Satellite image request system

    JP2009009436A

  • Satellite observation planning device, method and program

    JP2013095162A

  • Photography plan creation device, photography plan creation program and photography plan creation method

    JP2015028759A

  • Synthetic aperture radar image forming simulation system and method

    KR1020110097277A