Image generation device, terminal, image generation method, image display method, and program

Abstract

The purpose of the present invention is to provide an image generation device that enables a user to easily acquire a satellite image. An image generation device according to the present disclosure comprises: an acquisition unit that acquires terminal information indicating an attitude of a terminal that images a prescribed region on a map; an estimation unit that estimates an attitude of a satellite that images the prescribed region on the basis of the attitude of the terminal; a generation unit that generates image data representing a case where three-dimensional data of the prescribed region is imaged from the satellite; and a communication unit that transmits the image data to the terminal.

Description

Image generation device, terminal, image generation method, image display method, and program

[0001] The present disclosure relates to an image generation device, a terminal, an image generation method, and a program.

[0002] A service for generating satellite images using a camera mounted on an artificial satellite is provided. Patent Document 1 describes creating a shooting plan while checking a real-time video being shot using a satellite camera via a user app on a user terminal. Specifically, as shooting conditions, the user determines the start and end of each operation of zooming, panning, tilting, and rolling of the satellite camera. Further, it is described that in the normal editing mode, the user specifies the shooting conditions while checking a shooting preview video, which is an image that the satellite camera is actually expected to capture.

[0003] International Publication No. 2023 / 047648

[0004] In Patent Document 1, as shooting conditions, for example, it is necessary to input panning, tilting, rolling, etc., but it is unclear what values are appropriate for the user to obtain the necessary satellite images. Therefore, there is a problem that the user needs to repeatedly input values many times until reaching an appropriate value to obtain the necessary satellite images.

[0005] One object of the present disclosure is to provide an image generation device, a terminal, an image generation method, an image display method, and a program that enable a user to easily obtain satellite images.

[0006] The image generation device according to the present disclosure includes an acquisition unit that acquires terminal information indicating the attitude of a terminal that shoots a predetermined area on a map, an estimation unit that estimates the attitude of a satellite that shoots the predetermined area based on the attitude of the terminal, a generation unit that generates image data when shooting three-dimensional data of the predetermined area from the satellite, and a communication unit that transmits the image data to the terminal.

[0007] The terminal relating to this disclosure comprises: a shooting unit that photographs a predetermined area on a map; a communication unit that transmits terminal information indicating the orientation of the terminal when the predetermined area is photographed to an image generation device, and receives image data from the image generation device when three-dimensional data of the predetermined area is photographed from a satellite having an orientation estimated based on the orientation of the terminal; and a display unit that displays the image data.

[0008] The image generation method according to this disclosure acquires terminal information indicating the orientation of a terminal that photographs a predetermined area on a map, estimates the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal, generates image data when three-dimensional data of the predetermined area is photographed from the satellite, and transmits the image data to the terminal.

[0009] The program relating to this disclosure causes a computer to perform the following actions: acquire terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimate the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generate image data when three-dimensional data of the predetermined area is photographed from the satellite; and transmit the image data to the terminal.

[0010] This disclosure provides an image generation device, terminal, image generation method, image display method, and program that allow users to easily obtain satellite images.

[0011] Figure 1 shows an example of the configuration of an image generation device. Figure 2 shows the processing flow of the image generation method performed in the image generation device. Figure 3 shows an example of the configuration of an image generation system. Figure 4 shows an example of the configuration of a terminal. Figure 5 shows the process of taking a picture of the Earth's surface using a camera mounted on a satellite and taking a picture of a map using a terminal. Figure 6 shows an example of the configuration of an image generation device. Figure 7 shows the processing flow of the image display method in the terminal. Figure 8 shows the reference direction of the terminal. Figure 9 shows the orientation of the terminal when taking a picture of a map. Figure 10 shows the processing flow of the image generation method performed in the image generation device. Figure 11 is a block diagram showing an example of the configuration of an image generation device 10 and a terminal 20.

[0012] Embodiment 1 Figure 1 shows an example of the configuration of an image generation device 10. The image generation device 10 may be a computer device that operates by having a processor execute a program stored in memory.

[0013] The image generation device 10 includes an acquisition unit 11, an estimation unit 12, a generation unit 13, and a communication unit 14. The acquisition unit 11, estimation unit 12, generation unit 13, and communication unit 14 may be software or modules whose processing is performed by a processor executing a program stored in memory. Alternatively, the acquisition unit 11, estimation unit 12, generation unit 13, and communication unit 14 may be hardware such as circuits or chips.

[0014] Figure 1 shows an image generation device 10 having an acquisition unit 11, an estimation unit 12, a generation unit 13, and a communication unit 14. However, the acquisition unit 11, estimation unit 12, generation unit 13, and communication unit 14 may be distributed and mounted on two or more computer devices. In this case, the two or more computer devices may transmit data via a network.

[0015] The acquisition unit 11 may be used as a means to acquire data. The estimation unit 12 may be used as a means to estimate data. The generation unit 13 may be used as a means to generate data. The communication unit 14 may be used as a means to transmit or receive data.

[0016] The acquisition unit 11 acquires terminal information indicating the orientation of the terminal that is photographing a predetermined area on the map. The map may be, for example, a map printed on paper, or it may be digital data displayed on a screen. The terminal that photographs the predetermined area on the map may be, for example, a terminal equipped with a camera. The terminal may be, for example, a mobile phone terminal, a smartphone terminal, a tablet terminal, a digital camera with communication functions, etc.

[0017] The device orientation may include information indicating the device's position and its inclination relative to the map. The device's position may, for example, be the distance from the map to the device, or coordinates indicating the device's position relative to a specific location on the map. Alternatively, the device may be positioned in a specific direction or orientation relative to a specific location on the map.

[0018] The tilt of the device may be a value that indicates the angle of a predetermined direction of the device relative to a plane parallel to the Earth's surface, with the plane parallel to the Earth's surface as the reference point. The predetermined direction may be, for example, the direction in which the device is photographed. Alternatively, the tilt of the device may be a value that indicates the angle of a predetermined direction of the device relative to a specific plane in a predetermined three-dimensional space, with the plane parallel to the map as the Earth's surface. Specifically, the tilt of the device may be a value that indicates the angle of the direction in which the device is photographed relative to a plane parallel to the map, with the plane parallel to the map considered as the Earth's surface.

[0019] The acquisition unit 11 may acquire terminal information from a terminal via a network. The network may be a mobile network, and the acquisition unit 11 may acquire terminal information via a wireless communication line. Alternatively, the acquisition unit 11 may acquire terminal information via a wired communication line. Furthermore, the network may be the so-called internet.

[0020] The estimation unit 12 estimates the attitude of the satellite that will photograph a predetermined area based on the attitude of the terminal. The satellite is, for example, an artificial satellite, equipped with an imaging device that can photograph a designated area on Earth while moving in a specific orbit. Furthermore, a user who wishes to acquire satellite images taken from the satellite can also specify the satellite's imaging attitude. The satellite's attitude refers to the attitude of the imaging device mounted on the satellite.

[0021] Estimating the satellite's attitude based on the terminal's attitude means, for example, associating the terminal's attitude with the satellite's attitude. Specifically, the terminal's attitude may be considered as the satellite's attitude. Furthermore, the distance between the map and the terminal may be considered as the distance between the Earth's surface and the satellite. In other words, a terminal that photographs a specified area on a map may be used as a device that simulates a satellite photographing the Earth's surface.

[0022] The generation unit 13 generates image data when three-dimensional data of a predetermined area is captured from the satellite. The satellite has an estimated attitude. Having an estimated attitude means that the satellite has substantially the same attitude as the estimated attitude.

[0023] Three-dimensional data of a predetermined region may be generated, for example, based on multiple satellite images taken from a satellite in the past. Three-dimensional data generated based on multiple satellite images may be, for example, point cloud data. Point cloud data may be generated by matching feature points of multiple image data obtained by photographing the same object from multiple locations. The generation of point cloud data using multiple image data may be performed, for example, using Structure from Motion (SfM).

[0024] Alternatively, the 3D data for the specified area may be point cloud data generated by a sensor using LiDAR (Light Detection and Ranging).

[0025] Point cloud data is a collection of points that have three-dimensional information. The three-dimensional information may be, for example, coordinates in a three-dimensional space composed of mutually orthogonal X, Y, and Z axes. The generation unit 13 may generate image data as if the three-dimensional data were captured from a satellite at a predetermined distance. The image data may be, for example, two-dimensional data. The image data may be, for example, a satellite image. In other words, the generation unit 13 simulates an image as if the three-dimensional data were captured from a satellite with an estimated attitude.

[0026] The communication unit 14 transmits the image data to the terminal that captured the predetermined area on the map. Alternatively, the communication unit 14 may transmit the image data to a terminal different from the terminal that captured the predetermined area on the map.

[0027] Figure 2 shows the processing flow of the image generation method executed in the image generation device 10. First, the acquisition unit 11 acquires terminal information indicating the orientation of the terminal that will photograph a predetermined area on the map (S11). Next, the estimation unit 12 estimates the orientation of the satellite that will photograph the predetermined area based on the orientation of the terminal (S12). Next, the generation unit 13 generates image data when 3D data of the predetermined area is captured from the satellite (S13). Next, the communication unit 14 transmits the image data to the terminal (S14).

[0028] As described above, the image generation device 10 considers a terminal that photographs a predetermined area on a map as a satellite that photographs the predetermined area, and transmits image data to the terminal as if it were taken from a satellite with substantially the same attitude as the terminal. As a result, the user holding the terminal can check a simulated image of the predetermined area as if it were photographed from a satellite by tilting the terminal, etc., without having to input detailed information about the satellite's attitude into the image generation device 10. By checking the simulated image, the user can easily request or order the capture of desired image data.

[0029] Embodiment 2 Figure 3 shows an example of the configuration of an image generation system. The image generation system includes a terminal 20 and an image generation device 30. Embodiment 2 describes an example in which a smartphone terminal or a tablet terminal is used as the terminal 20.

[0030] The image generation device 30 may communicate with the terminal 20 via the network 40. The network 40 may be an open network such as the so-called Internet, or it may be a closed network such as an intranet. The terminal 20 and the image generation device 30 may be connected to the network 40 via a wireless or wired line. Figure 3 shows that the terminal 20 is connected to the network 40 via a wireless line and the image generation device 30 is connected to the network 40 via a wired line.

[0031] Figure 4 shows an example configuration of terminal 20. Terminal 20 may be a computer device that operates by a processor executing a program stored in memory. Terminal 20 has an imaging unit 21, a display unit 22, and a communication unit 23. The imaging unit 21, the display unit 22, and the communication unit 23 may be software or modules whose processing is performed by a processor executing a program stored in memory. The imaging unit 21 may be used as a means for taking images. The display unit may be used as a means for displaying data. The communication unit 23 may be used as a means for transmitting or receiving data.

[0032] The shooting unit 21 photographs an object in a predetermined shooting direction. The predetermined shooting direction may be determined, for example, by the direction the lens is pointing and the angle of view. Specifically, the shooting unit 21 photographs a map. The shooting unit 21 may photograph a specific area or region on the map. A specific area or region may be a specific country, a specific region within a country, a tourist attraction, a building, etc. Alternatively, a specific area or region may be an area or region having a predetermined area centered on a certain point.

[0033] Furthermore, the imaging unit 21 identifies terminal information indicating the orientation of the terminal 20 when imaging a predetermined area on the map. The orientation may be determined, for example, using a gyro sensor. For example, the imaging unit 21 may determine the angle of the terminal 20 based on the angular velocities of the yaw, pitch, and roll axes detected by the gyro sensor. If the angle of the terminal 20 represents an angle relative to a coordinate system defined by the gyro sensor, the imaging unit 21 may convert the angle of the terminal 20 to an angle in an absolute coordinate system. The absolute coordinate system may be, for example, a coordinate system defined with the direction of gravitational acceleration as the axis. The imaging unit 21 may also convert the angle of the terminal 20 to an angle in an absolute coordinate system using information detected by other sensors, such as a geomagnetic sensor or an acceleration sensor.

[0034] The imaging unit 21 may determine the angle of the terminal information depending on where the map is displayed or where the map is placed. For example, suppose the map is displayed on a display placed on a plane substantially parallel to the Earth's surface, or the paper on which the map is printed is placed on a plane substantially parallel to the Earth's surface. In such cases, the imaging unit 21 may determine the angle of the terminal in an absolute coordinate system.

[0035] Furthermore, suppose the map is displayed on a screen placed on a plane substantially perpendicular to the Earth's surface, or the paper on which the map is printed is placed on a wall or the like that is substantially parallel to the Earth's surface. In such cases, the imaging unit 21 may convert the direction of gravitational acceleration in the absolute coordinate system to the direction in which the screen or paper is facing, for example, a direction substantially parallel to the Earth's surface. The imaging unit 21 may also convert the information indicating the angle of the terminal by converting the direction of gravitational acceleration.

[0036] In other words, the imaging unit 21 may correct or adjust the angle of the terminal by transforming the absolute coordinate system so that the direction of gravitational acceleration in absolute coordinates is aligned with a direction perpendicular to the surface of the display on which the map is shown or the surface of the paper on which the map is printed.

[0037] The display unit 22 displays the map captured by the imaging unit 21. The angle of the terminal 20 that captures the map is assumed to simulate the angle of a satellite equipped with a camera that photographs the Earth's surface. Furthermore, the map displayed on the display unit 22 is assumed to simulate the area photographed using the camera mounted on the satellite.

[0038] Figure 5 shows how the Earth's surface is photographed using a camera mounted on a satellite, and how a map is photographed using terminal 20. The map shown in the right-hand diagram of Figure 5 corresponds to the Earth's surface shown in the left-hand diagram of Figure 5. Furthermore, terminal 20 shown in the right-hand diagram of Figure 5 corresponds to the satellite shown in the left-hand diagram of Figure 5. As shown in the right-hand diagram of Figure 5, the angle at which terminal 20 is tilted is considered to be the angle of the satellite. The right-hand diagram of Figure 5 simulates the attitude of the satellite when it photographs the Earth's surface from the satellite shown in the left-hand diagram of Figure 5.

[0039] Returning to Figure 4, the communication unit 23 transmits information indicating the angle of the terminal 20 identified by the imaging unit 21 to the image generation device 30. Furthermore, the communication unit 23 may also transmit the image data captured by the imaging unit 21 to the image generation device 30.

[0040] The image data captured by the imaging unit 21 may include information indicating the name of a region. In other words, the image data captured by the imaging unit 21 may include the name of a region shown on a map. Alternatively, the communication unit 23 may transmit information identifying the location displayed in the image data captured by the imaging unit 21 to the image generation device 30 along with the image data. The information identifying the location displayed in the image data may, for example, be input into the terminal 20 by a user operating the terminal 20.

[0041] Figure 6 shows an example of the configuration of the image generation device 30. The image generation device 30 is configured with a 3D data management unit 31 added to the image generation device 10 shown in Figure 1. Detailed explanations of the components of the image generation device 30, including their functions, processing, and operation, which are the same as those of the image generation device 10, are omitted.

[0042] The 3D data management unit 31 manages the 3D data. The 3D data may be 3D point cloud data generated using multiple satellite images taken from satellites in the past. The 3D data may be generated by a device other than the image generation device 30, or it may be generated by the image generation device 30. In addition, the 3D data management unit 31 may manage multiple satellite images used in generating the 3D data along with the 3D data.

[0043] The acquisition unit 11 receives information from the terminal 20 indicating the orientation of the terminal 20 and information indicating the shooting area. Furthermore, the acquisition unit 11 may also receive image data generated by the terminal 20 from the terminal 20. The information indicating the shooting area may be shown within the image data, or it may be received from the terminal 20 as separate information from the image data.

[0044] The estimation unit 12 may regard the posture of the terminal as the posture of the satellite. Also, a predetermined distance may be used as the distance between the satellite and the ground surface. That is, the estimation unit 12 may specify the position of the satellite that photographs the ground surface and the posture of the satellite.

[0045] The generation unit 13 generates image data when three-dimensional data of a predetermined area is photographed from the satellite according to the position of the satellite and the posture of the satellite specified by the estimation unit 12. Here, the generation unit 13 extracts three-dimensional data including the imaging area from the three-dimensional data management unit 31 based on the information indicating the imaging area acquired from the terminal 20.

[0046] The generation unit 13 generates image data when photographing the three-dimensional data including the imaging area from the position and posture of the satellite estimated by the estimation unit 12. The three-dimensional data is three-dimensional point cloud data. Therefore, the generation unit 13 can generate image data of the three-dimensional data photographed from various viewpoints by specifying the position of the satellite equipped with a camera in the three-dimensional space and the posture of the satellite.

[0047] The communication unit 14 transmits the image data generated by the generation unit 13 to the terminal 20.

[0048] The display unit 22 of the terminal 20 displays the image data received from the image generation device 30. The user operating the terminal 20 can confirm the image of the satellite image by viewing the image displayed on the display unit 22.

[0049] Figure 7 shows the processing flow of the image display method in terminal 20. First, the shooting unit 21 determines the reference direction (S21). For example, a user operating terminal 20 photographs a predetermined area on the map from a direction substantially perpendicular to the screen displaying the map or the paper on which the map is printed. The shooting unit 21 may initially determine the shooting direction when the map is photographed from a substantially perpendicular direction as the reference direction. The shooting direction may be, for example, the direction in which the lens of the camera mounted on terminal 20 is facing. The shooting unit 21 may also specify the shooting direction when the user photographs the map with terminal 20 set in a direction substantially perpendicular to the map as the reference direction. The reference direction may be the vertical direction relative to the map. The shooting unit 21 may, for example, specify the shooting direction when the user first presses a button or taps the screen when photographing the map from a substantially perpendicular direction as the reference direction.

[0050] Figure 8 shows the reference direction of the terminal 20. For example, the terminal 20 may be positioned substantially parallel to the map 50. Furthermore, the shooting direction of the terminal 20 may be determined to coincide with a direction substantially perpendicular to the plane of the map 50.

[0051] Returning to Figure 7, the next step is for the imaging unit 21 to photograph a predetermined area on the map (S22). The imaging unit 21 may also photograph the predetermined area on the map with the terminal 20 tilted from the reference direction. In other words, the user may tilt the terminal 20 to simulate the tilt of a satellite photographing the Earth's surface and photograph the predetermined area on the map. The user may also perform the imaging operation using the imaging unit 21 at a desired timing while confirming the predetermined area on the map displayed on the display unit 22.

[0052] Figure 9 shows the orientation of the terminal 20 when it takes a picture of the map 50. The user operating the terminal 20 tilts the terminal 20 to simulate a satellite and take a picture of the map 50. The angle indicating the orientation of the terminal 20 may be, for example, the angle between the shooting direction of the terminal 20 and the direction perpendicular to the plane of the map 50, as shown in Figure 9. The direction perpendicular to the plane of the map 50 coincides with the reference direction determined in step S21. Therefore, the shooting unit 21 may determine the angle between the reference direction and the shooting direction as orientation information.

[0053] Returning to Figure 7, the communication unit 23 then transmits the image data generated when the image was captured by the imaging unit 21 to the image generation device 30 (S23). Along with the image data, the communication unit 23 transmits terminal information indicating the orientation of the terminal 20 to the image generation device 30. Furthermore, the communication unit 23 may transmit information indicating the location of a predetermined area on the map to the image generation device 30.

[0054] Next, the communication unit 23 receives estimated satellite images from the image generation device 30 (S24). The estimated satellite images may be image data generated by the image generation device 30 by simulating a satellite with substantially the same attitude as the terminal 20 taking pictures of substantially the same area as the area photographed by the terminal 20. Simulating taking pictures may mean taking 3D data managed by the image generation device 30 from a predetermined attitude and direction.

[0055] Next, the display unit 22 displays the estimated satellite image (S25).

[0056] Figure 10 shows the processing flow of the image generation method executed in the image generation device 30. First, the acquisition unit 11 acquires terminal information and image data from the terminal 20 (S31).

[0057] Next, the estimation unit 12 identifies the location or region indicated by the image data (S32). If the estimation unit 12 obtains information about the location or region indicated by the image data from the terminal 20, it identifies the location indicated by the information about the location indicated by the image data as the location indicated by the image data. If the image data contains information indicating a location, the estimation unit 12 identifies the location indicated by the image data as the location indicated by the image data. Alternatively, the estimation unit 12 may identify the location indicated by the image data by performing image analysis on the image data. For example, the estimation unit 12 may obtain the location indicated by the image data by inputting the image data into a learning model that has been trained using the image data and the location indicated by the image data as training data.

[0058] Next, the estimation unit 12 determines the attitude of a virtual satellite that will capture 3D data including the identified location (S33). The virtual satellite is a satellite set up in 3D space to simulate capturing 3D data. 3D space is the space containing the 3D data. It is assumed that the virtual satellite will capture substantially the same location as indicated by the image data, with substantially the same attitude as the terminal 20 included in the terminal information. The height of the virtual satellite may be set to substantially the same height as the actual satellite.

[0059] Next, the generation unit 13 generates image data from the virtual satellite when it photographs the specified location (S34). The image data may be two-dimensional data. Next, the communication unit 14 transmits the image data to the terminal 20 (S35).

[0060] As explained above, the image generation device 30 generates image data assuming that the terminal 20 captured 3D data using the attitude of the virtual satellite when it photographed a predetermined area on the map. The terminal 20 can confirm the image data generated by the image generation device 30 as a virtual satellite image. As a result, the user operating the terminal 20 can confirm an image similar to an actual satellite image by viewing the virtual satellite image before formally ordering satellite images. This allows the user to decide whether or not to formally order satellite images after confirming the virtual satellite image.

[0061] Figure 11 is a block diagram showing an example configuration of an image generation device 10, a terminal 20, and an image generation device 30 (hereinafter referred to as "image generation device 10, etc."). Referring to Figure 11, the image generation device 10, etc. includes a network interface 1201, a processor 1202, and a memory 1203. The network interface 1201 may be used to communicate with a network node. The network interface 1201 may include, for example, a network interface card (NIC) compliant with the IEEE 802.3 series. IEEE stands for Institute of Electrical and Electronics Engineers.

[0062] The processor 1202 reads and executes software (computer programs) from the memory 1203 to perform processing such as that of the image generation device 10 as described using a flowchart. The processor 1202 may be, for example, a microprocessor, an MPU, or a CPU. The processor 1202 may include multiple processors.

[0063] Memory 1203 is composed of a combination of volatile and non-volatile memory. Memory 1203 may include storage located away from the processor 1202. In this case, the processor 1202 may access memory 1203 via an I / O (Input / Output) interface, which is not shown.

[0064] In the example shown in Figure 11, the memory 1203 is used to store a group of software modules. The processor 1202 can perform processing on the image generation device 10, etc., by reading and executing these software modules from the memory 1203.

[0065] As explained using Figure 11, each processor in the image generation device 10, etc., executes one or more programs that include a set of instructions for causing the computer to perform the algorithm described in the diagram.

[0066] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrical, optical, acoustic or other forms of propagating signals.

[0067] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0068] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments, rather than being associated with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps described in any of the drawings may be changed as appropriate.

[0069] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) An image generation device comprising: an acquisition unit that acquires terminal information indicating the attitude of a terminal that photographs a predetermined area on a map; an estimation unit that estimates the attitude of a satellite that photographs the predetermined area based on the attitude of the terminal; a generation unit that generates image data when three-dimensional data of the predetermined area is photographed from the satellite; and a communication unit that transmits the image data to the terminal. (Note 2) The image generation device according to Note 1, wherein the attitude of the terminal is the inclination with respect to a predetermined shooting direction of the terminal. (Note 3) The image generation device according to Note 2, wherein the predetermined shooting direction is the vertical direction with respect to the map when the map is the Earth's surface. (Note 4) The image generation device according to any one of Notes 1 to 3, wherein the estimation unit considers the attitude of the terminal to be the attitude of the satellite. (Note 5) The image generation device according to any one of Notes 1 to 4, further comprising a recording unit for recording the three-dimensional data generated based on a plurality of satellite images taken of the predetermined area. (Note 6) A terminal comprising: a shooting unit for taking a picture of a predetermined area on a map; a communication unit for transmitting terminal information indicating the attitude of the terminal when the predetermined area is photographed to the image generation device, and receiving image data from the image generation device when the three-dimensional data of the predetermined area is photographed from a satellite having an attitude estimated based on the attitude of the terminal; and a display unit for displaying the image data. (Note 7) The terminal according to Note 6, wherein the attitude of the terminal is the inclination with respect to a predetermined shooting direction of the terminal. (Note 8) The terminal according to Note 7, wherein the predetermined shooting direction is the vertical direction with respect to the map when the map is the Earth's surface. (Note 9) An image generation method comprising: acquiring terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimating the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generating image data when three-dimensional data of the predetermined area is photographed from the satellite; and transmitting the image data to the terminal.(Note 10) A program that causes a computer to perform the following actions: acquire terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimate the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generate image data when 3D data of the predetermined area is photographed from the satellite; and transmit the image data to the terminal. (Note 11) An image display method that photographs a predetermined area on a map, transmits terminal information indicating the orientation of the terminal when the predetermined area is photographed to an image generation device, receives image data from the image generation device when 3D data of the predetermined area is photographed from the satellite having the orientation estimated based on the orientation of the terminal, and displays the image data. (Note 12) A program that causes a computer to perform the following actions: photograph a predetermined area on a map, transmit terminal information indicating the orientation of the terminal when the predetermined area is photographed to an image generation device; receive image data from the image generation device when 3D data of the predetermined area is photographed from the satellite having the orientation estimated based on the orientation of the terminal, and displays the image data.

[0070] Some or all of the elements (e.g., configuration and function) described in Appendices 2 to 5 that are dependent on Appendice 1 may also be dependent on Appendices 9 and 10 in the same way as those described in Appendices 2 to 5. Some or all of the elements (e.g., configuration and function) described in Appendices 7 to 8 that are dependent on Appendice 6 may also be dependent on Appendices 11 and 12 in the same way as those described in Appendices 7 to 8. Some or all of the elements described in any appendice may be applied to various hardware, software, recording means, systems, and methods for recording software.

[0071] This application claims priority based on Japanese Patent Application No. 2024-205957, filed on 27 November 2024, and incorporates all of its disclosures herein.

[0072] 10 Image generation device 11 Acquisition unit 12 Estimation unit 13 Generation unit 14 Communication unit 20 Terminal 21 Shooting unit 22 Display unit 23 Communication unit 30 Image generation device 31 3D data management unit 40 Network

Claims

1. An image generation device comprising: acquisition means for acquiring terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimation means for estimating the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generation means for generating image data when three-dimensional data of the predetermined area is photographed from the satellite; and communication means for transmitting the image data to the terminal.

2. The orientation of the terminal is an inclination with respect to a predetermined shooting direction of the terminal, as described in claim 1.

3. The image generating apparatus according to claim 2, wherein the predetermined shooting direction is the vertical direction with respect to the map when the map is considered as the Earth's surface.

4. The image generation apparatus according to any one of claims 1 to 3, wherein the estimation means considers the attitude of the terminal to be the attitude of the satellite.

5. The image generation apparatus according to any one of claims 1 to 3, further comprising recording means for recording the three-dimensional data generated based on a plurality of satellite images taken of the predetermined region.

6. A terminal comprising: a shooting means for photographing a predetermined area on a map; a communication means for transmitting terminal information indicating the attitude of the terminal when the predetermined area is photographed to an image generation device, and receiving image data from the image generation device when three-dimensional data of the predetermined area is photographed from a satellite having an attitude estimated based on the attitude of the terminal; and a display means for displaying the image data.

7. The terminal according to claim 6, wherein the orientation of the terminal is an inclination with respect to a predetermined shooting direction of the terminal.

8. The terminal according to claim 7, wherein the predetermined shooting direction is the vertical direction with respect to the map when the map is considered as the ground surface.

9. An image generation method comprising: acquiring terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimating the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generating image data when three-dimensional data of the predetermined area is photographed from the satellite; and transmitting the image data to the terminal.

10. A program that causes a computer to perform the following actions: acquire terminal information indicating the orientation of a terminal that photographs a predetermined area on a map; estimate the orientation of a satellite that photographs the predetermined area based on the orientation of the terminal; generate image data when three-dimensional data of the predetermined area is photographed from the satellite; and transmit the image data to the terminal.

11. An image display method comprising: taking a photograph of a predetermined area on a map; transmitting terminal information indicating the attitude of the terminal when the predetermined area is photographed to an image generation device; receiving image data from the image generation device of three-dimensional data of the predetermined area taken from a satellite having an attitude estimated based on the attitude of the terminal; and displaying the image data.

12. A program that causes a computer to take a photograph of a predetermined area on a map, transmit terminal information indicating the attitude of the terminal when the predetermined area is photographed to an image generation device, receive image data from the image generation device of a satellite having an attitude estimated based on the attitude of the terminal when 3D data of the predetermined area is photographed, and display the image data.

Images