Information extraction method, information display method, information extraction device, information display device, and computer program

Abstract

To reduce the load of data processing when displaying an image using three-dimensional spatial information.SOLUTION: An information extraction method is executed by an information processing device including an arithmetic circuit that can access a storage device, information is linked to each of a plurality of subspaces, and the method extracts the information linked to at least one subspace accompanying movement of a moving object. The storage device stores three-dimensional spatial information including the information linked to each of the plurality of subspaces obtained by virtually and regularly dividing a three-dimensional space around the center of a sphere. Each subspace is associated with at least one first element that specifies three-dimensional coordinates indicating the three-dimensional space. The moving object is associated with a second element indicating at least one point of the moving object. The arithmetic circuit selects the subspace based on the three-dimensional spatial information according to a positional relation between the first element and the second element when virtually moving the moving object in the three-dimensional space, and extracts the information linked to the selected subspace.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information extraction method, an information display method, an information extraction device, an information display device, and a computer program for extracting or displaying three-dimensional spatial information. [Background technology]

[0002] Conventionally, various types of geospatial information have been used. In geospatial information, information about a specific point is associated with the coordinates of the point. By using such geospatial information, a user can obtain various information associated with coordinates on a map, which improves convenience.

[0003] Conventionally, geospatial information has generally been used in association with planar coordinates. On the other hand, in recent years, the use of three-dimensional spatial information, which is three-dimensional information, such as digital twins and metaverses, has become more common. When dealing with such three-dimensional spatial images, geospatial information associated with spatial coordinates may also be used. Images representing three-dimensional space are not limited to the conventional planar movements in the forward, backward, left, and right directions, but are expected to move freely in space.

[0004] Therefore, when using three-dimensional spatial information such as digital twins and metaverses, a huge amount of data is required compared to the two-dimensional data that has been handled traditionally. This increases the data processing load. In addition, if delays occur in data transmission and reception or calculation when handling a large amount of data to reproduce digital twins and metaverses, the display of realistic images is hindered. Research has been conducted on technologies to reduce the data processing load, but the need for such research is also increasing as the data processing load increases with the use of images that represent three-dimensional spaces such as digital twins and metaverses. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2022-161342 A [Patent Document 2] Special Publication No. 2019-531543 [Patent Document 3] JP 2015-118464 A Summary of the Invention [Problem to be solved by the invention]

[0006] In view of the above, the present invention provides an information extraction method, an information display method, an information extraction device, an information display device, and a computer program that reduce the load of data processing when displaying an image using three-dimensional spatial information. [Means for solving the problem]

[0007] The information extraction method of the present disclosure is executed by an information processing device including an arithmetic circuit that can access a storage device, and is an information extraction method in which information is linked to each of a plurality of subspaces as a moving body moves, and information linked to at least one subspace is extracted, wherein the storage device stores three-dimensional spatial information including information linked to each of a plurality of subspaces obtained by virtually and regularly dividing a three-dimensional space around the center of a sphere, each subspace is associated with at least one first element that specifies three-dimensional coordinates indicating the three-dimensional space, and the moving body is associated with a second element that indicates at least one point on the moving body, and the arithmetic circuit selects a subspace from the three-dimensional spatial information in accordance with the positional relationship between the first element and the second element when virtually moving the moving body within the three-dimensional space, and extracts information linked to the selected subspace. Effect of the Invention

[0008] The information extraction method, information display method, information extraction device, information display device, and computer program disclosed herein can reduce the load of data processing when displaying video using three-dimensional spatial information. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of an information display system. [Diagram 2] FIG. 2 is a schematic diagram showing a partial space represented by three-dimensional spatial information. [Diagram 3] FIG. 2 is a schematic diagram illustrating a partial space represented by three-dimensional spatial information. [Figure 4] 1 shows an example of a configuration of three-dimensional space information. [Diagram 5] FIG. 2 is a schematic diagram showing a plurality of subspaces included in three-dimensional space information. [Figure 6] 1 is an example of three-dimensional map information. [Figure 7] 4 shows an example of the configuration of moving body information. [Figure 8] 1 is a schematic diagram illustrating a three-dimensional shape represented by moving object information; [Figure 9A] 1 is an example of a three-dimensional image displayed in an information display system. [Figure 9B] 11 is another example of a three-dimensional image displayed in the information display system. [Figure 10] FIG. 5 is a schematic diagram illustrating a subspace selected from the subspaces illustrated in FIG. 4. [Figure 11] FIG. 11 is a schematic diagram illustrating a first element extracted from the multiple subspaces shown in FIG. [Figure 12] 10 is a flowchart illustrating a process of acquiring information in the information display device. [Figure 13] 10 is a flowchart illustrating a process of extracting and displaying information in an information display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The following describes an information extraction method, an information display method, an information display device, and a computer program according to the present disclosure, with reference to the drawings. The information display device according to the present disclosure is linked to a plurality of partial spaces defined in a three-dimensional space, and extracts information linked to at least one partial space in accordance with the movement of a moving body in the three-dimensional space. The information display device displays the extracted information. In the following, an example will be described in which the information display device according to the present disclosure displays a virtual space in which a real space is reproduced in a digital twin on a display. In this example, the information display device displays the extracted information in accordance with the movement of a moving body such as an animal or vehicle in the real space or the movement of a virtual moving body in the virtual space. Specifically, the information display device displays the extracted information according to the moving speed of the moving body, the viewpoint of the moving body, and the like. In the following description, the same components are denoted by the same reference numerals, and description thereof will be omitted.

[0011] Information Display System As shown in FIG. 1, an information display device 10 of the present disclosure is included in an information display system 1. The information display device 10 is connected to a user terminal 20 and an information providing device 30 via a network 40 so as to be able to perform data communication. The information display device 10 manages information provided by the information providing device 30. In addition, when the information display device 10 acquires the conditions of a moving object associated with the user terminal 20, it extracts information corresponding to the conditions of the moving object from the information it manages, and displays a three-dimensional image including the extracted information on the display of the user terminal 20. In the following description, an example will be described in which a three-dimensional image corresponding to the movement of a virtual moving object is displayed when the virtual moving object is moved in response to an operation from the user terminal 20 in a virtual space that reproduces a real space on the earth. Note that the earth is not limited to the ground, and the range in which the moving object can move can include the sea and the ground.

[0012] The user terminal 20 is an information processing terminal used by a user. The user terminal 20 receives a three-dimensional image showing the virtual space transmitted by the information display device 10 and displays it on a display. For example, the user terminal 20 may be a personal computer (PC) having a display, a smartphone, VR goggles, or the like. The user terminal 20 may also transmit an operation signal to the information display device 10 for moving a virtual moving object in the virtual space. In addition, the user terminal 20 may be a BCI (Brain Computer Interface) device (including brain-invasive and non-brain-invasive types) that connects the brain and a computer by detecting brain waves or stimulating the brain.

[0013] The information providing device 30 is an information processing terminal that provides three-dimensional space information D1 and three-dimensional map information D2 to the information display device 10. For example, the information providing device 30 is a device that provides information in a geographic information system (GIS).

[0014] 1, the information display device 10 is connected to one user terminal 20 and one information providing device 30, but the number of user terminals 20 and information providing devices 30 connected to the information display device 10 is not limited. Therefore, the information display device 10 may display the same or different three-dimensional images on multiple different user terminals 20. Furthermore, the information display device 10 may receive and manage three-dimensional space information D1 and three-dimensional map information D2 provided from multiple different information providing devices 30.

[0015] <Information display device> An information display device 10 according to an embodiment will be described with reference to Fig. 1. For example, the information display device 10 is an information processing device such as a personal computer including an arithmetic circuit 11, a storage device 12, an input device 13, an output device 14, and a communication circuit 15, as shown in Fig. 1.

[0016] The arithmetic circuit 11 is a controller that controls the entire information display device 10. The arithmetic circuit 11 executes various processes by executing computer programs stored in the storage device 12. The arithmetic circuit 11 may also be a hardware circuit designed specifically to achieve a predetermined function. For example, the arithmetic circuit 11 may be various processors such as a CPU, an MPU, a GPU, an FPGA, a DSP, or an ASIC.

[0017] The storage device 12 is a storage medium for recording various information. The storage device 12 is realized, for example, by a RAM, a ROM, a flash memory, an SSD (Solid State Drive), a hard disk drive, or other storage devices, or by an appropriate combination of these. The storage device 12 can store three-dimensional space information D1, three-dimensional map information D2, moving body information D3, and the like. The storage device 12 also stores various data used in the process of information extraction processing and information display processing.

[0018] The input device 13 is an operation button, a keyboard, a mouse, a touch panel, a microphone, etc. that are operated by an operator, while the output device 14 is a display, a speaker, etc. that are used to output processing results and data.

[0019] The communication circuit 15 is a communication means for enabling data communication with external devices such as the user terminal 20 and the information providing device 30. The data communication can be performed wirelessly and / or wired via the network 40 in accordance with known communication standards. For example, wired data communication is performed by using a communication controller of a semiconductor integrated circuit that operates in compliance with the Ethernet (registered trademark) standard and / or the USB (registered trademark) standard as the communication circuit 15. Wireless data communication is performed by using a communication controller of a semiconductor integrated circuit that operates in compliance with the IEEE802.11 standard for LAN (Local Area Network) and / or the fourth / fifth generation mobile communication system, so-called 4G / 5G, for mobile communication, as the communication circuit 15.

[0020] The three-dimensional space information D1 includes information describing a three-dimensional space including the spherical surface (earth surface) of the earth, which is a sphere. In this embodiment, the three-dimensional space is filled with a plurality of regular hexagonal pyramids, each of which has the center C of the earth as its apex. Each regular hexagonal pyramid is divided into a plurality of partial spaces obtained by virtually and regularly dividing it. Each of the plurality of partial spaces is associated with information about the respective partial space, and each piece of information constitutes the three-dimensional space information D1. FIG. 2 is an example showing a certain partial space O. As shown in FIG. 3, this partial space O is formed by dividing each side of a regular hexagonal pyramid with the center C of the earth as its apex at equal intervals. Specifically, in the example shown in FIG. 3, the plurality of partial spaces O may be a regular hexagonal pyramid and a regular hexagonal pyramid truncated by dividing a regular hexagonal pyramid with the center C of the earth as its apex into 10 equal parts at regular intervals. In this way, the plurality of partial spaces O may be a plurality of hexagonal pyramids or hexagonal pyramid truncated by dividing a three-dimensional space including the spherical surface of the earth at a predetermined interval for each of the hexagonal pyramids of the shape. Moreover, the area of ​​the top surface of each hexagonal pyramid farther from the center C is larger than the area of ​​the bottom surface closer to the center C. The three-dimensional space including the spherical surface of the earth is filled with regular hexagonal pyramids as shown in FIG. 3, with the center C of the earth as the apex. Therefore, the three-dimensional space including the spherical surface of the earth is filled with a plurality of partial spaces O. As described above, each partial space O is obtained by dividing a regular hexagonal pyramid at a predetermined interval. Therefore, when focusing on a plurality of regular hexagonal pyramids, layers (partial spaces) that are the same distance from the center C of the sphere have the same shape, that is, they may have the same volume. For simplification, the example shown in FIG. 2 shows only one partial space O included in the three-dimensional space. Therefore, the partial space O may exist in an upper layer or underground of the partial space O shown in FIG. 2, or may exist side by side in the same layer as the partial space O shown in FIG. 2. The method of forming the partial space O may be any method of dividing the surface of the earth. In this case, for example, assuming that the Earth is a sphere or an ellipsoid, the angle (radian) from the apex to the base of the regular hexagonal pyramid and the altitude (height) are calculated and the pyramid is divided into short distances.

[0021] In the three-dimensional space information D1, as shown in FIG. 4, the "identification information" of each partial space O is associated with the "coordinates of multiple vertices". The "coordinates of multiple vertices" are the coordinates of multiple vertices that represent the partial space O indicated by the identification information. For example, in the example of the Earth, the "coordinates" can be expressed in three-dimensional polar coordinates expressed by latitude, longitude, and distance from the center of the Earth. The partial space O is formed by connecting the coordinates of adjacent vertices in the multiple vertices associated with the identification information. For example, as shown in FIG. 2, when the partial space O is a hexagonal pyramid represented by the coordinates of 12 vertices, in the three-dimensional space information D1, the coordinates of the 12 vertices are associated with the identification information of the partial space. In addition, in the three-dimensional space information D1, as shown in FIG. 4, at least one "first element" that specifies the three-dimensional coordinates included in the three-dimensional space is associated with the "identification information" of each partial space O. The "first element" is, for example, C1 in FIG. 2. Moreover, the "first element" includes, for example, coordinates indicating a position in space and information related to the coordinates, as shown in FIG. 4. The information related to the coordinates is information associated with the coordinates, and may be metadata (including four-dimensional time-space information related to the position and time of a specific point or area on the ground, in the air, underground, etc.). Specifically, the information related to the coordinates may be information on a building existing at the coordinates, for example, a building name, a facility name and a facility type existing in the building. Furthermore, the information related to the coordinates may be an image taken at the coordinates. Furthermore, the information related to the coordinates may be weather information at the coordinates. For example, even if the weather information is at the same coordinates, it may be weather information that differs over time. This three-dimensional spatial information D1 includes three-dimensional coordinates as position information among general "geo-spatial information" and may include all kinds of information related to the three-dimensional coordinates. Note that the three-dimensional spatial information D1 does not need to include information related to the partial space O for all layers inside the earth. For example, in the three-dimensional spatial information D1, for a depth deep underground where no movement of a moving body occurs and no associated information exists, information may not be associated as shown in FIG. 4. Furthermore, the three-dimensional space information D1 includes, for the sky, information related to the partial space O up to the height at which the movement of the moving object occurs.

[0022] Such three-dimensional spatial information D1 represents a plurality of partial spaces O associated with the first information, for example, as shown in the schematic diagram of Fig. 5. Note that in the example shown in Fig. 5, only a portion of the partial space O two layers above the ground is illustrated, but the number of partial spaces on the ground defined by the three-dimensional spatial information D1 is not limited to two layers. Furthermore, the plurality of partial spaces may be arranged so as to cover the entire surface, rather than a portion of the ground surface as in Fig. 5. Therefore, the three-dimensional spatial information D1 may include identification information, a plurality of coordinates, and a first element at a hierarchy of a range including information and a range in which a mobile object is assumed to be movable.

[0023] The three-dimensional space information D1 may associate a plurality of different types of information with one coordinate. At this time, the three-dimensional space information D1 associates the type of information with the information related to each coordinate. As a result, when the information display device 10 displays information as a three-dimensional image on the user terminal 20, the information display device 10 may display the information in a different display method (for example, color or mark) depending on the type of information. Alternatively, the information display device 10 may select a type of information designated according to the user's purpose of use, operation, etc., and display the three-dimensional image. For example, when the moving object is an unmanned drone, the information display device 10 can select information used for the flight of the drone (whether or not other flying objects are flying in the vicinity of the partial space O of the flight area, information on the moving object, etc.) and display it as a three-dimensional image. On the other hand, when the moving object is a human being, the human being does not pass through such a flight area, so the information display device 10 can not display such information as a three-dimensional image.

[0024] The three-dimensional map information D2 is information used to draw a three-dimensional map of a space in association with the three-dimensional space information D1. For example, a three-dimensional map as shown in FIG. 6 can be displayed by the three-dimensional map information D2. In addition, a three-dimensional image to be displayed on the user terminal 20 is generated by combining a first element extracted from the three-dimensional space information D1 with the three-dimensional map extracted from the three-dimensional map information D2. This three-dimensional map may be represented by an absolute coordinate system corresponding to the coordinates of the three-dimensional space information D1. In this way, by representing coordinates uniformly using the absolute coordinate system in the information display system 1, it becomes possible to efficiently execute each process without performing coordinate conversion in each process.

[0025] As shown in FIG. 7 as an example, the moving body information D3 includes a "condition of the moving body" identified by the identification information and a "second element" of the moving body identified by the identification information. For example, the condition of the moving body may include the type of the moving body, the purpose of movement, the size, and / or the movement speed. The condition of the moving body may be a combination of multiple pieces of information. The "second element" includes coordinates indicating at least one point of the moving body and a three-dimensional shape of a range that is a reference for extracting information. Specifically, the coordinates included in the second element indicate a viewpoint based on the moving body. The three-dimensional shape included in the second element indicates a range from which information is extracted as the field of view of the moving body. For example, the second element includes coordinates Pr indicating a viewpoint and coordinates or formulas indicating a three-dimensional shape R that may be a range of the field of view based on the coordinates Pr, as shown in FIG. 8.

[0026] For example, if the moving body is a human, the second element may include information indicating coordinates indicating the position of the human's eyes and a three-dimensional shape representing the field of view according to the position of the human's eyes and the moving speed. For example, when a human walks, it is possible that the human moves forward while observing information about the surroundings. Therefore, by making the three-dimensional shape wider in the surrounding direction and shorter in the forward direction, the amount of information acquired can be reduced. On the other hand, when a human runs, it is possible that the human moves forward without observing much information about the surroundings. Therefore, by making the three-dimensional shape narrower in the surrounding direction than when walking and longer in the forward direction, the amount of information acquired can be reduced. If there are differences as described above and the three-dimensional shape of the second element of a human is a cone with the human's viewpoint as the apex, the three-dimensional shape during walking has a larger radial angle and a shorter length from the apex to the base compared to the three-dimensional shape during running.

[0027] Also, if the moving body is a car, the second element may include, for example, coordinates indicating the position of the driver's eyes and information indicating a three-dimensional shape representing the driver's field of view according to the moving speed of the car and the position of the driver's eyes. For example, since a car has little movement other than in the forward direction, a large collider may be used in the forward direction. This can reduce the acquisition of unnecessary information and reduce the processing load.

[0028] Furthermore, if the moving object is an unmanned drone, the second element may include, for example, coordinates indicating the position of a sensor such as a camera mounted on the drone, and information indicating a three-dimensional shape according to the moving speed of the drone and the shooting range of the camera. For example, since a drone may move in a wide range other than the front, a collider with a wide range may be used, like a human walking. In addition, if the moving object is a drone, the selected second element may be transformed according to the zoom level set by the camera equipped on the drone.

[0029] Specifically, even when a three-dimensional image is generated using the same three-dimensional map information D2, the information extracted differs depending on the conditions of the moving body, and therefore the generated three-dimensional image differs. As described above, for example, when the moving body is a car, a three-dimensional image including information on a range far in front of the surroundings is generated as shown in FIG. 9A. In contrast, when the moving body is a drone, a three-dimensional image including information on a wide range of the surroundings, not far away, may be generated as shown in FIG. 9B, compared to FIG. 9A. As described above, the second element differs depending on the conditions of the moving body, and therefore the example using FIGS. 9A and 9B is only an example. For example, in FIGS. 9A and 9B, only the coordinates of the information are shown, but as part of the information, a part of the text data, an illustration representing the information, or the like may be included in the three-dimensional image. These three-dimensional images may be displayed as AR (augmented reality) or VR (virtual reality).

[0030] Here, it is preferable that the coordinates included in the second element correspond to the coordinates of the three-dimensional space information D1, so that the first element can be easily extracted from the three-dimensional space information D1 according to the coordinates included in the second element.

[0031] When the arithmetic circuit 11 receives the three-dimensional space information D1 provided from the information providing device 30 via the communication circuit 15, it stores the information in the storage device 12. Here, when the coordinates included in each piece of information D1, D2 provided from the information providing device 30 are not expressed in an absolute coordinate system, the arithmetic circuit 11 may unify the coordinates into the absolute coordinate system.

[0032] The arithmetic circuit 11 receives conditions of a virtual moving object to be displayed on the display of the user terminal 20 from the user terminal 20 via the network 40. For example, the arithmetic circuit 11 receives a type of the moving object and a moving speed of the moving object via the user terminal 20 as conditions of the virtual moving object. Furthermore, the arithmetic circuit 11 refers to the moving object information D3 stored in the storage device 12 and selects a second element associated with the received conditions of the virtual moving object.

[0033] The arithmetic circuit 11 receives position information of the virtual moving object from the user terminal 20 via the network. The position information of the virtual moving object acquired here is preferably expressed in an absolute coordinate system used in the three-dimensional space information D1. If the received position information is not expressed in the absolute coordinate system used in the three-dimensional space information D1, the arithmetic circuit 11 may convert the received position information into the absolute coordinate system. In addition, the position information of the virtual moving object acquired here may be the coordinates Pr of the viewpoint of the virtual moving object described above with reference to FIG. 8. By handling the position information of the virtual moving object in the coordinates Pr of the viewpoint of the virtual moving object, the coordinate conversion process can be reduced.

[0034] When displaying a three-dimensional image showing a virtual space according to the movement of a virtual moving object, the arithmetic circuit 11 extracts a first element from the three-dimensional space information D1 according to the positional relationship between the first element and the second element. For example, the arithmetic circuit 11 selects a partial space O located in a range specified by the position of the virtual moving object and the second element from a plurality of partial spaces O represented by the three-dimensional space information D1 as described above with reference to FIG. 5. Specifically, the arithmetic circuit 11 determines the range of the three-dimensional shape R represented by the second element in the three-dimensional space based on the coordinates indicated by the position of the virtual moving object. In addition, the arithmetic circuit 11 selects four partial spaces O, as shown in FIG. 10, as partial spaces O existing in the range of the determined three-dimensional shape R from a plurality of partial spaces O represented by the three-dimensional space information D1. In addition, the arithmetic circuit 11 extracts all first elements C1 included in the selected partial space O. Assuming that the selected subspace O contains a total of six first elements C1 as shown in FIG. 10, the arithmetic circuit 11 extracts these six first elements C1.

[0035] However, even if the selected subspace O includes a total of six first elements, the range of the three-dimensional shape R specified by the position of the moving object and the second elements includes only five first elements as shown in Fig. 11. In this case, the arithmetic circuit 11 may extract only the five first elements.

[0036] At this time, the arithmetic circuit 11 extracts information associated with the selected subspace. That is, the arithmetic circuit 11 extracts information that is metadata included in the extracted first element.

[0037] Furthermore, the arithmetic circuit 11 extracts a three-dimensional map from the three-dimensional map information D2 according to the position of the second element.

[0038] The arithmetic circuit 11 generates a three-dimensional image in which each coordinate included in the first element extracted from the three-dimensional space information D1 is associated with information related to each coordinate in the three-dimensional map extracted from the three-dimensional map information D2. The arithmetic circuit 11 also transmits the generated three-dimensional image to the user terminal 20 and causes the user terminal 20 to display it.

[0039] In this way, the information display device 10 can extract a useful range of information from the three-dimensional space information D1. Moreover, the information display device 10 can generate and display a three-dimensional image using only the extracted information. This allows the information display system 1 to reduce the amount of data transmitted from the information display device 10 to the user terminal 20, thereby reducing the load.

[0040] <Processing for Acquiring Information in Information Display Device> An example of the flow of a process in which the information display device 10 acquires information from the information providing device 30 will be described with reference to the flowchart shown in FIG.

[0041] The arithmetic circuit 11 acquires three-dimensional space information D1 from the information providing device 30 via the network 40 (S01). At this time, the information display device 10 stores the acquired three-dimensional space information D1 in the storage device 12.

[0042] Furthermore, the arithmetic circuit 11 acquires three-dimensional map information D2 from the information providing device 30 via the network 40 (S02). At this time, the information display device 10 causes the storage device 12 to store the acquired three-dimensional map information D2.

[0043] The arithmetic circuit 11 determines whether the coordinate system of the three-dimensional space information D1 acquired in step S01 and the coordinate system of the three-dimensional map information D2 acquired in step S02 are the same (S03).

[0044] When the coordinate systems are not identical (NO in S03), the arithmetic circuit 11 matches the coordinate systems of the three-dimensional space information D1 and the three-dimensional map information D2 (S04).

[0045] When the coordinate systems are the same (YES in S03), or when the coordinate systems are aligned in step S04, the arithmetic circuit 11 ends the information acquisition process and waits for the next process. For example, the next process may be the acquisition of new information, which may be the process described above using steps S01 to S04. Alternatively, the next process may be the process of extracting and displaying information, which will be described later using FIG. 13.

[0046] (Processing of extracting and displaying information in information display device) The flow of processing in which the information display device 10 extracts information and displays it on the display of the user terminal 20 will be described with reference to the flowchart shown in FIG.

[0047] First, the arithmetic circuit 11 receives the conditions of the moving object from the user terminal 20 via the network 40 (S11).

[0048] The arithmetic circuit 11 refers to the moving object information D3 stored in the storage device 12, and extracts a second element associated with the moving object condition received in step S11 (S12).

[0049] Furthermore, the arithmetic circuit 11 receives coordinates indicating the position information of the moving object from the user terminal 20 via the network 40 (S13).

[0050] The arithmetic circuit 11 combines the coordinates indicated by the position information received in step S13 with the three-dimensional shape of the second element extracted in step S12 to determine the three-dimensional shape that is the subject of information extraction (S14).

[0051] The arithmetic circuit 11 refers to the three-dimensional space information D1 stored in the storage device 12, and extracts a first element according to the three-dimensional shape determined in step S14 (S15).

[0052] The arithmetic circuit 11 combines the three-dimensional map information D2 stored in the storage device 12 with the first element extracted in step S15 to generate a three-dimensional image for display (S16).

[0053] The arithmetic circuit 11 transmits the three-dimensional image generated in step S16 to the user terminal 20 via the network 40 (S17).

[0054] As a result, the arithmetic circuit 11 causes the generated three-dimensional image to be displayed on the user terminal 20. Furthermore, the processing of steps S11 to S18 is repeated until the processing of displaying the three-dimensional image is completed. For example, when the moving speed of the moving object is changed as a condition of the moving object, the new moving speed is accepted in step S11, and the second element is extracted in accordance with the change in step S12.

[0055] As described above, the information display device 10 extracts information from the three-dimensional space information D1 according to the conditions of the moving body, and generates and displays a three-dimensional image. That is, the information display device 10 can extract only information suitable for each moving body from the three-dimensional space information D1. For example, when the moving body is an automobile, the automobile rarely moves other than forward, so the three-dimensional shape can be generated mainly as a large collider in the front. Therefore, the information display device 10 can extract a large amount of information of the three-dimensional space information D1 related to the front, which is highly necessary for the movement of the automobile, as a three-dimensional image. On the other hand, the information display device 10 can reduce the amount of information of the three-dimensional space information D1 related to the left and right directions, which is not highly necessary for the movement of the automobile, as a three-dimensional image. As a result, the information display device 10 can reduce the load of information processing without impairing the appropriate movement of the moving body, thereby reducing the amount of data transmission and preventing the occurrence of processing delays. The information display device 10 can also generate a collider with an optimal three-dimensional shape for each area in which the vehicle is actually traveling, based on a trained program that has learned data such as the distance and speed the vehicle has actually traveled and the environment around the traveling area. For example, in an area that includes a steep downhill slope on a road with poor visibility, the information display device 10 can further change the shape of the collider selected for normal driving before approaching the slope, based on a trained program that has learned the actual driving data of the area, and generate a collider with a shape that includes information on a range further ahead as a three-dimensional image. This allows the vehicle to quickly recognize the steep downhill slope on a road with poor visibility and reduce the vehicle's speed.

[0056] <Variation 1> 2 and 3, each partial space O is described as a hexagonal pyramid and a hexagonal truncated pyramid obtained by dividing a hexagonal pyramid having a vertex at the center C of a sphere (earth), but is not limited to a hexagonal pyramid or a hexagonal truncated pyramid. For example, each partial space O may be another polyhedron such as a pyramid or a frustum formed by dividing a polygonal pyramid such as a regular triangular pyramid or a regular square pyramid having a vertex at the center C of a sphere, as long as it has a space-filling shape.

[0057] Furthermore, each partial space O may be a polyhedron obtained by dividing a pyramid such as a triangular pyramid, a square pyramid, or a hexagonal pyramid, or may be a partial space O obtained by dividing a sphere with a curved surface along the spherical surface. Each partial space O obtained in this way is not a polyhedron as shown in Figures 2 and 3, but is formed by multiple side surfaces of the same shape obtained by dividing the side surface of a pyramid, and two curved surfaces with different areas.

[0058] <Variation 2> In the above description using Figs. 2 and 3 and Modification 1, each partial space O is formed by equally dividing a pyramid, but this is not limiting. Specifically, as long as a plurality of partial spaces O in the same layer have the same height, the height of each partial space O in different layers may not be the same. For example, the height of each partial space O may be such that the pyramid is divided so that each partial space O has a similar shape. In this case, in the three-dimensional space information D1, a plurality of similarly shaped pyramid truncations that grow from the center of the earth toward the sky are defined as layers.

[0059] <Variation 3> Alternatively, in the three-dimensional space information D1, the height of each partial space O may be set to match the frequency of movement of the moving object and the density of information. For example, it is assumed that the frequency of movement of the moving object is high on the surface of the earth, and that the amount of information registered as metadata is also large on the surface of the earth. In such a case, the height of the partial space O may be set to be low on the surface of the earth, and high as it gets deeper from the ground or sea level and as it goes up into the sky. This allows the height of the partial space O to be adjusted according to the amount of information, which facilitates the processing of extracting information and displaying information, and reduces delays in processing and data transmission and reception.

[0060] Variation 4 In the above description using Figs. 2 and 3, each partial space O obtained by dividing a three-dimensional space is described as an example of a combination of pyramids and pyramid truncations generated based on a pyramid. However, the partial space O dividing the three-dimensional space is not limited to pyramids and pyramid truncations. Specifically, any shape may be used as long as the space filling rate along the ellipsoidal height of the earth can be 100%. For example, the partial space O dividing the three-dimensional space may be a truncated octahedron. Specifically, a truncated octahedron is useful as a shape of a partial space dividing a three-dimensional space in that it can fill space. For example, the center of the earth and the center of a reference truncated octahedron are arranged to coincide with each other. In addition, multiple truncated octahedrons of the same shape are arranged around the reference truncated octahedron so that their sides are in contact. In this way, multiple truncated octahedrons are filled along the sphere of the earth. In this case, the shapes and sizes of all the partial spaces are the same, making data management easy.

[0061] In addition, since the partial space O has a shape that can achieve a space filling rate of 100% along the ellipsoid height of the earth, it is easy to achieve equal division whether the space is on the earth or underground. For example, in the case of the XYZ tiles (XYZ map tiles) method in which the space is divided into shapes that have been divided into tiles in advance, the scale, size, and projection method used differ depending on the service provider and country, making it difficult to collect and superimpose spatial data. However, in this embodiment, whether the space is on the earth or underground, the partial space O is divided, for example, by a truncated octahedron, and the space filling rate along the ellipsoid height of the earth can be set to 100% by integrating each truncated octahedron, making it easy to collect and superimpose data linked to each partial space O. Note that, for example, in the case of a drone that can move diagonally in addition to up, down, left, and right, the moving body can be divided into the partial space O of a truncated octahedron, so that the space diagonally above and below the drone can be included. Therefore, information can be acquired by dividing a three-dimensional space into a partial space O suitable for the movement of a drone. By specifying the vertical and horizontal lengths and the zoom level, the drone can acquire an ID (information associated with the subspace O) contained within the subspace O adjacent to the drone. Note that, in addition to a truncated octahedron, the subspace O dividing the three-dimensional space may be a rhombic dodecahedron. Even when the subspace O dividing the three-dimensional space is a rhombic dodecahedron, the shape and size of all the subspaces are the same, making data management easier.

[0062] Other Modifications In the above example, the information display system 1 has been described as being used in a digital twin, but is not limited thereto. For example, the same applies when used in a metaverse, video games, etc. In this case, for example, the three-dimensional space information D1 and the three-dimensional map information D2 are information representing a metaverse space. In addition, in this case, the moving body may be an avatar or a virtual drone moving in the metaverse space. Therefore, the space represented by the three-dimensional space information D1 and the three-dimensional map information D2 is not limited to a space reproducing the earth, and may be a virtual space representing a planet based on another sphere. In addition, when used in a virtual space such as a metaverse or a video game, a collider used in a game engine may be adopted as the second element.

[0063] The information display system 1 can also be used in a moving object moving in real space. At this time, for example, the three-dimensional space information D1 is displayed in real space as AR (augmented reality). The moving object can be a drone moving in real space. When the drone moves in real space, the arithmetic circuit 11 receives the position information of the drone moving in real space from the user terminal 20 via a network based on a signal received by a GPS (global positioning system) receiver provided in the drone. As a result, the information display device 10 recognizes the area through which the drone actually passes, and in the partial space O corresponding to the passing area, obtains information used for real flight (topographical information, legal regulation information of the area, various weather information, etc.) as a first element of the three-dimensional space information D1, and can display it as a three-dimensional image of AR (augmented reality). As a result, a user who flies a drone in real space can perform risk assessment of the flight airspace during flight based on the information of the three-dimensional image displayed in AR. For example, when a flying drone actually approaches an area where drone flying is legally restricted, the legal information of the area can be acquired as a first element of the three-dimensional space information D1 and displayed as an AR three-dimensional image, allowing the flying drone to avoid entering the legally restricted area in advance.

[0064] In the above example, the information display system 1 has been described as displaying information on the display of the user terminal 20, but the display method is not limited to this. For example, the information display system 1 may be displayed by projecting the information within a range visible to the user of the user terminal 20. [Industrial Applicability]

[0065] INDUSTRIAL APPLICABILITY The present disclosure is useful for reducing the load of data processing when displaying video using three-dimensional spatial information. [Explanation of symbols]

[0066] 1 Information display system 10 Information display device 11 Arithmetic circuit 12 Storage device 13 Input Devices 14 Output Devices 15 Communication Circuits 20 User terminal 30 Information provision device

Claims

1. An information extraction method is executed by an information processing device including an arithmetic circuit that can access a storage device, the method ascertaining that information is associated with each of a plurality of partial spaces, and extracting information associated with at least one of the partial spaces as a moving object moves, the information extraction method comprising: The storage device includes: storing three-dimensional space information including the information associated with each of a plurality of partial spaces obtained by virtually and regularly dividing the three-dimensional space with the center of a sphere as a center; Each of the subspaces is associated with at least one first element that specifies three-dimensional coordinates that represent the three-dimensional space; the moving entity is associated with a second element that indicates at least one point of the moving entity; The arithmetic circuit includes: when the moving object is moved within the three-dimensional space, a partial space is selected from the three-dimensional space information according to a positional relationship between the first element and the second element; Extracting information associated with the selected subspace Information extraction method.

2. In the three-dimensional spatial information, In the three-dimensional space, the partial spaces are arranged in a plurality of layers, The subspaces have the same volume in layers that are the same distance from the center. The information extraction method according to claim 1 .

3. When the three-dimensional space is filled with a plurality of pyramids of the same shape with the center of the sphere as a vertex, each of the partial spaces has a shape formed by dividing each side of the plurality of pyramids. The information extraction method according to claim 2.

4. Each of the subspaces has a similar shape that increases with distance from the center. The information extraction method according to claim 3.

5. The storage device includes: storing moving body information associated with a second element including a three-dimensional shape of a range serving as a reference for extracting the information for each condition of the moving body; The arithmetic circuit includes: selecting a three-dimensional shape associated with a condition of the moving object by referring to the moving object information stored in the storage device; When extracting the information from the three-dimensional space information, all of the information associated with the selected partial space is extracted. The information extraction method according to claim 1 .

6. The storage device includes: storing moving body information associated with a second element including a three-dimensional shape of a range serving as a reference for extracting the information for each condition of the moving body; The arithmetic circuit includes: selecting a three-dimensional shape associated with a condition of the moving object by referring to the moving object information stored in the storage device; When extracting the information from the three-dimensional space information, the information associated with the range of the selected three-dimensional shape is extracted. The information extraction method according to claim 1 .

7. The conditions of the moving object include at least one of the type of the moving object, the purpose of the movement, and the speed of the movement. The information extraction method according to claim 5.

8. The arithmetic circuit includes: Further modifying the selected three-dimensional shape based on the information extracted from the three-dimensional spatial information. The information extraction method according to claim 5.

9. The sphere is the Earth. The information extraction method according to claim 1 .

10. The subspace has a shape in which its height increases with distance from the surface of the Earth. The information extraction method according to claim 9.

11. The subspace is a truncated octahedron The information extraction method according to claim 1 .

12. An information display method for displaying virtual three-dimensional space information, the method being executed by an information processing device including an arithmetic circuit accessible to a display, the method comprising: The arithmetic circuit is The information extracted by the information extraction method according to any one of claims 1 to 11 is displayed on the display. Information display method.

13. An information display device including an arithmetic circuit that can access a storage device, wherein information is associated with each of a plurality of partial spaces, and the information associated with at least one of the partial spaces is extracted in accordance with the movement of a moving object, and virtual three-dimensional space information is displayed based on the extraction result, The storage device includes: storing three-dimensional space information including the information associated with each of a plurality of partial spaces obtained by virtually and regularly dividing the three-dimensional space with the center of a sphere as a center; Each of the subspaces is associated with at least one first element that specifies three-dimensional coordinates that represent the three-dimensional space; the moving object is associated with a second element that indicates at least one point of the moving object; The arithmetic circuit includes: when the moving object is moved within the three-dimensional space, a partial space is selected from the three-dimensional space information according to a positional relationship between the first element and the second element; Extracting information associated with the selected subspace Information display device.

14. The positional relationship between the first element and the second element is expressed in an absolute coordinate system used in the three-dimensional space information. The information display device according to claim 13.

15. The mobile unit has a GPS (Global Positioning System) receiver; The arithmetic circuit obtains location information of the moving object as a second element based on a signal received by the GPS receiver. The information display device according to claim 14.

16. A computer program for causing an information processing device to execute the information extraction method according to any one of claims 1 to 11.

17. A computer program for causing an information processing device to execute the information display method according to claim 12.

Images