3D display system, 3D display method, and 3D display program

Abstract

This invention relates to a 3D display system, a 3D display method, and a 3D display program. [Solution] The 3D display system 1 comprises a storage unit, a coordinate mounting unit, and a display processing unit. The memory unit stores 3D data information for generating a 3D space and a 3D model located in the 3D space, as well as coordinate points indicating predetermined positions in the 3D space. The coordinate mounting unit determines the mounting coordinates by attaching coordinate points to the 3D model based on user input, and the display processing unit displays the 3D model in 3D space corresponding to the coordinate points based on the mounting coordinates.

Description

Technical Field

[0001] The present invention relates to a 3D display system, a 3D display method, and a 3D display program.

Background Art

[0002] Recently, various initiatives using various position information have been carried out at construction sites.

[0003] Patent Document 1 discloses a work area management system that determines the position and boom direction of a mobile crane based on the position measured by a first GNSS terminal and the position measured by a second GNSS terminal, and determines whether there is interference with other objects based on the position and boom direction of the mobile crane.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By using the technology of Patent Document 1, it is possible to grasp the interference between a mobile crane and other objects. However, in Patent Document 1, it is difficult to freely set the position of the mobile crane according to the user's request and display it in a 3D space (construction site). If flexible display of a 3D model according to the user's request can be realized, accurate situation grasping can be achieved in a 3D space even when visibility in the real space is poor, for example, at night.

[0006] The present invention has been made in view of the above problems of the prior art, and its object is to realize a 3D display system capable of simply and flexibly displaying the positional relationship of a heavy machine etc. (3D model) at a construction site (3D space). [Means for solving the problem]

[0007] To solve the above problems, a 3D display system that displays a 3D space corresponding to a construction site is provided, The 3D display system comprises a storage unit, a coordinate mounting unit, and a display processing unit. The storage unit stores 3D data information for generating the 3D space and the 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The aforementioned coordinate mounting unit determines the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates.

[0008] Furthermore, the present invention relates to a 3D display method executed by a 3D display system that displays a 3D space corresponding to a construction site, The 3D display system comprises a storage unit, a coordinate mounting unit, and a display processing unit. The memory unit stores 3D data information for generating the 3D space and a 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The coordinate mounting unit performs the steps of determining the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user, The display processing unit includes the step of displaying the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates.

[0009] Furthermore, the present invention is a 3D display program that displays a 3D space corresponding to a construction site, The computer is configured to function as a memory unit, a coordinate mounting unit, and a display processing unit. The storage unit stores 3D data information for generating the 3D space and the 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The aforementioned coordinate mounting unit determines the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates.

[0010] This configuration allows users to easily and flexibly display the positional relationships of heavy machinery and other equipment (3D models) within a construction site (3D space). As a result, accurate situational awareness can be achieved in 3D space even when visibility in the real world is poor, such as at night. Furthermore, the ability to freely set positions allows for measurement of distances from existing structures and differences or errors between the original position of the 3D model and the set position in the virtual space.

[0011] In a preferred embodiment of the present invention, the coordinate mounting unit determines a plurality of mounting coordinates by attaching a plurality of coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on a plurality of mounting coordinates.

[0012] This configuration makes it possible to display highly accurate 3D models using multiple coordinate points.

[0013] In a preferred embodiment of the present invention, the coordinate mounting unit determines the first mounting coordinate and the second mounting coordinate by attaching a first coordinate point and a second coordinate point to the 3D model based on input from the user. The display processing unit moves the 3D model from its original position to correspond to the first coordinate point based on the first mounting coordinate, and rotates the orientation of the 3D model to correspond to the first coordinate point based on the second mounting coordinate, with respect to the first mounting coordinate, and then performs the display processing.

[0014] This configuration allows for flexible and accurate display of the position and orientation of a 3D model in 3D space based on coordinate points.

[0015] In a preferred form of the present invention, based on an input from a user, the coordinate attachment unit determines first attachment coordinates, second attachment coordinates, and third attachment coordinates in the 3D model, Based on the second attachment coordinates and the third attachment coordinates, the display processing unit rotates the posture of the 3D model at an angle corresponding to the second attachment coordinates with respect to a rotation axis corresponding to the first attachment coordinates, and rotates the posture of the 3D model at an angle corresponding to the third attachment coordinates perpendicular to the rotation axis corresponding to the second attachment coordinates, and performs display processing on the 3D model.

[0016] With such a configuration, the position and posture of the 3D model in the 3D space can be displayed more accurately based on coordinate points.

[0017] In a preferred form of the present invention, the 3D display system further includes a calculation unit, The calculation unit calculates the difference between a predetermined position indicated by a coordinate point in the 3D space and the attachment coordinates at which the coordinate point is attached to the 3D model, Based on the difference, the display processing unit performs display processing on the 3D model moved to a position based on the difference.

[0018] With such a configuration, the 3D model can be displayed more accurately.

[0019] In a preferred form of the present invention, the 3D display system further includes a calculation unit, The calculation unit calculates a first unit vector in the first attachment coordinates and the second attachment coordinates, and calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point, Based on the difference between the predetermined position indicated by the first coordinate point in the 3D space and the first attachment coordinates, the display processing unit performs display processing on the 3D model at a position corresponding to the difference, and performs display processing on the 3D model according to an angle obtained from the difference between the first unit vector and the second unit vector.

[0020] By adopting such a configuration, the position and orientation of the 3D model can be accurately displayed using unit vectors.

[0021] In a preferred form of the present invention, the 3D display system further includes a calculation unit. The calculation unit calculates a first unit vector at the first attachment coordinates and the second attachment coordinates, and calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point. Furthermore, the calculation unit calculates a third unit vector at the first attachment coordinates and the third attachment coordinates, and calculates a fourth unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the third coordinate point. The display processing unit performs display processing on the 3D model at a position and orientation corresponding to a position obtained from the difference between the predetermined position indicated by the first coordinate point in the 3D space and the first attachment coordinates, an angle obtained from the difference between the first unit vector and the second unit vector, and an orthogonal rotation angle orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0022] By adopting such a configuration, the position and orientation of the 3D model can be more accurately displayed using unit vectors.

[0023] In a preferred form of the present invention, the display processing unit performs display processing on numerical information related to the coordinate point together with the coordinate point corresponding to the 3D model.

[0024] By adopting such a configuration, the user can visually recognize the 3D model in the 3D space while checking the difference between the original position (and / or attachment coordinates) in the 3D model such as a heavy machine and the position of the coordinate point.

Advantages of the Invention

[0025] According to the present invention, by associating a 3D model with a coordinate point and performing predetermined display processing, a novel technology related to a 3D display system can be provided.

Brief Description of the Drawings

[0026] [Figure 1] A block diagram of the system configuration for one embodiment of the present invention is shown. [Figure 2] A schematic diagram of an example of the hardware configuration of an information processing device and terminal according to one embodiment of the present invention is shown. [Figure 3] A flowchart of the processing procedure in a 3D display system according to one embodiment of the present invention is shown. [Figure 4] An example of the information used in a 3D display system according to one embodiment of the present invention is shown. [Figure 5] An example of a display image on a user terminal according to one embodiment of the present invention is shown. [Figure 6] This shows the flow of display processing on a user terminal related to one embodiment of the present invention. [Figure 7] This shows the flow of display processing on a user terminal related to one embodiment of the present invention. [Figure 8] An example of a display image on a user terminal according to one embodiment of the present invention is shown. [Figure 9] An example of a display image of numerical information relating to one embodiment of the present invention is shown. [Modes for carrying out the invention]

[0027] Further details will be provided below with reference to the attached drawings. The drawings show preferred embodiments. However, many different forms are possible and the embodiments are not limited to those described herein.

[0028] For example, in this embodiment, the configuration and operation of the 3D display system will be described, but similar effects can be achieved by the execution method (steps), apparatus, computer program, etc. The program in this embodiment may be provided as a computer-readable non-transient recording medium, or it may be provided so that it can be downloaded from an external server.

[0029] Furthermore, in this embodiment, "part" may also include, for example, hardware resources implemented by circuits in a broad sense, and the information processing of software that can be specifically realized by these hardware resources.

[0030] In this embodiment, "information" can be represented, for example, by the physical value of a signal value representing voltage or current, the high or low value of a signal value as a set of binary bits consisting of 0s or 1s, or by a quantum superposition (so-called qubit), and communication and calculations can be performed on a circuit in a broad sense.

[0031] In a broad sense, a circuit is a circuit realized by appropriately combining circuits, circuits (including processors and memory). That is, it includes CPUs (Central Processing Units), GPUs (Graphics Processing Units), LSIs (Large Scale Integration), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), etc.

[0032] <System Configuration> Figure 1 is a block diagram showing the system configuration according to one embodiment of the present invention. As shown in Figure 1, the 3D display system 1 includes an information processing device 10 and a database DB. The 3D display system 1 is configured to communicate with a plurality of user terminals 2 (reference numerals 2(a) to 2(d) in Figure 1) via a network NW.

[0033] The information processing device 10 operates as a server, and the user terminal 2 is a terminal used by users such as general contractors and site supervisors at construction sites.

[0034] In this embodiment, the network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, nor on the type or size of the network.

[0035] Furthermore, a general-purpose server computer or personal computer can be used as the information processing device 10. It is also possible to implement the functional components described later on multiple computers to constitute the 3D display system 1.

[0036] User terminal 2 is a terminal used by general contractors and others at construction sites. User terminal 2 can be a smartphone, tablet, personal computer, wearable device, etc. User terminal 2 stores a 3D display application program for the user, and this application program is configured to display a 3D space representing the construction site, as well as 3D models of heavy machinery, bridge girders, etc.

[0037] User terminal 2 can also be configured without a 3D display application program. In this case, user terminal 2 can display and transmit information using a web browser or similar.

[0038] <Hardware Configuration> Figure 2(a) shows an example of the hardware configuration of the information processing device 10. The information processing device 10 comprises a control unit 11, a storage unit 12, and a communication unit 13 as its hardware configuration.

[0039] The control unit 11 includes one or more processors such as a CPU, and controls the entire operation of the information processing device 10 by executing the 3D display program, OS, and other applications according to the present invention.

[0040] The storage unit 12 is an HDD, SSD, ROM, RAM, etc., and stores the 3D display program according to the present invention and data used by the control unit 11 when it executes processing based on the program. The control unit 11 executes processing based on the 3D display program stored in the storage unit 12, thereby realizing the functional configuration described later.

[0041] The communication unit 13 performs communication control with the network NW and provides inputs necessary for operating the information processing device 10, as well as outputs related to the operation results.

[0042] Figure 2(b) shows an example of the hardware configuration of terminal 90 (user terminal 2 in Figure 1). Terminal 90 comprises a control unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95 as its hardware configuration.

[0043] The control unit 91 of the terminal 90 includes one or more processors such as a CPU and controls the entire operation of the terminal 90. The storage unit 92 of the terminal 90 is an HDD, SSD, ROM, RAM, etc., and stores the aforementioned performance management application program and data used by the control unit 91 when executing processing based on the program.

[0044] The communication unit 93 of terminal 90 controls communication with the network. The input unit 94 of terminal 90 is a touch panel, mouse, keyboard, etc., which inputs user operation requests to the control unit 91. The output unit 95 of terminal 90 is a display, etc., which displays the results of processing by the control unit 91.

[0045] <Functional Configuration> As shown in Figure 2(a), the information processing device 10 comprises, as a functional configuration, a reception unit 101, a display processing unit 102, a coordinate mounting unit 103, and a calculation unit 104. These are the concrete realizations of information processing performed by software (stored in the storage unit 12) by hardware (control unit 11, etc.).

[0046] The reception unit 101 receives and registers various information from the user terminal 2 and the administrator. The reception unit 101 receives user information from the user terminal 2 and stores it in the storage unit 12. The reception unit 101 also receives 3D data information from the user terminal 2 and the administrator terminal (not shown in the diagram) and stores it in the storage unit 12. The reception unit 101 receives operation input for coordinate points indicating predetermined positions in 3D space (for example, operation input for attaching coordinate points to a 3D model) from the user terminal 2 and the administrator terminal.

[0047] The display processing unit 102 processes and displays various information. The display processing unit 102 processes and displays the 3D space based on the 3D data information. In this embodiment, the display processing unit 102 processes and displays the 3D model in the 3D space in correspondence with coordinate points indicating a predetermined position in the 3D space, based on the mounting coordinates (coordinates when the coordinate points are attached to the heavy equipment model, etc., by drag operation), which will be described later. The display processing unit 102 also processes and displays the 3D model in the 3D space in correspondence with coordinate points based on multiple mounting coordinates.

[0048] Specifically, the display processing unit 102 can move the 3D model from its original position to correspond to the first coordinate point based on the first mounting coordinate, and also rotate the orientation of the 3D model to correspond to the first coordinate point based on the second mounting coordinate, with the first mounting coordinate as the reference point, and then perform the display processing.

[0049] Furthermore, the display processing unit 102 can also display the 3D model by rotating the orientation of the 3D model at an angle corresponding to the second mounting coordinate, using the rotation axis corresponding to the first mounting coordinate as a reference, and by rotating the orientation of the 3D model at an angle corresponding to the third mounting coordinate which is orthogonal to the rotation axis corresponding to the second mounting coordinate, based on the second and third mounting coordinates. The display processing unit 102 may also display the difference corresponding to the 3D model.

[0050] Furthermore, the display processing unit 102 can also display the 3D model at a position and orientation corresponding to the position obtained from the difference between a predetermined position indicated by a first coordinate point in 3D space and the first mounting coordinate, the angle obtained from the difference between the first unit vector and the second unit vector (described later), and the orthogonal rotation angle that is orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0051] The coordinate attachment unit 103 attaches (associates) predetermined coordinate points to a 3D model of heavy machinery or the like in 3D space. In this embodiment, the coordinate attachment unit 103 attaches coordinate points to the 3D model and determines the attachment coordinates (coordinates located on the 3D model) based on input from the user. The coordinate attachment unit 103 also attaches multiple coordinate points to the 3D model and determines multiple attachment coordinates based on input from the user.

[0052] The coordinate mounting unit 103 can determine the first and second mounting coordinates by attaching a first coordinate point and a second coordinate point to the 3D model based on user input, or it can determine the first, second, and third mounting coordinates by attaching a first, second, and third coordinate point to the 3D model based on user input.

[0053] The calculation unit 104 calculates the information necessary for displaying the 3D model. In this embodiment, the calculation unit 104 calculates a first unit vector at the first mounting coordinate and the second mounting coordinate, and also calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point.

[0054] The calculation unit 104 can calculate the difference between a predetermined position indicated by a coordinate point in 3D space and the mounting coordinates to which the coordinate point is attached to a 3D model. Furthermore, the calculation unit 104 can calculate a third unit vector at the first mounting coordinates and the third mounting coordinates, and can also calculate a fourth unit vector at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the third coordinate point. The calculation unit 104 can calculate the difference between each of the values ​​calculated under predetermined conditions.

[0055] <database DB> The database DB in Figure 1 stores user information, 3D data information, coordinate point information, mounting coordinate information, and other information necessary for 3D display. Some or all of this information may be stored in the storage unit 12, or some of this information may be stored in another database.

[0056] The following describes the 3D display system 1 and the processing performed by each functional component, referring to Figures 3 to 8.

[0057] <Overview of the 3D display system> The 3D display system 1 according to this embodiment is a system that can easily and flexibly display 3D models (such as heavy machinery and bridge girders) in a 3D space according to predetermined conditions desired by the user. Specifically, in the 3D display system 1, coordinate points (meaning predetermined coordinates in the 3D space) that indicate predetermined positions in a 3D space that reproduces a construction site can be moved based on user input (screen drag operation), and by attaching these coordinate points to a 3D model, the 3D model can be displayed corresponding to the coordinate points.

[0058] By enabling such simple operation, that is, by accurately positioning 3D models using high-precision location information, it is possible to measure the distance from existing structures in virtual space (collision avoidance), and to measure the difference from design values ​​(design position) in virtual space (coordinate alignment). For example, even when visibility in the real world is poor, such as at night, the exact location can be confirmed in virtual space (situation assessment). The following describes the processing flow in 3D display system 1 in detail.

[0059] <Register various types of information> Figure 3 shows a flowchart of the processing procedure in a 3D display system according to one embodiment of the present invention. In S201, users such as the general contractor and site supervisor (and workers) at the construction site register various information.

[0060] Specifically, users can register information such as user information, 3D data information corresponding to construction sites and heavy machinery, coordinate point information relating to coordinate points indicating predetermined positions in 3D space, and mounting coordinate information relating to the correspondence between 3D models and coordinate points via user terminal 2, etc. In this embodiment, the term "user" includes not only the general contractor (the general contractor company and its personnel) but also site supervisors, workers, and other people who manage the process and work at the construction site.

[0061] To use the 3D display system 1, users register user information, such as company information. As shown in Figure 4(a), user information is managed by a user ID and includes information such as the company name (e.g., ○○○ Corporation or △△△ Corporation), company contact information, company address, types of work that can be performed, and registration date. User information can also include the name of the person in charge of the actual construction site.

[0062] In this embodiment, users whose user information is registered (prime contractors and their representatives) can use the services related to the 3D display system 1. However, registration of user information is not necessarily required, and the system may be configured so that users who have not registered their user information can also use the services.

[0063] As shown in Figure 4(b), 3D data information is managed by a 3D data ID, which includes information such as the storage location of the 3D data, location (coordinates), angle (or orientation or rotation of the 3D model), and scale (magnification). Here, 3D data is three-dimensional data (three-dimensional model) used to construct a 3D space. For example, structures and parts such as elevated bridges and buildings are managed by a 3D data ID (or structure ID or part ID not shown), and the 3D space of the construction site (and 3D models of heavy machinery and bridges, etc.) is constructed by combining these parts and structures.

[0064] As shown in Figure 4(c), coordinate point information is managed by a coordinate point ID, including information about the position. As shown in Figure 4(d), mounting coordinate information is managed by a mounting coordinate ID, including information about the mounting coordinates, model ID, coordinate point ID, etc.

[0065] <Displaying 3D space> In S202, the display processing unit 102 processes a 3D space that replicates the construction site. Based on user input and 3D data information, the display processing unit 102 processes a 3D space representing a predetermined construction site and 3D models of heavy machinery and other objects located within the 3D space, and transmits the results of the display processing to the user terminal 2.

[0066] As shown in Figure 5, the display screen W10 shown on the user terminal 2 displays a 3D space W20 that reproduces the construction site, 3D models W30 such as heavy equipment models, and coordinate points W40 that indicate predetermined positions in the 3D space W20, namely the first coordinate point W40a (GNSS1) and the second coordinate point W40b (GNSS2).

[0067] The display screen W10 consists of a 3D space W20 and a 3D model W30, and is displayed based on 3D data information. The 3D space W20 is composed of various parts and structures managed by 3D data IDs. The 3D model W30 represents heavy machinery, bridge girders, etc., and is composed of various parts and structures managed by 3D data IDs. In this embodiment, the 3D space W20 and the 3D model W30 are expressed as separate concepts, but sometimes the 3D space W20 and the 3D model W30 are collectively referred to as the 3D model.

[0068] The coordinate points W40 (first coordinate point W40a and second coordinate point W40b) indicate predetermined positions (coordinates) in the construction site (3D space W20), and include, for example, the position information of a GNSS terminal installed (or movable) at the construction site. In Figure 5, two GNSS terminals (GNSS1, GNSS2) are displayed as coordinate points. For example, the GNSS terminals are attached to heavy machinery at the actual construction site, and the position (coordinates) of the GNSS terminals is displayed in 3D space. Also, there may be one coordinate point or multiple coordinate points displayed on the display screen W10. For example, coordinate points can be defined for each predetermined position in 3D space, regardless of the GNSS terminals.

[0069] <Attaching coordinate points> Next, the attachment of coordinate points to the 3D model in the display screen W10 of this embodiment will be described. In S203 of Figure 3, the coordinate attachment unit 103 of the information processing device 10 attaches coordinate points W40 to the 3D model W30.

[0070] Figure 6 shows the flow of display processing in a user terminal according to one embodiment of the present invention. In Figure 6(a), a first coordinate point W40a and a second coordinate point W40b are displayed at predetermined positions in the 3D space W20. In this embodiment, the positions (dots) where the first coordinate point W40a and the second coordinate point W40b are shown are the same as the coordinates indicating a predetermined position in the 3D space. However, for example, the coordinate point does not necessarily have to be displayed at the same position as the coordinate position of the coordinate point, and the coordinate point W40 can be displayed at a different position corresponding to the predetermined coordinate position.

[0071] As shown in Figure 6(b), the first coordinate point W40a can be moved on the display screen W10 by user input, i.e., by the user's drag operation. In this embodiment, the coordinate point W40 can be moved after the mounting mode is selected by user input. In Figure 6(c), the first coordinate point W40a, located inside the 3D space W20, is attached to a part of the 3D model (heavy machinery model) W30 by user input operation (drag operation).

[0072] Similarly, as shown in Figure 7(a), the second coordinate point W40b can be attached to a part of the 3D model W30 by user input. Once the attachment of the first coordinate point W40a and the second coordinate point W40b is complete, their respective positions (coordinates) on the 3D model are determined as attachment coordinates.

[0073] The coordinate attachment unit 103 attaches coordinate points 40 (40a and 40b in Figures 6 and 7) to the 3D model W30 based on user input and determines the attachment coordinates. Specifically, the coordinate attachment unit 103 determines the first attachment coordinate (i.e., the first attachment coordinate is the position coordinate of W40a in Figure 7(a)) as the first attachment coordinate (i.e., the first attachment coordinate is the position coordinate of W40a in Figure 7(a)), and determines the second attachment coordinate (the position coordinate of W40b in Figure 7(a)) as the second attachment coordinate (the position coordinate of W40b in Figure 7(a)).

[0074] In this embodiment, two coordinate points, the first coordinate point W40a and the second coordinate point W40b, are attached to the 3D model W30. However, for example, only the first coordinate point W40a can be attached to the 3D model W30, or three points, the first coordinate point W40a, the second coordinate point W40b, and the third coordinate point (not shown), can be attached to a part of the 3D model W30. Depending on the number of these coordinate points, the position and orientation of the 3D model, as described later, can be calculated with high accuracy.

[0075] <Calculating the difference> In S204 of Figure 3, the calculation unit 104 calculates the difference between the coordinate point and the mounting coordinate. The calculation unit 104 calculates the difference between the predetermined position indicated by the coordinate point W40 in 3D space W20 and the mounting coordinate where the coordinate point W40 is attached to the 3D model W30.

[0076] In this embodiment, the difference is calculated using a unit vector based on two coordinate points (and mounting coordinates). In Figure 7, the calculation unit 104 calculates a first unit vector V1 at the first mounting coordinate and the second mounting coordinate, calculates a second unit vector V2 at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point, and further calculates the difference between the first unit vector V1 and the second unit vector V2.

[0077] For example, the calculation unit 104 can calculate the third unit vector V3 at the first mounting coordinate and the third mounting coordinate, calculate the fourth unit vector V4 at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the third coordinate point, and further calculate the difference between the third unit vector V3 and the fourth unit vector V4. In this embodiment, the display of the 3D model W30 corresponding to each coordinate point W40 can be realized based on the respective differences calculated by the calculation unit 104.

[0078] <Display processing using coordinate points> In S205 of Figure 3, the display processing unit 102 moves the 3D model and performs display processing. Based on the mounting coordinates (and / or coordinate points), the display processing unit 102 displays the 3D model W30 in 3D space W20 in correspondence with coordinate point W40. Specifically, the display processing unit 102 can move the 3D model to the position of coordinate point W40 and perform display processing. In this embodiment, the coordinate information of the coordinate point can be included along with the coordinate information related to the position attached by drag operation to the mounting coordinates.

[0079] As shown in Figure 7(c), the 3D model W30 moves from its position (coordinates) in Figure 7(b) to correspond to the first coordinate point W40a and the second coordinate point W40b. Specifically, the display processing unit 102 moves the 3D model W30 from its original position to correspond to the first coordinate point W40a based on the first mounting coordinate (moving without changing its orientation), and also rotates the orientation of the 3D model W30 based on the second mounting coordinate (rotating with the first mounting coordinate as the axis of rotation) and performs the display processing. For example, information regarding the scale (magnification) can also be used in this display processing.

[0080] More specifically, the calculation unit 104 calculates the first unit vector V1 at the first mounting coordinate and the second mounting coordinate, and also calculates the second unit vector V2 at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the second coordinate point. The display processing unit 102 then displays the 3D model W30 at a position corresponding to the difference between the predetermined position indicated by the first coordinate point 40a in 3D space W20 and the first mounting coordinate, and also displays the 3D model W30 according to the angle (rotation angle) obtained from the difference between the first unit vector V1 and the second unit vector V2.

[0081] For example, if the 3D model W30 has only one coordinate point to attach to it, which is the first coordinate point W40a, the display processing unit 102 can move the 3D model W30 from its original position in parallel to the first coordinate point W40a based on the first attachment coordinate (i.e., move it without changing its orientation). In this embodiment, the display processing unit 102 can display the 3D model that has been moved to the position based on the difference calculated by the calculation unit 104.

[0082] Furthermore, if there are three coordinate points to attach to the 3D model W30, the display processing unit 102 rotates the orientation of the 3D model at an angle corresponding to the second mounting coordinate, using the rotation axis corresponding to the first mounting coordinate as a reference, and also rotates the orientation of the 3D model W30 at an angle corresponding to the third mounting coordinate, which is perpendicular to the rotation axis corresponding to the second mounting coordinate, based on the first mounting coordinate, the second mounting coordinate, and the third mounting coordinate, and then displays the 3D model W30.

[0083] In this case, the calculation unit 104 calculates the first unit vector V1 in the first mounting coordinate and the second mounting coordinate, and also calculates the second unit vector V2 in the predetermined position indicated by the first coordinate point and the predetermined position indicated by the second coordinate point. Furthermore, the calculation unit 104 calculates the third unit vector V3 in the first mounting coordinate and the third mounting coordinate, and also calculates the fourth unit vector V4 in the predetermined position indicated by the first coordinate point and the predetermined position indicated by the third coordinate point.

[0084] The display processing unit 102 can then display the 3D model W30 at a position and orientation corresponding to the position obtained from the difference between a predetermined position indicated by a first coordinate point in 3D space and the first mounting coordinate, the angle obtained from the difference between the first unit vector and the second unit vector, and the orthogonal rotation angle that is orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0085] Furthermore, as shown in Figure 8, in this embodiment, when moving and displaying a 3D model W30 in 3D space W20 from its original position in correspondence with coordinate points (first coordinate point W40a and second coordinate point W40b), it is also possible to display the first numerical information W42a and the second numerical information W42b alongside the coordinate points (first coordinate point W40a and second coordinate point W40b).

[0086] For example, if a GNSS terminal at a real construction site is attached to heavy machinery such as a backhoe, the display processing unit 102 processes its position information and displays it as coordinate points W40 (W40a, W40b) in the 3D space W20. The display processing unit 102 then displays a 3D model W30 at a predetermined position in the 3D space (near coordinate point W40) without being linked to the 3D space W20, and by attaching coordinate point W40 to the 3D model W30 based on user input, the position of the heavy machinery at the real construction site can be accurately reproduced.

[0087] Figure 8 also shows the first numerical information W42a and the second numerical information W42b. The display processing unit 102 processes various information about the first coordinate point W40a and the second coordinate point W40b based on various data (not shown) stored in the storage unit 12, and can display the results of this processing together with the first coordinate point W40a and the second coordinate point W40b. As shown in Figure 9, the first numerical information W42a and the second numerical information W42b include information such as the GNSS terminal ID, GPS date and time, positioning status, latitude, longitude, altitude, large coordinates, and correction values. By displaying numerical values ​​related to the coordinate points along with the coordinate points in this way, the user can grasp appropriate information about the heavy machinery (3D model) and, for example, correct discrepancies (errors) between the position of the heavy machinery at the actual construction site and the position of the 3D model in 3D space.

[0088] As described above, according to the 3D display system 1 of the present invention, by attaching coordinate points W40 in the 3D space W20 to the 3D model W30 and performing a predetermined display process, the positional relationship of heavy machinery, etc. (3D model) in the construction site (3D space) can be easily and flexibly displayed based on coordinate points. As a result, the distance from existing structures can be determined in virtual space (collision avoidance), the difference from the design value (design position) can be measured in virtual space (coordinate alignment), and even when visibility in the real space is poor, such as at night, the accurate position can be confirmed in virtual space (situation assessment).

[0089] In this embodiment, a predetermined display process at a construction site (movement of a 3D model using coordinate points in 3D space) has been described. However, the same effects as the present invention can be obtained when the 3D display system 1 is used at locations other than construction sites. [Explanation of Symbols]

[0090] 1. 3D display system 2 User terminals 10 Information Processing Devices 11 Control Unit 12 Storage section 13 Communications Department 90 Terminals (User Terminal 2) 91 Control Unit 92 Memory section 93 Communications Department 94 Input section 95 Output section 101 Reception Department 102 Display Processing Unit 103 Coordinate mounting section 104 Calculation Unit NW Network W10 display screen W20 3D space W30 3D Model W40 Coordinate Point W40a First Coordinate Point W40b Second Coordinate Point W42 Difference Coordinates W42a First Numerical Information W42b Second Numerical Information

Claims

1. A 3D display system that displays a 3D space corresponding to a construction site, The 3D display system comprises a storage unit, a coordinate mounting unit, and a display processing unit. The storage unit stores 3D data information for generating the 3D space and the 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The aforementioned coordinate mounting unit determines the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates. 3D display system.

2. The aforementioned coordinate mounting unit determines multiple mounting coordinates by attaching multiple coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on a plurality of mounting coordinates. The 3D display system according to claim 1.

3. The coordinate mounting unit determines the first and second mounting coordinates by attaching a first coordinate point and a second coordinate point to the 3D model based on input from the user. The display processing unit moves the 3D model from its original position to correspond to the first coordinate point based on the first mounting coordinate, and rotates the orientation of the 3D model to correspond to the first coordinate point based on the second mounting coordinate, with respect to the first mounting coordinate, and then performs the display processing. The 3D display system according to claim 2.

4. The coordinate mounting unit, based on input from the user, attaches a first coordinate point, a second coordinate point, and a third coordinate point to the 3D model, and determines the first mounting coordinate, the second mounting coordinate, and the third mounting coordinate. The display processing unit rotates the orientation of the 3D model at an angle corresponding to the second mounting coordinate, with respect to the rotation axis corresponding to the first mounting coordinate, and rotates the orientation of the 3D model at an angle corresponding to the third mounting coordinate, which is perpendicular to the rotation axis corresponding to the second mounting coordinate, based on the second and third mounting coordinates, and then displays the 3D model. The 3D display system according to claim 3.

5. The 3D display system further includes a calculation unit, The calculation unit calculates the difference between a predetermined position indicated by a coordinate point in the 3D space and the mounting coordinates to which the coordinate point is attached to the 3D model. The display processing unit displays the 3D model that has been moved to the position based on the difference. The 3D display system according to claim 1.

6. The 3D display system further includes a calculation unit, The calculation unit calculates a first unit vector at the first mounting coordinate and the second mounting coordinate, and also calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point. The display processing unit displays the 3D model at a position corresponding to the difference between a predetermined position indicated by a first coordinate point in the 3D space and the first mounting coordinate, and also displays the 3D model according to the angle obtained from the difference between the first unit vector and the second unit vector. The 3D display system according to claim 3.

7. The 3D display system further includes a calculation unit, The calculation unit calculates a first unit vector at the first mounting coordinate and the second mounting coordinate, and also calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point. Furthermore, the calculation unit calculates a third unit vector at the first mounting coordinate and the third mounting coordinate, and also calculates a fourth unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the third coordinate point. The display processing unit displays the 3D model in a position and orientation corresponding to the position obtained from the difference between the predetermined position indicated by the first coordinate point in the 3D space and the first mounting coordinate, the angle obtained from the difference between the first unit vector and the second unit vector, and the orthogonal rotation angle perpendicular to the rotation angle obtained from the difference between the third unit vector and the fourth unit vector. The 3D display system according to claim 4.

8. The display processing unit processes and displays numerical information related to the coordinate points along with the coordinate points in correspondence with the 3D model. A 3D display system according to any one of claims 1 to 7.

9. A 3D display method executed by a 3D display system that displays a 3D space corresponding to a construction site, The 3D display system comprises a storage unit, a coordinate mounting unit, and a display processing unit. The memory unit stores 3D data information for generating the 3D space and a 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The coordinate mounting unit performs the steps of determining the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user, The display processing unit includes the step of displaying the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates, 3D display method.

10. A 3D display program that displays a 3D space corresponding to a construction site, The computer is configured to function as a memory unit, a coordinate mounting unit, and a display processing unit. The storage unit stores 3D data information for generating the 3D space and the 3D model located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. The aforementioned coordinate mounting unit determines the mounting coordinates by attaching the coordinate points to the 3D model based on input from the user. The display processing unit displays the 3D model in the 3D space in correspondence with the coordinate points based on the mounting coordinates. 3D display program.

Images