3D Display System, 3D Display Method, and 3D Display Program

Abstract

The present invention relates to a 3D display system, a 3D display method, and a 3D display program. 【Solution means】 The 3D display system 1 includes a storage unit, a coordinate attachment unit, and a display processing unit. The storage unit stores 3D data information for generating a 3D space and a 3D model located in the 3D space, and a coordinate point indicating a predetermined position in the 3D space. The coordinate attachment unit determines attachment coordinates by attaching a coordinate point to the 3D model based on an input from the user, and the display processing unit performs display processing on the 3D model in the 3D space corresponding to the coordinate point based on the attachment coordinates.

Description

Technical Field

[0001] The present invention relates to a 3D display system, a 3D display method, and a 3D display program.

Background Art

[0002] Recently, various efforts using various position information have been made at construction sites.

[0003] Patent Document 1 discloses a work area management system that can obtain the position of a mobile crane and the direction of its boom based on the position measured by a first GNSS terminal and the position measured by a second GNSS terminal, and determine whether there is interference with other objects based on the position of the mobile crane and the direction of its boom.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By using the technology of Patent Document 1, it is possible to grasp the interference between a mobile crane and other objects. However, in Patent Document 1, it is difficult to freely set the position of the mobile crane according to the user's request and display it in a 3D space (construction site). If flexible display of a 3D model according to the user's request can be realized, accurate situation recognition can be achieved in a 3D space even when visibility in the real space is poor, for example, at night.

[0006] The present invention has been made in view of the above problems of the prior art, and its object is to realize a 3D display system that can simply and flexibly display the positional relationship of a heavy machine (3D model) in a construction site (3D space).

Means for Solving the Problem

[0007] In order to solve the above problems, a 3D display system for displaying a 3D space corresponding to a construction site, The 3D display system includes a storage unit, a coordinate attachment unit, and a display processing unit. The storage unit stores 3D data information for generating the 3D space and 3D models located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. Based on an input from a user, the coordinate attachment unit attaches the coordinate points to the 3D model to determine attachment coordinates. Based on the attachment coordinates, the display processing unit performs display processing on the 3D model in the 3D space corresponding to the coordinate points.

[0008] Further, the present invention is a 3D display method executed by a 3D display system for displaying a 3D space corresponding to a construction site, The 3D display system includes a storage unit, a coordinate attachment unit, and a display processing unit. A step of storing, in the storage unit, 3D data information for generating the 3D space and 3D models located in the 3D space, and coordinate points indicating predetermined positions in the 3D space; A step of determining attachment coordinates by attaching the coordinate points to the 3D model based on an input from a user by the coordinate attachment unit; A step of performing display processing on the 3D model in the 3D space corresponding to the coordinate points based on the attachment coordinates by the display processing unit, and includes.

[0009] Further, the present invention is a 3D display program for displaying a 3D space corresponding to a construction site, Functioning a computer as a storage unit, a coordinate attachment unit, and a display processing unit, The storage unit stores 3D data information for generating the 3D space and 3D models located in the 3D space, and coordinate points indicating predetermined positions in the 3D space. Based on the input from the user, the coordinate attachment unit attaches the coordinate points to the 3D model to determine the attachment coordinates, Based on the attachment coordinates, the display processing unit performs display processing on the 3D model in the 3D space corresponding to the coordinate points.

[0010] With such a configuration, the user can easily and flexibly display the positional relationship of a heavy machine or the like (3D model) at the construction site (3D space). As a result, for example, even when visibility in the real space is poor at night or the like, an accurate situation grasp can be realized in the 3D space. In addition, since a highly free position setting is possible, the distance from existing structures, and the differences and errors between the original position and the set position of the 3D model can be measured in the virtual space.

[0011] In a preferred form of the present invention, based on the input from the user, the coordinate attachment unit attaches a plurality of coordinate points to the 3D model to determine a plurality of attachment coordinates, Based on the plurality of attachment coordinates, the display processing unit performs display processing on the 3D model in the 3D space corresponding to the coordinate points.

[0012] With such a configuration, it is possible to realize a display of a 3D model with high accuracy using a plurality of coordinate points.

[0013] In a preferred form of the present invention, based on the input from the user, the coordinate attachment unit attaches a first coordinate point and a second coordinate point to the 3D model to determine a first attachment coordinate and a second attachment coordinate, Based on the first attachment coordinate, the display processing unit moves the 3D model from its original position corresponding to the first coordinate point, and based on the second attachment coordinate, rotates the posture of the 3D model with respect to the first attachment coordinate corresponding to the first coordinate point for display processing.

[0014] With such a configuration, the position and posture of the 3D model in the 3D space can be displayed flexibly and accurately based on the coordinate points.

[0015] In a preferred embodiment of the present invention, based on an input from a user, the coordinate attachment unit determines first attachment coordinates, second attachment coordinates, and third attachment coordinates in the 3D model, based on the second attachment coordinates and the third attachment coordinates, the display processing unit rotates the posture of the 3D model at an angle corresponding to the second attachment coordinates with respect to a rotation axis corresponding to the first attachment coordinates, and rotates the posture of the 3D model at an angle corresponding to the third attachment coordinates perpendicular to the rotation axis corresponding to the second attachment coordinates, and performs display processing on the 3D model.

[0016] With such a configuration, the position and posture of the 3D model in the 3D space can be displayed more accurately based on coordinate points.

[0017] In a preferred embodiment of the present invention, the 3D display system further includes a calculation unit, the calculation unit calculates the difference between a predetermined position indicated by a coordinate point in the 3D space and the attachment coordinates at which the coordinate point is attached to the 3D model, based on the difference, the display processing unit performs display processing on the 3D model moved to a position based on the difference.

[0018] With such a configuration, the 3D model can be displayed more accurately.

[0019] In a preferred embodiment of the present invention, the 3D display system further includes a calculation unit, the calculation unit calculates a first unit vector in the first attachment coordinates and the second attachment coordinates, and calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point, based on the difference between a predetermined position indicated by a first coordinate point in the 3D space and the first attachment coordinates, the display processing unit performs display processing on the 3D model at a position corresponding to the difference, and performs display processing on the 3D model according to an angle obtained from the difference between the first unit vector and the second unit vector.

[0020] By adopting such a configuration, the position and orientation of the 3D model can be accurately displayed using unit vectors.

[0021] In a preferred embodiment of the present invention, the 3D display system further includes a calculation unit. The calculation unit calculates a first unit vector at the first attachment coordinates and the second attachment coordinates, and calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point. Furthermore, the calculation unit calculates a third unit vector at the first attachment coordinates and the third attachment coordinates, and calculates a fourth unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the third coordinate point. The display processing unit performs display processing on the 3D model at a position and orientation corresponding to a position obtained from the difference between the predetermined position indicated by the first coordinate point in the 3D space and the first attachment coordinates, an angle obtained from the difference between the first unit vector and the second unit vector, and an orthogonal rotation angle orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0022] By adopting such a configuration, the position and orientation of the 3D model can be more accurately displayed using unit vectors.

[0023] In a preferred embodiment of the present invention, the display processing unit performs display processing on numerical information related to the coordinate point together with the coordinate point corresponding to the 3D model.

[0024] By adopting such a configuration, the user can visually recognize the 3D model in the 3D space while checking the difference between the original position (and / or attachment coordinates) in the 3D model such as a heavy machine and the position of the coordinate point.

Advantages of the Invention

[0025] According to the present invention, by performing predetermined display processing in association with a 3D model and a coordinate point, a novel technology related to a 3D display system can be provided.

Brief Description of the Drawings

[0026]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0027] Hereinafter, with reference to the accompanying drawings, it will be described in more detail. The drawings show preferred embodiments. However, it can be implemented in many different forms and is not limited to the embodiments described in this specification.

[0028] For example, in this embodiment, the configuration, operation, etc. of a 3D display system will be described, but the same operational effects can also be achieved by the method (steps), apparatus, computer program, etc. executed. The program in this embodiment may be provided as a non-transitory computer-readable recording medium or may be provided so as to be downloadable from an external server.

[0029] In addition, in this embodiment, the "unit" may include, for example, hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources.

[0030] In this embodiment, the "information" is represented, for example, by a physical value of a signal value representing voltage or current, the high or low of a signal value as a set of binary bits composed of 0 or 1, or a quantum superposition (so-called quantum bit), and communication and calculation can be executed on a circuit in a broad sense.

[0031] The circuit in a broad sense is a circuit realized by appropriately combining a circuit, circuitry, a processor, a memory, etc. That is, it includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), etc.

[0032] <System Configuration> FIG. 1 is a block diagram showing a system configuration according to an embodiment of the present invention. As shown in FIG. 1, the 3D display system 1 includes an information processing apparatus 10 and a database DB. The 3D display system 1 is configured to be communicable with a plurality of user terminals 2 (reference numerals 2(a) to 2(d) in FIG. 1) via a network NW.

[0033] The information processing apparatus 10 operates as a server, and the user terminal 2 is a terminal used by users such as a prime contractor or a site supervisor at a construction site.

[0034] In this embodiment, the network NW is an IP (Internet Protocol) network, but there is no limitation on the type of communication protocol, and furthermore, there is no limitation on the type and scale of the network.

[0035] Note that as the information processing apparatus 10, it is possible to use a computer for general-purpose servers, a personal computer, or the like. It is also possible to configure the 3D display system 1 by implementing the functional components described later on a plurality of computers.

[0036] The user terminal 2 is a terminal used by a prime contractor or the like at the construction site. As the user terminal 2, a smartphone, a tablet terminal, a personal computer, a wearable device, or the like can be used. The user terminal 2 stores a 3D display application program for the user, and this application program is configured to have a function for displaying a 3D space representing the construction site, 3D models such as heavy machinery and bridge girders.

[0037] Note that the user terminal 2 can also be configured not to have a 3D display application program. In this case, the user terminal 2 can use a web browser or the like to display and transmit each piece of information.

[0038] <Hardware Configuration> FIG. 2(a) is a diagram showing an example of the hardware configuration of the information processing apparatus 10. The information processing apparatus 10 includes, as a hardware configuration, a control unit 11, a storage unit 12, and a communication unit 13.

[0039] The control unit 11 includes one or more processors such as a CPU, and controls the overall operation processing of the information processing apparatus 10 by executing the 3D display program, the OS, and other applications according to the present invention.

[0040] The storage unit 12 is an HDD, SSD, ROM, RAM, etc., and stores the 3D display program according to the present invention and data used when the control unit 11 executes processing based on the program. When the control unit 11 executes processing based on the 3D display program stored in the storage unit 12, the functional configurations described later are realized.

[0041] The communication unit 13 executes communication control with the network NW and performs inputs necessary for operating the information processing apparatus 10 and outputs related to the operation results.

[0042] FIG. 2(b) is a diagram showing an example of the hardware configuration of the terminal 90 (user terminal 2 in FIG. 1). The terminal 90 includes, as a hardware configuration, a control unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95.

[0043] The control unit 91 of the terminal 90 includes one or more processors such as a CPU and controls the entire operation processing of the terminal 90. The storage unit 92 of the terminal 90 is an HDD, SSD, ROM, RAM, etc., and stores the above-described performance management application program and data used when the control unit 91 executes processing based on the program.

[0044] The communication unit 93 of the terminal 90 controls communication with the network. The input unit 94 of the terminal 90 is a touch panel, mouse, keyboard, etc., and inputs operation requests by the user to the control unit 91. The output unit 95 of the terminal 90 is a display, etc., and displays the results of processing by the control unit 91.

[0045] <Functional Configuration> As shown in FIG. 2(a), the information processing apparatus 10 includes, as a functional configuration, a reception unit 101, a display processing unit 102, a coordinate attachment unit 103, and a calculation unit 104. These are specifically realized by hardware (such as the control unit 11) through information processing by software (stored in the storage unit 12).

[0046] The reception unit 101 receives and registers various information from the user terminal 2, the administrator, etc. The reception unit 101 receives user information etc. from the user terminal 2 etc. and stores it in the storage unit 12. Also, the reception unit 101 receives 3D data information etc. from the user terminal 2 or the administrator terminal (not shown) and stores it in the storage unit 12. The reception unit 101 receives an operation input of a coordinate point indicating a predetermined position in the 3D space (for example, an operation input for attaching the coordinate point to a 3D model etc.) from the user terminal 2, the administrator terminal, etc.

[0047] The display processing unit 102 performs display processing on various information. The display processing unit 102 performs display processing on the 3D space based on the 3D data information. The display processing unit 102 in the present embodiment performs display processing by corresponding the 3D model in the 3D space to the coordinate point indicating the predetermined position in the 3D space based on the attachment coordinates (coordinates when the coordinate point is attached to a heavy machinery model etc. by a drag operation) described later. Also, the display processing unit 102 performs display processing by corresponding the 3D model in the 3D space to the coordinate point based on a plurality of attachment coordinates.

[0048] Specifically, the display processing unit 102 can move the 3D model from the original position corresponding to the first coordinate point based on the first attachment coordinates, and rotate the posture of the 3D model corresponding to the first coordinate point with reference to the first attachment coordinates based on the second attachment coordinates for display processing.

[0049] Furthermore, the display processing unit 102 can rotate the posture of the 3D model at an angle corresponding to the second attachment coordinates with reference to the rotation axis corresponding to the first attachment coordinates based on the second and third attachment coordinates, and rotate the posture of the 3D model at an angle corresponding to the third attachment coordinates orthogonal to the rotation axis corresponding to the second attachment coordinates to perform display processing on the 3D model. The display processing unit 102 may perform display processing on the difference corresponding to the 3D model.

[0050] In addition, the display processing unit 102 can also perform display processing on the 3D model in a position and orientation corresponding to the position obtained from the difference between the predetermined position indicated by the first coordinate point and the first attachment coordinate in the 3D space, the angle obtained from the difference between the first unit vector and the second unit vector described later, and the orthogonal rotation angle orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0051] The coordinate attachment unit 103 attaches (corresponds) a predetermined coordinate point to a 3D model such as a heavy machine in the 3D space. The coordinate attachment unit 103 in the present embodiment determines the attachment coordinates (coordinates located on the 3D model) by attaching a coordinate point to the 3D model based on an input from the user. In addition, the coordinate attachment unit 103 determines a plurality of attachment coordinates by attaching a plurality of coordinate points to the 3D model based on an input from the user.

[0052] The coordinate attachment unit 103 attaches the first coordinate point and the second coordinate point to the 3D model based on an input from the user to determine the first attachment coordinate and the second attachment coordinate, or based on an input from the user, attaches the first coordinate point, the second coordinate point, and the third coordinate point to the 3D model to determine the first attachment coordinate, the second attachment coordinate, and the third attachment coordinate.

[0053] The calculation unit 104 calculates information necessary for displaying the 3D model. In the present embodiment, the calculation unit 104 calculates the first unit vector at the first attachment coordinate and the second attachment coordinate, and calculates the second unit vector at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the second coordinate point.

[0054] The calculation unit 104 can calculate the difference between the predetermined position indicated by the coordinate point in the 3D space and the attachment coordinates where the coordinate point is attached to the 3D model. Further, the calculation unit 104 can calculate the third unit vector at the first attachment coordinate and the third attachment coordinate, and calculate the fourth unit vector at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the third coordinate point. The calculation unit 104 can calculate the respective differences based on the numerical values calculated respectively under predetermined conditions.

[0055] <Database DB> The database DB in FIG. 1 stores user information, 3D data information, coordinate point information, mounting coordinate information, and other information necessary for 3D display. Some or all of these may be stored in the storage unit 12 or the like, or some of these may be stored in another database or the like.

[0056] Hereinafter, with reference to FIGS. 3 to 8, the 3D display system 1 will be described, and the processing contents by each functional component will be described.

[0057] <Overview of 3D Display System> The 3D display system 1 according to the present embodiment is a system that can simply and flexibly display a 3D model (such as a heavy machine or a bridge girder) in a 3D space corresponding to predetermined conditions desired by a user. Specifically, in the 3D display system 1, a coordinate point (meaning a predetermined coordinate in the 3D space) indicating a predetermined position in the 3D space that reproduces the construction site can be moved based on a user's operation input (a drag operation on the screen), and by attaching this coordinate point to the 3D model, the 3D model can be displayed corresponding to the coordinate point.

[0058] By realizing such display by a simple operation, that is, by accurately arranging the 3D model using high-precision position information, the separation from existing structures can be measured in the virtual space (collision avoidance), and the difference from the design value (design position) can be measured in the virtual space (coordinate alignment). For example, even when visibility is poor in the real space at night or the like, the accurate position can be confirmed in the virtual space (situation grasp). Hereinafter, the processing flow in the 3D display system 1 will be described in detail.

[0059] <Registration of Various Information> FIG. 3 shows a flowchart of a processing procedure in a 3D display system according to an embodiment of the present invention. In S201, a user such as a prime contractor or a site supervisor (and workers) at the construction site registers various information.

[0060] Specifically, the user can register information such as user information, 3D data information corresponding to a construction site, heavy machinery, etc., coordinate point information regarding a coordinate point indicating a predetermined position in the 3D space, and attachment coordinate information regarding the correspondence between the 3D model and the coordinate point via the user terminal 2 or the like. In the present embodiment, in addition to the prime contractor (prime contracting company and its person in charge), users are represented to include the site supervisor, workers, and other persons who manage processes and work at the construction site.

[0061] The user registers user information such as information regarding the company in order to use the 3D display system 1. As shown in FIG. 4(a), the user information includes information such as the company name such as ○○○ Co., Ltd. and △△△ Co., Ltd., the company's contact information, the company's address, the business types in which work is possible, the registration date, etc., and is managed by a user ID. The user information may also include the name of the person in charge who actually takes charge of the construction site.

[0062] Note that in the present embodiment, a user (prime contractor or its person in charge) in whom user information is registered can use the service regarding the 3D display system 1, but the registration of user information is not necessarily essential, and a configuration may be adopted in which a user who has not registered user information can also use the service.

[0063] As shown in FIG. 4(b), the 3D data information includes information such as the storage destination of the 3D data, information regarding the position (coordinates), information regarding the angle (orientation or rotation of the 3D model), information regarding the scale (magnification), etc., and is managed by a 3D data ID. Here, the 3D data is three-dimensional data (three-dimensional model) for constructing the 3D space. For example, it is managed by a 3D data ID (or a structure ID or component ID not shown) for each structure or component such as an elevated bridge or a building, and the 3D space of the construction site (and 3D models such as heavy machinery and bridges) is configured by combining each component and structure.

[0064] Also, as shown in FIG. 4(c), the coordinate point information includes information regarding the position and is managed by a coordinate point ID. As shown in FIG. 4(d), the attachment coordinate information includes information regarding the attachment coordinates, a model ID, a coordinate point ID, etc., and is managed by an attachment coordinate ID.

[0065] <3D Space Display> In S202, the display processing unit 102 performs display processing on a 3D space that reproduces the construction site. Based on the input from the user and the 3D data information, the display processing unit 102 performs display processing on a 3D space indicating a predetermined construction site and 3D models such as construction machinery located inside the 3D space, and transmits the display processing result to the user terminal 2.

[0066] As shown in FIG. 5, on the display screen W10 displayed on the user terminal 2, a 3D space W20 that reproduces the construction site, 3D models W30 such as a construction machinery model, and coordinate points W40 indicating predetermined positions in the 3D space W20, namely, a first coordinate point W40a (GNSS1) and a second coordinate point W40b (GNSS2), are displayed.

[0067] The display screen W10 is composed of a 3D space W20, 3D models W30, etc., and is subjected to display processing based on 3D data information. The 3D space W20 is composed by combining each component and structure managed by a 3D data ID. The 3D model W30 indicates construction machinery, bridge girders, etc., and is composed by combining each component and structure managed by a 3D data ID. In this embodiment, the 3D space W20 and the 3D model W30 are expressed as separate concepts, but for example, the 3D space W20 and the 3D model W30 may be collectively referred to as a 3D model.

[0068] The coordinate points W40 (the first coordinate point W40a and the second coordinate point W40b) indicate predetermined positions (coordinates) in the construction site (3D space W20), and for example, include the position information of GNSS terminals installed (or movable) at the construction site. In FIG. 5, two GNSS terminals (GNSS1, GNSS2) are displayed as coordinate points. For example, the GNSS terminal is attached to a construction machinery at the actual construction site, and the position (coordinates) of the GNSS terminal is displayed in the 3D space. Also, the number of coordinate points displayed on the display screen W10 may be one or a plurality. For example, it is also possible to define coordinate points for each predetermined position in the 3D space regardless of the GNSS terminal.

[0069] <Attachment of Coordinate Points> Next, the attachment of coordinate points to the 3D model on the display screen W10 of the present embodiment will be described. In S203 of FIG. 3, the coordinate attachment unit 103 of the information processing apparatus 10 attaches the coordinate point W40 to the 3D model W30.

[0070] FIG. 6 shows the flow of display processing in a user terminal according to an embodiment of the present invention. In FIG. 6(a), a first coordinate point W40a and a second coordinate point W40b are displayed at a predetermined position in the 3D space W20. In the present embodiment, the positions (dot marks) where the first coordinate point W40a and the second coordinate point W40b are shown are the same as the coordinates indicating a predetermined position in the 3D space. However, for example, the coordinate points do not necessarily have to be displayed at the same position as the coordinate positions of the coordinate points, and the coordinate point W40 can also be displayed at another position corresponding to a predetermined coordinate position.

[0071] Then, as shown in FIG. 6(b), on the display screen W10, the first coordinate point W40a can be moved on the screen by an operation input from the user, that is, a drag operation of the user. In the present embodiment, the coordinate point W40 can be moved after the attachment mode is selected by an operation input from the user. In FIG. 6(c), the first coordinate point W40a located inside the 3D space W20 is attached to a part of the 3D model (heavy machinery model) W30 by an input operation (drag operation) from the user.

[0072] Similarly, as shown in FIG. 7(a), the second coordinate point W40b is attached to a part of the 3D model W30 by an operation input from the user. When the attachment of the first coordinate point W40a and the second coordinate point W40b is completed, the respective positions (coordinates) on the 3D model are determined as attachment coordinates.

[0073] Based on the operation input from the user, the coordinate attachment unit 103 attaches coordinate points 40 (40a, 40b in FIGS. 6 and 7) to the 3D model W30 to determine the attachment coordinates. Specifically, the coordinate attachment unit 103 determines the first dragged coordinate point 40a as the first attachment coordinates (i.e., the position coordinates of W40a in FIG. 7(a)), and determines the second dragged coordinate point 40b as the second attachment coordinates (the position coordinates of W40b in FIG. 7(a)).

[0074] In this embodiment, two points, the first coordinate point W40a and the second coordinate point W40b, are attached to the 3D model W30. However, for example, only the first coordinate point W40a can be attached to the 3D model W30, or three points, the first coordinate point W40a, the second coordinate point W40b, and a third coordinate point (not shown), can be attached to a part of the 3D model W30. According to the number of these coordinate points, the position and orientation of the 3D model described later can be accurately calculated.

[0075] <Calculation of difference> In S204 of FIG. 3, the calculation unit 104 calculates the difference between the coordinate point and the attachment coordinates. The calculation unit 104 calculates the difference between the predetermined position indicated by the coordinate point W40 in the 3D space W20 and the attachment coordinates to which the coordinate point W40 is attached to the 3D model W30.

[0076] In this embodiment, the difference is calculated using unit vectors based on two coordinate points (and attachment coordinates). In FIG. 7, the calculation unit 104 calculates the first unit vector V1 at the first attachment coordinates and the second attachment coordinates, calculates the second unit vector V2 at the predetermined positions indicated by the first coordinate point and the second coordinate point, and further calculates the difference between the first unit vector V1 and the second unit vector V2.

[0077] For example, the calculation unit 104 can calculate the third unit vector V3 at the first attachment coordinate and the third attachment coordinate, calculate the fourth unit vector V4 at the predetermined position indicated by the first coordinate point and the predetermined position indicated by the third coordinate point, and further calculate the difference between the third unit vector V3 and the fourth unit vector V4. In the present embodiment, based on each difference calculated by these calculation units 104, the display of the 3D model W30 corresponding to each coordinate point W40 can be realized.

[0078] <Display processing using coordinate points> In S205 of FIG. 3, the display processing unit 102 performs display processing by moving the 3D model. The display processing unit 102 performs display processing by corresponding the 3D model W30 in the 3D space W20 to the coordinate point W40 based on the attachment coordinate (and / or coordinate point). Specifically, the display processing unit 102 can perform display processing by moving the 3D model to the position of the coordinate point W40. In the present embodiment, together with the coordinate information regarding the position attached by the drag operation to this attachment coordinate, the coordinate information of the coordinate point can also be included.

[0079] As shown in FIG. 7(c), the 3D model W30 has moved corresponding to the first coordinate point W40a and the second coordinate point W40b from the position (coordinate) in FIG. 7(b). Specifically, the display processing unit 102 moves (moves without changing the posture) the 3D model W30 from the original position to correspond to the first coordinate point W40a based on the first attachment coordinate, and rotates (rotates with the first attachment coordinate as the rotation axis) the posture of the 3D model W30 with respect to the first attachment coordinate based on the second attachment coordinate for display processing. For example, information regarding the scale (magnification) can also be used for this display processing.

[0080] More specifically, the calculation unit 104 calculates the first unit vector V1 at the first attachment coordinates and the second attachment coordinates, and calculates the second unit vector V2 at the predetermined positions indicated by the first coordinate point and the second coordinate point. Then, the display processing unit 102 performs display processing on the 3D model W30 at a position corresponding to the difference between the predetermined position indicated by the first coordinate point 40a in the 3D space W20 and the first attachment coordinates, and performs display processing on the 3D model W30 according to the angle (rotation angle) obtained from the difference between the first unit vector V1 and the second unit vector V2.

[0081] For example, if the coordinate point to be attached to the 3D model W30 is only one point of the first coordinate point W40a, the display processing unit 102 can translate the 3D model W30 from its original position to correspond to the first coordinate point W40a based on the first attachment coordinates (that is, move it as it is without changing the posture). In this embodiment, due to the difference calculated by the calculation unit 104, the display processing unit 102 can perform display processing on the 3D model moved to the position based on the difference.

[0082] Also, when there are three coordinate points to be attached to the 3D model W30, the display processing unit 102 rotates the posture of the 3D model by an angle corresponding to the second attachment coordinates with respect to the rotation axis corresponding to the first attachment coordinates based on each of the first attachment coordinates, the second attachment coordinates, and the third attachment coordinates, and rotates the posture of the 3D model W30 by an angle corresponding to the third attachment coordinates perpendicular to the rotation axis corresponding to the second attachment coordinates, and performs display processing on the 3D model W30.

[0083] In this case, the calculation unit 104 calculates the first unit vector V1 at the first attachment coordinates and the second attachment coordinates, and calculates the second unit vector V2 at the predetermined positions indicated by the first coordinate point and the second coordinate point. Further, the calculation unit 104 calculates the third unit vector V3 at the first attachment coordinates and the third attachment coordinates, and calculates the fourth unit vector V4 at the predetermined positions indicated by the first coordinate point and the third coordinate point.

[0084] Then, the display processing unit 102 can perform display processing on the 3D model W30 with a position and orientation corresponding to the position obtained from the difference between the predetermined position indicated by the first coordinate point in the 3D space and the first mounting coordinate, the angle obtained from the difference between the first unit vector and the second unit vector, and the orthogonal rotation angle orthogonal to the angle obtained from the difference between the third unit vector and the fourth unit vector.

[0085] Also, in this embodiment, as shown in FIG. 8, when moving and displaying the 3D model W30 in the 3D space W20 corresponding to the coordinate points (the first coordinate point W40a and the second coordinate point W40b) from the original position, the first numerical information W42a and the second numerical information W42b can also be displayed side by side with the coordinate points (the first coordinate point W40a and the second coordinate point W40b).

[0086] For example, a GNSS terminal at an actual construction site is attached to a heavy machine such as a backhoe, and the display processing unit 102 performs display processing with the position information as coordinate points W40 (W40a, W40b) in the 3D space W20. Then, the display processing unit 102 displays the 3D model W30 at a predetermined position (near the coordinate point W40) in the 3D space in a state where there is no position linkage with the 3D space W20, and accurately reproduces the position of the heavy machine at the actual construction site by attaching the coordinate point W40 to the 3D model W30 based on an operation input from the user.

[0087] Also, in FIG. 8, the first numerical information W42a and the second numerical information W42b are displayed. The display processing unit 102 performs display processing on various information regarding the first coordinate point W40a and the second coordinate point W40b based on various data (not shown) stored in the storage unit 12, and can perform display processing of the display processing result together with the first coordinate point W40a and the second coordinate point W40b. As shown in FIG. 9, the first numerical information W42a and the second numerical information W42b include information such as the ID of the GNSS terminal, the GPS date and time, the positioning status, the latitude, the longitude, the altitude, the large coordinates, and the correction value. By displaying the numerical values related to the coordinate points together with the coordinate points in this way, the user can grasp the appropriate information of the heavy machine (3D model), and can appropriately correct it even when there is a deviation (error) between the position of the heavy machine at the actual construction site and the position of the 3D model in the 3D space.

[0088] As described above, according to the 3D display system 1 according to the present invention, by attaching the coordinate points W40 in the 3D space W20 to the 3D model W30 and executing predetermined display processing, the positional relationship of the heavy machine etc. (3D model) at the construction site (3D space) can be easily and flexibly displayed based on the coordinate points. As a result, the separation from the existing structure can be virtualized (collision avoidance), the difference from the design value (design position) can be measured in the virtual space (coordinate alignment), and even when the visibility in the real space such as at night is poor, the accurate position can be confirmed in the virtual space (situation grasping).

[0089] In this embodiment, the predetermined display processing at the construction site (the movement of the 3D model using the coordinate points in the 3D space) has been described, but the same effect as the present invention can also be obtained when the 3D display system 1 is used at other places than the construction site.

Explanation of Signs

[0090] 1 3D display system 2 User terminal 10 Information processing device 11 Control unit 12 Storage unit 13 Communication unit 90 Terminal (User terminal 2) 91 Control Unit 92 Memory Unit 93 Communication Unit 94 Input Unit 95 Output Unit 101 Reception Unit 102 Display Processing Unit 103 Coordinate Attachment Unit 104 Calculation Unit NW Network W10 Display Screen W20 3D Space W30 3D Model W40 Coordinate Point W40a First Coordinate Point W40b Second Coordinate Point W42 Differential Coordinates W42a First Numerical Information W42b Second Numerical Information

Claims

1. A 3D display system for displaying a 3D space corresponding to a construction site, The 3D display system includes a storage unit, a coordinate mounting unit, and a display processing unit. the storage unit stores 3D data information for generating the 3D space and a 3D model located in the 3D space, and a plurality of coordinate points indicating predetermined positions in the 3D space; The coordinate mounting unit mounts a first coordinate point and a second coordinate point on the 3D model based on an input from a user to determine a first mounting coordinate and a second mounting coordinate; the display processing unit moves the 3D model in the 3D space from an original position corresponding to a first coordinate point based on the first mounting coordinates, and rotates an attitude of the 3D model based on the second mounting coordinates and corresponding to the first mounting coordinate point with the first mounting coordinates as a reference, thereby performing display processing. 3D display system.

2. The coordinate mounting unit mounts a first coordinate point, a second coordinate point, and a third coordinate point on the 3D model based on an input from a user to determine a first mounting coordinate, a second mounting coordinate, and a third mounting coordinate; the display processing unit rotates an attitude of the 3D model by an angle corresponding to the second mounting coordinates with respect to a rotation axis corresponding to the first mounting coordinates based on the second mounting coordinates and the third mounting coordinates, and rotates an attitude of the 3D model by an angle corresponding to the third mounting coordinates that is perpendicular to the rotation axis corresponding to the second mounting coordinates, thereby displaying the 3D model. The 3D display system according to claim 1 .

3. The 3D display system further includes a calculation unit, The calculation unit calculates a predetermined position indicated by a coordinate point in the 3D space, Calculate the difference between the mounting coordinates of the The display processing unit performs display processing on the 3D model moved to a position based on the difference. The 3D display system according to claim 1 .

4. The 3D display system further includes a calculation unit, The calculation unit calculates a first unit vector in the first mounting coordinate system and the second mounting coordinate system, and calculates a unit vector in a predetermined position indicated by the first coordinate point and a unit vector in a predetermined position indicated by the second coordinate point. A second unit vector is calculated. the display processing unit displays the 3D model at a position according to a difference between a predetermined position indicated by a first coordinate point in the 3D space and the first mounting coordinate, and displays the 3D model according to an angle obtained from a difference between the first unit vector and the second unit vector. The 3D display system according to claim 1 .

5. The 3D display system further comprises a calculation unit, the calculation unit calculates a first unit vector at the first mounting coordinate point and the second mounting coordinate point, and calculates a second unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the second coordinate point; Furthermore, the calculation unit calculates a third unit vector at the first mounting coordinate point and the third mounting coordinate point, and calculates a fourth unit vector at a predetermined position indicated by the first coordinate point and a predetermined position indicated by the third coordinate point, the display processing unit displays the 3D model at a position and orientation according to a position obtained from a difference between a predetermined position indicated by the first coordinate point in the 3D space and the first mounting coordinate, an angle obtained from a difference between the first unit vector and the second unit vector, and an orthogonal rotation angle orthogonal to a rotation angle obtained from a difference between the third unit vector and the fourth unit vector. The 3D display system according to claim 2 .

6. The display processing unit displays the coordinate points together with numerical information related to the coordinate points in association with the 3D model.

6. A 3D display system according to claim 1.

7. A 3D display method executed by a 3D display system that displays a 3D space corresponding to a construction site, comprising: The 3D display system includes a storage unit, a coordinate mounting unit, and a display processing unit. a step of storing, in the storage unit, 3D data information for generating the 3D space and a 3D model located in the 3D space, and a plurality of coordinate points indicating predetermined positions in the 3D space; the coordinate mounting unit mounting a first coordinate point and a second coordinate point to the 3D model based on input from a user to determine a first mounting coordinate and a second mounting coordinate; the display processing unit moves the 3D model in the 3D space from an original position corresponding to a first coordinate point based on the first mounting coordinates, and rotates an attitude of the 3D model based on the second mounting coordinates and corresponding to the first mounting coordinate point with the first mounting coordinates as a reference, thereby performing display processing. 3D display method.

8. A 3D display program for displaying a 3D space corresponding to a construction site, A computer is configured to function as a storage unit, a coordinate mounting unit, and a display processing unit; the storage unit stores 3D data information for generating the 3D space and a 3D model located in the 3D space, and a plurality of coordinate points indicating predetermined positions in the 3D space; The coordinate mounting unit mounts a first coordinate point and a second coordinate point on the 3D model based on an input from a user to determine a first mounting coordinate and a second mounting coordinate; the display processing unit moves the 3D model in the 3D space from an original position corresponding to a first coordinate point based on the first mounting coordinates, and rotates an attitude of the 3D model based on the second mounting coordinates and corresponding to the first mounting coordinate point with the first mounting coordinates as a reference, thereby performing display processing. 3D display program.

Images