Design Support System and Design Support Program

Abstract

Provided is a system or the like that can improve the design work efficiency of structures such as piping and cable trays, and supports or other structures that support other structures such as piping and / or cable trays. 【Solution means】After grasping the situation of the actual space where the structure Q0 exists, which the user visually recognized through the display 220, the user can determine the virtual space position of the first designated point p1 on the display 220 by an operation such as moving the fingertip pf. In response to this, design data (second design data) of a second virtual structure such as piping extending along one or a plurality of line segments connecting a plurality of nodes p0 having actual space positions corresponding to the virtual space positions of the plurality of first designated points p1 is generated and stored or saved in a storage device or the like.

Description

Technical Field

[0001] The present invention relates to a design support system for structures such as pipes and cable trays, and supports such as supports for other structures such as pipes and / or cable trays.

Background Art

[0002] There has been proposed a drawing projection system that projects a design drawing at full scale onto the real space by simply scanning the real space and, if necessary, scanning an AR marker or the like (see, for example, Patent Document 1). According to this system, complicated drawing work is not required, and the actual construction status and design drawings are superimposed even in the inspection after construction or the completion check process, so that the work efficiency is improved.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, it is preferable from the viewpoint of design work efficiency that a design drawing superimposed on the real space is created by the user on site and stored as design data at the site as it is.

[0005] Therefore, an object of the present invention is to provide a system or the like that can improve the design work efficiency of structures such as pipes and cable trays, and supports such as supports for other structures such as pipes and / or cable trays.

Means for Solving the Problems

[0006] The design support system of the present invention is Based on the output signal of the environmental sensor included in the design support device, the virtual space position in the two-dimensional virtual space coordinate system defined in the display that constitutes the output interface included in the design support device, and the , existing in real space a design environment recognition unit that recognizes the correspondence between the real space position in the three-dimensional real space coordinate system of the structure and; Based on the real space position of the designated point specified in the real space coordinate system through the input interface included in the design support device, a node position recognition unit that recognizes the real space position of the nodes separated from the structure; a design data generation unit that generates design data representing the real space occupancy mode of the virtual structure extending along the line segment connecting a plurality of nodes whose real space positions are recognized by the node position recognition unit, and stores and holds the design data in a storage device; a display control unit that superimposes and displays the virtual structure on the structure on the display based on the design data generated by the design data generation unit and the correspondence recognized by the design environment recognition unit.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiment for Carrying Out the Invention

[0008] (Configuration) As an embodiment of the present invention shown in FIG. 1, the design support system 1 is configured by a computer having an arithmetic processing unit, a storage device, and the like. The design support system 1 includes a design environment recognition unit 11, a node position recognition unit 12, a design data generation unit 13, and a display control unit 14. Each component of the design support system 1 executes a specified task by the arithmetic processing unit reading necessary programs (software) and data from the storage device and performing arithmetic processing on the data according to the program. The design support system 1 may be configured by a server computer, a tablet terminal, and / or a smartphone that can communicate with the design support device 2 via a network in a wireless communication method and / or a wired communication method.

[0009] As shown in FIG. 1, the design support device 2 includes a device control unit 20, an input interface 21, and an output interface 22. The device control unit 20 is configured by an arithmetic processing unit and a storage device. The arithmetic processing unit reads necessary programs (software) and data from the storage device and executes a specified task by performing arithmetic processing on the data according to the program. The design support system 1 may be configured by the device control unit 20 and mounted on the design support device 2. The input interface 21 has one or more cameras 210 (imaging devices). The camera 210 may be configured by a visible light camera, a visible light camera and an infrared camera in addition to the visible light camera. The input interface 21 may include a distance measuring sensor. The output interface 22 has a transmissive display 220 (image display device).

[0010] The design support device 2 is configured by, for example, a head-mounted type or goggle-type wearable device that is worn on the user's head as shown in FIG. 2. As shown in FIG. 2, the wearable device includes a headband 202, a housing 204 (front enclosure), a lens 221 (visor) configured by a half mirror, and a linear polarization type or circular polarization type 3D glasses 224.

[0011] The headband 202 is made of a flexible material such as synthetic resin, cloth, and / or rubber, and is wound or fitted around the user's head so that the wearable device is worn on the user's head. The housing 204 is made of a hard synthetic resin and is attached in front of the headband 202. The housing 204 incorporates, in addition to sensors such as a device control unit 20 and a camera 210, a projection device 222 that projects an image onto the lens 221. Corresponding to the left and right lenses of the 3D glasses 224, the projection device 222 is composed of a left-eye projector and a right-eye projector.

[0012] When the user wears the wearable device on the head, the user can visually recognize an object such as a structure existing in the real space in front of the eyes through the lens 221, and can also visually recognize a virtual object such as a virtual structure projected onto the lens 221 by the projection device 222. In this way, a virtual object is superimposed and displayed on the object existing in the real space on the display 220.

[0013] The lens 221 of the wearable device may be composed of a non-translucent mirror facing the user instead of a half mirror, and an imaging image representing the state of the real space may be projected onto the mirror by the projection device 222.

[0014] The design support device 2 may be a portable device such as a smartphone or a tablet terminal in addition to a wearable device. The portable device may be provided with a transmissive display, or may be provided with a non-transmissive (ordinary) display for displaying a captured image acquired through a camera.

[0015] (Function) The functions of the design support system 1 configured as described above will be described. FIG. 4 illustrates a state of a real space in which a structure Q0 exists as viewed by a user wearing the design support device 2 on the head through the 3D glasses 224 and the lens 221. As shown in FIG. 4, in the real space, in addition to the floor Q01, the wall Q02, and the ceiling Q03 of the building, there are structures Q0 such as a pipe Q04 such as an electric wire pipe provided along the wall Q02 and a switchboard or a distribution board Q05 installed on the floor Q01.

[0016] An imaging image including a marker M (index object) previously arranged in the real space is acquired by the camera 210 mounted on the design support device 2, and the reflection mode (position, size, and posture) of the marker M in the imaging image is recognized by the design environment recognition unit 11 (FIG. 3 / STEP10). For example, as shown in FIG. 4, the reflection mode of the marker M having a substantially rectangular planar shape arranged on the floor Q01 in the imaging image is recognized. The marker M has anisotropy. The marker M may not be a planar marker but a three-dimensional marker. Based on the reflection mode of the marker M in the imaging image, the relative position and posture of the display 220 having a virtual space coordinate system corresponding to the camera 210 and the imaging image coordinate system with respect to the marker M in the real space are determined.

[0017] Subsequently, based on the reflection mode of the marker M in the captured image and the design environment data, the design environment recognition unit 11 recognizes the correspondence between the virtual space position in the two-dimensional virtual space coordinate system defined on the display 220 and the real space position of the structure Q0 visible to the user through the display 220 in the three-dimensional real space coordinate system (FIG. 3 / STEP12). The "design environment data" is data representing the real space occupancy mode of the structure Q0 in the real space coordinate system, and based on this data, the real space positions (coordinates) of the point group representing the surface of the structure Q0 in the real space coordinate system are determined. The design environment data is read from a storage device or a database. As a result, for example, as shown in FIG. 4, the correspondence between the virtual space position of the point pv in the virtual space coordinate system (u, v) and the real space position of the point pr on the surface of the structure Q0 in the real space coordinate system (x, y, z), which is a three-dimensional orthogonal coordinate system based on the marker M, is recognized. The imaging image coordinate system of the camera 210 and the virtual space coordinate system of the display 220 may be adjusted in advance so as to coincide, or a coordinate transformation matrix between the imaging image coordinate system and the virtual space coordinate system may be determined in advance.

[0018] A plurality of markers M may be arranged spaced apart from each other in the real space, and a correspondence relationship between the virtual space position and the real space position may be recognized based on the reflection state of each of the plurality of markers M in the captured image and the design environment data. Even if the reflection state of one marker M in the captured image is inappropriate from the viewpoint of accurately determining the correspondence relationship, the reflection states of the other markers M are also considered together to determine the correspondence relationship, so that the accuracy of the correspondence relationship can be ensured. The average or weighted average of the correspondence relationship between the virtual space position and the real space position determined based on the reflection state of each of the plurality of markers M in the captured image and the design environment data may be recognized as the correspondence relationship. For example, the weight or weight coefficient may be determined so as to be smaller as the size of the marker M in the captured image is smaller, and / or so as to be smaller as the distortion of the area reflected in the captured image due to the characteristics of the lens of the camera 210 is larger. The plurality of markers M are arranged spaced apart in one of the x, y, and z directions of the real space, and the line segment connecting the plurality of markers (or their centers) in the captured image is recognized as a line segment parallel to the one direction in the real space, whereby the correspondence relationship between the virtual space position and the real space position may be recognized. For example, two markers M are arranged spaced apart in the x direction in the real space, the line segment connecting the two markers M in the captured image is recognized as the x direction in the real space, and the correspondence relationship may be recognized based on the difference in posture from the line segment in the virtual space.

[0019] The real space may be scanned by the distance measuring sensor constituting the input interface 21 to measure the real space position of the point group on the surface of the structure Q0, whereby the correspondence relationship may be recognized (see Patent Document 1).

[0020] The display control unit 14 reads the first design data from the storage device or database, and recognizes the actual space occupancy mode of the first virtual structure Q1 represented by the first design data. Then, the display control unit 14 superimposes and displays the first virtual structure Q1 on the structure Q0 existing in the actual space on the display 220 (Fig. 3 / STEP14). At this time, the size of the first virtual structure Q1 displayed or projected on the display 220 is appropriately scaled to match the size of the structure Q0 in the actual space. Thereby, for example, as shown in Fig. 5, in addition to the wire duct Q11, pipe Q12, and exhaust duct or cable tray Q13 extending along the wall Q02, the first virtual structure Q1 such as the pull box Q14 installed on the floor Q01 is superimposed and displayed on the structure Q0 on the display 220. The first virtual structure Q1 is, for example, pre-designed and stored in a storage device or the like. The display of the first virtual structure Q1 on the display 220 may be omitted.

[0021] Next, the node position recognition unit 12 determines whether or not the virtual space position of the first designated point p1 in the virtual space coordinate system has been designated by the user (Fig. 3 / STEP16). For example, when the fingertip pf as the designated body part of the user is tracked through the camera 210 and the fingertip pf temporarily stops (when there is an operation corresponding to a tap, double tap, or long tap), when the other hand appears in the captured image in addition to the fingertip pf of one hand, or when the fingertip pf overlaps any of the structures Q01 to Q05 and the first virtual structures Q11 to Q14, it is determined that the virtual space position of the fingertip pf at that time has been designated (see Fig. 6). In addition, the virtual pointer pb (constituting the "operator" of the input interface 21) superimposed on the display 220 is moved according to the movement of the fingertip pf being tracked through the camera 210. When the pointer pb is pushed in and stopped (when there is an operation corresponding to a tap, double tap, or long tap), it is determined that the virtual space position of the first designated point p1 of the pointer pb has been designated (see Fig. 7). The length of the virtual pointer Pb may be changed according to an extension instruction (e.g., a swipe operation of the fingertip pf upward) or a shortening instruction (e.g., a swipe operation of the fingertip pf downward) by the user through the input interface 21. The user's "designated body part" may include, in addition to the fingertip pf of the hand, the palm, wrist, elbow, knee, ankle, instep, toe tip, tongue tip, and may also include a pen held by the hand or foot, a rod held by the mouth, etc.

[0022] When the determination result is negative (Fig. 3 / STEP16..NO), the processes after the determination process (Fig. 3 / STEP16) of whether or not the virtual space position has been designated by the node position recognition unit 12 are repeatedly executed.

[0023] On the other hand, when the determination result is affirmative (Fig. 3 / STEP16..YES), the virtual space position of the first designated point p1 is recognized by the node position recognition unit 12 (Fig. 3 / STEP18). As a result, for example, as shown in Fig. 6, the virtual space positions of a plurality of first designated points p1 designated by the user's fingertip pf are recognized. In addition, for example, as shown in Fig. 7, the virtual space positions of a plurality of first designated points p1 designated by a virtual pointer pb that follows the movement of the user's fingertip pf are recognized. When it is determined that the virtual space position has been designated (Fig. 3 / STEP16..YES), the luminance of the pixel corresponding to the first designated point p1 may be adjusted so as to change (for example, temporarily increase in luminance, or repeatedly increase and decrease in luminance) on the display 220 that constitutes the output interface 22. Further, when it is determined that the virtual space position has been designated (Fig. 3 / STEP16..YES), a sound (for example, a temporary sound) may be emitted from the speaker that constitutes the output interface 22.

[0024] In addition, a plurality of candidate virtual space positions may be displayed on the display 220 (or projected onto the lens 221), and a virtual key or button (constituting the input interface 21) also displayed on the display 220 is operated according to the movement of the user's fingertip pf, so that a candidate virtual space position selected from among the plurality of candidate virtual space positions may be recognized as the virtual space position of the first designated point p1. The candidate virtual space position may be selected according to the user's voice detected by the microphone that constitutes the input interface 21.

[0025] Subsequently, based on the virtual space position of the first designated point p1, the real space position of the node p0 is recognized by the node position recognition unit 12 (FIG. 3 / STEP20). Specifically, as shown in FIG. 8 (plan view), based on the correspondence relationship, the real space position of one point (or a lump of partial point group) among the point group on the surface of the structure Q0 corresponding to the virtual space position of the first designated point p1 is defined as the real space position of the second designated point p2. Then, as shown in FIG. 8, the real space position of the point separated by the specified distance d along the line segment p1-p0 from the real space position of the second designated point p2 is defined as the real space position of the node p0. In addition, as shown in FIG. 8, the real space position of the point where the shortest distance from the structure Q0 on the line segment p1-p0 is the specified distance d may be defined as the real space position of the node p0'.

[0026] The specified distance d may be set in response to the operation of the virtual key or button (constituting the input interface 21) displayed or projected on the display 220 according to the movement of the user's fingertip pf. The specified distance d may be 0, but may be set in the range of, for example, 0.20 m to 1.0 m in consideration of the assumed size of the second virtual structure. The specified distance d may be set in response to the user's voice detected by the microphone constituting the input interface 21.

[0027] Next, it is determined by the design data generation unit 13 whether there is an instruction to generate design data through the input interface 21 (FIG. 3 / STEP22). Whether there is an instruction to generate design data may be determined according to whether the virtual key or button (constituting the input interface 21) displayed or projected on the display 220 is operated according to the movement of the user's fingertip pf. Whether there is an instruction to generate design data may be determined according to the user's voice detected by the microphone constituting the input interface 21.

[0028] When the determination result is negative (Fig. 3 / STEP22..NO), the processes after the determination process of whether the virtual space position is specified by the node position recognition unit 12 (Fig. 3 / STEP16) are repeatedly executed. On the other hand, when the determination result is positive (Fig. 3 / STEP22..YES), design data is generated as second design data by the design data generation unit 13 (Fig. 3 / STEP24). The "second design data" is data representing the actual space occupancy state of the second virtual structure Q2 extending along the line segment connecting the actual space positions of the plurality of nodes p0 recognized by the node position recognition unit 12. The data of the actual space positions of the plurality of nodes p0 is converted into line segment data, and for example, it is converted into solid data such as a cylinder or a prism or a cylinder or a prism having the line segment as a central axis. When the actual space positions of the nodes p0 are determined in order as p0(1) → p0(2) → p0(3) (the numbers in parentheses represent the order of specification), it may be converted into two line segments p0(1)-p0(2) and p0(2)-p0(3). In addition, it may be converted into two line segments p0(1)-p0(3) and p0(3)-p0(2) so that the line segment becomes the shortest or to avoid interference with the structure Q0 (and the first virtual structure Q1).

[0029] Data representing the actual space occupancy states of the plurality of second virtual structures Q2 extending along each of the line segment connecting the actual space positions of the plurality of nodes p0 and one or more line segments parallel thereto may be generated as the second design data. Data representing the actual space occupancy states of the plurality of second virtual structures Q2 extending along each of a plurality of line segments parallel to, rather than the line segment connecting the actual space positions of the plurality of nodes p0, may be generated as the second design data.

[0030] The specifiable virtual space positions may be restricted such that only the real space positions spaced from a single node p0(1) in a specified direction (e.g., the x-direction, y-direction, or z-direction) in the real space are specified as the real space positions of another node p0(2). Thereby, second design data representing the real space occupancy mode of the second virtual structure Q2 extending along the line segment connecting a single node p0(1) and another node p0(2) can be easily generated. The specified direction may be specified by the user through the input interface 21.

[0031] The second design data is stored in the storage device and / or database as part of the first design data or as separate design data from the first design data. The design data may be saved or deleted in response to the operation of virtual keys or buttons (constituting the input interface 21) displayed or projected on the display 220 according to the movement of the user's fingertip pf. The design data may be saved or deleted in response to the user's voice detected by the microphone constituting the input interface 21.

[0032] The display control unit 14 reads the second design data from the storage device or database, and recognizes the real space occupancy mode of the second virtual structure Q2 represented by the second design data. Then, the display control unit 14 superimposes and displays the second virtual structure Q2 on the first virtual structure Q1 and the structure Q0 existing in the real space on the display 220 (FIG. 3 / STEP26). At this time, the size of the second virtual structure Q2 displayed or projected on the display 220 is appropriately scaled to match the size of the structure Q0 in the real space. Thereby, for example, as shown in FIG. 9, second virtual structures Q2 such as pipes Q21 and Q22 composed of a plurality of cylinders connected by nodes p0 extending along the wall Q02 are superimposed and displayed on the first virtual structure Q1 and the structure Q0 on the display 220.

[0033] At least one of the shape, size, and color (at least one of hue, saturation, and lightness) of the second virtual structure Q2 displayed on the display 220 may be automatically adjusted. At least one of the overall lightness of the real space measured through the camera 210 constituting the environmental sensor or at least one of the local hue, saturation, and lightness of the area where the second virtual structure Q2 is superimposed and displayed, at least one of the shape, size, hue, saturation, and lightness of the second virtual structure Q2 may be automatically adjusted (so as to be easier for the user to visually recognize). For example, when the lightness of the real space is low, the lightness of the second virtual structure Q2 may be adjusted to be higher than the original lightness. For example, when the lightness of the real space is low, the second virtual structure Q2 may be adjusted to be a discontinuous line shape or column shape instead of a linear or columnar shape. In addition, the color of the second virtual structure Q2 displayed on the display 220 may be changed according to the user's instruction through the input interface 21. In addition to adjusting all the colors of the second virtual structure Q2, only a part of the colors of the second virtual structure Q2 may be adjusted. The part of the second virtual structure Q2 where the color is adjusted may be changed according to the user's instruction through the input interface 21.

[0034] (Effect) According to the design support system 1 of the present invention that exhibits the above function, after the user grasps the situation of the real space where the structure Q0 exists visually through the display 220, the user can determine the virtual space position of the first designated point p1 on the display 220 by an operation such as moving the fingertip pf (see FIGS. 6 and 7). Accordingly, the real space positions of a plurality of nodes p0 corresponding to the virtual space positions of the plurality of first designated points p1 are determined. At this time, the design work is simplified by the amount that the user does not need to specify the depth information or the distance from the design support device 2.

[0035] Then, design data (second design data) of a second virtual structure such as a pipe extending along one or more line segments connecting the real-space positions of a plurality of nodes p0 is generated and stored or saved in a storage device or the like. Since the second virtual structure Q2 is superimposed and displayed on the structure Q0 existing in the real space on the display 220, the user can check the design data and appropriately attempt to change the design data (see FIG. 9). Thereby, the working efficiency of designing the second virtual structure Q2 is improved.

[0036] Design data (second design data) may be generated according to the operation of one design support device 2 by one user, and a second virtual structure corresponding to the design data may be displayed on the structure Q0 on the display 220 of another design support device 2 possessed by another user. Thereby, sharing of design data and collaborative design of the second virtual structure Q2 and the like are enabled among a plurality of users, and the reliability of the design data and the like is improved.

[0037] (Other Embodiments of the Present Invention) Based on the real-space position and real-space orientation of the measuring device that change according to the movement of the user's body measured by the measuring device constituting the input interface 21, the real-space position of the designated point (second designated point p2) is recognized, and the real-space position of the node p0 may be recognized by the node position recognition unit 12 with reference to the real-space position. The measuring device may include a gyro sensor and, if necessary, a GPS or GNSS system, and may be configured to be able to measure the real-space position (latitude, longitude, and altitude) and orientation (determined from the displacement of the real-space position) of the measuring device or the own device. The measuring device is carried by the user or attached to a designated body part. Based on the real-space position of the measuring device at the time of the user's designated operation (for example, the time when the switch of the measuring device is pressed and / or the time when the acceleration of the measuring device changes steeply), the real-space position of the point on the surface of the structure Q0 on the line segment extending in the real-space orientation of the measuring device at that time is recognized as the real-space position of the second designated point p2. Then, as described above, the real-space position of the node p0 is recognized with reference to the second designated point p2.

[0038] In this case, when the real-space position of the node p0 is recognized, the virtual-space position of the first designated point p1 corresponding to the second designated point p2 may be recognized and displayed on the display 220. Although the virtual-space position of the first designated point p1 may not be recognized and displayed at this time, when the real-space position of the second designated point p2 is included in the captured image, the virtual-space position of the first designated point p1 corresponding to the second designated point p2 may be recognized and displayed on the display 220.

[0039] The measuring device may be configured to include a line-of-sight detector and a GPS or GNSS system, and to measure the line-of-sight direction of the user and the real-space position (latitude, longitude, and altitude) of the measuring device or the own device. The measuring device is provided, for example, on the design support device 2 (a head-mounted type or goggle-type wearable device worn on the user's head) or its housing 204. Based on the real-space position of the measuring device at the time of the user's designated operation (for example, when the user presses the switch of the measuring device and / or when the user's line-of-sight direction is continuously fixed for a certain period of time (for example, 2 to 5 seconds)), the real-space position of the point on the surface of the structure Q0 in the line segment extending in the line-of-sight direction of the user at this time is recognized as the real-space position of the second designated point p2. Then, as described above, the real-space position of the node p0 is recognized based on the second designated point p2.

[0040] Through the input interface 21, at least one of the position, shape, and size of the second virtual structure Q2 displayed on the display 220 may be changed by the user. For example, when the substantially columnar second virtual structure Q2 extends non-parallel to the x-axis or y-axis, its posture may be changed so that the second virtual structure Q2 extends parallel to the x-axis or y-axis. Further, the length and / or thickness (size) of the substantially columnar second virtual structure Q2 may be changed. Furthermore, the second virtual structure Q2 may be entirely moved in at least one of the x-direction, y-direction, and z-direction. By changing the position of the node p0 displayed on the display 220 by the user through the input interface 21, at least one of the position, shape, and size of the second virtual structure Q2 displayed on the display 220 may be changed.

[0041] The position of the node p0 displayed on the display 220 may be changed by the user through the input interface 21. For example, the virtual space position corresponding to the node p0 may be tapped, double-tapped, or long-tapped by the fingertip pf as the designated body part (and the node p0 may be displayed so as to vibrate accordingly), and the position of the node p0 may be changed by being swiped, flicked, or dragged.

Explanation of Signs

[0042] 1.. Design support system 2.. Design support device (wearable device) 11.. Design environment recognition unit 12.. Node position recognition unit 13.. Design data generation unit 14.. Display control unit 20.. Device control unit 21.. Input interface 210.. Camera 22.. Output interface 202.. Headband 204.. Housing 220.. Display 221.. Lens 222‥Projection device 224‥3D glasses p0‥Node p1‥First specified point p2‥Second specified point Q0, Q01~Q05‥Structures Q1, Q11~Q14‥First virtual structure Q2, Q21~Q22‥Second virtual structure.

Claims

1. Based on the output signal of the environmental sensor included in the design support device, a virtual space position in a two-dimensional virtual space coordinate system defined in a display that constitutes an output interface included in the design support device, and a three-dimensional real space position of a structure existing in the real space that is visible to the user through the display. A design environment recognition unit that recognizes the correspondence relationship between the real space positions; A node position recognition unit that recognizes the real space position of a node separated from the structure based on the real space position of a designated point designated in the real space coordinate system through an input interface included in the design support device; A design data generation unit that generates design data representing the real space occupancy state of a virtual structure extending along a line segment connecting a plurality of nodes whose real space positions are recognized by the node position recognition unit, and stores and holds the design data in a storage device; A display control unit that superimposes and displays the virtual structure on the structure on the display based on the design data generated by the design data generation unit and the correspondence relationship recognized by the design environment recognition unit. Design support system.

2. In the design support system according to Claim 1, When the virtual space position of a first designated point is designated in the virtual space coordinate system through the input interface, the node position recognition unit indirectly designates the virtual space position of the first designated point based on the virtual space position of the first designated point and the correspondence relationship recognized by the design environment recognition unit. Recognize the real space position of the node based on the real space position of the second designated point as the designated point corresponding to the virtual space position of the first designated point. Design support system.

3. In the design support system according to Claim 2, The node position recognition unit recognizes the virtual space position in the virtual space coordinate system corresponding to the point indicated by the designated body part of the user in the captured image, which is captured by a camera constituting the input interface, as the virtual space position of the first designated point. Design support system.

4. In the design support system according to Claim 2, The node position recognition unit uses an operator displayed or projected on the display that constitutes the input interface, and recognizes the virtual space position of the point indicated in the virtual space coordinate system as the virtual space position of the first designated point. Design support system.

5. In the design support system according to claim 2, the node position recognition unit recognizes the real-space position of the node that is separated from the structure by a distance specified using an operator that is displayed or projected on the display and constitutes the input interface. Design support system.

6. In the design support system according to claim 1, the node position recognition unit recognizes the real-space position of the designated point based on the real-space position and real-space orientation of the measuring device that change according to the movement of the user's body and are measured by the measuring device that constitutes the input interface. Design support system.

7. In the design support system according to claim 1, the design environment recognition unit recognizes the correspondence based on the position, size, and orientation of the index object in the captured image corresponding to the virtual space coordinate system captured by the camera as the environment sensor, and the design environment data representing the real-space occupancy mode of the structure in the real-space coordinate system. Design support system.

8. In the design support system according to claim 1, the display control unit reads first design data representing the real-space occupancy mode of the first virtual structure from the storage device, superimposes and displays the first virtual structure whose real-space occupancy mode is represented by the first design data on the structure on the display, and superimposes and displays the virtual structure whose real-space occupancy mode is represented by the second design data as the design data generated by the design data generation unit as a second virtual structure on the structure and the first virtual structure on the display. Design support system.

9. In the design support system according to claim 8, the design data generation unit generates new first design data by combining the first design data and the second design data. Design support system.

10. In the design support system according to claim 1, the design support device is constituted by a wearable device worn on the user's head. Design support system.

11. For the computer mounted on the design support device, Based on the output signal of the environmental sensor of the design support device, the virtual space position in the two-dimensional virtual space coordinate system defined in the display that constitutes the output interface of the design support device, and the real space position in the three-dimensional real space coordinate system of the structure existing in the real space that can be visually recognized by the user through the display, a design environment recognition process for recognizing the correspondence relationship; A node position recognition process for recognizing the real space position of a node separated from the structure based on the real space position of a designated point specified in the real space coordinate system through the input interface of the design support device; A design data generation process for generating design data representing the real space occupancy mode of a virtual structure extending along a line segment connecting a plurality of nodes whose real space positions are recognized by the node position recognition process, and storing and holding the design data in a storage device; Based on the design data generated by the design data generation process and the correspondence relationship recognized by the design environment recognition process, a display control process for superimposing and displaying the virtual structure on the structure on the display, and executing a design support method having the above; A design support program.

Images