Design support system and design support program

Abstract

To provide a system capable of improving design work efficiency for structures such as piping and cable trays, and supports that support other structures such as piping and / or cable trays.SOLUTION: A user can visually recognize a situation in a real space in which a structure Q0 exists through a display 220, and then determine a virtual space position of a first specified point p1 on the display 220 by moving fingertips pf, for example. In response, design data (second design data) of a second virtual structure such as a pipe extending along one or more line segments connecting a plurality of nodes p0, whose real space positions correspond to virtual space positions of the plurality of first specified points p1, is generated and stored or saved in a storage device, or the like.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a design support system for structures such as piping and cable trays and supports for supporting other structures such as piping and / or cable trays. [Background technology]

[0002] A drawing projection system has been proposed that projects a blueprint into real space in actual size simply by scanning the real space and, if necessary, scanning an AR marker (see, for example, Patent Document 1). This system eliminates the need for cumbersome marking work, and improves work efficiency by superimposing the actual construction status and design documents even during post-construction inspection or completion check processes. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6438995 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, it would be preferable from the viewpoint of design work efficiency if the design drawing to be superimposed on the real space were created by the user on-site and saved as is as design data for that site.

[0005] Therefore, an object of the present invention is to provide a system that can improve the efficiency of design work for structures such as piping and cable trays, as well as supports that support other structures such as piping and / or cable trays. [Means for solving the problem]

[0006] The design support system of the present invention comprises: a design environment recognition unit that recognizes, based on an output signal from an environmental sensor of the design support device, a correspondence between a virtual space position in a two-dimensional virtual space coordinate system defined on a display constituting an output interface of the design support device and a real space position in a three-dimensional real space coordinate system of a structure that can be viewed by a user through the display; a node position recognition unit that recognizes a real-space position of a node that is spaced apart from the structure, based on a real-space position of a designated point that is designated in the real-space coordinate system through an input interface of the design support device; a design data generating unit that generates design data representing a real-space occupation mode of a virtual structure extending along line segments connecting the plurality of nodes whose real-space positions have been recognized by the node position recognizing unit, and stores and retains the design data in a storage device; and a display control unit that displays the virtual structure superimposed on the structure on the display based on the design data generated by the design data generation unit and the correspondence recognized by the design environment recognition unit. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is an explanatory diagram relating to the configuration of a design support system according to an embodiment of the present invention; [Figure 2] FIG. 2 is an explanatory diagram relating to the configuration of a design support device. [Figure 3] 3 is a flowchart showing the functions of the design support system. [Figure 4] FIG. 4 is an explanatory diagram regarding the correspondence between virtual space positions and real space positions. [Figure 5] FIG. 10 is an explanatory diagram relating to a superimposed display mode of a first virtual structure. [Figure 6] FIG. 10 is an explanatory diagram relating to a manner of specifying a virtual space position. [Figure 7] FIG. 10 is an explanatory diagram relating to a manner of specifying a virtual space position. [Figure 8] FIG. 4 is an explanatory diagram regarding the correspondence relationship between the virtual space position of a first specified point and the real space position of a second specified point. [Figure 9]FIG. 10 is an explanatory diagram relating to a superimposed display mode of a second virtual structure. DETAILED DESCRIPTION OF THE INVENTION

[0008] (composition) A design support system 1 according to one embodiment of the present invention, shown in FIG. 1, is configured by a computer having a processing unit, a storage device, and the like. The design support system 1 includes a design environment recognition unit 11, a node position recognition unit 12, a design data generation unit 13, and a display control unit 14. Each component of the design support system 1 executes a designated task by the processing unit reading necessary programs (software) and data from the storage device and performing arithmetic processing on the data in accordance with the programs. The design support system 1 may also be configured by a server computer, tablet terminal, and / or smartphone, etc., capable of communicating with a design support device 2 via a network via wireless and / or wired communication.

[0009] As shown in FIG. 1, the design support device 2 includes an equipment control unit 20, an input interface 21, and an output interface 22. The equipment control unit 20 is configured with an arithmetic processing unit and a storage device. The arithmetic processing unit reads necessary programs (software) and data from the storage device and executes designated tasks by performing arithmetic processing on the data in accordance with the programs. The design support system 1 may be configured with the equipment control unit 20 and mounted on the design support device 2. The input interface 21 has one or more cameras 210 (imaging devices). The camera 210 may be configured with a visible light camera, a visible light camera, and an infrared camera. The input interface 21 may include a distance measurement sensor. The output interface 22 has a transmissive display 220 (image display device).

[0010] The design support device 2 is configured as a head loupe-type or goggle-type wearable device worn on the user's head, for example, as shown in Fig. 2. As shown in Fig. 2, the wearable device includes a headband 202, a housing 204 (front enclosure), a lens 221 (visor) configured as a half mirror, and linearly polarized or circularly polarized 3D glasses 224.

[0011] The headband 202 is made of a flexible material such as synthetic resin, cloth, and / or rubber, and is wrapped around or fitted onto the user's head, thereby attaching the wearable device to the user's head. The housing 204 is made of a hard synthetic resin and is attached to the front of the headband 202. The housing 204 contains the device control unit 20, sensors such as the camera 210, and a projection device 222 that projects an image onto the lens 221. The projection device 222 is made up of a left-eye projector and a right-eye projector corresponding to the left and right lenses of the 3D glasses 224.

[0012] With the wearable device attached to the head, the user can view objects such as structures that exist in the real space in front of the user through the lens 221, and can also view virtual objects such as virtual structures projected onto the lens 221 by the projection device 222. In this way, the display 220 displays virtual objects superimposed on objects that exist in the real space.

[0013] The lens 221 of the wearable device may be configured as a non-transparent mirror facing the user, rather than a half mirror, and a captured image representing the state of real space may be projected onto the mirror by the projection device 222.

[0014] The design support device 2 may be a wearable device or a portable device such as a smartphone or tablet terminal. The portable device may have a transparent display, or may have a non-transparent (normal) display that displays an image captured by a camera.

[0015] (function) The functions of the design support system 1 configured as described above will now be described. Fig. 4 illustrates an example of a real space in which a structure Q0 exists, as viewed by a user wearing the design support device 2 on their head through the 3D glasses 224 and lenses 221. As shown in Fig. 4, the real space includes a floor Q01, walls Q02, and ceiling Q03 of the building, as well as structures Q0 such as piping Q04 such as electrical conduits installed along the wall Q02 and a distribution board or panel Q05 installed on the floor Q01.

[0016] A camera 210 mounted on the design support device 2 acquires a captured image including a marker M (index object) previously placed in the real space, and the design environment recognition unit 11 recognizes the reflection manner (position, size, and orientation) of the marker M in the captured image (FIG. 3 / STEP 10). For example, as shown in FIG. 4, the reflection manner in the captured image of a substantially rectangular, planar marker M placed on a floor Q01 is recognized. The marker M has anisotropy. The marker M may not be a planar marker, but may be a three-dimensional marker. The relative positions and orientations of the camera 210 and the display 220, which has a virtual space coordinate system corresponding to the captured image coordinate system, with respect to the marker M in the real space are determined based on the reflection manner of the marker M in the captured image.

[0017] Next, the design environment recognition unit 11 recognizes the correspondence between the virtual space position in the two-dimensional virtual space coordinate system defined on the display 220 and the real space position in the three-dimensional real space coordinate system of the structure Q0 visible to the user through the display 220, based on the reflection mode of the marker M in the captured image and the design environment data (FIG. 3 / STEP 12). The "design environment data" is data representing the real space occupation mode of the structure Q0 in the real space coordinate system, and this data determines the real space position (coordinates) in the real space coordinate system of a point cloud representing the surface of the structure Q0. The design environment data is read from a storage device or a database. As a result, for example, as shown in FIG. 4, the correspondence between the virtual space position of a point pv in the virtual space coordinate system (u, v) and the real space position of a point pr on the surface of the structure Q0 in the real space coordinate system (x, y, z), which is a three-dimensional Cartesian coordinate system based on the marker M, is recognized. The captured image coordinate system of camera 210 and the virtual space coordinate system of display 220 may be adjusted in advance to coincide with each other, and a coordinate transformation matrix between the captured image coordinate system and the virtual space coordinate system may be determined in advance.

[0018] Multiple markers M may be arranged at a distance from one another in real space, and a correspondence between virtual space positions and real space positions may be recognized based on the reflection patterns of the multiple markers M in the captured image and the design environment data. Even if the reflection pattern of one marker M in the captured image is inappropriate from the perspective of accurately determining the correspondence, the accuracy of the correspondence may be ensured by determining the correspondence while also taking into account the reflection patterns of the other markers M. The correspondence may be recognized as an average or weighted average of the correspondence between virtual space positions and real space positions determined based on the reflection patterns of the multiple markers M in the captured image and the design environment data. For example, the weights or weighting coefficients may be set so that they are smaller for markers M with smaller sizes in the captured image and / or so that they are smaller for markers M with larger distortion in the area reflected in the captured image due to the characteristics of the lens of the camera 210. A correspondence between a virtual space position and a real space position may be recognized by arranging a plurality of markers M at intervals in one of the x, y, and z directions in real space and recognizing a line segment connecting the plurality of markers (or their centers) in the captured image as a line segment parallel to the one direction in real space. For example, two markers M may be arranged at intervals in the x direction in real space and a line segment connecting the two markers M in the captured image may be recognized as the x direction in real space, and the correspondence may be recognized based on a difference in posture between the line segment in virtual space and the line segment.

[0019] The correspondence may be recognized by scanning the real space with a distance measurement sensor constituting the input interface 21 and measuring the real space positions of the point cloud on the surface of the structure Q0 (see Patent Document 1).

[0020] The display control unit 14 reads out the first design data from a storage device or a database and recognizes the real-space occupation mode of the first virtual structure Q1 represented by the first design data. Then, the display control unit 14 superimposes the first virtual structure Q1 on the display 220 over a structure Q0 existing in real space (FIG. 3 / STEP 14). At this time, the size of the first virtual structure Q1 displayed or projected on the display 220 is appropriately scaled to match the size of the structure Q0 in real space. As a result, for example, as shown in FIG. 5, the first virtual structures Q1, such as a conduit Q11, a pipe Q12, and an intake / exhaust duct or cable tray Q13 extending along a wall Q02, as well as a pull box Q14 installed on a floor Q01, are superimposed on the structure Q0 on the display 220. The first virtual structure Q1 may be designed in advance and stored in a storage device or the like. Display of the first virtual structure Q1 on the display 220 may be omitted.

[0021] Next, the node position recognition unit 12 determines whether the virtual space position of the first specified point p1 in the virtual space coordinate system has been specified by the user (FIG. 3 / STEP 16). For example, when the camera 210 tracks the fingertip pf as the specified body part of the user, and the fingertip pf temporarily stops (when an action equivalent to a tap, double tap, or long tap is performed), when the fingertip pf of one hand and the other hand appear in the captured image, or when the fingertip pf overlaps with any of the structures Q01 to Q05 or the first virtual structures Q11 to Q14, it is determined that the virtual space position of the fingertip pf at that time has been specified (see FIG. 6). In addition, a virtual pointer pb (the "operator" constituting the input interface 21) superimposed on the display 220 is moved in accordance with the movement of the fingertip pf tracked via the camera 210. When the pointer pb is pressed inward and stopped (when an action equivalent to a tap, double tap, or long tap is performed), it is determined that the virtual space position of the first specified point p1 of the pointer pb has been specified (see FIG. 7). The length of the virtual pointer Pb may be changed in accordance with an extension instruction (e.g., an upward swipe of the fingertip pf) or a contraction instruction (e.g., a downward swipe of the fingertip pf) by the user via the input interface 21. The "specified body part" of the user may include the fingertip pf of the hand, as well as the palm, wrist, elbow, knee, ankle, top of the foot, toe tips, and tongue tip, as well as a pen held in the hand or foot, a stick held in the mouth, etc.

[0022] If the determination result is negative (FIG. 3 / STEP 16...NO), the process of determining whether or not a virtual space position has been designated by the node position recognition unit 12 (FIG. 3 / STEP 16) and subsequent processes are repeatedly executed.

[0023] On the other hand, if the determination result is affirmative (FIG. 3 / STEP 16...YES), the node position recognition unit 12 recognizes the virtual space position of the first specified point p1 (FIG. 3 / STEP 18). As a result, for example, as shown in FIG. 6, the virtual space positions of multiple first specified points p1 designated by the user's fingertip pf are recognized. Additionally, for example, as shown in FIG. 7, the virtual space positions of multiple first specified points p1 designated by a virtual pointer pb that follows the movement of the user's fingertip pf are recognized. If it is determined that a virtual space position has been designated (FIG. 3 / STEP 16...YES), the brightness of the pixel corresponding to the first specified point p1 on the display 220 constituting the output interface 22 may be adjusted to change (e.g., temporarily increase the brightness, or repeatedly increase and decrease the brightness). Furthermore, if it is determined that a virtual space position has been designated (FIG. 3 / STEP 16...YES), a sound (e.g., a temporary sound) may be emitted from a speaker constituting the output interface 22.

[0024] Alternatively, a plurality of candidate virtual space positions may be displayed on display 220 (or projected onto lens 221), and a virtual key or button (constituting input interface 21) also displayed on display 220 may be operated in accordance with the movement of the user's fingertip pf, whereby a candidate virtual space position selected from the plurality of candidate virtual space positions may be recognized as the virtual space position of first specified point p1. A candidate virtual space position may also be selected in accordance with the user's voice detected by a microphone constituting input interface 21.

[0025] Next, the node position recognition unit 12 recognizes the real-space position of the node p0 based on the virtual-space position of the first specified point p1 (FIG. 3 / STEP 20). Specifically, as shown in FIG. 8 (plan view), the real-space position of one point (or a group of partial points) among the points on the surface of the structure Q0 that corresponds to the virtual-space position of the first specified point p1 is determined as the real-space position of the second specified point p2 based on the correspondence relationship. Then, as shown in FIG. 8, the real-space position of a point that is a specified distance d away from the real-space position of the second specified point p2 along the line segment p1-p0 is determined as the real-space position of the node p0. Alternatively, as shown in FIG. 8, the real-space position of a point on the line segment p1-p0 that is the shortest distance from the structure Q0 by the specified distance d may be determined as the real-space position of the node p0'.

[0026] The designated distance d may be set in response to a virtual key or button (constituting the input interface 21) displayed or projected on the display 220 being operated in response to the movement of the user's fingertip pf. The designated distance d may be 0, but may also be set in the range of 0.20 m to 1.0 m, for example, taking into account the expected size of the second virtual structure. The designated distance d may also be set in response to the user's voice detected by a microphone constituting the input interface 21.

[0027] Next, the design data generation unit 13 determines whether or not an instruction to generate design data has been issued through the input interface 21 (FIG. 3 / STEP 22). The presence or absence of an instruction to generate design data may be determined depending on whether or not a virtual key or button (constituting the input interface 21) displayed or projected on the display 220 has been operated in accordance with the movement of the user's fingertip pf. The presence or absence of an instruction to generate design data may also be determined depending on the user's voice detected by a microphone constituting the input interface 21.

[0028] If the determination result is negative (FIG. 3 / STEP 22...NO), the processes following the process by the node position recognition unit 12 to determine whether a virtual space position has been specified (FIG. 3 / STEP 16) are repeatedly executed. On the other hand, if the determination result is positive (FIG. 3 / STEP 22...YES), the design data generation unit 13 generates design data as second design data (FIG. 3 / STEP 24). The "second design data" is data representing the real space occupation mode of a second virtual structure Q2 extending along a line segment connecting the real space positions of the multiple nodes p0 recognized by the node position recognition unit 12. The data of the real space positions of the multiple nodes p0 is converted into line segment data, and then converted into three-dimensional data such as a circular cylinder, a rectangular prism, a cylinder, or a rectangular tube with the line segment as its central axis. If the real-space position of node p0 is determined in the order p0(1) → p0(2) → p0(3) (the numbers in parentheses indicate the order of designation), it may be converted into two line segments p0(1)-p0(2) and p0(2)-p0(3). Additionally, it may be converted into two line segments p0(1)-p0(3) and p0(3)-p0(2) so that the line segments are the shortest or so that they avoid interference with structure Q0 (and first virtual structure Q1).

[0029] Data representing the real space occupation mode of each of the multiple second virtual structures Q2 extending along each of the line segments connecting the real space positions of the multiple nodes p0 and one or more line segments parallel to the line segments may be generated as the second design data.Data representing the real space occupation mode of each of the multiple second virtual structures Q2 extending not along each of the line segments connecting the real space positions of the multiple nodes p0 but along each of the multiple line segments parallel to the line segments may be generated as the second design data.

[0030] The virtual space positions that can be specified may be limited so that only real space positions that are separated from one node p0(1) in a specified direction (e.g., the x-, y-, or z-direction) in real space can be specified as the real space position of another node p0(2). This makes it easy to generate second design data that represents the real space occupation mode of a second virtual structure Q2 that extends along a line segment connecting one node p0(1) and the other node p0(2). The specified direction may be specified by the user via the input interface 21.

[0031] The second design data is stored in a storage device and / or a database as part of the first design data or as design data separate from the first design data. The design data may be saved or erased in response to a virtual key or button (constituting the input interface 21) displayed or projected on the display 220 being operated in response to the movement of the user's fingertip pf. The design data may also be saved or erased in response to the user's voice detected by a microphone constituting the input interface 21.

[0032] The display control unit 14 reads out the second design data from the storage device or database and recognizes the real-space occupation mode of the second virtual structure Q2 represented by the second design data. Then, the display control unit 14 displays the second virtual structure Q2 on the display 220, superimposed on the first virtual structure Q1 and the structure Q0 existing in the real space (FIG. 3 / STEP 26). At this time, the size of the second virtual structure Q2 displayed or projected on the display 220 is appropriately scaled to match the size of the structure Q0 in the real space. As a result, for example, as shown in FIG. 9, the second virtual structure Q2, such as pipes Q21 and Q22, e.g., electrical conduits, each composed of a plurality of cylinders connected at a node p0 extending along a wall Q02, is displayed on the display 220, superimposed on the first virtual structure Q1 and the structure Q0.

[0033] At least one of the shape, size, and color (at least one of hue, saturation, and brightness) of the second virtual structure Q2 displayed on the display 220 may be automatically adjusted. At least one of the shape, size, hue, saturation, and brightness of the second virtual structure Q2 may be automatically adjusted (to make it easier for the user to see) in accordance with at least one of the overall brightness of the real space measured by the camera 210 constituting the environmental sensor or the local hue, saturation, and brightness of the area where the second virtual structure Q2 is superimposed and displayed. For example, when the brightness of the real space is low, the brightness of the second virtual structure Q2 may be adjusted to be higher than its original brightness. For example, when the brightness of the real space is low, the second virtual structure Q2 may be adjusted to be not a line or columnar shape but an intermittent line or columnar shape. In addition, the color of the second virtual structure Q2 displayed on the display 220 may be changed by a user's instruction via the input interface 21. The color of the entire second virtual structure Q2 may be adjusted, or the color of only a part of the second virtual structure Q2 may be adjusted. The part of the second virtual structure Q2 whose color is adjusted may be changed by a user's instruction via the input interface 21.

[0034] (effect) According to the design support system 1 of the present invention that performs the above functions, the user can grasp the situation of the real space in which the structure Q0 exists, which is visually recognized through the display 220, and then determine the virtual space position of the first specified point p1 on the display 220 by moving the fingertip pf or the like (see FIGS. 6 and 7). In response to this, the real space positions of the multiple nodes p0 corresponding to the virtual space positions of the multiple first specified points p1 are determined, but at this time, the user does not need to specify depth information or distances from the design support device 2, thereby simplifying the design work.

[0035] Then, design data (second design data) of a second virtual structure such as a pipe extending along one or more line segments connecting the real-space positions of the multiple nodes p0 is generated and stored or saved in a storage device or the like. The second virtual structure Q2 is superimposed on the structure Q0 existing in real space on the display 220, so that the user can check the design data and try to change the design data as appropriate (see FIG. 9). This improves the efficiency of the design work for the second virtual structure Q2.

[0036] Design data (second design data) may be generated by one user in response to an operation of one design support device 2, and a second virtual structure corresponding to the design data may be displayed on the structure Q0 on the display 220 of another design support device 2 owned by another user. This allows multiple users to share design data and jointly design the second virtual structure Q2, thereby improving the reliability of the design data.

[0037] (Another embodiment of the present invention) The real-space position of a specified point (second specified point p2) may be recognized based on the real-space position and real-space orientation of the measuring device, which are measured by the measuring device constituting the input interface 21 and change in response to the user's body movements. The real-space position of the node p0 may then be recognized by the node position recognition unit 12 based on the real-space position. The measuring device may include a gyro sensor and, if necessary, a GPS or GNSS system, and be configured to measure the real-space position (latitude, longitude, and altitude) and orientation (determined from the displacement of the real-space position) of the measuring device or its own aircraft. The measuring device is carried by the user or attached to a specified body location. Based on the real-space position of the measuring device at the time of the user's specified action (e.g., the time when the measuring device's switch is pressed and / or the time when the acceleration of the measuring device changes suddenly), the real-space position of a point on the surface of the structure Q0 on a line segment extending in the real-space orientation of the measuring device at that time is recognized as the real-space position of the second specified point p2. Then, as described above, the real space position of the node p0 is recognized with reference to the second specified point p2.

[0038] In this case, at the time when the real space position of node p0 is recognized, the virtual space position of first specified point p1 corresponding to second specified point p2 may be recognized and displayed on display 220. At that time, the virtual space position of first specified point p1 may not be recognized and not displayed, but at the time when the real space position of second specified point p2 comes to be included in the captured image, the virtual space position of first specified point p1 corresponding to second specified point p2 may be recognized and displayed on display 220.

[0039] The measuring instrument may be equipped with a line-of-sight detector and a GPS or GNSS system, and configured to measure the user's line-of-sight direction and the real-space position (latitude, longitude, and altitude) of the measuring instrument or its own aircraft. The measuring instrument is provided, for example, on a design support device 2 (a head loupe-type or goggle-type wearable device worn on the user's head) or its housing 204. The real-space position of the measuring instrument at the time of a user's specified action (e.g., the time when the user presses a switch on the measuring instrument and / or the time when the user's line-of-sight direction is continuously fixed for a certain period of time (e.g., 2 to 5 seconds)) is used as a reference. The real-space position of a point on the surface of structure Q0 on a line segment extending in the user's line-of-sight direction at that time is recognized as the real-space position of second specified point p2. Then, as described above, the real-space position of node p0 is recognized based on second specified point p2.

[0040] At least one of the position, shape, and size of the second virtual structure Q2 displayed on the display 220 may be changed by the user through the input interface 21. For example, if the substantially columnar second virtual structure Q2 extends non-parallel to the x-axis or y-axis, the posture of the second virtual structure Q2 may be changed so that the second virtual structure Q2 extends parallel to the x-axis or y-axis. The length and / or thickness (size) of the substantially columnar second virtual structure Q2 may also be changed. Furthermore, the second virtual structure Q2 may be moved entirely in at least one of the x-direction, y-direction, and z-direction. At least one of the position, shape, and size of the second virtual structure Q2 displayed on the display 220 may be changed by the user through the input interface 21 changing the position of the node p0 displayed on the display 220.

[0041] The position of the node p0 displayed on the display 220 may be changed by the user through the input interface 21. For example, the position of the node p0 may be changed by tapping, double-tapping, or long-tapping the virtual space position corresponding to the node p0 with the fingertip pf as a designated body part (in response to this, the node p0 may be displayed to vibrate), or by swiping, flicking, or dragging. [Explanation of symbols]

[0042] 1. Design support system 2. Design support devices (wearable devices) 11‥Design environment recognition section 12. Node position recognition unit 13. Design data generation section 14. Display control unit 20. Equipment control unit 21. Input interface 210...Camera 22. Output interface 202...Headband 204. Housing 220‥Display 221...Lens 222‥Projection device 224...3D glasses p0...node p1‥1st specified point p2‥Second designated point Q0, Q01~Q05‥Structures Q1, Q11 to Q14: First virtual structure Q2, Q21~Q22...Second virtual structure.

Claims

1. a design environment recognition unit that recognizes, based on an output signal from an environmental sensor of the design support device, a correspondence between a virtual space position in a two-dimensional virtual space coordinate system defined on a display constituting an output interface of the design support device and a real space position in a three-dimensional real space coordinate system of a structure that can be viewed by a user through the display; a node position recognition unit that recognizes a real-space position of a node that is spaced apart from the structure, based on a real-space position of a designated point that is designated in the real-space coordinate system through an input interface of the design support device; a design data generating unit that generates design data representing a real-space occupation mode of a virtual structure extending along line segments connecting the plurality of nodes whose real-space positions have been recognized by the node position recognizing unit, and stores and retains the design data in a storage device; a display control unit that displays the virtual structure on the display in a superimposed manner on the structure based on the design data generated by the design data generation unit and the correspondence recognized by the design environment recognition unit. Design support system.

2. 2. The design support system according to claim 1, The node position recognition unit recognizes the real space position of the node based on the real space position of a second designated point, which is indirectly designated based on the virtual space position of the first designated point and the correspondence recognized by the design environment recognition unit when the virtual space position of the first designated point is designated in the virtual space coordinate system through the input interface. Design support system.

3. 3. The design support system according to claim 2, The node position recognition unit recognizes, as the virtual space position of the first specified point, a virtual space position in the virtual space coordinate system corresponding to a point designated by the designated body part of the user in a captured image captured by a camera constituting the input interface. Design support system.

4. 3. The design support system according to claim 2, the node position recognition unit recognizes a virtual space position of a point designated in the virtual space coordinate system using an operator displayed or projected on the display, which constitutes the input interface, as the virtual space position of the first designated point. Design support system.

5. 3. The design support system according to claim 2, The node position recognition unit recognizes the real space position of the node that is separated from the structure by a specified distance using an operator that is displayed or projected on the display and that constitutes the input interface. Design support system.

6. 2. The design support system according to claim 1, The nodal position recognition unit recognizes the real-space position of the specified point based on the real-space position and real-space orientation of a measuring device that is measured by the measuring device constituting the input interface and that changes in response to the movement of the user's body. Design support system.

7. 2. The design support system according to claim 1, The design environment recognition unit recognizes the correspondence based on the position, size, and orientation of an index object in a captured image corresponding to the virtual space coordinate system, captured by a camera serving as the environment sensor, and design environment data representing the real space occupation state of the structure in a real space coordinate system. Design support system.

8. 2. The design support system according to claim 1, The display control unit reads first design data representing a real space occupation mode of a first virtual structure from a storage device, and displays the first virtual structure, whose real space occupation mode is represented by the first design data, superimposed on the structure on the display, and displays the virtual structure, whose real space occupation mode is represented by second design data as the design data generated by the design data generation unit, as a second virtual structure superimposed on the structure and the first virtual structure on the display. Design support system.

9. 9. The design support system according to claim 8, The design data generating unit combines the first design data and the second design data to generate new first design data. Design support system.

10. 2. The design support system according to claim 1, The design support device is configured as a wearable device that is worn on the user's head. Design support system.

11. For the computer installed in the design support device, a design environment recognition process for recognizing, based on an output signal from an environment sensor of the design support device, a correspondence between a virtual space position in a two-dimensional virtual space coordinate system defined on a display constituting an output interface of the design support device and a real space position in a three-dimensional real space coordinate system of a structure visible to the user through the display; a node position recognition process for recognizing a real space position of a node that is separated from the structure, based on a real space position of a designated point that is designated in the real space coordinate system through an input interface of the design support device; a design data generation process for generating design data representing a real-space occupation mode of a virtual structure extending along line segments connecting the plurality of nodes whose real-space positions have been recognized by the node position recognition process, and storing and retaining the design data in a storage device; and a display control process for displaying the virtual structure on the display in a superimposed manner on the structure based on the design data generated by the design data generation process and the correspondence recognized by the design environment recognition process. Design support program.

Images