Design System for Component Layout and Design Method for Component Layout

Abstract

Provided are a design system for member layout and a design method for member layout that enable an operator to perform work while remaining in the same position regardless of the position of the members. 【Solution means】 A virtual space generation program 31, an image generation program 32, a virtual space display means 6, a hand tracking means 7 for detecting the movement of the operator's fingers, and based on the detection information from the hand tracking means 7, the layout of the members is corrected, and according to the image generation program 32, a layout correction means 42 for generating an image of the members reflecting the change in the layout of the members, and based on the detection information from the hand tracking means 7, according to the image generation program 32, a hand image generation means 43 for generating an image of the operator's fingers that changes moment by moment are provided, and the layout correction means 42 is configured to be able to correct the layout of the members with the intersection of the extension line of the operator's finger and the member as the starting point of the layout correction.

Description

Technical Field

[0001] The present invention relates to a member layout design system and a member layout design method for performing a design related to the layout of members in a virtual space.

Background Art

[0002] Conventionally, design support for determining the routing of wiring and piping and performing the design of the final shape using virtual space technology has been known. For example, the wiring / piping design device described in Patent Document 1 includes a head-mounted display worn on the head of an evaluation designer, a head (line-of-sight) detection transmitter for detecting the orientation or line-of-sight direction of the evaluation designer's head, a finger detection transmitter for detecting the position of the fingers of the evaluation designer's hand, a position detection sensor which is a receiver for detecting the positions of the head (line-of-sight) detection transmitter and the finger detection transmitter, a controller operated by the design evaluator, and a processing device.

[0003] In this configuration, the processing device moves and corrects the position of the grasped wire / piping tube (hereinafter referred to as "wire etc.") in the 3D data in accordance with the movement of the finger. For example, when in the virtual space, the evaluation designer grasps an arbitrary position of the wire etc. with two fingers of the left hand and grasps another position of the same wire etc. with two fingers of the other right hand, and moves the right hand without moving the left hand, the processing device performs position correction on the 3D data of the wire etc. so that the portion grasped by the right hand moves while the position grasped by the left hand is fixed.

[0004] That is, when the evaluation designer performs an operation of stretching and contracting the wire etc. while grasping the wire etc. in the virtual space according to the detection result of the position detection sensor, the wiring / piping design device described in Patent Document 1 can change the length of the member in the virtual space according to the operation and reflect it in the output image.

Prior Art Documents

Patent Documents

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-189122 [Summary of the Invention] [Problems to be Solved by the Invention]

[0006] However, in the wiring and piping design apparatus described in Patent Document 1, in order to correct the position in the three-dimensional data of a wire or the like, it was necessary for the evaluation designer to grasp the wire or the like with a finger and then stretch or contract the wire or the like. In this configuration, the evaluation designer had to move close to the wire or the like in order to grasp it, and in order to move the wire or the like to the target position, the evaluation designer had to move close to the target position.

[0007] For example, when the target position of a wire or the like is in the back of the virtual space, there are many structures that interfere between the target position, and the layout work is not easy. Also, when the target position of a wire or the like is in a high place such as the ceiling of the virtual space, the evaluation designer has to stand on a stepladder or the like, and in this case too, the layout work is not easy.

[0008] The present invention solves the above-described conventional problems, and an object thereof is to provide a design system for member layout and a design method for member layout that enable an operator to perform work while remaining in the same position regardless of the position of the member. [Means for Solving the Problems]

[0009] To achieve the above object, a design system for member layout according to the present invention is a design system for member layout for performing design related to the layout of members in a virtual space, comprising a virtual space generation program for generating the virtual space, a storage means storing an image generation program for generating an image of the member and an image of the operator's finger in the virtual space, a virtual space display means for displaying the virtual space, a hand tracking means for detecting the movement of the operator's finger, and a control means for performing control according to the virtual space generation program and the image generation program. The control means comprises a layout correction means for correcting the layout of the member based on the detection information from the hand tracking means and generating an image of the member reflecting the change in the layout of the member according to the image generation program, and a hand image generation means for generating an image of the operator's finger that changes moment by moment according to the image generation program based on the detection information from the hand tracking means. The layout correction means is characterized in that the intersection of the extension line of the operator's finger and the member can be used as a starting point for layout correction to correct the layout of the member.

[0010] The design method for member layout of the present invention is a design method for member layout for performing design related to the layout of members in a virtual space, including a virtual space generation program for generating the virtual space, an image generation program for generating images of the members and images of the operator's fingers in the virtual space, a virtual space display means for displaying the virtual space, a hand tracking means for detecting the movement of the operator's fingers, and a control means for controlling according to the virtual space generation program and the image generation program. The control means includes a layout correction means for correcting the layout of the members based on the detection information from the hand tracking means and generating an image of the members reflecting the change in the layout of the members according to the image generation program, and a hand image generation means for generating an image of the operator's fingers that changes moment by moment according to the image generation program based on the detection information from the hand tracking means. The layout correction means is characterized by correcting the layout of the members with the intersection of the extension line of the operator's finger and the member as the starting point of layout correction.

[0011] In the member layout design system and the member layout design method of the present invention, it is preferable that a mark is attached to the intersection.

Advantages of the Invention

[0012] The layout correction of the members according to the present invention is to move the members around and correct the layout with the intersection of the extension line of the operator's finger and the members as the starting point of layout correction. Therefore, when correcting the layout of the members, it is not necessary to directly grasp the members with the fingers, and the operator does not need to move close to the members. Thus, regardless of the position of the members, the operator can correct the layout of the members while staying at the same position.

[0013] According to the preferable configuration in which a mark is attached to the intersection of the extension line of the operator's finger and the member, the layout correction work becomes easy using the mark as a guide.

Brief Description of the Drawings

[0014]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0015] The present invention relates to a design system utilizing virtual space technology. The design content relates to the layout of members, and it is possible to design the path and length of members by modifying the layout (rerouting). The type of member is not particularly limited, and typical examples include wires for wiring, cables, pipes for piping, tubes, hoses. However, it may also be a metal bar, food (e.g., noodles), textile products (e.g., belts, strings, robes), etc. Also, there is no limitation on the size and length of the members. For example, it may be a long wire or pipe inside large equipment, or a tiny wire inside a semiconductor chip.

[0016] First, with reference to FIG. 1, the outline of a design system for member layout according to the present invention (hereinafter simply referred to as the "design system") will be described. The design system 1 includes an input means 2, a storage means 3, a control means 4, an output means 5, a virtual space display means 6, and a hand tracking means 7.

[0017] A typical example of the design system 1 is one in which a virtual space generation program 31 and an image generation program 32 are installed in the storage means 3 of a terminal such as a personal computer. However, these programs may also be prepared on the cloud. When the design system 1 is configured by a personal computer, the input means 2 is an import means, a keyboard, etc., and the output means 5 is a display provided in the personal computer.

[0018] 3D (three-dimensional) data 33 is stored in the storage means 3 by the input means 2. The 3D data 33 is 3D data of a structure, equipment, etc. that is the object of the member layout. In the case of the wiring design of a switchboard, it is 3D data showing the internal structure of the switchboard. The object data 34 is data related to the member to be designed, and is data related to the type of member (wire, pipe, etc.), diameter, length, type, etc.

[0019] The virtual space generation program 31 may utilize a commercially available program. This program is, for example, what is called an MR (Mixed Reality) application, which generates a virtual space and links and displays the generated virtual space to the real space. The virtual space is generated by the virtual space generation means 41 according to the virtual space generation program 31 based on the 3D data 33. The generated virtual space is displayed on the head-mounted display 61.

[0020] The image generation program 32 is a development tool such as Unity, for example, and generates images of members to be designed and images of the operator's fingers. The layout of the members in the virtual space changes moment by moment due to layout correction. As will be described in detail later, the layout correction means 42 corrects the layout of the members based on the detection information from the hand tracking means 7, and generates and displays an image of the members reflecting the layout that changes moment by moment in the virtual space according to the image generation program 32.

[0021] The virtual space display means 6 may be anything that can display a virtual space, such as something that can display a virtual space inside goggles or glasses. Also, the virtual space display means 6 does not have to be worn by the operator and may be an external display or a spatial (3D) hologram. In this embodiment, it is the head-mounted display 61. The head-mounted display 61 is worn on the operator's head, and the operator wearing it can see the virtual space displayed inside the head-mounted display 61. FIG. 2 shows an example of the virtual space seen by the operator 10. In FIG. 2, the virtual space 30 is displayed inside the head-mounted display 61, but is shown outside the operator 10 for convenience. The virtual space 30 is an example of wiring in a switchboard, and the main part of the display image is shown, and the illustration of individual structures in the switchboard is omitted.

[0022] In the virtual space 30, a wire 20 is displayed, and convex connectors 21a and 21b are connected to both ends of the wire 20. Also, in the virtual space 30, the left and right hands 11 and fingers 12 of the operator are displayed. The left and right hands 11 are not the actual hands of the operator 10, but as will be described in detail later, in FIG. 1, they are images generated by the hand image generation means 43 according to the image generation program 32 based on the detection information from the hand tracking means 7.

[0023] In FIG. 1, the hand tracking means 7 is provided with sensors for detecting the movement of the fingers of the operator 10, and the design system 1 can track the movement of the fingers of the operator 10. Specifically, in FIG. 1, based on the detection information from the hand tracking means 7, the hand image generation means 43 generates images of the hand 11 and fingers 12 of the operator 10 according to the image generation program 32 as shown in FIG. 2. That is, in accordance with the movement of the fingers of the operator 10, in the virtual space 30 of FIG. 2, the images of the hand 11 and fingers 12 will move.

[0024] The hand tracking means 7 may use sensors as described above, but instead, a plurality of cameras may be installed so that these cameras track the movement of the fingers. In this case, based on the image data of the cameras, the images of the hand 11 and fingers 12 will be linked in accordance with the movement of the fingers of the operator 10.

[0025] The design system 1 according to the present invention enables the operator to correct the layout of the members while remaining at the same position regardless of the position of the members. With reference to FIG. 3, the basic operation of layout correction will be described. FIG. 3(a) shows the state where the correction point of the wire 20 is pointed at with a finger 12 This state is, in FIG. 2, the state where the operator 10 points the actual finger at the wire 20 in the virtual space 30 while looking at the virtual space 30 in the head-mounted display 61. As a result, in the virtual space 30, the images of the hand 11 and fingers 12 will move to face the wire 20.

[0026] More specifically, in FIG. 3(a), a beam 22 is emitted from the tip of the finger 12 facing the wire 20, and the beam 22 reaches the wire 20. The intersection of the wire 20 and the beam 22 is the correction point, and a mark 23 is attached to the intersection by a selection operation. As a result, as shown in FIG. 3(a), the tip of the beam 22 points to the mark 23. That is, the mark 23 serving as the starting point of the layout correction is attached to the intersection of the extension line in the longitudinal direction of the operator's finger and the wire 20.

[0027] The hand tracking means 7 (FIG. 1) detects that a specific point has been selected by the above-described selection operation. The generation, display, and attachment of the mark 23 of the beam 22 are performed by the layout correction means 42 according to the image generation program 32 based on the detection information of the hand tracking means 7 in FIG. 1 (the same applies hereinafter).

[0028] The selection operation is, for example, an operation of pinching with the index finger and the thumb. In this case, since the operation is completed only by moving the finger, the controller becomes unnecessary. When using the controller, an image of the controller appears in the virtual space 30 of FIG. 2, and the operation is performed with this controller.

[0029] When the operator moves the finger from the state where the mark 23 is attached to the wire 20 as shown in FIG. 3(a), the trajectory of the beam 22 changes accordingly, and usually the length of the beam 22 also expands and contracts. FIG. 3(b) shows a state where the finger 12 points to a new movement destination of the mark 23. In the state of this figure, the tip 22a of the beam 22 becomes the new movement destination of the mark 23. If selected by the above-described selection operation from this state, the mark 23 moves to the new movement destination.

[0030] Figure 3(c) shows the state where the mark 23 has moved to a new destination. Along with the movement of the mark 23, as shown in Figure 3(c), the layout of the wire 20 has also changed. In the example of Figure 3, since the convex connectors 21a and 21b at both ends of the wire 20 are inserted into and fixed to the object, the wire 20 has changed into a mountain shape with the mark 23 as the apex due to the movement of the mark 23.

[0031] As shown in Figure 3(c), due to the wire 20 becoming mountain-shaped, the length of the wire 20 has become longer compared to the length of the wire 20 (in a substantially straight state) in Figure 3(b). Also, by performing an operation reverse to the above operation, when the mountain-shaped wire 20 in Figure 3(c) is returned to a substantially straight state as in Figure 3(b), the length of the wire 20 becomes shorter. That is, the wire 20 expands and contracts according to the operation of correcting the layout of the wire 20. The length of the wire 20 due to the expansion and contraction is calculated by the calculation means 44 (Figure 1).

[0032] In the state of Figure 3(c), when the layout correction of the wire 20 is completed, in Figure 1, the calculation means 44 calculates the length of the wire 20 based on the image data of the wire 20. The operation of completing the layout correction may be an operation by the movement of a finger as in the above selection operation, or may be an operation using the controller image presented in the virtual space. The length of the wire 20 after the completion of the layout correction can be displayed on the output stage 44 (Figure 1).

[0033] As described above, the outline of the design system 1 according to the present invention has been explained. Hereinafter, with reference to the flowchart of Figure 4, the design procedure by the design system 1 will be described more specifically. Figure 4 is a flowchart showing the design procedure by the design system 1 in the order of steps. Figures 5 to 13 are diagrams showing the images in the virtual space in the order of steps from the start of design to the end of design. In each of these figures, one operator is performing the work, but each of a plurality of operators may wear the head-mounted display 61 and perform collaborative work.

[0034] Figure 5 shows an image in the virtual space at the start of the design. Similar to Figure 2, the virtual space is inside the switchboard. The display image shows the key parts, and the illustration of individual structures inside the switchboard is omitted (the same applies to Figures 6 to 13). Although not shown in Figure 5, the object of the layout design is the wire 20 shown in Figures 2 and 3. While looking at the image in the head-mounted display 61 (Figure 2), the operator selects the connection destinations A and B of the wire 20 (step 100 in Figure 4).

[0035] In Figure 5, electrical components 30 and 32 are installed in the virtual space. The electrical component 30 is provided with a concave connector 31, and the electrical component 32 is provided with a concave connector 33. The finger 12 points to part A of the concave connector 31, and a beam 22 is emitted toward part A. If the operator performs a selection operation in this state, the concave connector 31 at part A is selected as the connection destination of the convex connector 21a (Figure 2) of the wire 20.

[0036] Figure 6 shows a state where the finger 12 points to part B of the concave connector 33. In this state, a beam 22 is emitted toward part B. If the operator performs a selection operation in this state, the concave connector 33 at part B is selected as the connection destination of the convex connector 21b (Figure 2) of the wire 20.

[0037] Figure 7 shows a state where part A of the electrical component 30 and part B of the electrical component 32 are connected by the wire 20 (step 101 in Figure 4). In the state of Figure 7, the wire 20 is connected between A and B with almost the shortest length. Thereafter, the operator modifies the layout of the wire 20 (step 102 in Figure 4). The image generation of the wire 20 is performed by the layout modification means 42 according to the image generation program 32 based on the object data 34 in Figure 1.

[0038] Figure 8 shows a state where the finger 12 points to the modification point of the wire 20. A beam 22 is emitted from the tip of the finger 12 facing the wire 20, and the beam 22 reaches the wire 20. By the operator's selection operation, a mark 24 is attached to the intersection of the wire 20 and the beam 22.

[0039] Figure 9 shows a state where finger 12 points to a new destination of mark 24. The tip 22a of beam 22 becomes the new destination of mark 23. From this state, by a selection operation, mark 24 moves to the new destination. Figure 10 shows a state where mark 24 has moved to the new destination. Along with the movement of mark 24, wire 20 is curved.

[0040] Figure 11 shows a state where the second correction point of wire 20 is pointed at by finger 12. Since the subsequent operations are the same as those in the case of the first correction, only the key points will be described. A new mark 25 is attached to the intersection of wire 20 and beam 22. Figure 12 shows a state where mark 25 has moved to the new destination. Along with the movement of mark 25, a second curved portion is formed in wire 20.

[0041] Figure 13 shows a state where the layout correction of wire 20 has been completed once. If the operator determines that the layout of wire 20 in Figure 13 is still not appropriate (step 103 in Figure 4), the above operations are repeated to re-correct the layout of wire 20. On the contrary, if the operator determines that the layout is appropriate in the state of wire 20 in Figure 13 (step 103 in Figure 4), the layout correction for wire 20 is completed by a confirmation operation.

[0042] Figures 5 to 13 show only electrical components 30 and 32 for the sake of illustration, but there are many connection points by wires in the distribution board. Therefore, usually, once the layout design of the first wire 20 is completed, the layout design for the next wire is proceeded with. That is, if there are other wires to be the object of the layout design (step 104 in Figure 4), the layout design is repeated for the new other wires (steps 100 to 102 in Figure 4). Once the layout design for all wires is completed, the design data such as the length of each wire is output to output means 5 (Figure 1).

[0043] The above embodiments are merely examples, and the following configurations may also be adopted. In the above embodiments, marks 23 to 25 are attached to the intersection of the wire 20 and the beam 22, so that the layout correction work is facilitated using the marks as a guide. However, a configuration in which the attachment of the marks is omitted may also be adopted. Similarly, the layout correction work is facilitated by the beam 22 being emitted from the finger 12. However, a configuration in which the generation of the beam 22 is omitted may also be adopted.

[0044] In the above embodiments, as shown in Fig. 3(b), the finger 12 first selects a new destination for the mark 23, and then, as shown in Fig. 3(c), the layout of the wire 20 is corrected. However, a configuration may also be adopted in which the mark 23 is made to follow the change in the position pointed to by the finger 12 as it is, and the layout of the wire 20 is corrected all at once.

[0045] In the examples of Figs. 8 to 13, after attaching the mark 24, the layout of the wire 20 is corrected, and after attaching a new mark 25, the layout of the wire 20 is corrected again. However, a configuration may also be adopted in which, after attaching the marks 24 and 25, the destinations of the marks 24 and 25 are selected respectively, and then the layout of the wire 20 is corrected all at once.

[0046] Also, in the examples of Figs. 8 to 13, both ends of the wire 20 are fixed. However, a configuration may also be adopted in which one end is a free end, and the wire 20 is expanded and contracted starting from the intersection of the wire 20 and the beam 22. Furthermore, a configuration may also be adopted in which both ends of the wire 20 are free ends, and the wire 20 is moved starting from the intersection of the wire 20 and the beam 22. In this case, an image of the wire 20 before the movement may be left, and a new wire 20 may be copied.

[0047] As described above, one embodiment of the present invention has been explained. However, the layout correction of the member according to the present invention is to correct the layout by moving the member around with the intersection of the extension line of the operator's finger and the member as the starting point of the layout correction. Therefore, when correcting the layout of the member, it is not necessary to directly grasp the member with the fingers, and the operator does not need to move close to the member. Therefore, regardless of the position of the member, the operator can correct the layout of the member while remaining in the same position.

[0048] For example, when the target movement destination of the member is in the depth of the virtual space, in the conventional design support device, the operator needs to approach the depth in order to grasp the member, and moreover, there are many structures that interfere with the fingers between the operator and the depth. Also, when the target movement destination of the member is at a high place such as the ceiling of the virtual space, in the conventional design support device, the operator needs to stand on a stepladder or the like. On the other hand, in the present invention, since it is not necessary to directly grasp the member with the fingers, the layout correction becomes easy even if the target movement destination of the member is in the depth of the virtual space or at a high place.

[0049] Also, as described above, according to the present invention, since the operator does not need to approach the member, the present invention is also useful for an operator with a physical disability. Furthermore, since the present invention corrects the layout of the member with the intersection of the extension line of the operator's finger and the member as the starting point of the layout correction, as in the operation examples of FIGS. 5 to 13, the operation with one hand becomes possible.

Explanation of Signs

[0050] 1 Design system 2 Input means 3 Storage means 4 Control means 5 Output means 6 Virtual space display means 7 Hand tracking means 10 Operator 11 Hand (image) 12 Finger (image) 20 Wire (member) 23, 24, 25 Mark 30 Virtual space 31 Virtual space generation program 32 Image generation program 33 3D data 41 Virtual space generation means 42 Layout correction means 43 Hand image generation means 44 Calculation means 61 Head-mounted display

Claims

1. A component layout design system for designing a layout of components in a virtual space, comprising: a storage means storing a virtual space generation program for generating the virtual space and an image generation program for generating an image of the member and an image of an operator's finger in the virtual space; a virtual space display means for displaying the virtual space; A hand tracking means for detecting the movement of the operator's fingers; a control means for performing control in accordance with the virtual space generation program and the image generation program, The control means a layout correction means for correcting a layout of the members based on detection information from the hand tracking means, and generating an image of the members reflecting the change in the layout of the members according to the image generation program; a hand image generating means for generating an image of the operator's hand or fingers that changes from moment to moment in accordance with the image generating program based on the detection information from the hand tracking means, The layout correction means is configured to use the intersection point between an extension line of the operator's finger image in the image of the hand and the component separated from the finger image as the starting point for layout correction, and to move the starting point to a new destination detected by the hand tracking means, thereby expanding or contracting the component, thereby pulling around the component and correcting the layout of the component.

2. 2. The member layout design system according to claim 1, wherein the intersections are marked.

3. A component layout design method for designing a layout of components in a virtual space, comprising: A virtual space generation program for generating the virtual space; an image generation program for generating an image of the member and an image of an operator's finger in the virtual space; a virtual space display means for displaying the virtual space; A hand tracking means for detecting the movement of the operator's fingers; using a control means for performing control in accordance with the virtual space generation program and the image generation program; The control means a layout correction means for correcting a layout of the members based on detection information from the hand tracking means, and generating an image of the members reflecting the change in the layout of the members according to the image generation program; a hand image generating means for generating an image of the operator's hand or fingers that changes from moment to moment in accordance with the image generating program based on the detection information from the hand tracking means, a layout modification means for modifying the layout of a component by moving an intersection point between an extension line of an image of the operator's finger in the image of the hand and the component separated from the finger image, the intersection point being a starting point for the layout modification to a new destination detected by the hand tracking means, thereby expanding or contracting the component, thereby drawing around the component and modifying the layout of the component.

4. 4. The member layout design method according to claim 3, further comprising the step of marking the intersections.

Images