Display device, display control method, and display control program
The display device addresses the challenge of clearly indicating installation positions by overlaying virtual objects with perpendicular lines or surfaces, allowing operators to accurately recognize the installation position and improve work efficiency.
Patent Information
- Application Number
- JP2024045612
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-03-21
- Publication Date
- 2025-03-18
- Estimated Expiration
- 2044-03-21
AI Technical Summary
Existing display devices struggle to clearly indicate the installation position in real space, leading to difficulties for operators in understanding the difference between auxiliary images and actual installation locations.
A display device that overlays virtual objects in real space, using a display control unit to show the installation position with lines or surfaces perpendicular to the construction surface, allowing for accurate recognition of the installation position.
The solution enables operators to accurately recognize the installation position, even if there is a deviation between the recognized construction surface and the actual surface, improving work efficiency and reducing errors.
Smart Images

Figure 0007647968000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display device that displays virtual objects in an overlay manner in accordance with positions in the real space, either in the field of view of a worker viewing the real space or in an image representing the real space. [Background technology]
[0002] Conventionally, in construction work, a method has been proposed in which information required for the work is displayed superimposed on the real space on a display device such as smart glasses worn by a worker while the work is being performed. For example, Patent Document 1 discloses a projection device that scans the real space, recognizes the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-163466 A Summary of the Invention [Problem to be solved by the invention]
[0004] Using the above technology, it is possible to overlay an image showing the construction position on the real space of the construction work target. Here, when the construction position is a point, the image showing the construction position may be displayed as an auxiliary image in an area different from the actual construction position in order to improve visibility. In this case, there is a problem that it becomes difficult for the worker to distinguish between the auxiliary image and the actual construction position.
[0005] An object of one aspect of the present invention is to provide a display device that allows a worker to clearly recognize a construction position. [Means for solving the problem]
[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing the real space as the target of construction work, or on an image representing the real space, and is equipped with a display control unit that displays, as the virtual object, a construction position image indicating a construction position on a construction surface existing in the real space, and the display control unit is configured to display, as the construction position image, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface.
[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space as a construction work target, or on an image representing the real space, and has a display control step of displaying, as the virtual object, a construction position image showing the construction position of an object to be mounted on a construction surface existing in the real space, and in the display control step, displays, as the construction position image, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface.
[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program of the display device that realizes the display device on a computer by causing the computer to operate as each part (software element) of the display device, and the computer-readable recording medium on which it is recorded, also fall within the scope of the present invention. Effect of the Invention
[0009] According to the present invention, even if there is a discrepancy between the position of the construction surface recognized on the display device and the position of the actual construction surface, which is the actual construction surface in real space, the worker can be made to recognize that construction should be performed at the intersection of the line or plane perpendicular to the construction surface and the actual construction surface. In addition, since the worker can recognize whether he is viewing the construction surface from a direction perpendicular to the construction surface based on the appearance of the image of the perpendicular line or plane, even if the line or plane does not intersect with the actual construction surface, the worker can be made to accurately recognize the construction position on the actual construction surface. [Brief description of the drawings]
[0010] [Figure 1] FIG. 11 is a perspective view showing an example of a display of a virtual object. [Diagram 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram showing a state in which smart glasses 1 according to the present embodiment are attached to a safety helmet 11. [Figure 4] 1 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Diagram 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] FIG. 13 is a diagram illustrating a modified example of the display of a virtual object. [Figure 7] FIG. 13 is a diagram illustrating another modified example of the display of a virtual object. [Figure 8] 2 is a flowchart showing a process flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, one embodiment of the present invention will be described in detail.
[0012] (Overview of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is constructing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.
[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and can also view the projected image in the real space. That is, the smart glasses 1 overlay and display a virtual object as construction reference information related to elevator construction in a position corresponding to the position in the real space in the field of view of a worker who views the real space including the elevator landing and elevator shaft. Note that, in this embodiment, elevator construction work is assumed, but the present invention is not limited thereto, and can be applied to any construction work as long as the construction work is to attach an object to be attached to a predetermined position in the real space.
[0014] FIG. 1 shows an example of a state in which virtual objects OB1 to OB8 are overlaid and displayed in real space. As shown in the figure, the virtual objects OB1 to OB8 are displayed in a space separated by a predetermined distance from a wall surface 300 in real space. This allows the worker to confirm the position in three-dimensional space where construction work should be performed in real space. This eliminates the need to measure and confirm the position where construction work should be performed in real space with a tape measure, thereby improving workability. The virtual objects OB1 to OB8 will be described in detail later.
[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of an external real space captured by a camera and an image of a virtual object may be used. In addition, instead of a head-mounted display, a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or by wire may be used as the display device according to the present invention.
[0016] The virtual object as the construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. The CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling). In BIM, various information such as the quantity, part number, dimensions, material, performance, and price of each part are included as object information in the 3D model, so at least one of these pieces of information may be displayed as the construction reference information.
[0017] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, a warning control unit 24, and a spatial distance measurement unit 25.
[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to the construction of the elevator. The projection unit 3 projects an image onto the half mirror, thereby allowing the worker, who is the wearer of the smart glasses 1, to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different from each other, thereby allowing the virtual object to be displayed as if it is three-dimensionally arranged at a predetermined position in the real space. This allows the worker to recognize the construction position as a three-dimensional position in the real space.
[0019] The display control unit 21 reads out the construction reference information including the three-dimensional CAD data or the two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or the two-dimensional CAD data also includes information indicating the positional relationship with an object existing in the real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in the real space recognized by the position recognition unit 22.
[0020] The display control unit 21 controls the display of an image having at least one of a line and a surface that is perpendicular to the construction surface and that includes the construction position as the construction position image. The display control will be described in detail later.
[0021] The display control unit 21 may acquire the construction reference information from the outside via the communication unit 6. The communication unit 6 may communicate with a PC or a server in a local network via a wireless LAN, for example, or with an external server via the Internet. This makes it possible to update the data stored in the storage unit 5 and acquire new data.
[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of the markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. In addition, the position recognition unit 22 is capable of position recognition with 6DoF (Degree of Freedom). As a result, once the worker has had the position recognized by the position recognition unit 22 using the markers M1 and M2, the worker can view the virtual object while maintaining its relative positional relationship with the real space even if the worker subsequently changes or moves the viewing direction.
[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, an image as an input interface is displayed in real space as a virtual object by the display control unit 21, and an instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.
[0024] Also, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker by performing voice recognition, thereby accepting the instruction input from the worker.
[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted by an input by a worker to the input device.
[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of the warning method include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and the like.
[0027] The warning condition may be that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued at the timing when the possibility of the worker falling into the elevator shaft increases, thereby further improving the safety of the worker.
[0028] At least one of the functions of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.
[0029] The spatial distance measuring unit 25 recognizes the distance to an object existing in the real space by using a distance sensor such as LiDAR (Light Detection And Ranging) and recognizes the actual shape of the real space. This enables processing such as changing the display mode according to the relationship between the display position of the virtual object as the construction reference information and the position of the actual object in the real space. For example, as will be described later in detail, the spatial distance measuring unit 25 measures the construction actual surface, which is the actual construction surface in the real space, and the display control unit 21 changes the display mode of the virtual object based on the measurement result. Note that the spatial distance measuring unit 25 is not essential, and a configuration may be adopted in which the distance to an object existing in the real space is recognized by an external spatial distance measuring device and the information is acquired via the communication unit 6.
[0030] (Example of real space where elevators are installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed at a stage in the middle of building construction. In this state, an opening 101 exists between the hall 200 and the hoistway 102 as an entrance for the elevator. The hall 200 has a floor surface 201 and a wall surface 202.
[0031] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is formed of a rectangular planar member, and a predetermined pattern is formed on the surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 in the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.
[0032] In this embodiment, two markers are provided for each platform, but the present invention is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but two markers are sufficient for position recognition.
[0033] In addition, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but this is not limited thereto, and the markers M1 and M2 may be provided on the wall surface 202. In addition, in this embodiment, the markers M1 and M2 are provided on the landing 200, but the markers may be provided in the hoistway 102.
[0034] The markers M1 and M2 are placed at predetermined positions on the floor surface 201, which are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of the markers M1 and M2 require high precision in order to accurately match the positions in real space with the display positions of the virtual objects, so it is preferable that they are set based on a predetermined position reference object whose placement position in real space is highly accurate. An example of the position reference object is a piano wire 103 installed in the elevator shaft 102.
[0035] FIG. 5 is a perspective view showing the outline of the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103·103 are hung from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103·103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using this piano wire as a position reference, it is possible to maintain high accuracy in the installation positions of the markers M1·M2. Note that the present invention is not limited to piano wires, and any strong wire member with a sufficiently thin diameter may be used.
[0036] Also, for example, a laser beam may be used as the position reference object. That is, by irradiating the laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, the laser beam can be positioned at a fixed position similar to piano wire. However, in the case of laser beam, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that the influence of errors due to the thickness of the beam may occur depending on the height of the building.
[0037] (Virtual object details) Next, virtual objects OB1 to OB8 shown in Fig. 1 will be described. Virtual objects OB1 to OB7 are construction position images showing construction positions on a construction surface existing in real space. Virtual object OB1 shows the construction position as a point, and is displayed as an intersection of a line segment shown by virtual object OB2, a line segment shown by virtual object OB5, and a line segment shown by virtual object OB6.
[0038] The virtual object OB2 is an image of a line segment that includes the construction position and is perpendicular to the construction surface. This allows the worker to recognize that construction should be performed at the intersection of the line or surface perpendicular to the construction surface and the actual construction surface, even if there is a deviation between the position of the construction surface recognized in the data of the construction reference information and the position of the actual construction surface that is the actual construction surface in real space. In addition, since the worker can recognize whether he is viewing from a direction perpendicular to the construction surface by the appearance of the image of the perpendicular line segment, even if the line does not intersect with the actual construction surface, the worker can accurately recognize the construction position on the actual construction surface. Note that the virtual objects OB1 to OB8 are displayed on the premise that the position of the construction surface recognized in the data of the construction reference information and the position of the actual construction surface match. However, there are cases where the construction surface and the actual construction surface are misaligned due to errors due to actual construction, and FIG. 1 and FIG. 6 described later show an example in which the actual construction surface is misaligned to the back side.
[0039] The virtual object OB5 is an image of a line segment that includes the construction position and is parallel to the construction surface in the horizontal direction. The virtual object OB6 is an image of a line segment that includes the construction position and is parallel to the construction surface in the vertical direction. In other words, the construction position is indicated by the intersection of the three line segments of the virtual objects OB2, OB5, and OB6, so that the worker can accurately recognize the position of the construction position in the three-dimensional space.
[0040] The construction position may be displayed by a plane including the construction position and perpendicular to the construction surface. That is, for example, a plane including virtual object OB5 and perpendicular to the construction surface, a plane including virtual object OB6 and perpendicular to the construction surface, and the construction surface may be displayed as virtual objects. Even in this case, the worker can accurately recognize the position of the construction position in the three-dimensional space. However, since the number of virtual objects of the plane image increases, there may be cases where the visibility of the configuration of the real space decreases. Therefore, in order to improve visibility, it is preferable to display the construction position by a line image.
[0041] The line segment as the virtual object OB2 is displayed in front of the actual construction surface, which is the actual construction surface in real space, and the virtual object OB4 as a point on the actual construction surface is one end of the line segment of the virtual object OB2. Also, a line segment as the virtual object OB3 is displayed on the extension line of the line segment as the virtual object OB2, behind the actual construction surface. The actual construction surface is detected by the spatial distance measuring unit 25, and the display mode of the virtual object OB2 and the virtual object OB3 is changed before and after the virtual object OB4, which is the point where the line including the construction position and perpendicular to the construction surface intersects with the actual construction surface.
[0042] The line segment as the virtual object OB2 and the line segment as the virtual object OB3 are displayed in a manner in which at least one of the color, pattern, and density is different. This allows the worker to recognize whether the virtual object OB2 is on the near side or the far side of the actual construction surface. This allows the worker to easily recognize the actual construction position. Note that the virtual object OB2 may be displayed so as to be interrupted at the position where it intersects with the actual construction surface, without displaying the virtual object OB3.
[0043] The virtual object OB7 is a circular image on the construction surface with the construction position at its center. This circular image can improve the visibility of the construction position in the three-dimensional space. In addition, the worker can easily and intuitively recognize that the center of the circle is the construction position.
[0044] In addition, by making the virtual object OB7 similar in shape to the shape of a component that exists on the actual construction surface, it is possible to make it easier for the worker to recognize the correspondence between the actual appearance of the real space and the appearance of the virtual object.
[0045] The virtual object OB8 is an image that displays text information related to construction. In the example shown in Fig. 1, a text image of "M10" is displayed, which indicates the nominal diameter of the anchor bolt to be constructed. The text information related to construction is not limited to this, and may also display the product name, product code, various sizes, and points to note during construction of the construction parts.
[0046] It is preferable that the virtual object OB8 is displayed a predetermined distance in front of the construction surface, thereby preventing a decrease in visibility due to the text information being displayed on the other side of the actual construction surface.
[0047] (Modification of Virtual Object Display) FIG. 6 shows a modified example of the display of a virtual object. In the example shown in 601, the virtual object OB7 is a horizontally elongated image consisting of an outline of a shape in which a pair of opposing sides are connected to a semicircular shape with respect to a rectangular shape. This horizontally elongated image is assumed to have a shape similar to that of a member existing on the actual construction surface, and as described above, it is possible to make the worker easily recognize the correspondence between the actual appearance of the real space and the appearance of the virtual object. In addition, when an allowable deviation range of the construction position is set in the horizontal direction, such a display allows the worker to recognize the range and direction in which the deviation of the construction position is allowed. Note that, in the example shown in 601, the horizontally elongated image is long in the horizontal direction, but is not limited thereto, and may be, for example, a vertically elongated image long in the vertical direction.
[0048] In the example shown in 602, a virtual object OB1 is displayed as a point image indicating a construction position. Also, no image is displayed in a predetermined area around the point image as the virtual object OB1. Specifically, the virtual objects OB2, OB5, and OB6 do not display line segment images within a predetermined distance from the point image indicating the construction position. This can improve the visibility of the area where the actual construction work should be performed.
[0049] In addition, since the virtual objects OB2, OB5, and OB6 are displayed at positions that are more than a predetermined distance away from the point image indicating the construction position, it is possible to make the worker easily recognize the point image indicating the construction position. Furthermore, since a circular image is also displayed as the virtual object OB7, it is possible to improve the visibility of the construction position in the three-dimensional space even if the construction position is displayed as a point image that is difficult to recognize. In addition, it is possible to make the worker easily recognize intuitively that the center of the circle is the construction position. In the example shown in 602, the virtual object OB2 is displayed in a broken state in a predetermined area around the point image as the virtual object OB1, but it may be displayed as a line segment that passes through the virtual object OB1 without being broken. In this case, even if the actual construction surface exists inside the predetermined area around the point image as the virtual object OB1, it is possible to clearly indicate the point (virtual object OB4) where the actual construction surface, which is the actual construction position, and the virtual object OB2 intersect. 7 shows another modified example of the display of a virtual object. In this example, a construction target is displayed with a rectangular outline shown by virtual object OB9, and a hole shown by virtual object OB7 is formed inside. The virtual object OB7 is a horizontally elongated image with an outline of a shape in which a pair of opposing sides are connected to a semicircular shape, in contrast to the rectangular shape. A virtual object OB1 is displayed as a construction position at the vertices of the semicircular shape at both ends of the virtual object OB7. That is, in the case of a construction target having a shape like this example, construction is performed so that the positions indicated by the virtual object OB1, which are both ends of a hole formed inside, are installed at predetermined positions. Also, as in FIG. 1 and FIG. 6, virtual objects OB2 and OB3 are displayed as line segments including the construction position and perpendicular to the construction surface, and a virtual object OB4 is displayed as a point where the virtual object OB2 and OB3 intersect with the construction actual surface. In the example shown in FIG. 7, the virtual object OB7 is a horizontally elongated image, but is not limited to this, and may be, for example, a vertically elongated image.
[0050] (Elevator installation method process flow) Next, a process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 8. When elevator installation is started, first, in step 1 (hereinafter referred to as S1), markers M1 and M2 are installed at predetermined positions in the hall 200. At this time, as described above, the markers M1 and M2 are installed with reference to a position reference object such as the piano wire 103.
[0051] Next, in S2, the worker wears the smart glasses 1, captures an image of the marker by the imaging unit 4, and causes the position recognition unit 22 to perform position recognition processing. After the position recognition is performed, in S3, the display control unit 21 performs an overlay display of the virtual object. Once the worker has caused the position recognition unit 22 to recognize the position by the markers M1 and M2, the worker can visually recognize the virtual object while maintaining its relative positional relationship with the real space even if the worker subsequently changes the viewing direction or moves. In this state, in S4, the worker performs the construction work while checking the construction reference information overlaid and displayed by the display control unit 21. Note that the construction work includes not only the actual construction work but also the check work after the construction work is performed. Then, in S5, the end of the construction work is confirmed, and if the result of S5 is No, i.e., the construction work is continuing, the processing from S3 is repeated, and if the result of S5 is Yes, i.e., the construction work is completed, the processing is terminated.
[0052] The above construction method and smart glasses 1 enable efficient construction of elevators. Such effects also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, for example, "Support the development of sustainable and resilient buildings using locally sourced materials in least developed countries, including through financial and technical assistance."
[0053] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 2).
[0054] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program to realize each function described in each of the above embodiments.
[0055] The program may be non-transitory and may be recorded in one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be provided to the device via any wired or wireless transmission medium.
[0056] In addition, some or all of the functions of each of the control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks can be realized by, for example, a quantum computer.
[0057] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may be executed by the control device or another device (for example, an edge computer or a cloud server).
[0058] (summary) The display device according to aspect 1 of the present invention is a display device that overlays a virtual object on the field of view of a worker viewing a real space as a construction work target, or on an image representing the real space, in an arrangement corresponding to a position in the real space, and is equipped with a display control unit that displays, as the virtual object, a construction position image indicating a construction position on a construction surface existing in the real space, and is configured to display, as the construction position image, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface.
[0059] According to the above configuration, an image having at least one of a line and a surface perpendicular to the construction surface including the construction position is displayed. This allows the worker to recognize that construction should be performed at the intersection of the line or surface perpendicular to the construction surface and the actual construction surface, even if there is a discrepancy between the position of the construction surface recognized by the display device and the position of the actual construction surface, which is the actual construction surface in real space. In addition, the worker can recognize whether he is viewing from a direction perpendicular to the construction surface based on the appearance of the image of the perpendicular line or surface, so that even if the line or surface does not intersect with the actual construction surface, the worker can accurately recognize the construction position on the actual construction surface.
[0060] A display device according to aspect 2 of the present invention may be configured in such a way that, in the above-mentioned aspect 1, the display control unit changes at least one of the color, pattern, and density between a portion displayed in front of the actual construction surface, which is the actual construction surface in real space, and a portion displayed on the other side of the actual construction surface, in an image of at least one of the lines and surfaces perpendicular to the construction surface.
[0061] According to the above configuration, the display mode of the construction position image allows the worker to recognize whether the construction position is on the near side or the far side of the actual construction surface. Therefore, the worker can easily recognize the actual construction position.
[0062] A display device according to a third aspect of the present invention may be configured in the above-mentioned first aspect such that the display control unit displays text information relating to the construction a predetermined distance in front of the construction surface.
[0063] According to the above configuration, the text information relating to the construction is displayed in front of the construction surface, so that it is possible to prevent a decrease in visibility caused by the text information being displayed behind the actual construction surface.
[0064] A display device according to aspect 4 of the present invention may be configured in accordance with aspect 1 above, such that the display control unit displays the construction position as a point image on the construction surface, while not displaying an image in a specified area around the point image.
[0065] According to the above configuration, the construction position is displayed as a dot image on the construction surface, and no image is displayed around it, thereby improving the visibility of the area where construction work should actually be performed.
[0066] A display control method according to aspect 5 of the present invention is a display control method for overlaying a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space as a construction work target, or on an image representing the real space, and includes a display control step of displaying, as the virtual object, a construction position image showing the construction position of an object to be mounted on a construction surface existing in the real space, and in the display control step, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface is displayed as the construction position image.
[0067] A display control program according to a sixth aspect of the present invention is a display control program for causing a computer to function as the display device in the first aspect, and causes the computer to function as the display control unit.
[0068] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]
[0069] 1. Smart glasses (display device) 2. Control section 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 25 Spatial ranging section 101 Opening 102 Hoistway 103 Piano wire 200 platform 201 Floor 202, 300 Wall M1 / M2 Markers OB1~OB9 Virtual Objects
Claims
1. A display device that displays a virtual object in an overlay manner in accordance with a position in a real space in a field of view of a worker viewing the real space as a construction work target or an image representing the real space, A display control unit is provided for displaying a construction position image indicating a construction position on a construction surface existing in the real space as the virtual object as information to be referred to during construction work, the construction position being a position in a three-dimensional space where construction work should be performed; The display control unit displays, as the construction position image, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface.
2. The display device described in claim 1, wherein the display control unit changes at least one of the color, pattern, and density between a portion displayed in front of the actual construction surface, which is the actual construction surface in real space, and a portion displayed on the other side of the actual construction surface, in an image of at least one of the lines and surfaces perpendicular to the construction surface.
3. The display device according to claim 1 , wherein the display control unit displays text information relating to the construction a predetermined distance in front of the construction surface.
4. The display device according to claim 1 , wherein the display control unit displays the construction position as a point image on the construction surface, and does not display an image in a predetermined area around the point image.
5. A display control method for overlaying a virtual object on a field of view of a worker viewing a real space as a construction work target or on an image representing the real space in an arrangement according to a position in the real space, comprising: A display control step of displaying a construction position image showing a construction position, which is a construction position of a mounting object on a construction surface existing in the real space and is a position in a three-dimensional space where construction work should be performed, as the virtual object as information to be referred to during construction work, A display control method, in which, in the display control step, an image having at least one of a line and a surface that includes the construction position and is perpendicular to the construction surface is displayed as the construction position image.
6. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing a computer to function as the display control unit.
Citation Information
Patent Citations
Drawing projection system, drawing projection method and program
JP2018163466A
Business management support device, business management support system, business management support method, and business management support program
JP2022155553A
Apparatus for Embodying Virtual Reality and Automatic Plan System of Electrical Wiring
KR1020200069009A