Display device, display control method and display control program

Abstract

To provide a display device capable of making an operator clearly recognize a tolerance limit in installing an attachment object, in an operation of installing the attachment object.SOLUTION: A display device includes a display control part (21) configured to display an image showing an installation location of an attachment object as a virtual object. The display control part (21) displays a first image (OB1) indicating a standard installation location of the attachment object as well as displays a second image (OB2, OB3) indicating a tolerance limit of the installation location of the attachment object.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display device that displays virtual objects in an overlaid manner in accordance with positions in real space, either in the field of view of a worker viewing real space or on an image representing real space. [Background technology]

[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]

[0004] Using the above technology, it is conceivable to overlay an image showing the installation position of the object onto the real space where the work is being performed. Here, if a tolerance range is set for the installation position, the tolerance range can be displayed as text information. However, when using text information, it is not easy for the worker to recognize the extent of the range in real space.

[0005] An object of one aspect of the present invention is to provide a display device that allows a worker to easily recognize the allowable range for installation of an object to be attached during installation work of the object to be attached. [Means for solving the problem]

[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays a virtual object in an arrangement corresponding to a position in the real space onto the field of view of a worker viewing the real space or onto an image representing the real space, and is equipped with a display control unit that displays an image indicating the installation position of an attachment object as the virtual object, and the display control unit is configured to display a first image indicating the standard installation position of the attachment object and a second image indicating the allowable range of the installation position of the attachment object.

[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing the real space or on an image representing the real space, and has a display control step that displays an image indicating the installation position of an attachment object as the virtual object, and in the display control step, displays a first image indicating the standard installation position of the attachment object and a second image indicating the allowable range of the installation position of the attachment object.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program for the display device that causes the computer to operate as each part (software element) of the display device to realize the display device, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0009] According to the present invention, the worker can install the object by checking the standard installation position and the allowable range, and comparing the displayed allowable range with the actual surrounding situation. Furthermore, compared to when the allowable range is shown as a numerical value, the worker can check the allowable range in real space, which has the effect of improving workability. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 is a perspective view showing an example of display of a virtual object. [Figure 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 3] FIG. 1 is a diagram showing a state in which smart glasses 1 according to this embodiment are attached to a safety helmet 11. [Figure 4] FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] FIG. 10 is a diagram illustrating a modified example of displaying a virtual object. [Figure 7] FIG. 10 is a diagram illustrating another modified example of displaying a virtual object. [Figure 8] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.

[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and can also view the projected image within the real space. That is, the smart glasses 1 overlay a virtual object as construction reference information related to elevator construction in a position corresponding to the position in the real space in the field of view of a worker viewing the real space including the elevator landing and hoistway. Note that while this embodiment is intended for elevator construction work, it is not limited thereto and can be applied to any construction work as long as the construction work involves installing an object to be installed at a predetermined position in real space.

[0014] FIG. 1 shows an example of a state in which virtual objects OB1 to OB4 are overlaid and displayed in real space. As shown in the figure, virtual objects OB1 to OB4 are displayed in a space a predetermined distance away from a wall surface 300 in real space. This allows the worker to confirm in real space the position in three-dimensional space where construction work should be performed. This eliminates the need for tasks such as measuring and confirming the position where construction work should be performed in real space, thereby improving workability. Details of the virtual objects OB1 to OB4 will be described later.

[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information.

[0017] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, and a warning control unit 24.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.

[0019] The display control unit 21 reads out construction reference information including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.

[0020] The display control unit 21 controls to display a first image showing the standard installation position of the attachment object, and a second image showing the allowable range of the installation position of the attachment object. The first image and the second image will be described in detail later.

[0021] The display control unit 21 may acquire construction reference information from outside via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This makes it possible to update the data stored in the storage unit 5 and acquire new data.

[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured image of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.

[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.

[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.

[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.

[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0029] (Example of a real space where an elevator is installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.

[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0031] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.

[0032] In addition, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but this is not limited thereto, and the markers M1 and M2 may be provided on the wall surface 202. In addition, in this embodiment, the markers M1 and M2 are provided on the landing 200, but the markers may be provided inside the hoistway 102.

[0033] Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.

[0034] FIG. 5 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using these piano wires as positional references, it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.

[0035] Furthermore, a laser beam, for example, may be used as the position reference object. That is, by irradiating a laser beam vertically downward from a predetermined position at the top of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the beam tends to become thicker as the distance from the light source increases, so there is a possibility that the thickness of the beam may cause errors depending on the height of the building.

[0036] (Virtual object details) Next, the virtual objects OB1 to OB4 shown in FIG. 1 will be described. Virtual object OB1 corresponds to a first image showing the standard installation position of the attachment object. The standard installation position is a standard position where the attachment object should be installed, and in principle, it is preferable that the attachment object be installed at this standard installation position. Virtual object OB1 is a planar image showing the outline of a predetermined surface of the attachment object. The predetermined surface of the attachment object corresponds to the surface of the attachment object that is visually recognized by the user, the surface that is operated by the user, and the surface from which sound is output when the attachment object is actually installed. For example, when the attachment object is ultimately installed on a wall, the surface exposed from the wall surface becomes the predetermined surface of the attachment object.

[0037] The virtual object OB1 may display an image showing the outline shape of a predetermined surface of the object to be attached, as well as an image showing the components, design, and construction work location present on that predetermined surface. This allows the worker to more easily understand the correspondence between the image displayed as the virtual object OB1 and the actual object to be attached. Furthermore, if the construction work location is displayed, it becomes possible to perform construction work based on the display of the virtual object OB1.

[0038] The first image showing the standard installation position is not limited to the above-described planar image, but may be a three-dimensional image showing the outline of the three-dimensional shape of the object to be attached. In this case, not only the predetermined surface of the object to be attached but also the shape in the depth direction is displayed, so the overall installation position of the object to be attached can be presented to the worker in a more easily understandable manner. On the other hand, if the shape in the depth direction is also displayed, the display of the virtual object in the real space may become excessive, which may worsen the visibility of the real space. Furthermore, in many cases, if the worker can recognize the installation position of the predetermined surface of the object to be attached, the installation work can be performed satisfactorily. Therefore, it is preferable to display a planar image showing the outline of the predetermined surface of the object to be attached as the virtual object OB1.

[0039] The virtual object OB2 corresponds to a second image showing the allowable range of the installation position of the attachment target, and is a planar image showing the allowable range as a rectangle. More specifically, the virtual object OB2 shows the allowable range as a location where a predetermined surface of the attachment target is to be placed as a rectangle. In other words, the planar image showing the standard installation position shown by the virtual object OB1 is included inside the rectangle shown by the virtual object OB2.

[0040] It is preferable that the virtual objects OB2 and OB1 be displayed in different ways so that the worker can distinguish them visually. Examples of the display manner include color, line thickness, line type (solid line, dashed line, dot-dash line, etc.).

[0041] By displaying this information, the worker can install the object while checking the standard installation position and the allowable range and comparing the displayed allowable range with the actual surrounding situation. Furthermore, compared to when the allowable range is displayed numerically, the worker can check the allowable range in real space, which improves workability.

[0042] The virtual object OB2 is not limited to the above-described planar image, but may be a three-dimensional image indicating an allowable range taking into account the overall three-dimensional shape of the mounting target. In this case, the allowable range is displayed three-dimensionally, taking into account not only the predetermined surface of the mounting target but also the shape in the depth direction. This makes it easier for the worker to understand the allowable range for the overall installation position of the mounting target. On the other hand, if the shape in the depth direction is also displayed, the virtual object may be displayed excessively in real space, potentially reducing the visibility of the real space. Furthermore, in many cases, the installation work can be performed satisfactorily if the worker can recognize the installation position of the predetermined surface of the mounting target. Therefore, it is preferable to display a planar image indicating the allowable range for the location where the predetermined surface of the mounting target is to be placed as the virtual object OB2.

[0043] 1, the virtual object OB2 is displayed as a rectangle, but it does not have to be a perfect rectangle as long as it is an image showing a rectangular area. For example, it may be displayed in a manner such that the middle of the sides of the rectangle are not displayed.

[0044] The virtual object OB3 corresponds to a second image showing the allowable range of the installation position of the attachment object, and is a planar image showing with arrows the allowable direction in which the installation position is allowed to deviate from the standard installation position and the allowable distance range in that direction. In the example shown in FIG. 1, since the installation position of the attachment object may deviate within a predetermined range in the left-right direction (horizontal direction) from the standard installation position, arrows are displayed at both ends of a line segment arranged in the left-right direction (horizontal direction). Furthermore, the length of the arrow, i.e., the length of the line segment with arrows drawn at both ends, represents the allowable distance range. Note that the allowable range may be set only in one direction (for example, only to the right) with respect to the standard installation position. In this case, virtual object OB1 is displayed at one end (for example, the left end) of virtual object OB2. For virtual object OB3, an arrow is drawn starting from virtual object OB1 and pointing toward the other end of virtual object OB2. That is, the tip of the arrow is drawn only on the other end side of virtual object OB3.

[0045] By displaying the virtual object OB2 in this manner, the worker can easily recognize the direction and range of the allowable deviation of the installation position from the standard installation position. Furthermore, since the allowable direction of deviation of the installation position is clearly indicated, the worker can intuitively recognize that deviation in any direction other than the allowable direction is not permitted. In the example shown in FIG. 1, both the virtual object OB2 and the virtual object OB3 are displayed, which allows the worker to more easily and accurately recognize the allowable range of the installation position of the object to be attached.

[0046] The position where the image of the arrow as virtual object OB3 is displayed may be any position within a plane that is an allowable range for the location of a predetermined surface of the attachment target. For example, the image may be displayed near the center of the length in the direction perpendicular to the allowable direction in a rectangle that is an allowable range for the location of a predetermined surface of the attachment target. Furthermore, if other images or characters are displayed near this center, the image of the arrow may be shifted to a position where those images or characters are not displayed.

[0047] Furthermore, multiple arrow images may be displayed in the depth direction based on the approximate three-dimensional shape of the attachment target, rather than just within a plane as the allowable range for the placement of the specified surface of the attachment target. In this case, the allowable range is displayed three-dimensionally, taking into account not only the specified surface of the attachment target but also its shape in the depth direction, making it easier for the worker to understand the allowable range for the overall installation position of the attachment target. On the other hand, displaying multiple arrow images in the depth direction may result in excessive display of virtual objects in real space, potentially reducing visibility of the real space. Furthermore, in many cases, the worker can perform the installation work satisfactorily if he or she can recognize the installation position of the specified surface of the attachment target. Therefore, it is preferable to display the virtual object OB3 within a plane as the allowable range for the placement of the specified surface of the attachment target.

[0048] The virtual object OB4 is a line image displayed as lines perpendicular to the wall surface 300 from each vertex of the virtual object OB2, which is an image showing a quadrangular region parallel to the wall surface 300 that exists in the real space.

[0049] 1, virtual object OB2 is displayed as a rectangular image parallel to wall surface 300, but is not limited to this and may be displayed as a rectangular image parallel to the floor surface. Also, the wall surface or floor surface may be tilted from the vertical or horizontal direction. Also, virtual object OB2 does not have to be parallel to wall surface 300, and may be a rectangular image tilted with respect to wall surface 300 at a position a predetermined distance away from wall surface 300.

[0050] It is preferable that the display mode of the virtual object OB4 be different from that of the virtual objects OB1 to OB3 so that the worker can distinguish them visually. Examples of the display mode include color, line thickness, line type (solid line, dashed line, dot-dash line, etc.).

[0051] By displaying virtual object OB4 in this manner, even if there is a discrepancy between the position of the rectangular image indicating the allowable range for virtual object OB2 and the position of the object to be attached when actually installing the object, the worker can easily recognize that the object should be installed within the range of the line image displayed on wall surface 300 from each vertex of the rectangular image.

[0052] (Variations of virtual object display) 6 shows a modified example of the display of a virtual object. In the example shown in the figure, a virtual object OB5 is displayed as a second image near the boundary of the allowable range as an image showing the general shape of the attachment object. More specifically, as shown in 601, in a rectangular image as a virtual object OB2 showing the allowable range of the installation position of the attachment object, two OB5 images showing the general shape of the attachment object are displayed so as to be inscribed on two opposing sides (boundaries) in the direction in which positional deviation is allowable. 602 shows a case in which the range in which positional deviation is allowable is narrower than the state shown in 601.

[0053] Moreover, 603 shows a case where the allowable range of positional deviation is even narrower than the state shown in 602. In 603, the allowable range of positional deviation is too small, so the display of virtual object OB5 is omitted. In this way, when the allowable range of the installation position of the attachment target is smaller than a predetermined size, by not displaying virtual object OB5, it is possible to prevent deterioration of visibility due to overlapping displays of virtual objects.

[0054] As described above, by displaying an image showing the general shape of the attachment object near the boundary of the allowable range, the user can easily recognize which attachment object the image showing the allowable range corresponds to.

[0055] The image showing the outline of the mounting object near the boundary of the tolerance range is not limited to the above-described planar image, but may be a three-dimensional image showing the outline of the three-dimensional shape of the mounting object. In this case, not only the predetermined surface of the mounting object but also the shape in the depth direction is displayed, so the overall installation position of the mounting object can be more clearly presented to the worker. On the other hand, if the shape in the depth direction is also displayed, the display of the virtual object in real space may be excessive, which may reduce visibility of the real space. Furthermore, in many cases, if the worker can recognize the installation position of the predetermined surface of the mounting object, the installation work can be performed satisfactorily. Therefore, it is preferable to display a planar image showing the outline of the predetermined surface of the mounting object as virtual object OB5.

[0056] 7 shows another modified example of the display of a virtual object. In the example shown in the figure, two opposing sides (boundaries) of a rectangle that form the allowable range in the direction in which positional deviation is allowable are displayed as a virtual object OB6 in the second image. Also displayed is a virtual object OB3, which is a planar image that indicates with arrows the allowable direction in which deviation of the installation position from the standard installation position is allowable and the allowable distance range in that direction.

[0057] More specifically, as shown in 701, short line segments extending in the direction of the allowable range are displayed on both ends of two opposing sides of the virtual object OB6 in the direction in which the positional deviation is allowed. This allows the worker to recognize the allowable range using only the virtual object OB6. Furthermore, by further displaying an arrow image using the virtual object OB3, the worker can more easily recognize the allowable range.

[0058] 602 shows a case where the range of allowable positional deviation is narrower than that shown in 601. Also, 603 shows a case where the range of allowable positional deviation is even narrower than that shown in 602.

[0059] According to the modification shown in Fig. 7, the image showing the tolerance range can be simplified, thereby improving the visibility of the real environment. Therefore, when there are many installation objects to be displayed, it becomes possible to display more construction reference information.

[0060] The image showing the two opposing sides and the line segments at both ends in the direction of allowable positional deviation is not limited to the planar image described above, but may be a three-dimensional image showing an allowable range taking into account the overall three-dimensional shape of the object to be attached. In this case, the allowable range taking into account not only the predetermined surface of the object to be attached but also the shape in the depth direction is displayed three-dimensionally, making it easier for the worker to understand the allowable range for the overall installation position of the object to be attached. On the other hand, if the shape in the depth direction is also displayed, the virtual object may be displayed excessively in real space, reducing visibility of the real space. Furthermore, in many cases, the worker can perform the installation work satisfactorily if he or she can recognize the installation position of the predetermined surface of the object to be attached. Therefore, it is preferable to display a planar image showing the allowable range for the location of the predetermined surface of the object to be attached as the virtual object OB6.

[0061] (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 8. When elevator installation begins, first, in step 1 (hereinafter referred to as S1), markers M1 and M2 are installed at predetermined positions in the hall 200. At this time, as described above, the markers M1 and M2 are installed using a position reference object such as the piano wire 103 as a reference.

[0062] Next, in S2, the worker wears the smart glasses 1, captures images of the markers using the imaging unit 4, and causes the position recognition unit 22 to perform position recognition processing. Once position recognition is complete, in S3, the display control unit 21 overlays the virtual object. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize their position, the worker can view the virtual object while maintaining its relative positional relationship with the real space, even if they subsequently change their viewing direction or move. In this state, in S4, the worker performs construction work while checking the construction reference information overlaid by the display control unit 21. Note that construction work includes not only the actual construction work but also checks after the construction work has been completed. Then, in S5, the completion of the construction work is confirmed. If S5 returns No, meaning that the construction work is continuing, the processing from S3 is repeated. If S5 returns Yes, meaning that the construction work has been completed, the processing ends.

[0063] The above construction method and smart glasses 1 enable efficient construction of elevators. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."

[0064] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0065] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0066] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0067] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, integrated circuits in which logic circuits functioning as the control blocks are formed are also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0068] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0069] (summary) A display device according to aspect 1 of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space or onto an image representing the real space, in an arrangement that corresponds to a position in the real space, and is equipped with a display control unit that displays an image indicating an installation position of an attachment object as the virtual object, and the display control unit is configured to display a first image indicating a standard installation position of the attachment object and a second image indicating an allowable range of installation positions of the attachment object.

[0070] According to the above configuration, the worker can install the object while checking the standard installation position and the allowable range and comparing the displayed allowable range with the actual surrounding situation. Furthermore, compared to when the allowable range is displayed as a numerical value, the worker can check the allowable range in real space, thereby improving workability. A display device according to aspect 2 of the present invention may be configured such that, in aspect 1 above, the display control unit displays, as the second image, an image of an arrow indicating an allowable direction in which deviation of the installation position from the standard installation position is allowable and an allowable distance range in that direction.

[0071] According to the above configuration, it is possible to easily recognize the direction and range in which the deviation of the installation position from the standard installation position is permissible. A display device according to aspect 3 of the present invention may be configured such that, in aspect 1 above, the display control unit displays, as the second image, an image showing a rectangular area at a position a predetermined distance away from a wall or floor surface existing in the real space, and displays line images perpendicular to the wall or floor surface from each vertex of the image showing the rectangular area.

[0072] According to the above configuration, even if there is a discrepancy between the position of the image showing the rectangular area indicating the tolerance range and the position of the object to be attached when actually installing the object to be attached, the worker can easily recognize that the object should be installed within the range of the line image displayed from each vertex of the image showing the rectangular area to the wall or floor surface. A display device according to a fourth aspect of the present invention may be configured in the first aspect as described above, such that the display control unit displays an image showing an outline of the attachment object as the first image.

[0073] According to the above configuration, the outline of the object to be attached is displayed at the standard installation position, so that the worker can easily recognize the standard installation position. A display device according to aspect 5 of the present invention may be configured in such a way that, in aspect 1 above, the display control unit displays, as the second image, an image showing the general shape of the object to be attached near the boundary of the allowable range.

[0074] According to the above configuration, the outline of the object to be attached is displayed near the boundary of the allowable range, so that the worker can easily recognize the allowable range. A display control method according to aspect 6 of the present invention is a display control method for overlaying a virtual object onto the field of view of a worker viewing a real space or onto an image representing the real space, in an arrangement corresponding to a position in the real space, and includes a display control step for displaying an image indicating an installation position of an attachment object as the virtual object, and in the display control step, a first image indicating a standard installation position of the attachment object and a second image indicating an allowable range of installation positions of the attachment object are displayed. A display control program according to a seventh aspect of the present invention is a display control program for causing a computer to function as the display device in the above-mentioned first aspect, and causes the computer to function as the display control unit.

[0075] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0076] 1. Smart glasses (display device) 2. Control section 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 101 Opening 102 Elevator 103 Piano wire Platform 200 201 Floor 202, 300 walls M1 / M2 markers OB1~OB6 Virtual Objects

Claims

1. A display device that displays a virtual object in an overlay manner in accordance with a position in a real space in a field of view of a worker viewing the real space or in an image representing the real space, a display control unit that displays an image indicating an installation position of an attachment object as the virtual object, The display control unit displays a first image indicating a standard installation position of the attachment object, and a second image indicating an allowable range of installation positions of the attachment object.

2. The display device according to claim 1 , wherein the display control unit displays, as the second image, an image of an arrow indicating an allowable direction in which deviation of the installation position from the standard installation position is allowable and an allowable distance range in that direction.

3. The display device according to claim 1, wherein the display control unit displays, as the second image, an image showing a rectangular area at a position a predetermined distance away from a wall or floor surface existing in the real space, and displays line images perpendicular to the wall or floor surface from each vertex of the image showing the rectangular area.

4. The display device according to claim 1 , wherein the display control unit displays, as the first image, an image showing a general shape of the attachment object.

5. The display device according to claim 1 , wherein the display control unit displays, as the second image, an image showing a general shape of the attachment object near a boundary of the allowable range.

6. A display control method for overlaying and displaying virtual objects in a field of view of a worker viewing a real space or an image representing the real space in an arrangement according to a position in the real space, comprising: a display control step of displaying an image indicating an installation position of an attachment target as the virtual object, In the display control step, a first image showing a standard installation position of the attachment object is displayed, and a second image showing an allowable range of installation positions of the attachment object is displayed.

7. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing the computer to function as the display control unit.

Images