Display device, method for controlling display, and display control program

Abstract

To provide a display device capable of allowing a worker to accurately recognize an interference state with an installation target without reducing visibility of a real space.SOLUTION: The display device includes a display control unit for displaying, as virtual objects (OB1-OB3), installation-target images showing the outline of an installation target in a state where the installation target is installed on an installation target surface, the display control unit displaying, as the installation-target images, virtual objects (OB1) showing the outline of the cross-sectional shape of the installation target on the installation target surface (300), and virtual objects (OB2 and OB3) showing the outlines of cross-sectional shapes of the installation target on planes perpendicular to the installation target surface.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display device that displays virtual objects in an overlaid manner in accordance with positions in real space, either in the field of view of a worker viewing real space or on an image representing real space. [Background technology]

[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]

[0004] Using the above technology, it is conceivable to overlay an image showing the installation target onto the real space where the construction work is to be performed. However, if the shape of the installation target is displayed as is, the displayed image reduces the visibility of the real space, making the work more difficult. On the other hand, if the shape of the installation target is oversimplified, it becomes difficult to recognize the state of interference with the real space.

[0005] An object of one aspect of the present invention is to provide a display device that allows a worker to accurately recognize interference conditions with installation objects, etc., without reducing visibility of the real space. [Means for solving the problem]

[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays virtual objects in an arrangement corresponding to the position of the real space on the field of view of a worker viewing the real space as the object of construction work, or on an image representing the real space, and is equipped with a display control unit that displays, as the virtual object, an installation object image showing the general shape of the installation object when installed on the installation object surface, and the display control unit is configured to display, as the installation object image, a first image showing the general shape of the cross-sectional shape of the installation object on the installation object surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation object surface.

[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays virtual objects in an arrangement corresponding to the position of the real space on the field of view of a worker viewing the real space as the object of construction work, or on an image representing the real space, and has a display control step of displaying, as the virtual object, an installation object image showing the general shape of the installation object when installed on the installation object surface, and in the display control step, displays, as the installation object image, a first image showing the general shape of the cross-sectional shape of the installation object on the installation object surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation object surface.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program for the display device that causes the computer to operate as each part (software element) of the display device to realize the display device, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0009] According to the present invention, an operator can easily check whether there are any objects or structures that may interfere with the real space before actually installing an installation target. Furthermore, because the outline of the cross-sectional shape of the installation target surface and a plane perpendicular to the installation target surface is displayed, the number of virtual objects displayed can be reduced, thereby achieving the effect of maintaining good visibility of the real space. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 is a perspective view showing an example of display of a virtual object. [Figure 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 3] FIG. 1 is a diagram showing a state in which smart glasses 1 according to this embodiment are attached to a safety helmet 11. [Figure 4] FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] FIG. 10 is a diagram illustrating a modified example of displaying a virtual object. [Figure 7] FIG. 10 is a diagram illustrating another modified example of displaying a virtual object. [Figure 8] FIG. 10 is a diagram illustrating yet another modified example of displaying a virtual object. [Figure 9] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.

[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and can also view the projected image within the real space. That is, the smart glasses 1 overlay a virtual object as construction reference information related to elevator construction in a position corresponding to the position in the real space in the field of view of a worker viewing the real space including the elevator landing and hoistway. Note that while this embodiment is intended for elevator construction work, it is not limited thereto and can be applied to any construction work as long as the construction work involves installing an object to be installed at a predetermined position in real space.

[0014] FIG. 1 shows an example of a state in which virtual objects OB1 to OB3 are overlaid and displayed in real space. As shown in the figure, virtual objects OB1 to OB3 are displayed in a three-dimensional space including a wall surface 300 in real space. This allows the worker to confirm in real space the position in three-dimensional space where construction work should be performed. This eliminates the need for work such as measuring and confirming the position where construction work should be performed in real space, thereby improving workability. Details of the virtual objects OB1 to OB3 will be described later.

[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information.

[0017] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, a warning control unit 24, and a spatial distance measurement unit 25.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.

[0019] The display control unit 21 reads out construction reference information including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.

[0020] The display control unit 21 controls the display of, as the installation object images, a first image showing the general shape of the cross-section of the installation object on the installation object surface, and a second image showing the general shape of the cross-section of the installation object on a plane perpendicular to the installation object surface. Details of this display control will be described later.

[0021] The display control unit 21 may acquire construction reference information from outside via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This makes it possible to update the data stored in the storage unit 5 and acquire new data.

[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.

[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.

[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.

[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.

[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0029] The spatial distance measuring unit 25 recognizes the distance to an object in real space using a distance sensor such as LiDAR (Light Detection and Ranging) and recognizes the actual shape of the real space. This enables processing such as changing the display mode depending on the relationship between the display position of a virtual object as construction reference information and the position of the actual object in real space. For example, as will be described in detail later, the spatial distance measuring unit 25 measures the actual construction surface, which is the actual construction surface in real space, and the display control unit 21 changes the display mode of the virtual object based on this measurement result. Note that the spatial distance measuring unit 25 is not essential, and a configuration may be adopted in which the distance to an object in real space is recognized by an external spatial distance measuring device and the information is acquired via the communication unit 6.

[0030] (Example of a real space where an elevator is installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.

[0031] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0032] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.

[0033] In addition, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but this is not limited thereto, and the markers M1 and M2 may be provided on the wall surface 202. In addition, in this embodiment, the markers M1 and M2 are provided on the landing 200, but the markers may be provided inside the hoistway 102.

[0034] Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.

[0035] FIG. 5 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using these piano wires as positional references, it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.

[0036] Furthermore, a laser beam, for example, may be used as the position reference object. That is, by irradiating a laser beam vertically downward from a predetermined position at the top of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the beam tends to become thicker as the distance from the light source increases, so there is a possibility that the thickness of the beam may cause errors depending on the height of the building.

[0037] (Virtual object details) Next, the virtual objects OB1 to OB3 shown in Fig. 1 will be described. The virtual objects OB1 to OB3 are images that indicate the positions of installation targets on an installation target surface 300 that exists in real space. The installation target surface 300 is a surface on which a building will be placed when it is completed, and it is assumed that the installation target surface 300 does not exist during construction. In other words, the virtual objects OB1 to OB3 may be displayed whether the installation target surface 300 exists or does not exist.

[0038] Virtual object OB1 is an image (first image) that shows the general shape of the cross-section of the installation object on installation target surface 300. In the example shown in the figure, an image showing the four sides of a rectangle is displayed as virtual object OB1. This rectangle represents the outline shape of the installation object on installation target surface 300. The four sides of the rectangle may be displayed in any manner, such as with solid lines, dashed lines, or dashed dotted lines, and there are no particular limitations on the color or line width.

[0039] Note that the rectangle as virtual object OB1 may be such that the width of the longest part in the horizontal direction of the contour shape of the installation target on the installation target surface is the horizontal width of the rectangle, and the width of the longest part in the vertical direction is the vertical width of the rectangle. With this display, if the contour shape of the installation target on the installation target surface is not a rectangle, the worker can recognize the position of the part with the widest horizontal width and the part with the widest vertical width.

[0040] Virtual object OB2 is an image (second image) showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to installation target surface 300 and in the vertical direction, the cross-sectional shape on the far side of installation target surface 300 (rear cross-sectional shape). In the example shown in the same figure, an image showing the four sides of a rectangle is displayed as virtual object OB2. In this rectangle, the width of the longest part in the direction perpendicular to installation target surface 300 (depth direction) is the horizontal width of the rectangle, and the width of the longest part in the vertical direction is the vertical width of the rectangle. The four sides of the rectangle may be displayed in any manner, such as with solid lines, dashed lines, or dashed dotted lines, and the colors and line widths are not particularly limited.

[0041] Virtual object OB3 is an image (second image) showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to installation target surface 300, the cross-sectional shape on the near side of installation target surface 300 (front-side cross-sectional shape). In the example shown in the same figure, an image showing the four sides of a rectangle is displayed as virtual object OB3. In the front-side cross-sectional shape of this rectangle, the width of the longest part in the direction perpendicular to installation target surface 300 (depth direction) is the horizontal width of the rectangle, and the width of the longest part in the vertical direction is the vertical width of the rectangle. The four sides of the rectangle may be displayed in any manner, such as with solid lines, dashed lines, or dashed dotted lines, and the colors and line widths are not particularly limited.

[0042] Virtual objects OB2 and OB3 display the entire cross-sectional shape of the installation target on a plane perpendicular to installation target surface 300. Virtual objects OB2 and OB3 are displayed along the center line that is the vertical direction of the rectangle represented by virtual object OB1. Note that the positions at which virtual objects OB2 and OB3 are displayed may be slightly shifted to the left or right depending on the display state of other virtual objects.

[0043] In the above example, virtual object OB2 and virtual object OB3 are displayed on the far side and near side of installation target surface 300, respectively, but the entire cross-sectional shape of the installation target on a plane perpendicular to installation target surface 300 may be displayed as a single virtual object. Also, if the installation target has no or only a small portion protruding on the near side of installation target surface 300, virtual object OB3 may not be displayed.

[0044] In the example shown in the figure, virtual objects OB2 and OB3 represent the cross-sectional shape of the installation target on a plane perpendicular to the installation target surface 300 in the vertical direction, but are not limited to this. For example, if the installation target is long in the horizontal direction, they may represent the cross-sectional shape of the installation target on a plane perpendicular to the installation target surface 300 in the horizontal direction.

[0045] The display as described above makes it possible to present to the worker the approximate size of the installation object when it is installed on the installation surface 300. Therefore, before actually installing the installation object, it is possible to easily check whether there are any objects or structures in the real space that may interfere with the installation object.

[0046] Furthermore, even when work is performed in a state where the installation target surface 300 does not exist in the real space, the installation target object can be installed by referring to the virtual object OB2. Therefore, even when the installation target surface 300 is installed thereafter, the positional relationship between the installation target surface 300 and the installation target object can be maintained as designed.

[0047] Furthermore, since the outline of the cross-sectional shape of the installation target surface 300 and a plane perpendicular to the installation target surface 300 is displayed, the number of virtual objects displayed can be reduced, and good visibility of the real space can be maintained. In particular, in the above example, virtual object OB1, virtual object OB2, and virtual object OB3 are images of the four sides of a rectangle, and the images showing the outline of the installation objects are very simple. Therefore, good visibility of the real space can be maintained.

[0048] When the installation target surface 300 exists in real space, the position of the installation target surface 300 may be identified by the space distance measuring unit 25, and the display manner of the virtual objects OB1 to OB3 may be different between the back side and the front side of the installation target surface 300. For example, when the virtual objects OB1 to OB3 exist on the back side of the installation target surface 300, that part may not be displayed. In this case, when the virtual objects OB1 to OB3 exist in a position where they are in the shadow of an object, they become invisible, providing a more realistic appearance. In this case, construction may be performed based on the virtual objects OB1 to OB3 that are visible on the front side of the installation target surface 300.

[0049] It may also be possible to switch between a mode in which virtual objects OB1 to OB3 on the far side of the installation surface 300 are displayed and a mode in which they are not displayed. This allows the worker to switch between a state in which the shadows of or virtual objects existing inside objects in real space are visible and a state in which they are not visible, just like in reality, thereby improving workability.

[0050] (Variations of virtual object display) FIG. 6 shows a modified example of the display of a virtual object. In the example shown in 601, an image showing the four vertices of a rectangle is displayed as virtual object OB1. This rectangle represents the outline shape of the installation object on installation surface 300. The vertices of the rectangle may be displayed in any manner, and there are no particular limitations on the color or size. In the example shown in the figure, the vertices are connected by dashed lines, but this display is not necessary.

[0051] In the example shown in 601, an image showing four vertices of a rectangle is displayed as virtual object OB2. Similarly, an image showing four vertices of a rectangle is displayed as virtual object OB3. In the same figure, a vertex common to virtual object OB2 and virtual object OB3 on installation target surface 300 is shown as virtual object OB4. Each vertex of the rectangle may be displayed in any manner, and there are no particular limitations on color or size. In the example shown in the same figure, each vertex is connected by a dashed dotted line, but this display may not be necessary. In addition, the display of virtual object OB4, which is a point image on installation target surface 300, may be omitted.

[0052] In the example shown in 602, virtual object OB1 is an image showing the four vertices of a rectangle, and line segments extending from each vertex at a predetermined short length in the direction of the rectangle's sides are also displayed. Similarly, virtual object OB2 is an image showing the four vertices of a rectangle, and line segments extending from each vertex at a predetermined short length in the direction of the rectangle's sides are also displayed. In this way, by displaying line segments extending from each vertex at a predetermined short length in the direction of the rectangle's sides, the operator can more easily recognize which quadrangle each vertex represents.

[0053] According to the above example, virtual objects OB1, OB2, and OB3 are images of the four vertices of a rectangle, and the images showing the outline of the installation target are very simple. Therefore, the visibility of the real space can be further improved.

[0054] As described above, when the installation target surface 300 exists in real space, the position of the installation target surface 300 can be identified by the spatial distance measuring unit 25, and the display manner of the virtual objects OB1 to OB3 can be made different between the back side and the front side of the installation target surface 300.

[0055] It may also be possible to switch between a mode in which virtual objects OB1 to OB3 on the far side of the installation surface 300 are displayed and a mode in which they are not displayed. This allows the worker to switch between a state in which the shadows of or virtual objects existing inside objects in real space are visible and a state in which they are not visible, just like in reality, thereby improving workability.

[0056] 7 shows another modified example of the display of a virtual object. Specifically, 701 shows a case where the installation object is a hall call unit 81 including a call button 83 at an elevator hall and a display unit 82 that displays the current floor location of the elevator car.

[0057] 702 in FIG. 7 is a front view of the hall call unit 81. As shown in 702, the display unit 82 is provided at the top of the surface plate of the hall call unit 81, and displays a number indicating the current floor and an image indicating the direction in which the car will move. The call buttons 83 are provided at the bottom of the surface plate of the hall call unit 81, with an up call button 83 and a down call button 83 arranged vertically. Although not shown, a housing containing various components, circuits, wiring, etc. for displaying information on the display unit 82, as well as a housing containing various components, circuits, wiring, etc. connected to the call buttons 83, is provided at the rear of the surface plate. The housing provided at the rear of the surface plate is not essential, and a single housing containing both the display unit 82 and the call buttons 83 may be provided.

[0058] As shown in 701, a rectangular image representing the surface shape of the surface plate is displayed as a virtual object OB1. Also, the general shape of a housing containing various components, circuits, wiring, etc. provided on the rear side of the surface plate is displayed as a rectangular image representing a virtual object OB2. Note that the vertical side on the rear side of the rectangular image representing the virtual object OB2 may represent the distance to the surface plate from the portion of the various components, circuits, wiring, etc. provided on the rear side of the surface plate that is located furthest from the surface plate.

[0059] Furthermore, the button center position between the upward call button 83 and the downward call button 83 is displayed as a virtual object OB5. The virtual object OB5 is composed of an image of a line segment that passes through the button center position and extends horizontally along the surface of the surface plate, and an image of a line segment that passes through the button center position and extends in the normal direction of the surface plate. The intersection of these two line segments indicates the button center position. This is because the height of the button center position is an important position for user operation, and the height position of the hall call unit 81 is set by this button center position. Note that for the top floor and the bottom floor, only one call button is provided, either upward or downward. In this case, the button center position is the center position of one call button.

[0060] Furthermore, a virtual object OB6 may be displayed as an image indicating the outer diameter of display unit 82 at the position where display unit 82 is disposed. This makes it easier for the worker to recognize that the object displayed by virtual objects OB1 to OB6 indicates hall call unit 81.

[0061] In this way, the outline of the surface plate of the hall call unit 81 is displayed, and the outline of the housing that contains various components, circuits, wiring, etc. provided on the rear side of the surface plate is also displayed. Therefore, an overlay display that is useful in the installation work of the hall call unit 81 at the hall can be realized.

[0062] Fig. 8 shows yet another modified example of the display of a virtual object. In the example shown in the figure, virtual object OB1 shows the outline shape of an installation object on installation target surface 300. Here, Fig. 8 particularly shows a case where the outline shape of the installation object on installation target surface 300 is not rectangular. In the example shown in the figure, the width of the upper half of the outline shape is different from the width of the lower half, but this is not particularly limited and any outline shape may be used.

[0063] In this way, by displaying the outline shape of the installation target on installation target surface 300, the worker can accurately recognize the range in which the installation target will be placed on installation target surface 300. Therefore, the worker can recognize whether or not interference will occur between the installation target and an object in the real environment on installation target surface 300. Furthermore, because the specific shape of the installation target is displayed, the worker can easily recognize which work target the virtual object relates to, compared to when it is displayed as a simple rectangular image.

[0064] Furthermore, virtual object OB2 represents the contour shape of the installation target on a plane perpendicular to installation target surface 300. In the example shown in the drawing, the depth of the upper half of the contour shape is different from the depth of the lower half, but this is not particularly limited and any contour shape may be used.

[0065] In this way, by displaying the contour shape of the installation target in the depth direction relative to the installation target surface 300, the worker can accurately recognize the range in the depth direction in which the installation target will be placed. Therefore, the worker can recognize whether or not there is interference between the installation target and an object in the real environment in the depth direction. Furthermore, because the specific shape of the installation target is displayed, the worker can easily recognize which work target the virtual object relates to, compared to when it is displayed as a simple rectangular image. (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Figure 9. When elevator installation begins, first in step 1 (hereinafter referred to as S1), markers M1 and M2 are installed at predetermined positions in the hall 200. At this time, as described above, the markers M1 and M2 are installed using a position reference object such as the piano wire 103 as a reference.

[0066] Next, in S2, the worker wears the smart glasses 1, captures images of the markers using the imaging unit 4, and causes the position recognition unit 22 to perform position recognition processing. Once position recognition is complete, in S3, the display control unit 21 overlays the virtual object. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize their position, the worker can view the virtual object while maintaining its relative positional relationship with the real space, even if they subsequently change their viewing direction or move. In this state, in S4, the worker performs construction work while checking the construction reference information overlaid by the display control unit 21. Note that construction work includes not only the actual construction work but also checks after the construction work has been completed. Then, in S5, the completion of the construction work is confirmed. If S5 returns No, meaning that the construction work is continuing, the processing from S3 is repeated. If S5 returns Yes, meaning that the construction work has been completed, the processing ends.

[0067] The above construction method and smart glasses 1 enable efficient construction of elevators. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."

[0068] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0069] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0070] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0071] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0072] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0073] (summary) A display device according to a first aspect of the present invention is a display device that overlays virtual objects in an arrangement corresponding to the position of the real space on the field of view of a worker viewing the real space as the target of construction work, or on an image representing the real space, and is equipped with a display control unit that displays, as the virtual object, an installation object image showing the general shape of the installation object when installed on the installation object surface, and the display control unit is configured to display, as the installation object image, a first image showing the general shape of the cross-sectional shape of the installation object on the installation object surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation object surface.

[0074] According to the above configuration, the approximate size of the installation target object when installed on the installation target surface can be presented to the worker. Therefore, before actually installing the installation target object, the worker can easily check whether there are any objects or structures that may interfere with the real space. Furthermore, because the approximate cross-sectional shapes of the installation target surface and a plane perpendicular to the installation target surface are displayed, the number of virtual objects displayed can be reduced, thereby maintaining good visibility of the real space.

[0075] A display device according to aspect 2 of the present invention may be configured such that, in aspect 1 above, the display control unit displays, as the first image and the second image, an image showing the four sides of a rectangle or an image showing the four vertices of a rectangle.

[0076] According to the above configuration, the image showing the outline of the installation object becomes very simple, so that the visibility of the real space can be maintained even better.

[0077] A display device according to aspect 3 of the present invention may be configured such that, in aspect 2 above, the display control unit displays the rectangle in the second image so that the side farthest from the installation target surface is the side that passes through the part of the cross-sectional shape of the installation target that is farthest from the installation target surface.

[0078] According to the above configuration, the position of the part of the installation object that is farthest from the installation surface can be presented to the worker using a simple graphic. Therefore, the simple display allows the worker to recognize the interference status with the real space.

[0079] A display device according to aspect 4 of the present invention may be configured in the above-mentioned aspect 1 such that the display control unit displays line images showing the contours of the cross-sectional shape of the object to be installed as the first image and the second image.

[0080] According to the above configuration, the image showing the outline of the installation object becomes very simple, so that the visibility of the real space can be maintained even better.

[0081] A display device according to aspect 5 of the present invention is configured such that, in aspect 1 above, the installation object is a hall call unit having at least one of a call button at an elevator hall and a display unit that displays the current floor location of the elevator car, and the cross-sectional shape of the installation object on the installation surface is the surface shape of a surface plate on which the call button and the display unit are provided.

[0082] According to the above configuration, the outline of the surface plate of the hall call unit is displayed, and the outline of the housing that contains various components, circuits, wiring, etc., provided on the rear side of the surface plate is also displayed. Therefore, an overlay display that is useful in the installation work of the hall call unit at the hall can be realized.

[0083] A display control method according to aspect 6 of the present invention is a display control method for overlaying virtual objects in an arrangement corresponding to the position of the real space on the field of view of a worker viewing the real space as the target of construction work, or on an image representing the real space, and includes a display control step for displaying, as the virtual object, an installation object image showing the general shape of the installation object when installed on the installation object surface, and in the display control step, displaying, as the installation object image, a first image showing the general shape of the cross-sectional shape of the installation object on the installation object surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation object surface.

[0084] A display control program according to a seventh aspect of the present invention is a display control program for causing a computer to function as the display device in the above-mentioned first aspect, and causes the computer to function as the display control unit.

[0085] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0086] 1. Smart glasses (display device) 2. Control Unit 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 25 Spatial ranging section 101 Opening 102 Elevator 103 Piano wire Platform 200 201 Floor 202, 300 walls M1 / M2 markers OB1~OB6 Virtual Objects

Claims

1. A display device that overlays and displays virtual objects in an arrangement according to positions in the real space in a field of view of a worker viewing the real space as a construction work target or an image representing the real space, a display control unit that displays, as the virtual object, an installation object image showing an outline of the installation object when installed on the installation object surface; The display control unit displays, as the installation object image, a first image showing the general shape of the cross-sectional shape of the installation object on the installation object surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation object surface.

2. The display device according to claim 1 , wherein the display control unit displays, as the first image and the second image, an image showing four sides of a rectangle or an image showing four vertices of a rectangle.

3. The display device according to claim 2, wherein the display control unit displays the second image so that the side of the rectangle in the second image that is farthest from the installation target surface is the side that passes through the part of the cross-sectional shape of the installation target that is farthest from the installation target surface.

4. The display device according to claim 1 , wherein the display control unit displays, as the first image and the second image, line images that indicate contours of a cross-sectional shape of the installation object.

5. 2. The display device according to claim 1, wherein the installation object is a hall call unit having at least one of a call button at an elevator hall and a display unit that displays the current floor location of the elevator car, and the cross-sectional shape of the installation object on the installation surface is the surface shape of a surface plate on which the call button and the display unit are provided.

6. A display control method for overlaying a virtual object on a field of view of a worker viewing a real space as a construction work target or on an image representing the real space, in an arrangement according to a position in the real space, comprising: a display control step of displaying, as the virtual object, an installation object image showing an outline of a state in which the installation object is installed on an installation object surface; A display control method in which, in the display control step, a first image showing the general shape of the cross-sectional shape of the installation object on the installation target surface, and a second image showing the general shape of the cross-sectional shape of the installation object on a plane perpendicular to the installation target surface are displayed as the installation object images.

7. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing the computer to function as the display control unit.

Images