Display device, display control method and display control program

Abstract

To provide a display device capable of clearly presenting to an operator which floor construction reference information being displayed corresponds to, in construction work of an elevator using a display device overlaying and displaying a virtual object in an arrangement according to a location in a real space.SOLUTION: A smart glass (1) includes: a position recognition part (22) configured to recognize a marker installed at a prescribed location in a real space to recognize a location in the real space including a hoistway of an elevator; and a display control part (21) configured to overlay and display, on the real space, a virtual object according to the marker. The display control part (21) makes a display mode of a virtual object corresponding to a prescribed floor different from a display mode of a virtual object corresponding to a floor different from the prescribed floor.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a display device that displays virtual objects in an overlaid manner in accordance with positions in real space, either in the field of view of a worker viewing real space or on an image representing real space. [Background technology]

[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]

[0004] During the construction stage of a building, there may be situations where doors have not been installed between the elevator shaft and the landing. In such a situation, if markers are installed corresponding to each floor, for example, to allow the display device to recognize the position in real space, it is possible that multiple markers will be recognized by the display device through the space of the elevator shaft. In this case, it may be unclear which floor the displayed construction reference information corresponds to.

[0005] One aspect of the present invention aims to provide a display device that can clearly show workers which floor the displayed construction reference information corresponds to during elevator construction work using a display device that overlays virtual objects in an arrangement that corresponds to the position in real space. [Means for solving the problem]

[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays virtual objects in an arrangement corresponding to the position in the real space onto the field of view of a worker viewing a real space including an elevator shaft, or onto an image representing the real space, and is equipped with a position recognition unit that recognizes the position of the real space including the elevator shaft by image recognition of markers installed at predetermined positions in the real space, and a display control unit that overlays construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the marker, and is configured to differentiate the display mode of the construction reference information corresponding to a predetermined floor from the display mode of the construction reference information corresponding to a floor other than the predetermined floor.

[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object in an arrangement corresponding to the position of the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, and includes a position recognition step that recognizes the position of the real space including the elevator shaft by image recognition of a marker installed at a predetermined position in the real space, and a display control step that overlays construction reference information regarding the construction of the elevator as the virtual object on the real space based on the marker, and in the display control step, the display mode of the construction reference information corresponding to a predetermined floor is made different from the display mode of the construction reference information corresponding to a floor other than the predetermined floor.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program for the display device that causes the computer to operate as each part (software element) of the display device to realize the display device, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0009] According to the present invention, it has the effect of allowing a worker to easily determine whether the displayed construction reference information corresponds to a specified floor or to another floor. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 is a perspective view showing an example of display of a virtual object. [Figure 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 3] FIG. 1 is a diagram showing a state in which smart glasses 1 according to this embodiment are attached to a safety helmet 11. [Figure 4] FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] 10 is a diagram showing the data structure of construction reference data DAT indicating construction reference information. FIG. [Figure 7] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.

[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and can also view the projected image within the real space. That is, the smart glasses 1 overlay a virtual object as construction reference information related to elevator construction in a position corresponding to the position in the real space in the field of view of a worker viewing the real space including the elevator landing and hoistway. Note that while this embodiment is intended for elevator construction work, it is not limited thereto and can be applied to any construction work as long as the construction work involves installing an object to be installed at a predetermined position in real space.

[0014] FIG. 1 shows an example of a state in which virtual objects are overlaid on real space when looking down at an elevator shaft. As shown in the figure, rails RL1 to RL3 and rail brackets BR1 to BR3 are displayed as virtual objects in a three-dimensional space in real space. This allows workers to confirm in real space the position in three-dimensional space where construction work should be performed. This eliminates the need to measure and confirm the position where construction work should be performed in real space, thereby improving workability. Details of the rails RL1 to RL3 and rail brackets BR1 to BR3 as virtual objects will be described later.

[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information.

[0017] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, a warning control unit 24, and a spatial distance measurement unit 25.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.

[0019] The display control unit 21 reads out construction reference information including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.

[0020] The display control unit 21 controls the display mode of the construction reference information corresponding to a predetermined floor to be different from the display mode of the construction reference information corresponding to a floor other than the predetermined floor. Details of this display control will be described later.

[0021] The display control unit 21 may acquire construction reference information from outside via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This makes it possible to update the data stored in the storage unit 5 and acquire new data.

[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.

[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.

[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.

[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.

[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0029] (Example of a real space where an elevator is installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.

[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0031] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.

[0032] Furthermore, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but this is not limiting and the markers M1 and M2 may be provided on the wall surface 202. Furthermore, in this embodiment, the markers M1 and M2 are provided on the landing 200, but the markers may be provided in the hoistway 102. However, providing the markers M1 and M2 on the floor surface 201 is preferable for the following reasons.

[0033] For example, during the construction of a building in which an elevator will be installed, various modifications will be added to the wall surface 202 of the hall 200 from time to time, and there is a high possibility that the shape will change significantly. For example, it is conceivable that initially there will be no walls, with only support pillars installed, and at some point walls will be installed. In other words, if markers are repositioned in response to changes in the environment, the marker positions will change significantly, resulting in a significant change in the reference position of the overlay display. In this case, it will be necessary to significantly change the marker positions in the data for the overlay display, and in some circumstances, it may be necessary to change the definition of the positional relationship between the markers and the virtual object itself. In contrast, when markers M1 and M2 are placed on the floor surface 201, the shape of the floor surface 201 changes little during the construction of the building. Therefore, even if the height of the floor surface 201 is slightly changed, for example, due to floor beautification, and markers M1 and M2 are repositioned, the change in the positions of markers M1 and M2 will be relatively small. Therefore, it is possible to address this issue by fine-tuning the data for the overlay display. Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.

[0034] FIG. 5 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using these piano wires as positional references, it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.

[0035] Alternatively, a laser beam may be used as a position reference, for example. That is, by irradiating a laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, or by irradiating a laser beam vertically upward from a predetermined position in the lower part of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that errors due to the thickness of the beam may be affected depending on the height of the building. Alternatively, a reference point (architectural markings) marked on the landing of each floor may be used as a position reference. Furthermore, multiple landings 200 will be provided for each floor for one elevator, and it is preferable to install the markers at the same location in relation to the elevator entrance / exit, i.e., at the same relative position in relation to the entrance, at each landing 200.

[0036] In many cases, all halls 200 for the same elevator have the same structural arrangement. In this case, since markers M1 and M2 can be installed in the same locations relative to the elevator entrances at each hall 200, the marker installation work can be performed using the same standards and work. This allows the marker installation work to be performed efficiently. In addition, the data for overlay display can also have a common data structure among multiple halls 200.

[0037] (Data adjustment process according to the position change of markers M1 and M2) As described above, the markers M1 and M2 are provided on the floor surface 201 of the landing 200. Here, when a building is under construction, the surface of the floor surface 201 is beautified, and it is conceivable that the markers M1 and M2 will be repositioned before and after the beautification. The height of the markers M1 and M2 will change before and after this beautification. Here, in many cases, the change in height of the markers M1 and M2 before and after the beautification is on the order of a few millimeters to a few centimeters. Furthermore, it is possible to prevent the horizontal positions of the markers M1 and M2 from changing before and after the beautification.

[0038] If the position of the marker changes significantly, the positional relationship between the virtual object and the marker must be significantly changed in the data for overlay display.In contrast, even if markers M1 and M2 are repositioned due to floor beautification as described above, the change in the marker position is limited to the vertical direction, and the amount of change is small, so correcting the data is relatively easy.

[0039] Specifically, the input control unit 23 causes the display control unit 21 to display an interface for changing the height positions of the markers M1 and M2 as a virtual object, and allows the worker to input the desired height. More specifically, an interface displaying input options is displayed, and the worker selects a virtual object corresponding to the desired height change of the markers M1 and M2. The worker then inputs a height change amount corresponding to the actual construction work using a virtual object such as a numeric keypad, and the input control unit 23 accordingly corrects the data indicating the positional relationship between the virtual object and the markers. As described above, the height change amount may be input by the worker using various input devices such as a wireless keyboard, and the communication unit 6 may communicate with the input device to receive the input. (Virtual object details) Next, we will explain the virtual object shown in Fig. 1. As mentioned above, Fig. 1 shows a state in which a virtual object is overlaid on real space looking down on an elevator shaft. More specifically, it is assumed that the overlay display is for when a worker is on the third floor, with FL1 indicating the floor level of the first floor, FL2 indicating the floor level of the second floor, and FL3 indicating the floor level of the third floor.

[0040] Markers M31 and M32 are provided on the floor of the third floor, markers M21 and M22 are provided on the floor of the second floor, and markers M11 and M12 are provided on the floor of the first floor. Markers M31 and M32, markers M21 and M22, and markers M11 and M12 correspond to markers M1 and M2 shown in Figure 4.

[0041] Each of the markers M31 and M32, the markers M21 and M22, and the markers M11 and M12 has a two-dimensional code. In Fig. 1, each of the markers M31 and M32 has a two-dimensional code QR1 or QR2. The two-dimensional codes QR1 and QR2 indicate information about the floor on which the marker M31 or M32 is located. That is, when the position recognition unit 22 recognizes the markers M31 and M32 in the captured image, it also recognizes the two-dimensional codes QR1 and QR2, thereby enabling it to recognize information about the floor on which the read marker M31 or M32 is located.

[0042] The floor information included in the marker is not limited to a two-dimensional code. For example, the marker may display text such as "3F," which may be acquired as floor information through character recognition. Furthermore, the marker may be colored specific to each floor or display an image with a specific shape, allowing the floor to be recognized through image recognition.

[0043] Rails RL1 to RL3 are virtual objects that function as rails along which the elevator car moves when ascending or descending. Rail RL3 indicates a rail located on the third floor, rail RL2 indicates a rail located on the second floor, and rail RL1 indicates a rail located on the first floor.

[0044] Rail brackets BR1 to BR3 are virtual objects that serve as brackets for fixing rails to the wall surface inside the elevator shaft. Rail bracket BR3 indicates a rail bracket located on the third floor, rail bracket BR2 indicates a rail bracket located on the second floor, and rail bracket BR1 indicates a rail bracket located on the first floor.

[0045] As described above, the display control unit 21 performs control to differentiate the display mode of virtual objects as construction reference information corresponding to a predetermined floor from the display mode of virtual objects as construction reference information corresponding to floors other than the predetermined floor. In the example shown in Fig. 1, the rail RL3 and rail bracket BR3 corresponding to the third floor, where a worker is present, are displayed in different modes from the rails RL2 and RL1 and rail brackets BR2 and BR1 corresponding to the second floor and the first floor, where no worker is present.

[0046] More specifically, rail RL3 and rail bracket BR3 are displayed with solid lines, while rails RL2 and RL1 and rail brackets BR2 and BR1 are displayed with dashed lines. Note that the difference in display mode is not limited to solid and dashed lines, and may be at least one of density, color, and pattern. This allows the worker to more easily determine whether the displayed virtual object corresponds to the floor where the worker is located or to another floor.

[0047] Furthermore, the rail RL3 and rail bracket BR3 are displayed in detail, while the rails RL2 and RL1 and rail brackets BR2 and BR1 are displayed in simplified form, which also allows the worker to more easily distinguish whether the displayed virtual object corresponds to the floor where the worker is located or to another floor.

[0048] 1 shows a view looking down from the third floor, but the same display control as above may be performed when looking up. For example, the rail RL3 and rail bracket BR3 corresponding to the third floor, where a worker is present, may be displayed in different ways from the rails and rail brackets corresponding to the fourth floor or higher, where no worker is present.

[0049] Furthermore, the virtual objects are not limited to rails and rail brackets, and various components present in the elevator shaft or at the landing may be displayed as virtual objects. When a large number of components present on multiple floors are displayed as virtual objects in this manner, it is conceivable that a worker may have difficulty recognizing which components are present on the floor where the worker is located. In contrast, the display control described above allows the worker to easily recognize the components present on the floor where the worker is located. Because workers often perform construction work related to components present on the floor where the worker is located, such display control can improve work efficiency and reduce the occurrence of errors.

[0050] In the above example, the display control is performed to make the display mode of the virtual object corresponding to the floor where the worker is located different from the display mode of the virtual object corresponding to a floor other than the floor where the worker is located, but this is not limited to this. For example, the display control may be performed to make the display mode of the virtual object corresponding to the floor where the worker is located and the display mode of the virtual object corresponding to at least one of the floors one floor above and one floor below the floor where the worker is located different from the display mode of the virtual object corresponding to the other floors.

[0051] Virtual objects on the floors above and below the floor where the worker is currently located are likely to affect the work on the floor where the worker is currently working. Therefore, the worker can be made aware of virtual objects related to adjacent floors above and below, which can further improve work efficiency and reduce the occurrence of errors.

[0052] Note that display control may be performed to differentiate the display mode of the virtual object corresponding to the floor where the worker is located from the display mode of the virtual object corresponding to at least one of the floors one floor above and one floor below the floor where the worker is located. That is, the display mode of the floor where the worker is located, the display mode of at least one of the floors one floor above and one floor below the floor where the worker is located, and the display mode of the other floors may be different from each other. This changes the display mode of the virtual objects according to these three classifications, allowing the virtual objects related to the work to be presented to the worker in a more organized and easy-to-understand state.

[0053] (Details of construction reference data) As described above, the display control unit 21 controls the display of virtual objects based on construction reference information including 3D CAD data or 2D CAD data. FIG. 6 is a diagram showing the data structure of construction reference data DAT indicating construction reference information. As shown in the figure, the construction reference data DAT has construction reference data corresponding to each floor of the building to be constructed. Specifically, the construction reference data DAT has construction reference data DAT1 for the first floor, construction reference data DAT2 for the second floor, and construction reference data DATN for the Nth floor. The Nth floor indicates either the third floor or higher, or a floor below the basement level.

[0054] The construction reference data DAT1 for the first floor is construction reference data that is overlaid and displayed by the display control unit 21 when a worker is present on the first floor. The construction reference data DAT1 for the first floor includes rail drawing data DAT11 and rail bracket drawing data DAT12. The rail drawing data DAT11 includes data for drawing the rails for the first floor and data for drawing the rails for the floors other than the first floor. As described above, the display format differs between the data for drawing the rails for the first floor and the data for drawing the rails for the floors other than the first floor. Similarly, the rail bracket drawing data DAT12 includes data for drawing the rail brackets for the first floor and data for drawing the rail brackets for the floors other than the first floor. As described above, the display format differs between the data for drawing the rail brackets for the first floor and the data for drawing the rail brackets for the floors other than the first floor. Note that the construction reference data DAT1 for the first floor may include data for drawing various other components.

[0055] The construction reference data DAT2 for the second floor includes rail drawing data DAT21 and rail bracket drawing data DAT22, etc. The construction reference data DATN for the Nth floor includes rail drawing data DATN1 and rail bracket drawing data DATN2, etc. In other words, the construction reference data DAT2 for the second floor and the construction reference data DATN for the Nth floor have the same data structure as the construction reference data DAT1 for the first floor.

[0056] In addition, the rail drawing data and rail bracket drawing data in the construction reference data for each floor may have three types: data on the display mode of the relevant floor, data on the display mode of at least one of the floors one floor above and one floor below the relevant floor, and data on the display mode of other floors.

[0057] According to the construction reference data having the above-described data structure, the display control unit 21 can read out the construction reference data corresponding to the floor on which the worker is located, thereby performing display control to make the display mode of the virtual object corresponding to the floor on which the worker is located different from the display mode of the virtual object corresponding to a floor other than the floor on which the worker is located.

[0058] The construction reference data is not limited to the above-described data structure. For example, the rail drawing data and the rail bracket drawing data may include two types of data with different display modes as data for portions corresponding to each floor. In this case, the display control unit 21 can perform display control to vary the display modes as described above by selecting data to be read out depending on the floor on which the worker is present. In other words, with regard to the drawing data for various components, two types of data with different display modes are prepared for each portion corresponding to each floor, and the display control unit 21 reads out the drawing data corresponding to the floor on which the worker is present and the drawing data corresponding to the floor on which the worker is not present so that they have different display modes.

[0059] (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 7. When elevator installation begins, first in step 1 (hereinafter referred to as S1), markers are installed on the floor at predetermined positions in the landing area of ​​each floor. At this time, as described above, the markers are installed using a position reference object such as piano wire 103 as a reference.

[0060] Next, in S2, the worker wears the smart glasses 1 on the floor where he or she is to work, and the marker corresponding to the floor where the worker is located is captured by the imaging unit 4, and position recognition processing is performed by the position recognition unit 22. Here, the position recognition unit 22 identifies the floor where the worker is located based on the information included in the marker.

[0061] The position recognition unit 22 may determine whether a marker is installed on the floor where the worker is located based on the distance to the marker. This allows the marker to be properly recognized as the marker installed on the floor where the worker is located, even if markers on other floors are included in the image capture range of the image capture unit 4. The distance to the marker may be determined based on the size of the marker in the captured image, or a distance sensor such as LiDAR (Light Detection and Ranging) may be used.

[0062] Once the position is recognized, in S3, the display control unit 21 overlays a virtual object according to the floor recognized by the position recognition unit 22. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize the position, the worker can view the virtual object while maintaining its relative positional relationship with the real space, even if the worker subsequently changes the viewing direction or moves.

[0063] In this way, the floor where the worker is working is identified based on the marker, and a virtual object corresponding to that floor is displayed, so the worker can check information appropriate for that floor without having to go through the trouble of inputting floor information. Furthermore, the display device recognizes the marker corresponding to the floor where the worker is working, thereby enabling position recognition. Therefore, the accuracy of the display position of the overlay display can be improved compared to when position recognition is performed based on markers on other floors.

[0064] In the above example, the floor where the worker is located is identified based on the information contained in the marker, but this is not limited to this. For example, numbers indicating the floor number written on the landing or elevator shaft may be recognized.

[0065] Alternatively, the worker may input the floor on which the worker is located using an input means such as an input interface using a virtual object. Alternatively, by inputting the floor that the worker wants to display using such an input means, it may be possible to display a virtual object relating to a floor on which the worker is not located.

[0066] In this state, in S4, the worker performs construction work while checking the construction reference information overlaid and displayed by the display control unit 21. Specifically, this includes positioning work to install the rail bracket at a position corresponding to the floor where the worker is located (work to mark the installation position of the rail bracket on the wall inside the elevator shaft). The actual rail bracket installation work (anchor bolt installation work, rail bracket installation work, etc.) may be performed with the worker removing the smart glasses 1, or may be performed with the smart glasses 1 attached. Furthermore, the construction work is not limited to the rail bracket positioning work described above, and other work may also be performed. Note that the construction work includes not only the actual construction work but also the check work after the construction work is completed.

[0067] Next, in S5, it is confirmed whether the floor on which the worker is located has changed. If the result in S5 is Yes, that is, if the worker has moved to another floor, the process returns to S2, and position recognition is performed based on the marker set on the floor after the worker has moved. This allows the display device to re-recognize the marker corresponding to the floor on which the worker is working, even if the worker has moved to a different floor, thereby maintaining a high level of accuracy in the display position of the overlay display.

[0068] If the answer to S5 is No, i.e., if the floor where the worker is located has not changed, the completion of the construction work is confirmed in S6. If the answer to S6 is No, i.e., if the construction work is continuing, the process from S3 is repeated, and if the answer to S6 is Yes, i.e., if the construction work has ended, the process is terminated.

[0069] The above construction method and smart glasses 1 enable efficient construction of elevators. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."

[0070] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0071] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0072] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0073] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0074] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0075] (summary) A display device according to aspect 1 of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including an elevator shaft, or onto an image representing the real space, in an arrangement corresponding to the position of the real space. The display device comprises: a position recognition unit that recognizes the position of the real space including the elevator shaft by performing image recognition on a marker installed at a predetermined position in the real space; and a display control unit that overlays construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the marker, and the display control unit is configured to differentiate the display mode of the construction reference information corresponding to a predetermined floor from the display mode of the construction reference information corresponding to a floor other than the predetermined floor.

[0076] According to the above configuration, the worker can easily determine whether the construction reference information being displayed corresponds to a specified floor or to another floor.

[0077] The display device according to a second aspect of the present invention may be configured in the first aspect as described above, so that the display control unit displays the floor where the worker is present as the predetermined floor.

[0078] According to the above configuration, it is possible to easily determine whether the displayed construction reference information corresponds to the floor where the worker is located or to another floor.

[0079] A display device according to aspect 3 of the present invention may be configured such that, in aspect 2 above, the display control unit displays, in addition to the floor on which the worker is located, at least one of the floors one floor above and one floor below the floor on which the worker is located as the specified floor.

[0080] According to the above configuration, it is possible to allow a worker to recognize construction reference information relating to adjacent floors above and below that are likely to affect the floor on which work is being performed.

[0081] A display device according to aspect 4 of the present invention may be configured such that, in aspect 1 above, the display control unit differs the display mode of the construction reference information corresponding to a specified floor from the display mode of the construction reference information corresponding to a floor other than the specified floor by at least one of density, color, and pattern.

[0082] According to the above configuration, the worker can more easily determine whether the displayed construction reference information corresponds to a specified floor or to another floor.

[0083] A display device according to aspect 5 of the present invention may be configured such that, in aspect 1 above, the position recognition unit identifies the floor on which the worker is located based on information contained in the recognized marker, and the display control unit displays the construction reference information corresponding to the floor recognized by the position recognition unit.

[0084] According to the above method, the floor on which the worker is working is identified based on the marker recognized by the display device, and construction reference information corresponding to that floor is displayed, so the worker can check the information appropriate for that floor without having to go through the trouble of inputting floor information.

[0085] A display control method according to aspect 6 of the present invention is a display control method for overlaying a virtual object onto the field of view of a worker viewing a real space including an elevator shaft, or onto an image representing the real space, in an arrangement corresponding to the position of the real space. The display control method includes a position recognition step for recognizing the position of the real space including the elevator shaft by image recognition of a marker installed at a predetermined position in the real space, and a display control step for overlaying construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the marker, and in the display control step, the display mode of the construction reference information corresponding to a predetermined floor is made different from the display mode of the construction reference information corresponding to a floor other than the predetermined floor.

[0086] A display control program according to a seventh aspect of the present invention is a display control program for causing a computer to function as the display device in the first aspect above, and causes the computer to function as the position recognition unit and the display control unit.

[0087] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0088] 1. Smart glasses (display device) 2. Control section 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 25 Spatial ranging section 101 Opening 102 Elevator 103 Piano wire Platform 200 201 Floor 202, 300 walls BR1, BR2, BR3 Rail Brackets DAT1, DAT2 floor construction reference data DAT11, DAT21, DATN1 rail drawing data DAT12, DAT22, DATN2 rail bracket drawing data M1·M2, M11·M12, M21·M22, M31·M32 markers QR1 / QR2 2D code RL1, RL2, RL3 rails

Claims

1. A display device that overlays and displays virtual objects in a position corresponding to a position in a real space in a field of view of a worker viewing a real space including an elevator shaft or an image representing the real space, the display device comprising: a position recognition unit that recognizes a position in the real space including the elevator shaft by performing image recognition on a marker installed at a predetermined position in the real space; a display control unit that overlays and displays construction reference information related to the construction of the elevator as the virtual object in the real space based on the marker, The display control unit of the display device differentiates the display mode of the construction reference information corresponding to a specified floor from the display mode of the construction reference information corresponding to a floor other than the specified floor.

2. The display device according to claim 1 , wherein the display control unit displays a floor where the worker is present as the predetermined floor.

3. The display device according to claim 2, wherein the display control unit displays, in addition to the floor on which the worker is present, at least one of the floors one floor above and one floor below the floor on which the worker is present as the specified floor.

4. The display device described in claim 1, wherein the display control unit differentiates the display mode of the construction reference information corresponding to a specified floor from the display mode of the construction reference information corresponding to a floor other than the specified floor by at least one of density, color, and pattern.

5. the location recognition unit identifies the floor on which the worker is located based on information included in the recognized marker; The display device according to claim 1 , wherein the display control unit displays the construction reference information according to the floor recognized by the position recognition unit.

6. A display control method for overlaying a virtual object onto a field of view of a worker viewing a real space including an elevator shaft or onto an image representing the real space, in an arrangement according to a position in the real space, the method comprising: a position recognition step of recognizing a position in the real space including the elevator shaft by performing image recognition on a marker installed at a predetermined position in the real space; a display control step of overlaying construction reference information regarding the construction of the elevator as the virtual object in the real space based on the marker, A display control method in which, in the display control step, the display mode of the construction reference information corresponding to a specified floor is made different from the display mode of the construction reference information corresponding to a floor other than the specified floor.

7. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing a computer to function as the position recognition unit and the display control unit.

Images