Elevator installation method, display device, display control method, and display control program

Abstract

Provided is an elevator construction method that can maintain high accuracy of the display position of an overlay display during elevator construction work using a display device that overlays and displays virtual objects in an arrangement corresponding to the position in real space. [Solution] The method includes a marker installation process in which markers are installed on the floor of the elevator so that the smart glasses can recognize their position in real space; a position recognition process in which the smart glasses use image recognition to recognize the marker corresponding to the floor where the worker is located and recognize the position in real space; and a construction process in which construction reference information regarding the construction of the elevator is overlaid on the real space as a virtual object using the smart glasses, and construction work is performed.

Description

[Technical field]

[0001] The present invention relates to a display device that displays virtual objects in an overlay manner in accordance with positions in the real space, either in the field of view of a worker viewing the real space or in an image representing the real space. [Background technology]

[0002] Conventionally, in construction work, a method has been proposed in which information required for the work is displayed superimposed on the real space on a display device such as smart glasses worn by a worker while the work is being performed. For example, Patent Document 1 discloses a projection device that scans the real space, recognizes the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-163466 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the middle of the construction of a building, there may be a situation where a door is not installed between the elevator shaft and the landing. In such a situation, if markers for the display device to recognize the position in the real space are installed corresponding to each floor, for example, it is considered that the display device will recognize multiple markers through the space of the elevator shaft. In this case, if the position is recognized by a marker installed far from the floor where the worker is located, the accuracy of the display position of the overlay display may decrease.

[0005] One aspect of the present invention aims to provide an elevator construction method that can maintain high accuracy of the display position of the overlay display during elevator construction work using a display device that overlays virtual objects in an arrangement that corresponds to the position in real space. [Means for solving the problem]

[0006] In order to solve the above problems, the elevator construction method of the present invention is an elevator construction method using a display device that overlays virtual objects in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, the method including a marker installation step of installing markers for the display device to recognize the position of the real space at positions corresponding to each floor of a building in which the elevator is installed, a position recognition step of causing the display device to recognize the marker corresponding to the floor on which the worker is located by image recognition and recognize the position of the real space, and a construction step of performing construction work with construction reference information regarding the construction of the elevator overlaid on the real space as the virtual object by the display device.

[0007] In order to solve the above problems, the display device of the present invention is a display device that overlays virtual objects in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, and is configured to include a position recognition unit that recognizes the position of the real space including the elevator shaft by image recognition of a marker that corresponds to the floor on which the worker is located, among markers installed at positions corresponding to each of the floors of a building in which the elevator is installed, in response to instructions from the worker, and a display control unit that overlays construction reference information regarding the construction of the elevator on the real space as the virtual object based on the marker.

[0008] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, and includes a position recognition step of recognizing the position of the real space including the elevator shaft by image recognition of a marker that corresponds to the floor on which the worker is located, among markers installed at positions corresponding to each of the floors of a building in which the elevator is installed, in response to an instruction from the worker, and a display control step of overlaying construction reference information regarding the construction of the elevator as the virtual object on the real space based on the marker.

[0009] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program of the display device that realizes the display device on a computer by causing the computer to operate as each part (software element) of the display device, and the computer-readable recording medium on which it is recorded, also fall within the scope of the present invention. Effect of the Invention

[0010] According to the present invention, even if a worker moves to a different floor where he or she is working, the marker corresponding to the floor where the worker is working is re-recognized by the display device, thereby achieving the effect of maintaining a high level of accuracy in the display position of the overlay display. [Brief description of the drawings]

[0011] [Figure 1] FIG. 11 is a perspective view showing an example of a display of a virtual object. [Diagram 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram showing a state in which smart glasses 1 according to the present embodiment are attached to a safety helmet 11. [Figure 4]1 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 on which the elevator is to be constructed. [Diagram 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] 13 is a diagram showing the data structure of construction reference data DAT indicating construction reference information. FIG. [Figure 7] 2 is a flowchart showing a process flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, one embodiment of the present invention will be described in detail.

[0013] (Overview of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is constructing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.

[0014] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and can also view the projected image in the real space. That is, the smart glasses 1 overlay and display a virtual object as construction reference information related to elevator construction in a position corresponding to the position in the real space in the field of view of a worker who views the real space including the elevator landing and elevator shaft. Note that, in this embodiment, elevator construction work is assumed, but the present invention is not limited thereto, and can be applied to any construction work as long as the construction work is to attach an object to be attached to a predetermined position in the real space.

[0015] FIG. 1 shows an example of a state in which virtual objects are overlaid on real space when looking down an elevator shaft. As shown in the figure, rails RL1 to RL3 and rail brackets BR1 to BR3 are displayed as virtual objects in a three-dimensional space in real space. This allows the worker to confirm the position in the three-dimensional space where construction work should be performed in real space. This eliminates the need to measure and confirm the position where construction work should be performed in real space with a tape measure, improving workability. Details of the rails RL1 to RL3 and rail brackets BR1 to BR3 as virtual objects will be described later.

[0016] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of an external real space captured by a camera and an image of a virtual object may be used. In addition, instead of a head-mounted display, a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or by wire may be used as the display device according to the present invention.

[0017] The virtual object as the construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. The CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling). In BIM, various information such as the quantity, part number, dimensions, material, performance, and price of each part are included as object information in the 3D model, so at least one of these pieces of information may be displayed as the construction reference information.

[0018] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, a warning control unit 24, and a spatial distance measurement unit 25.

[0019] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to the construction of the elevator. The projection unit 3 projects an image onto the half mirror, thereby allowing the worker, who is the wearer of the smart glasses 1, to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different from each other, thereby allowing the virtual object to be displayed as if it is three-dimensionally arranged at a predetermined position in the real space. This allows the worker to recognize the construction position as a three-dimensional position in the real space.

[0020] The display control unit 21 reads out the construction reference information including the three-dimensional CAD data or the two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or the two-dimensional CAD data also includes information indicating the positional relationship with an object existing in the real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in the real space recognized by the position recognition unit 22.

[0021] The display control unit 21 performs control to make the display mode of the construction reference information corresponding to a predetermined floor different from the display mode of the construction reference information corresponding to a floor other than the predetermined floor. The details of this display control will be described later.

[0022] The display control unit 21 may acquire the construction reference information from the outside via the communication unit 6. The communication unit 6 may communicate with a PC or a server in a local network via a wireless LAN, for example, or with an external server via the Internet. This makes it possible to update the data stored in the storage unit 5 and acquire new data.

[0023] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of the markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. In addition, the position recognition unit 22 is capable of position recognition with 6DoF (Degree of Freedom). As a result, once the worker has had the position recognized by the position recognition unit 22 using the markers M1 and M2, the worker can view the virtual object while maintaining its relative positional relationship with the real space even if the worker subsequently changes or moves the viewing direction.

[0024] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, an image as an input interface is displayed in real space as a virtual object by the display control unit 21, and an instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0025] Also, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker by performing voice recognition, thereby accepting the instruction input from the worker.

[0026] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted by an input by a worker to the input device.

[0027] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of the warning method include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and the like.

[0028] The warning condition may be that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued at the timing when the possibility of the worker falling into the elevator shaft increases, thereby further improving the safety of the worker.

[0029] At least one of the functions of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0030] (Example of real space where elevators are installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed at a stage in the middle of building construction. In this state, an opening 101 exists between the hall 200 and the hoistway 102 as an entrance for the elevator. The hall 200 has a floor surface 201 and a wall surface 202.

[0031] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is formed of a rectangular planar member, and a predetermined pattern is formed on the surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 in the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0032] In this embodiment, two markers are provided for each platform, but the present invention is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but two markers are sufficient for position recognition.

[0033] In addition, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but the present invention is not limited to this, and the markers M1 and M2 may be provided on the wall surface 202. In this embodiment, the markers M1 and M2 are provided on the landing 200, but the markers may be provided in the hoistway 102. However, providing the markers M1 and M2 on the floor surface 201 is preferable for the following reasons.

[0034] For example, during the construction stage of a building in which an elevator is to be installed, various processing is added to the wall surface 202 of the hall 200 from time to time, and there is a high possibility that the shape will change significantly. For example, it is possible that at first, there are no walls and only pillars are installed, and then at some point, walls are installed. In other words, if the markers are re-installed in response to changes in the environment, the positions of the markers will change significantly, and the reference position of the overlay display will be changed significantly. In this case, it becomes necessary to significantly change the positions of the markers in the data for the overlay display, and depending on the situation, it may become necessary to change the definition of the positional relationship between the markers and the virtual object itself. In contrast, when the markers M1 and M2 are installed on the floor surface 201, the shape of the floor surface 201 changes little during the construction stage of a building, so even if the height is slightly changed due to floor beautification processing, for example, and the markers M1 and M2 are re-installed, the change in the positions of the markers M1 and M2 will be relatively small. Therefore, it is possible to deal with this by fine-tuning the data for the overlay display. The markers M1 and M2 are placed at predetermined positions on the floor surface 201, which are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of the markers M1 and M2 require high precision in order to accurately match the positions in real space with the display positions of the virtual objects, so it is preferable that they are set based on a predetermined position reference object whose placement position in real space is highly accurate. An example of the position reference object is a piano wire 103 installed in the elevator shaft 102.

[0035] FIG. 5 is a perspective view showing the outline of the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103·103 are hung from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103·103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using this piano wire as a position reference, it is possible to maintain high accuracy in the installation positions of the markers M1·M2. Note that the present invention is not limited to piano wires, and any strong wire member with a sufficiently thin diameter may be used.

[0036] Also, for example, a laser beam may be used as a position reference object. That is, by irradiating the laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, or by irradiating the laser beam vertically upward from a predetermined position in the lower part of the elevator shaft 102, the laser beam can be positioned at a fixed position similar to piano wire. However, in the case of laser beam, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that the influence of errors due to the thickness of the beam may occur depending on the height of the building. Also, a reference point (architectural markings) marked on the landing of each floor may be used as a position reference object. In addition, multiple landings 200 will be provided for each floor for one elevator, and it is preferable to install the marker in the same location in each landing 200 with respect to the elevator entrance, i.e., in the same relative position with respect to the entrance.

[0037] In many cases, all halls 200 for the same elevator have the same structural arrangement. In this case, the markers M1 and M2 can be installed in the same locations for the elevator entrances at each hall 200, and the marker installation work can be performed using the same procedures and standards. This allows the marker installation work to be performed efficiently. In addition, the data for overlay display can also have a common data structure for the multiple halls 200.

[0038] (Data adjustment process according to the change in the positions of markers M1 and M2) As described above, the markers M1 and M2 are provided on the floor surface 201 at the landing 200. Here, when a building is in the middle of construction, the surface of the floor surface 201 is beautified, and it is considered that the markers M1 and M2 will be reinstalled before and after the beautification. The height of the markers M1 and M2 will change before and after this beautification. Here, the change in height of the markers M1 and M2 before and after the beautification is often on the order of a few millimeters to a few centimeters. Also, it is possible to prevent the horizontal positions of the markers M1 and M2 from changing before and after the beautification.

[0039] If the position of the marker changes significantly, the positional relationship between the virtual object and the marker must be significantly changed in the data for overlay display.In contrast, even if markers M1 and M2 are repositioned due to floor beautification processing as described above, the change in the marker position is limited to the height direction, and the amount of change is small, so it is relatively easy to correct the data.

[0040] Specifically, the input control unit 23 causes the display control unit 21 to display an interface for changing the height positions of the markers M1 and M2 as a virtual object, and allows the worker to input the interface. More specifically, an interface showing input options is displayed, and the worker selects a virtual object of the option corresponding to changing the height of the markers M1 and M2 from the interface. The worker then inputs an amount of height change corresponding to the actual construction work into a virtual object such as a numeric keypad, and the input control unit 23 corrects the data indicating the positional relationship between the virtual object and the markers in response to the input. As described above, the communication unit 6 may communicate with various input devices such as a wireless keyboard, and the input of the amount of height change may be received through input by the worker into the input device. (Virtual object details) Next, the virtual object shown in Fig. 1 will be described. As described above, Fig. 1 shows a state in which the virtual object is overlaid on the real space looking down on the elevator shaft. More specifically, it is assumed that the overlay display is for when a worker is on the third floor, and FL1 indicates the floor level of the first floor, FL2 the floor level of the second floor, and FL3 the floor level of the third floor.

[0041] Markers M31 and M32 are provided on the floor surface of the third floor, markers M21 and M22 are provided on the floor surface of the second floor, and markers M11 and M12 are provided on the floor surface of the first floor. Markers M31 and M32, markers M21 and M22, and markers M11 and M12 correspond to markers M1 and M2 shown in Figure 4.

[0042] Two-dimensional codes are provided on the markers M31 and M32, the markers M21 and M22, and the markers M11 and M12, respectively. In Fig. 1, two-dimensional codes QR1 and QR2 are provided on the markers M31 and M32, respectively. The two-dimensional codes QR1 and QR2 indicate information on the floor on which the markers M31 and M32 on which the two-dimensional codes QR1 and QR2 are provided are located. In other words, when the position recognition unit 22 performs image recognition of the markers M31 and M32 in the captured image, it also recognizes the two-dimensional codes QR1 and QR2, thereby making it possible to recognize information on the floor on which the read markers M31 and M32 are located.

[0043] The floor information included in the marker is not limited to a two-dimensional code. For example, the marker may display text such as "3F," which may be obtained as floor information through character recognition. In addition, the marker may be colored in a color specific to each floor or display an image of a specific shape, allowing the floor to be recognized through image recognition.

[0044] Rails RL1 to RL3 are virtual objects that function as rails along which an elevator car moves when ascending or descending. Rail RL3 indicates a rail that is located on the third floor, rail RL2 indicates a rail that is located on the second floor, and rail RL1 indicates a rail that is located on the first floor.

[0045] Rail brackets BR1 to BR3 are virtual objects that serve as brackets for fixing rails to the wall surface inside the elevator shaft. Rail bracket BR3 indicates a rail bracket located on the third floor, rail bracket BR2 indicates a rail bracket located on the second floor, and rail bracket BR1 indicates a rail bracket located on the first floor.

[0046] As described above, the display control unit 21 performs control to make the display mode of the virtual object as the construction reference information corresponding to a predetermined floor different from the display mode of the virtual object as the construction reference information corresponding to a floor other than the predetermined floor. In the example shown in Fig. 1, the rail RL3 and the rail bracket BR3 corresponding to the third floor where the worker is present are displayed in different modes from the rails RL2 and RL1 and the rail brackets BR2 and BR1 corresponding to the second floor and the first floor where the worker is not present.

[0047] More specifically, the rail RL3 and the rail bracket BR3 are displayed with solid lines, while the rails RL2 and RL1 and the rail brackets BR2 and BR1 are displayed with dashed lines. The difference in the display mode is not limited to a solid line and a dashed line, but may be at least one of the density, color, and pattern. This allows the worker to more easily distinguish whether the displayed virtual object is a virtual object corresponding to the floor where the worker is present, or a virtual object corresponding to another floor.

[0048] In addition, the rail RL3 and rail bracket BR3 are displayed in detail, while the rails RL2 and RL1 and rail brackets BR2 and BR1 are displayed in a simplified form, allowing the worker to more easily distinguish whether the displayed virtual object corresponds to the floor where the worker is located or to another floor.

[0049] 1 shows a state where the user is looking down from the third floor, but the display control may be performed in the same manner as described above even when the user is looking up. For example, the rail RL3 and rail bracket BR3 corresponding to the third floor where the worker is present may be displayed in a different manner from the rails and rail brackets corresponding to the fourth floor or higher where the worker is not present.

[0050] In addition, the virtual objects are not limited to rails and rail brackets, and various components present in the elevator hoistway or landing may be displayed as virtual objects. In this way, when many components present on multiple floors are displayed as virtual objects, it is expected that the worker may have difficulty recognizing which components exist on the floor where the worker is present. In contrast, the above-mentioned display control makes it easy to recognize the components present on the floor where the worker is present. Since the worker often performs construction work related to the components present on the floor where the worker is present, such display control can improve the efficiency of the work and suppress the occurrence of mistakes.

[0051] In the above example, the display control is performed to make the display mode of the virtual object corresponding to the floor where the worker is present different from the display mode of the virtual object corresponding to a floor other than the floor where the worker is present, but the present invention is not limited to this. For example, the display control may be performed to make the display mode of the virtual object corresponding to the floor where the worker is present, and the display mode of the virtual object corresponding to at least one of the floor above and below the floor where the worker is present different from the display mode of the virtual object corresponding to the other floors.

[0052] Virtual objects that exist on the floor above and below the floor where the worker is currently working are likely to affect the work on the floor where the worker is currently working. Therefore, it is possible to make the worker aware of virtual objects related to the adjacent floors above and below, which can further improve work efficiency and reduce the occurrence of errors.

[0053] In addition, display control may be performed to make the display mode of the virtual object corresponding to the floor where the worker is present different from the display mode of the virtual object corresponding to at least one floor above and one floor below the floor where the worker is present. That is, the display mode of the floor where the worker is present, the display mode of at least one floor above and one floor below the floor where the worker is present, and the display mode of the other floors may be different from each other. As a result, the display mode of the virtual object is changed according to these three classifications, so that the virtual objects related to the work can be presented to the worker in a more organized and easy-to-understand state.

[0054] (Details of construction reference data) As described above, the display control unit 21 controls the display of the virtual object based on the construction reference information including the three-dimensional CAD data or the two-dimensional CAD data. FIG. 6 is a diagram showing the data structure of the construction reference data DAT indicating the construction reference information. As shown in the figure, the construction reference data DAT has construction reference data corresponding to each floor of the building to be constructed. Specifically, the construction reference data DAT has construction reference data DAT1 for the first floor, construction reference data DAT2 for the second floor, and construction reference data DATN for the Nth floor. The Nth floor indicates either the third floor or higher, or the floors below the basement level.

[0055] The construction reference data DAT1 for the first floor is construction reference data that is overlaid and displayed by the display control unit 21 when the worker is present on the first floor. The construction reference data DAT1 for the first floor includes rail drawing data DAT11 and rail bracket drawing data DAT12. The rail drawing data DAT11 includes data for drawing the rail of the part corresponding to the first floor and data for drawing the rail of the part corresponding to the floor other than the first floor. As described above, the display mode is different between the data for drawing the rail of the part corresponding to the first floor and the data for drawing the rail of the part corresponding to the floor other than the first floor. Similarly, the rail bracket drawing data DAT12 includes data for drawing the rail bracket of the part corresponding to the first floor and data for drawing the rail bracket of the part corresponding to the floor other than the first floor. As described above, the display mode is different between the data for drawing the rail bracket of the part corresponding to the first floor and the data for drawing the rail bracket of the part corresponding to the floor other than the first floor. Note that the construction reference data DAT1 for the first floor may include data for drawing various other members.

[0056] The second floor construction reference data DAT2 includes rail drawing data DAT21 and rail bracket drawing data DAT22. The Nth floor construction reference data DATN includes rail drawing data DATN1 and rail bracket drawing data DATN2. That is, the second floor construction reference data DAT2 and the Nth floor construction reference data DATN have the same data structure as the first floor construction reference data DAT1.

[0057] In addition, the rail drawing data and rail bracket drawing data in the construction reference data for each floor may have three types of data: data on the display mode of the relevant floor, data on the display mode of at least one of the floor above and one floor below the relevant floor, and data on the display mode of the other floors.

[0058] According to the construction reference data having the above-described data structure, the display control unit 21 can perform display control to make the display mode of a virtual object corresponding to the floor on which the worker is present different from the display mode of a virtual object corresponding to a floor other than the floor on which the worker is present, by reading out the construction reference data corresponding to the floor on which the worker is present.

[0059] The construction reference data is not limited to the above data structure. For example, the rail drawing data and the rail bracket drawing data may include two types of data with different display modes as data for parts corresponding to each floor. In this case, the display control unit 21 can perform display control to change the display modes as described above by selecting data to be read out depending on the floor where the worker is present. In other words, with regard to the drawing data of various components, two types of data with different display modes are prepared for each part corresponding to each floor, and the display control unit 21 reads out the drawing data corresponding to the floor where the worker is present and the drawing data corresponding to the floor where the worker is not present so that the display modes are different from each other.

[0060] (Elevator installation method process flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 7. When elevator installation is started, first, in step 1 (hereinafter referred to as S1), a marker is installed on the floor surface at a predetermined position in the landing of each floor. At this time, as described above, the marker is installed with reference to a position reference object such as the piano wire 103.

[0061] Next, in S2, the worker wears the smart glasses 1 on the floor where the worker is to work, and the image capturing unit 4 captures an image of a marker corresponding to the floor where the worker is located, and the position recognition unit 22 performs position recognition processing. Here, the position recognition unit 22 identifies the floor where the worker is located based on the information included in the marker.

[0062] The position recognition unit 22 may determine whether or not the marker is installed on the floor where the worker is present, depending on the distance to the marker. This allows the marker installed on the floor where the worker is present to be properly recognized, even if markers on other floors are included within the imaging range of the imaging unit 4. The distance to the marker may be determined, for example, based on the size of the marker in the captured image, or a distance sensor such as LiDAR (Light Detection And Ranging) may be used.

[0063] When the position recognition is performed, in S3, the display control unit 21 overlays a virtual object according to the floor recognized by the position recognition unit 22. Once the worker has caused the position recognition unit 22 to recognize the position using the markers M1 and M2, the worker can view the virtual object with its relative positional relationship with the real space maintained even if the worker subsequently changes the viewing direction or moves.

[0064] In this way, the floor where the worker is working is identified based on the marker, and a virtual object corresponding to that floor is displayed, so the worker can check information appropriate for that floor without having to take the time to input floor information, etc. Also, the position recognition is performed by having the display device recognize the marker corresponding to the floor where the worker is working. Therefore, the accuracy of the display position of the overlay display can be improved compared to when position recognition is performed based on markers present on other floors.

[0065] In the above example, the floor where the worker is located is identified based on the information contained in the marker, but the present invention is not limited to this. For example, the floor number indicated on the landing or elevator may be recognized.

[0066] Also, the worker himself may input the floor on which he is present using an input means such as an input interface using a virtual object. Also, by inputting the floor he wants to display using such an input means, it may be possible to display a virtual object relating to a floor on which the worker is not present.

[0067] In this state, in S4, the worker performs the construction work while checking the construction reference information overlaid and displayed by the display control unit 21. Specifically, the worker performs a positioning work for installing the rail bracket at a position corresponding to the floor where the worker is present (a work of marking the installation position of the rail bracket on the wall surface in the elevator shaft) and the like. The actual installation work of the rail bracket (anchor bolt installation work, rail bracket installation work, etc.) may be performed with the worker removing the smart glasses 1, or may be performed with the smart glasses 1 attached. In addition, the construction work is not limited to the above-mentioned rail bracket positioning work, and other work may be performed. The construction work includes not only the actual construction work, but also the check work after the construction work is performed.

[0068] Next, in S5, it is confirmed whether the floor where the worker is present has changed. If the answer is Yes in S5, that is, if the worker has moved to another floor, the process returns to S2, and the position is recognized based on the marker set on the floor after the worker has moved. This allows the display device to recognize the marker corresponding to the floor where the worker is working again even if the worker has moved to a different floor, so that the accuracy of the display position of the overlay display can be maintained at a high level.

[0069] If the answer to S5 is No, i.e., the floor where the worker is present has not changed, the end of the construction work is confirmed in S6. If the answer to S6 is No, i.e., the construction work is continuing, the process from S3 is repeated, and if the answer to S6 is Yes, i.e., the construction work has ended, the process is terminated.

[0070] The above construction method and smart glasses 1 enable efficient construction of elevators. Such effects also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, for example, "Support the development of sustainable and resilient buildings using locally sourced materials in least developed countries, including through financial and technical assistance."

[0071] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0072] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program to realize each function described in each of the above embodiments.

[0073] The program may be non-transitory and may be recorded in one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be provided to the device via any wired or wireless transmission medium.

[0074] In addition, some or all of the functions of each of the control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks can be realized by, for example, a quantum computer.

[0075] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may be executed by the control device or another device (for example, an edge computer or a cloud server).

[0076] (summary) An elevator construction method according to aspect 1 of the present invention is an elevator construction method using a display device that overlays virtual objects in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, the method including a marker installation step of installing markers for the display device to recognize the position of the real space at positions corresponding to each floor of a building in which the elevator is installed, a position recognition step of causing the display device to recognize the marker corresponding to the floor on which the worker is located by image recognition and recognize the position of the real space, and a construction step of performing construction work with construction reference information regarding the construction of the elevator overlaid on the real space as the virtual object by the display device.

[0077] According to the above method, markers are placed on each floor, and when actually performing work, the marker corresponding to the floor on which the work is being performed is recognized by the display device, and the construction work is performed. As a result, even if the worker moves to a different floor on which the work is being performed, the marker corresponding to the floor on which the work is being performed is recognized by the display device again, so that the accuracy of the display position of the overlay display can be maintained at a high level.

[0078] An elevator installation method according to a second aspect of the present invention may be a method in which, in the marker installation step, the markers are installed on a floor surface of a landing at each floor of the elevator.

[0079] According to the above method, the markers installed on the floor of the elevator hall can be used to make the display device recognize the position in real space, allowing the worker to perform safe work while reducing the risk of falling into the elevator shaft. Also, after the elevator doors have been installed at the entrance, the position can be recognized by reading the markers in the hall space in front of the doors.

[0080] In addition, for example, during the construction stage of a building in which an elevator is installed, various processing is added from time to time to the wall surface of the landing, and there is a high possibility that the shape will change significantly. In other words, if the marker is re-installed in response to the change in shape, the position of the marker will change significantly, and the reference for the position of the overlay display will be changed significantly. In this case, it becomes necessary to significantly change the position of the marker in the data for the overlay display. In contrast, according to the above method, since the shape of the floor surface changes little during the construction stage of a building, even if the height is changed slightly due to, for example, beautifying the floor surface, and the marker is re-installed, the change in the position of the marker will be relatively small. Therefore, it is possible to deal with this by fine-tuning the data for the overlay display.

[0081] An elevator construction method according to aspect 3 of the present invention may be a method in which, in the construction process of aspect 1 above, positioning work is performed to install a rail bracket connecting the elevator rail and the wall surface of the hoistway at a position corresponding to the floor where the worker is located.

[0082] According to the above method, in the positioning work for installing the rail brackets at the positions corresponding to each floor, the worker can accurately recognize the installation positions and perform the construction work.

[0083] An elevator construction method according to aspect 4 of the present invention may be a method in which, in the position recognition process of aspect 1 above, the floor on which the worker is located is identified by the display device based on information contained in the recognized marker, and, in the construction process, the construction reference information corresponding to the floor recognized in the position recognition process is displayed by the display device.

[0084] According to the above method, the floor on which the worker is working is identified based on the marker recognized by the display device, and construction reference information corresponding to that floor is displayed, so that the worker can check the information appropriate for that floor without having to take the time to input floor information.

[0085] A display device according to aspect 5 of the present invention is a display device that overlays virtual objects in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, and is configured to include a position recognition unit that recognizes the position of the real space including the elevator shaft by performing image recognition of a marker that corresponds to the floor on which the worker is located, among markers installed at positions corresponding to each of the floors of a building in which the elevator is installed, in response to an instruction from the worker, and a display control unit that overlays construction reference information regarding the construction of the elevator on the real space as the virtual object based on the marker.

[0086] A display device according to aspect 6 of the present invention may be configured in the above-mentioned aspect 5 such that the position recognition unit identifies the floor on which the worker is located based on information contained in the recognized marker, and the display control unit displays the construction reference information corresponding to the floor recognized by the position recognition unit.

[0087] A display control method according to aspect 7 of the present invention is a display control method for overlaying a virtual object in an arrangement corresponding to a position in the real space on the field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, the method including a position recognition step for recognizing the position of the real space including the elevator shaft by image recognition of a marker corresponding to the floor on which the worker is located, among markers installed at positions corresponding to each of the floors of a building in which the elevator is installed, in response to an instruction from the worker, and a display control step for overlaying construction reference information regarding the construction of the elevator on the real space as the virtual object based on the marker.

[0088] A display control program according to an eighth aspect of the present invention is a display control program for causing a computer to function as the display device in the above-mentioned fourth aspect, and causes the computer to function as the position recognition unit and the display control unit.

[0089] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0090] 1. Smart glasses (display device) 2. Control section 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 25 Spatial ranging section 101 Opening 102 Hoistway 103 Piano wire 200 platform 201 Floor 202, 300 Wall BR1, BR2, BR3 Rail Brackets DAT1, DAT2 floor construction reference data DAT11, DAT21, DATN1 rail drawing data DAT12, DAT22, DATN2 Rail bracket drawing data M1·M2, M11·M12, M21·M22, M31·M32 markers QR1 QR2 2D code RL1, RL2, RL3 rails

Claims

1. 1. An elevator installation method using a display device that displays a virtual object in an overlay manner in accordance with a position in a real space, on a field of view of a worker viewing a real space including an elevator shaft, or on an image representing the real space, the method comprising: a marker installation step of installing markers for the display device to recognize positions in the real space at positions corresponding to each floor of a building in which the elevator is provided; a position recognition step of causing the display device to recognize the marker corresponding to the floor where the worker is present by image recognition, and to recognize the position of the marker in the real space; and a construction step of performing construction work while overlaying construction reference information regarding the construction of the elevator as the virtual object in the real space using the display device.

2. 2. The elevator construction method according to claim 1, wherein in the marker installation step, the markers are installed on a floor surface of a landing of each floor of the elevator.

3. 2. The elevator installation method according to claim 1, wherein in the installation step, a positioning operation is performed to install a rail bracket that connects the elevator rail and a wall surface of the hoistway at a position corresponding to the floor where the worker is present.

4. In the position recognition step, the floor on which the worker is present is identified by the display device based on information included in the recognized marker, The elevator construction method according to claim 1 , wherein, in the construction step, the construction reference information corresponding to the floor recognized in the position recognition step is displayed by the display device.

5. A display device that displays a virtual object in an overlay manner in accordance with a position in a real space in a field of view of a worker viewing a real space including an elevator shaft or an image representing the real space, the display device comprising: a position recognition unit that recognizes a position in the real space including the elevator shaft by performing image recognition of a marker corresponding to the floor on which the worker is present, among markers installed at positions corresponding to each floor of the building in which the elevator is provided, in response to an instruction from the worker; A display control unit that overlays construction reference information regarding the construction of the elevator as the virtual object in the real space based on the marker.

6. The position recognition unit identifies the floor on which the worker is present based on information included in the recognized marker, The display device according to claim 5 , wherein the display control unit displays the construction reference information corresponding to the floor recognized by the position recognition unit.

7. 1. A display control method for overlaying a virtual object on a field of view of a worker viewing a real space including an elevator shaft or on an image representing the real space, in an arrangement according to a position in the real space, comprising: a position recognition step of recognizing a position in the real space including the elevator shaft by performing image recognition of a marker corresponding to the floor on which the worker is present, among markers installed at positions corresponding to each floor of the building in which the elevator is provided, in response to an instruction from the worker; A display control method comprising: a display control step of overlaying construction reference information regarding the construction of the elevator as the virtual object in the real space based on the marker.

8. 6. A display control program for causing a computer to function as the display device according to claim 5, the display control program causing a computer to function as the position recognition unit and the display control unit.

Images