Elevator construction method, display device, display control method and display control program
The display device uses markers and image recognition to safely guide elevator construction by overlaying virtual objects, addressing the risk of workers falling into the shaft and improving work efficiency.
Patent Information
- Application Number
- JP2024045610
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-21
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2044-03-21
AI Technical Summary
During elevator construction, workers wearing smart glasses for position recognition face a risk of falling into the elevator shaft due to limited field of vision and distraction, as they perform tasks in real-world environments where doors are not yet installed.
A display device that overlays virtual objects corresponding to real-space positions using markers on the elevator landing and hoistway, enabling safe construction by recognizing these positions through image recognition and overlaying construction reference information.
Ensures safe elevator construction by minimizing the risk of workers falling into the shaft while enhancing workability and efficiency through accurate position recognition and virtual object overlays.
Smart Images

Figure 2025145433000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an elevator installation method using a display device that overlays virtual objects in an arrangement corresponding to positions in the real space onto the field of view of a worker viewing a real space including an elevator landing and a hoistway, or onto an image representing the real space. [Background technology]
[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]
[0004] During the construction stage of a building, there are situations where doors are not installed between the elevator shaft and the landing. In such situations, it is expected that workers will wear smart glasses and perform position recognition tasks in the real world. When wearing smart glasses, the worker's field of vision is somewhat limited, and there is a risk that they may fall into the elevator shaft if they are distracted by the position recognition task.
[0005] One aspect of the present invention aims to provide an elevator construction method that can ensure the safety of workers during elevator construction work using a display device that overlays virtual objects in an arrangement that corresponds to their position in real space. [Means for solving the problem]
[0006] In order to solve the above problems, the elevator construction method of the present invention uses a display device that overlays virtual objects in an arrangement corresponding to the position in the real space onto the field of view of a worker viewing a real space including an elevator landing and a hoistway, or onto an image representing the real space, and includes a marker installation step in which the display device installs a marker on at least one of the floor and wall of the elevator landing to allow the display device to recognize the position in the real space; a position recognition step in which the display device recognizes the marker by image recognition and recognizes the position in the real space; and a construction step in which construction work is performed with construction reference information regarding the construction of the elevator overlaid on the real space as the virtual object by the display device.
[0007] In order to solve the above problems, the display device of the present invention is a display device that overlays virtual objects in an arrangement corresponding to the position in the real space onto the field of view of a worker viewing a real space including an elevator landing and hoistway, or onto an image representing the real space, and is configured to include a position recognition unit that recognizes the position of the real space including the elevator landing and hoistway by image recognition of markers installed on at least one of the floor and wall surfaces of the elevator landing, and a display control unit that overlays construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the markers.
[0008] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object in an arrangement according to the position in the real space on the field of view of a worker viewing a real space including an elevator landing and hoistway, or on an image representing the real space, and includes a position recognition step that recognizes the position of the real space including the elevator landing and hoistway by image recognition of markers installed on at least one of the floor and wall of the elevator landing, and a display control step that overlays construction reference information regarding the construction of the elevator on the real space as the virtual object based on the markers.
[0009] The display device according to each aspect of the present invention may be realized by a computer. In this case, the display control program for the display device that causes the computer to operate as each part (software element) of the display device to realize the display device, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]
[0010] According to the present invention, it is possible to achieve the effect of enabling workers to perform safe work while reducing the risk of falling into the elevator shaft. [Brief explanation of the drawings]
[0011] [Figure 1] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 3] FIG. 1 is a diagram showing a state in which smart glasses 1 are attached to a work helmet 11. [Figure 4] FIG. 10 is a diagram showing an example of a state in which a virtual object OB is overlaid and displayed. [Figure 5]FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 6] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, one embodiment of the present invention will be described in detail.
[0013] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 11. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 11.
[0014] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and also view the projected image within the real space. That is, the smart glasses 1 overlay virtual objects as construction reference information for elevator construction in the field of view of a worker viewing the real space including the elevator landing and hoistway, with the objects positioned according to their position in the real space.
[0015] 4 shows an example of a state in which a virtual object OB is overlaid and displayed in real space. As shown in the figure, the virtual object OB is displayed in a space a predetermined distance away from a wall surface 300 in real space. This allows the worker to confirm in real space the position in three-dimensional space where the construction work should be performed. This eliminates the need for tasks such as measuring and confirming the position where the construction work should be performed in real space, thereby improving workability.
[0016] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.
[0017] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information.
[0018] (Details of smart glasses configuration) 2 is a block diagram showing an outline of the configuration of the smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, and a warning control unit 24.
[0019] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.
[0020] The display control unit 21 reads out construction reference information including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.
[0021] The display control unit 21 may acquire construction reference information from outside via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This makes it possible to update the data stored in the storage unit 5 and acquire new data.
[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.
[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.
[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.
[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.
[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.
[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.
[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.
[0029] (Example of a real space where an elevator is installed) Figure 5 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.
[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.
[0031] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.
[0032] In addition, in this embodiment, the markers M1 and M2 are provided on the floor surface 201, but this is not limitative, and the markers M1 and M2 may be provided on the wall surface 202. However, providing the markers M1 and M2 on the floor surface 201 is preferable for the following reasons.
[0033] For example, during the construction of a building in which an elevator will be installed, various modifications will be added to the wall surface 202 of the hall 200 from time to time, and the shape is likely to change significantly. For example, it is conceivable that initially there are no walls, and only support pillars are installed, and at some point walls will be installed. In other words, if markers are repositioned in response to changes in the environment, the marker positions will change significantly, significantly altering the reference position for the overlay display. In this case, it may be necessary to significantly change the marker positions in the data for the overlay display, and in some cases, it may even be necessary to change the definition of the positional relationship between the markers and the virtual object itself. In contrast, when markers M1 and M2 are placed on the floor surface 201, the shape of the floor surface 201 changes little during the construction of a building. Therefore, even if the height of the floor surface 201 is slightly changed, for example, due to floor beautification, and markers M1 and M2 are repositioned, the change in the positions of markers M1 and M2 will be relatively small. Therefore, this can be addressed by fine-tuning the data for the overlay display. Details of the data adjustment process associated with changes in the positions of markers M1 and M2 will be described later.
[0034] Furthermore, in this embodiment, the markers M1 and M2 are provided at the hall 200, but the markers may be provided in the hoistway 102. However, providing the markers M1 and M2 at the hall 200 is preferable for the following reasons.
[0035] When performing position recognition using the position recognition unit 22, the worker wears the smart glasses 1 and captures an image of the marker using the imaging unit 4, causing the position recognition unit 22 to perform position recognition processing. Here, if the marker is installed inside the elevator shaft 102, the worker needs to approach the elevator shaft 102 to capture the image of the marker. Since the worker is wearing the smart glasses 1, his or her field of vision is somewhat limited, and it is expected that the worker will not be able to check his or her feet properly while concentrating on recognizing the marker. In other words, there is a risk of the worker falling into the elevator shaft 102. In contrast, if the markers M1 and M2 are installed at the landing 200, the marker recognition work can be performed in an area away from the opening 101 to the elevator shaft 102 at the landing 200, allowing the worker to perform safe work while reducing the risk of falling into the elevator shaft 102. Furthermore, once a door has been installed at the opening 101, which is the elevator entrance, position recognition by reading the marker can be performed in the landing space in front of the door.
[0036] Furthermore, in the middle of the construction of a building, a safety fence for preventing elevators from falling into the hoistway 102 may be placed in front of the opening 101 to the hoistway 102 at the landing 200. In this case, by providing markers M1 and M2 on the floor surface 201 between the safety fence and the opening 101, the markers M1 and M2 are placed in an area that is difficult for people to enter, and it is possible to prevent the markers M1 and M2 from being moved inadvertently.
[0037] Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.
[0038] FIG. 6 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using these piano wires as positional references, it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.
[0039] Alternatively, a laser beam may be used as a position reference, for example. That is, by irradiating a laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, or by irradiating a laser beam vertically upward from a predetermined position in the lower part of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that errors due to the thickness of the beam may be affected depending on the height of the building. Alternatively, a reference point (architectural markings) marked on the landing of each floor may be used as a position reference.
[0040] Furthermore, multiple landings 200 will be provided for each floor for one elevator, and it is preferable to install the markers at the same location in relation to the elevator entrance / exit, i.e., at the same relative position in relation to the entrance, at each landing 200.
[0041] In many cases, all halls 200 for the same elevator have the same structural arrangement. In this case, since markers M1 and M2 can be installed in the same locations relative to the elevator entrances at each hall 200, the marker installation work can be performed using the same standards and work. This allows the marker installation work to be performed efficiently. In addition, the data for overlay display can also have a common data structure among multiple halls 200.
[0042] (Data adjustment process according to the position change of markers M1 and M2) As described above, the markers M1 and M2 are provided on the floor surface 201 of the landing 200. Here, when a building is under construction, the surface of the floor surface 201 is beautified, and it is conceivable that the markers M1 and M2 will be repositioned before and after the beautification. The height of the markers M1 and M2 will change before and after this beautification. Here, in many cases, the change in height of the markers M1 and M2 before and after the beautification is on the order of a few millimeters to a few centimeters. Furthermore, it is possible to prevent the horizontal positions of the markers M1 and M2 from changing before and after the beautification.
[0043] If the position of the marker changes significantly, the positional relationship between the virtual object and the marker must be significantly changed in the data for overlay display.In contrast, even if markers M1 and M2 are repositioned due to floor beautification as described above, the change in the marker position is limited to the vertical direction, and the amount of change is small, so correcting the data is relatively easy.
[0044] Specifically, the input control unit 23 causes the display control unit 21 to display an interface for changing the height positions of the markers M1 and M2 as a virtual object, and allows the worker to input the desired height. More specifically, an interface displaying input options is displayed, and the worker selects a virtual object corresponding to the desired height change of the markers M1 and M2. The worker then inputs a height change amount corresponding to the actual construction work using a virtual object such as a numeric keypad, and the input control unit 23 accordingly corrects the data indicating the positional relationship between the virtual object and the markers. As described above, the height change amount may be input by the worker using various input devices such as a wireless keyboard, and the communication unit 6 may communicate with the input device to receive the input.
[0045] (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Figure 1. When elevator installation begins, first in step 1 (hereinafter referred to as S1), markers M1 and M2 are installed at predetermined positions in the hall 200. At this time, as described above, the markers M1 and M2 are installed using a position reference object such as the piano wire 103 as a reference. After that, the worker puts on the smart glasses 1 and starts the installation work.
[0046] Next, in S2, it is confirmed whether the heights of the markers M1 and M2 have been changed. That is, it is confirmed whether the height of the floor surface 201 on which the markers M1 and M2 are placed in S1 has been changed from the height of the floor surface 201 assumed at the time when the data for overlay display was created. This confirmation may be performed by the input control unit 23 displaying an interface as a virtual object when the worker issues an instruction to start position recognition processing, which will be described later. Alternatively, the worker may instruct the input control unit 23 to display an interface for voluntarily inputting an instruction to change the heights of the markers M1 and M2.
[0047] If the answer to S2 is YES, i.e., if the heights of the markers M1 and M2 have been changed, the worker inputs the amount of height change in S3. The worker specifies the amount of height change by measuring the actual amount of change in the height of the floor surface 201 or by checking the design specifications for the beautification treatment of the floor surface 201. The amount of height change input by the worker is accepted by the input control unit 23, and the data for overlay display is corrected. The corrected data is saved in the memory unit 5 or saved in an external database via the communication unit 6.
[0048] If S2 returns No or S3 is performed, S4 causes the imaging unit 4 to capture an image of the marker, and the position recognition unit 22 performs position recognition processing. After position recognition is performed, S5 causes the display control unit 21 to overlay a virtual object. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize the position, the worker can view the virtual object while maintaining its relative positional relationship with the real space, even if the worker subsequently changes his or her viewing direction or moves. In this state, in S6, the worker performs construction work while checking the construction reference information overlaid by the display control unit 21. Note that construction work includes not only the actual construction work but also checks performed after the construction work is completed. Then, in S7, the completion of the construction work is confirmed. If S7 returns No, meaning that the construction work is continuing, the processing from S5 is repeated. If S7 returns Yes, meaning that the construction work has completed, the processing ends.
[0049] If the floor surface 201 is processed during the construction work and it becomes necessary to reposition the markers M1 and M2, the process starts from S1.
[0050] The above construction method and smart glasses 1 enable elevator construction to be carried out safely and efficiently. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."
[0051] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).
[0052] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.
[0053] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.
[0054] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.
[0055] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device or on another device (for example, an edge computer or a cloud server).
[0056] (summary) An elevator construction method according to aspect 1 of the present invention is an elevator construction method using a display device that overlays virtual objects in an arrangement corresponding to the position in the real space onto the field of view of a worker viewing a real space including an elevator landing and hoistway, or onto an image representing the real space, and includes a marker installation process in which the display device installs a marker on at least one of the floor and wall of the elevator landing to allow the display device to recognize the position in the real space; a position recognition process in which the display device recognizes the marker by image recognition and recognizes the position in the real space; and a construction process in which construction reference information regarding the construction of the elevator is overlaid on the real space as the virtual object by the display device, and construction work is performed.
[0057] According to the above method, the markers installed on the floor and / or wall of the elevator hall can be used to display the real-world location of the worker, allowing the worker to perform safe work while minimizing the risk of falling into the elevator shaft. Furthermore, once the elevator doors have been installed at the entrance, the markers can be read to identify the worker's location in the hall space in front of the doors. An elevator installation method according to a second aspect of the present invention may be a method in which, in the marker installation step, the marker is installed on a floor surface of the elevator hall.
[0058] For example, during the construction of a building in which an elevator will be installed, various modifications will be added to the walls of the landing area from time to time, and there is a high possibility that the shape will change significantly. In other words, if the markers are repositioned in response to changes in the shape, the marker positions will change significantly, which will significantly alter the reference position for the overlay display. In this case, it becomes necessary to significantly change the marker positions in the data for the overlay display. In contrast, with the above method, since the shape of the floor surface changes little during the construction of a building, even if the height is slightly changed, for example, due to floor beautification, and the markers are repositioned, the change in the marker positions will be relatively small. Therefore, it is possible to address this issue by fine-tuning the data for the overlay display. An elevator installation method according to aspect 3 of the present invention may be a method in which, in the marker installation step of aspect 1 above, the marker is installed based on a piano wire suspended within the elevator shaft, or a laser beam irradiated within the elevator shaft as a positional reference.
[0059] According to the above method, markers are placed based on piano wires whose relative positions to the building structure are precisely positioned, so that the construction reference information in the overlay display can be displayed in an accurate position without any deviation from the real space. An elevator installation method according to a fourth aspect of the present invention may be a method in which, in the marker installation step, the markers are installed at the same locations relative to elevator entrances at a plurality of the halls.
[0060] In many cases, all halls for the same elevator have the same structural layout. In this case, the above method simply requires that markers be installed in the same locations relative to the elevator entrances at each hall, allowing marker installation work to be performed using the same standards and procedures. This allows for efficient marker installation work. Furthermore, data for overlay display on the display device can also have a common data structure across multiple halls. An elevator construction method according to aspect 5 of the present invention may be a method in which, in the marker installation step of aspect 2 above, if the height of the floor surface on which the marker is installed is changed, the marker is reinstalled on the floor surface whose height has been changed, and an input step is further included in which the amount of change in the height of the floor surface is input into the display device.
[0061] According to the above method, even if the floor height is changed during the construction stage of a building, the positional accuracy of the overlay display can be maintained accurately by simply inputting the amount of change into the display device. A display device according to a sixth aspect of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including an elevator landing and hoistway, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and is configured to include a position recognition unit that recognizes the position of the real space including the elevator landing and hoistway by performing image recognition of markers installed on at least one of the floor and wall surfaces of the elevator landing, and a display control unit that overlays construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the markers. The display device of aspect 7 of the present invention, in aspect 6 above, further includes an input control unit that accepts input of the amount of change in the height of the floor surface when the height of the floor surface on which the marker is placed changes and the marker is re-placed on the floor surface with the changed height, and the display control unit may be configured to change the position at which the construction reference information is overlaid on the real space based on the amount of change in the height of the floor surface accepted by the input control unit. The display device according to aspect 8 of the present invention may be configured in the above-mentioned aspect 6, further comprising a warning control unit that issues a warning to the worker when the position recognition unit recognizes that the worker's position is within a predetermined area near the elevator shaft.
[0062] According to the above configuration, a warning is issued when the possibility of the worker falling into the elevator shaft increases, thereby further improving the safety of the worker. A display control method according to aspect 9 of the present invention is a display control method for overlaying a virtual object onto the field of view of a worker viewing a real space including an elevator landing and hoistway, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, the method comprising: a position recognition step for recognizing the position of the real space including the elevator landing and hoistway by image recognition of markers installed on at least one of the floor and wall of the elevator landing; and a display control step for overlaying construction reference information regarding the construction of the elevator onto the real space as the virtual object based on the markers. A display control program according to aspect 10 of the present invention is a display control program for causing a computer to function as the display device in aspect 6 above, and causes the computer to function as the position recognition unit and the display control unit.
[0063] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]
[0064] 1. Smart glasses (display device) 2. Control section 3 Projection section 4. Imaging unit 5 Storage section 6. Communications Department 7 Audio input / output section 11 Safety helmet 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 101 Opening 102 Elevator 103 Piano wire Platform 200 201 Floor 202, 300 walls M1 / M2 markers
Claims
1. 1. An elevator installation method using a display device that overlays and displays virtual objects in an arrangement corresponding to positions in the real space on a field of view of a worker viewing a real space including an elevator landing and a hoistway, or on an image representing the real space, the method comprising: a marker installation step of installing a marker on at least one of a floor surface and a wall surface of the elevator hall so that the display device can recognize a position in the real space; a position recognition step of causing the display device to recognize the marker by image recognition and recognize the position of the marker in real space; and a construction step of performing construction work while overlaying construction reference information regarding the construction of the elevator as the virtual object in the real space using the display device.
2. 2. The elevator installation method according to claim 1, wherein the marker is installed on a floor surface of the elevator hall in the marker installation step.
3. 2. The elevator installation method according to claim 1, wherein in the marker installation step, the marker is installed based on a piano wire suspended in the elevator shaft or a laser beam irradiated as a positional reference in the elevator shaft.
4. 2. The elevator installation method according to claim 1, wherein the marker installation step installs the markers at the same locations relative to elevator entrances in a plurality of the halls.
5. In the marker installation step, when the height of the floor surface on which the marker is installed is changed, the marker is reinstalled on the floor surface whose height has been changed; 3. The elevator construction method according to claim 2, further comprising an input step of inputting the amount of change in floor height into the display device.
6. A display device that overlays and displays virtual objects in an arrangement according to positions in the real space on a field of view of a worker viewing a real space including an elevator landing and a hoistway, or on an image representing the real space, the display device comprising: a position recognition unit that recognizes a position in the real space including the elevator hall and the elevator shaft by performing image recognition of a marker installed on at least one of a floor surface and a wall surface of the elevator hall; a display control unit that overlays construction reference information regarding the construction of the elevator as the virtual object in the real space based on the marker.
7. an input control unit that, when the height of the floor surface on which the marker is placed is changed and the marker is placed again on the floor surface whose height has been changed, receives an input of an amount of change in the height of the floor surface; The display device according to claim 6 , wherein the display control unit changes a position where the construction reference information is overlaid and displayed in the real space based on the amount of change in the height of the floor surface received by the input control unit.
8. The display device according to claim 6, further comprising a warning control unit that issues a warning to the worker when the position recognition unit recognizes that the worker is located within a predetermined area near the elevator shaft.
9. A display control method for overlaying a virtual object on a field of view of a worker viewing a real space including an elevator landing and a hoistway, or on an image representing the real space, in an arrangement according to a position in the real space, the method comprising: a position recognition step of recognizing a position in the real space including the elevator hall and the elevator shaft by performing image recognition of a marker installed on at least one of a floor surface and a wall surface of the elevator hall; and a display control step of overlaying construction reference information regarding the construction of the elevator as the virtual object in the real space based on the marker.
10. 7. A display control program for causing a computer to function as the display device according to claim 6, wherein the display control program causes the computer to function as the position recognition unit and the display control unit.
Citation Information
Patent Citations
Method for assisted installation
EP3964471A1
Device for installing elevator in tower
JP1984158780A
Alerting device
JP2018002337A
System for virtual display and method of use
US20220155592A1
Drawing projection system, drawing projection method and program
JP2018163466A