Display device, display control method, and display control program

Abstract

To provide a display device that displays virtual objects in an overlay arrangement corresponding to positions in real space, which can efficiently provide a construction work environment with excellent visibility.SOLUTION: A device comprises a display control unit (21) that reads and displays construction reference information (D) related to virtual objects from display data for an overlay display. The display data is data with which the construction reference information (D) is associated for each step in construction work, and the display control unit (21) displays the construction reference information (D) corresponding to the steps specified by workers.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display device that overlays virtual objects in an arrangement according to positions in the real space onto the field of view of a worker viewing the real space where a building is to be constructed, or onto an image representing the real space. [Background technology]

[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]

[0004] Using the above technology, it is conceivable to overlay an image showing the installation position of a construction object onto the real space where the work is being carried out. For example, this overlay display technology can be used when constructing an elevator shaft or landing in a building. There are many construction objects in the shaft or landing, and if all of these are overlaid, the visibility of each construction object will be reduced, and the visibility of the real space will also be reduced.

[0005] One aspect of the present invention aims to provide a display device that overlays virtual objects in an arrangement that corresponds to a position in real space, and that can efficiently provide a construction work environment with good visibility. [Means for solving the problem]

[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and is equipped with a display control unit that reads and displays construction reference information related to the virtual object from display data for the overlay display, the display data being data in which construction reference information is associated with each process in construction work, and the display control unit is configured to display the construction reference information corresponding to the process specified by the worker.

[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and includes a display control step that reads and displays construction reference information related to the virtual object from display data for the overlay display, the display data being data in which construction reference information is associated with each process in construction work, and in the display control step, the construction reference information corresponding to the process specified by the worker is displayed.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, a display control program that causes the computer to operate as each part (software element) of the display device to realize the display device on a computer, and a computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0009] According to the present invention, since the worker can select and display the construction reference information that he / she needs to display for each process, it is possible to efficiently display only the necessary information. Therefore, it is possible to provide a construction work environment with good visibility and to achieve the effect of realizing the efficiency of the construction work. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing a schematic configuration of a construction reference information generating device 11 according to an embodiment of the present invention. [Figure 3] 1 is a diagram showing a state in which smart glasses (display device) 1 according to the present embodiment are attached to a safety helmet 111. FIG. [Figure 4] FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] FIG. 10 is a perspective view showing an example of a state in which a rail bracket RLB as a virtual object is overlaid and displayed in real space. [Figure 7] FIG. 10 is a perspective view showing an example of a state in which an IR plate IRP and an IR plate bracket IRPB are overlaid and displayed as virtual objects in real space. [Figure 8] FIG. 10 is a side view showing a state in which virtual objects relating to a large number of construction targets are displayed simultaneously. [Figure 9] FIG. 10 is a side view showing an example in which a virtual object displayed for each process is changed. [Figure 10] FIG. 10 is a side view showing an example in which the overlay display in the process indicated by 902 in FIG. 9 is further displayed for each construction target as a component. [Figure 11] FIG. 10 is a diagram showing a display example of an input interface that receives instruction input from a worker as a virtual object. [Figure 12] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 111. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 111.

[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and also view the projected image within the real space. That is, the smart glasses 1 overlay virtual objects as construction reference information for elevator construction in the field of view of a worker viewing the real space including the elevator landing and hoistway, with the objects positioned according to their position in the real space.

[0014] 6 shows an example of a state in which a rail bracket RLB as a virtual object is overlaid on real space. As shown in the figure, the rail bracket RLB as a virtual object is displayed on a wall surface 300 in real space. This allows the worker to confirm in real space the position in three-dimensional space where the construction work should be performed. This eliminates the need to measure and confirm the position where the construction work should be performed in real space, thereby improving workability.

[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information. Details of the construction reference information will be described later.

[0017] (Details of smart glasses configuration) Fig. 1 is a block diagram showing an outline of the configuration of smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, and a warning control unit 24.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.

[0019] The display control unit 21 reads out construction reference information D including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.

[0020] The storage unit 5 stores first process step data D1 and second process step data D2 as construction reference information D. The number of process step data is not limited, and more process step data may be included. The first process step data D1 includes 1-1 component data D11 and 1-2 component data D12. The second process step data D2 includes 2-1 component data D21 and 2-2 component data D22. The number of component data included in each process step data is not limited, and more component data may be included. Details of these data will be described later.

[0021] The display control unit 21 may acquire the construction reference information D from an external source via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This allows the data stored in the storage unit 5 to be updated or new data to be acquired.

[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.

[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.

[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.

[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.

[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0029] (Example of a real space where an elevator is installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.

[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0031] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.

[0032] Furthermore, in this embodiment, the markers M1 and M2 are provided at the hall 200, but the markers may also be provided within the hoistway 102.

[0033] Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.

[0034] FIG. 5 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using this piano wire as a position reference (reference line), it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.

[0035] Alternatively, a laser beam may be used as a position reference, for example. That is, by irradiating a laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, or by irradiating a laser beam vertically upward from a predetermined position in the lower part of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that errors due to the thickness of the beam may be affected depending on the height of the building. Alternatively, a reference point (architectural markings) marked on the landing of each floor may be used as a position reference.

[0036] Furthermore, multiple landings 200 will be provided for each floor for one elevator, and it is preferable to install the markers at the same location in relation to the elevator entrance / exit, i.e., at the same relative position in relation to the entrance, at each landing 200.

[0037] In many cases, all halls 200 for the same elevator have the same structural arrangement. In this case, since markers M1 and M2 can be installed in the same locations relative to the elevator entrances at each hall 200, the marker installation work can be performed using the same standards and work. This allows the marker installation work to be performed efficiently. In addition, the data for overlay display can also have a common data structure among multiple halls 200.

[0038] Each of the markers M1 and M2 may be provided with a two-dimensional code. In Fig. 4, each of the markers M1 and M2 is provided with a two-dimensional code QR1 or QR2. The two-dimensional codes QR1 and QR2 indicate information about the floor on which the marker M1 or M2 is located. In other words, when the position recognition unit 22 recognizes the markers M1 and M2 in the captured image, it also recognizes the two-dimensional codes QR1 and QR2, thereby enabling it to recognize information about the floor on which the read marker M1 or M2 is located.

[0039] The floor information included in the marker is not limited to a two-dimensional code. For example, the marker may display text such as "3F," which may be acquired as floor information through character recognition. Furthermore, the marker may be colored specific to each floor or display an image with a specific shape, allowing the floor to be recognized through image recognition.

[0040] (Details of construction reference information) Next, the construction reference information D will be described. As described above, the construction reference information D includes the first process step data D1 and the second process step data D2. The first process step data D1 includes the 1-1 component data D11 and the 1-2 component data D12. The second process step data D2 includes the 2-1 component data D21 and the 2-2 component data D22.

[0041] When constructing an elevator in a building, multiple processes are carried out in order. If there are many processes, and all construction objects involved in all processes are displayed as virtual objects in an overlay, visibility may be impaired due to the simultaneous display of many virtual objects.

[0042] In contrast, as described above, the construction reference information D includes the first process step data D1 and the second process step data D2 as data for each process, so the smart glasses 1 can select and display the construction reference information that the worker needs to display for each process step. Therefore, since only the necessary information can be displayed efficiently, a construction work environment with good visibility can be provided and the efficiency of the construction work can be improved.

[0043] Furthermore, because each process data contains part data, the construction reference information that the worker needs to display can be further selected and displayed on a part-by-part basis. This allows the construction reference information to be displayed in a focused manner, providing a more preferable viewing environment for the worker according to the progress of the construction work.

[0044] The data structure of the construction reference information D is not particularly limited, and may be, for example, a data structure in which each part data is assigned an attribute related to the process to which it belongs. Alternatively, the data structure may be such that the process is further subdivided. In other words, a plurality of sub-process data may be included in the major process data, and each of the sub-process data may include part data. The division of the process data into stages is not limited to two stages, but may be three or more stages. Furthermore, the part data may also be divided into major part data and small part data included in each major part data. The division of the part data into stages is not limited to two stages, but may be three or more stages.

[0045] (Example of overlay display) Next, a specific example of overlay display will be described. As described above, Fig. 6 is a perspective view showing a state in which a rail bracket RLB as a virtual object is overlaid on real space. Fig. 7 is a perspective view showing a state in which an IR plate IRP and an IR plate bracket IRPB as virtual objects are overlaid on real space.

[0046] The rail bracket RLB is a bracket for fixing the rail RL to the wall surface inside the hoistway 102. The IR plate IRP is a component that indicates the stopping position of the elevator car, and when the IR plate IRP interrupts a sensor attached to the car, it is determined whether the car has landed at a predetermined position on each floor. The IRP bracket IRPB is a bracket for attaching the IR plate IRP to the rail RL. That is, the construction sequence is as follows: first, a process is performed in which the rail bracket RLB is installed on the wall surface inside the hoistway 102. Next, a process is performed in which the rail RL is installed using the rail bracket RLB. After that, a process is performed in which the IR plate bracket IRP, with the IR plate IRP attached, is installed on the rail RL.

[0047] Accordingly, first, in the process of installing the rail bracket RLB, the overlay display is displayed as shown in Fig. 6. Then, after the rail RL is installed, in the process of installing the IR plate bracket IRPB, the overlay display is displayed as shown in Fig. 7. In this way, for each process, only the construction objects to be constructed in that process are overlaid, allowing workers to perform construction work while referring to the minimum necessary information with good visibility.

[0048] Next, we will explain the situation in which a larger number of construction targets are constructed. Figure 8 is a side view showing a state in which virtual objects related to a large number of construction targets are displayed simultaneously. As shown in the figure, the virtual objects displayed are a rail bracket RLB, a limit switch trough LST, a power receiving panel box bracket PRB, a governor rope guide GG, and an IR plate IRP. The limit switch trough LST is a component for attaching a limit switch that detects the position of the car near the top or bottom floor. The power receiving panel box bracket PRB is a bracket for attaching a box containing electrical equipment, including a power receiving panel that receives power from the building's power source and supplies it to the car, to the rail RL. The governor rope guide GG is a component that guides the side of the governor rope that is not fastened to the car, preventing the rope from swaying.

[0049] 8, there is provided a rail bracket RLB that fixes a rail RL1 corresponding to the car to the wall surface within the hoistway 102, and a rail bracket RLB that fixes a rail RL2 corresponding to the counterweight to the wall surface within the hoistway 102. In addition, a limit switch trough LST, a power receiving panel box bracket PRB, a governor rope guide GG, and an IR plate IRP are attached to the rail RL1.

[0050] The PRB power box bracket has an arrow indicating the up and down direction, with upper and lower limit lines at both ends of the arrow indicating the upper and lower limits of the installation position. This indicates the allowable range of the PRB power box bracket's installation position in the up and down direction. The governor rope guide GG also has a downward arrow and the reference information "within 1m from the trough." This also indicates the allowable range of the governor rope guide GG's installation position.

[0051] The position of the floor level FL is also shown. That is, each construction object is displayed as a virtual object at an accurate installation position based on the floor level FL.

[0052] Note that the construction objects are not limited to those shown in FIG. 8 . For example, the construction objects may be sill brackets, buffer bases, cable hangers, machines, machine beams, breaker boxes, control panels, hall button boxes, panel bases, and floor ducts. The sill brackets are brackets used to secure the sills (thresholds) that guide the landing doors to the wall surfaces inside the elevator shaft 102. The buffer bases are base members used to secure buffers (shock absorbers) that absorb shock in the unlikely event that the elevator car or counterweight falls to the pit at the bottom of the elevator shaft 102, and also serve to secure the rails to the bottom of the pit. The cable hangers are members used to secure the intermediate position of the traveling cable (tail cord) that connects the elevator car and the control panel. The machines are motors that raise and lower the elevator by winding up the rope, and the machine beams are members that secure the machines to the rails and pits. The breaker boxes are boxes that house breakers, and the control panels are devices that control the elevator operation. The hall button box is installed on the wall of the landing and houses the landing call buttons and a display that shows the current position and direction of the elevator car. In elevators with a machine room on the roof of a building, the electrical panel and machines must be installed in the machine room and wired together. The base that secures this electrical panel to the building is called the panel base, and the ducts that form the wiring route from each electrical panel to each machine are called floor ducts.

[0053] As described above, even in the state shown in Figure 8, a large number of construction objects are displayed, and if even more construction objects are displayed simultaneously, the amount of information displayed will become too large, and the visibility of the virtual objects will deteriorate.

[0054] Fig. 9 shows an example of changing the virtual objects displayed for each process. 901 shows a display example for the process of installing the rail bracket RLB, and 902 shows a display example for the process of installing the construction target on the rails RL1 and RL2 after the rails RL1 and RL2 have been installed. In this way, by limiting the display of virtual objects for each process to those related to the construction target required for that process, it is possible to achieve an overlay display with better visibility than the state shown in Fig. 8.

[0055] Figure 10 shows an example of an overlay display for the process shown in 902 in Figure 9, further displaying each construction object as a component. 1001 shows a state in which only the limit switch trough LST is displayed, 1002 shows a state in which only the power receiving panel box bracket PRB is displayed, 1003 shows a state in which only the governor rope guide GG is displayed, and 1004 shows a state in which only the IR plate IRP is displayed. In this way, by displaying only the component on which the worker is about to work, an overlay display with even better visibility can be achieved compared to the state shown in Figure 9.

[0056] (Example of input interface) Fig. 11 shows an example of a display of an input interface that accepts instruction input from a worker as a virtual object. In the example shown in the figure, the display content selection screen displays options for the major process steps of "attaching parts to the framework," "rail centering," "overhead equipment installation," and "attaching parts to the rails." As sub-processes belonging to the major process step of "attaching parts to the framework," options for "centering inside the tower," "installing landing equipment," and "setting up the rails" are displayed. As sub-processes belonging to the major process step of "attaching parts to the rails," options for "installing equipment inside the tower," "electrical work inside the tower," "assembling counterweights," and "installing machines" are displayed.

[0057] The option "Buffer base" is displayed as a part belonging to the sub-process of "Centering inside the tower." The process of "Centering inside the tower" corresponds to the work of stringing piano wire 103 from the top to the buffer base of the pit in the hoistway 102, and the work of centering the buffer base.

[0058] The options for "sill bracket" and "hall button box" are displayed as parts belonging to the sub-process of "landing equipment installation." The "landing equipment installation" process corresponds to the installation work of thresholds, frames, landing doors, etc. at the landing 200. For the sill bracket, at least either the main body outline or the anchor installation position is displayed as a virtual object.

[0059] The option "Rail Bracket" is displayed as a part belonging to the "Rail Setting" sub-process. The "Rail Setting" process corresponds to the work of temporarily fixing various rails. For the rail bracket RLB, at least either the outer shape of the main body or the anchor placement position is displayed as a virtual object.

[0060] The options displayed are "Governor rope guide," "IR plate," "Cable hanger," and "Various panels" as parts that belong to the sub-process of "Installation of equipment inside the tower." The process of "Installation of equipment inside the tower" corresponds to the installation of various parts to be attached to the rail RL, decorative fixtures, etc.

[0061] The options "machine" and "machine beam" are displayed as parts belonging to the sub-process of "machine installation." The process of "machine installation" corresponds to the work of taking in the machine, the work of installing the machine beam, and the work of installing the machine.

[0062] In the display example of the input interface shown in FIG. 11, a check box is displayed at the beginning of each option, and the part whose check box is selected by the worker is displayed as a virtual object. Here, when a higher-level option is selected, all of the lower-level options included in that option may be automatically selected. For example, in the example shown in FIG. 11, when the option "hall equipment installation" is selected, the options "sill bracket" and "hall button box" included therein are also selected. Note that the selection of options may span multiple processes.

[0063] As shown in Figure 11, the processes displayed on the input interface are arranged in the order of the construction work steps, making it easier for workers to understand which process to select next.

[0064] (Configuration of construction reference information generation device) Next, the construction reference information generating device 11 that generates construction reference information will be described. Fig. 2 is a block diagram showing a schematic configuration of the construction reference information generating device 11. As shown in the figure, the construction reference information generating device 11 includes a control unit 112, a display unit 113, an input unit 114, a communication unit 115, and a storage unit 116. The construction reference information generating device 11 is assumed to be configured, for example, by a normal general-purpose PC (Personal Computer), but is not limited to this, and may have at least a part of its processing executed by a cloud service.

[0065] The control unit 112 is a block that performs various information processes in the construction reference information generating device 11, and includes a construction reference information generating unit 1121.

[0066] The construction reference information generation unit 1121 generates first process data D1 and second process data D2 as construction reference information D. The construction reference information generation unit 1121 generates the construction reference information D in response to an instruction input from a worker accepted by the input unit 114. For example, as described above, the construction reference information D is generated by reading out information on a three-dimensional model of a building generated as a BIM in response to an instruction input from a worker, and then adding design data of a construction object in response to the instruction input from the worker.

[0067] The construction reference information generation unit 1121 stores the construction reference information D generated as described above in the storage unit 116. Thereafter, the generated construction reference information D is transferred to the smart glasses 1 based on instructions from the worker as necessary. The method of data transfer is not particularly limited. For example, the transfer may be performed by communication between the construction reference information generation device 11 and the smart glasses 1 via wireless LAN or a USB cable. Alternatively, the construction reference information D may be temporarily uploaded from the construction reference information generation device 11 to a cloud server, and the smart glasses 1 may access the cloud server to acquire the information, thereby transferring the information. Alternatively, the transfer may be performed by a storage medium such as a USB memory.

[0068] (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 12. When elevator installation begins, first, in step 1 (hereinafter referred to as S1), a marker installation jig MJ having markers M1 and M2 attached thereto is installed at a predetermined position in the hall 200.

[0069] Next, in S2, the worker wears the smart glasses 1 on the floor where he or she is to work, and the marker corresponding to the floor where the worker is located is captured by the imaging unit 4, and position recognition processing is performed by the position recognition unit 22. Here, the position recognition unit 22 identifies the floor where the worker is located based on the information included in the marker.

[0070] The position recognition unit 22 may determine whether a marker is installed on the floor where the worker is located based on the distance to the marker. This allows the marker to be properly recognized as the marker installed on the floor where the worker is located, even if markers on other floors are included in the image capture range of the image capture unit 4. The distance to the marker may be determined based on the size of the marker in the captured image, or a distance sensor such as LiDAR (Light Detection and Ranging) may be used.

[0071] Once the position is recognized, the worker calls up an input interface as a display content selection screen in S3. The input interface is then displayed as a virtual object, and the worker selects at least one of the processes and parts to be displayed.

[0072] Then, in S4, the display control unit 21 reads out data of the construction reference information D according to the floor recognized by the position recognition unit 22, based on at least one of the selected process and part. Then, the display control unit 21 performs an overlay display of the virtual object based on the read-out data. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize their position, they can view the virtual object with its relative positional relationship with the real space maintained, even if they subsequently change their viewing direction or move.

[0073] In this way, the floor where the worker is working is identified based on the markers M1 and M2, and the virtual object OB corresponding to that floor is displayed, so the worker can check information appropriate for that floor without having to go through the trouble of inputting floor information. Furthermore, location recognition is performed based on the markers M1 and M2 corresponding to the floor where the worker is working. Therefore, the accuracy of the display position of the overlay display can be improved compared to when location recognition is performed based on markers on other floors.

[0074] In the above example, the floor where the worker is located is identified based on the information contained in the marker, but this is not limiting. For example, numbers indicating floor numbers marked on landings or elevator shafts may be recognized. Furthermore, the worker may input the floor where the worker is located using input means such as a virtual object input interface.

[0075] In this state, in S5, the worker performs construction work while checking the construction reference information overlaid and displayed by the display control unit 21. Note that the construction work includes not only the actual construction work but also the check work after the construction work is completed.

[0076] Next, in S6, the display control unit 21 determines whether or not an instruction to change at least one of the processes and parts to be displayed has been received from the worker. Specifically, it determines whether or not an input interface serving as a display content selection screen has been called up by the worker.

[0077] If the answer to S6 is Yes, that is, if an instruction to change at least one of the processes and parts to be displayed by the worker is received, the process returns to S3, where the worker selects at least one of the processes and parts to be displayed.

[0078] If the answer to S6 is No, i.e., if the worker has not received an instruction to change at least one of the process and parts to be displayed, the completion of the construction work is confirmed in S7, and if the answer to S7 is No, i.e., the construction work is continuing, the processing from S4 is repeated, and if the answer to S7 is Yes, i.e., the construction work has been completed, the processing is terminated.

[0079] The above construction method and smart glasses 1 enable elevator construction to be carried out safely and efficiently. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."

[0080] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0081] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0082] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0083] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0084] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0085] (summary) A display device according to a first aspect of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and is equipped with a display control unit that reads and displays construction reference information related to the virtual object from display data for the overlay display, the display data being data in which construction reference information is associated with each process in construction work, and the display control unit is configured to display the construction reference information corresponding to the process specified by the worker.

[0086] According to the above configuration, the worker can select and display the construction reference information that he / she needs to display on a process-by-process basis, so that only the necessary information can be displayed efficiently. Therefore, a construction work environment with good visibility can be provided, and the efficiency of the construction work can be improved.

[0087] A display device according to aspect 2 of the present invention may be configured such that, in aspect 1 above, the display control unit displays the construction reference information relating to the parts specified by the worker from among the construction reference information corresponding to the process specified by the worker.

[0088] According to the above configuration, the construction reference information that the worker needs to display can be further selected and displayed on a part-by-part basis, so that the construction reference information can be displayed in a focused manner. Therefore, a more preferable visual environment can be provided for the worker according to the progress of the construction work.

[0089] A display device according to aspect 3 of the present invention may be configured in the above-mentioned aspect 1 such that the display control unit simultaneously displays the construction reference information corresponding to multiple processes specified by the worker.

[0090] According to the above configuration, construction reference information relating to a plurality of processes can be displayed, so that, for example, it becomes possible to simultaneously check the states of each virtual object before and after a process.

[0091] A display device according to a fourth aspect of the present invention may be configured in the first aspect above so that the display control unit displays, as the virtual object, an input interface that accepts instruction input from the worker.

[0092] According to the above configuration, since the input interface is provided to the worker as a virtual object, it is not necessary to prepare a separate device for inputting instructions, etc. This reduces the cost of the device and the number of required devices.

[0093] A display control method according to aspect 5 of the present invention is a display control method for overlaying a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, the method including a display control step for reading and displaying construction reference information related to the virtual object from display data for the overlay display, the display data being data in which construction reference information is associated with each process in construction work, and the display control step displays the construction reference information corresponding to the process specified by the worker.

[0094] A display control program according to a sixth aspect of the present invention is a display control program for causing a computer to function as the display device in the first aspect, and causes the computer to function as the display control unit.

[0095] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0096] 1. Smart glasses (display device) 2, 112 Control unit 3 Projection section 4. Imaging unit 5, 116 storage section 6, 115 Communications Department 7 Audio input / output section 11 Construction reference information generation device 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 101 Opening 102 Elevator 103 Piano wire 111 Safety Helmet 113 Display section 114 Input section Platform 200 201 Floor 202, 300 walls 1121 Construction reference information generation department D1 First process data D2 2nd process data D11, D12, D21, D22 parts data M1 / M2 markers QR1 / QR2 2D code RL1, RL2 rails

Claims

1. A display device that overlays and displays virtual objects in an arrangement according to positions in a real space in a field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or in an image representing the real space, the display device comprising: a display control unit that reads and displays construction reference information related to the virtual object from the display data for the overlay display; the display data is data in which the construction reference information is associated with each process in the construction work, The display control unit is a display device that displays the construction reference information corresponding to the process specified by the worker.

2. The display device according to claim 1 , wherein the display control unit displays the construction reference information relating to a part specified by the worker, out of the construction reference information corresponding to the process specified by the worker.

3. The display device according to claim 1 , wherein the display control unit simultaneously displays the construction reference information corresponding to a plurality of the processes designated by the worker.

4. The display device according to claim 1 , wherein the display control unit displays, as the virtual object, an input interface that accepts instruction input from the worker.

5. 1. A display control method for overlaying a virtual object in a field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or an image representing the real space, in an arrangement according to a position in the real space, the method comprising: a display control step of reading and displaying construction reference information related to the virtual object from the display data for the overlay display; the display data is data in which the construction reference information is associated with each process in the construction work, In the display control step, the construction reference information corresponding to the process designated by the worker is displayed.

6. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing the computer to function as the display control unit.

Images