Display device, display control method, and display control program

Abstract

Provided is a display device that overlays and displays virtual objects in an arrangement according to the position in the real space, and that can efficiently provide a construction work environment with good visibility. 【Solution means】A display control unit (21) is provided that reads and displays construction reference information (D) related to a virtual object from display data for overlay display. The display data is data in which construction reference information (D) is associated with each process in the construction work, and the display control unit (21) displays the construction reference information (D) corresponding to the process designated by the worker.

Description

Technical Field

[0001] The present invention relates to a display device that overlays and displays virtual objects in a layout corresponding to the position in the real space with respect to the field of view of an operator viewing the real space to be constructed in a building or an image representing the real space.

Background Art

[0002] Conventionally, in construction work and the like, a method has been proposed in which construction work is performed in a state where information necessary for the construction work is displayed in an overlapping manner with the real space on a display device such as smart glasses worn by an operator. For example, Patent Document 1 discloses a projection device that scans the real space to recognize the space shape, scales the drawing data according to the real space, and maps and displays it in the real space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Using the above technology, it is conceivable to overlay and display an image representing the installation position of a construction object in the real space to be worked on. For example, in the construction of a building, when constructing an elevator shaft or a landing, it is conceivable to use this overlay display technology. There are a large number of construction objects in the shaft and the landing, and if all of them are overlaid and displayed, the visibility of each construction object will deteriorate, and the visibility of the real space will also deteriorate.

[0005] One aspect of the present invention aims to provide a display device that can efficiently provide a construction work environment with good visibility in a display device that overlays and displays virtual objects in a layout corresponding to the position in the real space.

Means for Solving the Problem

[0006] In order to solve the above problems, a display device according to the present invention is a display device that overlays and displays a virtual object in an arrangement corresponding to the position of a real space that includes at least one of an elevator hoistway and a landing, in the field of view of an operator viewing the real space, or on an image representing the real space, and includes a display control unit that reads and displays construction reference information regarding the virtual object from display data for the overlay display. The display data is data in which construction reference information is associated with each process in construction work, and the display control unit displays the construction reference information corresponding to the process designated by the operator.

[0007] In order to solve the above problems, a display control method according to the present invention is a display control method that overlays and displays a virtual object in an arrangement corresponding to the position of a real space that includes at least one of an elevator hoistway and a landing, in the field of view of an operator viewing the real space, or on an image representing the real space, and has a display control step of reading and displaying construction reference information regarding the virtual object from display data for the overlay display. The display data is data in which construction reference information is associated with each process in construction work, and in the display control step, the construction reference information corresponding to the process designated by the operator is displayed.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, a display control program for realizing the display device by operating the computer as each part (software element) included in the display device, and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.

Advantages of the Invention

[0009] According to the present invention, since an operator can select and display construction reference information that requires display in units of processes, it is possible to efficiently display only the necessary information. Therefore, it is possible to provide a construction work environment with good visibility and to achieve the effect of improving the efficiency of construction work.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0011] Hereinafter, an embodiment of the present invention will be described in detail.

[0012] (Overview of Smart Glass Application Example) FIG. 3 is a diagram showing a state in which a smart glass (display device) 1 according to this embodiment is mounted on a safety helmet 111. In this embodiment, a situation is assumed in which an operator who performs elevator construction during the construction of a building wears the smart glass 1 together with the safety helmet 111.

[0013] The smart glass 1 is an optically transmissive head-mounted display. The wearer of the smart glass 1 can view the external real space and also view the projected image within the real space. That is, the smart glass 1 overlays and displays a virtual object as construction reference information regarding elevator construction in an arrangement corresponding to the position in the real space with respect to the field of view of an operator who views the real space including the elevator landing and hoistway.

[0014] FIG. 6 shows an example of a state in which a rail bracket RLB as a virtual object is overlaid and displayed in the real space. As shown in the figure, a rail bracket RLB as a virtual object is displayed with respect to the wall surface 300 in the real space. Thereby, the operator can confirm the position in the three-dimensional space where the construction work should be performed in the real space. Therefore, operations such as measuring and confirming the position where the construction work should be performed with a measuring tool in the real space become unnecessary, and the workability can be improved.

[0015] In the present embodiment, the smart glass 1, which is an optical transmissive head-mounted display, is used as the display device. However, the present invention is not limited to this. For example, a video transmissive head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Further, as the display device according to the present invention, instead of a head-mounted display, for example, a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and a camera connected to an information processing device by wire or wirelessly may be used.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. These CAD data may be generated based on, for example, the information of a 3D model generated as BIM (Building Information Modeling). In BIM, various information such as the quantity, part number, dimensions, material, performance, and price of each part is included as object information in the 3D model. Therefore, at least one of these pieces of information may be displayed as construction reference information. The details of the construction reference information will be described later.

[0017] (Details of the Configuration of the Smart Glass) FIG. 1 is a block diagram showing an outline of the configuration of the smart glass 1. As shown in the figure, the smart glass 1 includes a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glass 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, and a warning control unit 24.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to the construction of the elevator. The projection unit 3 projects an image onto the half mirror, allowing the operator, who is the wearer of the smart glass 1, to visually recognize the external real space while also visually recognizing the projected image. The display control unit 21 can display the virtual object as being three-dimensionally arranged at a predetermined position within the real space by making the projected image for the right eye different from the projected image for the left eye. As a result, the operator can recognize the construction position in the three-dimensional position of the real space.

[0019] The display control unit 21 reads out the construction reference information D including the 3D CAD data or 2D CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the 3D CAD data or 2D CAD data also includes information indicating the positional relationship with the objects existing in the real space. Further, the display control unit 21 controls the display position of the virtual object based on the position of the real space recognized by the position recognition unit 22.

[0020] The storage unit 5 stores the first process data D1 and the second process data D2 as the construction reference information D. Note that the number of process data is not limited and may include even more process data. The first process data D1 includes the first-1 component data D11 and the first-2 component data D12. Also, the second process data D2 includes the second-1 component data D21 and the second-2 component data D22. Note that the number of component data included in each process data is not limited and may include even more component data. Details of these data will be described later.

[0021] Note that the display control unit 21 may acquire the construction reference information D from the outside via the communication unit 6. The communication unit 6 may communicate with a PC or server on the local network, for example, via a wireless LAN, or communicate with an external server via the Internet. This enables the update of the data stored in the storage unit 5 and the acquisition of new data.

[0022] The position recognition unit 22 recognizes the captured images of markers M1 and M2 (details will be described later) arranged at predetermined positions in the real space captured by the imaging unit 4, thereby recognizing the three-dimensional position of the smart glasses 1 in the real space and the three-dimensional direction in which the smart glasses 1 are facing. In addition, the position recognition unit 22 can perform position recognition in 6DoF (Degree of Freedom). As a result, once the operator has the position recognized by the markers M1 and M2 with respect to the position recognition unit 22, the virtual object can be visually recognized in a state where the relative positional relationship with the real space is maintained even if the viewing direction or the position is changed later.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the operator. Examples of the instruction input include an input to the input interface as a virtual object. That is, an image as an input interface is displayed in the real space as a virtual object by the display control unit 21, and the operator's instruction input is received by recognizing that the operator has virtually touched it with a finger or the like.

[0024] Further, for example, the instruction input from the operator may be received by voice input from the voice input / output unit 7. That is, the instruction input from the operator is received by the input control unit 23 recognizing the voice received by the voice input / output unit 7 and recognizing the instruction content from the operator.

[0025] Further, the instruction input from the operator may be received by an external input device via the communication unit 6. For example, various input devices such as a Bluetooth (registered trademark)-compatible input controller and a wireless keyboard communicate with the communication unit 6, and the instruction input is received by the operator's input to the input device.

[0026] The warning control unit 24 controls any warnings issued to the operator wearing the smart glasses 1. Examples of warning methods include projecting and displaying warning content by overlay display by the display control unit 21, and outputting a warning sound or voice indicating the warning content from the audio input / output unit 7.

[0027] Examples of warning conditions include when the position recognition unit 22 recognizes that the operator's position is within a predetermined area near the hoistway. As a result, a warning is issued at a timing when the possibility of the operator falling into the hoistway increases, so the safety of the operator can be further enhanced.

[0028] Note that at least one of the functions of the display control unit 21, position recognition unit 22, input control unit 23, and warning control unit 24 provided in the control unit 2 may be realized by an external computer via communication.

[0029] (Example of the real space to be the elevator construction target) FIG. 4 is a perspective view showing an overview of the elevator landing 200 and the hoistway 102 that are the construction targets of the elevator. The figure shows a state where the elevator door is not attached during the construction stage of the building. In this state, an opening 101 as an elevator entrance exists between the landing 200 and the hoistway 102. The landing 200 has a floor surface 201 and a wall surface 202.

[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used for the position recognition unit 22 to recognize the position of the real space by image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is composed of a quadrangular planar member, and a predetermined pattern is formed on the surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the landing 200, the position recognition unit 22 can accurately recognize the positions of the landing 200 and the hoistway 102 in the three-dimensional space.

[0031] In this embodiment, two markers are provided for one landing, but the present invention is not limited to this. One marker may be provided, or three or more markers may be provided. The higher the number of markers provided, the higher the accuracy of position recognition. However, if two markers are provided, position recognition can be performed with sufficient accuracy.

[0032] Further, in this embodiment, markers M1 and M2 are provided on the landing 200, but markers may be provided in the hoistway 102.

[0033] The markers M1 and M2 are arranged at predetermined positions on the floor surface 201 defined as marker installation positions in the construction reference information including 3D CAD data or 2D CAD data. Since a high accuracy is required for the installation positions of the markers M1 and M2 to accurately match the positions in the real space and the display positions of the virtual objects, it is preferable that they are provided based on a predetermined position reference object with a high accuracy of the arrangement position in the real space. As an example of the position reference object, the piano wires 103 provided in the hoistway 102 can be mentioned.

[0034] FIG. 5 is a perspective view showing an outline when the opening 101 is viewed from the inside of the hoistway 102. As shown in the figure, during the construction stage of the building, two piano wires 103 and 103 are suspended from a predetermined position at the upper part in the hoistway 102. That is, the piano wires 103 and 103 are arranged at fixed positions without being affected by the construction state of each floor. Therefore, by using this piano wire as a position reference object (reference line), the accuracy of the installation positions of the markers M1 and M2 can be kept high. Note that not limited to the piano wire, any wire member with a sufficiently small diameter and sufficient strength may be used.

[0035] Further, as the position reference object, for example, laser light may be used. That is, by irradiating laser light vertically downward from a predetermined position at the upper part in the hoistway 102 or irradiating laser light vertically upward from a predetermined position at the lower part in the hoistway 102, the laser light can be arranged at a position determined in the same manner as the piano wire. However, in the case of laser light, since the thickness of the light beam tends to increase as the distance from the light source increases, depending on the height of the building, there may be an influence of errors due to the thickness of the light beam. Further, as the position reference object, the reference points (construction marks) indicated at the landing on each floor may be used.

[0036] In addition, for one elevator, a plurality of landings 200 corresponding to each floor will be provided. However, at each landing 200, it is preferable to install the marker at the same location with respect to the elevator landing opening, that is, at the same relative position with respect to the boarding opening.

[0037] In many cases, all the landings 200 for the same elevator have the same structural arrangement. In this case, since the markers M1 and M2 may be installed at the same location with respect to the elevator landing opening at each landing 200, the marker installation work can be performed by the same operation based on the same standard. Therefore, the marker installation work can be performed efficiently. Also, the data for the overlay display can have a common data structure at the plurality of landings 200.

[0038] The markers M1 and M2 may each be provided with a two-dimensional code. In FIG. 4, the markers M1 and M2 are each provided with two-dimensional codes QR1 and QR2. The two-dimensional codes QR1 and QR2 indicate the information of the floor on which the markers M1 and M2 provided with the two-dimensional codes QR1 and QR2 are installed. That is, when the position recognition unit 22 performs image recognition on the markers M1 and M2 in the captured image, by also recognizing the two-dimensional codes QR1 and QR2, the information of the floor on which the read markers M1 and M2 are arranged can also be recognized.

[0039] Note that the floor information included in the marker is not limited to two-dimensional codes. For example, the marker may be displayed with the characters "3F" or the like, and this may be obtained as floor information by character recognition. Also, the marker may be colored with a color unique to the floor or may display an image with a unique shape, etc., so that the floor may be recognized by image recognition.

[0040] (Details of construction reference information) Next, the construction reference information D will be described. As described above, the construction reference information D includes the first process data D1 and the second process data D2. Further, the first process data D1 includes the first-1 component data D11 and the first-2 component data D12. Also, the second process data D2 includes the second-1 component data D21 and the second-2 component data D22.

[0041] When performing construction on a building related to an elevator, a plurality of processes are carried out in order. Here, when all the construction objects included in all the processes are overlaid and displayed as virtual objects, it is considered that the visibility deteriorates due to the simultaneous display of a large number of virtual objects.

[0042] On the other hand, as described above, since the construction reference information D includes the first process data D1 and the second process data D2 as data for each process, the smart glasses 1 can select and display the construction reference information required by the operator in units of processes. Therefore, only the necessary information can be efficiently displayed, so that a construction work environment with good visibility can be provided and the efficiency of the construction work can be realized.

[0043] Also, since each of the process data includes component data, the construction reference information required by the operator can be selected and displayed in units of components. Therefore, the construction reference information can be displayed by narrowing down the points, so that a more preferable visual environment can be provided for the operator according to the progress of the construction work.

[0044] Note that the data structure of the construction reference information D is not particularly limited. For example, it may be a data structure in which each component data is given an attribute related to the process to which it belongs. Also, it may be a data structure in which the process is further subdivided. That is, a plurality of small process data may be included in the large process data, and each small process data may include component data. The hierarchical classification of the process data is not limited to two levels, and may be three levels or more. Furthermore, with respect to the component data, it may be hierarchically classified into large component data and small component data included in each large component data. The hierarchical classification of the component data is not limited to two levels, and may be three levels or more.

[0045] (Specific example of overlay display) Next, a specific example of the overlay display will be described. As described above, FIG. 6 shows a perspective view of a state in which the rail bracket RLB as a virtual object is overlaid and displayed in the real space. Also, FIG. 7 shows a perspective view of a state in which the IR plate IRP and the IR plate bracket IRPB as virtual objects are overlaid and displayed in the real space.

[0046] The rail bracket RLB is a bracket for fixing the rail RL to the wall surface in the hoistway 102. The IR plate IRP is a member indicating the stop position of the elevator car. By blocking the sensor attached to the car by the IR plate IRP, it is determined whether or not the car has landed at a predetermined position on each floor. The IRP bracket IRPB is a bracket for attaching the IR plate IRP to the rail RL. That is, as the construction order, first, the process of installing the rail bracket RLB on the wall surface in the hoistway 102 is performed. Next, the process of installing the rail RL by the rail bracket RLB is performed. Thereafter, the process of installing the IR plate bracket IRPB to which the IR plate IRP is attached to the rail RL is performed.

[0047] Accordingly, first, in the step of installing the rail bracket RLB, an overlay display is performed in the state shown in FIG. 6. Then, after the rail RL is installed, in the step of installing the IR plate bracket IRPB, an overlay display is performed in the state shown in FIG. 7. In this way, for each step, only the construction object to be constructed in that step is overlay-displayed, so that the operator can perform the construction work while referring to the necessary minimum information with good visibility.

[0048] Next, a situation where a larger number of construction objects are constructed will be described. FIG. 8 is a side view showing a state in which virtual objects related to a large number of construction objects are simultaneously displayed. As shown in the figure, as virtual objects, a rail bracket RLB, a limit switch trough LST, a switchboard box bracket PRB, a governor rope guide GG, and an IR plate IRP are displayed. The limit switch trough LST is a member for attaching a limit switch that detects the position of the car near the top floor or the bottom floor. The switchboard box bracket PRB is a bracket for attaching a box containing electrical equipment including a switchboard that receives power supplied from the building's power source and supplies it to the car to the rail RL. The governor rope guide GG is a member that guides the side of the governor rope that is not fastened to the car to prevent the rope from swaying.

[0049] In FIG. 8, a rail bracket RLB for fixing the rail RL1 corresponding to the car to the wall surface in the hoistway 102 and a rail bracket RLB for fixing the rail RL2 corresponding to the counterweight to the wall surface in the hoistway 102 are provided. Further, the limit switch trough LST, the switchboard box bracket PRB, the governor rope guide GG, and the IR plate IRP are attached to the rail RL1.

[0050] Regarding the switchboard box bracket PRB, an arrow indicating the vertical direction and upper and lower limit lines indicating the upper and lower limits of the installation position are shown at both ends of the arrow. This indicates the allowable range in the vertical direction of the installation position of the switchboard box bracket PRB. Also, for the governor rope guide GG, a downward arrow and reference information in the form of the characters "within 1 m from the trough" are shown. This also indicates the allowable range of the installation position of the governor rope guide GG.

[0051] Also, the position of the floor level FL is shown. That is, based on the floor level FL, each object to be constructed is displayed as a virtual object at the correct installation position.

[0052] Note that it is not limited to the construction object shown in FIG. 8. For example, the construction object may be a sill bracket, a buffer base, a cable hanger, a machine, a machine beam, a breaker box, a control panel, a hall button box, a panel base, and a floor duct. The sill bracket is a bracket for fixing a sill (threshold) that guides the landing door to the wall surface in the hoistway 102. The buffer base is a base member for fixing a buffer (shock absorber) that absorbs the impact in case the car or counterweight accidentally falls to the bottom pit in the hoistway 102, and also has a role of fixing the rail to the bottom surface of the pit. The cable hanger is a member for fixing the middle position of a traveling cable (tail cord) that connects the car and the control panel. The machine is a motor that raises and lowers the elevator by winding the rope, and the machine beam is a member for fixing the machine to the rail or the pit. The breaker box is a box in which breakers are stored, and the control panel is a device for controlling the operation of the elevator. The hall button box is a box installed on the wall surface of the landing, and stores a landing call button, a display unit for displaying the current position and moving direction of the car, etc. In an elevator of a type having a machine room on the roof of a building, it is necessary to install an electrical panel and a machine in the machine room and wire them. The base for fixing this electrical panel to the building is the panel base, and the duct that forms the wiring path from each electrical panel to each machine is the floor duct.

[0053] As described above, even in the state shown in FIG. 8, a large number of construction objects are displayed. Furthermore, if a large number of construction objects are displayed simultaneously, the amount of information to be displayed will be too large, and the visibility of the virtual object will deteriorate.

[0054] Figure 9 shows an example of changing the virtual object displayed for each process. 901 shows a display example in the process of installing the rail bracket RLB, and 902 shows a display example in the process of installing the construction object on the rails RL1 and RL2 after installing the rails RL1 and RL2. In this way, by limiting the display of the virtual object related to the construction object required in each process to only that process, an overlay display with better visibility can be realized compared to the state shown in Figure 8.

[0055] Figure 10 shows an example in which the overlay display in the process shown in 902 of Figure 9 is further displayed for each construction object as a part. 1001 shows a state where only the limit switch trough LST is displayed, 1002 shows a state where only the switchboard box bracket PRB is displayed, 1003 shows a state where only the governor rope guide GG is displayed, and 1004 shows a state where only the IR plate IRP is displayed. In this way, by displaying only the part that the operator is about to work on, an overlay display with even better visibility can be realized compared to the state shown in Figure 9.

[0056] (Example of input interface) Figure 11 shows a display example of an input interface that receives an instruction input from an operator as a virtual object. In the example shown in the figure, as a display content selection screen, options for major processes of "Component installation on the body", "Rail centering", "Overhead equipment installation", and "Component installation on the rail" are displayed. As options for minor processes belonging to the major process of "Component installation on the body", options for "In-tower centering", "Landing equipment installation", and "Rail erection" are displayed. As options for minor processes belonging to the major process of "Component installation on the rail", options for "In-tower equipment installation", "In-tower electrical work", "Counterweight assembly", and "Machine installation" are displayed.

[0057] Options for "buffer base" are shown as components belonging to the sub-process of "core extraction inside the tower". The process of "core extraction inside the tower" corresponds to the operation of stretching the piano wire 103 from the top to the buffer base in the pit within the hoistway 102, and the core extraction operation of the buffer base.

[0058] Options for "silver bracket" and "hall button box" are shown as components belonging to the sub-process of "landing equipment installation". The process of "landing equipment installation" corresponds to the installation work of thresholds, frames, landing doors, etc. in the landing 200. For the silver bracket, at least one of the main body outer shape and the anchor casting position is displayed as a virtual object.

[0059] An option for "rail bracket" is shown as a component belonging to the sub-process of "rail erection". The process of "rail erection" corresponds to the work of temporarily fixing various rails. For the rail bracket RLB, at least one of the main body outer shape and the anchor casting position is displayed as a virtual object.

[0060] Options for "governor rope guide", "IR plate", "cable hanger", and "various panels" are shown as components belonging to the sub-process of "equipment installation inside the tower". The process of "equipment installation inside the tower" corresponds to the installation work of various components attached to the rail RL and design tools, etc.

[0061] Options for "machine" and "machine beam" are shown as components belonging to the sub-process of "machine installation". The process of "machine installation" corresponds to the work of loading the machine, installing the machine beam, and installing the machine, etc.

[0062] In the display example of the input interface shown in FIG. 11, check boxes are displayed at the beginning of each option, and the parts in which the check boxes are selected by the operator are displayed as virtual objects. Here, when a higher-level option is selected, it may be configured such that all lower-level options included in the selected option are automatically selected. For example, in the example shown in FIG. 11, when the option of "landing equipment installation" is selected, the options of "silver bracket" and "hall button box" included therein are also in a selected state. Note that the selection of options may span multiple steps.

[0063] As shown in FIG. 11, each step displayed on the input interface is arranged in the order of the construction work steps. This makes it easier for the operator to understand which step to select next.

[0064] (Configuration of the Construction Reference Information Generation Device) Next, a construction reference information generation device 11 that generates construction reference information will be described. FIG. 2 is a block diagram showing the schematic configuration of the construction reference information generation device 11. As shown in the figure, the construction reference information generation device 11 includes a control unit 112, a display unit 113, an input unit 114, a communication unit 115, and a storage unit 116. The construction reference information generation device 11 is assumed to be configured by, for example, a normal general-purpose PC (Personal Computer), but is not limited thereto, and may be in a form in which at least some of the processing is executed by a cloud service.

[0065] The control unit 112 is a block that performs various information processes in the construction reference information generation device 11 and includes a construction reference information generation unit 1121.

[0066] The construction reference information generation unit 1121 generates the first process data D1 and the second process data D2 as the construction reference information D. The construction reference information generation unit 1121 generates the construction reference information D in response to the instruction input from the operator received by the input unit 114. For example, as described above, the information of the three-dimensional model of the building generated as BIM is read according to the instruction input from the operator, and the design data of the construction object is added according to the instruction input from the operator, whereby the construction reference information D is generated.

[0067] The construction reference information generation unit 1121 stores the generated construction reference information D in the storage unit 116. Then, based on the instruction from the operator as necessary, the generated construction reference information D is transferred to the smart glass 1. The method of data transfer is not particularly limited. For example, the transfer may be performed by communication between the construction reference information generation device 11 and the smart glass 1 via a wireless LAN or a USB cable. Also, for example, the construction reference information D may be uploaded from the construction reference information generation device 11 to a cloud server once, and the smart glass 1 may access the cloud server to obtain it for transfer. Also, for example, the transfer may be performed by a storage medium such as a USB memory.

[0068] (Flow of the elevator construction method) Next, the flow of the elevator construction method according to the present embodiment will be described with reference to FIG. 12. When the construction related to the elevator is started, first, in step 1 (hereinafter referred to as S1), the marker installation jig MJ provided with the markers M1 and M2 is installed at a predetermined position in the landing 200.

[0069] Next, in S2, the operator wears the smart glass 1 on the floor where the work is being performed, and the imaging unit 4 images the marker corresponding to the floor where the operator is present, and causes the position recognition unit 22 to perform position recognition processing. Here, the position recognition unit 22 specifies the floor where the operator is present based on the information included in the marker.

[0070] Note that the position recognition unit 22 may determine whether a marker is installed on the floor where the operator is present according to the distance to the marker. Thereby, even if markers on other floors are included in the imaging range by the imaging unit 4, the markers installed on the floor where the operator is present can be appropriately recognized. The distance to the marker may be determined based on, for example, the size of the marker in the captured image, or a distance sensor such as LiDAR (Light Detection And Ranging) may be used.

[0071] When the position recognition is performed, in S3, the operator calls an input interface as a display content selection screen. Then, an input interface as a virtual object is displayed, and at least one of the process and the part to be displayed is selected by the operator.

[0072] Thereafter, in S4, based on at least one of the selected process and the part, according to the floor recognized by the position recognition unit 22, the display control unit 21 reads the data of the construction reference information D. Then, an overlay display of the virtual object is performed by the display control unit 21 based on the read data. Once the operator has the position recognized by the position recognition unit 22 by the markers M1 and M2, even if the viewing direction or the position is changed thereafter, the virtual object can be visually recognized while maintaining the relative positional relationship with the real space.

[0073] In this way, the floor where the operator is working is specified based on the markers M1 and M2, and the virtual object OB corresponding to that floor is displayed. Therefore, the operator can check the information suitable for that floor without the trouble of inputting the floor information or the like. Also, the position recognition is performed based on the markers M1 and M2 corresponding to the floor where the work is being done. Therefore, the accuracy of the display position of the overlay display can be increased compared to the case where the position recognition is performed based on markers existing on other floors.

[0074] In the above example, the floor where the worker is located is identified based on the information included in the marker, but it is not limited to this. For example, the numbers indicating the floor numbers written in the landing or elevator shaft may be recognized. Also, for example, the worker himself / herself may input the floor where the worker is located by an input means such as an input interface using a virtual object.

[0075] In this state, in S5, the worker performs the construction work while checking the construction reference information overlaid by the display control unit 21. Note that the construction work includes not only the actual construction work but also the check work after the construction work is performed.

[0076] Next, in S6, it is determined by the display control unit 21 whether an instruction to change at least one of the process and the parts to be displayed by the worker has been received. Specifically, it is determined whether the worker has called the input interface as the display content selection screen.

[0077] If Yes in S6, that is, if an instruction to change at least one of the process and the parts to be displayed by the worker has been received, the process returns to S3, and at least one of the process and the parts to be displayed by the worker is selected.

[0078] If No in S6, that is, if an instruction to change at least one of the process and the parts to be displayed by the worker has not been received, in S7, the completion of the construction work is confirmed. If No in S7, that is, if the construction work is continuing, the processing from S4 is repeated. If Yes in S7, that is, if the construction work has ended, the processing ends.

[0079] According to the above construction method and the smart glass 1, the construction of the elevator can be carried out safely and efficiently. Such an effect also contributes to the achievement of, for example, Goal 11.c of the Sustainable Development Goals (SDGs) proposed by the United Nations, "Support the development of sustainable and resilient buildings using local materials in developing countries through financial and technical support, etc."

[0080] [Example of Realization by Software] The function of the smart glass 1 (hereinafter referred to as the "device") is a program for causing a computer to function as the device, and can be realized by a program for causing a computer to function as each control block of the device (especially each part included in the control unit 2).

[0081] In this case, the above device includes a computer having at least one control device (for example, a processor) and at least one storage device (for example, a memory) as hardware for executing the above program. By executing the above program with this control device and storage device, each function described in the above embodiments is realized.

[0082] The above program may be recorded on one or more computer-readable recording media, not temporarily. This recording medium may or may not be provided in the above device. In the latter case, the above program may be supplied to the above device via any wired or wireless transmission medium.

[0083] Also, part or all of the functions of each of the above control blocks can also be realized by a logic circuit. For example, an integrated circuit in which a logic circuit functioning as each of the above control blocks is formed is also included in the scope of the present invention. In addition to this, for example, it is also possible to realize the functions of each of the above control blocks by a quantum computer.

[0084] In addition, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may operate in the above control device, or may operate in another device (for example, an edge computer or a cloud server, etc.).

[0085] (Summary) The display device according to Aspect 1 of the present invention is a display device that overlays and displays virtual objects in a layout corresponding to the position in the real space with respect to the field of view of an operator viewing a real space including at least one of the hoistway and the landing of an elevator, or an image representing the real space, and includes a display control unit that reads and displays construction reference information regarding the virtual object from the display data for the overlay display. The display data is data in which construction reference information is associated with each process in the construction work, and the display control unit is configured to display the construction reference information corresponding to the process designated by the operator.

[0086] According to the above configuration, the operator can select and display the construction reference information required for display in units of processes, so that only the necessary information can be efficiently displayed. Therefore, a construction work environment with good visibility can be provided, and the efficiency of the construction work can be realized.

[0087] The display device according to Aspect 2 of the present invention, in the above Aspect 1, the display control unit may be configured to display the construction reference information regarding the component designated by the operator among the construction reference information corresponding to the process designated by the operator.

[0088] According to the above configuration, the operator can further select and display the construction reference information required for display in units of components, so that the construction reference information can be displayed with a narrowed focus. Therefore, a more preferable viewing environment for the operator can be provided according to the progress of the construction work.

[0089] In the display device according to Aspect 3 of the present invention, in the above Aspect 1, the display control unit may be configured to simultaneously display the construction reference information corresponding to a plurality of the processes specified by the operator.

[0090] According to the above configuration, since it is possible to display the construction reference information regarding a plurality of processes, for example, it becomes possible to simultaneously check the states of each virtual object before and after the process.

[0091] In the display device according to Aspect 4 of the present invention, in the above Aspect 1, the display control unit may be configured to display an input interface that receives an instruction input from the operator as the virtual object.

[0092] According to the above configuration, since the input interface is provided to the operator as a virtual object, it is possible to eliminate the need to separately prepare a device for instruction input or the like. Therefore, it is possible to reduce the device cost and the required devices.

[0093] A display control method according to Aspect 5 of the present invention is a display control method for overlay-displaying a virtual object in an arrangement according to the position in a real space in the field of view of an operator viewing a real space including at least one of an elevator hoistway and a landing, or an image representing the real space, the method having a display control step of reading out and displaying construction reference information regarding the virtual object from display data for the overlay display, the display data being data in which construction reference information is associated with each process in construction work, and in the display control step, displaying the construction reference information corresponding to the process specified by the operator.

[0094] A display control program according to Aspect 6 of the present invention is a display control program for causing a computer to function as the display device in the above Aspect 1, causing the computer to function as the display control unit.

[0095] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope indicated in the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

Explanation of Signs

[0096] 1 Smart Glass (Display Device) 2, 112 Control Unit 3 Projection Unit 4 Imaging Unit 5, 116 Storage Unit 6, 115 Communication Unit 7 Audio Input / Output Unit 11 Construction Reference Information Generation Device 21 Display Control Unit 22 Position Recognition Unit 23 Input Control Unit 24 Warning Control Unit 101 Opening 102 Elevator Shaft 103 Piano Wire 111 Safety Helmet 113 Display Unit 114 Input Unit 200 Landing 201 Floor 202, 300 Wall 1121 Construction Reference Information Generation Section D1 First Process Data D2 Second Process Data D11, D12, D21, D22 Component Data M1·M2 Marker QR1·QR2 Two-Dimensional Code RL1, RL2 Rail

Claims

1. A display device that displays a virtual object in an overlay manner in accordance with a position in a real space including at least one of an elevator shaft and a landing, on a field of view of an operator viewing the real space or on an image representing the real space, the display device comprising: A display control unit that reads out and displays construction reference information related to the virtual object from the display data for the overlay display; an input control unit that receives and processes instruction inputs from an operator; Equipped with The display data is data in which the construction reference information is associated with each of a plurality of steps in a construction work, The display control unit is a display device that displays the construction reference information corresponding to the process specified by the worker via the input control unit among the plurality of processes.

2. The display device according to claim 1 , wherein the display control unit displays the construction reference information relating to a part specified by the worker via the input control unit, among the construction reference information corresponding to each of a plurality of parts included in the process specified by the worker.

3. The display device according to claim 1 , wherein the display control unit simultaneously displays the construction reference information corresponding to a plurality of the processes designated by the worker.

4. the display control unit displays, as the virtual object, an input interface that receives an instruction input from the worker; The display device according to claim 1 , wherein the input interface displays options for each of the plurality of processes, and the options are selectable by an operator.

5. The display control unit displays an input interface that accepts instruction input from the worker as the virtual object, The display device according to claim 2 , wherein the input interface displays options for each of the plurality of parts, and the options are selectable by an operator.

6. 1. A display control method for overlaying a virtual object on a field of view of an operator viewing a real space including at least one of an elevator shaft and a landing, or on an image representing the real space, in an arrangement according to a position in the real space, the method comprising: a display control step of reading and displaying construction reference information related to the virtual object from the display data for the overlay display; an input control step of receiving and processing instruction input from an operator; having The display data is data in which the construction reference information is associated with each of a plurality of steps in a construction work, In the display control step, the construction reference information corresponding to the process designated by the worker in the input control step is displayed among the plurality of processes.

7. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing a computer to function as the display control unit.

Images