Display device, display control method, and display control program

Abstract

To provide a display device which is configured to overlay virtual objects at positions corresponding to positions in real space, and which reduces the size of construction reference information data and effort required to create such data.SOLUTION: A display device provided herein comprises a display control unit (21) configured to read and display construction reference information (D) related to virtual objects from display data for overlay display, the display data containing data common to a plurality of specific floors as common floor data (D2, D3). The display control unit (21) reads the common floor data (D2, D3) when displaying construction reference data (D) related to the specific floors.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display device that overlays virtual objects in an arrangement according to positions in the real space onto the field of view of a worker viewing the real space where a building is to be constructed, or onto an image representing the real space. [Background technology]

[0002] Conventionally, in construction work and the like, a method has been proposed in which information necessary for the work is displayed superimposed on real space on a display device such as smart glasses worn by a worker while the work is being carried out. For example, Patent Document 1 discloses a projection device that scans real space to recognize the spatial shape, scales drawing data to fit the real space, and maps and displays it on the real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-163466 Summary of the Invention [Problem to be solved by the invention]

[0004] Using the above technology, it is conceivable to overlay an image showing the installation position of a construction target onto the real space where the work is being carried out. For example, this overlay display technology could be used when constructing elevator shafts and landings in the construction of a building. The shaft is located between the lowest and highest floors of the building and has a long vertical structure. Landings are also located on each floor. Because many different components are installed in such shafts and landings, the amount of data used as construction reference information for overlay display becomes enormous. Another problem is that the amount of work required to create such a large amount of data is also significant.

[0005] One aspect of the present invention aims to provide a display device that overlays virtual objects in an arrangement that corresponds to their position in real space, and that can reduce the size of data used as construction reference information and the effort required to create the data. [Means for solving the problem]

[0006] In order to solve the above problems, the display device of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and is equipped with a display control unit that reads and displays construction reference information for the virtual object from display data for the overlay display, the display data including data common to a plurality of specific floors as common floor data, and the display control unit reads out the common floor data when displaying the construction reference information for the specific floor.

[0007] In order to solve the above problems, the display control method of the present invention is a display control method that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement that corresponds to the position of the real space, and includes a display control step that reads and displays construction reference information related to the virtual object from display data for the overlay display, and the display data includes data common to a plurality of specific floors as common floor data, and in the display control step, the common floor data is read out when displaying the construction reference information for the specific floor.

[0008] The display device according to each aspect of the present invention may be realized by a computer. In this case, a display control program that causes the computer to operate as each part (software element) of the display device to realize the display device on a computer, and a computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention. [Effects of the Invention]

[0009] According to the present invention, for multiple specific floors, it is sufficient to read and display common floor data, which reduces the size of the display data. Also, for multiple specific floors, it is sufficient to create one common floor data, which reduces the effort required to create the display data and also reduces the effort required to modify the display data. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an outline of the configuration of smart glasses 1 according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing a schematic configuration of a construction reference information generating device 11 according to an embodiment of the present invention. [Figure 3] 1 is a diagram showing a state in which smart glasses (display device) 1 according to the present embodiment are attached to a safety helmet 111. FIG. [Figure 4] FIG. 2 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102 to which the elevator is to be constructed. [Figure 5] 1 is a perspective view showing an outline of an opening 101 as viewed from inside a hoistway 102. FIG. [Figure 6] FIG. 10 is a diagram showing an example of a state in which a virtual object OB is overlaid and displayed. [Figure 7] As an example of a building, this is a side cross-sectional view of an elevator shaft 102 in a building having floors 1 to 6. [Figure 8] 3 is a flowchart showing a processing flow of an elevator installation method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, one embodiment of the present invention will be described in detail.

[0012] (Outline of smart glass application examples) 3 is a diagram showing a state in which smart glasses (display device) 1 according to this embodiment are attached to a safety helmet 111. In this embodiment, a situation is assumed in which a worker who is installing an elevator during the construction of a building wears the smart glasses 1 together with the safety helmet 111.

[0013] The smart glasses 1 are optically transparent head-mounted displays. A wearer of the smart glasses 1 can view the external real space and also view the projected image within the real space. That is, the smart glasses 1 overlay virtual objects as construction reference information for elevator construction in the field of view of a worker viewing the real space including the elevator landing and hoistway, with the objects positioned according to their position in the real space.

[0014] 6 shows an example of a state in which a virtual object OB is overlaid and displayed in real space. As shown in the figure, the virtual object OB is displayed in a space a predetermined distance away from a wall surface 300 in real space. This allows the worker to confirm in real space the position in three-dimensional space where the construction work should be performed. This eliminates the need for tasks such as measuring and confirming the position where the construction work should be performed in real space, thereby improving workability.

[0015] In this embodiment, smart glasses 1, which are optically transparent head-mounted displays, are used as the display device, but the present invention is not limited to this. For example, a video-transparent head-mounted display that displays both an image of the external real space captured by a camera and an image of a virtual object may be used. Furthermore, instead of a head-mounted display, the display device according to the present invention may be a portable information display terminal such as a tablet PC or a notebook PC, or a portable display and camera connected to an information processing device wirelessly or via a cable.

[0016] The virtual object as construction reference information is displayed based on 3D CAD data or 2D CAD data generated based on the design specifications of the construction target. This CAD data may be generated based on information of a 3D model generated as BIM (Building Information Modeling), for example. In BIM, various information such as the quantity, product number, dimensions, material, performance, and price of each part is included in the 3D model as object information, so at least one of this information may be displayed as construction reference information. Details of the construction reference information will be described later.

[0017] (Details of smart glasses configuration) Fig. 1 is a block diagram showing an outline of the configuration of smart glasses 1. As shown in the figure, the smart glasses 1 include a control unit 2, a projection unit 3, an imaging unit 4, a storage unit 5, a communication unit 6, and an audio input / output unit 7. The control unit 2 is a block that performs various information processing in the smart glasses 1, and includes a display control unit 21, a position recognition unit 22, an input control unit 23, and a warning control unit 24.

[0018] The display control unit 21 controls the projection unit 3 to overlay and display a virtual object as construction reference information related to elevator construction. The projection unit 3 projects an image onto the half mirror, allowing the worker wearing the smart glasses 1 to view the projected image while viewing the external real space. The display control unit 21 makes the projected image for the right eye and the projected image for the left eye different, thereby displaying the virtual object as if it were three-dimensionally positioned at a predetermined position in real space. This allows the worker to recognize the construction position as a three-dimensional position in real space.

[0019] The display control unit 21 reads out construction reference information D including three-dimensional CAD data or two-dimensional CAD data stored in the storage unit 5 and controls the display of the virtual object. Here, the three-dimensional CAD data or two-dimensional CAD data also includes information indicating a positional relationship with an object existing in real space. In addition, the display control unit 21 controls the display position of the virtual object based on the position in real space recognized by the position recognition unit 22.

[0020] The storage unit 5 stores top floor data D1, first common floor data D2, second common floor data D3, and bottom floor data D4 as construction reference information D. Details of these data will be described later.

[0021] The display control unit 21 may acquire the construction reference information D from an external source via the communication unit 6. The communication unit 6 may communicate with a PC or server on a local network via a wireless LAN, or with an external server via the Internet, for example. This allows the data stored in the storage unit 5 to be updated or new data to be acquired.

[0022] The position recognition unit 22 recognizes the three-dimensional position of the smart glasses 1 in real space and the three-dimensional direction in which the smart glasses 1 are facing by recognizing the captured images of markers M1 and M2 (details will be described later) placed at predetermined positions in real space captured by the imaging unit 4. The position recognition unit 22 is also capable of position recognition with 6DoF (Degree of Freedom). This allows the worker to once have their position recognized by the position recognition unit 22 using the markers M1 and M2, and then view the virtual object while maintaining its relative positional relationship with real space even if they subsequently change their viewing direction or move.

[0023] The input control unit 23 is a block that receives and processes various instruction inputs from the worker. For example, an instruction input is an input to an input interface as a virtual object. That is, the display control unit 21 displays an image as the input interface as a virtual object in real space, and the instruction input from the worker is received by image recognition of the worker's virtual touch with a finger or the like.

[0024] Furthermore, for example, an instruction input from a worker may be accepted by voice input from the voice input / output unit 7. That is, the input control unit 23 recognizes the voice received by the voice input / output unit 7 and recognizes the content of the instruction from the worker, thereby accepting the instruction input from the worker.

[0025] Furthermore, an instruction input from a worker may be accepted by an external input device via the communication unit 6. For example, the communication unit 6 communicates with various input devices such as a Bluetooth (registered trademark) compatible input controller or a wireless keyboard, and an instruction input is accepted as an input by a worker to the input device.

[0026] The warning control unit 24 controls some kind of warning to be issued to the worker wearing the smart glasses 1. Examples of warning methods include projecting and displaying the warning content using an overlay display by the display control unit 21, outputting a warning sound or a voice indicating the warning content from the audio input / output unit 7, and so on.

[0027] The warning condition is that the position recognition unit 22 recognizes that the worker is located within a predetermined area near the elevator shaft. This allows a warning to be issued when there is an increased risk of the worker falling into the elevator shaft, thereby further improving the safety of the worker.

[0028] At least one function of the display control unit 21, the position recognition unit 22, the input control unit 23, and the warning control unit 24 included in the control unit 2 may be realized in an external computer via communication.

[0029] (Example of a real space where an elevator is installed) Fig. 4 is a perspective view showing an outline of an elevator hall 200 and a hoistway 102, which are the targets of elevator construction. The figure shows a state in which the elevator doors have not yet been installed, during the construction stage of a building. In this state, an opening 101 serving as an elevator entrance exists between the hall 200 and the hoistway 102. The hall 200 has a floor surface 201 and a wall surface 202.

[0030] Two markers M1 and M2 are provided on the floor surface 201. As described above, the markers M1 and M2 are used by the position recognition unit 22 to recognize the positions in real space by performing image recognition of the markers M1 and M2 in the captured image. Each of the markers M1 and M2 is made up of a rectangular planar member, and a predetermined pattern is formed on its surface. By arranging such markers M1 and M2 at predetermined positions near the opening 101 on the floor surface 201 of the hall 200, the position recognition unit 22 can accurately recognize the positions of the hall 200 and the elevator shaft 102 in three-dimensional space.

[0031] In this embodiment, two markers are provided for each landing, but this is not limited to this, and one marker, or three or more markers may be provided. The more markers provided, the higher the accuracy of position recognition, but if two markers are provided, position recognition can be performed with sufficient accuracy.

[0032] Furthermore, in this embodiment, the markers M1 and M2 are provided at the hall 200, but the markers may also be provided within the hoistway 102.

[0033] Markers M1 and M2 are placed at predetermined positions on floor surface 201 that are specified as marker installation positions in construction reference information including 3D CAD data or 2D CAD data. The installation positions of these markers M1 and M2 require high precision in order to accurately match the positions in real space with the displayed positions of the virtual objects. Therefore, it is preferable that the markers be placed based on a predetermined position reference object with high placement position accuracy in real space. An example of the position reference object is piano wire 103 placed in elevator shaft 102.

[0034] FIG. 5 is a perspective view showing the opening 101 as seen from inside the elevator shaft 102. As shown in the figure, two piano wires 103, 103 are suspended from predetermined positions at the top of the elevator shaft 102 during the construction stage of a building. In other words, the piano wires 103, 103 are placed in fixed positions without being affected by the construction status of each floor. Therefore, by using this piano wire as a position reference (reference line), it is possible to maintain a high level of accuracy in the installation positions of the markers M1, M2. Note that this is not limited to piano wire, and any strong wire member with a sufficiently thin diameter may be used.

[0035] Alternatively, a laser beam may be used as a position reference, for example. That is, by irradiating a laser beam vertically downward from a predetermined position in the upper part of the elevator shaft 102, or by irradiating a laser beam vertically upward from a predetermined position in the lower part of the elevator shaft 102, the laser beam can be positioned at a fixed position, similar to piano wire. However, with laser beams, the thickness of the beam tends to increase as the distance from the light source increases, so there is a possibility that errors due to the thickness of the beam may be affected depending on the height of the building. Alternatively, a reference point (architectural markings) marked on the landing of each floor may be used as a position reference.

[0036] Furthermore, multiple landings 200 will be provided for each floor for one elevator, and it is preferable to install the markers at the same location in relation to the elevator entrance / exit, i.e., at the same relative position in relation to the entrance, at each landing 200.

[0037] In many cases, all halls 200 for the same elevator have the same structural arrangement. In this case, since markers M1 and M2 can be installed in the same locations relative to the elevator entrances at each hall 200, the marker installation work can be performed using the same standards and work. This allows the marker installation work to be performed efficiently. In addition, the data for overlay display can also have a common data structure among multiple halls 200.

[0038] Each of the markers M1 and M2 may be provided with a two-dimensional code. In Fig. 4, each of the markers M1 and M2 is provided with a two-dimensional code QR1 or QR2. The two-dimensional codes QR1 and QR2 indicate information about the floor on which the marker M1 or M2 is located. In other words, when the position recognition unit 22 recognizes the markers M1 and M2 in the captured image, it also recognizes the two-dimensional codes QR1 and QR2, thereby enabling it to recognize information about the floor on which the read marker M1 or M2 is located.

[0039] The floor information included in the marker is not limited to a two-dimensional code. For example, the marker may display text such as "3F," which may be acquired as floor information through character recognition. Furthermore, the marker may be colored specific to each floor or display an image with a specific shape, allowing the floor to be recognized through image recognition.

[0040] (Details of construction reference information) Next, we will explain the construction reference information D. As described above, the construction reference information D includes the top floor data D1, the first common floor data D2, the second common floor data D3, and the bottom floor data D4.

[0041] 7 shows, as an example of a building, a side cross-sectional view of an elevator shaft 102 in a building having floors 1 to 6. On each floor, virtual objects OB corresponding to various construction targets are displayed in the elevator shaft 102 and at the landing 200. The virtual objects OB corresponding to each floor are displayed with the floor level FL of each floor as the position reference.

[0042] In the example of the building shown in Fig. 7, the placement position of the virtual object OB with respect to the floor level FL is the same for the 5th floor and the 4th floor. The placement position of the virtual object OB with respect to the floor level FL is also the same for the 3rd floor and the 2nd floor. On the other hand, the placement position of the virtual object OB with respect to the floor level FL for the 6th floor, which is the top floor, and the 1st floor, which is the bottom floor, is different from that of the other floors.

[0043] In this case, the top floor data D1 corresponds to the construction reference information for the 6th floor as the top floor. The first common floor data D2 corresponds to the construction reference information for the 5th and 4th floors as the first common floors. The second common floor data D3 corresponds to the construction reference information for the 3rd and 2nd floors as the second common floors. The bottom floor data D4 corresponds to the construction reference information for the 1st floor as the bottom floor.

[0044] In this embodiment, two types of common floors are set, but the present invention is not limited to this, and one type of common floor may be set depending on the structure of the building, or three or more types of common floors may be set. Furthermore, common floor data may be applied even to the top floor or the bottom floor.

[0045] (Configuration of construction reference information generation device) Next, a description will be given of the construction reference information generating device 11 that generates construction reference information. FIG. 1 is a block diagram showing a schematic configuration of the construction reference information generating device 11. As shown in the figure, the construction reference information generating device 11 includes a control unit 112, a display unit 113, an input unit 114, a communication unit 115, and a storage unit 116. The construction reference information generating device 11 is assumed to be configured, for example, by a normal general-purpose PC (Personal Computer), but is not limited to this, and at least a part of the processing may be performed by a cloud service.

[0046] The control unit 112 is a block that performs various information processes in the construction reference information generating device 11, and includes a construction reference information generating unit 1121.

[0047] The construction reference information generation unit 1121 generates the top floor data D1, the first common floor data D2, the second common floor data D3, and the bottom floor data D4 as the construction reference information D. The construction reference information generation unit 1121 generates the construction reference information D in response to instructions input from the worker received by the input unit 114. For example, as described above, the construction reference information D is generated by reading the 3D model information of the building generated as a BIM in response to the instructions input from the worker, and then adding the design data of the construction object to the BIM in response to the instructions input from the worker. Here, for multiple specific floors, such as the 5th and 4th floors, and the 3rd and 2nd floors, it is sufficient to create one common floor data each. This reduces the time and effort required by the worker to create the construction reference information D. Furthermore, even if it becomes necessary to modify or add content to the construction reference information D due to design changes, the modification or addition work can be performed on the common floor data, thereby reducing the time and effort required by the worker.

[0048] The construction reference information generation unit 1121 stores the construction reference information D generated as described above in the storage unit 116. Thereafter, the generated construction reference information D is transferred to the smart glasses 1 based on instructions from the worker as necessary. The method of data transfer is not particularly limited. For example, the transfer may be performed by communication between the construction reference information generation device 11 and the smart glasses 1 via wireless LAN or a USB cable. Alternatively, the construction reference information D may be temporarily uploaded from the construction reference information generation device 11 to a cloud server, and the smart glasses 1 may access the cloud server to acquire the information, thereby transferring the information. Alternatively, the transfer may be performed by a storage medium such as a USB memory.

[0049] Examples of construction objects include IR plates, IRP brackets, rail brackets, sill brackets, buffer bases, cable hangers, machines, machine beams, limit switch troughs, breaker boxes, control panels, governor rope guides, hole button boxes, panel bases, and floor ducts.

[0050] The IR plate indicates the elevator car's stopping position. When the IR plate interrupts a sensor attached to the car, it determines whether the car has landed at the designated position at each floor. The IRP bracket attaches the IR plate to the rail. The rail bracket secures the rail RL to the wall of the hoistway 102. The sill bracket secures the sill, which guides the landing door, to the wall of the hoistway 102. The buffer base is a base component for securing a buffer, which absorbs shock in the event of a car or counterweight falling, to the pit at the bottom of the hoistway 102, and also serves to secure the rail to the bottom of the pit. The cable hanger secures the intermediate position of the traveling cable (tail cord) connecting the car to the control panel. The machine is a motor that raises and lowers the elevator by winding up the rope, and the machine beam secures the machine to the rail or pit. The limit switch trough is a component that mounts a limit switch that detects the car's position near the top or bottom floor. The breaker box is a box that houses the breaker, and the control panel is a device that controls the elevator's operation. The governor rope guide is a component that guides the side of the governor rope that is not fastened to the car, preventing the rope from swaying. The hall button box is a box installed on the wall of the landing that houses the landing call button and a display that shows the car's current position and direction of movement. In elevators with a machine room on the roof of a building, the electrical panel and machines must be installed in the machine room and wired together. The base that secures this electrical panel to the building is called the panel base, and the ducts that form the wiring paths from each electrical panel to each machine are called floor ducts.

[0051] (Elevator installation method processing flow) Next, the process flow of the elevator installation method according to this embodiment will be described with reference to Fig. 8. When elevator installation begins, first, in step 1 (hereinafter referred to as S1), a marker installation jig MJ having markers M1 and M2 attached thereto is installed at a predetermined position in the hall 200.

[0052] Next, in S2, the worker wears the smart glasses 1 on the floor where he or she is to work, and the marker corresponding to the floor where the worker is located is captured by the imaging unit 4, and position recognition processing is performed by the position recognition unit 22. Here, the position recognition unit 22 identifies the floor where the worker is located based on the information included in the marker.

[0053] The position recognition unit 22 may determine whether a marker is installed on the floor where the worker is located based on the distance to the marker. This allows the marker to be properly recognized as the marker installed on the floor where the worker is located, even if markers on other floors are included in the image capture range of the image capture unit 4. The distance to the marker may be determined based on the size of the marker in the captured image, or a distance sensor such as LiDAR (Light Detection and Ranging) may be used.

[0054] Once position recognition is performed, in S3, the display control unit 21 reads out data of the construction reference information D according to the floor recognized by the position recognition unit 22. That is, if the recognized floor is the 6th floor, the top floor data D1 is read out; if the recognized floor is the 5th or 4th floor, the first common floor data D2 is read out; if the recognized floor is the 3rd or 2nd floor, the second common floor data D3 is read out; and if the recognized floor is the 1st floor, the bottom floor data D4 is read out. Then, the display control unit 21 overlays the virtual object based on the read out data. Once the worker has used the markers M1 and M2 to have the position recognition unit 22 recognize their position, they can view the virtual object while maintaining its relative positional relationship with the real space, even if they subsequently change their viewing direction or move.

[0055] In this way, the floor where the worker is working is identified based on the markers M1 and M2, and the virtual object OB corresponding to that floor is displayed, so the worker can check information appropriate for that floor without having to go through the trouble of inputting floor information. Furthermore, location recognition is performed based on the markers M1 and M2 corresponding to the floor where the worker is working. Therefore, the accuracy of the display position of the overlay display can be improved compared to when location recognition is performed based on markers on other floors.

[0056] In the above example, the floor where the worker is located is identified based on the information contained in the marker, but this is not limiting. For example, numbers indicating floor numbers marked on landings or elevator shafts may be recognized. Furthermore, the worker may input the floor where the worker is located using input means such as a virtual object input interface.

[0057] In this state, in S4, the worker performs construction work while checking the construction reference information overlaid and displayed by the display control unit 21. Note that the construction work includes not only the actual construction work but also the check work after the construction work is completed.

[0058] Next, in S5, it is confirmed whether the floor on which the worker is located has changed. If the result in S5 is Yes, i.e., if the worker has moved to another floor, the process returns to S2, and position recognition is performed based on the marker set on the floor after the worker has moved. This allows the display device to re-recognize the marker corresponding to the floor on which the worker is working, even if the worker has moved to a different floor, thereby maintaining a high level of accuracy in the display position of the overlay display.

[0059] If the answer is No in S5, i.e., if the floor where the worker is located has not changed, in S6 the input control unit 23 checks whether or not an instruction to change the floor information to be displayed has been received from the worker. For example, the floor that the worker wants to display may be input by input means such as an input interface using a virtual object. Also, for example, a 3D model that simply displays the floors of a building may be displayed as an input interface using a virtual object, allowing the worker to select a desired floor portion.

[0060] If the answer is Yes in S6, that is, if an instruction to change the floor information to be displayed is received from the worker, the display control unit 21 reads out the data for the specified floor in S7. That is, if the specified floor is the 6th floor, the top floor data D1 is read out; if the specified floor is the 5th or 4th floor, the first common floor data D2 is read out; if the specified floor is the 3rd or 2nd floor, the second common floor data D3 is read out; and if the specified floor is the 1st floor, the bottom floor data D4 is read out. Then, the overlay display in S3 is performed based on the read data.

[0061] Here, position recognition is performed based on markers M1 and M2 corresponding to the floor where the work is being performed, and construction reference information D for the floor specified by the worker is displayed in the real space where the position has been recognized. This makes it possible to perform construction work while referring to construction reference information D corresponding to other floors.

[0062] For example, a case can be considered in which the top floor data D1 is read and displayed while work is being performed on the bottom floor. Limit switches are installed on the top and bottom floors, but their locations must be consistent in the horizontal plane. This is because the limit switches must contact components installed in designated locations on the elevator car. Therefore, a possible application example is to switch between displaying the top floor data D1 and the bottom floor data D4 on the bottom floor to confirm whether the horizontal positions of the limit switches on the top and bottom floors are consistent. Another possible application example is to check whether the location of the arrival light indicating the arrival of the elevator and the location of the hall call button are consistent among the top floor, the first common floor, the second common floor, and the bottom floor at hall 200. In this way, by displaying data for a specific floor on another floor, work can be performed while referring to information on other floors to check for interference with construction objects and consistency between the floors above and below.

[0063] If the answer to S6 is No, i.e., if the worker has not given an instruction to change the floor information to be displayed, the completion of construction work is confirmed in S8, and if the answer to S8 is No, i.e., if construction work is continuing, the processing from S3 is repeated, and if the answer to S8 is Yes, i.e., if construction work has ended, the processing is terminated.

[0064] The above construction method and smart glasses 1 enable elevator construction to be carried out safely and efficiently. Such effects will also contribute to the achievement of Goal 11.c of the Sustainable Development Goals (SDGs) advocated by the United Nations, which states, "Support the development of sustainable and resilient buildings using local materials in least developed countries, including through financial and technical assistance."

[0065] [Software implementation example] The functions of the smart glasses 1 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 2).

[0066] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0067] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0068] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0069] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0070] (summary) A display device according to aspect 1 of the present invention is a display device that overlays a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position in the real space, and is equipped with a display control unit that reads and displays construction reference information related to the virtual object from display data for the overlay display, the display data including data common to a plurality of specific floors as common floor data, and the display control unit reads the common floor data when displaying the construction reference information for the specific floor.

[0071] According to the above configuration, for multiple specific floors, it is sufficient to read and display common floor data, which reduces the size of the display data. Also, for multiple specific floors, it is sufficient to create one common floor data, which reduces the effort required to create the display data and also reduces the effort required to modify the display data.

[0072] A display device according to aspect 2 of the present invention may be configured in the above aspect 1 to include a position recognition unit that recognizes the position in the real space where the construction reference information is displayed, and when the floor recognized by the position recognition unit is the specific floor, the display control unit reads out the common floor data and displays the construction reference information.

[0073] According to the above configuration, when the recognized floor is a specific floor, display is performed based on the common floor data, so that construction reference information can be displayed without causing trouble to the worker.

[0074] A display device according to aspect 3 of the present invention may be configured such that, in aspect 1 above, the display control unit reads out the common floor data and displays the construction reference information when the floor specified by the worker is the specific floor.

[0075] According to the above configuration, when the floor specified by the worker is a specific floor, the display is based on the common floor data, so that the construction reference information can be displayed in accordance with the worker's intentions.

[0076] A display device according to aspect 4 of the present invention may be configured in the above-mentioned aspect 1 to include a position recognition unit that recognizes the position of the real space including the elevator shaft by performing image recognition of a marker corresponding to the floor on which the worker is located, among markers installed at positions corresponding to each floor of the building in which the elevator is installed, in accordance with instructions from the worker, and the display control unit may read out the display data corresponding to the floor specified by the worker and display the construction reference information in the real space corresponding to the floor on which the worker is located.

[0077] According to the above configuration, the construction reference information for the floor indicated by the worker can be displayed in the real space where the position is recognized by the marker. Therefore, for example, it becomes possible to perform construction work while referring to the construction reference information for other floors.

[0078] A display control method according to aspect 5 of the present invention is a display method for overlaying a virtual object onto the field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or onto an image representing the real space, in an arrangement corresponding to the position of the real space, the method having a display control step for reading and displaying construction reference information for the virtual object from display data for the overlay display, the display data including data common to a plurality of specific floors as common floor data, and in the display control step, reading out the common floor data when displaying the construction reference information for the specific floor.

[0079] A display control program according to a sixth aspect of the present invention is a display control program for causing a computer to function as the display device in the first aspect, and causes the computer to function as the display control unit.

[0080] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0081] 1. Smart glasses (display device) 2, 112 Control unit 3 Projection section 4. Imaging unit 5, 116 storage section 6, 115 Communications Department 7 Audio input / output section 11 Construction reference information generation device 21 Display control unit 22 Position recognition part 23 Input control section 24 Warning control section 101 Opening 102 Elevator 103 Piano wire 111 Safety Helmet 113 Display section 114 Input section Platform 200 201 Floor 202, 300 walls 1121 Construction reference information generation department D1 Top floor data D2 1st common floor data D3 Second common floor data D4 Bottom floor data M1 / M2 markers QR1 / QR2 2D code

Claims

1. A display device that overlays and displays virtual objects in an arrangement according to positions in a real space in a field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or in an image representing the real space, the display device comprising: a display control unit that reads and displays construction reference information related to the virtual object from the display data for the overlay display; The display data includes data common to a plurality of specific floors as common floor data, A display device wherein the display control unit reads out the common floor data when displaying the construction reference information for the specific floor.

2. a position recognition unit that recognizes a position in the real space where the construction reference information is displayed; The display device according to claim 1 , wherein, when the floor recognized by the position recognition unit is the specific floor, the display control unit reads out the common floor data and displays the construction reference information.

3. The display device according to claim 1 , wherein the display control unit reads out the common floor data and displays the construction reference information when the floor designated by the worker is the specific floor.

4. a position recognition unit that recognizes a position in the real space including the elevator shaft by performing image recognition of a marker corresponding to the floor where the worker is located, among markers installed at positions corresponding to each floor of the building in which the elevator is installed, in response to an instruction from the worker; The display device according to claim 1, wherein the display control unit reads out the display data corresponding to the floor specified by the worker and displays the construction reference information in the real space corresponding to the floor on which the worker is located.

5. A display control method for overlaying a virtual object in a field of view of a worker viewing a real space including at least one of an elevator shaft and a landing, or an image representing the real space, in an arrangement according to a position in the real space, the method comprising: a display control step of reading and displaying construction reference information related to the virtual object from the display data for the overlay display; The display data includes data common to a plurality of specific floors as common floor data, A display control method, wherein in the display control step, when the construction reference information for the specific floor is displayed, the common floor data is read out.

6. 2. A display control program for causing a computer to function as the display device according to claim 1, the display control program causing the computer to function as the display control unit.

Images