Program, equipment information display method, equipment information display system, and terminal device

Abstract

To facilitate checking of an equipment layout at an actual construction site.SOLUTION: A program is provided, for causing a processor to implement a function for managing equipment images by group, and a function for controlling display of the equipment images by group.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to a program, a method for displaying facility information, a facility information display system, and a terminal device.

Background Art

[0002] For example, Patent Document 1 discloses a piping drawing system for creating a piping drawing by arranging icons of devices and piping lines on a grid line diagram displayed on a screen. When the starting point position of a piping line is specified at the intersection of grid lines on the grid line diagram, a piping line cursor of a certain length is displayed radially along each grid line centering on the intersection, and by setting an end point at an arbitrary position of any of the displayed piping line cursors, a piping line from the starting point to the end point is drawn. A piping drawing system is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, conventionally, when designing building facilities in a building, for example, on an installed PC terminal, drawings related to the arrangement of building facilities are created. And the user imagines the arrangement of building facilities in the building by comparing, for example, the printed paper drawings and the actual building at the construction site. In this case, the image of the arrangement of building facilities based on the paper drawings was left to the user. Also, even when an image of the arrangement of building facilities could be formed in the actual building, when trying to change the arrangement of building facilities, it was necessary to recreate the drawing on the PC terminal, print out the created drawing, and compare the actual building and the drawing again, which was time-consuming.

[0005] The present invention aims to facilitate the confirmation of the arrangement of equipment at an actual site.

Means for Solving the Problems

[0006] The invention according to claim 1 is a program for causing a processor to realize a function of managing images of equipment by group and a function of controlling the display of the images of the equipment by group. The invention according to claim 2 is the program according to claim 1, wherein the processor further has a function of receiving the presence or absence of display by group and a function of displaying, on a display screen, an image of the equipment corresponding to a group selected as a display target. The invention according to claim 3 is the program according to claim 2, wherein the processor further has a function of displaying images of the equipment in different colors when a plurality of groups are selected as display targets. The invention according to claim 4 is the program according to claim 2, wherein the processor further has a function of displaying, at a corresponding position of a two-dimensional or three-dimensional layout diagram, an image of the equipment corresponding to a selected group. The invention according to claim 5 is the program according to claim 2, wherein the processor further has a function of superimposing and displaying, at a corresponding position of a photographed image of an actual site, an image of the equipment corresponding to a selected group. The invention according to claim 6 is the program according to any one of claims 1 to 5, wherein the processor displays construction estimate information regarding an image of the equipment on a display screen when receiving a predetermined operation. The invention according to claim 7 is the program according to any one of claims 1 to 5, wherein the processor further has a function of causing the display of the image of the equipment to follow a change in a photographed image of an actual site and a function of receiving a plurality of settings of a reference indicating a boundary portion where the change in the photographed image starts. The invention according to claim 8 is the program according to any one of claims 1 to 5, wherein the processor further has a function of receiving a setting of the arrangement of an image of the equipment penetrating a boundary portion of a site. The invention according to claim 9 is the program according to any one of claims 1 to 8, wherein the facility includes at least one of an air conditioning facility, a plumbing facility, an electrical facility, a building facility, a facility related to water or other liquids, a facility related to gas or other gases, a facility related to electrical wiring, and a facility related to telecommunications. The invention according to claim 10 is the program according to any one of claims 1 to 9, wherein the group is managed for each boundary surface partitioning a space. The invention according to claim 11 is the program according to any one of claims 1 to 10, wherein the group is prepared according to the type of facility. The invention according to claim 12 is a method for displaying facility information, in which a processor manages images of facilities by group and manages the display of the images of the facilities by group. The invention according to claim 13 is a display system for facility information, which has a functional unit for managing images of facilities by group and a functional unit for controlling the display of the images of the facilities by group. The invention according to claim 14 is a terminal device having a processor, and the processor manages images of facilities by group and controls the display of the images of the facilities by group.

Advantages of the Invention

[0007] According to the present invention, it is possible to easily confirm the arrangement of facilities at an actual site.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings.

[0010] <Building Equipment Display System 1> FIG. 1 is an overall view of the building equipment display system 1 according to the present embodiment. As shown in FIG. 1, the building equipment display system 1 of the present embodiment includes a terminal device 10 for assisting in the design of building equipment in a building, and a management server device 20 for managing information related to the building equipment handled by the terminal device 10.

[0011] In the building equipment display system 1 of the present embodiment, the terminal device 10 and the management server device 20 can communicate with each other via a network. The network is not particularly limited as long as it is a communication network used for data communication between devices, and may be, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, etc. The communication line used for data communication may be wired or wireless, or a combination of these.

[0012] The building equipment display system 1 of the present embodiment can be applied to the design of building equipment such as pipes through which liquids such as tap water and sewage flow, or liquids such as refrigerants of air conditioning equipment, indoor units of air conditioning equipment provided indoors, and outdoor units of air conditioning equipment provided outdoors. Note that the building equipment display system 1 of the present embodiment is not limited to water supply pipes and sewage pipes, and can also be applied to building equipment such as gas pipes through which gases such as gas flow, and electric conduit pipes through which electrical wiring passes. In addition, the building equipment display system 1 of the present embodiment can also be applied to equipment related to telecommunications and equipment related to gas.

[0013] Here, the outline of the building equipment display system 1 of the present embodiment will be described. FIG. 2 is an explanatory diagram of the outline of the building equipment display system 1 of the present embodiment. As shown in Fig. 2(1), the user designs the building equipment to be installed in the building on the display screen 11D of the terminal device 10. In the present embodiment, the design of the building equipment is performed by the user arranging the equipment image 75 on the reception screen 400 displayed on the display screen 11D. In this way, in the building equipment display system 1 of the present embodiment, the design of the building equipment can be performed in a sketch-like manner by the user's tap operation on the display screen 11D. Furthermore, as shown in Fig. 2(2), in the terminal device 10, the layout diagram 71 of the building equipment is created based on the design of the building equipment by the user. In the description of the present embodiment, creating the layout diagram 71 of the building equipment is referred to as "layout diagram creation".

[0014] Then, as shown in Fig. 2(3), the terminal device 10 displays a superimposed image 800 on the display screen 11D in which the equipment image 75 is superimposed on the captured image 120 of the building to be designed. Here, the positional relationship between the equipment image 75 and the captured image 120 of the actual building is associated. Then, in the terminal device 10, when the captured image 120 changes by moving the display screen 11D, the equipment image 75 follows the changed captured image 120, and the display direction of the equipment image 75 changes. In the description of the present embodiment, superimposing and displaying the equipment image 75 and the captured image 120 is referred to as "augmented reality (AR) display". Here, augmented reality (AR) is to expand the world that the user sees by adding information such as graphics and characters to an image of an actual scene.

[0015] Thereafter, as shown in Fig. 2(4), the terminal device 10 creates an estimate image 850 (an example of estimate information) indicating the estimated amount for the construction of the building equipment based on the designed layout diagram 71 of the building equipment. Then, the terminal device 10 displays the created estimate image 850 on the display screen 11D. In the description of the present embodiment, creating the estimate image 850 and displaying it on the display screen 11D is referred to as "estimate creation".

[0016] In the building equipment display system 1 of this embodiment, "layout drawing creation", "AR display", and "estimate creation" are interconnected. Therefore, for example, the user can repeatedly perform simulations on the terminal device 10 as many times as they like, such as re-arranging the building equipment based on the results of the AR display or re-arranging the building equipment based on the results of the estimated amount. In particular, in the building equipment display system 1 of this embodiment, a series of operations including layout drawing creation, AR display, and estimate creation can be performed by the user collectively on the display screen 11D. Hereinafter, each component of the above-described building equipment display system 1 will be described in detail.

[0017] 〔Terminal device 10〕 FIG. 3 is a functional block diagram of the terminal device 10 of this embodiment.

[0018] As shown in FIG. 1, as the terminal device 10 (an example of a display means), a portable terminal device such as a tablet-type terminal or a mobile phone such as a smartphone that the user can carry around can be used. The terminal device 10 of this embodiment includes a touch panel unit 11 that displays an image and accepts the user's operations, and a camera 12 that performs shooting. The terminal device 10 also has a communication device (not shown) that receives information from other devices such as the management server device 20 and transmits information to other devices. In the touch panel unit 11, by being touched by the user on the display screen 11D, operations and instructions on the image displayed on the display screen 11D are accepted from the user.

[0019] The camera 12 (an example of imaging means) is provided on the surface of the terminal device 10 opposite to the touch panel unit 11. Then, the camera 12 displays the captured image 120 on the touch panel unit 11. The terminal device 10 of the present embodiment is used while being held by the user with the user (the user's face) facing the display screen 11D of the touch panel unit 11. In this case, the imaging direction of the camera 12 of the terminal device 10 is the same as the direction in which the user's face faces (the direction of the user's line of sight). Then, the captured image 120 displayed on the display screen 11D and the scenery seen by the user are the same.

[0020] Furthermore, as shown in FIG. 3, the terminal device 10 includes a layout creation unit 30 (an example of reception means) for creating a layout diagram 71, and an augmented reality (AR) display unit 40 (an example of control means) for superimposing and displaying an image of building facilities based on the created layout diagram 71 on the captured image 120 and showing it to the user, and an estimate creation unit 50 for creating estimate information based on the created layout diagram 71.

[0021] 〔Management server device 20〕 FIG. 4 is a functional block diagram of the management server device 20 of the present embodiment. FIG. 5 is an example of a facility information management table 210 managed by the management server device 20.

[0022] As shown in FIG. 4, the management server device 20 includes a building facility database (DB) unit 21 that stores information on building facilities used by the layout creation unit 30, a layout storage unit 22 that stores information on the layout diagram 71 created by the terminal device 10, and a construction drawing creation unit 23 that creates a construction drawing used as a construction drawing based on the layout diagram 71.

[0023] (Building facility DB unit 21) The building equipment DB unit 21 stores an equipment information management table 210 that manages information on multiple types of building equipment. As shown in FIG. 5, the equipment information management table 210 includes items such as an "equipment ID" that can identify the building equipment, a "name" which is a specific name provided for each building equipment, an "equipment image ID" that identifies the equipment image 75 used for creating the layout diagram 71, a "unit price" which is the price set for each building equipment, and "product information" that shows detailed information on the building equipment.

[0024] For example, in the case of an indoor unit of an air conditioning equipment as an example of building equipment, for the "equipment ID": AC001, the "name": air conditioning indoor unit, the "equipment image ID": ac001.jpg, and the "unit price": ¥200,000, and "product information": URL001 are respectively associated. Note that the "product information" stores address information for accessing the database where the product information is stored. Also, the product information includes detailed information on the building equipment such as the product image and design drawing of the building equipment, the model number of the building equipment, the manufacturer information of the building equipment, and the specifications of the building equipment (for example, dimensions and service life, etc.).

[0025] The building equipment DB 21 transmits the content of the equipment information management table 210 to the terminal device 10 based on a request from the terminal device 10. Also, the building equipment DB 21 manages the equipment information management table 210 based on settings received from the management user, such as setting the unit price, adding or deleting the equipment image 75.

[0026] (Layout diagram storage unit 22) The layout diagram storage unit 22 acquires information on the layout diagram 71 created by the terminal device 10. Then, the layout diagram storage unit 22 stores the acquired information on the layout diagram 71. Also, the layout diagram storage unit 22 transmits the stored information on the layout diagram 71 to the terminal device 10 in response to a request from the terminal device 10.

[0027] (Construction drawing creation unit 23) The construction drawing creation unit 23 acquires the information of the layout drawing 71 from the layout drawing storage unit 22. Then, based on the acquired layout drawing 71, the construction drawing creation unit 23 creates the construction drawings of the building. The construction drawings can use, for example, the format of CAD (Computer-aided Design) drawings, and are more detailed drawings than the layout drawing 71 in the present embodiment. Then, the construction drawing creation unit 23 transmits the information of the created construction drawings to the required destination. For example, the construction drawing creation unit 23 can transmit the information of the created construction drawings to the terminal device 10, the printing device, or even other devices.

[0028] Subsequently, each functional configuration in the terminal device 10 of the present embodiment will be described in detail. (Layout drawing creation unit 30) FIG. 6 is a functional block diagram of the layout drawing creation unit 30 of the terminal device 10 of the present embodiment. FIGS. 7 and 8 are explanatory diagrams of the reception screen 400 of the present embodiment.

[0029] As shown in FIG. 6, the layout drawing creation unit 30 includes a facility information acquisition unit 31 that acquires information on building facilities, a reception screen display unit 32 that receives operations related to the creation of the layout drawing 71 from the user, and a layout drawing management unit 33 that manages the created layout drawing 71.

[0030] The facility information acquisition unit 31 acquires the facility information management table 210 (see FIG. 5) from the management server device 20. Then, the facility information acquisition unit 31 acquires the information on building facilities stored in the facility information management table 210. Further, the facility information acquisition unit 31 sends the acquired information on building facilities to the reception screen display unit 32.

[0031] The reception screen display unit 32 draws the layout drawing 71 created by the user's operation on the display screen 11D. In the present embodiment, the reception screen display unit 32 draws the layout drawing 71 displayed in 3D (hereinafter referred to as the 3D layout drawing 713) or the layout drawing 71 displayed in 2D (2D layout drawing 712).

[0032] The layout diagram management unit 33 manages the information of the layout diagram 71 created by the user on the reception screen 400 described above. Specifically, for each created layout diagram 71, the layout diagram management unit 33 stores the boundary image 73 and the arrangement of the facility images 75 in the boundary image 73. Then, in response to a request from the reception screen display unit 32, the layout diagram management unit 33 passes the stored information of the layout diagram 71 to the reception screen display unit 32. Also, the layout diagram management unit 33 sends the stored information of the layout diagram 71 to the AR display unit 40 and the estimate creation unit 50. Further, the layout diagram management unit 33 transmits the information of the layout diagram 71 to the management server device 20.

[0033] Next, the reception screen display unit 32 will be described in detail. As shown in FIG. 7, the reception screen display unit 32 of the present embodiment displays a boundary image 73 indicating a boundary surface that partitions a space in a building and a facility image 75 indicating building facilities set in the building on the display screen 11D. And the reception screen display unit 32 of the present embodiment displays the 3D layout diagram 713 as an aerial view. The 3D layout diagram 713 includes a 3D boundary image 733 which is a boundary image 73 displayed in 3D and a 3D facility image 753 which is a facility image 75 displayed in 3D.

[0034] The 3D boundary image 733 (an example of a building image) is an image showing the design space corresponding to the actual building where the user arranges building facilities. The 3D boundary image 733 is created based on numerical information regarding the size of the actual building received from the user. Also, the 3D boundary image 733 includes an inner surface 73N showing the inner surface in the room space and an outer surface 73G showing the outer surface in the room space. The inner surface 73N and the outer surface 73G are respectively formed for the floor part on the lower side in the vertical direction in the room space, the ceiling part on the upper side in the vertical direction in the room space, and the four wall parts in the horizontal direction. And between the inner surface 73N and the outer surface 73G is the thickness part (inside) of each of the ceiling part, the floor part, and the wall part.

[0035] In the description of the present embodiment, when not particularly distinguishing the ceiling part, floor part, and wall part that constitute the boundary with adjacent room spaces or the outside in a building, they will be described as "boundary parts".

[0036] As will be described later, the three-dimensional facility image 753 is displayed based on the arrangement of the two-dimensional facility image 752 arranged by the user in the two-dimensional arrangement diagram 712. In the present embodiment, in the three-dimensional arrangement diagram 713, the three-dimensional facility image 753 cannot be edited. However, it may be possible to enable editing of the three-dimensional facility image 753 in the three-dimensional arrangement diagram 713.

[0037] Furthermore, when the reception screen display unit 32 receives a slide operation of the user on the three-dimensional arrangement diagram 713 on the display screen 11D, the reception screen display unit 32 rotates the three-dimensional arrangement diagram 713 in an arbitrary direction of up, down, left, or right. Furthermore, when the reception screen display unit 32 receives a pinch-out operation of the user on the three-dimensional arrangement diagram 713 on the display screen 11D, the reception screen display unit 32 enlarges the display of the three-dimensional arrangement diagram 713, or when it receives a pinch-in operation, it reduces the display of the three-dimensional arrangement diagram 713.

[0038] Also, as shown in FIGS. 8(A) and 8(B), the reception screen display unit 32 of the present embodiment displays the two-dimensional arrangement diagram 712 in a plan view. The two-dimensional arrangement diagram 712 includes a two-dimensional boundary image 732 that is a two-dimensional boundary image 73 and a two-dimensional facility image 752 that is a two-dimensional facility image 75, respectively.

[0039] The two-dimensional arrangement diagram 712 is displayed on the display screen 11D in response to a touch operation of the user on the three-dimensional arrangement diagram 713. That is, when the reception screen display unit 32 receives a tap operation of the user on one boundary part (wall part, ceiling part, floor part) in the three-dimensional arrangement diagram 713 (see FIG. 7), the reception screen display unit 32 displays the two-dimensional arrangement diagram 712 of the one boundary part where the tap operation was performed on the display screen 11D. In this case, the reception screen display unit 32 does not display the two-dimensional arrangement diagram 712 of the other boundary parts where the tap operation was not performed on the display screen 11D.

[0040] Furthermore, when a user's tap operation is performed on the three-dimensional layout diagram 713, the reception screen display unit 32 displays, on the reception screen 400, a two-dimensional layout diagram 712 showing the inner surface 73N side of the one boundary part where the tap operation was performed, as shown in Fig. 8(A). In the two-dimensional layout diagram 712 showing the inner surface 73N side, a two-dimensional boundary image 732 when the two-dimensional layout diagram 712 is viewed from the inner surface 73N side and a two-dimensional facility image 752 arranged on the inner surface 73N of the two-dimensional boundary image 732 are displayed.

[0041] Here, in a building, building facilities are mainly provided inside the room space. Also, the inside of the room space greatly affects the interior of the room space. Therefore, the reception screen display unit 32 of the present embodiment preferentially displays, on the reception screen 400, the two-dimensional layout diagram 712 showing the inner surface 73N of the boundary part, over the outer surface 73G, in accordance with the tap operation on the three-dimensional layout diagram 713, so that the user can perform the placement work on the facility image 75 on the inner surface 73N of the boundary part first.

[0042] In addition, the reception screen display unit 32 displays a grid 91 on the two-dimensional boundary image 732. The grid 91 is displayed by arranging a plurality of lines in a grid pattern. And the grid 91 enables the two-dimensional facility image 752, which is a linear building facility such as a pipe, to be arranged only along the lines. Also, the grid 91 enables the center of the two-dimensional facility image 752, which is a rectangular building facility such as a facility device, to be arranged so as to coincide with the intersection of the lines. In this way, in the present embodiment, the grid 91 specifies the arrangement of the two-dimensional facility image 752 to some extent. Thereby, in the present embodiment, it becomes easy for the user to install the two-dimensional facility image 752 or connect facilities to each other by performing a tap operation on the display screen 11D.

[0043] Then, the reception screen display unit 32 receives from the user the arrangement of the 2D facility image 752 with respect to the 2D boundary image 732. The reception screen display unit 32 draws the 2D layout diagram 712 based on the arrangement of the 2D facility image 752 received from the user. Also, the reception screen display unit 32 reflects the arrangement of the 2D facility image 752 in the 2D layout diagram 712 in the 3D layout diagram 713. Further, the reception screen display unit 32 sends the information of the updated 3D layout diagram 713 to the layout diagram management unit 33.

[0044] In addition, when the reception screen display unit 32 receives a slide operation of the user with respect to the 2D layout diagram 712 displayed on the display screen 11D, it performs a display operation of moving the 2D layout diagram 712 in any direction of up, down, left, or right. Further, when the reception screen display unit 32 receives a pinch-out operation of the user with respect to the 2D layout diagram 712 displayed on the display screen 11D, it enlarges the 2D layout diagram 712, and when it receives a pinch-in operation, it reduces the display of the 2D layout diagram 712.

[0045] Next, the operation button images displayed on the reception screen 400 in the state where the 3D layout diagram 713 is displayed will be specifically described. As shown in FIG. 7, the reception screen display unit 32 displays a new creation button 611, a read button 612, and a save button 613 on the reception screen 400 on which the 3D layout diagram 713 is displayed.

[0046] The new creation button 611 is a button image that receives a selection operation of the user when newly creating the layout diagram 71 of the building facilities in the building. When the new creation button 611 is selected, the reception screen display unit 32 requests the user to set the room space of the building to be displayed as the 3D boundary image 733. Specifically, when the reception screen display unit 32 receives the selection operation of the new creation button 611, it receives from the user the input of the size of the room space, that is, the distance between each boundary part and the thickness of the boundary part. Then, the reception screen display unit 32 creates the boundary image 73 (3D boundary image 733, 2D boundary image 732) based on the input numerical value of the distance and displays it on the reception screen 400.

[0047] The read button 612 is a button image that accepts from the user an operation of reading out and displaying on the display screen 11D the layout diagram 71 created and saved in the past by the user. Further, the read button 612 is a button image that accepts from the user an operation of reading out and displaying on the display screen 11D the layout diagram 71 created based on the measurement information measured by a measurement device described later. The save button 613 is a button image that accepts from the user an operation of causing the terminal device 10 to store and save the layout diagram 71 created by the user. In the building equipment display system 1 of the present embodiment, it is possible to store the layout diagram 71 in the layout diagram management unit 33 of the terminal device 10 and also store it in the management server device 20.

[0048] Further, as shown in FIG. 7, the reception screen display unit 32 displays the layer management button 62 on the reception screen 400 on which the three-dimensional layout diagram 713 is displayed. The layer management button 62 is a button image that accepts from the user a management operation of the layer configuration of the boundary image 73. The layer management button 62 has a layer display switching button 621 and a layer addition button 622.

[0049] FIG. 9 is an explanatory diagram of the layer structure of the boundary image 73 of the present embodiment. Here, the boundary image 73 of the present embodiment has a plurality of layers provided at each boundary portion, and it is possible to receive the arrangement of the facility image 75 for each layer. For example, as shown in FIG. 9(A), the boundary image 73 of each boundary portion can be configured with a three-layer structure of a first layer 73a, a second layer 73b, and a third layer 73c. Then, as shown in FIG. 9(B), for example, the facility image 75 related to the air conditioning facility is displayed on the first layer 73a, the facility image 75 related to the plumbing facility is displayed on the second layer 73b, and the facility image 75 related to the electrical facility is displayed on the third layer 73c. Note that the layer configuration of the boundary image 73 is reflected in both the two-dimensional layout diagram 712 and the three-dimensional layout diagram 713. Also, in the present embodiment, the display color of the facility image 75 can be made different for each layer for display.

[0050] And the layer display switching button 621 accepts the switching of the display / non-display of the facility image 75 in each layer among the plurality of layers. Also, the layer addition button 622 is used when newly adding a layer. As described above, in the present embodiment, with the layer structure, building facilities can be managed for each type of building facility such as air conditioning facilities, plumbing facilities, and electrical facilities.

[0051] Furthermore, as shown in FIG. 7, the reception screen display unit 32 displays an AR display button 63 and an estimate creation button 64 on the reception screen 400 on which the three-dimensional layout diagram 713 is displayed. The AR display button 63 (an example of an instruction image) is a button image that accepts an execution instruction for AR display to superimpose and display the created layout diagram 71 on the captured image 120 from the user. When the AR display button 63 is selected, the reception screen display unit 32 causes the AR display unit 40 to execute the AR display on the display screen 11D. Note that the AR display will be described in detail later.

[0052] The estimate creation button 64 (an example of the third instruction image) is a button image for receiving an estimate creation instruction from the user based on the created layout drawing 71. When the estimate creation button 64 is selected, the reception screen display unit 32 causes the estimate creation unit 50 to display an estimate image 850 on the display screen 11D. The estimate display will be described in detail later.

[0053] Next, the operation button images displayed on the reception screen 400 in the state where the two-dimensional layout drawing 712 is displayed will be specifically described. As shown in FIG. 8(A), the reception screen display unit 32 of the present embodiment displays an equipment image drawing button 65 related to the display of the two-dimensional equipment image 752 on the reception screen 400 on which the two-dimensional layout drawing 712 on the inner surface 73N side is displayed. In the present embodiment, the equipment image drawing button 65 includes a drawing button 651, a deletion button 652, a connection button 653, a punching button 654, and an equipment selection button 655.

[0054] The drawing button 651 is a button image for receiving a setting that enables the two-dimensional equipment image 752 of the selected building equipment to be added to the two-dimensional boundary image 732. When the drawing button 651 is selected, the reception screen display unit 32 adds and displays the two-dimensional equipment image 752 based on the position where the tap is performed each time the user performs a tap operation on the two-dimensional boundary image 732 thereafter.

[0055] As shown in FIG. 8(A), when the indoor unit of the air conditioning equipment is selected as the building equipment and the drawing button 651 is selected, the reception screen display unit 32 then displays the two-dimensional equipment image 752 corresponding to the indoor unit at the position where the user performs a tap operation on the two-dimensional boundary image 732. Also, as shown in FIG. 8(A), when piping is selected as the building equipment and the drawing button 651 is selected, the reception screen display unit 32 then displays the two-dimensional equipment image 752 corresponding to the piping so as to connect the positions where the user continuously performs tap operations on the two-dimensional boundary image 732.

[0056] The delete button 652 is a button image that accepts a setting to make the two-dimensional facility image 752 deletable. When the delete button 652 is selected, the reception screen display unit 32 deletes the two-dimensional facility image 752 that the user then taps on.

[0057] The connection button 653 is a button image that accepts a display of a joint that connects the intersecting parts when two-dimensional facility images 752, which are displayed linearly such as pipes, intersect.

[0058] The punching button 654 is a button image that accepts an operation to display the two-dimensional facility image 752 in a direction penetrating the boundary part. When the punching button 654 is selected, the reception screen display unit 32 causes the two-dimensional facility image 752 that the user then taps on to be displayed penetrating the two-dimensional boundary image 732. Note that the reception screen display unit 32 executes a display of penetrating the boundary part regardless of whether the operation based on the punching button 654 is performed on the two-dimensional facility image 752 of either the two-dimensional boundary image 732 on the inner surface 73N side or the two-dimensional boundary image 732 on the outer surface 73G side.

[0059] The facility selection button 655 is a button image that accepts a selection of building facilities as the two-dimensional facility images 752 to be added to the two-dimensional boundary image 732 based on the operation of the drawing button 651. When the facility selection button 655 is selected, the reception screen display unit 32 displays options for a plurality of building facilities that can be selected as the two-dimensional facility image 752 on the reception screen 400. Note that the reception screen display unit 32 displays options for a plurality of building facilities based on the facility information management table 210 acquired by the facility information acquisition unit 31. Then, the reception screen display unit 32 displays the building facility selected based on the operation of the facility selection button 655 on the two-dimensional boundary image 732 in response to the user's tap operation after the operation of the drawing button 651 as described above.

[0060] Further, as shown in FIG. 8(A), the reception screen display unit 32 of the present embodiment displays a reference setting button 661, a grid setting button 662, a cancel button 671, a retry button 672, an outer display button 681, and an aerial view button 69 on the reception screen 400 on which the two-dimensional layout diagram 712 on the inner surface 73N side is displayed.

[0061] The reference setting button 661 is a button image for receiving the setting of the reference image 95 that serves as a reference for starting the movement of the display screen 11D of the terminal device 10 when performing AR display. In the present embodiment, the reference image 95 has an arrow shape. After the reference setting button 661 is selected, when the user performs a tap operation on one boundary portion, the reference image 95 is displayed such that the tip of the arrow faces the back side of the display screen 11D at the position of the tap operation in the two-dimensional boundary image 732 of the one boundary portion. Further, the display of the reference image 95 can be set for either the inner surface 73N or the outer surface 73G of the two-dimensional boundary image 732.

[0062] Then, the setting of the reference image 95 on the two-dimensional layout diagram 712 is also reflected in the three-dimensional layout diagram 713. As shown in FIG. 7, when the reference image 95 is set on the inner surface 73N, the arrow is provided so that the direction of the arrow faces the outer surface 73G side. When the reference image 95 is set on the outer surface 73G, the arrow is provided so that the direction of the arrow faces the inner surface 73N side. Note that the reference image 95 will be described in detail later.

[0063] The grid setting button 662 receives from the user the setting of the interval of the grid 91. When the grid setting button 662 is selected, options indicating a plurality of intervals are displayed on the reception screen 400. A plurality of types of intervals of the grid 91 are provided and can be arbitrarily selected by the user.

[0064] The cancel button 671 is a button image for receiving an instruction to cancel the previous user operation. The redo button 672 receives an instruction to re - execute the operation canceled by the cancel button 671.

[0065] The outer display button 681 is a button image that receives an operation to switch the display from the state showing the inner surface 73N side of the two - dimensional layout diagram 712 to the outer surface 73G side of the two - dimensional layout diagram 712 on the opposite side. As shown in FIG. 8(A), when the inner surface 73N side of the two - dimensional layout diagram 712 is being displayed, the two - dimensional facility image 752 arranged on the inner surface 73N side of the two - dimensional boundary image 732 is displayed. On the other hand, when the outer display button 681 is selected, as shown in FIG. 8(B), the display switches to the state where the outer surface 73G side of the two - dimensional layout diagram 712 is displayed, and the two - dimensional facility image 752 arranged on the outer surface 73G side of the two - dimensional boundary image 732 is displayed.

[0066] In this embodiment, when the inner surface 73N side of the two - dimensional layout diagram 712 is being displayed, the two - dimensional facility image 752 arranged on the inner surface 73N is displayed, and the two - dimensional facility image 752 arranged on the outer surface 73G is not displayed. On the other hand, when the outer surface 73G side of the two - dimensional layout diagram 712 is being displayed, the two - dimensional facility image 752 arranged on the outer surface 73G is displayed, and the two - dimensional facility image 752 arranged on the inner surface 73N is not displayed. Thus, in this embodiment, the display of the two - dimensional layout diagram 712 is prevented from becoming complicated.

[0067] The bird's - eye view button 69 (an example of the second instruction image) is a button image that receives an operation to switch the display from the state where the two - dimensional layout diagram 712 is being displayed to the three - dimensional layout diagram 713. As shown in FIG. 8(A), when the bird's - eye view button 69 is selected while the two - dimensional layout diagram 712 is being displayed on the reception screen 400, as shown in FIG. 7, the reception screen 400 on which the three - dimensional layout diagram 713 is displayed is shown.

[0068] Subsequently, the reception screen 400 on which the two - dimensional layout diagram 712 on the outer surface 73G side is displayed will be described. As shown in FIG. 8(B), the reception screen display unit 32 of the present embodiment displays a two-dimensional layout diagram 712 showing the outer surface 73G side on the reception screen 400. In the two-dimensional layout diagram 712 showing the outer surface 73G side, a two-dimensional boundary image 732 when the two-dimensional layout diagram 712 is viewed from the outer surface 73G side and a two-dimensional facility image 752 arranged on the outer surface 73G of the two-dimensional boundary image 732 are displayed.

[0069] Also, as shown in FIG. 8(B), the reception screen display unit 32 of the present embodiment displays, on the reception screen 400 where the two-dimensional layout diagram 712 on the outer surface 73G side is displayed, basically the same button images as those on the reception screen 400 where the two-dimensional layout diagram 712 on the inner surface 73N side shown in FIG. 8(A) is displayed. However, on the reception screen 400 where the two-dimensional layout diagram 712 on the outer surface 73G side is displayed, an inner display button 682 is displayed instead of the outer display button 681.

[0070] The inner display button 682 is a button image that accepts an operation to switch the display to the inner surface 73N side of the two-dimensional layout diagram 712 on the opposite side from the state where the outer surface 73G side of the two-dimensional layout diagram 712 is shown. When the inner display button 682 is selected, the display of the reception screen 400 switches from the state where the outer surface 73G side of the two-dimensional layout diagram 712 shown in FIG. 8(B) is displayed to the state where the inner surface 73N side of the two-dimensional layout diagram 712 is displayed as shown in FIG. 8(A).

[0071] (AR display unit 40) FIG. 10 is a diagram showing the functional blocks of the AR display unit 40 of the present embodiment. FIG. 11 is an explanatory diagram of AR display by the AR display unit 40 of the present embodiment. FIG. 12 is an explanatory diagram of the tracking operation in the AR display of the present embodiment.

[0072] As shown in FIG. 10, the AR display unit 40 includes a captured image acquisition unit 41 that acquires a captured image 120, a motion identification unit 42 that identifies the motion of the movement of the position and orientation of the display screen 11D, a superimposed display unit 43 that superimposes and displays the layout diagram 71 on the captured image 120, and an adjustment unit 44 that adjusts the display position of the layout diagram 71.

[0073] The imaging image acquisition unit 41 acquires the imaging image 120 captured by the camera 12 (see FIG. 1). Then, the imaging image acquisition unit 41 sends the information of the acquired imaging image 120 to the motion identification unit 42 and the superimposed display unit 43. Note that the imaging image acquisition unit 41 always acquires the imaging image 120 from the camera 12 when the AR display is being executed.

[0074] The motion identification unit 42 identifies the movement of the imaging image 120 acquired from the imaging image acquisition unit 41. For example, when the user moves the terminal device 10, the orientation of the camera 12 provided in the terminal device 10 changes, so the content of the imaging image 120 captured by the camera 12 changes. That is, as the terminal device 10 moves, the imaging image 120 also moves. Then, the motion identification unit 42 identifies the amount of movement in the vertical, horizontal, and front - rear directions of the image based on the feature points of the image displayed in the imaging image 120. Then, the motion identification unit 42 sends the information on the amount of movement of the identified imaging image 120 to the superimposed display unit 43.

[0075] Note that the motion identification unit 42 may identify the position and orientation of the display screen 11D by, for example, a motion sensor mounted on the terminal device 10. In this case, as the motion sensor, a three - axis gyro sensor that detects the angular velocity (rotation speed) of the terminal device 10, a three - axis acceleration sensor that detects the acceleration of the terminal device 10, and a three - axis geomagnetic sensor that detects the geomagnetism and detects the absolute direction of the terminal device 10 can be used.

[0076] The superimposed display unit 43 acquires the imaging image 120 from the imaging image acquisition unit 41. Further, the superimposed display unit 43 acquires the information of the layout diagram 71 from the layout diagram creation unit 30. Then, as shown in FIG. 11, the superimposed display unit 43 displays a superimposed image 800 in which the three - dimensional facility image 753 of the layout diagram 71 is superimposed on the imaging image 120 on the display screen 11D of the terminal device 10. Also, when the superimposed display unit 43 of the present embodiment displays the three - dimensional facility image 753, it arranges both the three - dimensional facility image 753 arranged on the inner surface 73N and the three - dimensional facility image 753 arranged on the outer surface 73G.

[0077] Further, the superimposed display unit 43 determines the display size of the three-dimensional facility image 753 based on the characteristics of the room space obtained from the captured image 120. The superimposed display unit 43 extracts the characteristics of the room space from the captured image 120, such as the corners of the room, the width of the wall in the left-right direction, and the width of the wall in the up-down direction (the height from the floor to the ceiling). Then, the superimposed display unit 43 aligns the corners of the boundary portion of the three-dimensional boundary image 733 with the corners of the room in the captured image 120, or aligns the size of the boundary portion in the three-dimensional boundary image 733 with the size of the boundary portion such as the wall portion in the captured image 120. In this way, the superimposed display unit 43 of the present embodiment determines the display position and display size (scale) on the display screen 11D of the three-dimensional layout diagram 713.

[0078] Here, in the building equipment display system 1 of the present embodiment, when performing AR display, the user is required to hold the terminal device 10 (display screen 11D) at a predetermined position in the room space of the actual building and start the AR display with the display screen 11D facing in a predetermined direction. Note that the position of the display screen 11D of the terminal device 10 and the orientation of the display screen 11D required of the user are determined by the position and orientation of the reference image 95 preset by the user in the boundary image 73.

[0079] Then, in the building equipment display system 1, with the state where the display screen 11D is facing in a predetermined direction at a predetermined position as the initial state, the user moves the position and orientation of the display screen 11D. Further, in the building equipment display system 1, the display of the three-dimensional facility image 753 is changed according to the amount of movement of the display screen 11D from the initial state. As a result, even if the user moves the display screen 11D, a follow-up display is realized in which the three-dimensional facility image 753 is displayed at the position where the user arranged it on the three-dimensional boundary diagram 733 with respect to the captured image 120 showing the actual building. Hereinafter, the AR display will be described in more detail.

[0080] When starting to display the 3D facility image 753 of the layout diagram 71, the superimposed display unit 43 displays the 3D facility image 753 according to the position and orientation based on the reference image 95 specified by the user when creating the layout diagram. For example, as shown in Fig. 8(A), assume that when creating the layout diagram, the user has specified a reference image 95 in the direction from the inner surface 73N side to the outer surface 73G side at the center of the 2D layout diagram 712 that displays the inner surface 73N of one wall portion.

[0081] In this case, when starting to display the 3D facility image 753 of the layout diagram 71, the superimposed display unit 43 displays the 3D facility image 753 viewed from the inner surface 73N side of one wall portion on the display screen 11D. Also, the superimposed display unit 43 arranges and displays the 3D facility image 753 arranged on the inner surface 73N of one wall portion on the front side of the display screen 11D and the 3D facility image 753 arranged on the outer surface 73G of one wall portion on the back side.

[0082] Then, the superimposed display unit 43 changes the display content of the 3D facility image 753 to be displayed on the display screen 11D based on the information on the movement amount of the captured image 120 acquired from the operation specifying unit 42. For example, as shown in Fig. 12(A), when the user moves the terminal device 10 in the left - right direction, the display direction of the 3D facility image 753 is changed in the left - right direction so as to follow the change in the left - right direction of the captured image 120 displayed on the display screen 11D. Note that this following operation is the same for the up - down movement of the terminal device 10.

[0083] Furthermore, as shown in Fig. 12(B), when the position of the terminal device 10 moves in the front - back direction due to the movement of the user, the display direction of the 3D facility image 753 is changed in the front - back direction so as to follow the change in the front - back direction of the captured image 120 displayed on the display screen 11D.

[0084] In addition, when a user inside a room in an actual building moves around to the outside of the room (wall), the three-dimensional facility image 753 as viewed from the inner surface 73N side of the boundary part changes from the state of being displayed on the front side in the display screen 11D to the state of being displayed on the front side in the display screen 11D as viewed from the outer surface 73G side of the boundary part.

[0085] As described above, when the captured image 120 displayed on the display screen 11D changes due to the user changing the orientation or moving the position of the terminal device 10, the superimposed display unit 43 causes the three-dimensional facility image 753 to be displayed following the captured image 120. In this way, in the building facility display system 1 of the present embodiment, when the user views the captured image 120 of the actual building facilities through the display screen 11D, the three-dimensional facility image 753 is displayed on the captured image 120, so that it can be felt as if the building facilities actually exist there.

[0086] Next, the button images displayed on the display screen 11D where AR display is performed will be described. FIG. 13 is an explanatory diagram of the button images displayed on the display screen 11D where AR display is performed.

[0087] As shown in FIG. 11, the superimposed display unit 43 displays the bird's-eye view button 69 and the button ON image 81 on the display screen 11D where the superimposed image 800 is displayed. When the bird's-eye view button 69 is selected in the state where the superimposed image 800 is displayed, the superimposed display unit 43 displays the reception screen 400 (see FIG. 7) that displays the three-dimensional layout diagram 713 on the display screen 11D. For example, it is assumed that the user wants to change the layout diagram 71 by grasping the image of the layout of the building facilities of the target building from the superimposed image 800 in the AR display. In such a case, in the present embodiment, by displaying the bird's-eye view button 69 on the display screen 11D where the superimposed image 800 is displayed, the user can immediately start changing the layout of the facility image 75 in the layout diagram 71.

[0088] Further, in the present embodiment, by providing the bird's-eye view button 69 at the lower side in the display screen 11D and at the end in the left-right direction, when the user holds the terminal device 10 with both hands, the operability when shifting to the display screen 11D on which the three-dimensional layout diagram 713 is displayed is improved.

[0089] The button ON image 81 is a button image that receives an instruction to display a button image group related to the correction of the display of the three-dimensional facility image 753 on the display screen 11D on which the superimposed image 800 is displayed. When the button ON image 81 is selected, the superimposed display unit 43 displays a button image group related to the correction of the display of the three-dimensional facility image 753 on the display screen 11D. Note that the button images related to the correction of the display of the three-dimensional facility image 753 will be described later. In the present embodiment, when displaying the superimposed image 800, in order to secure as wide an area as possible where the captured image 120 is displayed, other button image groups are displayed on the condition of an operation on the button ON image 81, and the button image group is not displayed unless the button ON image 81 is operated.

[0090] As shown in FIG. 13(A), when the button ON image 81 (see FIG. 11) is selected, the adjustment unit 44 displays the button OFF image 82, the reference designation button 83, the rotation button 84, the left-right movement button 85, the up-down movement button 86, and the zoom button 87 on the display screen 11D on which the superimposed image 800 is displayed. Then, in accordance with these button operations, the adjustment unit 44 receives from the user an adjustment of the display position of the three-dimensional facility image 753 with respect to the captured image 120 in the superimposed image 800. Further, in the present embodiment, the button OFF image 82, the reference designation button 83, the rotation button 84, the left-right movement button 85, the up-down movement button 86, and the zoom button 87 are displayed at the lower side in the display screen 11D and at the end in the left-right direction.

[0091] The button OFF image 82 is a button image for receiving from the user an operation to hide the button images displayed on the display screen 11D in accordance with the operation of the button ON image 81 (see FIG. 11).

[0092] In this embodiment, the reference specifying button 83 includes a reference 1 button 831, a reference 2 button 832, and a reference 3 button 833. As shown in FIG. 13(B), the reference 1 button 831, the reference 2 button 832, and the reference 3 button 833 respectively correspond to a first reference image 951, a second reference image 952, and a third reference image 953, which are reference images 95 set at predetermined positions in the three-dimensional layout diagram 713.

[0093] For example, in an actual building, the user selects the reference 1 button 831 at a position corresponding to the location where the first reference image 951 is displayed in the three-dimensional layout diagram 713. Then, when the reference 1 button 831 is operated, the adjustment unit 44 redisplay the three-dimensional facility image 753 centered on the first reference image 951 on the display screen 11D. And the superimposed display unit 43 changes the display direction of the three-dimensional facility image 753 that has started to be redisplayed following the change in the position and orientation of the terminal device 10 when the reference 1 button 831 is operated, with the position and orientation of the terminal device 10 when the reference 1 button 831 is operated as the origin.

[0094] Similarly, when the adjustment unit 44 accepts the selection of the reference 2 button 832 at a position corresponding to the location where the second reference image 952 is displayed in the three-dimensional layout diagram 713, it redisplay the three-dimensional facility image 753 centered on the second reference image 952 on the display screen 11D. Also, when the adjustment unit 44 accepts the selection of the reference 3 button 833 at a position corresponding to the location where the third reference image 953 is displayed in the three-dimensional layout diagram 713, it redisplay the three-dimensional facility image 753 centered on the third reference image 953 on the display screen 11D. In this way, in this embodiment, based on a plurality of different references set in the three-dimensional layout diagram 713, the reference position of the display of the three-dimensional facility image 753 with respect to the captured image 120 in the superimposed image 800 is adjusted.

[0095] As shown in FIG. 13(A), the rotation button 84 is a button image that accepts an operation to rotate the three-dimensional facility image 753 in the superimposed image 800 about a predetermined virtual rotation axis as the rotation center. The left - right movement button 85 is a button image that accepts an operation to parallel - move the 3D facility image 753 in the superimposed image 800 in the left - right direction of the display screen 11D as a whole. The up - down movement button 86 is a button image that accepts an operation to parallel - move the 3D facility image 753 in the superimposed image 800 in the up - down direction of the display screen 11D as a whole. The zoom - in / out button 87 is a button image that accepts an operation to enlarge or reduce the 3D facility image 753 in the superimposed image 800 as a whole.

[0096] In this embodiment, the display position of the 3D facility image 753 is adjusted using the reference - designation button 83, but it is not limited to this mode. For example, in the terminal device 10 of this embodiment, instead of the reference - designation button 83, based on features of the room space such as corners in the building obtained from the captured image 120 or predetermined reference markers, the display position of the 3D facility image 753 in the superimposed image 800 may be automatically adjusted.

[0097] FIG. 14 is a flowchart of the operation of the AR display unit 40 of this embodiment. As shown in FIG. 14, the AR display unit 40 determines whether the AR display button 63 (see FIG. 7) is selected (step 101). If the AR display button 63 is not selected (NO in step 101), the process returns to step 101 again. On the other hand, if the AR display button 63 is selected (YES in step 101), the AR display unit 40 acquires the captured image 120 from the camera 12 (step 102). Further, the AR display unit 40 superimposes the 3D facility image 753 based on the reference image 95 on the acquired captured image 120, and starts displaying the superimposed image 800 on the display screen 11D (step 103).

[0098] Thereafter, it is determined whether there is a change in the movement of the captured image 120 (step 104). And if there is a change in the movement of the captured image 120 (YES in step 104), the superimposed image 800 in which the 3D facility image 753 follows the captured image 120 is displayed on the display screen 11D (step 105).

[0099] And when there is no change in movement in the captured image 120 (NO in step 104), or when the display that has been made to follow in step 105 is performed, it is determined whether an instruction for position adjustment of the 3D facility image has been received from the user (step 106). The instruction for position adjustment of the 3D facility image is determined based on the operation of any of the button images of the rotation button 84, left - right movement button 85, up - down movement button 86, and zoom button 87 (see FIG. 13). And when an instruction for position adjustment of the 3D facility image has been received from the user (YES in step 106), the position adjustment of the 3D facility image is executed (step 107).

[0100] Thereafter, when an instruction for position adjustment of the 3D facility image has not been received from the user (NO in step 106), or when the position adjustment of the 3D facility image has been performed in step 107, it is determined whether an operation of the reference designation button 83 (see FIG. 13) has been received from the user (step 108). And when an operation of the reference designation button 83 has been received (YES in step 108), the 3D facility image 753 is redisplayed based on the reference designation button 83 (step 109).

[0101] Furthermore, when an operation of the reference designation button 83 has not been received (NO in step 108), or when the 3D facility image 753 has been redisplayed based on the reference designation button 83 in step 109, it is determined whether there is an operation of the bird's - eye view button 69 (see FIG. 13) (step 110). When an operation of the bird's - eye view button 69 has been performed (YES in step 110), the display screen 11D is shifted to the reception screen 400 on which the 3D layout diagram 713 is displayed from the superimposed image 800, and a series of processes of AR display are terminated. On the other hand, when an operation of the bird's - eye view button 69 has not been performed (NO in step 110), the process returns to step 104, and again, it is determined whether there is a change in movement in the captured image 120. As described above, in the building equipment display system 1 of the present embodiment, AR display in the terminal device 10 is performed.

[0102] (Estimate Creation Unit 50) Next, the estimate creation of this embodiment will be described. FIG. 15 is a functional block diagram of the estimate creation unit 50 of this embodiment. As shown in FIG. 15, the estimate creation unit 50 (an example of estimate creation means) includes a layout drawing information acquisition unit 51 that acquires information on the layout drawing 71, a price information acquisition unit 52 that acquires information on the price of building equipment, and an estimate image creation unit 53 that creates an estimate image.

[0103] The layout drawing information acquisition unit 51 acquires the information on the layout drawing 71 created by the user from the layout drawing creation unit 30. Then, the layout drawing information acquisition unit 51 sends the acquired information on the layout drawing 71 to the estimate image creation unit 53.

[0104] The price information acquisition unit 52 acquires price information on the unit price of building equipment from the equipment information management table 210 held by the layout drawing creation unit 30. Then, the price information acquisition unit 52 sends the acquired price information for each building equipment to the estimate image creation unit 53.

[0105] The estimate image creation unit 53 identifies the types and quantities of the building equipment used in the layout drawing 71 from the information on the layout drawing 71 acquired from the layout drawing information acquisition unit 51. Then, the estimate image creation unit 53 calculates the price for constructing the building equipment created as the layout drawing 71 based on the price information of the building equipment received from the price information acquisition unit 52.

[0106] In addition, the estimate image creation unit 53 of this embodiment identifies the types and quantities of the building equipment provided in the direction penetrating the boundary portion. For example, in an actual building, when installing building equipment in the direction penetrating a boundary portion such as a wall portion, for example, work such as drilling through the wall portion is required. Therefore, when calculating the estimate price, even when using the same building equipment, the construction-related price differs between the building equipment that requires drilling work and the building equipment that does not require drilling work. Thus, the estimate image creation unit 53 of this embodiment sets different prices, such as setting a higher price for the building equipment provided in the direction penetrating the boundary portion than for the building equipment that does not require drilling work.

[0107] Then, the estimate image creation unit 53 creates an estimate image 850 based on the estimate for the construction of the building facilities calculated based on the layout diagram 71 and displays it on the display screen 11D.

[0108] FIG. 16 is a diagram of an example of the estimate image that the estimate creation unit 50 of the present embodiment displays on the display screen 11D. As shown in FIG. 16, on the display screen where the estimate image 850 is displayed, a 3D layout diagram 713, a new creation button 611, a read button 612, a save button 613, an estimate print button 88, a close button 89, and an AR display button 63 are displayed.

[0109] The estimate print button 88 is a button image for receiving an instruction from the user to print the estimate image 850. The close button 89 is a button image for receiving an instruction from the user to make the estimate image 850 non - displayed. When the close button 89 is operated, the display of the estimate image 850 disappears, and the 3D layout diagram 713 that was displayed behind the estimate image 850 is displayed. Then, the display screen 11D shifts to the reception screen 400 (see FIG. 7) where the 3D layout diagram 713 is displayed. In the terminal device 10 of the present embodiment, when the user wants to review the arrangement of the building facilities again after confirming the estimate amount, the user can immediately start by operating the close button 89.

[0110] When the AR display button 63 is operated, the display screen 11D shifts to the screen where the superimposed image 800 is displayed. In the terminal device 10 of the present embodiment, when the user wants to view the image of the arrangement of the building facilities again in the superimposed image 800 after confirming the estimate amount, the user can immediately confirm by operating the AR display button 63.

[0111] In this embodiment, by providing the close button 89 and the AR display button 63 at the lower side of the display screen 11D at the left and right ends respectively, when the user holds the terminal device 10 with both hands, the operability when shifting to the display screen 11D on which the reception screen 400 and the superimposed image 800 are displayed is improved.

[0112] Next, a specific example of using the pre-created layout diagram 71 will be described. In the above-described example, the layout diagram 71 was created according to the operation by the user on the reception screen 400. Here, the layout diagram 71 is created based on the measurement information obtained by measuring the layout of the building facilities (hereinafter, existing building facilities) already installed in the actual building, and can be displayed on the reception screen 400.

[0113] For example, when the existing building facility is a pipe such as a water supply pipe, the layout of the pipe is specified using a measuring device that can move inside the pipe. The measuring device includes a photographing unit capable of photographing the surroundings, a distance measuring unit for measuring the moving distance of the device itself, and an attitude measuring unit for measuring the attitude of the device itself (that is, the direction in which the device itself faces). Then, by actually moving this measuring device, for example, inside the pipe, based on the information of the moving distance and the attitude, the layout (that is, the structure) of the existing building facilities is specified. Also, by moving the measuring device while performing photographing with the photographing unit, a facility photographing image of the existing building facilities is obtained. Further, the facility photographing image is associated with the information of the photographing position in the existing building facilities. Note that the facility photographing image may be a moving image or a still image.

[0114] Then, the measurement information of the existing building facilities measured by the measuring device is converted into a form that can be used as the layout diagram 71 and stored in the layout diagram storage unit 22 of the management server device 20. Also, the photographing information of the existing building facilities measured by the measuring device is stored in the layout diagram storage unit 22 together with the information of the photographing position.

[0115] FIG. 17 is an example of the 3D layout diagram 713 displayed based on the pre-created layout diagram 71. As shown in FIG. 17, in response to a user's operation on the read button 612, the layout diagram 71 created in advance using the above-described measuring device or the like is read out. The read layout diagram 71 is displayed on the reception screen 400 of the display screen 11D. FIG. 17 shows an example of the three-dimensional layout diagram 713. Then, the user can check the layout of the existing building facilities in the building by referring to the three-dimensional layout diagram 713.

[0116] FIGS. 18, 19, and 20 are examples of the two-dimensional layout diagram 712 displayed based on the layout diagram 71 created in advance. As shown in FIG. 18(A), the reception screen display unit 32 displays the two-dimensional layout diagram 712 on the display screen 11D in response to a tap operation of the user on the three-dimensional layout diagram 713 (see FIG. 17). As described above, the two-dimensional layout diagram 712 shown in FIG. 18(A) is not displayed by the user's drawing on the reception screen 400, but is displayed based on the layout diagram 71 created in advance and acquired from the layout diagram storage unit 22.

[0117] In addition, the reception screen display unit 32 displays a detailed information button 90 on the reception screen 400. The detailed information button 90 is a button image for receiving the display of detailed information about the facility image 75.

[0118] As shown in FIG. 18(B), when the detailed information button 90 is selected, the reception screen display unit 32 displays a shooting information button 901 and a product information button 902. The shooting information button 901 is a button for displaying an equipment shooting image obtained by shooting an existing building facility on the display screen 11D. In this example, the reception screen display unit 32 plays a video as an equipment shooting image in response to a user's operation on the shooting information button 901. In addition, the product information button 902 is a button for displaying information related to the building facility corresponding to the facility image 75 displayed on the reception screen 400 on the display screen 11D. The reception screen display unit 32 displays detailed information about the product of the building facility in response to a user's operation on the product information button 902.

[0119] Then, as shown in FIG. 19(A), after the shooting information button 901 (see FIG. 18(B)) of the detailed information button 90 is selected, when the user performs a tap operation on one of the two-dimensional facility images 752 in the facility image 75, the facility shooting image 92 corresponding to the one two-dimensional facility image 752 is reproduced. Further, when the facility shooting image 92 is displayed, a mark 92M is superimposed and displayed on the two-dimensional facility image 752 that is the display target of the facility shooting image 92. This mark 92M corresponds to the shooting position of the video being reproduced as the facility shooting image 92. Then, as shown in FIG. 19(B), the mark 92M moves on the two-dimensional facility image 752 according to the progress of the video of the facility shooting image 92. Note that the mark 92M can be moved on the two-dimensional facility image 752 by the user's slide operation. When the user moves the mark 92M to a predetermined position, the reception screen display unit 32 displays the facility shooting image 92 taken at the predetermined position.

[0120] Also, as shown in FIG. 20(A), the reception screen display unit 32 can receive a change from the user to the previously created layout diagram 71. The reception screen display unit 32 receives a change operation on the layout diagram 71 by the facility image drawing button 65. For example, as described with reference to FIGS. 19(A) and 19(B), as a result of the user checking the facility shooting image 92, the user may determine that there is a part that needs repair in the existing building facilities. In such a case, as shown in FIG. 20(A), the user performs operations such as deleting or drawing the two-dimensional facility image 752 of the target part on the reception screen 400. Note that the two-dimensional facility image 752 indicated by the dashed line in FIG. 20(A) is the facility image 75 of the building facilities that has been changed by the user. Note that the layout diagram 71 in which the change operation of the facility image 75 has been performed is stored in the layout diagram storage unit 22 of the management server device 20.

[0121] Furthermore, as shown in FIG. 20(B), after the product information button 902 (see FIG. 18(B)) of the detailed information button 90 is selected and the user performs a tap operation on the changed two-dimensional facility image 752, the product information 93 of the building facility corresponding to the two-dimensional facility image 752 is displayed. The product information 93 is displayed based on the information for each building facility stored in the facility information management table 210. Specifically, the product information 93 displays such contents as the name and model number, product image, manufacturer name, price, service life, etc. of the building facility as published in the product catalog.

[0122] Also, in the above-described example, the facility photographed image 92 is displayed on the display screen 11D in response to an operation on the two-dimensional facility image 752, but it may also be displayed in response to an operation on the three-dimensional facility image 753. Also, the product information 93 may be displayed, for example, when the user taps on the column of the building facility in the estimate image 850. Also, the product information 93 can also be displayed in response to a tap operation on the layout diagram 71 created by the user described with reference to FIGS. 8(A) and 8(B).

[0123] Here, the hardware configurations of the terminal device 10 and the management server device 20 of the present embodiment will be described. The terminal device 10 and the management server device 20 each include a CPU (Central Processing Unit) which is an arithmetic means, a working memory which is a main storage means, a magnetic disk device (HDD: Hard Disk Drive) which is an auxiliary storage means, a network interface, a display mechanism including a display device, an audio mechanism, and input devices such as a keyboard and a mouse. And the auxiliary storage means stores the OS program and application programs. And when these programs are read into the working memory and executed by the CPU, the functions of each component in the terminal device 10 and the management server device 20 are realized.

[0124] Furthermore, the program that realizes a series of functions in the building equipment display system 1 of the present embodiment on the terminal device 10 and the management server device 20 can be provided not only by communication means, for example, but also stored in various recording media and provided.

[0125] In the building equipment display system 1 of the present embodiment, the layout diagram 71 created by the user is superimposed on the captured image 120 by the layout diagram creation unit 30, but it is not limited to creating the layout diagram 71 by the layout diagram creation unit 30. For example, the terminal device 10 downloads other drawings that can be converted into layout diagrams such as layout diagrams created in advance by the management server device 20 and CAD drawings. The terminal device 10 may superimpose and display the equipment image on the captured image 120 based on the downloaded drawing.

[0126] Also, in the building equipment display system 1 of the present embodiment, the superimposed image 800 displayed on the terminal device 10 is temporarily stored in the working memory and is not configured to be stored in and read from the auxiliary storage means. However, in the building equipment display system 1, the video or still image of the superimposed image 800 may be stored in the auxiliary storage means of the terminal device 10 or the management server device 20.

[0127] <Others> (((1))) A building equipment display system comprising: imaging means for imaging a building; display means for displaying an image on a display screen; reception means for receiving, on the reception image displayed on the display screen, a display of a layout diagram in which equipment images indicating building equipment are arranged on a building image corresponding to the building; and control means for performing control to display, on the display screen, a superimposed image in which the equipment image is superimposed on a captured image of the building captured by the imaging means in response to a user's operation on an instruction image displayed on the display screen on which the layout diagram is displayed. (((2))) The control means is characterized in that, in response to an operation of a user on a second instruction image displayed on the display screen on which the superimposed image is displayed, the reception image is displayed on the display screen, in the building equipment display system according to ((1)). (((3))) The control means is characterized in that, in a state where the display screen is set up, the instruction image and the second instruction image are displayed below the display screen, in the building equipment display system according to ((2)). (((4))) The control means is characterized in that, in response to an operation of a user on a third instruction image displayed on the display screen on which the layout diagram is displayed, estimate information regarding an estimate of construction of building equipment created based on the layout diagram is displayed on the display screen, in the building equipment display system according to ((1)) or ((2)). (((5))) The reception means is characterized in that it receives from a user a setting of an arrangement of equipment images in a direction penetrating a boundary part constituting a boundary in a building, in the building equipment display system according to ((1)). (((6))) It includes an estimate creation means for creating an estimate regarding construction of building equipment based on the layout diagram received by the reception means, and the estimate creation means is characterized in that, when an equipment image in a direction penetrating the boundary part is selected, an estimate amount different from that of an equipment image not penetrating the boundary part is set, in the building equipment display system according to ((5)). (((7))) The control means displays the superimposed image by causing the equipment image to follow the photographed image when the photographed image displayed on the display screen changes as the display screen moves, and the reception means is characterized in that it receives from a user, in the reception image on which the layout diagram is displayed, a setting of a reference for starting the movement of the display screen, in the building equipment display system according to ((1)). (((8))) The control means is characterized in that the superimposed image is displayed based on a plurality of different settings of the reference in the building equipment display system described in ((7)). (((9))) The reception means receives the arrangement of the equipment image from the user in the layout diagram displayed two-dimensionally, and the control means displays the equipment image displayed three-dimensionally on the display screen based on the two-dimensional layout diagram received by the reception means in the building equipment display system described in ((1)). (((10))) The reception means is characterized in that it receives from the user the display of the layout diagram created based on the measurement information obtained from the measurement means that measures the arrangement of the building equipment already installed in the building in the building equipment display system described in ((1)). (((11))) The building equipment display system described in ((1)) is characterized in that detailed information about the building equipment is displayed in response to a user operation on the layout diagram. (((12))) The detailed information is characterized in that it is an equipment photographed image obtained by photographing the building equipment already installed in the building in the building equipment display system described in ((11)). (((13))) A terminal device comprising: a photographing means for photographing a building; a display means for displaying an image on a display screen; a reception means for receiving from the user, in a reception image displayed on the display screen, a display of a layout diagram in which an equipment image indicating building equipment is arranged on a building image corresponding to the building; and a control means for performing control to display, on the display screen, a superimposed image obtained by superimposing the equipment image on a photographed image of the building photographed by the photographing means in response to a user operation on an instruction image displayed on the display screen on which the layout diagram is displayed. (((14))) A program causes a computer functioning as a portable terminal device to realize: a function of photographing a building; a function of displaying an image on a display screen; a function of receiving, with a reception image displayed on the display screen, a layout diagram in which facility images indicating building facilities are arranged on a building image corresponding to the building, from a user; and a function of performing control to display, on the display screen, a superimposed image in which the facility image is superimposed on a photographed image of the building photographed by photographing means, in response to a user operation on an instruction image displayed on the display screen on which the layout diagram is displayed. According to the above (1) to (14), it is possible to easily create a drawing related to the layout of building facilities in a building and compare the created drawing with the actual building.

Explanation of Signs

[0128] 1... Building facility display system, 10... Terminal device, 11D... Display screen, 12... Camera, 30... Layout diagram creation unit, 40... AR display unit, 50... Estimate creation unit, 63... AR display button, 64... Estimate creation button, 69... Aerial view button, 71... Layout diagram, 73... Boundary image, 75... Facility image, 120... Photographed image, 400... Reception screen, 800... Superimposed image, 850... Estimate image

Claims

1. A program for causing a processor to implement a function of managing images of facilities by group, and a function of controlling the display of the images of the facilities by group.

2. The processor further has a function of accepting presence or absence of display by group, and a function of displaying, on a display screen, an image of the facility corresponding to a group selected as a display target. The program according to claim 1.

3. The processor further has a function of displaying an image of the facility in a different color when a plurality of groups are selected as display targets. The program according to claim 2.

4. The processor further has a function of displaying an image of the facility corresponding to a selected group at a corresponding position in a two-dimensional or three-dimensional layout diagram. The program according to claim 2.

5. The processor further has a function of superimposing and displaying an image of the facility corresponding to a selected group at a corresponding position in a photographed image of an actual site. The program according to claim 2.

6. The processor displays construction estimate information regarding an image of the facility on a display screen when a predetermined operation is received. The program according to any one of claims 1 to 5.

7. The processor further has a function of causing the display of the image of the facility to follow a change in a photographed image of an actual site, and a function of accepting a plurality of settings of a reference indicating a boundary portion where the change in the photographed image starts. The program according to any one of claims 1 to 5.

8. The processor further has a function of accepting a setting of an arrangement of an image of the facility penetrating a boundary portion of a site. The program according to any one of claims 1 to 5.

9. The facility includes at least one of an air conditioning facility, a plumbing facility, an electrical facility, a building facility, a facility related to water or other liquids, a facility related to gas or other gases, a facility related to electrical wiring, and a facility related to electrical communication. The program according to any one of claims 1 to 8.

10. The group is managed for each boundary surface partitioning a space. The program according to any one of claims 1 to 9.

11. The group is prepared according to the type of facility. The program according to any one of claims 1 to 10.

12. A method for displaying facility information, wherein a processor manages images of facilities by group, and manages the display of the images of the facilities by group.

13. ​ ​ A functional unit for managing images of facilities by group, A functional unit for controlling the display of images of the facilities by group, An equipment information display system having the above.

14. Having a processor, The processor, Manages images of facilities by group, Controls the display of images of the facilities by group, A terminal device.

Images