Display method, program, and terminal device

Abstract

This provides a display method and other features that can assist users in modifying ceiling plan data. [Solution] The display method performed by the terminal device 50 equipped with a display unit 55 includes a first display step of displaying ceiling plan data, which includes information indicating the positions of multiple devices arranged on the ceiling of the space, on the display unit 55, and a second display step of displaying correction guide information on the display unit 55 to assist the user in correcting the ceiling plan data displayed on the display unit 55 in the first display step.

Description

Technical Field

[0001] The present disclosure relates to a display method, a program, and a terminal device.

Background Art

[0002] Patent Document 1 discloses a system that assists a user in identifying the product number of a lighting fixture based on an image obtained by capturing the lighting fixture.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] During construction work for replacing lighting equipment or air conditioning equipment installed on a ceiling, a constructor performs estimation work. Generally, in such estimation work, the constructor performs work to create a ceiling layout drawing to be presented to the customer, and this work of creating the ceiling layout drawing incurs costs. The ceiling layout drawing is a drawing including information indicating the type of equipment mounted on the ceiling.

[0005] A technique for estimating the type of equipment based on an image of the equipment, as disclosed in Patent Document 1, can support the creation of a ceiling layout drawing.

[0006] For example, it is conceivable to create a ceiling layout drawing using a trained AI (Artificial Intelligence) based on an image obtained by capturing the ceiling. Such a ceiling layout drawing may contain errors.

[0007] The present disclosure aims to provide a display method and the like that can assist a user in modifying ceiling layout drawing data.

Means for Solving the Problem

[0008] One aspect of the display method relating to this disclosure is a display method performed by a terminal device equipped with a display unit, comprising: a first display step of displaying ceiling plan data including information indicating the positions of a plurality of devices arranged on the ceiling of a space on the display unit; and a second display step of displaying correction guide information on the display unit to assist a user in correcting the ceiling plan data displayed on the display unit in the first display step.

[0009] Furthermore, one embodiment of the terminal device relating to this disclosure comprises a display unit, an imaging unit that captures RGB data and depth data targeting the ceiling surface of a space, and an information processing unit that causes the display unit to display ceiling plan data created based on the RGB data and depth data captured by the imaging unit, wherein the information processing unit causes the display unit to display correction guide information to assist the user in correcting the ceiling plan data.

[0010] Furthermore, this disclosure can be implemented not only as the above-described display method, but also as a program that causes a computer to execute the above-described display method. Moreover, it can also be implemented as a computer-readable recording medium storing that program. [Effects of the Invention]

[0011] The display methods and other aspects related to this disclosure can assist users in modifying ceiling plan data. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a block diagram showing the functional configuration of a ceiling plan creation system according to an embodiment. [Figure 2] Figure 2 is a sequence diagram illustrating the operation by which the ceiling plan creation system according to the embodiment creates ceiling plan data. [Figure 3] Figure 3 shows an example of ceiling plan data according to the embodiment. [Figure 4]Figure 4 is a flowchart illustrating the operation by which the terminal device according to the embodiment accepts modifications to the ceiling plan data. [Figure 5] Figure 5 shows an example of the display of modification guide information according to the embodiment. [Figure 6] Figure 6 shows another example of the display of modification guide information according to the embodiment. [Modes for carrying out the invention]

[0013] (Embodiment) The following describes in detail, with reference to the drawings, embodiments of the display method, program, and terminal device relating to this disclosure. The embodiments described below are all preferred examples of this disclosure. The numerical values, components, arrangement and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples and are not intended to limit this disclosure. Furthermore, components in the following embodiments that are not described in an independent claim are described as any component constituting a preferred configuration.

[0014] Please note that each figure is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.

[0015] Furthermore, unless otherwise specified, ordinal numbers such as "first," "second," etc., in this disclosure do not refer to the number or order of components, etc., but are used for the purpose of avoiding confusion and distinguishing similar components, etc.

[0016] [Background leading to this disclosure] When replacing lighting or air conditioning equipment in tenant spaces or offices, an estimate is prepared beforehand. For example, this estimate is required when replacing fluorescent lights with LEDs (Light Emitting Diodes).

[0017] In such estimation work, it is common for site representatives, site supervisors, and the like of electrical contractors who perform construction work handling wiring for lighting and outlets to actually visit the site to conduct on-site surveys.

[0018] In the on-site survey, the site supervisor visually recognizes the type, position, and number of devices arranged on the ceiling, and takes notes by hand. After that, the estimation work is performed by creating a ceiling layout drawing based on these notes, and a construction proposal is made to the customer (for example, a tenant or an office owner). The ceiling layout drawing is a drawing including information indicating the type, position, and number of devices arranged on the ceiling.

[0019] The work of creating this ceiling layout drawing is a high-load work for site supervisors. This is because the number of work sites is large, and the work becomes wasted if the construction order is lost.

[0020] Accordingly, the inventor has conceived a system that supports the work of creating such a ceiling layout drawing.

[0021] [Configuration] First, the configuration of a ceiling layout drawing creation system that executes a device estimation method according to an embodiment will be described. Figure 1 is a block diagram showing the functional configuration of the ceiling layout drawing creation system 10 according to the embodiment.

[0022] The ceiling layout drawing creation system 10 is a system for creating ceiling layout drawing data of an indoor space. The indoor space is, for example, a space such as an office or a tenant. In this specification, the term "space" means an indoor space. The user of the ceiling layout drawing creation system 10 is, for example, a constructor who performs construction work related to devices installed on the ceiling of an office or a tenant.

[0023] The ceiling layout drawing creation system 10 includes a ceiling layout drawing creation device 20 and a terminal device 50. The ceiling layout drawing creation device 20 and the terminal device 50 are communicably connected to each other via a public network 60.

[0024] The user goes to the indoor space where the ceiling plan data is created, carrying the terminal device 50. By operating the terminal device 50, the user can generate the information necessary for creating the ceiling plan data and verify the ceiling plan data generated by the ceiling plan creation device 20.

[0025] The ceiling plan creation device 20 is a device that creates ceiling plan data. The ceiling plan data is a drawing of the ceiling of an interior space. Specifically, the ceiling plan data includes information showing the outline of the ceiling of the interior space. The ceiling plan data also includes information showing the location and type of equipment installed on the ceiling of the interior space. The ceiling plan creation device 20 comprises a drawing creation device 30 and an equipment estimation device 40. The ceiling plan creation device 20 may be implemented by two server devices, one server device that implements the functions of the drawing creation device 30 and the other server device that implements the functions of the equipment estimation device 40, or it may be implemented by one server device that implements the functions of both the drawing creation device 30 and the equipment estimation device 40.

[0026] The drawing creation device 30 is a device that creates ceiling drawing data and ceiling plan data. The drawing creation device 30 is implemented, for example, by a cloud server. The drawing creation device 30 comprises a communication unit 31, an information processing unit 32, and a storage unit 33.

[0027] The communication unit 31 is a communication circuit (communication module) for the drawing creation device 30 to communicate with the equipment estimation device 40 and the terminal device 50 via the public network 60. The communication performed by the communication unit 31 is, for example, wireless communication. The communication unit 31 may communicate wirelessly with the terminal device 50 and with the equipment estimation device 40 via wired communication. The communication standard for the communication performed by the communication unit 31 is not particularly limited.

[0028] The information processing unit 32 performs information processing for the drawing creation device 30 to create ceiling drawing data and ceiling plan data. The information processing unit 32 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 32 are realized by the execution of a computer program (software) stored in the storage unit 33 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 32. Specifically, the information processing unit 32 includes an acquisition unit 321, a creation unit 322, and an output unit 323.

[0029] The acquisition unit 321 acquires RGB data and Depth data of the indoor space from the terminal device 50. The RGB data is an RGB image captured with respect to the ceiling surface of the indoor space. The RGB data shows multiple pieces of equipment installed on the ceiling surface of the indoor space. The Depth data is data that includes distance values ​​to the ceiling surface, walls, and equipment of the indoor space. The Depth data may also be three-dimensional point cloud data showing the outline of the indoor space, generated by converting the distance values ​​to the ceiling surface, walls, and equipment of the indoor space into point cloud data.

[0030] The creation unit 322 creates drawing data of the ceiling of the interior space based on the RGB data and depth data of the interior space acquired by the acquisition unit 321. The ceiling drawing data is data that shows the outer shape of the ceiling of the interior space, and the location and number of equipment installed on the ceiling of the interior space.

[0031] Furthermore, the creation unit 322 creates ceiling plan data based on the ceiling drawing data and the equipment estimation results created by the equipment estimation device 40. The ceiling plan data is data that associates the location and type of equipment installed on the ceiling of the room space. For example, the creation unit 322 associates the location and type of equipment installed on the ceiling of the room space by embedding object data indicating the type of each of the multiple pieces of equipment into the ceiling drawing data.

[0032] The output unit 323 outputs the ceiling plan data created by the creation unit 322.

[0033] The memory unit 33 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 32. The memory unit 33 is implemented, for example, by semiconductor memory. The computer programs stored in the memory unit 33 include a program for creating ceiling drawing data based on RGB data and depth data of the interior space.

[0034] The equipment estimation device 40 is a device that estimates the type of equipment installed on the ceiling. The equipment estimation device 40 is implemented, for example, by a cloud server. The equipment estimation device 40 comprises a communication unit 41, an information processing unit 42, and a storage unit 43. The type of equipment is, for example, if the equipment is lighting equipment, a classification based on the shape of the equipment, such as downlights or base lights. The type of equipment is, for example, if the equipment is air conditioning equipment, exhaust vents and intake vents, etc.

[0035] The communication unit 41 is a communication circuit (communication module) for the equipment estimation device 40 to communicate with the drawing creation device 30 and the terminal device 50 via the public network 60. The communication performed by the communication unit 41 is, for example, wireless communication. The communication unit 41 may communicate wirelessly with the terminal device 50 and with the drawing creation device 30 via wired communication. The communication standard for the communication performed by the communication unit 41 is not particularly limited.

[0036] The information processing unit 42 performs information processing for the equipment estimation device 40 to estimate the type of equipment. The information processing unit 42 is implemented, for example, by a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 42 are realized by the execution of a computer program (software) stored in the storage unit 43 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 42. Specifically, the information processing unit 42 includes an acquisition unit 421, an estimation unit 422, a correction unit 423, an output unit 424, and a learning unit 425.

[0037] The acquisition unit 421 acquires RGB data of the indoor space. For example, the acquisition unit 421 acquires RGB data of the indoor space captured by the terminal device 50.

[0038] The estimation unit 422 estimates the type of equipment included in the RGB data based on the RGB data of the indoor space acquired by the acquisition unit 421. The estimation unit 422 estimates the type of equipment using the trained equipment estimation model 100 stored in the storage unit 43.

[0039] The correction unit 423 corrects the type of device estimated by the estimation unit 422. The correction unit 423 corrects the type of device using the learned device estimation model 100 stored in the storage unit 43. In this embodiment, it is not essential that the device estimation device 40 includes the correction unit 423.

[0040] The output unit 424 outputs at least one of the results of the estimation of the equipment type by the estimation unit 422 and the results of the correction of the equipment type by the correction unit 423.

[0041] The learning unit 425 trains the device estimation model 100.

[0042] The memory unit 43 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 42. The memory unit 43 is implemented, for example, by semiconductor memory. The computer program stored in the memory unit 43 includes a device estimation model 100 for estimating the type of device.

[0043] The device estimation model 100 is a pre-trained AI (Artificial Intelligence) model. The device estimation model 100 is pre-trained by the learning unit 425.

[0044] The method for creating the equipment estimation model 100 is, for example, supervised learning using a training dataset. Specifically, for example, the person setting up the system prepares training data, which is RGB data (image data) captured on the ceiling surface of a room, associating the area in which equipment installed on the ceiling is visible with the type of equipment. The learning unit 425 then uses this training data to machine-learn the equipment estimation model 100. The equipment estimation model 100 is trained to output the area in which equipment is visible and the type of equipment when RGB data captured on the ceiling surface of a room is input. The equipment estimation model 100 trained by the learning unit 425 is stored in the storage unit 43.

[0045] The terminal device 50 is an information terminal used by the user. The user can use the terminal device 50 to check the ceiling plan data of the room space. The terminal device 50 is implemented, for example, by a dedicated terminal of the ceiling plan creation system 10. The terminal device 50 may also be implemented by a general-purpose terminal such as a smartphone or tablet terminal. Specifically, the terminal device 50 comprises a communication unit 51, an information processing unit 52, a storage unit 53, an operation reception unit 54, a display unit 55, and an imaging unit 56.

[0046] The communication unit 51 is a communication circuit (communication module) for the terminal device 50 to communicate with the ceiling plan creation device 20 via a public network 60 such as the Internet. The communication performed by the communication unit 51 is, for example, wireless communication. The communication standard for the communication performed by the communication unit 51 is not particularly limited.

[0047] The information processing unit 52 performs information processing to allow the user to acquire ceiling plan data using the terminal device 50. The information processing unit 52 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 52 are realized by the execution of a computer program (software) stored in the storage unit 53 by the hardware, such as the microcomputer or processor that constitutes the information processing unit 52. Specifically, the information processing unit 52 includes an acquisition unit 521, a control unit 522, a determination unit 523, and an output unit 524.

[0048] The acquisition unit 521 acquires the ceiling plan data created by the ceiling plan creation device 20.

[0049] The control unit 522 displays the ceiling plan data acquired by the acquisition unit 521 on the display unit 55. The control unit 522 also displays correction guide information on the display unit 55 to assist the user in correcting the ceiling plan data.

[0050] The determination unit 523 identifies the parts of the ceiling plan data that require modification of the equipment.

[0051] The output unit 524 outputs the RGB data and depth data captured by the imaging unit 56.

[0052] The memory unit 53 is a storage device that stores computer programs and the like executed by the information processing unit 52. The computer programs stored in the memory unit 53 include a predetermined application program for presenting ceiling plan data to the user. The memory unit 53 is implemented, for example, by semiconductor memory.

[0053] The operation reception unit 54 receives user input. The operation reception unit 54 is implemented, for example, by a touch panel.

[0054] The display unit 55 is a display for presenting images to the user, for example, by presenting the user with an image of the ceiling plan data created by the ceiling plan creation device 20. The image displayed on the display unit 55 includes an image of at least one of the RGB data and depth data being captured by the imaging unit 56, and an image of correction guide information to assist in the capture of the RGB data and depth data. The display unit 55 is implemented by a display panel such as a liquid crystal panel or an organic EL (Electronic Luminescence) panel.

[0055] The imaging unit 56 captures an image of the indoor space. The user uses the imaging unit 56 of the terminal device 50 to perform imaging on the ceiling surface of the indoor space. Specifically, the imaging unit 56 captures RGB data and depth data of the space. The imaging unit 56 is implemented, for example, by a camera capable of capturing visible light images and LiDAR (Light Detection And Ranging).

[0056] [Action to create ceiling diagram data] The operation of the ceiling plan creation device 20 according to the embodiment in which ceiling plan data is created will be described. Figure 2 is a sequence diagram illustrating the operation of the ceiling plan creation system 10 according to the embodiment in which ceiling plan data is created.

[0057] First, the terminal device 50 captures RGB data of the space (S101). Specifically, the user uses the imaging unit 56 of the terminal device 50 to capture RGB data of the ceiling surface of the room.

[0058] Next, the terminal device 50 captures depth data of the space (S102). The user uses the imaging unit 56 of the terminal device 50 to capture depth data targeting the ceiling surface of the room space.

[0059] When spatial RGB data and depth data are captured, the output unit 524 of the terminal device 50 transmits the spatial RGB data and depth data to the drawing creation device 30 via the public network 60 using the communication unit 51 (S103). The spatial RGB data and depth data transmitted by the terminal device 50 are received by the communication unit 31 of the drawing creation device 30.

[0060] The acquisition unit 321 of the drawing creation device 30 acquires spatial RGB data and depth data (S104).

[0061] Once RGB data and depth data are acquired, the creation unit 322 of the drawing creation device 30 creates drawing data for the ceiling (S105). Specifically, the drawing data for the ceiling is drawing data that shows the outer shape of the ceiling of the room space, and the location and number of equipment installed on the ceiling of the room space.

[0062] Furthermore, the output unit 524 of the terminal device 50 transmits spatial RGB data to the device estimation device 40 via the public network 60 using the communication unit 51 (S106). The spatial RGB data transmitted by the terminal device 50 is received by the communication unit 41 of the device estimation device 40.

[0063] The acquisition unit 421 of the equipment estimation device 40 acquires spatial RGB data (S107).

[0064] The information processing unit 42 of the equipment estimation device 40 estimates the type of equipment installed on the ceiling of the room space based on the acquired RGB data of the space (S108). For example, the estimation unit 422 identifies the area of ​​equipment in the RGB data and estimates the type of equipment reflected in the RGB data using the trained equipment estimation model 100. In other words, the estimation unit 422 estimates the type of each of the one or more equipment whose areas have been identified.

[0065] Next, the information processing unit 42 of the equipment estimation device 40 transmits the equipment estimation result to the drawing creation device 30 using the communication unit 41 (S109). The equipment estimation result includes information indicating the type of equipment estimated by the equipment estimation device 40 and information indicating the position of the equipment in RGB data. The equipment estimation result transmitted by the equipment estimation device 40 is received by the drawing creation device 30.

[0066] Upon receiving the equipment estimation results, the creation unit 322 of the drawing creation device 30 creates ceiling plan data (S110). Specifically, the drawing creation device 30 creates ceiling plan data by applying the received equipment estimation results to the ceiling drawing data created in step S105. In other words, the creation unit 322 associates the equipment estimation results with the equipment whose positions are indicated in the ceiling drawing data. The ceiling plan data is data that associates the positions and types of equipment installed on the ceiling of an indoor space. Figure 3 shows an example of ceiling plan data 200 according to an embodiment.

[0067] As shown in Figure 3, the ceiling plan data 200 indicates that the ceiling is a rectangle with dimensions of Xm × Ym. It also indicates that nine pieces of equipment are installed on the ceiling, eight of which are base lights and one of which is an air conditioning unit. In other words, the ceiling plan data 200 shown in Figure 3 indicates the location and type of equipment installed on the ceiling of the interior space.

[0068] Once the ceiling plan data is created, the output unit 323 of the drawing creation device 30 outputs the ceiling plan data (S111). The output unit 323 of the drawing creation device 30 transmits the ceiling plan data to the terminal device 50 using the communication unit 31 (S112). The ceiling plan data transmitted by the drawing creation device 30 is received by the terminal device 50. The acquisition unit 521 of the terminal device 50 acquires the ceiling plan data using the communication unit 51.

[0069] Upon receiving the ceiling plan data, the terminal device 50 presents the ceiling plan data to the user (S113). For example, the control unit 522 presents the ceiling plan data to the user by displaying it on the display unit 55.

[0070] Thus, the ceiling plan creation system 10 according to this embodiment can create and present ceiling plan data of an indoor space based on RGB data and depth data captured of the indoor space by the user.

[0071] This ceiling plan creation system 10 reduces the effort required for users to draft ceiling plans.

[0072] [An action that accepts corrections to the celestial map] As described above, the ceiling plan creation device 20 creates ceiling plan data of the room space based on the RGB data and depth data captured of the room space by the user.

[0073] However, the ceiling plan data created by the ceiling plan creation device 20 may contain errors. For example, if the equipment estimation model 100 misestimates the type of equipment, or if the equipment estimation model 100 is unable to estimate the orientation of the equipment's placement because the parts that need to be identified to determine the direction in which the equipment is installed on the ceiling are too small, the ceiling plan data created by the ceiling plan creation device 20 will contain errors.

[0074] The terminal device 50 according to this embodiment displays correction guide information to assist the user in correcting the ceiling plan data created by the ceiling plan creation device 20. In this way, the terminal device 50 according to this embodiment can assist the user in correcting the ceiling plan data.

[0075] The following describes how such a terminal device 50 accepts modifications to the ceiling plan. Figure 4 is a flowchart illustrating how the terminal device according to this embodiment accepts modifications to the ceiling plan data.

[0076] First, the control unit 522 of the terminal device 50 presents the ceiling plan data to the user by displaying the ceiling plan data on the display unit 55 (S113).

[0077] Next, the determination unit 523 identifies the parts of the ceiling plan data that require modification of the equipment (S201). The ceiling plan data includes information indicating the type of equipment estimated by the equipment estimation device 40. Furthermore, the ceiling plan data includes information indicating the direction in which the equipment is arranged.

[0078] For example, the part of the equipment that requires modification is the part of the equipment that requires modification in terms of type.

[0079] The determination unit 523 determines whether or not the type of equipment needs to be modified based on the regularity of the types of multiple other equipment arranged around the equipment. The determination unit 523 determines that the type of equipment needs to be modified if the equipment and the equipment around it are arranged according to a predetermined pattern and the types of equipment and the equipment around it are different. Here, multiple equipment being arranged according to a predetermined pattern means that the multiple equipment is arranged regularly, for example, that the multiple equipment is of the same type and is arranged at equal intervals.

[0080] The determination unit 523 may determine whether or not the type of equipment needs to be corrected based on its relationship with the estimated types of other equipment arranged around the equipment. The relationship between the type of equipment and the types of other equipment is based on rules governing the relationships between equipment in a building, such as the fact that an "inspection hatch" is provided near an "air conditioner," and that the number of "exhaust vents" and "intake vents" are equal. For example, the determination unit 523 determines that the type of equipment needs to be corrected if, in the ceiling plan data, there is no object data indicating an "inspection hatch" near the object data indicating an "air conditioner." In this case, the determination unit 523 may identify object data among multiple object data arranged near the object data indicating an "air conditioner" that is likely to be confused with the object data indicating an "inspection hatch," and determine that it is object data that requires correction of the type of equipment.

[0081] Furthermore, for example, areas requiring modification of equipment are areas where the orientation of the equipment needs to be corrected.

[0082] The determination unit 523 determines that the orientation of the equipment needs to be corrected if, among the types of equipment shown in the object data included in the ceiling plan data, there is equipment for which the equipment estimation model 100 cannot estimate the orientation of placement. For example, the determination unit 523 can determine whether or not the orientation of the equipment needs to be corrected by referring to the list of equipment for which the equipment estimation model 100 cannot estimate the orientation of placement stored in the memory 53. An example of equipment for which the equipment estimation model 100 cannot estimate the orientation of placement is the equipment "inspection hatch".

[0083] If the determination unit 523 determines that there is equipment that requires correction (Yes in S202), the control unit 522 displays correction guide information on the display unit 55 (S203). By checking the correction guide information, the user can identify equipment that is highly likely to require correction.

[0084] Figure 5 shows an example of the display of modification guide information according to the embodiment. As shown in Figure 5, the terminal device 50 displays ceiling plan data 200 and modification guide information. The modification guide information shown in Figure 5 is information to assist the user in modifying object data. In the ceiling plan data 200 shown in Figure 5, the type of equipment indicated by the object data of a horizontal rectangle with a circle superimposed on it is a base light, and the type of equipment indicated by the object data of a circular shape is a down light.

[0085] In the example shown in Figure 5, the determination unit 523 determines that the object data representing the downlight and the object data representing the multiple base lights arranged around it are in a regular pattern, and therefore the object data representing the downlight is the object data that requires correction. The control unit 522 displays the phrase "Is this a base light?" as correction guide information, associating it with the object data that requires correction. In the example shown in Figure 5, the phrase and the object data are associated with the number "1".

[0086] By reviewing the correction guide information, users can identify object data that is likely to require correction based on the type of equipment.

[0087] Figure 6 shows another example of the display of correction guide information according to the embodiment. As shown in Figure 6, the terminal device 50 displays ceiling plan data 200 and correction guide information. The correction guide information shown in Figure 6 is information to support the user in correcting the information indicating the direction in which each of the multiple pieces of equipment is arranged. Specifically, it is information to support the user in correcting the direction in which the inspection opening shown in the ceiling plan data opens. The determination unit 523 determines that the object data indicating the equipment "inspection opening" is object data that requires correction of the equipment's arrangement direction. The control unit 522 displays the sentence "Is the orientation of the inspection opening correct?" as correction guide information, associating it with the object data that requires correction. In the example shown in Figure 6, the sentence and the object data are associated by the number "1".

[0088] By reviewing the correction guide information, users can identify object data that is likely to require correction of the equipment's orientation.

[0089] Finally, the control unit 522 accepts user modifications via the operation reception unit 54 (S204). For example, the user can modify equipment by tapping the object data of the equipment to be modified in the displayed ceiling plan data 200.

[0090] If the determination unit 523 determines that there is no equipment requiring correction (No in S202), the process proceeds to step S204, and the control unit 522 accepts the user's correction. In other words, even if the correction guide information is not displayed, the user can correct the ceiling plan data 200 if they discover an error in the ceiling plan data 200.

[0091] Such a terminal device 50 can prevent users from overlooking areas in the ceiling plan data that require correction by displaying correction guide information. Furthermore, it can improve the quality of the corrected ceiling plan data regardless of the user's skill level.

[0092] Therefore, such a terminal device 50 can assist the user in modifying ceiling plan data.

[0093] [Effects, etc.] The technologies derived from the disclosures in this specification include, for example, the following. The technologies derived from the disclosures in this specification will be described below, along with the effects obtained by such technologies.

[0094] Technology 1 is a display method performed by a terminal device 50 equipped with a display unit 55, comprising: a first display step of displaying ceiling plan data including information indicating the positions of a plurality of devices arranged on the ceiling of a space on the display unit 55; and a second display step of displaying correction guide information on the display unit 55 to assist the user in correcting the ceiling plan data displayed on the display unit 55 in the first display step.

[0095] This display method can assist users in modifying ceiling plan data. Specifically, by displaying modification guide information, this method can prevent users from overlooking areas in the ceiling plan data that require correction. Furthermore, it can improve the quality of the corrected ceiling plan data regardless of the user's skill level.

[0096] Technology 2 is a display method of Technology 1, wherein the ceiling plan data includes ceiling drawing data and object data indicating the type of each of the multiple devices embedded in the ceiling drawing data, and in the second display step, correction guide information to assist the user in correcting the object data is displayed on the display unit 55.

[0097] This display method can help users correct equipment types when there is a high probability that equipment is incorrectly identified in the ceiling plan data.

[0098] Technology 3 is a display method of Technology 1 or 2, wherein the ceiling plan data includes information indicating the direction in which each of the multiple devices is positioned, and in the second display step, correction guide information is displayed on the display unit 55 to assist the user in correcting the information indicating the direction in which each of the multiple devices is positioned.

[0099] This display method can help users correct the placement orientation of equipment when there is a high probability that some equipment is shown in the ceiling plan data with an incorrect orientation.

[0100] Technology 4 is a display method of Technology 3, wherein multiple devices include inspection hatches, and in the second display step, correction guide information is displayed on the display unit 55 to assist the user in correcting the direction in which the inspection hatches shown in the ceiling plan data open.

[0101] This display method can help users correct the orientation of inspection hatches when the ceiling plan data includes equipment that is highly likely to be shown in the wrong orientation.

[0102] Technology 5 is a program that causes the terminal device 50 to execute one of the display methods from Technology 1 to 4.

[0103] Such programs can help users modify ceiling plan data.

[0104] Technology 6 is a terminal device 50 comprising a display unit 55, an imaging unit 56 that captures RGB data and depth data targeting the ceiling surface of the space, and an information processing unit 52 that displays ceiling plan data created based on the RGB data and depth data captured by the imaging unit 56 on the display unit 55, the information processing unit 52 displaying correction guide information on the display unit 55 to assist the user in correcting the ceiling plan data.

[0105] Such a terminal device 50 can prevent users from overlooking areas in the ceiling plan data that require correction by displaying correction guide information. Furthermore, it can improve the quality of the corrected ceiling plan data regardless of the user's skill level. Therefore, such a terminal device 50 can assist users in correcting ceiling plan data.

[0106] (Other embodiments) Although embodiments have been described above, the present invention is not limited to the embodiments described above.

[0107] For example, in the above embodiment, the system, such as the ceiling plan creation system, was implemented by multiple devices, but it may also be implemented as a single device. Thus, the system in this specification may consist of a single device or it may consist of multiple devices. When the system is implemented by multiple devices, the components of the system may be distributed among the multiple devices in any way.

[0108] Furthermore, in the above embodiment, the processing performed by a specific processing unit may be performed by another processing unit. Also, the order of multiple processing units may be changed, or multiple processing units may be executed in parallel.

[0109] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0110] Furthermore, each component may be implemented by hardware. Each component may also be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0111] Furthermore, general or specific embodiments of the present invention may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. Alternatively, they may be implemented as any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

[0112] For example, the present invention may be implemented as a terminal device as described in the above embodiment. Alternatively, the present invention may be implemented as a display method executed by a terminal device. The present invention may also be implemented as a program for causing a computer to execute a display method, or as a computer-readable non-temporary recording medium on which such a program is stored.

[0113] Furthermore, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. [Explanation of Symbols]

[0114] 20 Ceiling Plan Creation Device 50 Terminal devices 52 Information Processing Section 55 Display section 56 Imaging Unit 100-device estimation model 200 Ceiling Plan Data

Claims

1. A display method performed by a terminal device equipped with a display unit, A first display step involves displaying ceiling plan data, which includes information indicating the positions of multiple devices arranged on the ceiling of the space, on the display unit. The first display step includes a second display step in which correction guide information is displayed on the display unit to assist the user in correcting the ceiling plan data displayed on the display unit, Display method.

2. The ceiling plan data includes ceiling drawing data and object data indicating the type of each of the multiple pieces of equipment embedded in the ceiling drawing data. In the second display step, the modification guide information for assisting the user in modifying the object data is displayed on the display unit. The display method according to claim 1.

3. The ceiling diagram data includes information indicating the orientation in which each of the multiple devices is positioned. In the second display step, the correction guide information for assisting the user in correcting information indicating the orientation in which each of the plurality of devices is arranged is displayed on the display unit. The display method according to claim 1.

4. The aforementioned multiple devices include inspection ports, In the second display step, the correction guide information for assisting the user in correcting the direction in which the inspection opening shown in the ceiling plan data opens is displayed on the display unit. The display method according to claim 3.

5. A program for causing the terminal device to execute the display method described in any one of claims 1 to 4.

6. Display unit and An imaging unit that captures RGB data and depth data targeting the ceiling surface of the space, The system includes an information processing unit that causes the display unit to display ceiling map data created based on the RGB data and depth data captured by the imaging unit. The information processing unit displays correction guide information on the display unit to assist the user in correcting the ceiling plan data. Terminal device.

Images