Equipment estimation method, ceiling plan data creation method, program, equipment estimation device, and ceiling plan creation device.

Abstract

This invention provides a device estimation method that can estimate the type of equipment installed on the ceiling with greater accuracy. [Solution] A device estimation method for estimating the types of multiple devices arranged on the ceiling of a space executed by a computer, comprising: an acquisition step of acquiring RGB data of the space; an estimation step of estimating the types of multiple devices included in the RGB data based on the RGB data acquired in the acquisition step; and a correction step of correcting the type of a first device among the multiple devices estimated in the estimation step based on the relationship with the estimation results of the types of other devices arranged around the first device.

Description

Technical Field

[0001] The present disclosure relates to an equipment estimation method, a ceiling layout diagram data creation method, a program, an equipment estimation device, and a ceiling layout diagram creation device.

Background Art

[0002] Patent Document 1 discloses a system that assists a user in identifying the part number of a lighting fixture based on an image obtained by imaging the lighting fixture.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the work of replacing lighting equipment or air conditioning equipment installed on a ceiling, a constructor performs estimation work. Generally, in the estimation work, the constructor performs the work of creating a ceiling layout diagram to be presented to the customer, and this work of creating the ceiling layout diagram incurs costs. The ceiling layout diagram includes information indicating the type of equipment installed on the ceiling.

[0005] An object of the present disclosure is to provide an equipment estimation method and the like that can estimate the type of equipment installed on a ceiling with higher accuracy.

Means for Solving the Problems

[0006] One embodiment of the equipment estimation method relating to this disclosure is an equipment estimation method for estimating the types of a plurality of devices arranged on the ceiling of a space in which a computer is executed, comprising: an acquisition step of acquiring RGB data of the space; an estimation step of estimating the types of a plurality of devices included in the RGB data based on the RGB data acquired in the acquisition step; and a correction step of correcting the type of a first device among the plurality of devices estimated in the estimation step based on the relationship with the estimated results of the types of other devices arranged around the first device.

[0007] Furthermore, one embodiment of the ceiling plan data creation method relating to this disclosure is a ceiling plan data creation method that creates ceiling plan data including information indicating the types of a plurality of devices arranged on the ceiling of a space executed by a computer, and includes: an acquisition step of acquiring RGB data and depth data of the space; a drawing creation step of creating drawing data of the ceiling of the space based on the RGB data and depth data acquired in the acquisition step; an estimation step of performing estimation of the types of a plurality of devices included in the RGB data based on the RGB data acquired in the acquisition step and generating a device estimation result as a result of the estimation; a correction step of correcting the device estimation result by correcting the type of a first device among the plurality of device types estimated in the estimation step based on the relationship with the estimation results of the types of other devices arranged around the first device; and a ceiling plan creation step of creating ceiling plan data by associating the device estimation result corrected in the correction step with the drawing data created in the drawing creation step.

[0008] Furthermore, one embodiment of the equipment estimation device according to the present disclosure is an equipment estimation device for estimating the types of multiple devices arranged on the ceiling of a space, comprising: an acquisition unit for acquiring RGB data of the space; an estimation unit for estimating the types of multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit; and a correction unit for correcting the type of a first device among the multiple devices estimated by the estimation unit based on the relationship with the estimated results of the types of other devices arranged around the first device.

[0009] Furthermore, one embodiment of the ceiling plan creation device according to the present disclosure is a ceiling plan creation device that creates ceiling plan data including information indicating the types of a plurality of devices arranged on the ceiling of a space, comprising: an acquisition unit that acquires RGB data and depth data of the space; a drawing creation unit that creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit; an estimation unit that performs estimation of the types of a plurality of devices included in the RGB data based on the RGB data acquired by the acquisition unit and generates an equipment estimation result as a result of the estimation; a correction unit that corrects the equipment estimation result by correcting the type of a first device among the plurality of device types estimated by the estimation unit based on the relationship with the estimation results of the types of other devices arranged around the first device; and a ceiling plan creation unit that creates ceiling plan data by associating the equipment estimation result corrected by the correction unit with the drawing data created by the drawing creation unit.

[0010] Furthermore, this disclosure can be implemented not only as the above-mentioned equipment estimation method or ceiling plan data creation method, but also as a program that causes a computer to execute the above-mentioned equipment estimation method or ceiling plan data creation method. Moreover, it can also be implemented as a computer-readable recording medium that stores the program. [Effects of the Invention]

[0011] The equipment estimation method described herein can estimate the type of equipment installed on the ceiling with greater accuracy. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a block diagram showing the functional configuration of a ceiling plan creation system according to an embodiment. [Figure 2] Figure 2 is a sequence diagram illustrating the operation by which the ceiling plan creation system according to the embodiment creates ceiling plan data. [Figure 3] Figure 3 shows an example of ceiling plan data according to the embodiment. [Figure 4] Figure 4 is a flowchart illustrating the operation of the equipment estimation device according to the embodiment. [Figure 5] Figure 5 shows an example of the first estimation result according to the embodiment. [Figure 6] Figure 6 shows an example of the second estimation result according to the embodiment. [Modes for carrying out the invention]

[0013] (Embodiment) The following describes in detail, with reference to drawings, embodiments of the equipment estimation method, ceiling plan data creation method, and program related to this disclosure. The embodiments described below are all preferred examples of this disclosure. The numerical values, components, arrangement and connection configurations of components, steps, and step order shown in the following embodiments are examples and are not intended to limit this disclosure. Furthermore, components in the following embodiments that are not described in an independent claim are described as any component constituting a preferred configuration.

[0014] Please note that each figure is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.

[0015] Further, ordinal numbers such as "first" and "second" in the present disclosure do not imply the number or order of components or the like unless otherwise specifically noted, and are used for the purpose of avoiding confusion and distinguishing components of the same type.

[0016] [Background Leading to the Conception of the Present Disclosure] When carrying out work to replace lighting equipment and air conditioning equipment in tenants, offices, or the like, estimation work is performed in advance. For example, estimation work when performing a construction work to change fluorescent lamps to LEDs (Light Emitting Diodes) can be considered.

[0017] In such estimation work, it is usual for on-site representatives, site supervisors, and the like of electrical contractors who perform construction work handling wiring for lighting and outlets to actually visit the site to conduct on-site surveys.

[0018] In the on-site survey, the site supervisor visually confirms the type, position, and number of devices arranged on the ceiling, and takes handwritten notes. Thereafter, the estimation work is performed by creating a ceiling layout drawing based on these notes, and a construction proposal is made to the customer (for example, the owner of a tenant or office). The ceiling layout drawing is a drawing that includes information indicating the type, position, and number of devices arranged on the ceiling.

[0019] The work of creating this ceiling layout drawing is a high-load task for site supervisors. This is because the number of work sites is large, and the work becomes wasted if the construction order is lost.

[0020] Accordingly, the inventor has conceived a system that supports the work of creating such a ceiling layout drawing.

[0021] [Configuration] First, the configuration of a ceiling layout drawing creation system that executes a device estimation method according to an embodiment will be described. Figure 1 is a block diagram showing a functional configuration of the ceiling layout drawing creation system 10 according to the embodiment.

[0022] The ceiling plan creation system 10 is a system for creating ceiling plan data for an indoor space. An indoor space is, for example, an office or a tenant space. In this specification, "space" means an indoor space. A user of the ceiling plan creation system 10 is, for example, a contractor who performs work related to equipment installed on the ceiling of an office or tenant space.

[0023] The ceiling plan creation system 10 comprises a ceiling plan creation device 20 and a terminal device 50. The ceiling plan creation device 20 and the terminal device 50 are connected to each other so as to be able to communicate via a public network 60.

[0024] The user goes to the indoor space where the ceiling plan data is created, carrying the terminal device 50. By operating the terminal device 50, the user can generate the information necessary for creating the ceiling plan data and verify the ceiling plan data generated by the ceiling plan creation device 20.

[0025] The ceiling plan creation device 20 is a device that creates ceiling plan data. The ceiling plan data is a drawing of the ceiling of an interior space. Specifically, the ceiling plan data includes information showing the outline of the ceiling of the interior space. The ceiling plan data also includes information showing the location and type of equipment installed on the ceiling of the interior space. The ceiling plan creation device 20 comprises a drawing creation device 30 and an equipment estimation device 40. The ceiling plan creation device 20 may be implemented by two server devices, one server device that implements the functions of the drawing creation device 30 and the other server device that implements the functions of the equipment estimation device 40, or it may be implemented by one server device that implements the functions of both the drawing creation device 30 and the equipment estimation device 40.

[0026] The drawing creation device 30 is a device that creates ceiling drawing data and ceiling plan data. The drawing creation device 30 is implemented, for example, by a cloud server. The drawing creation device 30 comprises a communication unit 31, an information processing unit 32, and a storage unit 33.

[0027] The communication unit 31 is a communication circuit (communication module) for the drawing creation device 30 to communicate with the equipment estimation device 40 and the terminal device 50 via the public network 60. The communication performed by the communication unit 31 is, for example, wireless communication. The communication unit 31 may communicate wirelessly with the terminal device 50 and with the equipment estimation device 40 via wired communication. The communication standard for the communication performed by the communication unit 31 is not particularly limited.

[0028] The information processing unit 32 performs information processing for the drawing creation device 30 to create ceiling drawing data and ceiling plan data. The information processing unit 32 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 32 are realized by the execution of a computer program (software) stored in the storage unit 33 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 32. Specifically, the information processing unit 32 includes an acquisition unit 321, a creation unit 322, and an output unit 323.

[0029] The acquisition unit 321 acquires RGB data and Depth data of the indoor space from the terminal device 50. The RGB data is an RGB image captured with respect to the ceiling surface of the indoor space. The RGB data shows multiple pieces of equipment installed on the ceiling surface of the indoor space. The Depth data is data that includes distance values ​​to the ceiling surface, walls, and equipment of the indoor space. The Depth data may also be three-dimensional point cloud data showing the outline of the indoor space, generated by converting the distance values ​​to the ceiling surface, walls, and equipment of the indoor space into point cloud data.

[0030] The creation unit 322 creates drawing data of the ceiling of the interior space based on the RGB data and depth data of the interior space acquired by the acquisition unit 321. The ceiling drawing data is data that shows the outer shape of the ceiling of the interior space, and the location and number of equipment installed on the ceiling of the interior space.

[0031] Furthermore, the creation unit 322 creates ceiling plan data based on the ceiling drawing data and the equipment estimation results created by the equipment estimation device 40. The ceiling plan data is data that associates the location and type of equipment installed on the ceiling of the room space.

[0032] The output unit 323 outputs the ceiling plan data created by the creation unit 322.

[0033] The memory unit 33 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 32. The memory unit 33 is implemented, for example, by semiconductor memory. The computer programs stored in the memory unit 33 include a program for creating ceiling drawing data based on RGB data and depth data of the interior space.

[0034] The equipment estimation device 40 is a device that estimates the type of equipment installed on the ceiling. The equipment estimation device 40 is implemented, for example, by a cloud server. The equipment estimation device 40 comprises a communication unit 41, an information processing unit 42, and a storage unit 43. The type of equipment is, for example, if the equipment is lighting equipment, a classification based on the shape of the equipment, such as downlights or base lights. The type of equipment is, for example, if the equipment is air conditioning equipment, exhaust vents and intake vents, etc.

[0035] The communication unit 41 is a communication circuit (communication module) for the equipment estimation device 40 to communicate with the drawing creation device 30 and the terminal device 50 via the public network 60. The communication performed by the communication unit 41 is, for example, wireless communication. The communication unit 41 may communicate wirelessly with the terminal device 50 and with the drawing creation device 30 via wired communication. The communication standard for the communication performed by the communication unit 41 is not particularly limited.

[0036] The information processing unit 42 performs information processing for the equipment estimation device 40 to estimate the type of equipment. The information processing unit 42 is implemented, for example, by a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 42 are realized by the execution of a computer program (software) stored in the storage unit 43 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 42. Specifically, the information processing unit 42 includes an acquisition unit 421, an estimation unit 422, a correction unit 423, an output unit 424, and a learning unit 425.

[0037] The acquisition unit 421 acquires RGB data of the indoor space. For example, the acquisition unit 421 acquires RGB data of the indoor space captured by the terminal device 50.

[0038] The estimation unit 422 estimates the type of equipment included in the RGB data based on the RGB data of the indoor space acquired by the acquisition unit 421. The estimation unit 422 estimates the type of equipment using the trained equipment estimation model 100 stored in the storage unit 43.

[0039] The correction unit 423 corrects the type of equipment estimated by the estimation unit 422. The correction unit 423 corrects the type of equipment using the learned equipment estimation model 100 stored in the memory unit 43. Specifically, the correction unit 423 corrects the equipment estimation result by correcting the type of the first equipment among the multiple types of equipment estimated by the estimation unit 422 based on the relationship with the estimated results of the types of other equipment arranged around the first equipment. The relationship between the type of the first equipment and the types of other equipment is based on rules of relationships between equipment in a building, such as the fact that an equipment "inspection port" is provided near an equipment "air conditioner", and the number of equipment "exhaust ports" is equal to the number of equipment "intake ports". In other words, the rules of relationships between equipment are the expected relationships between equipment. Relationships are, for example, positional relationships.

[0040] The output unit 424 outputs at least one of the results of the estimation of the equipment type by the estimation unit 422 and the results of the correction of the equipment type by the correction unit 423.

[0041] The learning unit 425 trains the device estimation model 100.

[0042] The memory unit 43 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 42. The memory unit 43 is implemented, for example, by semiconductor memory. The computer program stored in the memory unit 43 includes a device estimation model 100 for estimating the type of device.

[0043] The device estimation model 100 is a pre-trained AI (Artificial Intelligence) model. The device estimation model 100 is pre-trained by the learning unit 425.

[0044] The method for creating the equipment estimation model 100 is, for example, supervised learning using a training dataset. Specifically, for example, the person setting up the system prepares training data, which is RGB data (image data) captured on the ceiling surface of an indoor space, associating the area where equipment installed on the ceiling is visible with the type of equipment. The learning unit 425 then uses this training data to machine-learn the equipment estimation model 100. The equipment estimation model 100 is trained to output the area where equipment is visible and the type of equipment when RGB data captured on the ceiling surface of an indoor space is input. Furthermore, the equipment estimation model 100 learns the rules governing the relationships between equipment in a building. In other words, the equipment estimation model 100 learns the expected relationships between multiple pieces of equipment in a building. For example, the learning unit 425 trains the equipment estimation model 100 to calculate the probability for each of the pre-prepared equipment types for one of the multiple pieces of equipment based on the estimation results of the types of multiple pieces of equipment that have been input. The device estimation model 100 learned by the learning unit 425 is stored in the memory unit 43.

[0045] The terminal device 50 is an information terminal used by the user. The user can use the terminal device 50 to check the ceiling plan data of the room space. The terminal device 50 is implemented, for example, by a dedicated terminal of the ceiling plan creation system 10. The terminal device 50 may also be implemented by a general-purpose terminal such as a smartphone or tablet terminal. Specifically, the terminal device 50 comprises a communication unit 51, an information processing unit 52, a storage unit 53, an operation reception unit 54, a display unit 55, and an imaging unit 56.

[0046] The communication unit 51 is a communication circuit (communication module) for the terminal device 50 to communicate with the drawing creation device 30 and the equipment estimation device 40 via a public network 60 such as the Internet. The communication performed by the communication unit 51 is, for example, wireless communication. The communication standard for the communication performed by the communication unit 51 is not particularly limited.

[0047] The information processing unit 52 performs information processing to allow the user to acquire ceiling plan data using the terminal device 50. The information processing unit 52 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 52 are realized by the execution of a computer program (software) stored in the storage unit 53 by the hardware, such as the microcomputer or processor that constitutes the information processing unit 52.

[0048] The memory unit 53 is a storage device that stores computer programs and the like executed by the information processing unit 52. The computer programs stored in the memory unit 53 include a predetermined application program for presenting ceiling plan data to the user. The memory unit 53 is implemented, for example, by semiconductor memory.

[0049] The operation reception unit 54 receives user input. The operation reception unit 54 is implemented, for example, by a touch panel.

[0050] The display unit 55 is a display for presenting images to the user, for example, by presenting the user with an image of the ceiling plan data created by the ceiling plan creation device 20. The display unit 55 is implemented by a display panel such as a liquid crystal panel or an organic EL (Electronic Luminescence) panel.

[0051] The imaging unit 56 captures an image of the indoor space. The user uses the imaging unit 56 of the terminal device 50 to perform imaging on the ceiling surface of the indoor space. Specifically, the imaging unit 56 captures RGB data and depth data of the space. The imaging unit 56 is implemented, for example, by a camera capable of capturing visible light images and LiDAR (Light Detection And Ranging).

[0052] [Action to create ceiling diagram data] The operation of the ceiling plan creation device 20 according to the embodiment in which ceiling plan data is created will be described. Figure 2 is a sequence diagram illustrating the operation of the ceiling plan creation system 10 according to the embodiment in which ceiling plan data is created.

[0053] First, the terminal device 50 captures RGB data of the space (S101). Specifically, the user uses the imaging unit 56 of the terminal device 50 to capture RGB data of the ceiling surface of the room.

[0054] Next, the terminal device 50 captures depth data of the space (S102). The user uses the imaging unit 56 of the terminal device 50 to capture depth data targeting the ceiling surface of the room space.

[0055] When spatial RGB data and depth data are captured, the information processing unit 52 of the terminal device 50 transmits the spatial RGB data and depth data to the drawing creation device 30 via the public network 60 using the communication unit 51 (S103). The spatial RGB data and depth data transmitted by the terminal device 50 are received by the communication unit 31 of the drawing creation device 30.

[0056] The acquisition unit 321 of the drawing creation device 30 acquires spatial RGB data and depth data (S104).

[0057] Once RGB data and depth data are acquired, the creation unit 322 of the drawing creation device 30 creates drawing data for the ceiling (S105). Specifically, the drawing data for the ceiling is drawing data that shows the outer shape of the ceiling of the room space, and the location and number of equipment installed on the ceiling of the room space.

[0058] Furthermore, the information processing unit 52 of the terminal device 50 transmits spatial RGB data to the device estimation device 40 via the public network 60 using the communication unit 51 (S106). The spatial RGB data transmitted by the terminal device 50 is received by the communication unit 41 of the device estimation device 40.

[0059] The acquisition unit 421 of the equipment estimation device 40 acquires spatial RGB data (S107).

[0060] The information processing unit 42 of the equipment estimation device 40 estimates the type of equipment installed on the ceiling of the room based on the acquired RGB data of the space (S108). The processing in step S108 will be described in detail later.

[0061] Next, the information processing unit 42 of the equipment estimation device 40 transmits the equipment estimation result to the drawing creation device 30 using the communication unit 41 (S109). The equipment estimation result includes information indicating the type of equipment estimated by the equipment estimation device 40 and information indicating the position of the equipment in RGB data. The equipment estimation result transmitted by the equipment estimation device 40 is received by the drawing creation device 30.

[0062] Upon receiving the equipment estimation results, the creation unit 322 of the drawing creation device 30 creates ceiling plan data (S110). Specifically, the drawing creation device 30 creates ceiling plan data by applying the received equipment estimation results to the ceiling drawing data created in step S105. In other words, the creation unit 322 associates the equipment estimation results with the equipment whose positions are indicated in the ceiling drawing data. The ceiling plan data is data that associates the positions and types of equipment installed on the ceiling of an indoor space. Figure 3 shows an example of ceiling plan data 200 according to an embodiment.

[0063] As shown in Figure 3, the ceiling plan data 200 indicates that the ceiling is a rectangle with dimensions of Xm × Ym. It also indicates that nine pieces of equipment are installed on the ceiling, eight of which are base lights and one of which is an air conditioning unit. In other words, the ceiling plan data 200 shown in Figure 3 indicates the location and type of equipment installed on the ceiling of the interior space.

[0064] Once the ceiling plan data is created, the output unit 323 of the drawing creation device 30 outputs the ceiling plan data (S111). The output unit 323 of the drawing creation device 30 transmits the ceiling plan data to the terminal device 50 using the communication unit 31 (S112). The ceiling plan data transmitted by the drawing creation device 30 is received by the terminal device 50.

[0065] Upon receiving the ceiling plan data, the terminal device 50 presents the ceiling plan data to the user (S113). For example, the information processing unit 52 presents the ceiling plan data to the user by displaying it on the display unit 55.

[0066] Thus, the ceiling plan creation system 10 according to this embodiment can create and present ceiling plan data of an indoor space based on RGB data and depth data captured of the indoor space by the user.

[0067] This ceiling plan creation system 10 reduces the effort required for users to draft ceiling plans.

[0068] [Action to estimate the device] Next, we will explain in detail the operation of the equipment estimation device 40 in estimating the type of equipment. In other words, we will explain the process of step S107 in Figure 2. Figure 4 is a flowchart illustrating the operation of the equipment estimation device 40 according to the embodiment.

[0069] Prior to this, the acquisition unit 421 acquires the RGB data of the space (S106).

[0070] First, the estimation unit 422 identifies the area of ​​the equipment in the RGB data (S201). The RGB data is image data captured targeting the ceiling surface of the room. The RGB data shows equipment installed on the ceiling of the room. For example, the estimation unit 422 identifies the area in the RGB data where the equipment is visible as coordinates in the RGB data. At the same time, the estimation unit 422 also identifies the area in the RGB data where the ceiling surface of the room is visible as coordinates in the RGB data.

[0071] Next, the estimation unit 422 estimates the type of equipment (S202). The estimation unit 422 uses the trained equipment estimation model 100 to estimate the type of equipment that appears in the RGB data. The estimation unit 422 estimates the type of each of the multiple equipment whose regions have been identified.

[0072] Once the type of device is estimated, the estimation unit 422 generates a first estimation result (S203). The first estimation result is, for example, information that associates the types of multiple devices with regions in RGB data.

[0073] Figure 5 shows an example of the first estimation result in the embodiment. Figure 5 shows the estimation results of the types of multiple devices (devices 71, 72) installed on the ceiling. In Figure 5, device 71, which is represented by a rectangle with "RC" written inside and "I" in the lower right corner, is estimated to be an "air conditioner". Device 72, which is represented by a rectangle with two adjacent circles written inside, is estimated to be a "ventilation fan". The lines colored with diagonal lines indicate the outer shape of the ceiling surface.

[0074] As shown in Figure 5, for example, the equipment estimation model 100 calculates "air conditioner 0.9" as the estimated score for the type of equipment 71, and the estimation unit 422 estimates the type of equipment 71 to be "air conditioner". Also, for example, the equipment estimation model 100 calculates "ventilation fan 0.6, inspection port 0.5" as the estimated score for the type of equipment 72, and the estimation unit 422 estimates the type of equipment 72 to be "ventilation fan", which has the highest estimated score.

[0075] Next, the correction unit 423 uses the trained device estimation model 100 to determine whether there is a problem in the relationship between the estimated type of the first device and the estimated type of the surrounding devices in the first estimation result (S204). The first device is one of several devices whose types have been identified. Surrounding devices are devices whose regions are located near the region of the first device in the RGB data.

[0076] For example, if the device 72 shown in Figure 5 is the first device, the correction unit 423 determines whether there is a problem with the relationship between the estimated type of device 72 and the estimated type of device 71.

[0077] If a problem is determined (Yes in S205), the correction unit 423 corrects the estimated result of the type of the first equipment (S206). Specifically, the correction unit 423 corrects the type of the first equipment so that the relationship between the type of the first equipment and the types of other equipment becomes a normal relationship. A normal relationship means, for example, that the positional relationship between the equipment is as it should be. For example, as shown in Figure 5, if the estimated result of the type of equipment 71 is an air conditioner and the estimated result of the type of equipment 72 is a ventilation fan, the correction unit 423 determines that there is a problem with the estimated result of the type of equipment 72. The equipment estimation model 100 has learned the rule that there should be one inspection opening near one "air conditioner", so the correction unit 423 can determine that there is a problem with the estimated result of the type of equipment 72.

[0078] If it is determined that there are no problems (No in S205), the process proceeds to step S207.

[0079] Next, the correction unit 423 determines whether or not the determination has been performed for all devices (S207). The correction unit 423 determines whether or not the processes in steps S204 to S206 have been performed for all devices whose type was estimated in the process of step S202.

[0080] If it is determined that a determination has not yet been made for all devices (No in S207), the process returns to step S204, and the estimation unit 422 performs a determination on the device for which a determination has not yet been made, designating it as the first device.

[0081] If it is determined that a determination has been made for all devices (Yes in S207), the correction unit 423 generates a second estimation result (S208). The second estimation result is, for example, information that associates the types of multiple devices with the regions in the RGB data, and is information on which the correction has been made to the first estimation result.

[0082] Figure 6 shows an example of a second estimation result according to the embodiment. In Figure 6, the equipment (equipment 82) shown as a rectangle with a dashed triangle inside indicates that it was estimated to be of the type "inspection opening". In the second estimation result shown in Figure 6, the estimated type of equipment 72 (82) has been corrected from a ventilation fan to an inspection opening compared to the first estimation result shown in Figure 5.

[0083] Once the second estimation result is generated, the process proceeds to step S108, and the output unit 424 transmits the second estimation result as the equipment estimation result to the drawing creation device 30.

[0084] Through this operation, the equipment estimation device 40 can correct an error in the estimation of the equipment type by referring to the expected relationship with the estimation results of the types of other equipment installed around the equipment.

[0085] Therefore, the equipment estimation device 40 can estimate the type of equipment installed on the ceiling with higher accuracy.

[0086] [Effects, etc.] The technologies derived from the disclosures in this specification include, for example, the following. The technologies derived from the disclosures in this specification will be described below, along with the effects obtained by such technologies.

[0087] Technology 1 is a device estimation method for estimating the types of multiple devices arranged on the ceiling of a space in which a computer is executed, and the method includes an acquisition step of acquiring RGB data of the space, an estimation step of estimating the types of multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, and a correction step of correcting the type of a first device among the multiple devices estimated in the estimation step based on the relationship with the estimation results of the types of other devices arranged around the first device.

[0088] This type of equipment estimation method can correct the estimation result if it is incorrect, based on the expected relationship between the equipment and the types of other equipment installed around it. Therefore, this type of equipment estimation method can estimate the type of equipment installed on the ceiling with higher accuracy.

[0089] Technique 2 is the device estimation method of Technique 1, wherein the estimation step and correction step are performed using a trained AI model. The device estimation model 100 in the above embodiment is an example of a trained AI model.

[0090] This type of equipment estimation method uses a trained AI model to estimate the type of equipment installed on the ceiling. This method allows for a simpler estimation of the type of equipment installed on the ceiling.

[0091] Technology 3 is a device estimation method of Technology 1 or 2, in which, in the correction step, the type of the first device is corrected so that the relationship between the estimated type of the first device and the estimated types of other devices becomes a normal relationship.

[0092] This equipment estimation method allows for correction of incorrect estimations of equipment types based on the expected relationship between the equipment and other equipment installed around it. This method also allows for more accurate estimation of the type of equipment installed on the ceiling.

[0093] Technology 4 is a method for creating ceiling plan data that includes information indicating the types of multiple pieces of equipment arranged on the ceiling of a space executed by a computer, and includes an acquisition step of acquiring RGB data and depth data of the space; a drawing creation step of creating drawing data of the ceiling of the space based on the RGB data and depth data acquired in the acquisition step; an estimation step of performing estimation of the types of multiple pieces of equipment included in the RGB data based on the RGB data acquired in the acquisition step and generating equipment estimation results as a result of the estimation; a correction step of correcting the equipment estimation results by correcting the type of a first piece of equipment among the multiple types of equipment estimated in the estimation step based on the relationship with the estimation results of the types of other equipment arranged around the first piece of equipment; and a ceiling plan creation step of creating ceiling plan data by associating the equipment estimation results corrected in the correction step with the drawing data created in the drawing creation step. The first estimation result in the above embodiment is the equipment estimation result generated in the estimation step, and the second estimation result in the above embodiment is the equipment estimation result corrected in the correction step.

[0094] This method of creating ceiling plan data allows users to view the created ceiling plan data of an indoor space by capturing RGB and depth data of that space. This method of creating ceiling plan data reduces the effort required for users to draft ceiling plans.

[0095] Technique 5 is a program that causes a computer to execute one of the device estimation methods from Techniques 1 to 3.

[0096] Such programs can help estimate the type of equipment installed on the ceiling with greater accuracy.

[0097] Technique 6 is a program that causes a computer to execute the ceiling plan data creation method of Technique 4.

[0098] Such programs can help reduce the effort required for users to create ceiling plans.

[0099] Technology 7 is an equipment estimation device 40 for estimating the types of multiple devices arranged on the ceiling of a space, comprising: an acquisition unit 421 for acquiring RGB data of the space; an estimation unit 422 for estimating the types of multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit 421; and a correction unit 423 for correcting the type of a first device among the multiple devices estimated by the estimation unit 422 based on the relationship with the estimated results of the types of other devices arranged around the first device.

[0100] Such an equipment estimation device 40 can correct the estimation result of the equipment type if it is incorrect, based on the expected relationship with the types of other equipment installed around the equipment. Therefore, such an equipment estimation device 40 can estimate the type of equipment installed on the ceiling with higher accuracy.

[0101] Technology 8 is a ceiling plan creation device 20 that creates ceiling plan data including information indicating the types of multiple pieces of equipment arranged on the ceiling of a space, comprising: an acquisition unit that acquires RGB data and depth data of the space; a drawing creation unit that creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit; an estimation unit 422 that performs estimation of the types of multiple pieces of equipment included in the RGB data based on the RGB data acquired by the acquisition unit and generates equipment estimation results as a result of the estimation; a correction unit 423 that corrects the equipment estimation results by correcting the type of a first piece of equipment among the multiple pieces of equipment estimated by the estimation unit 422 based on the relationship with the estimation results of other pieces of equipment arranged around the first piece of equipment; and a ceiling plan creation unit that creates ceiling plan data by associating the equipment estimation results corrected by the correction unit with the drawing data created by the drawing creation unit.The acquisition unit 321 and acquisition unit 421 in the above embodiment are examples of the acquisition unit.The creation unit 322 in the above embodiment are examples of the drawing creation unit and the ceiling plan creation unit.

[0102] With such a ceiling plan creation device 20, the user can view the created ceiling plan data of the room space by capturing RGB data and depth data of the room space, thereby reducing the effort required for the user to draw a ceiling plan.

[0103] (Other embodiments) Although embodiments have been described above, this disclosure is not limited to the embodiments described above.

[0104] For example, in the above embodiment, the ceiling plan creation device 20 presented the user with ceiling plan data created based on the equipment estimation result corrected by the correction unit 423 of the equipment estimation device 40. However, the device may also present the user with ceiling plan data created based on the equipment estimation result before correction. With such a ceiling plan creation device 20, the user can check multiple estimation results of equipment types by the equipment estimation device 40 and select the most suitable estimation result.

[0105] Furthermore, for example, while the equipment estimation device 40 transmits the equipment estimation results to the drawing creation device 30, it may also transmit them directly to the terminal device 50 in a viewable format. With such an equipment estimation device 40, the user can confirm the type and number of equipment installed on the ceiling, making the estimation process easier.

[0106] For example, in the above embodiment, the ceiling plan creation system was implemented by multiple devices. When the ceiling plan creation system is implemented by multiple devices in this way, the components of the ceiling plan creation system (especially the functional components) may be distributed among the multiple devices in any manner.

[0107] Furthermore, the ceiling plan creation system may be implemented as a single device. For example, the ceiling plan creation system may be implemented as a single device equivalent to a ceiling plan creation device.

[0108] Furthermore, the method of communication between devices in the above embodiment is not particularly limited. In addition, relay devices (such as gateway devices), which are not shown, may be involved in the communication between devices.

[0109] Furthermore, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit. Also, the order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0110] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0111] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0112] Furthermore, the general or specific embodiments of this disclosure may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. They may also be implemented in any combination of systems, apparatus, methods, integrated circuits, computer programs, and recording media.

[0113] Furthermore, this disclosure may be implemented as a ceiling plan creation method executed by a computer, such as the ceiling plan creation system (ceiling plan creation device) of the above embodiment, or as a program (in other words, a computer program product) for causing a computer to execute the ceiling plan creation method. Alternatively, this disclosure may be implemented as a computer-readable non-temporary recording medium on which such a program is recorded.

[0114] Furthermore, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of this disclosure. [Explanation of Symbols]

[0115] 20 Ceiling Plan Creation Device 30 Drawing creation device 321 Acquisition Department 322 Treasury Section 40 Equipment estimation device 421 Acquisition Department 422 Estimation Department 423 Correction section 100 device estimation models 200 Ceiling Plan Data

Claims

1. A device estimation method for estimating the types of multiple devices placed on the ceiling of a space in which a computer is executed, An acquisition step to acquire RGB data of the aforementioned space, An estimation step is performed to estimate the types of multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, The estimation step includes a correction step in which the type of the first device among the plurality of devices estimated in the estimation step is corrected based on the relationship with the estimated results of the types of other devices arranged around the first device. Instrument estimation methods.

2. The estimation step and the correction step are performed using a trained AI (Artificial Intelligence) model. The device estimation method according to claim 1.

3. In the correction step, the type of the first device is corrected so that the relationship between the estimated type of the first device and the estimated type of the other devices becomes a normal relationship. The device estimation method according to claim 1 or 2.

4. A method for creating ceiling plan data, which includes information indicating the types of multiple devices placed on the ceiling of a space where a computer is to be operated, An acquisition step of acquiring RGB data and depth data of the space, A drawing creation step in which drawing data of the ceiling of the space is created based on the RGB data and Depth data acquired in the acquisition step, An estimation step is performed to estimate the types of multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, and to generate a device estimation result as a result of the estimation. A correction step to correct the equipment estimation result by correcting the type of the first equipment among the multiple types of equipment estimated in the estimation step based on the relationship with the estimated results of the types of other equipment arranged around the first equipment, A ceiling plan creation step is included in which ceiling plan data is created by associating the equipment estimation results corrected in the correction step with the drawing data created in the drawing creation step. Method for creating ceiling plan data.

5. A program for causing a computer to execute the device estimation method described in claim 1 or 2.

6. A program for causing a computer to execute the ceiling plan data creation method described in claim 4.

7. A device for estimating the types of multiple devices arranged on the ceiling of a space, An acquisition unit that acquires RGB data of the aforementioned space, An estimation unit estimates the types of multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit, The system includes a correction unit that corrects the type of the first device among the plurality of devices estimated by the estimation unit based on the relationship with the estimated results of the types of other devices arranged around the first device. Equipment estimation device.

8. A ceiling plan creation device that creates ceiling plan data including information indicating the types of multiple pieces of equipment arranged on the ceiling of a space, An acquisition unit that acquires RGB data and depth data of the space, A drawing creation unit creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit, An estimation unit, based on the RGB data acquired by the acquisition unit, performs estimation of the types of multiple devices included in the RGB data and generates a device estimation result as a result of the estimation. A correction unit corrects the equipment estimation result by correcting the type of the first equipment among the multiple types of equipment estimated by the estimation unit based on the relationship with the estimated results of the types of other equipment arranged around the first equipment. The system includes a ceiling plan creation unit that creates ceiling plan data by associating the equipment estimation results corrected by the correction unit with the drawing data created by the drawing creation unit. A device for creating ceiling plans.

Images