Equipment estimation method, ceiling plan data creation method, program, equipment estimation device, and ceiling plan creation device.

Abstract

This invention provides a device estimation method that can estimate the type of equipment installed on the ceiling with greater accuracy. [Solution] A computer-based device estimation method for estimating the types of multiple devices arranged on the ceiling of a space includes: an acquisition step of acquiring RGB data and depth data of the space; an estimation step of estimating the type of each of the multiple devices included in the RGB data based on the RGB data acquired in the acquisition step; and a correction step of correcting the type of each of the multiple devices estimated in the estimation step based on the shape of each of the multiple devices calculated based on the depth data acquired in the acquisition step.

Description

Technical Field

[0001] The present disclosure relates to a device estimation method, a ceiling layout drawing data creation method, a program, a device estimation apparatus, and a ceiling layout drawing creation apparatus.

Background Art

[0002] Patent Document 1 discloses a system that assists a user in identifying the product number of a lighting fixture based on an image obtained by capturing the lighting fixture.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] During construction work to replace lighting equipment or air-conditioning equipment installed on a ceiling, a constructor performs estimation work. In general, in the estimation work, the constructor performs work to create a ceiling layout drawing to be presented to the customer, and the work of creating this ceiling layout drawing incurs costs. The ceiling layout drawing includes information indicating the type of equipment installed on the ceiling.

[0005] An object of the present disclosure is to provide a device estimation method and the like that can estimate the type of equipment installed on a ceiling with higher accuracy.

Means for Solving the Problem

[0006] One embodiment of the equipment estimation method relating to this disclosure is an equipment estimation method for estimating the types of a plurality of devices arranged on the ceiling of a space in which a computer is executed, and includes: an acquisition step of acquiring RGB data and depth data of the space; an estimation step of estimating the type of each of the plurality of devices included in the RGB data based on the RGB data acquired in the acquisition step; and a correction step of correcting the type of each of the plurality of devices estimated in the estimation step based on the shape of each of the plurality of devices calculated based on the depth data acquired in the acquisition step.

[0007] Furthermore, one embodiment of the ceiling plan data creation method relating to this disclosure is a ceiling plan data creation method that creates ceiling plan data including information indicating the types of a plurality of devices arranged on the ceiling of a space executed by a computer, and includes: an acquisition step of acquiring RGB data and depth data of the space; a drawing creation step of creating drawing data of the ceiling of the space based on the RGB data and depth data acquired in the acquisition step; an acquisition step of acquiring RGB data and depth data of the space; an estimation step of estimating the type of each of the plurality of devices included in the RGB data based on the RGB data acquired in the acquisition step; a correction step of correcting the type of each of the plurality of devices estimated in the estimation step based on the shape of each of the plurality of devices calculated based on the depth data acquired in the acquisition step; and a ceiling plan creation step of creating ceiling plan data by associating the type of each of the devices corrected in the correction step with the drawing data created in the drawing creation step.

[0008] Furthermore, one embodiment of the equipment estimation device according to the present disclosure is an equipment estimation device for estimating the types of multiple devices arranged on the ceiling of a space, comprising: an acquisition unit that acquires RGB data and depth data of the space; an estimation unit that estimates the type of each of the multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit; and a correction unit that corrects the type of each of the multiple devices estimated by the estimation unit based on the shape of each of the multiple devices calculated based on the depth data acquired by the acquisition unit.

[0009] Furthermore, one embodiment of the ceiling plan creation device according to the present disclosure is a ceiling plan creation device that creates ceiling plan data including information indicating the types of a plurality of devices arranged on the ceiling of a space, comprising: an acquisition unit that acquires RGB data and depth data of the space; a drawing creation unit that creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit; an acquisition unit that acquires RGB data and depth data of the space; an estimation unit that estimates the type of each of the plurality of devices included in the RGB data based on the RGB data acquired by the acquisition unit; a correction unit that corrects the type of each of the plurality of devices estimated by the estimation unit based on the shape of each of the plurality of devices calculated based on the depth data acquired by the acquisition unit; and a ceiling plan creation unit that creates ceiling plan data by associating the type of each of the devices corrected by the correction unit with the drawing data created by the drawing creation unit.

[0010] Furthermore, this disclosure can be implemented not only as the above-mentioned equipment estimation method or ceiling plan data creation method, but also as a program that causes a computer to execute the above-mentioned equipment estimation method or ceiling plan data creation method. Moreover, it can also be implemented as a computer-readable recording medium that stores the program. [Effects of the Invention]

[0011] The equipment estimation method described herein can estimate the type of equipment installed on the ceiling with greater accuracy. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a block diagram showing the functional configuration of a ceiling plan creation system according to an embodiment. [Figure 2] Figure 2 is a sequence diagram illustrating the operation by which the ceiling plan creation system according to the embodiment creates ceiling plan data. [Figure 3] Figure 3 shows an example of ceiling plan data according to the embodiment. [Figure 4] Figure 4 is a flowchart illustrating the operation of the equipment estimation device according to the embodiment. [Figure 5] Figure 5 shows an example of the estimation and calculation results according to the embodiment. [Figure 6A] Figure 6A shows the correction results according to the embodiment. [Figure 6B] Figure 6B shows another example of the correction result according to the embodiment. [Modes for carrying out the invention]

[0013] (Embodiment) The following describes in detail, with reference to drawings, embodiments of the equipment estimation method, ceiling plan data creation method, and program related to this disclosure. The embodiments described below are all preferred examples of this disclosure. The numerical values, components, arrangement and connection configurations of components, steps, and step order shown in the following embodiments are examples and are not intended to limit this disclosure. Furthermore, components in the following embodiments that are not described in an independent claim are described as any component constituting a preferred configuration.

[0014] Note that each drawing is a schematic diagram and is not necessarily strictly illustrated. In each drawing, substantially the same components are denoted by the same reference numerals, and duplicate descriptions may be omitted or simplified in some cases.

[0015] Further, ordinal numbers such as "first" and "second" in the present disclosure do not indicate the number or order of components or the like unless otherwise specified, and are used for the purpose of distinguishing and avoiding confusion between components of the same type.

[0016] [Background Leading to the Conception of the Present Disclosure] When performing work to replace lighting equipment and air conditioning equipment in tenants, offices, etc., estimation work is carried out in advance. For example, estimation work when performing work to change fluorescent lamps to LEDs (Light Emitting Diodes) can be considered.

[0017] In such estimation work, it is usual for site representatives, site supervisors, etc. of electrical contractors who perform construction work handling wiring for lighting and outlets to actually visit the site and conduct on-site surveys.

[0018] In the on-site survey, the site supervisor visually recognizes the type, position and number of devices arranged on the ceiling, and takes handwritten notes. After that, the estimation work is performed by creating a ceiling layout diagram based on these notes, and a construction proposal is made to the customer (for example, the owner of the tenant or office). The ceiling layout diagram is a drawing including information indicating the type, position and number of devices arranged on the ceiling.

[0019] The work of creating this ceiling layout diagram is a high-load work for site supervisors. This is because there are many work sites, and the work becomes wasted if the construction order is lost.

[0020] Accordingly, the inventor has conceived a system that supports the work of creating such a ceiling layout diagram.

[0021] [Configuration] First, the configuration of the ceiling plan creation system that executes the equipment estimation method according to the embodiment will be described. Figure 1 is a block diagram showing the functional configuration of the ceiling plan creation system 10 according to the embodiment.

[0022] The ceiling plan creation system 10 is a system for creating ceiling plan data for an indoor space. An indoor space is, for example, an office or a tenant space. In this specification, "space" means an indoor space. A user of the ceiling plan creation system 10 is, for example, a contractor who performs work related to equipment installed on the ceiling of an office or tenant space.

[0023] The ceiling plan creation system 10 comprises a ceiling plan creation device 20 and a terminal device 50. The ceiling plan creation device 20 and the terminal device 50 are connected to each other so as to be able to communicate via a public network 60.

[0024] The user goes to the indoor space where the ceiling plan data is created, carrying the terminal device 50. By operating the terminal device 50, the user can generate the information necessary for creating the ceiling plan data and verify the ceiling plan data generated by the ceiling plan creation device 20.

[0025] The ceiling plan creation device 20 is a device that creates ceiling plan data. The ceiling plan data is a drawing of the ceiling of an interior space. Specifically, the ceiling plan data includes information showing the outline of the ceiling of the interior space. The ceiling plan data also includes information showing the location and type of equipment installed on the ceiling of the interior space. The ceiling plan creation device 20 comprises a drawing creation device 30 and an equipment estimation device 40. The ceiling plan creation device 20 may be implemented by two server devices, one server device that implements the functions of the drawing creation device 30 and the other server device that implements the functions of the equipment estimation device 40, or it may be implemented by one server device that implements the functions of both the drawing creation device 30 and the equipment estimation device 40.

[0026] The drawing creation device 30 is a device that creates ceiling drawing data and ceiling plan data. The drawing creation device 30 is implemented, for example, by a cloud server. The drawing creation device 30 comprises a communication unit 31, an information processing unit 32, and a storage unit 33.

[0027] The communication unit 31 is a communication circuit (communication module) for the drawing creation device 30 to communicate with the equipment estimation device 40 and the terminal device 50 via the public network 60. The communication performed by the communication unit 31 is, for example, wireless communication. The communication unit 31 may communicate wirelessly with the terminal device 50 and with the equipment estimation device 40 via wired communication. The communication standard for the communication performed by the communication unit 31 is not particularly limited.

[0028] The information processing unit 32 performs information processing for the drawing creation device 30 to create ceiling drawing data and ceiling plan data. The information processing unit 32 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 32 are realized by the execution of a computer program (software) stored in the storage unit 33 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 32. Specifically, the information processing unit 32 includes an acquisition unit 321, a creation unit 322, and an output unit 323.

[0029] The acquisition unit 321 acquires RGB data and Depth data of the indoor space from the terminal device 50. The RGB data is an RGB image captured with respect to the ceiling surface of the indoor space. The RGB data shows multiple pieces of equipment installed on the ceiling surface of the indoor space. The Depth data is data that includes distance values ​​to the ceiling surface, walls, and equipment of the indoor space. The Depth data may also be three-dimensional point cloud data showing the outline of the indoor space, generated by converting the distance values ​​to the ceiling surface, walls, and equipment of the indoor space into point cloud data.

[0030] The creation unit 322 creates drawing data of the ceiling of the interior space based on the RGB data and depth data of the interior space acquired by the acquisition unit 321. The ceiling drawing data is data that shows the outer shape of the ceiling of the interior space, and the location and number of equipment installed on the ceiling of the interior space.

[0031] Furthermore, the creation unit 322 creates ceiling plan data based on the ceiling drawing data and the equipment estimation results created by the equipment estimation device 40. The ceiling plan data is data that associates the location and type of equipment installed on the ceiling of the room space.

[0032] The output unit 323 outputs the ceiling plan data created by the creation unit 322.

[0033] The memory unit 33 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 32. The memory unit 33 is implemented, for example, by semiconductor memory. The computer programs stored in the memory unit 33 include a program for creating ceiling drawing data based on RGB data and depth data of the interior space.

[0034] The equipment estimation device 40 is a device that estimates the type of equipment installed on the ceiling. The equipment estimation device 40 is implemented, for example, by a cloud server. The equipment estimation device 40 comprises a communication unit 41, an information processing unit 42, and a storage unit 43. The type of equipment is, for example, if the equipment is lighting equipment, a classification based on the shape of the equipment, such as downlights or base lights. Here, a base light is lighting equipment installed on the ceiling that has a shape close to a rectangle when viewed from directly below. A downlight is lighting equipment installed on the ceiling that has a shape close to a square when viewed from directly below. The type of equipment is, for example, if the equipment is air conditioning equipment, exhaust vents and intake vents, etc.

[0035] The communication unit 41 is a communication circuit (communication module) for the equipment estimation device 40 to communicate with the drawing creation device 30 and the terminal device 50 via the public network 60. The communication performed by the communication unit 41 is, for example, wireless communication. The communication unit 41 may communicate wirelessly with the terminal device 50 and with the drawing creation device 30 via wired communication. The communication standard for the communication performed by the communication unit 41 is not particularly limited.

[0036] The information processing unit 42 performs information processing for the equipment estimation device 40 to estimate the type of equipment. The information processing unit 42 is implemented, for example, by a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 42 are realized by the execution of a computer program (software) stored in the storage unit 43 by the hardware, such as a microcomputer or processor, that constitutes the information processing unit 42. Specifically, the information processing unit 42 includes an acquisition unit 421, an estimation unit 422, a correction unit 423, an output unit 424, and a learning unit 425.

[0037] The acquisition unit 421 acquires RGB data and depth data of the indoor space. For example, the acquisition unit 421 acquires RGB data and depth data of the indoor space captured by the terminal device 50.

[0038] The estimation unit 422 estimates the type of equipment included in the RGB data based on the RGB data of the indoor space acquired by the acquisition unit 421. The estimation unit 422 estimates the type of equipment using the trained equipment estimation model 100 stored in the storage unit 43.

[0039] The correction unit 423 corrects the type of equipment estimated by the estimation unit 422. The correction unit 423 corrects the type of equipment using the learned equipment estimation model 100 stored in the memory unit 43. Specifically, the correction unit 423 corrects the type of each of the multiple equipment estimated by the estimation unit 422 based on the shape of each of the multiple equipment calculated based on the depth data acquired by the acquisition unit 421.

[0040] The output unit 424 outputs at least one of the results of the estimation of the equipment type by the estimation unit 422 and the results of the correction of the equipment type by the correction unit 423.

[0041] The learning unit 425 trains the device estimation model 100.

[0042] The memory unit 43 is a storage device that stores information necessary for information processing, such as computer programs executed by the information processing unit 42. The information stored in the memory unit 43 includes a device shape database that associates device types with device shapes. For each device type, the device shape database associates information indicating the shape of the device, for example, the aspect ratio of the device's external dimensions. The memory unit 43 is implemented, for example, by a semiconductor memory. The computer program stored in the memory unit 43 includes a device estimation model 100 for estimating the device type.

[0043] The device estimation model 100 is a pre-trained AI (Artificial Intelligence) model. The device estimation model 100 is pre-trained by the learning unit 425.

[0044] The method for creating the equipment estimation model 100 is, for example, supervised learning using a training dataset. Specifically, for example, the person setting up the system prepares training data, which is RGB data (image data) captured on the ceiling surface of a room, associating the area where equipment installed on the ceiling is visible with the type of equipment. The learning unit 425 then uses this training data to machine-learn the equipment estimation model 100. The equipment estimation model 100 is trained to output the area where equipment is visible and the type of equipment when RGB data captured on the ceiling surface of a room is input. Furthermore, the equipment estimation model 100 is trained to output the type of equipment that has the shape closest to the actual equipment shape from among the candidate equipment types when candidate equipment types and the shape of the equipment are input. The device estimation model 100 learned by the learning unit 425 is stored in the memory unit 43.

[0045] The terminal device 50 is an information terminal used by the user. The user can use the terminal device 50 to check the ceiling plan data of the room space. The terminal device 50 is implemented, for example, by a dedicated terminal of the ceiling plan creation system 10. The terminal device 50 may also be implemented by a general-purpose terminal such as a smartphone or tablet terminal. Specifically, the terminal device 50 comprises a communication unit 51, an information processing unit 52, a storage unit 53, an operation reception unit 54, a display unit 55, and an imaging unit 56.

[0046] The communication unit 51 is a communication circuit (communication module) for the terminal device 50 to communicate with the drawing creation device 30 and the equipment estimation device 40 via a public network 60 such as the Internet. The communication performed by the communication unit 51 is, for example, wireless communication. The communication standard for the communication performed by the communication unit 51 is not particularly limited.

[0047] The information processing unit 52 performs information processing to allow the user to acquire ceiling plan data using the terminal device 50. The information processing unit 52 is implemented by, for example, a microcomputer, but may also be implemented by a processor or dedicated circuit. The functions of the information processing unit 52 are realized by the execution of a computer program (software) stored in the storage unit 53 by the hardware, such as the microcomputer or processor that constitutes the information processing unit 52.

[0048] The memory unit 53 is a storage device that stores computer programs and the like executed by the information processing unit 52. The computer programs stored in the memory unit 53 include a predetermined application program for presenting ceiling plan data to the user. The memory unit 53 is implemented, for example, by semiconductor memory.

[0049] The operation reception unit 54 receives user input. The operation reception unit 54 is implemented, for example, by a touch panel.

[0050] The display unit 55 is a display for presenting images to the user, for example, by presenting the user with an image of the ceiling plan data created by the ceiling plan creation device 20. The display unit 55 is implemented by a display panel such as a liquid crystal panel or an organic EL (Electronic Luminescence) panel.

[0051] The imaging unit 56 captures an image of the indoor space. The user uses the imaging unit 56 of the terminal device 50 to perform imaging on the ceiling surface of the indoor space. Specifically, the imaging unit 56 captures RGB data and depth data of the space. The imaging unit 56 is implemented, for example, by a camera capable of capturing visible light images and LiDAR (Light Detection And Ranging).

[0052] [Action to create ceiling diagram data] The operation of the ceiling plan creation device 20 according to the embodiment in which ceiling plan data is created will be described. Figure 2 is a sequence diagram illustrating the operation of the ceiling plan creation system 10 according to the embodiment in which ceiling plan data is created.

[0053] First, the terminal device 50 captures RGB data of the space (S101). Specifically, the user uses the imaging unit 56 of the terminal device 50 to capture RGB data of the ceiling surface of the room.

[0054] Next, the terminal device 50 captures depth data of the space (S102). The user uses the imaging unit 56 of the terminal device 50 to capture depth data targeting the ceiling surface of the room space.

[0055] When spatial RGB data and depth data are captured, the information processing unit 52 of the terminal device 50 transmits the spatial RGB data and depth data to the drawing creation device 30 via the public network 60 using the communication unit 51 (S103). The spatial RGB data and depth data transmitted by the terminal device 50 are received by the communication unit 31 of the drawing creation device 30.

[0056] The acquisition unit 321 of the drawing creation device 30 acquires spatial RGB data and depth data (S104).

[0057] Once RGB data and depth data are acquired, the creation unit 322 of the drawing creation device 30 creates drawing data for the ceiling (S105). Specifically, the drawing data for the ceiling is drawing data that shows the outer shape of the ceiling of the room space, and the location and number of equipment installed on the ceiling of the room space.

[0058] Furthermore, the information processing unit 52 of the terminal device 50 transmits spatial RGB data and depth data to the device estimation device 40 via the public network 60 using the communication unit 51 (S106). The spatial RGB data and depth data transmitted by the terminal device 50 are received by the communication unit 41 of the device estimation device 40.

[0059] The acquisition unit 421 of the equipment estimation device 40 acquires spatial RGB data and depth data (S107).

[0060] The information processing unit 42 of the equipment estimation device 40 estimates the type of equipment installed on the ceiling of the room based on the acquired RGB data and depth data of the space (S108). The processing in step S108 will be described in detail later.

[0061] Next, the information processing unit 42 of the equipment estimation device 40 transmits the equipment estimation result to the drawing creation device 30 using the communication unit 41 (S109). The equipment estimation result includes information indicating the type of equipment estimated by the equipment estimation device 40 and information indicating the position of the equipment in RGB data. The equipment estimation result transmitted by the equipment estimation device 40 is received by the drawing creation device 30.

[0062] Upon receiving the equipment estimation results, the creation unit 322 of the drawing creation device 30 creates ceiling plan data (S110). Specifically, the drawing creation device 30 creates ceiling plan data by applying the received equipment estimation results to the ceiling drawing data created in step S105. In other words, the creation unit 322 associates the equipment estimation results with the equipment whose positions are indicated in the ceiling drawing data. The ceiling plan data is data that associates the positions and types of equipment installed on the ceiling of an indoor space. Figure 3 shows an example of ceiling plan data 200 according to an embodiment.

[0063] As shown in Figure 3, the ceiling plan data 200 indicates that the ceiling is a rectangle with dimensions of Xm × Ym. It also indicates that nine pieces of equipment are installed on the ceiling, eight of which are base lights and one of which is an air conditioning unit. In other words, the ceiling plan data 200 shown in Figure 3 indicates the location and type of equipment installed on the ceiling of the interior space.

[0064] Once the ceiling plan data is created, the output unit 323 of the drawing creation device 30 outputs the ceiling plan data (S111). The output unit 323 of the drawing creation device 30 transmits the ceiling plan data to the terminal device 50 using the communication unit 31 (S112). The ceiling plan data transmitted by the drawing creation device 30 is received by the terminal device 50.

[0065] Upon receiving the ceiling plan data, the terminal device 50 presents the ceiling plan data to the user (S113). For example, the information processing unit 52 presents the ceiling plan data to the user by displaying it on the display unit 55.

[0066] Thus, the ceiling plan creation system 10 according to this embodiment can create and present ceiling plan data of an indoor space based on RGB data and depth data captured of the indoor space by the user.

[0067] This ceiling plan creation system 10 reduces the effort required for users to draft ceiling plans.

[0068] [Action to estimate the device] Next, we will explain in detail the operation of the equipment estimation device 40 in estimating the type of equipment. In other words, we will explain the process of step S107 in Figure 2. Figure 4 is a flowchart illustrating the operation of the equipment estimation device 40 according to the embodiment.

[0069] Prior to this, the acquisition unit 421 acquires spatial RGB data and depth data (S106).

[0070] First, the estimation unit 422 identifies the area of ​​the equipment in the RGB data (S201). The RGB data is image data captured targeting the ceiling surface of the room. The RGB data shows equipment installed on the ceiling of the room. For example, the estimation unit 422 identifies the area in the RGB data where the equipment is visible as coordinates in the RGB data. At the same time, the estimation unit 422 also identifies the area in the RGB data where the ceiling surface of the room is visible as coordinates in the RGB data.

[0071] Next, the estimation unit 422 estimates the type of equipment (S202). The estimation unit 422 uses the trained equipment estimation model 100 to estimate the type of equipment that appears in the RGB data. The estimation unit 422 estimates the type of each of the multiple equipment whose regions have been identified.

[0072] Once the type of device is estimated, the estimation unit 422 generates a first estimation result (S203). The first estimation result is, for example, information that associates the types of multiple devices with regions in RGB data.

[0073] Next, the correction unit 423 calculates the shape of the equipment based on the depth data (S204). For example, the correction unit 423 calculates the aspect ratio of the equipment's shape based on the depth data. Specifically, the correction unit 423 calculates the aspect ratio of each of the shapes of the multiple pieces of equipment included in the depth data acquired in step S106. The shape of the equipment calculated based on the depth data is the actual shape of the equipment installed on the ceiling.

[0074] Figure 5 shows an example of the estimation result 70 and calculation result 80 of the equipment according to the embodiment. In Figure 5, the estimation result 70 is the estimation result of the equipment type estimated based on RGB data. For the equipment shown in Figure 5, the equipment estimation model 100 calculates "base light 0.7" and "down light 0.5" as AI estimation scores. As shown in Figure 5, when the equipment estimation model 100 calculates the estimated scores of the equipment type as "base light 0.7, down light 0.5", the estimation unit 422 estimates the equipment type as the type with the highest estimated score, "base light", as the first estimation result.

[0075] Calculation result 80 is the calculation result of the device shape calculated based on the depth data. For the device shown in Figure 5, the correction unit 423 calculates that the aspect ratio of the device shape is a rectangle with "height:width = n:m" and "m > n", as calculation result 80.

[0076] The estimation unit 422 may use the equipment estimation model 100 to estimate a first candidate type and a second candidate type as candidates for each type of multiple equipment. In other words, in the estimation result 70 shown in Figure 5, "base light" may be estimated as the first candidate type and "downlight" as the second candidate type.

[0077] Next, the correction unit 423 compares the shape of the estimated equipment type with the calculated equipment shape (S205). Specifically, the correction unit 423 uses the trained equipment estimation model 100 to compare the shape of each of the estimated equipment types with the calculated shapes of each of the multiple equipment types. The correction unit 423 identifies the shape of each of the multiple equipment types estimated by the estimation unit 422, for example, by referring to the equipment shape database.

[0078] In the equipment shape database, for example, the shape of equipment type "base light" is associated with a rectangle (i.e., a rectangle with an aspect ratio of n:m and m > n), and the shape of equipment type "downlight" is associated with a square (i.e., a rectangle with an aspect ratio of n:m and n = m).

[0079] The correction unit 423 compares the shape of the estimated equipment type with the calculated equipment shape to determine whether the shapes match (S206). For example, in the example shown in Figure 5, the correction unit 423 determines that the shapes match because the shape of the estimated result 70, which is the type of "base light," matches the shape shown in the calculated result 80.

[0080] If it is determined that the shapes match (Yes in S206), the process proceeds to step S209. In other words, if the shape associated with the type of equipment estimated by the estimation unit 422 matches the shape of the equipment calculated by the correction unit 423, there is a high probability that the type of equipment estimated by the estimation unit 422 is the correct type. Therefore, the correction unit 423 does not correct the first estimation result for that equipment. In other words, the correction unit 423 corrects the equipment to maintain the first estimation result. Figure 6A is a diagram showing an example of the correction result 90 according to the embodiment. The correction result 90a shown in Figure 6A is the correction result when corrected to a base light in this way.

[0081] If it is determined that the shapes do not match (No in S206), the correction unit 423 determines whether the calculated shape of the device matches the shape of other candidate types in the estimation results (S207). For example, if the shape shown in the calculation result 80 is a square, the correction unit 423 determines that the shape of the estimated device type and the calculated shape of the device do not match, and determines whether there is a type with a square shape among the other candidate types.

[0082] If it is determined that the shape matches that of other candidate types (Yes in S207), the correction unit 423 corrects the first estimation result (S208). For example, as shown in Figure 5, if "downlight" is included among the other candidates in the estimation result, and the shape shown in the calculation result 80 is a square, the correction unit 423 corrects the first estimation result from "base light" to "downlight". Figure 6B shows another example of the correction result according to the embodiment. The correction result 90b shown in Figure 6B is the correction result when it is corrected to a downlight in this way.

[0083] If it is determined that the shape of the estimated result does not match that of other candidate types (No in S207), the process proceeds to step S209. In other words, if the shape associated with the type of equipment estimated by the estimation unit 422 does not match the shape of the equipment calculated by the correction unit 423, the type of equipment for which the equipment estimation model 100 calculated the highest estimated score is provisionally set as the correct type. At this time, the correction unit 423 does not perform any correction on the first estimation result for that equipment.

[0084] Furthermore, if the estimation unit 422 estimates a first candidate type and a second candidate type as candidates for each of the multiple types of equipment, the correction unit 423 may correct the type of equipment to the type with a shape that is closest to the shape of the calculated result 80 from among the first candidate type and the second candidate type. In other words, in the example shown in Figure 5, among the first candidate type, "base light," and the second candidate type, "downlight," the "base light," which has a shape that is closer to the shape in the calculated result 80 where the width is greater than the height, may be estimated as the correct type of equipment.

[0085] Once the first estimation result is corrected by the correction unit 423, the correction unit 423 generates a second estimation result (S209). The correction unit 423 generates the second estimation result by performing the processing in steps S205 to S208 for all of the multiple devices included in the ceiling plan data. The second estimation result is, for example, information that associates the types of multiple devices with the regions in the RGB data, and is information on which the correction has been performed on the first estimation result. In other words, the second estimation result includes multiple correction results.

[0086] Once the second estimation result is generated, the process proceeds to step S108, and the output unit 424 transmits the second estimation result as the equipment estimation result to the drawing creation device 30.

[0087] According to this operation, the equipment estimation device 40 can correct the estimation result to the correct one if the type of equipment was incorrectly estimated based on the shape of the equipment.

[0088] Therefore, the equipment estimation device 40 can estimate the type of equipment installed on the ceiling with higher accuracy.

[0089] [Effects, etc.] The technologies derived from the disclosures in this specification include, for example, the following. The technologies derived from the disclosures in this specification will be described below, along with the effects obtained by such technologies.

[0090] Technology 1 is a device estimation method for estimating the types of multiple devices arranged on the ceiling of a space executed by a computer, and includes an acquisition step of acquiring RGB data and depth data of the space; an estimation step of estimating the type of each of the multiple devices included in the RGB data based on the RGB data acquired in the acquisition step; and a correction step of correcting the type of each of the multiple devices estimated in the estimation step based on the shape of each of the multiple devices calculated based on the depth data acquired in the acquisition step.

[0091] This type of equipment estimation method can correct the estimated equipment type based on the shape of the equipment. Therefore, this type of equipment estimation method can estimate the type of equipment installed on the ceiling with higher accuracy.

[0092] Technique 2 is the device estimation method of Technique 1, wherein the estimation step and correction step are performed using a trained AI model. The device estimation model 100 in the above embodiment is an example of a trained AI model.

[0093] This type of equipment estimation method can estimate the type of equipment installed on the ceiling using a pre-trained AI model. This method allows for a simpler estimation of the type of equipment installed on the ceiling.

[0094] Technology 3 is a device estimation method of Technology 1 or 2, in which, in the estimation step, a first candidate type and a second candidate type are estimated as candidates for the type of each of the multiple devices, and in the correction step, the type of each of the multiple devices is corrected to the type of shape that is closest to the shape of each of the multiple devices calculated based on Depth data from among the first candidate type and the second candidate type.

[0095] This type of equipment estimation method can identify a more appropriate equipment type from a list of candidate equipment types based on the shape of the equipment, and use this as the final equipment type estimation result. Therefore, this type of equipment estimation method can estimate the type of equipment installed on the ceiling with higher accuracy.

[0096] Technology 4 is a method for creating ceiling plan data that includes information indicating the types of multiple devices arranged on the ceiling of a space executed by a computer, and includes an acquisition step of acquiring RGB data and depth data of the space, a drawing creation step of creating drawing data of the ceiling of the space based on the RGB data and depth data acquired in the acquisition step, an acquisition step of acquiring RGB data and depth data of the space, an estimation step of estimating the type of each of the multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, a correction step of correcting the type of each of the multiple devices estimated in the estimation step based on the shape of each of the multiple devices calculated based on the depth data acquired in the acquisition step, and a ceiling plan creation step of creating ceiling plan data by associating the type of each of the devices corrected in the correction step with the drawing data created in the drawing creation step.

[0097] This method of creating ceiling plan data allows users to view the created ceiling plan data of an indoor space by capturing RGB and depth data of that space. This method of creating ceiling plan data reduces the effort required for users to draft ceiling plans.

[0098] Technique 5 is a program that causes a computer to execute one of the device estimation methods from Techniques 1 to 3.

[0099] Such programs can help estimate the type of equipment installed on the ceiling with greater accuracy.

[0100] Technique 6 is a program that causes a computer to execute the ceiling plan data creation method of Technique 4.

[0101] Such programs can help reduce the effort required for users to create ceiling plans.

[0102] Technology 7 is an equipment estimation device 40 for estimating the types of multiple devices arranged on the ceiling of a space, comprising: an acquisition unit 421 for acquiring spatial RGB data and spatial depth data; an estimation unit 422 for estimating the type of each of the multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit; and a correction unit 423 for correcting the type of each of the multiple devices estimated by the estimation unit 422 based on the shape of each of the multiple devices calculated based on the depth data acquired by the acquisition unit 421.

[0103] Since such an equipment estimation device 40 can correct the estimation result of the equipment type based on the shape of the equipment, it can estimate the type of equipment installed on the ceiling with higher accuracy.

[0104] Technology 8 is a ceiling plan creation device 20 that creates ceiling plan data including information indicating the types of multiple devices arranged on the ceiling of a space, comprising: an acquisition unit that acquires RGB data and depth data of the space; a drawing creation unit that creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit; an acquisition unit that acquires RGB data and depth data of the space; an estimation unit 422 that estimates the type of each of the multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit; a correction unit 423 that corrects the type of each of the multiple devices estimated by the estimation unit 422 based on the shape of each of the multiple devices calculated based on the depth data acquired by the acquisition unit; and a ceiling plan creation unit that creates ceiling plan data by associating the type of each of the devices corrected by the correction unit 423 with the drawing data created by the drawing creation unit. The acquisition unit 321 and acquisition unit 421 in the above embodiment are examples of the acquisition unit. Furthermore, the creation unit 322 in the above embodiment is an example of a drawing creation unit and a ceiling plan creation unit.

[0105] Such a ceiling plan creation device 20 can create ceiling plan data that includes information indicating the type of equipment estimated with high accuracy, thereby reducing the effort required for the user to draw the ceiling plan.

[0106] (Other embodiments) Although embodiments have been described above, this disclosure is not limited to the embodiments described above.

[0107] For example, in the above embodiment, the ceiling plan creation device 20 presented the user with ceiling plan data created based on the equipment estimation result corrected by the correction unit 423 of the equipment estimation device 40. However, the device may also present the user with ceiling plan data created based on the equipment estimation result before correction. With such a ceiling plan creation device 20, the user can check multiple estimation results of equipment types by the equipment estimation device 40 and select the most suitable estimation result.

[0108] Furthermore, for example, while the equipment estimation device 40 transmits the equipment estimation results to the drawing creation device 30, it may also transmit them directly to the terminal device 50 in a viewable format. With such an equipment estimation device 40, the user can confirm the type and number of equipment installed on the ceiling, making the estimation process easier.

[0109] For example, in the above embodiment, the ceiling plan creation system was implemented by multiple devices. When the ceiling plan creation system is implemented by multiple devices in this way, the components of the ceiling plan creation system (especially the functional components) may be distributed among the multiple devices in any manner.

[0110] Furthermore, the ceiling plan creation system may be implemented as a single device. For example, the ceiling plan creation system may be implemented as a single device equivalent to a ceiling plan creation device.

[0111] Furthermore, the method of communication between devices in the above embodiment is not particularly limited. In addition, relay devices (such as gateway devices), which are not shown, may be involved in the communication between devices.

[0112] Furthermore, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit. Also, the order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0113] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0114] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0115] Furthermore, the general or specific embodiments of this disclosure may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. They may also be implemented in any combination of systems, apparatus, methods, integrated circuits, computer programs, and recording media.

[0116] Furthermore, this disclosure may be implemented as a ceiling plan creation method executed by a computer, such as the ceiling plan creation system (ceiling plan creation device) of the above embodiment, or as a program (in other words, a computer program product) for causing a computer to execute the ceiling plan creation method. Alternatively, this disclosure may be implemented as a computer-readable non-temporary recording medium on which such a program is recorded.

[0117] Furthermore, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of this disclosure. [Explanation of Symbols]

[0118] 20 Ceiling Plan Creation Device 321 Acquisition Department 322 Treasury Section 40 Equipment estimation device 421 Acquisition Department 422 Estimation Department 423 Correction section 425 Learning Department 100 device estimation models 200 Ceiling Plan Data

Claims

1. A device estimation method for estimating the types of multiple devices placed on the ceiling of a space in which a computer is executed, An acquisition step of acquiring RGB data and depth data of the space, An estimation step is performed to estimate the type of each of the multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, The process includes a correction step in which the type of each of the plurality of devices estimated in the estimation step is corrected based on the shape of each of the plurality of devices calculated based on the Depth data acquired in the acquisition step, Instrument estimation methods.

2. The estimation step and the correction step are performed using a trained AI (Artificial Intelligence) model. The device estimation method according to claim 1.

3. In the estimation step described above, a first candidate type and a second candidate type are estimated as candidates for each of the multiple devices. In the correction step, the type of each of the multiple devices is corrected to the type of shape that is closest to the shape of each of the multiple devices calculated based on the Depth data, from among the first candidate type and the second candidate type. The device estimation method according to claim 1 or 2.

4. A method for creating ceiling plan data, which includes information indicating the types of multiple devices placed on the ceiling of a space where a computer is to be operated, An acquisition step of acquiring RGB data and depth data of the space, A drawing creation step in which drawing data of the ceiling of the space is created based on the RGB data and Depth data acquired in the acquisition step, An acquisition step of acquiring RGB data and depth data of the space, An estimation step is performed to estimate the type of each of the multiple devices included in the RGB data based on the RGB data acquired in the acquisition step, A correction step in which the type of each of the plurality of devices estimated in the estimation step is corrected based on the shape of each of the plurality of devices calculated based on the Depth data acquired in the acquisition step, A ceiling plan creation step is included in which ceiling plan data is created by associating the respective types of equipment corrected in the correction step with the drawing data created in the drawing creation step, Method for creating ceiling plan data.

5. A program for causing a computer to execute the device estimation method described in claim 1 or 2.

6. A program for causing a computer to execute the ceiling plan data creation method described in claim 4.

7. A device for estimating the types of multiple devices arranged on the ceiling of a space, An acquisition unit that acquires RGB data and depth data of the space, An estimation unit estimates the type of each of the multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit, The system includes a correction unit that corrects the type of each of the multiple devices estimated by the estimation unit based on the shape of each of the multiple devices calculated based on the depth data acquired by the acquisition unit. Equipment estimation device.

8. A ceiling plan creation device that creates ceiling plan data including information indicating the types of multiple pieces of equipment arranged on the ceiling of a space, An acquisition unit that acquires RGB data and depth data of the space, A drawing creation unit creates drawing data of the ceiling of the space based on the RGB data and depth data acquired by the acquisition unit, An acquisition unit that acquires RGB data and depth data of the space, An estimation unit estimates the type of each of the multiple devices included in the RGB data based on the RGB data acquired by the acquisition unit, A correction unit corrects the type of each of the multiple devices estimated by the estimation unit based on the shape of each of the multiple devices calculated based on the depth data acquired by the acquisition unit. The system includes a ceiling plan creation unit that creates ceiling plan data by associating the respective types of equipment corrected by the correction unit with the drawing data created by the drawing creation unit. A device for creating ceiling plans.

Images