Method, apparatus, device and storage medium for generating a floor plan

Abstract

Embodiments according to the present disclosure provide methods, apparatuses, devices and storage media for generating a planar layout map. The method described herein includes: generating an outline map of a target space based on model data of the target space and semantic information associated with a layout of the target space; determining distribution features of specific target elements in the target space based on a captured image of the target space; and generating a planar layout map of the target space based on the outline map and the distribution features of the specific target elements. In this way, a corresponding planar layout map can be generated in real time during the construction of a three-dimensional model, saving labor costs and improving the production efficiency of the layout map.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to a method, apparatus, device, and computer-readable storage medium for generating a floor plan. Background Art

[0002] Virtual reality (VR) and three-dimensional modeling technology can be used to construct panoramic models with a sense of space and depth. Panoramic models can provide users with an immersive experience and a sense of presence in the scene, and therefore are widely used in various fields. An exemplary application scenario is VR house viewing. Users can view a panoramic house model online and combine it with the house floor plan to understand the house's layout structure, space utilization, etc., and obtain the same experience as offline house viewing. When producing panoramic house models and floor plans, it is usually necessary to use images taken at the house site and measured data. At present, panoramic house models can be automatically generated with the help of computers, while the production of floor plans still requires human participation. Summary of the Invention

[0003] In a first aspect of the present disclosure, a method for generating a floor plan diagram is provided. The method comprises: generating a contour diagram of the target space based on model data of the target space and semantic information associated with the layout of the target space; determining distribution characteristics of specific target elements in the target space based on a captured image of the target space; and generating a floor plan diagram of the target space based on the contour diagram and the distribution characteristics of the specific target elements.

[0004] In a second aspect of the present disclosure, a method for processing a floor plan is provided. The method comprises: receiving a floor plan of a target space from a remote device; presenting a floor plan of the target space to be reviewed based on the floor plan and model data of the target space, where the floor plan is generated by superimposing the floor plan and the model data; and transmitting a review result of the floor plan to the remote device.

[0005] In a third aspect of the present disclosure, a device for generating a plan layout diagram is provided. The device includes: a contour diagram generation module configured to generate a contour diagram of a target space based on model data of the target space and semantic information associated with the layout of the target space; a feature determination module configured to determine distribution features of specific target elements in the target space based on a captured image of the target space; and a layout diagram generation module configured to generate a plan layout diagram of the target space based on the contour diagram and the distribution features of the specific target elements.

[0006] In a fourth aspect of the present disclosure, a device for processing a floor plan is provided. The device includes: a receiving module configured to receive a floor plan of a target space from a remote device; a presenting module configured to present a pending review layout of the target space based on the floor plan and model data of the target space, where the pending review layout is generated by superimposing the floor plan and the model data; and a second sending module configured to send a review result of the floor plan to the remote device.

[0007] In a fifth aspect of the present disclosure, an electronic device is provided. The electronic device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect or the second aspect.

[0008] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method of the first aspect or the second aspect is implemented.

[0009] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] Figure 1 A schematic diagram illustrating an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figure 2 An interactive diagram illustrating a process for generating a floor plan according to some embodiments of the present disclosure;

[0013] Figure 3 shows a top view of a target space according to some embodiments of the present disclosure;

[0014] Figure 4 A schematic diagram illustrating an exemplary contour map of a target space according to some embodiments of the present disclosure;

[0015] Figure 5A A schematic diagram illustrating an exemplary floor plan layout of a target space according to some embodiments of the present disclosure;

[0016] Figure 5B A schematic diagram illustrating floor plan layout data submitted to a remote device according to some embodiments of the present disclosure;

[0017] Figure 6 A schematic diagram illustrating a user interface for processing a floor plan according to some embodiments of the present disclosure is shown;

[0018] Figure 7 A flowchart illustrating a process for generating a floor plan according to some embodiments of the present disclosure is shown;

[0019] Figure 8 A flowchart illustrating a process for processing a floor plan according to some embodiments of the present disclosure is shown;

[0020] Figure 9 A block diagram of an apparatus for generating a floor plan diagram according to some embodiments of the present disclosure is shown;

[0021] Figure 10 A block diagram illustrating an apparatus for processing a floor plan according to some embodiments of the present disclosure is shown; and

[0022] Figure 11 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0023] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0024] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0026] In the description of the embodiments of the present disclosure, the use of words such as "first" and "second" is merely to distinguish between different elements, objects, targets, and units, and does not imply the order or difference of these elements, objects, targets, and units in time, space, or priority.

[0027] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0028] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operation of the disclosed technical solution based on the prompt message.

[0029] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0030] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0031] Currently, the industry relies primarily on manual production of floor plans. Workers draw floor plans based on on-site images and measurements. This method incurs high labor and time costs. Therefore, improvements to the floor plan production process are desirable.

[0032] The embodiments of the present disclosure propose a solution for generating floor plans. This solution utilizes model data and image semantics to automatically generate corresponding floor plans during the construction of a three-dimensional model. Furthermore, the generated floor plans can be audited based on specific rules. If defects or issues are found in the floor plans, an audit failure indication is returned and the floor plans are re-created. This not only saves labor costs and improves production efficiency, but also ensures the accuracy of the layouts.

[0033] The following description of the embodiments of the present disclosure will be based on the scenario of house modeling. However, it should be understood that house modeling is only one of many application scenarios of the embodiments of the present disclosure, and the embodiments of the present disclosure are also applicable to other scenarios where a corresponding floor plan is generated based on a three-dimensional model, such as engineering construction, geological exploration, digital cities, traffic management, etc. Therefore, the scope of the embodiments of the present disclosure is not limited thereto.

[0034] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. Example environment 100 includes terminal devices 110 and 120 and a remote device 130. Terminal device 110 can be used to create a three-dimensional model and a corresponding floor plan. In some embodiments, the three-dimensional model can include a VR panoramic model associated with a house, and the floor plan can be a floor plan of the house. In other embodiments, the three-dimensional model can also be any other suitable model.

[0035] In some embodiments, the real-scene pictures or modeled images used to create the three-dimensional model and floor plan can be taken or generated by the terminal device 110. In other embodiments, these real-scene pictures or modeled images can come from any other data source. Therefore, the embodiments of the present disclosure are not limited in this respect.

[0036] In some embodiments, the terminal device 110 may perform one or more modeling operations for creating a three-dimensional model, including but not limited to stitching panoramic images, extracting feature points, understanding semantics, merging point clouds, estimating textures, mapping, etc. The above operations may be performed by an algorithm module or a processing unit in the terminal device 110.

[0037] The terminal device 120 may be installed with an application 122 for processing floor plans. As an example, the application 122 may be a housing information review platform for reviewing floor plans. In some embodiments, the application 122 may identify defects or problems in the floor plans based on predetermined rules. In addition, the application 122 may also present the floor plans to be reviewed to a user 124 (e.g., a reviewer), and the user 124 may identify defects or problems in the floor plans and return the review results to the terminal device 110. Additionally or alternatively, in other embodiments, the application 122 may also be used to review three-dimensional models.

[0038] The terminal devices 110 and 120 may be any type of mobile, fixed, or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a gaming device, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal devices 110 and 120 may also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0039] Either of the terminal devices 110 and 120 can communicate with the remote device 130 to implement storage, updating, and access to the model data and floor plan of the three-dimensional model. For example, the remote device 130 can be used to expand the storage and processing capabilities of the terminal devices 110 and 120. In some embodiments, the remote device 130 can be various types of computing systems / servers that can provide computing capabilities, including but not limited to mainframes, edge computing nodes, electronic devices in cloud environments, and the like. Figure 1 In the example shown, remote device 130 may be located in cloud environment 132 .

[0040] In this document, images, pictures, and three-dimensional models can be obtained through various shooting methods or modeling operations and can have any data format. The embodiments of the present disclosure are not limited in this respect. It should also be understood that the structure and function of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0041] The following will refer to Figure 2 , which shows an interaction diagram of a process 200 for processing a floor plan according to some embodiments of the present disclosure. The process 200 may involve Figure 1 The terminal devices 110, 120 and the remote device 130 are shown. Of course, the process 200 may also involve any other suitable devices. For ease of discussion, reference will be made to Figure 1 The process 200 is described with reference to the environment 100 of FIG.

[0042] The terminal device 110 can construct a three-dimensional model of the target space based on the panoramic image of the target space by applying a set of modeling operations. In some embodiments, the modeling operations may include, but are not limited to, panoramic image stitching, feature point extraction, semantic understanding, point cloud fusion, texture estimation, mapping, and the like. In the embodiments of the present disclosure, the target space can refer to any enclosed space, such as a house, building, etc. Taking a house as an example, the terminal device 110 can use images captured on-site to construct a panoramic model of the house.

[0043] The terminal device 110 generates (202) a contour map of the target space based on the model data of the target space and semantic information associated with the layout of the target space. The semantic information may indicate the distribution of walls in the target space. Taking a house modeling scenario as an example, the semantic information may be determined, for example, by a three-dimensional house type algorithm. In other scenarios, other appropriate algorithms may also be used, and the embodiments of the present disclosure are not limited in this respect.

[0044] In some embodiments, the model data may be, for example, a top view of the target space generated based on a modeling operation. Figure 3 FIG. 3 shows a top view 300 of a target space according to some embodiments of the present disclosure. Figure 3 In the example, the target space is a house. Since the bird's-eye view 300 is generated based on an image taken inside the house, it can reflect the layout characteristics of the house, the distribution of walls, specific target elements (e.g., doors, windows), etc.

[0045] Figure 4 FIG. 4 is a schematic diagram illustrating an exemplary contour map 400 of a target space according to some embodiments of the present disclosure. Figure 4 As shown, outline drawing 400 is a wireframe diagram depicting the wall outline of the target space. However, in addition to the wall structure, top view 300 also includes specific target elements present in the target space, such as single-leaf doors 310 to 316, double-leaf door 318, door 320, standard windows 330 and 332, bay window 340, and floor-to-ceiling window 350. Outline drawing 400 does not fully reflect these specific target elements.

[0046] The terminal device 110 determines (204) distribution characteristics of specific target elements in the target space based on the captured image of the target space. The captured image of the target space can be, for example, a model map of the target space, which can be used to identify the specific target elements in the target space and their positions in the corresponding walls.

[0047] In some embodiments, the terminal device 110 may identify a semantic model of a specific target element based on semantic segmentation from the bird's-eye view 300 of the target space, and then modify the contour map 400 based on the semantic model.

[0048] In some embodiments, the distribution characteristics of a specific target element may include, but are not limited to, the positions of doors and windows of the target space in corresponding walls, the opening direction of the door, and the like.

[0049] Additionally or alternatively, in other embodiments, the distribution features may also include categories of doors and windows, including but not limited to ordinary walls, glass walls, fences, virtual walls, ordinary windows, ordinary bay windows, floor-to-ceiling windows, floor-to-ceiling bay windows, single doors, double doors, sliding doors, folding doors, doorways, etc.

[0050] The terminal device 110 generates (206) a floor plan of the target space based on the outline image and the distribution characteristics of the specific target elements. The generated floor plan can be, for example, a vector floor plan. In some embodiments, the terminal device 110 can add the specific target elements to the outline image 400 based on the distribution characteristics. Figure 5A A schematic diagram of an exemplary floor plan 500 of a target space according to some embodiments of the present disclosure is shown. As shown in FIG5 , compared to the outline diagram 400 , single doors 510 to 516 , a double door 518 , a door 520 , standard windows 530 and 532 , a bay window 540 , and a floor-to-ceiling window 550 have been added to the corresponding locations in floor plan 500 .

[0051] In some cases, the contour map may not accurately reflect the specific target element. For example, the contour map may depict a double door as a single door, i.e., the specific target element is incorrectly categorized. Additionally or alternatively, in some embodiments, the terminal device 110 may modify the specific target element on the contour map 400 based on the distribution characteristics.

[0052] In this way, the corresponding plane layout diagram can be automatically generated during the modeling process of the target space without the need for manual measurement and drawing, thereby improving the efficiency of layout diagram production.

[0053] In some embodiments, the terminal device 110 may send (208) the model identification of the target space and the floor plan associated with the target space to the remote device 130. As an example, the remote device 130 may be a database and may store the floor plan file and the corresponding three-dimensional model data in an associated manner based on the model identification.

[0054] Figure 5B Schematic diagram of floor plan layout data submitted to remote device 130 according to some embodiments of the present disclosure is shown. It should be understood that the data structure shown is only for illustrative purposes, and in actual applications, any other suitable data structure may also be used.

[0055] The terminal device 120 receives (210) a floor plan of the target space from the remote device 130. In some embodiments, the terminal device 120 may review (212) the floor plan based on predetermined rules.

[0056] In some embodiments, the predetermined rules may include, but are not limited to, at least one of the following:

[0057] Whether the degree of overlap between the floor plan and the top view of the target space reaches the predetermined ratio,

[0058] Whether the matching degree between the floor plan and the auxiliary information of the target space meets the threshold, for example, the error between the floor area of ​​the apartment and the area of ​​the auxiliary business data cannot exceed 30%, etc.

[0059] The degree of closure of the floor plan, for example, whether the floor plan is closed.

[0060] Whether the distribution characteristics of specific target elements in the floor plan meet specific standards, for example, whether each room has at least one door, whether the outermost wall structure has at least one door (e.g., an entrance door), etc.

[0061] In some embodiments, terminal device 120 can utilize a machine learning model to identify defects or issues in a floor plan to be reviewed. The machine learning model can be trained using, for example, a training dataset comprising review rules and historical review results. The embodiments of the present disclosure are applicable to any type of machine learning model, training method, and training dataset and are therefore not limited in this respect.

[0062] In some embodiments, the terminal device 120 presents (214) a layout diagram to be reviewed of the target space based on the floor plan and the model data of the target space, where the layout diagram to be reviewed is generated by superimposing the floor plan and the model data. Figure 6 A schematic diagram of a user interface (UI) 600 for processing a floor plan according to some embodiments of the present disclosure is shown. The UI 600 includes a target element control 610, an operation bar 620, a floor plan presentation area 630 for review, an information presentation area 640, a preliminary result presentation area 650, and a review result area 660.

[0063] It should be understood that the UI layout and interaction shown are merely illustrative, and a variety of interface designs and interaction methods are possible. In addition, the controls included in user interface 600 can be implemented using any currently known or future developed UI elements and technologies. Furthermore, the type, form, operation mode, layout, and arrangement of these controls in the UI are all illustrative and are not intended to limit the scope of this disclosure in any way.

[0064] like Figure 6As shown, the floor plan to be reviewed is generated by superimposing the floor plan 500 and the top view 300 of the target space. The terminal device 120 can also present auxiliary information on the floor plan to be reviewed. The auxiliary information can be obtained, for example, from the remote device 130. The auxiliary information can indicate at least one of the following: the total area of ​​the target space, the name of each subspace in the target space, and the corresponding area. Figure 6 In the example, each room in the floor plan to be reviewed is presented with the corresponding functional room name and corresponding area.

[0065] The information presentation area 640 can be used to present information about the target space. The preliminary result presentation area 650 can be used to present the preliminary review results of the floor plan by the terminal device 120 based on predetermined rules. This information can be used to assist in the manual review of the floor plan. Figure 6 In the example of FIG, the terminal device 120 automatically identifies based on a predetermined rule that the overlap between the floor plan and the top view 632 of the target space does not reach a predetermined ratio. Accordingly, a preliminary review result indicating this defect is presented in the preliminary result presentation area 650.

[0066] In some embodiments, the user 124 may activate at least one of the target element controls 610 to add a corresponding target element to the floor plan to be reviewed.

[0067] In some embodiments, the user 124 can perform corresponding operations on the presented floor plan by activating one or more controls in the operation bar 620, including but not limited to saving, searching the gallery, undoing, restoring, selecting, clearing, moving, displaying, setting, uploading, etc.

[0068] Audit result area 660 includes controls 662 to 666. After completing the audit, user 124 can submit the audit result by activating the corresponding controls. In some embodiments, if the audit for the floor plan is qualified, terminal device 120 can receive user input to "audit qualified" control 662. On the contrary, if the audit for the floor plan is unqualified, terminal device 120 can receive user input to "audit unqualified" control 664. In this case, user 124 can also input the reason for the unqualified audit by activating control 666 to promote the modification and update of the floor plan.

[0069] The terminal device 120 sends (216) the audit result for the floor plan to the remote device 130. After receiving the audit result, the remote device 130 may store the audit result in association with the model data and the floor plan (218). For illustrative purposes, Table 1 shows an exemplary storage format for the floor plan. Of course, other data storage formats may also be used in actual applications, and the embodiments of the present disclosure are not limited in this respect.

[0070] Table 1 - Floor plan storage format

[0071]

[0072] In some embodiments, the terminal device 110 may obtain (220) an audit result for the floor plan from the remote device 130. The terminal device 110 may present (222) the audit result. If the audit fails, the terminal device 110 may also present an indication of the audit failure, for example, a defect or problem in the floor plan. Then, manual modifications may be made, and the terminal device 110 may submit the modified floor plan to the remote device 130 for re-audit. The audit operation may refer to actions 208 to 214, and thus will not be described in detail here.

[0073] It should be understood that the actions indicated by dashed lines in process 200 are optional actions, and process 200 may include Figure 2 In addition, the execution order of each action in process 200 is only exemplary. In actual applications, different execution orders can be adopted, and the scope of this disclosure is not limited in this respect.

[0074] According to some embodiments of the present disclosure, a scheme for generating and reviewing floor plan drawings is provided. The scheme can automatically generate floor plan drawings based on semantic segmentation and layout algorithms (e.g., three-dimensional apartment type algorithms). For example, a floor plan drawing is generated by a layout algorithm, and when a rendering operation is performed, a semantic model is identified based on a top view, and the floor plan drawing is corrected based on the semantic model. In addition, the generated floor plan drawings can be reviewed based on specific rules. For example, in a house modeling scenario, it can be reviewed whether the apartment plan drawings are closed-loop and whether each room has a door. If so, it indicates that the generated apartment plan drawings are accurate. If it is found that the regulations are not met, for example, some rooms do not have doors, an indication of unqualified review can be generated and returned for modification.

[0075] Figure 7 FIG2 is a flowchart of a process 700 for generating a floor plan according to some embodiments of the present disclosure. The process 700 may be implemented at the terminal device 110, or may be implemented at any suitable device. Figure 1The process 700 is described with reference to the environment 100 of FIG.

[0076] In block 710 , the terminal device 110 generates an outline map of the target space based on the model data of the target space and semantic information associated with the layout of the target space. In some embodiments, the model data includes at least a top view of the target space.

[0077] In some embodiments, the semantic information at least indicates the distribution of walls in the target space. Taking a house modeling scenario as an example, the semantic information can be determined, for example, using a three-dimensional house type algorithm. In other scenarios, other appropriate algorithms may also be used, and the embodiments of the present disclosure are not limited in this respect.

[0078] In block 720 , the terminal device 110 determines distribution characteristics of specific target elements in the target space based on the captured image of the target space. The image of the target space may be, for example, a model map of the target space.

[0079] In some embodiments, the specific target element includes at least one of the following: a door, a window.

[0080] In some embodiments, the distribution characteristics of a specific target element may include at least one of the following: the position of a door or window in a corresponding wall of the target space, and the opening direction of the door.

[0081] In block 730, the terminal device 110 generates a floor plan of the target space based on the outline map and the distribution characteristics of the specific target elements. In some embodiments, the terminal device 110 may add the specific target elements to the outline map based on the distribution characteristics. Additionally or alternatively, the terminal device 110 may modify the specific target elements in the outline map based on the distribution characteristics.

[0082] In some embodiments, the terminal device 110 may send the model identification of the target space and the floor plan in association to the remote device 130. In this way, the terminal device 120 may obtain the floor plan from the remote device 130 and review it based on predetermined rules.

[0083] In the above embodiment, if the terminal device 110 receives an indication that the floor plan has failed the review, the terminal device 110 may modify the floor plan based on the defects or problems in the floor plan and resubmit it for review.

[0084] According to some embodiments of the present disclosure, a solution for generating a floor plan layout diagram is provided. This solution can automatically generate a corresponding floor plan layout diagram by utilizing model data of a three-dimensional spatial model and combining it with semantic segmentation. This approach can save labor and time costs and improve the efficiency of layout diagram production.

[0085] Figure 8FIG1 is a flow chart showing a process 800 for processing a floor plan according to some embodiments of the present disclosure. The process 800 may be implemented at the terminal device 120, or may be implemented at any suitable device. For ease of discussion, reference will be made to FIG1. Figure 1 The process 800 is described with reference to the environment 100 of FIG.

[0086] In block 810, the terminal device 120 receives a floor plan of the target space from the remote device 130. In some embodiments, the floor plan of the target space is automatically generated by the terminal device 110 based on model data of the target space.

[0087] In block 820, the terminal device 120 presents a layout diagram of the target space to be reviewed based on the floor plan and the model data of the target space. The layout diagram to be reviewed is generated by superimposing the floor plan and the model data.

[0088] In some embodiments, the terminal device 120 may present auxiliary information on the layout diagram to be reviewed. The auxiliary information may indicate at least one of the following: the total area of ​​the target space, the name of each subspace in the target space, and the corresponding area.

[0089] The model data of the target space may include, for example, a top view of the target space. In such an embodiment, the terminal device 120 may assist in reviewing the floor plan based on at least one of the following: the degree of overlap between the floor plan and the top view, the degree of matching between the floor plan and auxiliary information of the target space, the degree of closure of the floor plan, the distribution characteristics of specific target elements in the floor plan, etc. In some embodiments, the specific target element may include at least one of a door and a window.

[0090] In block 830, the terminal device 120 sends the audit result for the floor plan to the remote device 130. In some embodiments, the terminal device 120 may identify whether there are defects in the floor plan based on predetermined rules and generate an audit result accordingly.

[0091] Additionally or alternatively, in some embodiments, the user 124 may perform an audit based on the result of automatic recognition by the terminal device 120 .

[0092] According to some embodiments of the present disclosure, a solution for processing floor plans is provided, which can identify whether there are defects in floor plans based on predetermined rules, thereby saving manual review costs and improving floor plan production efficiency.

[0093] Figure 91 shows a schematic structural block diagram of an apparatus 900 for generating a floor plan according to certain embodiments of the present disclosure. The apparatus 900 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 900 may be implemented by hardware, software, firmware, or any combination thereof.

[0094] As shown in the figure, the device 900 includes: a contour map generation module 910, which is configured to generate a contour map of the target space based on the model data of the target space and semantic information associated with the layout of the target space; a feature determination module 920, which is configured to determine the distribution characteristics of specific target elements in the target space based on the captured image of the target space; and a layout map generation module 930, which is configured to generate a planar layout map of the target space based on the contour map and the distribution characteristics of the specific target elements.

[0095] In some embodiments, the semantic information at least indicates the distribution of walls in the target space.

[0096] In some embodiments, the specific target element includes at least one of the following: a door, a window.

[0097] In some embodiments, the model data includes at least a top view of the target space.

[0098] In some embodiments, the distribution feature includes at least one of the following: the location of the doors and windows of the target space in the corresponding walls, and the opening direction of the doors.

[0099] In some embodiments, the layout diagram generating module 930 includes: an element adding module configured to add specific target elements to the outline diagram based on the distribution characteristics.

[0100] In some embodiments, the apparatus 900 further includes: a first sending module configured to send the model identification of the target space and the floor plan in association with each other to a remote device.

[0101] Figure 10 1 shows a schematic structural block diagram of an apparatus 1000 for processing a floor plan according to certain embodiments of the present disclosure. The apparatus 1000 may be implemented as or included in a terminal device 120. Each module / component in the apparatus 1000 may be implemented by hardware, software, firmware, or any combination thereof.

[0102] As shown in the figure, the device 1000 includes: a receiving module 1010, configured to receive a floor plan of a target space from a remote device; a presenting module 1020, configured to present a layout diagram to be reviewed of the target space based on the floor plan and the model data of the target space, wherein the layout diagram to be reviewed is generated by superimposing the floor plan and the model data; and a second sending module 1030, configured to send the review result of the floor plan to the remote device.

[0103] In some embodiments, the presentation module 1020 includes: an information presentation module configured to present auxiliary information on the layout diagram to be reviewed, the auxiliary information indicating at least one of the following: the total area of ​​the target space, the name of each subspace in the target space and the corresponding area.

[0104] In some embodiments, the model data of the target space includes at least a top view of the target space, and the device 1000 also includes: an audit module, configured to assist in the audit of the floor plan based on at least one of the following: the degree of overlap between the floor plan and the top view, the degree of matching between the floor plan and the feature information of the target space, the degree of closure of the floor plan, and the distribution characteristics of specific target elements in the floor plan.

[0105] In some embodiments, the specific target element includes at least one of the following: a door, a window.

[0106] Figure 11 1 shows a block diagram illustrating an electronic device 1100 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 11 The illustrated electronic device 1100 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 11 The electronic device 1100 shown can be used to implement Figure 1 terminal device 110 or 120, or remote device 130.

[0107] like Figure 11 As shown, electronic device 1100 is in the form of a general electronic device. Components of electronic device 1100 may include, but are not limited to, one or more processors or processing units 1110, memory 1120, storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. Processing unit 1110 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 1120. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of electronic device 1100.

[0108] The electronic device 1100 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1120 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1130 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 1100.

[0109] The electronic device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 11 As shown in FIG, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 1120 may include a computer program product 1125 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0110] The communication unit 1140 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 1100 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 1100 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0111] Input device 1150 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 1160 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 1100 may also communicate with one or more external devices (not shown) via communication unit 1140 as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with electronic device 1100, or with any device that allows electronic device 1100 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0112] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0113] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0114] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0115] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0116] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0117] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating a floor plan, comprising: generating a contour map of the target space using a three-dimensional apartment layout algorithm based on model data of the target space and semantic information associated with the layout of the target space, wherein the semantic information at least indicates the distribution of walls in the target space; determining, based on the captured image of the target space, distribution characteristics of specific target elements in the target space, wherein the specific target element includes at least one of a door or a window, the distribution characteristics include at least a category of the specific target element, and the image includes a model map of the target space, the model map being used to identify the specific target element in the target space and a position of the specific target element in a corresponding wall; and generating a planar layout diagram of the target space based on the contour map and the distribution characteristics of the specific target elements, Determining the distribution characteristics of specific target elements in the target space includes: Identifying a semantic model of the specific target element from the overhead view of the target space based on semantic segmentation, thereby determining the distribution characteristics of the specific target element; Generating the plan layout diagram of the target space includes: modifying the contour map based on the distribution characteristics of the specific target element; and The corrected outline diagram is determined as the plane layout diagram. The method according to claim 1 , wherein the model data comprises at least the top view of the target space.

3. The method according to claim 1, wherein the distribution characteristics further include at least one of the following: The positions of the doors and windows of the target space in the corresponding walls, and the opening directions of the doors.

4. The method according to claim 1, wherein generating the floor plan of the target space comprises: Based on the distribution characteristics, the specific target element is added to the contour map.

5. The method according to claim 1, further comprising: The model identifier of the target space and the floor plan are sent to a remote device in an associated manner.

6. A device for generating a floor plan, comprising: a contour map generating module configured to generate a contour map of the target space using a three-dimensional apartment layout algorithm based on model data of the target space and semantic information associated with the layout of the target space, wherein the semantic information at least indicates the distribution of walls in the target space; a feature determination module configured to determine, based on a captured image of the target space, distribution features of specific target elements in the target space, wherein the specific target element includes at least one of a door or a window, the distribution features include at least a category of the specific target element, the image includes a model map of the target space, the model map is used to identify the specific target element in the target space and the position of the specific target element in the corresponding wall, wherein determining the distribution features of the specific target element in the target space includes: identifying a semantic model of the specific target element from a top view of the target space based on semantic segmentation, thereby determining the distribution features of the specific target element; and A layout diagram generation module is configured to generate a plan layout diagram of the target space based on the contour diagram and the distribution characteristics of the specific target elements, wherein generating the plan layout diagram of the target space includes: correcting the contour diagram based on the distribution characteristics of the specific target elements; and determining the corrected contour diagram as the plan layout diagram. The apparatus according to claim 6 , wherein the model data comprises at least the top view of the target space.

8. The apparatus according to claim 6, wherein the distribution characteristics include at least one of the following: The positions of the doors and windows of the target space in the corresponding walls, and the opening directions of the doors.

9. The apparatus according to claim 6, wherein the apparatus further comprises: The first sending module is configured to send the model identifier of the target space and the floor plan in association to a remote device.

10. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 5 when executed by the at least one processing unit.

11. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images