Decoration Progress Monitoring Method, Device, Electronic Device and Storage Medium

By shooting the decoration site by cameras and matching objects with contour recognition technology, the problem of untimely monitoring of decoration progress in the existing technology is solved, automated monitoring and visual progress display are realized, and construction management efficiency and customer control are improved.

CN114140690BActive Publication Date: 2025-06-10DEFORMED BUILDING BLOCKS (SHANGHAI) TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111466878.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-11-10
Filing Date
2021-12-03
Publication Date
2025-06-10
Estimated Expiration
2041-12-03

AI Technical Summary

Technical Problem

The existing technology is difficult to effectively monitor the renovation progress, resulting in unreasonable construction arrangements and customers are unable to understand the progress in a timely manner, which affects cost control.

Method used

By calling the camera to shoot the decoration site, the contour recognition technology is used to divide objects, and the objects are matched into a pre-established interior design model, highlighting the completed material model, and monitoring the decoration progress in real time.

Benefits of technology

It has realized automatic monitoring of the progress of the decoration project, provided visual progress display, and helped the construction party to arrange construction reasonably, so that customers can timely understand the progress and control expenses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114140690B_ABST
    Figure CN114140690B_ABST
Patent Text Reader

Abstract

An embodiment of the present application provides a decoration monitoring method, device, electronic device, and storage medium. The monitoring method takes pictures of the on-site decoration environment by calling a camera to obtain images; uses contour recognition to divide the objects in the images into multiple objects; matches each object with a style model in the material model respectively. If the match is consistent, the material model is prominently displayed in the interior design model, where the material model is a material model in the interior design model established in advance corresponding to the on-site environment; the prominently displayed material model indicates that the construction of the material model is completed, and the decoration project progress can be automatically known and visualized. The decoration party can reasonably arrange the decoration construction, and the customer can timely understand the decoration progress and control the cost expenditure of the decoration company.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of computer-aided design, and in particular, to a method, device, electronic device, and storage medium for monitoring the decoration progress. Background Art

[0002] Home decoration design is a very time-consuming and laborious task. A qualified design plan usually takes designers several hours or even days to design. With the continuous progress of computer and network technologies, the design tools on the computer side are constantly being optimized, but the design efficiency of manpower is still relatively low. Especially when performing some relatively similar repetitive design tasks, the demand for automatic home decoration design is becoming stronger and stronger.

[0003] Manage and control the construction progress of decoration projects to ensure the efficient completion of project construction goals. The construction progress control of decoration projects is one of the core tasks of the project, which is directly related to the construction benefits of the project. Due to the inability to timely understand the decoration progress, it is impossible to reasonably arrange the decoration construction, and customers cannot timely understand the decoration progress and cannot control the cost expenditure of the decoration company. Summary of the Invention

[0004] Embodiments of the present application provide a method, device, electronic device, and storage medium for monitoring the decoration progress, which can automatically obtain the decoration project progress and visualize it.

[0005] In a first aspect, embodiments of the present application provide a decoration monitoring method, and the monitoring method includes:

[0006] Call a camera to take a photo of the on-site decoration environment to obtain an image;

[0007] Use contour recognition to divide the objects in the image into multiple objects;

[0008] Match each object with the style model in the material model respectively. If the match is consistent, highlight the material model in the interior design model. The material model is a material model in the interior design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed.

[0009] As a possible implementation manner of the present application, the step of calling a camera to take a photo of the on-site decoration environment to obtain an image includes

[0010] Obtain the position information of the image during the photo-taking process, and determine the corresponding interior design model through the position information.

[0011] As a possible implementation manner of the present application, the indoor design model is configured with identification information, and the commissioning user is found according to the identification information of the indoor design model, and then the construction location information is found.

[0012] As a possible implementation manner of the present application, after using contour recognition to divide an object in an image into multiple objects, the position of the object in the house is determined by the position of the object in the image.

[0013] As a possible implementation manner of the present application, the monitoring method further includes recording the shooting time, matching the shooting time with the construction period time corresponding to the matched material model, and judging whether the construction period is delayed, where the construction period time is pre-configured.

[0014] As a possible implementation manner of the present application, the establishment of the indoor design model includes:

[0015] Obtain multiple 2D design drawings;

[0016] Input the 2D design drawings into a pre-established learning model, where the 2D design drawings include markings and dimension information of the house frame structure;

[0017] Through the recognition and learning of the markings and dimension information, an indoor structure model is obtained;

[0018] Display the indoor structure model and material units in different regions on the operation interface;

[0019] Add a certain material unit to the indoor structure model to obtain an indoor design model.

[0020] As a possible implementation manner of the present application, before displaying the material units, prompt the designer to select the scene type, function type, and style type, and after receiving the type selection instruction, display the corresponding material units according to the selected type; or select according to the package type, and the package type includes material units of fixed models, including material units of successful cases designed before.

[0021] In a first aspect, an embodiment of the present application provides a decoration monitoring device, and the device includes:

[0022] An image acquisition module, which calls a camera to take a photo of the on-site decoration environment to obtain an image;

[0023] An image division module, which uses contour recognition to divide an object in an image into multiple objects;

[0024] A matching display module that matches each object with a style model in a material model. If the match is consistent, the material model is highlighted in the indoor design model, where the material model is a material model in a pre-established indoor design model corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed.

[0025] In a third aspect, an embodiment of the present application provides an electronic device, including a memory and a processor. A computer program is stored on the memory, and when the processor executes the program, the method described in any item of the first aspect is implemented.

[0026] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in any item of the first aspect is implemented.

[0027] An embodiment of the present application provides a method, device, electronic device, and storage medium for monitoring boards. The monitoring method takes pictures of the on-site decoration environment by calling a camera to obtain an image; uses contour recognition to divide the objects in the image into multiple objects; matches each object with a style model in a material model. If the match is consistent, the material model is highlighted in the indoor design model, where the material model is a material model in a pre-established indoor design model corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed, and it can automatically obtain the decoration project progress and visualize it.

[0028] It should be understood that the content described in the summary of the invention is not intended to limit the key or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become easily understood through the following description. Brief Description of the Drawings

[0029] In order to more clearly illustrate the technical solutions in one or more embodiments of this specification or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in this specification. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0030] Figure 1 Shows a flowchart of a decoration monitoring method according to an embodiment of the present application;

[0031] Figure 2 Shows a flowchart of a method for pre-establishing an indoor design model according to an embodiment of the present application;

[0032] Figure 3 The figure shows a schematic diagram of a decoration monitoring device according to an embodiment of the present application;

[0033] Figure 4 The figure shows a structural diagram of an electronic device according to an embodiment of the present application. Detailed implementation manners

[0034] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the following will clearly and completely describe the technical solutions in one or more embodiments of this specification in conjunction with the accompanying drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, rather than all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this document.

[0035] Computer Aided Design (CAD) refers to using a computer and its graphic devices to assist designers in their design work. In design, computers are usually used to perform a large number of calculations, analyses, and comparisons on different schemes to determine the optimal scheme; various design information, whether numerical, textual, or graphical, can be stored in the computer's memory or external storage and can be retrieved quickly.

[0036] Existing online design tools are complex to operate. Designers need to spend more time familiarizing themselves with the operation steps and then design the pictures. For this reason, the embodiment of the present application provides a material unit, which includes not only the materials required for interior design but also the materials required for decoration. Designers can complete interior design and generate models by providing a simple drag-and-drop method.

[0037] It should be noted that the description of the embodiments of the present application is only for more clearly explaining the technical solutions of the embodiments of the present application and does not constitute a limitation on the technical solutions provided by the embodiments of the present application.

[0038] Figure 1 The figure shows a flowchart of a decoration monitoring method according to an embodiment of the present application.

[0039] See Figure 1 , the monitoring method includes:

[0040] S20. Invoke a camera to take a photo of the on-site decoration environment to obtain an image;

[0041] S40. Use contour recognition to divide the objects in the image into multiple objects;

[0042] Specifically, object division is performed on the image to segment out each object without identifying what the object is. This division includes foreground segmentation and background segmentation, and mainly uses contour recognition.

[0043] S60. Match each object with the style model in the material model respectively. If the match is consistent, highlight the material model in the indoor design model, where the material model is the material model in the indoor design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of this material model has been completed.

[0044] The embodiment of the present application provides a decoration monitoring method, device, electronic device and storage medium. The monitoring method takes pictures of the on-site decoration environment by calling a camera to obtain an image; uses contour recognition to divide the image into multiple objects; matches each object with the style model in the material model respectively. If the match is consistent, highlight the material model in the indoor design model, where the material model is the material model in the indoor design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of this material model has been completed, which can automatically obtain the decoration project progress and visualize it. The decoration party can reasonably arrange the decoration construction, and the customer can timely understand the decoration progress and control the cost expenditure of the decoration company.

[0045] In some embodiments, taking pictures of the on-site decoration environment by calling a camera to obtain an image includes,

[0046] Obtain the position information of the image during the photographing process, and determine the corresponding indoor design model through the position information. The indoor design model is configured with identification information, and the entrusted user is found according to the identification information of the indoor design model, and then the construction position information is found.

[0047] In some embodiments, after using contour recognition to divide the image into multiple objects, determine the position of the object in the house through the position of the object in the image; match the object with the material model at this position in the design model, which can reduce the matching process; the shooting time can also be recorded, and the shooting time is matched with the construction period time corresponding to the matched material model to judge whether the construction period is delayed, and the construction period time can be configured in advance; the design model after the material model is highlighted is stored in the system, and users logging in to the system can all see it and understand the project progress.

[0048] Figure 2 Shows the flowchart of the method for establishing an indoor design model in the embodiment of the present application, as Figure 2 shown, the method for establishing an indoor design model includes,

[0049] S601. Obtain multiple 2D design drawings;

[0050] S602. Input the 2D design drawing into a pre - established learning model. The 2D design drawing includes markings and dimension information of the house frame structure;

[0051] S603. Through the recognition and learning of the markings and dimension information, obtain an indoor structure model;

[0052] S604. Display the indoor structure model and the material units in different regions on the operation interface;

[0053] S605. Add a certain material unit to the indoor structure model to obtain an indoor design model.

[0054] Specifically, for the indoor structure model and the material units, the material unit is the smallest unit for decoration and design; the material unit can be, for example, floor, wallpaper, table, switch, waterproof coating, etc. The material unit is the smallest unit for decoration and design, such as a piece of floor, a switch, etc.; the material unit includes a unique identifier (such as XX - model floor); type (such as floor, table, switch, etc.); style model (such as style pictures, visual display); dimension parameters, the dimension parameters are adjustable, or fixed and non - adjustable according to the type; color parameters, the color parameters are adjustable, or fixed and non - adjustable according to the type. For the material unit, further editing can also be performed according to the editing instruction, for example, including shape - editing characteristics and color - setting characteristics. The shape - editing characteristic means that operations such as scaling, moving, and stretching can be performed on the material, and the color - setting characteristic means that the color of the material can be set. In the process of establishing the indoor design model, for example, drag a certain material unit into the structure model, and only one material unit is added each time it is dragged; or, fill the relevant area according to the type of the material unit; or, after adding the material unit, confirm whether to continue adding at the adjacent position of the material unit. This embodiment provides multiple implementation methods. Method 1: Only one material unit is added each time it is dragged. Method 2: Automatically fill the relevant area according to the type of the material unit. For example, the floor can fill the entire floor area. Method 3: After dragging once, confirm the addition, and automatically prompt whether to continue adding at the adjacent position, etc. This method can provide a large number of material units for the designer, facilitate the designer to combine materials, save the designer's time for searching materials, and improve the design efficiency. It should be noted that the indoor structure model can also be, for example, a 3D model of the house structure, such as a BIM model;

[0055] Specifically, before displaying the material units, prompt the designer to select the scene type, function type, and style type. After receiving the type - selection instruction, display the corresponding material units according to the selected type; or select according to the package type. The package type includes material units of fixed models, including material units of successful design cases in the past.

[0056] Specifically, the selection according to the package type includes

[0057] selecting n package types with similar proportions and structures according to the house structure and size;

[0058] adapting each material unit type in the selected package type according to the size ratio of the structure model.

[0059] For example, scaling proportionally, aligning and scaling according to the preset reference points, etc. The designer can also make manual adjustments. When filling the entire area, partial display can be made at the edge part, and crop size parameters can be added to the material units at the edge part. Specifically, receive parameter modification instructions for the material units, such as modifying the size and color, etc., and refill the corresponding area with the modified material units.

[0060] Specifically, the method for establishing an interior design model may further include the step of correcting the interior design model, specifically including obtaining accurate data by laser scanning to generate a laser scanning model; correcting the interior design model according to the data in the laser scanning model and modifying the house frame structure data; for example, reading the data at the same position from the laser scanning model and the design model respectively, such as the height at the same position on the same wall; comparing the two data, if they are different, then modifying the data of the design model with the data of the laser scanning model. For the design model after modifying the data, adjust the material units in the design model. For example, modify the position, size, etc. of the material units. Such as refilling the floor and wall surfaces. Adjust the position of the furniture relative to the wall. For example, adding or reducing material units. Such as taking the plane where the floor is located as the horizontal plane, after modifying the data, it is found that the ground is uneven, then there is an idle space between the ground of the house frame and the floor ground, and leveling parts are automatically filled in the idle space. Calculate the quantity and height of the leveling parts according to the area and height of the idle space, and fill the corresponding leveling parts accordingly. Another example is that the plane where the wall paint is located is a vertical plane. After modifying the data, it is found that the wall is not perpendicular, then material units of cement are automatically filled in the space between the wall surface and the paint plane.

[0061] Based on the same inventive concept, an embodiment of the present application also provides a decoration monitoring device, which can be used to implement the decoration monitoring method described in the above embodiments, as described in the following embodiments. Since the principle of the decoration monitoring device for solving problems is similar to that of the decoration monitoring method, the implementation of the decoration monitoring device can refer to the implementation of a decoration monitoring method, and the repeated parts will not be described again. Hereinafter, the term "unit" or "module" may be a combination of software and / or hardware that can achieve a predetermined function. Although the systems described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0062] Figure 3The structural block diagram of the decoration monitoring device according to an embodiment of the present application is shown. As Figure 3 shown, the decoration monitoring device includes:

[0063] An image acquisition module 20, which calls a camera to take pictures of the on-site decoration environment to obtain images;

[0064] An image division module 40, which divides the objects in the image into multiple objects by using contour recognition;

[0065] Specifically, when dividing the objects in the image and segmenting each object, it is not necessary to identify what the object is. This segmentation includes foreground segmentation and background segmentation, and mainly uses contour recognition.

[0066] A matching display module 60, which matches each object with a style model in the material model respectively. If the match is consistent, the material model is highlighted in the interior design model, where the material model is a material model in the interior design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed.

[0067] The embodiment of the present application provides a decoration monitoring method and device. The image acquisition module 20 calls a camera to take pictures of the on-site decoration environment to obtain images; the image division module 40 divides the objects in the image into multiple objects by using contour recognition; the matching display module 60 matches each object with a style model in the material model respectively. If the match is consistent, the material model is highlighted in the interior design model, where the material model is a material model in the interior design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed, which can automatically obtain the decoration project progress and visualize it. The decoration party can reasonably arrange the decoration construction, and the customer can timely understand the decoration progress and control the cost expenditure of the decoration company.

[0068] In some embodiments, calling a camera to take pictures of the on-site decoration environment to obtain images includes

[0069] obtaining the position information of the image during the photographing process, and determining the corresponding interior design model through the position information. The interior design model is configured with identification information, and the entrusted user is found according to the identification information of the interior design model, and then the construction position information is found.

[0070] In some embodiments, after the objects in the image are divided into multiple objects by contour recognition, the positions of the objects in the house are determined according to the positions of the objects in the image; the objects are matched with the material models in the design model at these positions, which can reduce the matching process; the shooting time can also be recorded, and the shooting time is matched with the construction period time corresponding to the matched material model to determine whether the construction period is delayed, and the construction period time can be pre-configured; the design model with the material model highlighted is stored in the system and can be seen by users who log in to the system, so as to understand the project progress.

[0071] An embodiment of the present application also provides a computer electronic device. Figure 4 The structural schematic diagram of the electronic device to which the embodiments of the present application can be applied is shown, as Figure 4 shown, the computer electronic device includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 402 or the program loaded from the storage part 408 into the random access memory (RAM) 403. In the RAM 403, various programs and data required for system operation are also stored. The CPU 401, ROM 402, and RAM 403 are connected to each other through a bus 404. The input / output (I / O) interface 405 is also connected to the bus 404.

[0072] The following components are connected to the I / O interface 405: an input part 406 including a keyboard, a mouse, etc.; an output part 407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage part 408 including a hard disk, etc.; and a communication part 409 including a network interface card such as a LAN card, a modem, etc. The communication part 409 performs communication processing via a network such as the Internet. A driver 410 is also connected to the I / O interface 405 as required. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the driver 410 as required, so that the computer program read from it can be installed into the storage part 408 as required.

[0073] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0074] The units or modules involved in the embodiments described in this application can be implemented in software or in hardware. The described units or modules can also be provided in a processor. For example, it can be described as: a processor includes an image acquisition module, an image partitioning module, and a matching display module. In some cases, the names of these modules do not constitute a limitation on the module itself. For example, the task generation module can also be described as "an image partitioning module that partitions an image into multiple objects using contour recognition".

[0075] As another aspect, this application also provides a computer-readable storage medium. This computer-readable storage medium can be the computer-readable storage medium included in the decoration monitoring device described in the above embodiments; or it can exist separately and be a computer-readable storage medium not assembled into an electronic device. The computer-readable storage medium stores one or more programs, and the one or more programs are used by one or more processors to execute a decoration monitoring method described in this application.

[0076] The above description is only for the preferred embodiments of this application and the explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, technical solutions formed by mutually replacing the above features with (but not limited to) technical features having similar functions disclosed in this application.

Claims

1. A method for monitoring the decoration progress, characterized in that, the monitoring method includes: calling a camera to take pictures of the on-site decoration environment to obtain images; using contour recognition to divide the objects in the images into multiple objects; respectively matching each object with the style models in the material models, and if the match is consistent, highlighting the material models in the interior design model, wherein the material models are the material models in the interior design model established in advance corresponding to the on-site environment; the highlighted material models indicate that the construction of the material models has been completed; the establishment of the interior design model includes: obtaining multiple 2D design drawings; inputting the 2D design drawings into a pre-established learning model, and the 2D design drawings include the markings and dimension information of the house frame structure; obtaining the interior structure model through the recognition and learning of the markings and dimension information; displaying the interior structure model and the material units in different regions on the operation interface; adding a certain material unit to the interior structure model to obtain the interior design model; before displaying the material units, prompting the designer to select the scene type, function type and style type, and after receiving the type selection instruction, displaying the corresponding material units according to the selected type; or selecting according to the package type, and the package type includes the material units of fixed models, including the material units of successful cases designed before.

2. The monitoring method according to claim 1, characterized in that, the step of calling a camera to take pictures of the on-site decoration environment to obtain images includes obtaining the position information of the images during the taking process, and determining the corresponding interior design model through the position information.

3. The monitoring method according to claim 1, characterized in that, the interior design model is configured with identification information, and the entrusted user is found corresponding to the identification information of the interior design model, and then the construction position information is found.

4. The monitoring method according to claim 1, characterized in that, after using contour recognition to divide the objects in the images into multiple objects, determining the positions of the objects in the house through the positions of the objects in the images.

5. The monitoring method according to claim 1, characterized in that, the monitoring method further includes recording the shooting time, matching the shooting time with the construction period time corresponding to the matched material model, and judging whether the construction period is delayed, wherein the construction period time is pre-configured.

6. A decoration monitoring device, characterized in that, The device includes: an image acquisition module that calls a camera to take pictures of the on-site decoration environment to obtain images; an image division module that uses contour recognition to divide the objects in the image into multiple objects; a matching display module that matches each object with a style model in the material model respectively. If the match is consistent, the material model is highlighted in the interior design model, where the material model is a material model in the interior design model established in advance corresponding to the on-site environment; the highlighted material model indicates that the construction of the material model has been completed; the establishment of the interior design model includes: obtaining multiple 2D design drawings; inputting the 2D design drawings into a pre-established learning model, and the 2D design drawings include markings and dimension information of the house frame structure; through the recognition and learning of the markings and dimension information, an interior structure model is obtained; the interior structure model and material units are displayed in different regions on the operation interface; a certain material unit is added to the interior structure model to obtain an interior design model. Before displaying the material units, prompt the designer to select the scene type, function type, and style type. After receiving the type selection instruction, display the corresponding material units according to the selected type; or select according to the package type, and the package type includes material units of fixed models, including material units of successful cases designed previously.

7. An electronic device, including a memory and a processor, with a computer program stored on the memory, characterized in that, when the processor executes the computer program, it implements the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, with a computer program stored thereon, characterized in that, when the computer program is executed by the processor, it implements the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Construction progress visualization method based on BIM model and monitoring image comparison

    CN113360583A