A virtual house design and decoration method, system, device and storage medium

Abstract

The application discloses a virtual house design and decoration method, system and device and a storage medium. The virtual house design and decoration method comprises the following steps: creating a house interior VR model, and specifying a region to be designed in the VR model; obtaining design element voice information, and identifying the design element voice information as design element keywords through a first AI program; forming design elements from the design element keywords through a second AI program; and rendering the design elements on the region to be designed to form design element rendering images, and combining the design element rendering images with a virtual design model obtained by superimposing the VR model, so that the user can see the rendering house design effect through VR, the whole house intelligent decoration design is realized, and economic losses caused by designer drawings are avoided.

Description

Technical Field

[0001] This invention relates to the field of virtual reality image processing technology, and in particular to a method, system, device and storage medium for virtual house design and decoration. Background Technology

[0002] Currently, before home renovation, most people consult with designers to design the interior. Designers provide design drawings and adjust the style and various design elements, such as wall colors, murals, and materials. However, the design drawings provided by designers are mostly flat or static images from a single angle, which do not allow users to intuitively experience the overall design of the entire house. Therefore, some designers have started to use VR models to present the results of the renovation design. However, when users receive the VR model and need to modify a certain part of the design, they still have to go through the designer for adjustments, which often takes a lot of time and prevents users from deeply participating in the home renovation design process.

[0003] Taking the living room wall as an example, murals are commonly used for decoration. The design and main interaction with the computer involve selecting the mural image using a mouse, keyboard, and monitor, and then designing it using drawing software (such as Photoshop) and dragging it onto the room wall. If you are not satisfied with the mural image and need to change it, you have to find a new image and go through the wall painting process again, which is quite complicated.

[0004] Therefore, there is a need for a method that allows for a direct understanding of the overall design of a house and facilitates quick modifications to design elements. Summary of the Invention

[0005] Based on this, it is necessary to address the problems mentioned in the background technology by providing a virtual house design and decoration method, system, equipment, and storage medium. By combining virtual reality (VR) technology and artificial intelligence (AI) technology, the interior decoration design of a house can be generated quickly. Users can see the rendered house design effect in VR, avoiding economic losses caused by the difference between the designer's design renderings and the actual decoration.

[0006] To address the aforementioned technical problems, the first aspect of this application proposes a virtual house decoration design method, comprising:

[0007] Create a VR model of the house's interior, and specify the areas to be designed within the VR model;

[0008] Acquire the voice information of design elements, and process it through the first AI program to identify the voice information of design elements as keywords of design elements;

[0009] The second AI program transforms design element keywords into design elements;

[0010] The design elements are rendered on the area to be designed to form a design element rendering image, which is then combined with the VR model to form a virtual design model.

[0011] Furthermore, the steps for specifying the area to be designed include:

[0012] Determine the scope of the first preset area;

[0013] The second preset area is determined within the first preset area based on the wall surface requirements information provided by the user.

[0014] Define the wall surface to be designed within the second preset area.

[0015] Furthermore, the step of determining the range of the first preset area includes:

[0016] Obtain design label information, which includes label information for the area to be designed and label information for non-design areas;

[0017] The first preset area range is determined in the VR model of the house based on the design label information.

[0018] Furthermore, the step of determining the area to be designed within the second preset area includes:

[0019] Determine whether there are traces within the second preset area;

[0020] If there are traces within the second preset area, then it is determined as the area to be designed;

[0021] If there are no traces within the second preset area, then the second preset area is redefined.

[0022] Furthermore, the first AI program includes a natural language processing program, and the second AI program includes the DAIl-E Mini model.

[0023] Furthermore, the step of rendering design elements on the area to be designed also includes:

[0024] Determine if the rendered image of a design element is larger than expected;

[0025] If the rendered image of a design element is larger than expected, then confirm the design element.

[0026] If the rendered image of a design element is less than expected, the voice information of the design element should be retrieved again.

[0027] Furthermore, "further" includes:

[0028] Convert VR models and virtual design models into AR models;

[0029] Set up location points to be identified in the AR model;

[0030] Acquire images of the interior of the physical house and match them with the identified positioning points in the AR model. If the match is successful, overlay the AR model onto the image of the interior of the physical house.

[0031] The second aspect of this application proposes a house mural design system, comprising:

[0032] The "Design Area Specifying" module is used to specify the area to be designed in the VR model of the building's interior.

[0033] The speech recognition module is used to acquire the speech information of design elements and convert the speech information of design elements into keywords of design elements;

[0034] The design element generation module is used to generate design elements based on design element keywords.

[0035] The rendering module renders and displays design elements in the VR model on the area to be designed.

[0036] A third aspect of this application provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the method described above.

[0037] The fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described above.

[0038] In the virtual house design and decoration method, system, device and storage medium provided in the above embodiments, a VR house model is created to determine the area to be designed, and design element keywords are obtained through voice recognition. Then, the design element keywords are combined into design elements through an AI program, and the design elements are superimposed and rendered onto the area to be designed in the VR model. In this way, design elements can be adjusted or created through voice, making it easier to understand the state of the house interior decoration more intuitively.

[0039] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, the preferred embodiments of the present invention are described in detail below. Detailed Implementation

[0040] To facilitate understanding of this application, a more complete description will be provided below. However, this application can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the disclosure of this application.

[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the specification of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0042] One embodiment of this application provides a virtual house design and decoration method, which includes the following steps:

[0043] S01: Create a VR model of the house interior and specify the area to be designed in the VR model;

[0044] S02: Obtain the voice information of design elements, and process it through the first AI program to identify the voice information of design elements as keywords of design elements;

[0045] S03: Use the second AI program to transform design element keywords into design elements;

[0046] S04: Render the design elements on the area to be designed to form a design element rendering image, and then overlay and combine it with the VR model to form a virtual design model.

[0047] Furthermore, it can also include S05: after combining with the VR model to form a virtual design model, convert the VR model into an AR model, set the identification positioning points in the AR model; acquire the image inside the physical house and match it with the identification positioning points in the AR model; if the match is successful, overlay the AR model onto the image inside the physical house.

[0048] Steps S01-S04 in the above house design method can also be applied to the terminal. The terminal can be, but is not limited to, various personal computers, laptops, smartphones, tablets and portable wearable devices. S05 can be combined with a smartphone or tablet. The first AI program and the second AI program can be installed in the back-end server. The back-end server can be implemented by an independent server or a server cluster composed of multiple servers.

[0049] In the first embodiment, the area to be designed can be a wall, and the number of walls is not unique; there can be multiple walls, and the mural images to be designed for multiple walls can be different from each other. By using artificial intelligence (AI) technology and virtual reality (VR) technology, multiple walls to be designed and their corresponding mural images can be rendered quickly and efficiently to obtain the overall house mural design effect, effectively saving economic costs.

[0050] Specifically, users can describe design elements via voice. For example, a user might say they want a mural of a red fox in a Monet painting or a sunset on a beach. The first AI program (natural language processing program) first recognizes the speech content and extracts design element keywords, such as red, fox, and Monet. These design element keywords are then sent to the second AI program, which may include a DAI1-E Mini model. The second AI program uses the design element keywords to search for multiple murals or synthesizes them automatically. Users can then select their favorite mural from the pool of murals and render it onto the design area within the VR model for display.

[0051] In addition, the area to be designed is not limited to walls, but can also be the ground or a specific area in the room. Through voice recognition, you can say things like European-style dining table, 78-inch LCD TV, wall clock with petal design, etc. Then, the first AI program identifies the keywords of the design elements, and the second AI program obtains the graphics or patterns of the design elements, which are then superimposed on the VR model.

[0052] Furthermore, in the first embodiment, the following steps are also included:

[0053] Step S11: Determine the range of the first preset area;

[0054] Step S12: Determine the second preset area range within the first preset area range based on the design requirements information provided by the user;

[0055] Step S13: Determine the area to be designed within the second preset area.

[0056] Specifically, the first preset area is the walls inside the house that have label information. These labeled walls include walls the user wants to design or walls with specific usage meanings. In step S12, walls within the first preset area that meet the user's wall requirement information are identified. These walls constitute the second preset area. The first preset area may include the second preset area, or it may not include the second preset area. The first and second preset areas may overlap. The number of walls within the first preset area is greater than or equal to the number of walls within the second preset area, or the number of walls within the first preset area is less than the number of walls within the second preset area.

[0057] As an example, the wall surface requirements provided by the user are the scope of the mural to be painted, as described by the designer or homeowner, such as the entire wall surface of the whole house, the entire children's room, or a specific number of walls and ceilings in the children's room, etc. There are no restrictions on this; the user can modify it according to their needs.

[0058] Furthermore, in the first embodiment, step S11: determining the range of the first preset region includes the following steps:

[0059] Step S111: Obtain design label information, which includes label information for the area to be designed and label information for non-design areas;

[0060] Step S112: Determine the first preset area range in the house VR model according to the design tag information.

[0061] Specifically, in step S111, the entire house is projected in 3D to obtain its internal structure, thereby acquiring information about each wall. The user uses the VR model to label the walls, obtaining design label information for each wall. The label information for the area to be designed indicates the wall to be designed with murals, while the label information for the non-design area indicates the wall not to be designed with murals. In step S112, in the house VR model, walls can be selected based on the label information for the area to be designed. All walls with the label information for the area to be designed form a first preset area.

[0062] In addition, step S13: Determine the area to be designed within the second preset area, including the following steps:

[0063] Step S131: Determine whether there are traces within the second preset area;

[0064] Step S132: If there are traces within the second preset area, then it is determined to be the area to be designed;

[0065] Step S133: If there are no traces within the second preset area, then redetermine the range of the second preset area.

[0066] In one embodiment, step S04, which involves rendering design elements on the area to be designed to form a design element rendering image and then overlaying it with a VR model to create a virtual design model, further includes the following steps:

[0067] Step S41: Determine whether the rendered image of the design element is larger than expected;

[0068] Step S42: If the rendered image of the design element is larger than expected, then confirm the design element;

[0069] Step S43: If the rendered image of the design element is less than expected, then reacquire the voice information of the design element.

[0070] Specifically, users can directly view the illustrations of house design elements to get an overall view of the house's design and determine if it meets their expectations. If it does not meet their expectations, the audio information of the design elements is retrieved again, or the design elements are regenerated, or the images of the design elements corresponding to the area to be designed are adjusted, rearranged, and rendered to obtain a rendered image of the design elements.

[0071] In addition, it should be noted that in step S05 above, after combining with the VR model to form a virtual design model, the VR model can be further converted into an AR model, and identification positioning points can be set in the AR model. When the user is actually inside the house, he can take a video or photo of the house with his mobile terminal. After the program identifies the AR positioning points, the AR model is superimposed on the image inside the real house, so that he can more intuitively understand the decoration design inside the actual house.

[0072] In another embodiment of this application, a house mural design system is also provided, including: a module for specifying the area to be designed, a voice recognition module, a design element generation module, and a rendering module; wherein,

[0073] The "Design Area Specify" module is used to create a VR model of the house to determine the walls to be designed.

[0074] The speech recognition module is used to acquire the speech information of design elements and process it through the first AI program preset in the back-end server to form keywords of design elements.

[0075] The design element generation module is used to generate design elements based on design element keywords. Then, the second AI program in the backend server searches for or synthesizes design elements based on design element keywords.

[0076] The rendering module controls the backend server to render and display the design elements in the VR model within the area to be designed.

[0077] Specific limitations regarding the virtual house decoration and design system can be found in the limitations on virtual house design and decoration methods described above, and will not be repeated here. Each module in the aforementioned virtual house decoration and design system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.

[0078] In another embodiment, a computer device is provided, which may be a server. The computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database stores design data for house murals. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements a virtual house design and decoration method.

[0079] Those skilled in the art will understand that the above content is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than described above, or combine certain components, or have different component arrangements.

[0080] In another embodiment of this application, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the above-described virtual house design and decoration method.

[0081] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0082] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0083] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A virtual house design and decoration method, characterized in that, include: Create a VR model of the house's interior, and specify the area to be designed within the VR model; The step of specifying the area to be designed includes: determining a first preset area range; determining a second preset area range within the first preset area range based on design requirements provided by the user; determining the area to be designed within the second preset area range; the step of determining the area to be designed within the second preset area range includes: determining whether there are traces within the second preset area range; if there are traces within the second preset area range, then determining it as the area to be designed; if there are no traces within the second preset area range, then re-determining the second preset area range; acquiring voice information of design elements, and identifying the voice information of design elements as design element keywords through a first AI program; forming design elements from the design element keywords through a second AI program; rendering the design elements on the area to be designed to form a design element rendering image, and overlaying it with the VR model to form a virtual design model; the step of determining the first preset area range includes: acquiring design tag information, the design tag information including design area tag information and non-design area tag information; determining the first preset area range in the VR model based on the design tag information.

2. The virtual house design and decoration method according to claim 1, characterized in that, The first AI program includes a natural language processing program, and the second AI program includes the DAll-E Mini model.

3. The virtual house design and decoration method according to claim 1, characterized in that, The step of rendering the design element on the area to be designed further includes: determining whether the rendered image of the design element is greater than the expected effect; if the rendered image of the design element is greater than the expected effect, then confirming the design element; if the rendered image of the design element is less than the expected effect, then re-acquiring the voice information of the design element.

4. The virtual house design and decoration method according to claim 1, characterized in that, Further includes: converting the VR model and the virtual design model into an AR model; setting identification positioning points in the AR model; acquiring an image inside a physical house and matching it with the identification positioning points in the AR model; if the match is successful, overlaying the AR model onto the image inside the physical house.

5. A virtual house design and decoration system, employing the virtual house design and decoration method as described in claim 1, characterized in that, include: The "Design Area Specifying" module is used to specify the area to be designed in the VR model of the building's interior. The speech recognition module is used to acquire the speech information of design elements and convert the speech information of design elements into keywords of design elements; The design element generation module is used to generate design elements based on design element keywords. The rendering module renders and displays the design elements in the VR model within the area to be designed.

6. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.