Decoration effect diagram generation method, device, electronic equipment and storage medium

Obtain user information through human-computer dialogue and use artificial intelligence to analyze it, and generate decoration renderings that meet the needs, solving the problems of cumbersome operation, high professional threshold and inconvenient adjustment of decoration renderings in the existing technology, realizing user-friendly decoration Design experience.

CN117095082BActive Publication Date: 2024-11-26KE COM (BEIJING) TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310868527.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-14
Publication Date
2024-11-26
Estimated Expiration
2043-07-14

AI Technical Summary

Technical Problem

In the prior art, the generation of decoration renderings is complicated, the professional threshold is high, and the generation effect is inconvenient, making it difficult for ordinary users to generate satisfactory decoration renderings.

Method used

Through human-computer dialogue, users' room type, decoration trend information, feedback information of historical decoration renderings, decoration description statements and decoration case images are obtained, and decoration element information is analyzed and extracted by pre-trained artificial intelligence models to generate decorations that meet user needs. renderings.

Benefits of technology

It achieves simple operation and low professional threshold. Users can generate satisfactory decoration renderings through simple language descriptions and image selection, reducing the complexity of decoration design.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117095082B_ABST
    Figure CN117095082B_ABST
Patent Text Reader

Abstract

The present disclosure provides a decoration rendering generation method, device, electronic device and storage medium. The decoration rendering generation method of the embodiment of the present disclosure includes: obtaining an original image of a first room; obtaining a room type of the first room set by a user; obtaining decoration element information based on decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by the user and / or decoration case images selected by the user; generating a decoration rendering of the first room according to the decoration element information, the room type of the first room and the original image. The present disclosure has the advantages of simple operation and low professional threshold.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a decoration effect picture generation method, device, electronic equipment and storage medium. Background Art

[0002] In the related art, decoration renderings can be generated by inputting images, but the solutions of the related art still have the following shortcomings and deficiencies: 1) Complicated operation: The existing technology requires users to input detailed decoration requirements, select space, style and other information, and requires multiple adjustments and editing to obtain satisfactory renderings; 2) High professional threshold: The existing technology requires users to have a certain foundation in design and computer technology, which is inconvenient for many ordinary users to use; 3) Inconvenient adjustment of generated effects: The AI ​​renderings generated in the existing technology cannot be modified based on user demands, and adjustment requires certain skills. Summary of the invention

[0003] In order to solve at least one of the above technical problems, the present disclosure provides a decoration effect picture generation method, device, electronic device and storage medium.

[0004] According to one aspect of the present disclosure, a method for generating a decoration effect diagram is provided, comprising:

[0005] Get the original image of the first room;

[0006] Get the room type of the first room set by the user;

[0007] Obtaining previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by users, and / or decoration case images selected by users;

[0008] Acquiring decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements and / or decoration case images;

[0009] A decoration rendering of the first room is generated according to the decoration element information, the room type of the first room and the original image.

[0010] In some possible implementations of the embodiments of the present disclosure, the decoration element information includes information on one or more of the following decoration elements: decoration style, decoration color matching, layout method, and decoration elements.

[0011] In some possible implementations of the embodiments of the present disclosure, the historical decoration renderings include: historical decoration renderings of the first room and / or historical decoration renderings of other rooms of the current user.

[0012] In some possible implementations of the embodiments of the present disclosure, the acquiring of the original image of the first room includes one of the following:

[0013] Guiding the user to select the original image of the first room from the original images uploaded by the user through human-computer dialogue;

[0014] Guiding the user to search a pre-created field survey image database to obtain an original image of the first room through human-computer dialogue;

[0015] The user is guided to upload the original image of the first room through human-computer dialogue.

[0016] In some possible implementations of the disclosed embodiments, guiding the user to search for the original image of the first room in a pre-created field survey image database by means of human-computer dialogue includes:

[0017] guiding the user to trigger the image search interface through human-computer dialogue to provide the image search interface to the user;

[0018] In response to a region keyword input by a user in the image search interface, querying a pre-created field survey image database for apartment type thumbnails corresponding to the region keyword and displaying the thumbnails;

[0019] In response to a user selecting the apartment type thumbnail, querying the actual survey image database for an actual survey image corresponding to the apartment type thumbnail selected by the user and displaying a thumbnail of the actual survey image;

[0020] In response to a user selecting a thumbnail of the field survey image, the corresponding field survey image is determined as an original image of the first room.

[0021] In some possible implementations of the embodiments of the present disclosure, the acquiring of decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements and / or decoration case images includes one of the following:

[0022] Using a pre-trained first artificial intelligence model to perform natural language analysis on the decoration description sentence to determine the user's decoration intention, and generate decoration element information according to the user's decoration intention;

[0023] Using a pre-trained second artificial intelligence model to identify decoration elements of the decoration case image to extract the decoration element information;

[0024] Acquire the historical decoration renderings preferred by the user based on the feedback information of the user on the historical decoration renderings, and identify the decoration elements of the historical decoration renderings preferred by the user to extract the decoration element information;

[0025] The decoration element information is extracted from the decoration trend information.

[0026] In some possible implementations of the embodiments of the present disclosure, the decoration trend information includes information of one or more of the following decoration elements:

[0027] Decoration elements selected and used by users exceeding the first predetermined threshold within the first predetermined period:

[0028] Decoration elements marked as popular by users exceeding a second predetermined threshold within a second predetermined period of time;

[0029] The decoration elements marked as popular by a third party that exceed a third predetermined threshold within a third predetermined time period; wherein the decoration elements include one or more of the following: decoration style, decoration color matching, layout method, and decoration elements.

[0030] In some possible implementations of the embodiments of the present disclosure, the decoration description statement is a natural language description statement guided by the user to input through human-computer dialogue.

[0031] In some possible implementations of the embodiments of the present disclosure, it also includes: when the decoration element information cannot be extracted from the decoration description sentence, a prompt of sentence parsing failure is provided to the user in the form of a dialogue on the current human-computer dialogue interface.

[0032] In some possible implementations of the embodiments of the present disclosure, it also includes: providing a case selection interface to the user in response to a user operation, the case selection interface displaying thumbnails of case images classified by room type; the decoration case image is determined in response to the user's selection operation on the thumbnail of a specific case image on the case selection interface.

[0033] In some possible implementations of the disclosed embodiments, the user's feedback information on the historical decoration renderings is obtained in the following manner:

[0034] Providing preference options in a human-computer dialogue interface including a preview prompt of the historical decoration renderings;

[0035] In response to the user's operation on the preference option, feedback information of the user on the historical decoration rendering is generated.

[0036] In some possible implementations of the embodiments of the present disclosure, obtaining the room type of the first room set by the user includes: guiding the user to trigger a type option pop-up layer or a type option display on the current human-computer dialogue interface through human-computer dialogue; and, in response to the user's selection operation on the type option pop-up layer or a specific type option in the human-computer dialogue interface, generating corresponding room type information and displaying the room type information in the current human-computer dialogue interface in the form of a user reply message.

[0037] In one aspect of the present disclosure, a device for generating a decoration effect diagram is provided, comprising:

[0038] An acquisition unit is used to acquire an original image of the first room, acquire a room type of the first room set by a user; and acquire previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by the user, and / or decoration case images selected by the user;

[0039] An information extraction unit, configured to obtain decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements and / or decoration case images;

[0040] The rendering generation unit is used to generate a decoration rendering of the first room according to the decoration element information, the room type of the first room and the original image.

[0041] According to one aspect of the present disclosure, there is provided an electronic device, including:

[0042] a memory storing execution instructions; and,

[0043] A processor executes the execution instructions stored in the memory, so that the processor executes the above-mentioned decoration effect picture generation method.

[0044] According to one aspect of the present disclosure, a readable storage medium is provided, in which execution instructions are stored. When the execution instructions are executed by a processor, they are used to implement the above-mentioned decoration effect picture generation method.

[0045] According to one aspect of the present disclosure, a computer program product is provided, including a computer program / instruction, wherein the computer program / instruction implements the above-mentioned decoration effect picture generating method when executed by a processor.

[0046] The disclosed embodiment obtains decoration element information by parsing decoration description sentences, decoration case images or feedback information on historical decoration renderings, thereby generating decoration renderings that meet user needs, and can at least achieve the following beneficial effects: 1) Simple operation: Users only need to enter a simple language description, select a case image or click an option to provide feedback on a historical decoration rendering to obtain a satisfactory decoration rendering. 2) Low professional threshold: Users do not need to have a basic knowledge of design and computer technology, and ordinary users can also easily complete the generation of decoration renderings through human-computer dialogue. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0048] Figure 1 It is a flowchart of a decoration effect diagram generating method according to an embodiment of the present disclosure.

[0049] Figure 2 It is an example diagram of an operation process and an interactive interface of a user searching a survey image database for an original image of a first room according to an embodiment of the present disclosure.

[0050] Figure 3 It is an example diagram of the operation process and interactive interface for implementing room type setting through human-computer dialogue according to an embodiment of the present disclosure.

[0051] Figure 4 It is an example diagram of the operation process and interface jump of generating a decoration effect picture by inputting a decoration description sentence according to an embodiment of the present disclosure.

[0052] Figure 5 It is an operational process and an example diagram of interface jump for obtaining a decoration case image and generating a decoration rendering through a case selection interface according to an embodiment of the present disclosure.

[0053] Figure 6 It is an interface for providing guidance prompts and generating new solution options to users through a human-computer dialogue interface and a schematic diagram of the next interface according to an embodiment of the present disclosure.

[0054] Figure 7 This is an example diagram of a device for generating a decoration effect diagram using a hardware implementation of a processing system according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0055] The present disclosure is further described in detail below in conjunction with the accompanying drawings and implementations. It is understood that the specific implementations described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.

[0056] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0057] Unless otherwise specified, the exemplary embodiments / embodiments shown will be understood as providing exemplary features of various details of some ways in which the technical concept of the present disclosure can be implemented in practice. Therefore, unless otherwise specified, the features of the various embodiments / embodiments can be combined, separated, interchanged and / or rearranged without departing from the technical concept of the present disclosure.

[0058] The use of cross-hatching and / or shading in the accompanying drawings is generally used to make the boundaries between adjacent components clear. As such, unless otherwise specified, the presence or absence of cross-hatching or shading does not convey or indicate any preference or requirement for the specific materials, material properties, dimensions, proportions, commonalities between the components shown, and / or any other characteristics, attributes, properties, etc. of the components. In addition, in the accompanying drawings, the sizes and relative sizes of the components may be exaggerated for clarity and / or descriptive purposes. When the exemplary embodiments can be implemented differently, the specific process sequence can be performed in a different order than described. For example, two successively described processes can be performed substantially simultaneously or in an order opposite to the described order. In addition, the same figure numbers represent the same components.

[0059] When a component is referred to as being "on," "over," "connected to," or "coupled to" another component, the component may be directly on, directly connected to, or directly coupled to the other component, or intervening components may be present. However, when a component is referred to as being "directly on," "directly connected to," or "directly coupled to" another component, there are no intervening components. For this purpose, the term "connected" may refer to a physical connection, an electrical connection, etc., with or without intervening components.

[0060] The terms used herein are for the purpose of describing specific embodiments, and are not intended to be restrictive. As used herein, unless the context clearly indicates otherwise, the singular forms "one (kind, person)" and "said (the)" are also intended to include plural forms. In addition, when the terms "comprise" and / or "include" and their variations are used in this specification, it is explained that there are stated features, integral bodies, steps, operations, parts, assemblies and / or their groups, but it is not excluded that there are or add one or more other features, integral bodies, steps, operations, parts, assemblies and / or their groups. It should also be noted that, as used herein, the terms "substantially", "approximately" and other similar terms are used as approximate terms and not as degree terms, so that they are used to explain the inherent deviations of the measured values, calculated values ​​and / or the values ​​provided that will be recognized by those of ordinary skill in the art.

[0061] Terminology explanation:

[0062] First room: any room for which the decoration rendering is to be generated.

[0063] Figure 1 FIG. 1 is a flow chart of a method for generating a decoration effect diagram according to an embodiment of the present disclosure. Figure 1 As shown, the decoration effect picture generating method of the embodiment of the present disclosure may include the following steps S102 to S104:

[0064] Step S102, obtaining an original image of the first room;

[0065] The original image of the first room may be a real shot image of the first room. For example, the original image of the first room may be, but is not limited to: a room photo taken by the user, a real shot photo of a room of the same apartment type in the same community collected by the platform or a third party, a room photo previously uploaded by the user, etc.

[0066] In some implementations, step S102 may include one of the following:

[0067] 1) guiding the user to select the original image of the first room from the original images uploaded by the user through human-computer dialogue;

[0068] 2) guiding the user to search the pre-created field survey image database to obtain the original image of the first room through human-computer dialogue;

[0069] 3) Guide the user to upload the original image of the first room through human-computer dialogue.

[0070] For example, a photo upload option may be provided to the user in a human-computer interaction interface, and in response to a user operation on the photo upload option (e.g., the user selects the option "Try uploading a photo"), a photo upload selection interface may be provided to the user, and a variety of photo upload options may be provided in the photo upload selection interface, such as "Select photos of my home", "Use photos of the same apartment type in the community", "Take a photo", "Select from the album", etc. The user may select "Select photos of my home" to enter the existing photo selection interface that he / she has uploaded previously and select the room photo of the first room. The user may select "Use photos of the same apartment type in the community" to enter the search interface and operate in the search interface to query the pre-created survey image database for survey photos of the same apartment type as the first room and use them as the original image of the first room. The user may also select "Take a photo" to take a photo of the first room in real time and upload it, or select "Select from the camera" to enter the local album selection interface to select a photo from the local album of the user device as the original image of the first room and upload it.

[0071] In some embodiments, guiding the user to search a pre-created survey image database for the original image of the first room through human-computer dialogue may include: guiding the user to trigger an image search interface through human-computer dialogue to provide the user with an image search interface; in response to an area keyword input by the user in the image search interface, querying a pre-created survey image database for apartment type thumbnails corresponding to the area keyword and displaying them; in response to a user's selection operation on an apartment type thumbnail, querying the survey image database for the survey image corresponding to the apartment type thumbnail selected by the user and displaying the thumbnail of the survey image; in response to a user's selection operation on a thumbnail of the survey image, determining the corresponding survey image as the original image of the first room.

[0072] The regional keyword may be, but is not limited to, a community name, a street name, etc. The user may jump to the image search interface by selecting the option "Use photos of the same apartment type in the community" in the photo selection interface.

[0073] In some implementations, after step S102, the following may be included: if the floor plan corresponding to the regional keyword cannot be found in the field survey image database, a search failure prompt may be provided to the user. For example, the search failure prompt may be a prompt such as "there is no community you searched for at the moment" or "there is no floor plan for the community at the moment".

[0074] Figure 2 An example diagram of the operation process and interactive interface of guiding a user to search a survey image database for a survey image to obtain an original image of a first room through human-computer dialogue is shown.

[0075] Step S104, obtaining the room type of the first room set by the user;

[0076] Room types can be flexibly configured according to needs or scenarios. For example, room types can include but are not limited to living room, study, children's room, kitchen, bathroom, bedroom, balcony, etc.

[0077] In some embodiments, in step S104, the user can be guided by the human-computer dialogue to trigger the type option pop-up window or the type option display in the current human-computer dialogue interface; and, in response to the user's selection operation on the type option pop-up window or a specific type option in the human-computer dialogue interface, the corresponding room type information is generated and the holiday type information is displayed in the current human-computer dialogue interface in the form of a user reply message.

[0078] For example, in response to the user's confirmation operation on the original image of the first room in the current human-computer dialogue interface, a variety of room type options can be provided to the user in the form of a dialogue in the current human-computer dialogue interface, such as "living room", "study", "children's room", "kitchen", "bathroom", "bedroom", "balcony" and other options. The user clicks on one of the options (for example, "living room") to automatically complete the room type setting of the first room (for example, setting the purpose of the first room to a living room). Figure 3 The diagram shows an operation process of providing type options through a human-computer dialogue interface to implement room type settings and an example diagram of the interactive interface.

[0079] For another example, if the user has previously designed the first room, he can click "Continue designing using previous pictures" after re-entering the human-computer dialogue interface to continue the design of the first room. At this time, in response to the user's selection operation for options such as "Continue designing using previous pictures", a floating "selection pop-up layer" will pop up in the current human-computer dialogue interface. The pop-up layer provides options for room type (i.e., room purpose), and the user can set the first room to the corresponding room type by clicking one of the options.

[0080] Step S106, obtaining previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by users, and / or decoration case images selected by users;

[0081] It should be noted that the execution order of step S102, step S104 and step S106 is not limited, and they can be executed simultaneously, or step S106 can be executed first, and then steps S102 to S140, or steps S102 to S104 can be executed first before entering step S106. Of course, step S104 can also be executed before step S102, or after step S106, etc. The execution process of steps S102 to S106 corresponds to the user operation, and the embodiment of the present disclosure does not limit this.

[0082] Step S108, acquiring decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements and / or decoration case images;

[0083] In some embodiments, the decoration element information may include, but is not limited to, any one or more of the following decoration elements: decoration style, decoration color matching, layout method, decoration elements, etc. For example, the decoration style may include information such as Nordic style, Chinese style, and Japanese style. The decoration color matching may include black, white, gray, the same color system, contrasting colors, etc. The layout method may include, but is not limited to, reading layout, parallel layout, L-shaped layout, enclosed layout, partition layout, etc. The decoration elements may include, but are not limited to, green plants and flowers, decorative paintings, glass bricks, folding windows, hidden doors, etc. In specific applications, the specific content of the decoration element information can be pre-configured, or it can be flexibly adjusted according to different application scenarios. The specific content of the decoration element information is not limited in the embodiments of the present disclosure.

[0084] The decoration trend information may include, but is not limited to, one or more of the following decoration elements: 1) decoration elements selected and used by users exceeding a first predetermined threshold within a first predetermined period; 2) decoration elements marked as popular by users exceeding a second predetermined threshold within a second predetermined period; 3) decoration elements marked as popular by third parties exceeding a third predetermined threshold within a third predetermined period; wherein the decoration elements include one or more of the following: decoration style, decoration color matching, layout method, decoration elements. Thus, the decoration trend information can be used to indicate the currently popular decoration style, decoration color matching, layout method, decoration elements, etc., and a decoration rendering can be directly generated based on the currently popular decoration elements, so that users can obtain the currently popular decoration rendering without any extra operations.

[0085] In some implementations, decoration trend information can be obtained by regularly counting and analyzing information on new decoration elements provided in real time by third parties such as house designers, house designers, house design platforms, etc.

[0086] In some implementations, the decoration trend information may also be obtained by regularly collecting statistics and analyzing decoration renderings within a certain period of time provided in real time by users or third parties.

[0087] In some implementations, the decoration trend information can also be obtained by regularly collecting statistics and analyzing the marking data of decoration elements or decoration effect pictures fed back in real time by users or third parties.

[0088] The first predetermined time period, the second predetermined time period and the third predetermined time period may be the same or different, and are preferably a time period closer to the current time. The first predetermined threshold, the second predetermined threshold and the third predetermined threshold are all quantity thresholds and can be flexibly set.

[0089] In a specific application, considering that different room types may have different decoration trends, the decoration trend information can be classified according to room types, and in step S106, only the decoration trend information of the room type corresponding to the first room needs to be obtained. It should be noted that the content of the decoration trend information, the acquisition method and other specific details are not limited in this disclosure.

[0090] The decoration description sentence can be a natural language description sentence of any length input by the user and containing various character forms. For example, the decoration description sentence can be a meaningless sentence such as "%¥#@@*", or it can be a natural language description containing decoration elements such as "I want a Nordic style living room".

[0091] In step S108, the pre-trained first artificial intelligence model can be used to perform natural language analysis on the decoration description sentence to determine the user's decoration intention, and generate decoration element information according to the user's decoration intention. For example, the user can activate the input box by clicking on the input box of the current human-computer dialogue interface and enter the decoration description sentence in the input box. In response to the user's "send" operation on the decoration description sentence, the first artificial intelligence model is called to perform natural language analysis on the decoration description sentence to determine the user's decoration intention, and generate decoration element information according to the user's decoration intention.

[0092] In a specific application, the first artificial intelligence model can be trained by a large number of natural description sentences annotated with decoration elements. The first artificial intelligence model can be, but is not limited to, a neural network or any other type.

[0093] For example, the user's decoration intention can be represented by keywords. For example, if the decoration description sentence input by the user is "I want a Nordic style living room", the user's decoration intention determined by natural language analysis can be represented as "Nordic style; living room", and the generated decoration element information can be represented as "Decoration style = Nordic style; decoration color = empty; layout = empty; decoration element = empty".

[0094] Figure 4 An example diagram of an interface update for generating a decoration rendering by inputting a decoration description statement is shown.

[0095] After step S108, the following may be included: if the user's decoration intention cannot be determined after natural language analysis of the decoration description sentence, a prompt of sentence parsing failure is provided to the user in a dialogue manner in the current human-computer dialogue interface. For example, the prompt of sentence parsing failure may be, but is not limited to, "The assistant cannot answer your question for the time being".

[0096] Decoration case images can be uploaded by users, or the platform or a third party can provide users with a case image library for users to choose from.

[0097] In some implementations, the decoration case image can be obtained in the following manner: in response to a user operation, a case selection interface is provided to the user, and the case selection interface displays thumbnails of case images classified by room type; in response to a user selecting a specific case image option on the case selection interface, the decoration case image is obtained. That is, the decoration case image can be determined in response to a user selecting a thumbnail of a specific case image on the case selection interface.

[0098] In step S108, the pre-trained second artificial intelligence model can be used to identify the decoration elements of the decoration case image to extract the decoration element information. The second artificial intelligence model can be trained by a large number of decoration pictures annotated with decoration elements. The second artificial intelligence model can be, but is not limited to, a neural network or any other type. The second artificial intelligence model and the first artificial intelligence model can be the same model, or different models can be used, and the embodiments of the present disclosure are not limited to this.

[0099] For example, in response to a user clicking on "Solution Square" in the bottom menu bar, the interface jumps from the current human-computer dialogue interface to the case selection interface, and case image options are displayed to the user in the case selection interface according to the room type (i.e., the purpose of the room). These case image options are presented as thumbnails of case images. Users can browse thumbnails of existing case images in the case selection interface by operations such as sliding up and down, sliding left and right, etc. The user selects the corresponding case image by clicking on a case image thumbnail. In response to the user's selection operation on a case image thumbnail, the interface jumps to the case image confirmation interface, and the case image confirmation interface displays a thumbnail of the case image selected by the user and a confirmation option. In response to the user's selection operation on the confirmation option in the case image confirmation interface, the currently selected case image is determined as the decoration case image of the first room, and the second artificial intelligence model is called to perform image recognition on the case image selected by the user to extract the decoration element information therein.

[0100] Figure 5 The operation process of obtaining decoration case images and generating decoration renderings through the case selection interface and the example diagram of interface jump are shown.

[0101] The historical decoration renderings may include but are not limited to: the historical decoration renderings of the first room and / or the historical decoration renderings of other rooms of the current user. Other rooms refer to other rooms other than the first room and of the same room type as the first room.

[0102] In step S106, a human-computer dialogue interface including a preview prompt of the historical decoration renderings may be provided to provide the user with preference options; in response to the user's operation on the preference options, the user's feedback information on the historical decoration renderings is generated. The feedback information on the historical decoration renderings may include, but is not limited to: the user's preference information on specific historical decoration renderings. For example, in a human-computer dialogue interface that provides thumbnails of historical decoration renderings, preference options may be provided to the user at the same time, and the preference options may include the two options of "like" and "dislike", and the user can generate the user's preference information on the current historical decoration renderings by clicking on these preference options.

[0103] In step S108, the historical decoration renderings preferred by the user can be obtained based on the user's feedback information on the historical decoration renderings, and the decoration element information can be extracted by performing image recognition on the historical decoration renderings preferred by the user. The specific implementation method of extracting the decoration element information through the historical decoration renderings can be the same as the implementation method of obtaining the decoration element information through the decoration case images mentioned above.

[0104] Step S110, generating a decoration rendering of the first room according to the decoration element information, the room type of the first room and the original image.

[0105] Specifically, the spatial structure of the original image can be extracted by performing processing such as image recognition on the original image of the first room, and the spatial structure of the original image can be rendered according to the decoration element information and the room type to generate a decoration rendering of the first room.

[0106] In specific applications, an existing image recognition model or image recognition algorithm can be used to extract the spatial structure of the original image, and any image rendering method applicable to the embodiments of the present disclosure can be used to render and generate a decoration effect map. The embodiments of the present disclosure do not limit the specific implementation methods of extracting the spatial structure of the original image and rendering and generating the decoration effect map.

[0107] The decoration renderings of the first room generated in step S110 may include a plurality of decoration renderings with different decoration effects but all containing the aforementioned decoration requirement information and conforming to the room type of the first room.

[0108] In step S110, a thumbnail of the decoration rendering of the first room can be provided to the user in a dialogue manner in the current human-computer dialogue interface. The user can enter the preview interface of the decoration rendering by clicking on the thumbnail of the decoration rendering. The decoration rendering is displayed in the preview interface of the decoration rendering in the original size or a size larger than the thumbnail.

[0109] After step S110, the method may further include: providing a preference option to the user in a human-computer dialogue interface including a thumbnail of the decoration rendering of the first room, and generating user feedback information on the decoration rendering of the first room in response to the user's operation on the preference option.

[0110] After step S110, the method may also include: providing a guidance prompt and an option to generate a new plan to the user in a human-computer dialogue interface containing a thumbnail of the decoration rendering of the first room; in response to the user selecting the option to generate a new plan, continuing to generate a new decoration rendering of the first room based on the previously acquired decoration element information, the decoration element information extracted from the guidance prompt, the room type of the first room and the original image of the first room. Figure 6 The diagram shows an interface for providing guidance prompts to users and generating new solution options through a human-computer dialogue interface and a schematic diagram of the next interface.

[0111] In some implementations, the guidance prompt may be generated based on user feedback information regarding historical decoration renderings, or may be generated based on currently popular decoration elements, or may use a default statement.

[0112] For example, a guiding prompt may be: You seem to like the "Nordic style" very much. Do you need to generate more similar style plans for you?

[0113] For another example, the guidance prompt may be: The layout of the "reading living room" is popular recently. Do you want to generate relevant plans?

[0114] For another example, the guidance prompt could be "Do you have a preferred style? You can select a style and generate a more suitable solution."

[0115] The above-mentioned decoration rendering generation method of the embodiment of the present disclosure can generate decoration renderings in the form of human-computer dialogue, that is, the original image and room type of the room and the decoration description statement, decoration case image or feedback information for the historical decoration rendering provided by the user are obtained through human-computer dialogue, and the decoration element information is obtained by parsing the decoration description statement, decoration case image or feedback information for the historical decoration rendering, so as to generate a decoration rendering that meets the user's needs. Therefore, the embodiment of the present disclosure can achieve the following beneficial effects: 1) Simple operation: The user only needs to enter a simple language description, select a case image or click an option to provide feedback on the historical decoration rendering to obtain a satisfactory decoration rendering. 2) Low professional threshold: Users do not need to have a design and computer technology foundation, and ordinary users can also easily complete the generation of decoration renderings through human-computer dialogue. 3) Simple adjustment: For the effect of conventional AI raw images, it can be quickly modified through dialogue, so as to meet the reference requirements more quickly. Therefore, the method of generating decoration renderings based on dialogue in the embodiment of the present disclosure has great potential in practical applications and can meet the user's needs for automation and personalization.

[0116] Figure 7 An example diagram of a decoration effect picture generating device using a hardware implementation of a processing system is shown.

[0117] The device may include a corresponding module for performing each or several steps in the above flowchart. Therefore, each step or several steps in the above flowchart may be performed by a corresponding module, and the device may include one or more modules in these modules. The module may be one or more hardware modules specially configured to perform the corresponding steps, or implemented by a processor configured to perform the corresponding steps, or stored in a computer-readable medium for implementation by a processor, or implemented by some combination.

[0118] The hardware structure can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 800 connects various circuits including one or more processors 900, memory 1000, and / or hardware modules together. The bus 800 can also connect various other circuits 1100 such as peripherals, voltage regulators, power management circuits, external antennas, etc.

[0119] The bus 800 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the figure only uses one connecting line, but does not mean that there is only one bus or one type of bus.

[0120] Any process or method description in the flowchart or otherwise described herein can be understood as a module, fragment or portion of a code representing one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present disclosure includes other implementations, in which the functions may not be performed in the order shown or discussed, including performing the functions in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by a person skilled in the art of the present disclosure. The processor performs the various methods and processes described above. For example, the method implementation in the present disclosure can be implemented as a software program, which is tangibly contained in a machine-readable medium, such as a memory. In some embodiments, part or all of the software program can be loaded and / or installed via a memory and / or a communication interface. When the software program is loaded into the memory and executed by the processor, one or more steps in the method described above can be performed. Alternatively, in other embodiments, the processor can be configured to perform one of the above methods in any other appropriate manner (e.g., by means of firmware).

[0121] The logic and / or steps represented in the flowchart or otherwise described herein may be embodied in any readable storage medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions on an instruction execution system, apparatus, or device), or in combination with such instruction execution systems, apparatuses, or devices.

[0122] For the purposes of this specification, a "readable storage medium" may be any device that can contain, store, communicate, propagate or transmit a program for use with or in conjunction with an instruction execution system, device or apparatus. More specific examples of readable storage media (a non-exhaustive list) include the following: an electrical connection with one or more wirings (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), a fiber optic device, and a portable read-only memory (CDROM). In addition, the readable storage medium may even be paper or other suitable medium on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a memory.

[0123] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0124] A person skilled in the art may understand that all or part of the steps of implementing the above-mentioned implementation method may be completed by instructing related hardware through a program, and the program may be stored in a readable storage medium, which, when executed, includes one or a combination of the steps of the implementation method.

[0125] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a readable storage medium. The storage medium may be a read-only memory, a disk or an optical disk, etc.

[0126] Figure 7 is a structural example diagram of a decoration effect picture generating device according to an embodiment of the present disclosure. Figure 7 The decoration effect picture generating device 700 of the embodiment of the present disclosure may include:

[0127] The acquisition unit 702 is used to acquire the original image of the first room, acquire the room type of the first room set by the user; and acquire previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by the user and / or decoration case images selected by the user;

[0128] An information extraction unit 704 is used to obtain decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description sentences and / or decoration case images;

[0129] The rendering generation unit 706 is used to generate a decoration rendering of the first room according to the decoration element information, the room type of the first room and the original image.

[0130] Other technical details of the decoration effect picture generating device 700 of the embodiment of the present disclosure can be found in the method section above and will not be repeated here.

[0131] The present disclosure also provides an electronic device, including: a memory, the memory storing execution instructions; and a processor or other hardware module, the processor or other hardware module executes the execution instructions stored in the memory, so that the processor or other hardware module executes the above-mentioned decoration effect picture generation method.

[0132] The present disclosure also provides a readable storage medium, in which execution instructions are stored. When the execution instructions are executed by a processor, they are used to implement the above-mentioned decoration effect picture generation method.

[0133] The present disclosure also provides a computer program product, including a computer program / instruction, which implements the above-mentioned decoration effect picture generation method when executed by a processor.

[0134] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present application. In this specification, the schematic representations of the above terms are not necessarily the same embodiment / method or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments / methods or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments / methods or examples described in this specification and the features of the different embodiments / methods or examples, unless they are contradictory.

[0135] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0136] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. A method for generating a decoration effect diagram, characterized in that: include: Get the original image of the first room; Get the room type of the first room set by the user; Obtaining previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by users, and / or decoration case images selected by users; Acquire decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by users and / or decoration case images selected by users; wherein the decoration element information includes one or more of decoration style, decoration color matching, layout method, and decoration elements; Generate a decoration effect diagram of the first room according to the decoration element information, the room type of the first room and the original image; The decoration trend information includes one or more of the following decoration element information: decoration element information selected and used by users exceeding a first predetermined threshold within a first predetermined period; decoration element information marked as popular by users exceeding a second predetermined threshold within a second predetermined period; decoration element information marked as popular by third parties exceeding a third predetermined threshold within a third predetermined period; Generating a decoration rendering of the first room according to the decoration element information, the room type of the first room and the original image includes: extracting the spatial structure of the original image by processing the original image of the first room, and rendering the spatial structure of the original image according to the decoration element information and the room type to generate the decoration rendering of the first room; wherein the generated decoration rendering of the first room includes a plurality of decoration renderings having different decoration effects but all containing the aforementioned decoration element information and conforming to the room type of the first room; The decoration rendering generation method also includes: providing a thumbnail of the decoration rendering of the first room to the user in a dialogue manner on the current human-computer dialogue interface, and the user enters a preview interface of the decoration rendering by clicking on the thumbnail of the decoration rendering; wherein, providing a preference option to the user on the human-computer dialogue interface including the thumbnail of the decoration rendering of the first room, and generating user feedback information on the decoration rendering of the first room in response to the user's operation on the preference option; providing a guide prompt and an option to generate a new plan to the user on the human-computer dialogue interface including the thumbnail of the decoration rendering of the first room, and continuing to generate a new decoration rendering of the first room based on the previously acquired decoration element information, the decoration element information extracted from the guide prompt, the room type of the first room and the original image of the first room in response to the user's selection operation on the option to generate a new plan.

2. The decoration effect diagram generating method according to claim 1, characterized in that: The historical decoration renderings include: historical decoration renderings of the first room and / or historical decoration renderings of other rooms of the current user.

3. The decoration effect diagram generating method according to claim 1, characterized in that: The obtaining of the original image of the first room includes one of the following steps: Guiding the user to select the original image of the first room from the original images uploaded by the user through human-computer dialogue; Guiding the user to search a pre-created field survey image database to obtain an original image of the first room through human-computer dialogue; The user is guided to upload the original image of the first room through human-computer dialogue.

4. The decoration effect diagram generation method according to claim 3, characterized in that: Guiding the user to search a pre-created survey image database to obtain the original image of the first room by means of human-computer dialogue includes: guiding the user to trigger the image search interface through human-computer dialogue to provide the image search interface to the user; In response to a region keyword input by a user in the image search interface, querying a pre-created field survey image database for apartment type thumbnails corresponding to the region keyword and displaying the thumbnails; In response to a user selecting the apartment type thumbnail, querying the actual survey image database for an actual survey image corresponding to the apartment type thumbnail selected by the user and displaying a thumbnail of the actual survey image; In response to a user selecting a thumbnail of the field survey image, the corresponding field survey image is determined as an original image of the first room.

5. The decoration effect diagram generating method according to claim 1, characterized in that: Acquiring decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by users, and / or decoration case images selected by users includes one of the following: Using a pre-trained first artificial intelligence model to perform natural language analysis on the decoration description sentence to determine the user's decoration intention, and generate decoration element information according to the user's decoration intention; Using a pre-trained second artificial intelligence model to identify decoration elements of the decoration case image to extract the decoration element information; Acquire the historical decoration renderings preferred by the user based on the feedback information of the user on the historical decoration renderings, and identify the decoration elements of the historical decoration renderings preferred by the user to extract the decoration element information; The decoration element information is extracted from the decoration trend information.

6. The decoration effect diagram generating method according to claim 1 or 5, characterized in that: The decoration description sentence is a natural language description sentence input by the user under the guidance of human-computer dialogue.

7. The decoration effect diagram generating method according to claim 1 or 5, characterized in that: Also includes: In response to the user operation, providing a case selection interface to the user, wherein the case selection interface displays thumbnails of case images classified by room type; The decoration case image is determined in response to a user selecting a thumbnail of a specific case image on the case selection interface.

8. The decoration effect diagram generating method according to claim 1 or 5, characterized in that: The user's feedback information on the historical decoration renderings is obtained in the following manner: Providing preference options in a human-computer dialogue interface including a preview prompt of the historical decoration renderings; In response to the user's operation on the preference option, feedback information of the user on the historical decoration rendering is generated.

9. The decoration effect drawing generation method according to claim 1, characterized in that: The step of obtaining the room type of the first room set by the user includes: Guide users to trigger the type option pop-up layer or the type option display of the current human-computer dialogue interface through human-computer dialogue; In response to the user's operation on the type option pop-up or the selection of a specific type option in the human-computer dialogue interface, the corresponding room type information is generated and displayed in the current human-computer dialogue interface in the form of a user reply message.

10. A decoration effect picture generating device, characterized in that: include: an acquisition unit, configured to acquire an original image of the first room, acquire a room type of the first room set by a user, wherein the room type includes but is not limited to a living room, a study, a children's room, a kitchen, a bathroom, a bedroom or a balcony; and acquire previously obtained decoration trend information, user feedback information on historical decoration renderings, decoration description statements provided by the user and / or decoration case images selected by the user; An information extraction unit, configured to obtain decoration element information based on the decoration trend information, user feedback information on historical decoration renderings, decoration description statements and / or decoration case images; wherein the decoration element information includes one or more of decoration style, decoration color matching, layout method, and decoration elements; An effect picture generating unit, configured to generate a decoration effect picture of the first room according to the decoration element information, the room type of the first room and the original image; The decoration trend information includes one or more of the following decoration element information: Information on decoration elements selected and used by users exceeding a first predetermined threshold within a first predetermined period of time; Decoration element information marked as popular by users exceeding a second predetermined threshold within a second predetermined period of time; Decoration element information marked as popular by a third party exceeding a third predetermined threshold within a third predetermined time period; According to the decoration element information, the room type of the first room and the original image, generating the decoration effect picture of the first room includes: extracting the spatial structure of the original image by processing the original image of the first room, rendering the spatial structure of the original image according to the decoration element information and the room type to generate the decoration effect picture of the first room; wherein the generated decoration effect picture of the first room includes a plurality of decoration effect pictures having different decoration effects but all containing the aforementioned decoration element information and conforming to the room type of the first room; The decoration rendering generating device also includes: providing a thumbnail of the decoration rendering of the first room to the user in a dialogue manner on the current human-computer dialogue interface, and the user enters a preview interface of the decoration rendering by clicking on the thumbnail of the decoration rendering; wherein, providing a preference option to the user on the human-computer dialogue interface including the thumbnail of the decoration rendering of the first room, and generating user feedback information on the decoration rendering of the first room in response to the user's operation on the preference option; providing a guide prompt and an option to generate a new plan to the user on the human-computer dialogue interface including the thumbnail of the decoration rendering of the first room, and continuing to generate a new decoration rendering of the first room based on the previously acquired decoration element information, the decoration element information extracted from the guide prompt, the room type of the first room and the original image of the first room in response to the user's selection operation on the option to generate a new plan.

11. An electronic device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instructions stored in the memory, so that the processor executes the decoration effect picture generating method according to any one of claims 1 to 9.

12. A readable storage medium, characterized in that: The readable storage medium stores execution instructions, which, when executed by a processor, are used to implement the decoration effect picture generation method described in any one of claims 1 to 9.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for generating a decoration effect diagram according to any one of claims 1 to 9 is implemented.