Room image display method, electronic device, storage medium and program product

Abstract

The invention provides a room image display method, electronic equipment, a readable storage medium and a computer program product. The room image display method comprises the following steps: determining a room image and an expected floor material image; the method comprises the following steps: determining a ground area in a room image by performing semantic segmentation on the room image; replacing the image in the ground area with an expected ground material image to obtain a replaced room image; and displaying the room image after replacement.

Description

Technical Field

[0001] The present disclosure relates to the technical field of computers and the like, and in particular to a room image display method, an electronic device, a storage medium and a program product. Background Art

[0002] Flooring is a building material used to decorate the ground. Flooring is divided into soft flooring, hard flooring and special flooring. Soft flooring includes plastic floor tiles, carpets, wooden floors, etc. Hard flooring includes ceramic tiles, stone, etc. Special flooring includes plywood, patterned steel plates, terrazzo, water-polished terrazzo, etc.

[0003] In the related art, a large amount of floor materials are needed for house decoration, and the decorative effect of the floor materials on the house can only be known after the floor materials are laid. In other words, there is a problem in the related art that it is difficult to predict the decorative effect of the floor materials. Summary of the invention

[0004] In order to solve at least one of the above technical problems, the present disclosure provides a room image display method, an electronic device, a storage medium and a program product.

[0005] According to one aspect of the present disclosure, a room image display method is provided, including: determining a room image and an expected floor material image; determining a floor area in the room image by semantically segmenting the room image; replacing the image in the floor area with the expected floor material image to obtain a replaced room image; and displaying the replaced room image.

[0006] According to at least one embodiment of the room image display method of the present disclosure, the image in the floor area is replaced with the desired floor material image to obtain a replaced room image, comprising: extracting a floor image from the room image based on the floor area; tiling the desired floor material image onto the floor image to obtain a tiled image; and replacing the image in the floor area with the tiled image to obtain the replaced room image.

[0007] According to at least one embodiment of the room image display method of the present disclosure, the image in the floor area is replaced with the tiled image to obtain the replaced room image, including: extracting floor material texture features in the desired floor material image; adding noise matching the floor material texture features to the tiled image; and replacing the image in the floor area with the tiled image with the noise added to obtain the replaced room image.

[0008] According to the room image display method of at least one embodiment of the present disclosure, displaying the replaced room image includes: determining first brightness information and second brightness information, wherein the first brightness information is the brightness information of the ground area in the replaced room image, and the second brightness information is the brightness information of the non-ground area in the replaced room image; adjusting the ground area brightness and / or the non-ground area brightness of the replaced room image according to the first brightness information and the second brightness information to obtain an adjusted room image; and displaying the adjusted room image.

[0009] According to the room image display method of at least one embodiment of the present disclosure, the floor area brightness and / or non-floor area brightness of the replaced room image is adjusted according to the first brightness information and the second brightness information, including: adjusting the floor area brightness of the replaced room image from the first brightness to the second brightness, wherein the first brightness is obtained by the first brightness information and the second brightness is obtained by the second brightness information; or adjusting the non-floor area brightness of the replaced room image from the second brightness to the first brightness.

[0010] According to the room image display method of at least one embodiment of the present disclosure, the floor area brightness and / or non-floor area brightness of the replaced room image is adjusted according to the first brightness information and the second brightness information, including: adjusting the floor area brightness of the replaced room image from the first brightness to the third brightness; and adjusting the floor area brightness of the replaced room image from the second brightness to the third brightness.

[0011] According to the room image display method of at least one embodiment of the present disclosure, the replaced room image is displayed, including: inputting the replaced room image into an image processing model, eliminating the splicing marks between the ground area and the non-ground area in the replaced image through the image processing model, to obtain a processed room image; and displaying the processed room image.

[0012] According to at least one embodiment of the room image display method of the present disclosure, determining a desired floor material image includes: displaying a plurality of floor material images; determining a floor material image selected from the plurality of floor material images; and using the selected floor material image as the desired floor material image.

[0013] According to at least one embodiment of the room image display method of the present disclosure, after determining the selected floor material image from the multiple floor material images, it also includes: in response to the number of selected floor material images being multiple, determining the splicing order of the multiple selected floor material images; and splicing the multiple selected floor material images based on the splicing order to obtain the desired floor material image.

[0014] According to at least one embodiment of the room image display method of the present disclosure, determining a desired floor material image includes: prompting a user to upload a floor material image; and upon receiving a floor material image uploaded by the user, using the uploaded floor material image as the desired floor material image.

[0015] According to another aspect of the present disclosure, an electronic device is provided, comprising: a memory storing a computer program; and a processor executing the computer program stored in the memory, so that the processor executes the room image display method of any one embodiment of the present disclosure.

[0016] According to another aspect of the present disclosure, a readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the room image display method of any embodiment of the present disclosure.

[0017] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the room image display method according to any one of the embodiments of the present disclosure is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0019] Figure 1 It is a schematic diagram of the overall process of a room image display method according to an embodiment of the present disclosure.

[0020] Figure 2 FIG. 4 is a schematic diagram of a process of determining a desired ground material image according to an embodiment of the present disclosure.

[0021] Figure 3 FIG. 4 is a schematic diagram of a process of determining a desired ground material image according to another embodiment of the present disclosure.

[0022] Figure 4 FIG. 4 is a visualization example diagram of a desired floor material image according to an embodiment of the present disclosure.

[0023] Figure 5 FIG. 4 is a schematic diagram of a process of determining a desired ground material image according to another embodiment of the present disclosure.

[0024] Figure 6 It is a schematic diagram of a process of replacing an image in a ground area with an image of a desired ground material according to one embodiment of the present disclosure.

[0025] Figure 7 It is a schematic diagram of a process of replacing an image in a ground area with a tiled image according to an embodiment of the present disclosure.

[0026] Figure 8 The figure is a schematic diagram of a process of displaying a replaced room image according to an embodiment of the present disclosure.

[0027] Fig. 9 FIG. 4 is a schematic diagram of a process of displaying a replaced room image according to another embodiment of the present disclosure.

[0028] Fig.10 It is a flowchart of a room image display method according to an embodiment of the present disclosure.

[0029] Fig.11 It is a schematic diagram of a visualization process of generating a second processed room image according to one embodiment of the present disclosure.

[0030] Fig.12 It is a schematic block diagram of the structure of a room image display device according to an embodiment of the present disclosure.

[0031] Fig.13 The present invention is a block diagram showing a structure of an electronic device equipped with a room image display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is understood that the specific examples described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.

[0033] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0034] Different people have different requirements for the aesthetics of their living environment, and floor materials are an important element of interior decoration. Floor materials have a variety of colors and patterns. Therefore, the selection of floor materials is crucial to meet the requirements of aesthetics. In the related art, the decorative effect of the floor materials on the house can only be known after the floor materials are laid, and once the floor materials are laid, it is difficult to change. If the user is not satisfied with the decorative effect of the floor materials and re-purchases the floor materials for laying, it will take a lot of time, money and energy, and require a lot of manpower and material resources. In addition, the decorative effect of the re-purchased floor materials cannot be known in advance, and it is difficult to meet the user's requirements for aesthetics. In summary, there is a problem in the related art that it is difficult to predict the decorative effect of floor materials.

[0035] To this end, the present disclosure proposes a room image display method.

[0036] The room image display method disclosed in the present invention can be used for an electronic device to display an image after the desired floor material is laid in the room (i.e., the room image after replacement). In the present disclosure, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a personal computer, a wearable device, an ATM, etc.

[0037] For the convenience of description and to make the technical solutions of the specific embodiments of the present disclosure easier to understand, before describing the room image display method implemented in the present disclosure, the technical terms involved in the specific embodiments of the present disclosure are explained as follows: A room image refers to an image obtained by photographing the interior of a room. The room image may include a ground area and a non-ground area.

[0038] The ground area refers to the ground area which is completely paved with flooring materials, the ground area which is completely unpaved with flooring materials, or the ground area which is partially paved with flooring materials and partially unpaved with flooring materials.

[0039] The ground image is the image located in the ground area of ​​the room image.

[0040] The non-ground area refers to part or all of the area in the room image except the ground area.

[0041] The non-ground image refers to the image in the non-ground area of ​​the room image.

[0042] Floor materials are building materials used to decorate the ground. Floor materials include flooring, floor tiles, etc. Among them, flooring is usually made of wood and / or other materials, and floor tiles are usually made of clay and / or other materials.

[0043] Floor material images refer to images of floor materials, which can reflect basic information of floor materials such as color, pattern, shape, and size.

[0044] Desired flooring refers to flooring that you want to predict the decorative effect of when it is laid on the floor of a room.

[0045] The desired floor material image refers to an image of the desired floor material, which can reflect basic information such as color, pattern, shape, and size of the desired floor material.

[0046] The replaced room image refers to a room image including a desired floor material image in the floor area.

[0047] The adjusted room image refers to the room image with adjusted brightness.

[0048] The processed room image refers to a room image in which the splicing traces between the ground area and the non-ground area are eliminated.

[0049] Semantic segmentation refers to labeling the category of each pixel in the image, such as ground category and non-ground category. Pixels labeled as ground category can form ground areas, and pixels labeled as non-ground category can form non-ground areas.

[0050] Tiling refers to stitching together several selected images until the specified area is filled.

[0051] The tiled image refers to an image that includes the desired ground material image and has the same shape and size as the ground image.

[0052] Perspective transformation refers to the transformation that uses the condition that the perspective center, image point and target point are collinear, and according to the law of perspective rotation, the image receiving surface (perspective plane) is rotated by a certain angle around the trace line (perspective axis), thereby destroying the original projection light beam, while still keeping the projected geometric figure on the image receiving surface unchanged.

[0053] The texture characteristics of floor materials are used to characterize the properties of the floor material surface.

[0054] The image processing model refers to a pre-trained model for eliminating the splicing traces between the ground area and the non-ground area in the image.

[0055] Figure 1 FIG. 2 is a schematic diagram showing the overall process of a room image display method M100 according to an embodiment of the present disclosure. Figure 1 The method shown includes steps S110 to S140. The method can be executed by electronic devices such as mobile phones and tablet computers.

[0056] Specifically, Figure 1 The methods shown include: S110, determining a room image and a desired floor material image; The room image refers to an image obtained by photographing the interior of the room. For example, the room image can be obtained by the user photographing the interior of the room on site, or by the user selecting a historical image from an electronic photo album and uploading it, which is not limited here.

[0057] Desired floor material refers to the floor material whose decorative effect one wants to predict when it is laid on the floor of a room. Desired floor material image refers to the image of the desired floor material, which can reflect the basic information of the desired floor material, such as color, pattern, shape, and size. In different application scenarios, the desired floor material image can be selected by the user independently or automatically by the electronic device, which is not limited here. It can be understood that the use of images facilitates the electronic device to automatically generate, through data processing, an image that can represent the effect of laying the desired floor material in the room.

[0058] S120, determining a ground area in the room image by performing semantic segmentation on the room image; Semantic segmentation refers to labeling the category of each pixel in the room image, such as ground category or non-ground category. Pixels labeled as ground category can form ground area, and pixels labeled as non-ground category can form non-ground area. Ground area refers to the area where the ground is completely paved with flooring materials, or the area where the ground is completely unpaved with flooring materials, or the area where the ground is partially paved with flooring materials and partially unpaved with flooring materials, that is, the area where the desired flooring materials need to be laid.

[0059] For example, a pre-trained semantic segmentation network can be used to perform semantic segmentation on the room image to obtain multiple blocks of the ground category, and the blocks corresponding to the ground category with an area greater than the area threshold are used as the ground area in the room image, thereby improving the accuracy of the determined ground area and avoiding misidentification. Furthermore, after determining the ground area in the room image, an edge detection algorithm in the relevant technology can be used to perform edge detection on the ground area, and morphological operations (such as dilation and erosion) can be used to enhance the clarity of the detected edges, thereby making the boundary of the ground area clearer.

[0060] S130: Replace the image in the ground area with the desired ground material image to obtain a replaced room image.

[0061] The replaced room image refers to a room image including the desired floor material image in the floor area. The replaced room image basically no longer contains the image in the floor area of ​​the original room image, and the image in the floor area of ​​the original room image is basically replaced by the desired floor material image. Therefore, the replaced room image can be used to know the decorative effect after the desired floor material is laid in the room.

[0062] S140: Display the replaced room image.

[0063] The room image display method of the disclosed embodiment obtains a replaced room image by replacing the image in the floor area of ​​the room image with an image of a desired floor material. Since the floor area in the replaced room image has been replaced from the original floor image to the image of the desired floor material, the user can predict the decorative effect after the desired floor material is laid in the room through the replaced room image. Therefore, the user does not have to actually lay the desired floor material in the room and can still determine whether the desired floor material meets his or her decorative needs, thereby reducing the user's consumption of time, money and energy and saving manpower and material resources.

[0064] Regarding step S110, in some embodiments of the present disclosure, it may include: Figure 2 Steps S111 to S113 are shown.

[0065] S111, displaying a plurality of ground material images; The floor material image refers to the image of the floor material, which can reflect the basic information of the floor material such as color, pattern, shape, size, etc. The multiple floor material images displayed in this step can be pre-configured floor material images, so that the basic information of the floor materials in the multiple floor material images displayed is more complete and the format is more standardized, so that the subsequent room image display step can be carried out stably and the execution result is more controllable. At the same time, multiple floor material images can provide users with more choices, thereby meeting the user's needs for selecting floor materials.

[0066] S112, determining a selected ground material image from a plurality of ground material images; Exemplarily, icons corresponding to each floor material image among the plurality of floor material images may be displayed, and when it is detected that the icon is triggered (eg, single-clicked, double-clicked, long-pressed, selected by voice, etc.), it is determined that the floor material image corresponding to the icon is selected.

[0067] S113: The selected ground material image is used as the desired ground material image.

[0068] Exemplarily, when the number of selected floor material images is one, the selected floor material image is used as the desired floor material image. It is understandable that when a user selects a displayed floor material image, it means that the user is interested in the floor material image and wants to know the decorative effect of the floor material image after it is laid in the house, so the selected floor material image is directly used as the desired floor material image.

[0069] The room image display method of the above embodiment can efficiently and accurately determine the user's desired floor material image by displaying multiple floor material images to the user and determining the desired floor material image based on the floor material image selected by the user, thereby providing a stable foundation for the subsequent room image display steps.

[0070] Regarding step S110, in some embodiments of the present disclosure, after step S112, the following may also be included: Figure 3 Steps S114 and S115 are shown.

[0071] S114, in response to the number of selected ground material images being multiple, determining a splicing order of the multiple selected ground material images; The selected multiple ground material images may be multiple ground material images, such as ground material images with different basic information such as color and pattern, or may be the same ground material image, i.e. ground material images with completely the same basic information such as color and pattern, which is not limited in the present disclosure. The stitching order can determine the position of the selected ground material image in the desired ground material image. The stitching order can be set automatically or customized by the user, which is not limited in the present disclosure.

[0072] S115 . Based on the splicing order, splice the multiple selected ground material images to obtain a desired ground material image.

[0073] In one example, there are four selected ground material images, namely, a first ground material image, a second ground material image, a third ground material image, and a fourth ground material image. The splicing order is to splice the first ground material image, the second ground material image, the third ground material image, and the fourth ground material image in sequence along the length direction of the ground material image. In this way, after splicing the multiple selected ground material images based on the splicing order, a desired ground material image in a long strip can be obtained, such as Figure 4 It should be noted that the specific numerical values ​​mentioned above are only used as examples to illustrate the implementation of the present disclosure in detail, and should not be understood as limiting the present disclosure. In other examples or implementations or embodiments, other numerical values ​​can be selected according to the present disclosure, and are not specifically limited here.

[0074] The room image display method of the above embodiment, when the user selects multiple floor material images, can splice the multiple selected floor material images according to the splicing order, so as to obtain the desired floor material image with a special display effect, which can make the desired floor material image more diverse and rich, thereby providing a stable foundation for the subsequent room image display steps.

[0075] Regarding step S110, in some embodiments of the present disclosure, it may include: Figure 5 Step S111' and step S112' are shown.

[0076] S111', prompting the user to upload a ground material image; In one example, an upload button for a floor material image may be displayed, and when it is detected that the upload button is triggered, an electronic photo album is opened so that the user can select a picture from the electronic photo album to upload as a floor material image. In another example, an upload area for a floor material image may be displayed, and when it is detected that an image is dragged to the upload area, the image is used as the floor material image uploaded by the user.

[0077] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0078] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0079] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0080] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0081] At the same time, it is understandable that the data involved in the technical solution of the present disclosure (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0082] S112': When receiving a floor material image uploaded by a user, the uploaded floor material image is used as a desired floor material image.

[0083] The room image display method of the above embodiment can directly use the floor material image uploaded by the user as the desired floor material image, thereby enabling the user to customize the desired floor material image, providing the user with more operation options, and being conducive to meeting the personalized needs of different users.

[0084] Regarding step S130, in some embodiments of the present disclosure, it may include the following steps: Figure 6 Steps S131 to S133 are shown.

[0085] S131, extracting a ground image from the room image based on the ground area; The ground image is the image in the ground area of ​​the room image. Exemplarily, the room image may be cropped along the boundary of the ground area, so as to extract the ground image from the room image.

[0086] S132, tiling the desired ground material image onto the ground image to obtain a tiled image; Tiling refers to stitching together several desired ground material images until the ground image is full. A tiled image refers to an image that includes one or more desired ground material images and has the same shape and size as the ground image. In one example, the ground image and the desired ground material image are both squares, and the side length of the desired ground material image is one-fourth of the side length of the ground image, that is, the size of the ground image is an integer multiple of the desired ground material image, and thus the tiled image can include four desired ground material images stitched together. It is understandable that when the size of the ground image is not an integer multiple of the desired ground material image, in order to cover the entire ground image, part of the desired ground material image will exceed the ground image, and at this time, the part of the desired ground material image that exceeds the ground image should be cropped off to ensure that the size of the tiled image is the same as the size of the ground image.

[0087] In certain embodiments, when a perspective effect exists in a floor image, a perspective transformation is performed on the tiled image based on perspective parameters in the floor image, so that the desired floor material in the tiled image after the perspective transformation looks like it is laid in a three-dimensional space, thereby improving the accuracy of the decorative effect of the desired floor material in the subsequently displayed replaced room image.

[0088] S133: Replace the image in the ground area with the tiled image to obtain a replaced room image.

[0089] The replaced room image no longer contains the image in the ground area of ​​the original room image, and the image in the ground area of ​​the original room image is replaced by the tiled image.

[0090] In some embodiments, when there is a light source in the room image, after the image in the floor area is replaced with the tiled image, the shadows and highlights on the desired floor material in the replaced room image can be adjusted according to the position of the light source in the room image, so that the desired floor material conforms to the light and shadow angles in the room image and looks more realistic.

[0091] The room image display method of the above embodiment extracts the floor image from the room image, and then replaces the extracted floor image with the desired floor material image, which can avoid replacing the non-ground image in the room image and improve the accuracy of the replacement. At the same time, through the tiling method, the original shape and size of the desired floor material image can be guaranteed to be unchanged as much as possible, so that the decorative effect of the desired floor material in the replaced room image is basically consistent with the decorative effect of laying the desired floor material in the room in reality, thereby improving the accuracy of the decorative effect of the desired floor material in the displayed replaced room image.

[0092] Regarding step S133, in some embodiments of the present disclosure, it may include the following steps: Figure 7 Steps S1331 to S1333 are shown.

[0093] S1331, extracting ground material texture features in the desired ground material image; The floor material texture features are used to characterize the properties of the floor material surface, such as the roughness or smoothness of the floor material surface. For example, the floor material texture features in the desired floor material image can be extracted by a pre-trained texture feature extraction network.

[0094] S1332, adding noise points matching the texture features of the ground material to the tiled image; Exemplarily, a pre-trained noise addition network can be used to add noise matching the ground material texture features in the tiled image. Different ground material texture features can match different types of noise. For example, if the ground material texture feature indicates that the expected ground material surface is rough, then the noise of the expected ground material in the image under real conditions can be simulated by adding speckle noise to the tiled image; if the ground material texture feature indicates that the expected ground material surface is smooth, then Gaussian noise can be added to the tiled image to simulate the noise of the expected ground material in the image under real conditions. Different ground material texture features can match different numbers of noise. For example, the rougher the ground material surface is, the more noise is added; the smoother the ground material surface is, the smaller the number of noise is added.

[0095] S1333: Replace the image in the ground area with the tiled image after adding noise, to obtain a replaced room image.

[0096] The replaced room image basically no longer contains the image in the ground area of ​​the original room image. The image in the ground area of ​​the original room image is basically replaced by the tiled image with noise added. Therefore, the replaced room image can be used to know the decorative effect after the desired floor material is laid in the room.

[0097] The room image display method of the above-mentioned embodiment enhances the texture and realism of the tiled image by adding noise points matching the texture features of the floor material in the tiled image, and can further make the decorative effect of the desired floor material in the replaced room image basically consistent with the decorative effect of actually laying the desired floor material in the room in reality, thereby improving the accuracy of the decorative effect of the desired floor material in the displayed replaced room image.

[0098] Regarding step S140, in some embodiments of the present disclosure, it may include: Figure 8 Steps S141 to S143 are shown.

[0099] S141, determining first brightness information and second brightness information, wherein the first brightness information is brightness information of a floor area in the room image after replacement, and the second brightness information is brightness information of a non-floor area in the room image after replacement; The non-ground area is a part or all of the area in the room image except the ground area. For example, the first brightness information may include the brightness average of all pixels in the ground area of ​​the replaced room image (i.e., the first brightness), and the second brightness information may include the brightness average of all pixels in the non-ground area of ​​the replaced room image (i.e., the second brightness). Determining the first brightness information and the second brightness information helps the electronic device to fully understand the brightness information of the ground area and the brightness information of the non-ground area in the replaced room image.

[0100] S142, adjusting the brightness of the floor area and / or the brightness of the non-floor area of ​​the replaced room image according to the first brightness information and the second brightness information to obtain an adjusted room image; Exemplarily, brightness adjustment may be achieved through a pre-trained diffusion model.

[0101] As a possible implementation, the brightness of the ground area of ​​the replaced room image is adjusted from the first brightness to the second brightness, wherein the first brightness is obtained through the first brightness information, and the second brightness is obtained through the second brightness information. In this way, no matter the brightness of the ground area of ​​the replaced room image is higher than the brightness of the non-ground area of ​​the replaced room image, or the brightness of the ground area of ​​the replaced room image is lower than the brightness of the non-ground area of ​​the replaced room image, the brightness of the ground area in the replaced room image can be adjusted based on the brightness of the non-ground area in the replaced room image (i.e., the second brightness), so that the brightness of the ground area in the adjusted room image is basically consistent with the brightness of the non-ground area, that is, the brightness in the adjusted room image is more balanced and coordinated, so that the image in the ground area can be naturally integrated with the surrounding images, which is conducive to improving the display effect of the image.

[0102] As another possible implementation, the brightness of the non-ground area of ​​the replaced room image is adjusted from the second brightness to the first brightness, wherein the first brightness is obtained through the first brightness information, and the second brightness is obtained through the second brightness information. In this way, no matter the brightness of the ground area of ​​the replaced room image is higher than the brightness of the non-ground area of ​​the replaced room image, or the brightness of the ground area of ​​the replaced room image is lower than the brightness of the non-ground area of ​​the replaced room image, the brightness of the non-ground area in the replaced room image can be adjusted based on the brightness of the ground area in the replaced room image (i.e., the first brightness), so that the brightness of the ground area in the adjusted room image is basically consistent with the brightness of the non-ground area, that is, the brightness in the adjusted room image is more balanced and coordinated, so that the image in the ground area can be naturally integrated with the surrounding images, which is conducive to improving the display effect of the image.

[0103] As another possible implementation, the brightness of the floor area of ​​the replaced room image is adjusted from the first brightness to the third brightness; and the brightness of the floor area of ​​the replaced room image is adjusted from the second brightness to the third brightness, wherein the first brightness is obtained through the first brightness information, the second brightness is obtained through the second brightness information, and the third brightness may be a pre-set brightness. In this way, no matter the brightness of the floor area of ​​the replaced room image is higher than the brightness of the non-floor area of ​​the replaced room image, or the brightness of the floor area of ​​the replaced room image is lower than the brightness of the non-floor area of ​​the replaced room image, or both the brightness of the floor area and the non-floor area of ​​the replaced room image are too high, or both the brightness of the floor area and the non-floor area of ​​the replaced room image are too low, or one of the brightness of the floor area and the non-floor area of ​​the replaced room image is too high or too low, the brightness of the floor area and the non-floor area in the replaced room image can be adjusted based on the third brightness, so that the brightness of the floor area in the adjusted room image is basically consistent with the brightness of the non-floor area and the brightness is appropriate, that is, the brightness in the adjusted room image is more balanced, coordinated and appropriate, so that the image in the floor area can be naturally integrated with the surrounding images and the brightness of the entire room image is more appropriate, which is beneficial to improving the display effect of the image.

[0104] S143: Display the adjusted room image.

[0105] The room image display method of the above-mentioned embodiment adjusts the brightness of the floor area and / or the non-floor area of ​​the replaced room image to obtain an adjusted room image that meets certain brightness requirements. In this way, when the adjusted room image is displayed, the floor area image and the non-floor area image in the displayed adjusted room image are more natural, avoiding a harsh and uncoordinated display effect, thereby improving the accuracy of the decorative effect of the desired floor material in the displayed adjusted room image.

[0106] Regarding step S140, in some embodiments of the present disclosure, it may include: Fig. 9 Step S141' and step S142' are shown.

[0107] S141', inputting the replaced room image into the image processing model, and eliminating the splicing traces between the ground area and the non-ground area in the replaced image through the image processing model to obtain a processed room image; The image processing model refers to a pre-trained model for eliminating splicing traces between ground areas and non-ground areas in an image. In one example, the image processing model is a diffusion model.

[0108] S142', display the processed room image.

[0109] The room image display method of the above-mentioned embodiment can automatically eliminate the splicing marks between the ground area and the non-ground area in the replaced image with the help of the image processing model. In this way, when the processed room image is displayed, the transition between the ground area image and the non-ground area image in the processed room image is more natural, avoiding abrupt and inharmonious display effects, thereby improving the accuracy of the decorative effect of the desired floor material in the displayed processed room image.

[0110] It is understandable that, in other embodiments, step S140 may also include: determining first brightness information and second brightness information, wherein the first brightness information is the brightness information of the ground area in the replaced room image, and the second brightness information is the brightness information of the non-ground area in the replaced room image; adjusting the ground area brightness and / or the non-ground area brightness of the replaced room image according to the first brightness information and the second brightness information to obtain an adjusted room image; inputting the adjusted room image into an image processing model, eliminating the splicing traces between the ground area and the non-ground area in the adjusted image through the image processing model to obtain a second processed room image; and displaying the second processed room image. In this way, it is possible to ensure that the brightness of the ground area image and the non-ground area image in the displayed second processed room image is appropriate, and the splicing traces between the ground area and the non-ground area can be eliminated, so that the transition between the ground area image and the non-ground area image in the displayed second processed room image is more natural to a greater extent, avoiding a blunt and uncoordinated display effect, thereby improving the accuracy of the decorative effect of the desired floor material in the displayed second processed room image to a greater extent.

[0111] Below Fig.10 and Fig.11 Taking the room image display method of the embodiment of the present disclosure as an example, the room image display method of the embodiment of the present disclosure is described.

[0112] like Fig.10 and Fig.11 As shown, a room image and an expected floor material image are obtained; the floor area in the room image is determined by semantic segmentation of the room image; based on the floor area, the floor image is extracted from the room image; the expected floor material image is tiled onto the floor image to obtain a tiled image; floor material texture features in the expected floor material image are extracted; noise matching the floor material texture features is added to the tiled image; the image in the floor area is replaced with the tiled image after adding noise to obtain a replaced room image; first brightness information and second brightness information are determined; according to the first brightness information and the second brightness information, the floor area brightness and / or the non-floor area brightness of the replaced room image are adjusted to obtain an adjusted room image; the adjusted room image is input into an image processing model, and the splicing marks between the floor area and the non-floor area in the adjusted room image are eliminated by the image processing model to obtain a second processed room image; and the second processed room image is displayed.

[0113] Based on any of the above embodiments, the present disclosure also provides a room image display device.

[0114] Fig.12 It is a schematic block diagram of the structure of a room image display device according to an embodiment of the present disclosure.

[0115] like Fig.12 As shown, the room image display device includes: The determination module 110 is used to determine a room image and a desired floor material image.

[0116] The semantic segmentation module 120 is used to determine the ground area in the room image by performing semantic segmentation on the room image.

[0117] The replacement module 130 is used to replace the image in the ground area with the desired ground material image to obtain a replaced room image.

[0118] The display module 140 is used to display the replaced room image.

[0119] The above modules can be implemented by computer program modules.

[0120] In some embodiments of the present disclosure, the determination module 110 is used to: display multiple ground material images; determine a ground material image selected from the multiple ground material images; and use the selected ground material image as the desired ground material image. Further, the determination module 110 is also used to: in response to the number of selected ground material images being multiple, determine a splicing order of the multiple selected ground material images; and splice the multiple selected ground material images based on the splicing order to obtain the desired ground material image.

[0121] In some embodiments of the present disclosure, the determination module 110 is used to: prompt the user to upload a floor material image; and upon receiving a floor material image uploaded by the user, use the uploaded floor material image as the desired floor material image.

[0122] In some embodiments of the present disclosure, the replacement module 130 is used to: extract a ground image from a room image based on the ground area; tile the desired ground material image onto the ground image to obtain a tiled image; and replace the image in the ground area with the tiled image to obtain a replaced room image. Further, the replacement module 130 is used to: extract ground material texture features in the desired ground material image; add noise matching the ground material texture features to the tiled image; and replace the image in the ground area with the tiled image with the added noise to obtain a replaced room image.

[0123] In some embodiments of the present disclosure, the display module 140 is used to: determine first brightness information and second brightness information, wherein the first brightness information is the brightness information of the ground area in the replaced room image, and the second brightness information is the brightness information of the non-ground area in the replaced room image; adjust the ground area brightness and / or non-ground area brightness of the replaced room image according to the first brightness information and the second brightness information to obtain the adjusted room image; and display the adjusted room image. Further, the display module 140 is used to: adjust the ground area brightness of the replaced room image from the first brightness to the second brightness, wherein the first brightness is obtained by the first brightness information and the second brightness is obtained by the second brightness information; or adjust the non-ground area brightness of the replaced room image from the second brightness to the first brightness. Alternatively, the display module 140 is used to: adjust the ground area brightness of the replaced room image from the first brightness to the third brightness; and adjust the ground area brightness of the replaced room image from the second brightness to the third brightness.

[0124] In some embodiments of the present disclosure, the display module 140 is used to: input the replaced room image into the image processing model, eliminate the stitching traces between the ground area and the non-ground area in the replaced image through the image processing model, and obtain a processed room image; and display the processed room image.

[0125] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0126] The execution subject of the room image display method in the specific implementation manner of the present disclosure may be an electronic device such as a mobile phone, a tablet computer, or a server.

[0127] Therefore, based on any of the above embodiments, the present disclosure also provides an electronic device, which can execute the room image display method of any of the embodiments described above in the present disclosure, and the room image display device of any of the embodiments described above can be configured on the electronic device.

[0128] Fig.13 FIG. 1 is a schematic block diagram of the structure of an electronic device 1000 equipped with a room image display device according to an embodiment of the present disclosure.

[0129] The hardware structure of the electronic device 1000 can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 1100 connects various circuits including one or more processors 1200, memory 1300 and / or hardware modules together. The bus 1100 can also connect various other circuits 1400 such as peripherals, voltage regulators, power management circuits, external antennas, etc.

[0130] The bus 1100 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the figure only uses one connecting line, but does not mean that there is only one bus or one type of bus.

[0131] The present disclosure also provides a readable storage medium, in which a computer program is stored, and the computer program is used to implement the above method when executed by a processor. "Readable storage medium" can be any device that can contain, store, communicate, propagate or transmit a program for use in an instruction execution system, device or equipment or in combination with these instruction execution systems, devices or equipment. More specific examples of readable storage media include the following: an electrical connection portion (electronic device) with one or more wirings, a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM), etc.

[0132] The present disclosure also provides a computer program product. The method of the present disclosure can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed, the process or function of the present disclosure is executed in whole or in part.

[0133] The computer program or instructions may be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The readable storage medium may be any available medium that can be accessed or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid state drive. The computer readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0134] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0135] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0136] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0137] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0138] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, or characteristics described may be combined in a suitable manner in any one or more embodiments / methods or examples. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and features of different embodiments / methods or examples, unless they are contradictory.

[0139] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0140] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. A room image display method, characterized in that: include: Determine the room image and the desired floor material image; Determine a ground area in the room image by performing semantic segmentation on the room image; Replacing the image in the floor area with the desired floor material image to obtain a replaced room image; and The replaced room image is displayed.

2. The room image display method according to claim 1, characterized in that: Replacing the image in the ground area with the desired ground material image to obtain a replaced room image, comprising: Based on the ground area, extracting a ground image from the room image; Tiling the desired ground material image onto the ground image to obtain a tiled image; and The image in the ground area is replaced with the tiled image to obtain the replaced room image.

3. The room image display method according to claim 2, characterized in that: Replacing the image in the ground area with the tiled image to obtain the replaced room image includes: Extracting ground material texture features in the desired ground material image; Adding noise points matching the texture features of the ground material to the tiled image; and The image in the ground area is replaced with the tiled image after adding noise to obtain the replaced room image.

4. The room image display method according to claim 1, characterized in that: Displaying the replaced room image includes: Determine first brightness information and second brightness information, wherein the first brightness information is brightness information of a floor area in the replaced room image, and the second brightness information is brightness information of a non-floor area in the replaced room image; According to the first brightness information and the second brightness information, adjusting the brightness of the floor area and / or the brightness of the non-floor area of ​​the replaced room image to obtain an adjusted room image; and The adjusted room image is displayed.

5. The room image display method according to claim 1, characterized in that: Displaying the replaced room image includes: Inputting the replaced room image into an image processing model, and eliminating the splicing traces between the ground area and the non-ground area in the replaced image through the image processing model to obtain a processed room image; and The processed room image is displayed.

6. The room image display method according to claim 1, characterized in that: Determine the desired ground material image, including: Display multiple ground material images; determining a selected ground material image from among the plurality of ground material images; and The selected ground material image is used as the desired ground material image.

7. The room image display method according to claim 6, characterized in that: After determining the selected ground material image from the plurality of ground material images, the method further includes: In response to the number of the selected ground material images being multiple, determining a splicing order of the multiple selected ground material images; and Based on the stitching sequence, a plurality of the selected ground material images are stitched together to obtain the desired ground material image.

8. An electronic device, characterized in that: include: a memory storing a computer program; as well as A processor, wherein the processor executes the computer program stored in the memory so that the processor executes the room image display method according to any one of claims 1 to 7.

9. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program is used to implement the room image display method according to any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the room image display method according to any one of claims 1 to 7 is implemented.

Images