Visualization method for laundry treatment apparatus

Abstract

The invention relates to the technical field of intelligent household appliances, particularly provides a visualization method for clothes treatment equipment, and aims to solve the problem that a user cannot intuitively feel the smudginess condition of a roller and the self-cleaning effect of the roller in the prior art. In order to achieve the purpose, the method comprises the steps that a current roller image of a roller is obtained; obtaining a three-dimensional structure model of the roller; the three-dimensional structure model is reconstructed according to the current roller image, a visual model of the roller is obtained, and the visual model can display the smudginess condition of the roller; and carrying out visual display on the visual model. According to the invention, the smudginess condition of the roller can be visually displayed to the user through the visual model, so that the user can conveniently know the smudginess condition of the roller and timely control the clothes processing equipment to perform self-cleaning, and the use experience of the user can be improved.

Description

Technical Field

[0001] This invention relates to the field of smart home appliance technology, specifically providing a visualization method for clothing processing equipment. Background Technology

[0002] Currently, washing machines have become an essential home appliance for more and more families, greatly simplifying laundry and improving the convenience of life. During washing machine use, dirt, lint, detergent, and moisture from clothes remain on the drum. These residues can easily breed bacteria and mold in a damp environment. If not cleaned, these bacteria and mold can contaminate clothes and pose a threat to human health.

[0003] The relevant technology enables the washing machine to self-clean based on the dirt level of the drum. However, users cannot intuitively perceive the dirt level of the drum or the self-cleaning effect of the drum in this technology.

[0004] Accordingly, a new technical solution is needed in this field to solve the above problems. Summary of the Invention

[0005] The present invention aims to solve the above-mentioned technical problems, namely, to solve the problem that users cannot intuitively perceive the dirtiness of the roller and the self-cleaning effect of the roller in the related technologies.

[0006] This invention provides a visualization method for a garment processing device, the garment processing device including a roller, the visualization method comprising: acquiring a current image of the roller; acquiring a three-dimensional structural model of the roller; reconstructing the three-dimensional structural model based on the current image of the roller to obtain a visualization model of the roller, the visualization model being able to display the dirt status of the roller; and visually displaying the visualization model.

[0007] In some embodiments, the garment processing device further includes an imageable sensor; the step of "acquiring a current image of the roller" specifically includes: acquiring multiple partial images of the roller through the imageable sensor; and stitching the partial images together to form a complete image of the roller, which is used as the current image of the roller.

[0008] In some embodiments, after acquiring multiple partial images of the roller and before stitching them together, the method further includes: enhancing the spatial features of the partial images; and aligning the multiple partial images according to the spatial position information of the partial images.

[0009] In some embodiments, the step of "enhancing the spatial features of the local image" specifically includes: enhancing the brightness and contrast of the local image.

[0010] In some embodiments, the step of "reconstructing the three-dimensional structural model based on the current roller image" specifically includes: determining the dirty area of ​​the roller based on the current roller image; and mapping the dirty area to the three-dimensional structural model based on the spatial location information of the dirty area.

[0011] In some embodiments, the step of "determining the dirty area of ​​the roller based on the current roller image" specifically includes: acquiring a standard roller image of the roller; and determining the dirty area in the roller by comparing the standard roller image and the current roller image.

[0012] In some embodiments, after determining the dirty areas in the roller, the visualization method further includes: determining the dirt level of the dirty areas; and marking the dirt level of the corresponding dirty areas in the visualization model.

[0013] In some embodiments, the step of "determining the dirt level of the dirty area" specifically includes: determining the dirt level based on the area and color difference of the dirty area; wherein the color difference is the difference between the color of the dirty area and the color of the corresponding area in the standard roller image.

[0014] In some embodiments, the step of "reconstructing the three-dimensional structure model based on the current roller image" specifically includes: attaching the current roller image to the three-dimensional structure model based on the spatial position information of the current roller image.

[0015] In some embodiments, the visualization method further includes: acquiring a standard roller image of the roller; determining a dirty area in the roller based on the standard roller image and the current roller image; determining the dirt level of the dirty area; and marking the dirt level of the corresponding dirty area in the visualization model.

[0016] By employing the above technical solution, the visualization method for garment processing equipment provided by this invention reconstructs a three-dimensional structural model based on the current image of the roller, thereby obtaining a visual model of the roller. This visual model allows the user to view the roller's soiling status. Thus, this invention can intuitively display the roller's soiling status to the user through a visual model, facilitating the user's understanding of the roller's soiling condition and enabling timely control of the garment processing equipment for self-cleaning. Furthermore, the user can intuitively understand the roller's self-cleaning effect through the visual model before and after self-cleaning, which enhances the user experience.

[0017] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0018] The preferred embodiments of the present invention are described below with reference to the accompanying drawings, in which:

[0019] Figure 1 This is a flowchart of the main steps of the visualization method for clothing processing equipment provided by the present invention;

[0020] Figure 2 yes Figure 1 A detailed flowchart of one step in the visualization method shown;

[0021] Figure 3 yes Figure 1 A detailed flowchart of one step in the visualization method shown;

[0022] Figure 4 This is a detailed flowchart of the visualization method for clothing processing equipment provided by the present invention;

[0023] Figure 5 This is a detailed flowchart of the visualization method for clothing processing equipment provided by the present invention. Detailed Implementation

[0024] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention. Those skilled in the art can make adjustments as needed to adapt to specific application scenarios. Such changes in application scenarios do not depart from the basic principles of the present invention and fall within the scope of protection of the present invention.

[0025] Currently, washing machines have become an essential home appliance for more and more families, greatly simplifying laundry and improving the convenience of life. During washing machine use, dirt, lint, detergent, and moisture from clothes remain on the drum. These residues can easily breed bacteria and mold in a damp environment. If not cleaned, these bacteria and mold can contaminate clothes and pose a threat to human health.

[0026] The relevant technology allows the washing machine to self-clean based on the level of dirt on the drum. However, users cannot directly perceive the level of dirt on the drum or the effectiveness of the self-cleaning process using this technology.

[0027] This invention provides a visualization method for garment processing equipment, which can intuitively display the dirt status of the roller and the self-cleaning effect of the roller.

[0028] In this application, the garment handling equipment includes washing machines, dryers, or washer-dryer combos. The garment handling equipment includes a drum for holding garments. The drum includes an inner drum and an outer drum.

[0029] Figure 1 This is a flowchart illustrating the main steps of the visualization method for clothing processing equipment provided by the present invention. (Combined with...) Figure 1 As shown, the visualization method provided by this invention includes:

[0030] S101, Obtain the current image of the roller.

[0031] The current roller image is a complete image of the roller and is a two-dimensional image.

[0032] S102, Obtain the three-dimensional structural model of the roller.

[0033] The 3D structural model is a simulation model of the roller, which can be built using digital twin technology. The 3D structural model can be a static or dynamic display model, which can be selected according to actual needs.

[0034] S103, Reconstruct the three-dimensional structural model based on the current roller image to obtain a visual model of the roller, which can display the dirt status of the roller.

[0035] S104 visualizes the model.

[0036] For example, garment processing equipment may include an operation screen displaying a visual model, which users can observe and manipulate. Alternatively, the visual model may be displayed on a mobile device such as a smartphone, allowing users to view and manipulate it via a downloaded application. Users can carefully observe different parts of the roller using rotation and zoom operations, making it easy to understand the level of dirt on the roller.

[0037] By employing the above technical solution, the visualization method for garment processing equipment provided by this invention reconstructs a three-dimensional structural model based on the current image of the roller, thereby obtaining a visual model of the roller. This visual model allows the user to view the roller's soiling status. Thus, this invention can intuitively display the roller's soiling status to the user through a visual model, facilitating the user's understanding of the roller's soiling condition and enabling timely control of the garment processing equipment for self-cleaning. Furthermore, the user can intuitively understand the roller's self-cleaning effect through the visual model before and after self-cleaning, which enhances the user experience.

[0038] In some embodiments, the garment handling apparatus further includes an imagerable sensor.

[0039] An image-capable sensor is a sensor capable of acquiring photographic images; it allows the acquisition of a current image of the garment roller. Image-capable sensors include spectral sensors, CMOS sensors, and wide-angle cameras, among others. Garment handling equipment may include one or more image-capable sensors, which can be flexibly configured according to specific needs.

[0040] Figure 2 yes Figure 1 A detailed flowchart of step S101 in the visualization method shown is provided. In some embodiments, combined with... Figure 2 As shown, the steps for "obtaining the current roller image" specifically include:

[0041] S201 acquires multiple partial images of the roller using an imaging sensor.

[0042] In the first embodiment, this step involves capturing multiple partial images of the roller using multiple imageable sensors. Since the roller is cylindrical, it is difficult to capture a complete image of the roller using only one imageable sensor. By using multiple imageable sensors to capture multiple partial images of the roller, the completeness and accuracy of the partial image capture can be improved. These imageable sensors can be installed at different locations on the garment handling equipment to acquire images of the roller from multiple angles or positions. Each imageable sensor captures at least one local area of ​​the roller and generates a corresponding partial image.

[0043] In the second embodiment, this step involves capturing multiple partial images of the roller using at least one imageable sensor in conjunction with the roller's rotation. Using at least one imageable sensor in conjunction with the roller's rotation allows for more complete capture of the entire image of the roller and helps reduce costs.

[0044] S202, stitch the local images together to form the overall image of the drum, which is then used as the current drum image.

[0045] After acquiring multiple partial images, the partial images are stitched together to form a complete view of the roller, which facilitates the subsequent construction of a visual model of the roller.

[0046] By adopting the above technical solution, multiple partial images of the roller are acquired through an imaging sensor, and these partial images are stitched together to form a complete current roller image, which facilitates the subsequent construction of a visualization model of the roller. The visualization model is constructed based on the actual imaging of the roller, which makes the dirt situation presented by the visualization model closer to the actual dirt situation of the roller.

[0047] In some embodiments, after acquiring multiple partial images of the rollers and before stitching them together, the visualization method for a garment processing device provided by the present invention further includes: enhancing the spatial features of the partial images; and aligning the multiple partial images based on their spatial location information.

[0048] Enhancing the spatial features of local images helps to highlight the brightness variations, morphology of soiled areas, edges and lines of soiled areas, etc., facilitating subsequent identification of soiled areas. Since each local image is captured from a different angle or position, their relative positions need to be determined before stitching, thereby aligning multiple local images into the same coordinate system, which facilitates the subsequent stitching of local images to obtain the current roller image mentioned above.

[0049] In some embodiments, the step of "enhancing the spatial features of a local image" specifically includes: enhancing the brightness and contrast of the local image. By enhancing the brightness and contrast of the local image, the varying brightness levels, the shape of dirty areas, the edges and lines of dirty areas, etc., in the local image can be highlighted, thereby improving the quality and accuracy of the local image and facilitating subsequent identification of dirty areas.

[0050] For example, the brightness of a local image can be enhanced by power transformation, and the contrast of a local image can be enhanced by grayscale stretching.

[0051] Figure 3 yes Figure 1 The diagram shows a detailed flowchart of one step in the visualization method.

[0052] In some embodiments, combined with Figure 3 As shown, the steps of "reconstructing the 3D structural model based on the current drum image" specifically include:

[0053] S301, determine the dirty area of ​​the roller based on the current roller image.

[0054] In this step, the dirty areas in the current drum image can be automatically labeled using the gradient method or the local histogram equalization method to identify the dirty areas in the current drum image.

[0055] S302, based on the spatial location information of the dirty area, map the dirty area onto the 3D structural model. For example, this step can be implemented as follows: extract the spatial coordinates of the dirty area boundary relative to the roller. Since the 3D structural model is a simulation model of the roller, there is a certain scaling relationship between the spatial coordinates of the dirty area on the 3D structural model and the spatial coordinates of the dirty area on the roller. Based on this scaling relationship, map the dirty area onto the 3D structural model. Further, fill the area containing the dirty area in the 3D model with different colors and display it on the 3D structural model. Alternatively, circle the area containing the dirty area in the 3D model with lines of different colors and display it on the 3D structural model. Alternatively, label the area containing the dirty area in the 3D model with text and display it on the 3D structural model.

[0056] By adopting the above technical solution, the embodiments of the present invention can map the dirty area to a three-dimensional structural model. Compared with directly displaying the image of the dirty area, the visualization model obtained by mapping is clearer and simpler in terms of visual effect, and users can understand the dirt status of the roller more easily and directly.

[0057] In some embodiments, the step of "determining the dirty areas of the roller based on the current roller image" specifically includes: acquiring a standard roller image of the roller; and determining the dirty areas in the roller by comparing the standard roller image with the current roller image. The standard roller image refers to an image of the roller when it is clean, and it serves as a reference. By comparing the standard roller image with the current roller image, the dirty areas in the current roller image can be identified.

[0058] For example, determining the dirty areas in the drum by comparing the standard drum image and the current drum image can be achieved as follows: using a gradient method or a local histogram equalization method to compare the colors of the standard drum image and the current drum image, the areas of color change in the current drum image are determined as the dirty areas.

[0059] Optionally, the standard roller image can be updated based on the usage of the garment processing equipment. As the garment processing equipment is used, the roller may become yellowed, dented, scratched, or otherwise damaged. Updating the standard image based on the usage of the garment processing equipment helps improve the accuracy of identifying soiled areas.

[0060] Optionally, the usage of the garment processing equipment includes: operating time, number of uses, and lifespan. For example, the standard roller image is updated every three months of the garment processing equipment's lifespan. Alternatively, the standard roller image is updated every 50 uses of the garment processing equipment. Or, the standard roller image is updated every 300 hours of operating time of the garment processing equipment.

[0061] In some embodiments, after determining the soiled areas in the drum, the visualization method provided by the present invention further includes: determining the soiling level of the soiled areas. The soiling level of the corresponding soiled areas is then marked in the visualization model. By adopting the above technical solution, users can intuitively and effectively understand the location and extent of soiled areas in the drum, thus facilitating users or garment processing equipment to more accurately formulate drum cleaning plans and meet users' requirements for the cleanliness of garment processing equipment.

[0062] Optionally, the level of dirtiness of a dirty area can be indicated in various ways.

[0063] For example, different colors can be used to represent different levels of dirt. For instance, red can represent heavy dirt, yellow represents moderate dirt, and green represents light dirt.

[0064] Alternatively, the specific level of dirtiness, such as "Level 1", "Level 2", "A", or "B", can be marked inside, next to, or above the dirty area.

[0065] Alternatively, specific icons or symbols can be used to represent the level of dirtiness; these icons or symbols can be preset or customized according to user preferences.

[0066] In some embodiments, the step of "determining the dirt level of a dirty area" specifically includes: determining the dirt level based on the area and color difference of the dirty area. The color difference is the difference between the color of the dirty area and the color of the corresponding area in the standard roller image.

[0067] By comparing the colors of corresponding areas in the current roller image and the standard roller image, dirty areas can be identified. Further analysis of the area and color intensity of the dirty area allows for the determination of its level of dirtiness. The level of dirtiness is determined by two parameters: area and color difference. The larger the area of ​​the dirty area and the greater the color difference, the more severe the dirtiness.

[0068] Figure 4 This is a detailed flowchart of the visualization method for clothing processing equipment provided by the present invention. (Combined with...) Figure 4As shown, the visualization method for clothing processing equipment provided by the present invention includes:

[0069] S401 acquires multiple partial images of the roller using an imaging sensor.

[0070] S402 enhances the brightness and contrast of local images.

[0071] S403: Align multiple local images based on the spatial location information of the local images.

[0072] S404, stitch the local images together to form the overall image of the drum, which is then used as the current drum image.

[0073] S405, Obtain the three-dimensional structural model of the roller.

[0074] S406, Obtain the standard roller image of the roller.

[0075] S407, determine the dirty areas in the roller by comparing the standard roller image and the current roller image.

[0076] S408: Based on the spatial location information of the dirty area, the dirty area is mapped to a three-dimensional structural model to obtain a visual model of the roller.

[0077] S409, determine the level of dirtiness based on the area and color difference of the dirty area.

[0078] S410, mark the dirt level of the corresponding dirty area in the visualization model.

[0079] S411 visualizes the model.

[0080] With the above technical solution, the visualization model provided by the present invention can more clearly and concisely show the user the dirt status of the drum, making it easier for the user to understand the dirt status of the drum and control the clothing processing equipment to perform self-cleaning in a timely manner.

[0081] In some embodiments, the step of "reconstructing the 3D structural model based on the current roller image" specifically includes: attaching the current roller image to the 3D structural model based on the spatial position information of the current roller image. When using this technical solution, the visualized model displays a true image of the roller. Directly attaching the current roller image to the obtained visualized model provides a more intuitive and realistic visual effect, making it easier for users to understand the true condition of the roller.

[0082] For example, based on the spatial position information of the current roller image, the current roller image can be attached to the three-dimensional structure model in the following way: Since the three-dimensional structure model is a simulation model of the roller, there is a certain scaling relationship between the spatial position coordinates of the current roller image on the three-dimensional structure model and the spatial position coordinates of the current roller image on the roller. Based on this scaling relationship, the current roller image can be directly attached to the three-dimensional structure model.

[0083] In some embodiments, the visualization method provided by the present invention further includes: acquiring a standard roller image; determining soiled areas in the roller based on the standard roller image and the current roller image; determining the soiling level of the soiled areas; and marking the soiling level of the corresponding soiled areas in the visualization model. This configuration allows users to intuitively and effectively understand the location and extent of soiling in the roller by comparing the standard roller image and the current roller image. This facilitates more accurate roller cleaning plans and meets users' requirements for the cleanliness of garment processing equipment.

[0084] For example, based on a standard roller image and a current roller image, the dirty areas in the roller can be determined as follows: by comparing the colors of the standard roller image and the current roller image using a gradient method or a local histogram equalization method, the areas of color change in the current roller image are identified as the dirty areas.

[0085] Optionally, the step of "determining the dirt level of the dirty area" specifically includes: determining the dirt level based on the area and color difference of the dirty area. The color difference is the difference between the color of the dirty area and the color of the corresponding area in the standard roller image. For example, a convolutional neural network or grayscale difference algorithm model can be built in the cloud to classify different dirt levels based on the area and color intensity of the dirty area, and the dirt level can be classified using an algorithm.

[0086] By comparing the colors of corresponding areas in the current roller image and the standard roller image, dirty areas can be identified. Further analysis of the area and color intensity of the dirty area allows for the determination of its level of dirtiness. The level of dirtiness is determined by two parameters: area and color difference. The larger the area of ​​the dirty area and the greater the color difference, the more severe the dirtiness.

[0087] Figure 5 This is a detailed flowchart of the visualization method for clothing processing equipment provided by the present invention. (Combined with...) Figure 5 As shown, the visualization method for clothing processing equipment provided by the present invention includes:

[0088] S501, Obtain the current image of the roller. The current image of the roller is the overall image of the roller and is a two-dimensional image.

[0089] S502, Obtain the three-dimensional structural model of the roller.

[0090] S503: Based on the spatial position information of the current roller image, attach the current roller image to the three-dimensional structural model to obtain a visual model of the roller.

[0091] S504, Obtain the standard roller image of the roller.

[0092] S505, based on the standard roller image and the current roller image, determine the dirty areas in the roller.

[0093] S506, determine the level of dirtiness in a dirty area.

[0094] S507, mark the dirt level of the corresponding dirty area in the visualization model.

[0095] S508 visualizes and displays the model.

[0096] When the above technical solution is adopted, the visualization model provided by the present invention displays the real image of the drum. The visualization model obtained by directly attaching the current drum image is more intuitive and realistic in terms of visual effect, making it easier for users to understand the real situation of the drum.

[0097] Although the steps in the above embodiments are described in the above order, those skilled in the art will understand that in order to achieve the effect of this embodiment, different steps do not need to be executed in such an order. They can be executed simultaneously (in parallel) or in a reverse order. These simple variations are all within the protection scope of this invention.

[0098] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of the present invention.

Claims

1. A visualization method for a garment processing device, the garment processing device comprising a roller, characterized in that, The visualization method includes: Obtain the current image of the roller; Obtain the three-dimensional structural model of the roller; The three-dimensional structural model is reconstructed based on the current drum image to obtain a visual model of the drum, which can display the dirt status of the drum. The visualization model is then presented visually.

2. The visualization method according to claim 1, characterized in that, The garment processing equipment also includes an image sensor; The step of "obtaining the current image of the roller" specifically includes: Multiple partial images of the roller are acquired using the imageable sensor; The local images are stitched together to form the overall image of the roller, which is then used as the current roller image.

3. The visualization method according to claim 2, characterized in that, After acquiring multiple partial images of the roller, and before stitching them together, the method further includes: Enhance the spatial features of the local image; Based on the spatial location information of the local images, align multiple local images.

4. The visualization method according to claim 3, characterized in that, The steps of "enhancing the spatial features of the local image" specifically include: Enhance the brightness and contrast of the local image.

5. The visualization method according to any one of claims 1 to 4, characterized in that, The step of "reconstructing the three-dimensional structural model based on the current drum image" specifically includes: The dirty areas of the roller are determined based on the current roller image; Based on the spatial location information of the dirty area, the dirty area is mapped onto the three-dimensional structural model.

6. The visualization method according to claim 5, characterized in that, The step of "determining the dirty area of ​​the roller based on the current roller image" specifically includes: Obtain a standard roller image of the roller; The dirty areas in the roller are determined by comparing the standard roller image and the current roller image.

7. The visualization method according to claim 6, characterized in that, After identifying the contaminated areas in the roller, the visualization method further includes: Determine the level of dirtiness of the dirty area; The level of dirtiness corresponding to the dirty areas is marked in the visualization model.

8. The visualization method according to claim 7, characterized in that, The steps for "determining the level of dirtiness in the dirty area" specifically include: The level of dirtiness is determined based on the area and color difference of the dirty area; The color difference is the difference between the color of the dirty area and the color of the corresponding area in the standard roller image.

9. The visualization method according to any one of claims 1 to 4, characterized in that, The step of "reconstructing the three-dimensional structural model based on the current drum image" specifically includes: Based on the spatial position information of the current roller image, the current roller image is attached to the three-dimensional structure model.

10. The visualization method according to claim 9, characterized in that, The visualization method also includes: Obtain a standard roller image of the roller; Based on the standard roller image and the current roller image, determine the dirty areas in the roller; Determine the level of dirtiness of the dirty area; The level of dirtiness corresponding to the dirty areas is marked in the visualization model.

Images