Method and apparatus for removing foreign matter in a washing machine

Abstract

The application provides a foreign matter removing method and device in a washing machine, the method comprising: processing the laundry to be washed in the washing machine to unfold the laundry to be washed; obtaining a target image of the laundry to be washed, inputting the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using multiple sets of historical data, each set of data in the multiple sets of historical data comprising: a historical image and a detection result corresponding to the historical image, the historical image being an image of the laundry to be washed obtained before the current time; and in the case that the detection result is that the target image comprises foreign matter, adjusting the operating parameters of the washing machine to remove the foreign matter, the parameters at least comprising one of the water temperature of the washing machine, the rotating speed of the washing machine and the operating duration of the washing machine. The application solves the problem of foreign matter remaining in the washing process of the washing machine in the prior art.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of home appliance maintenance, in particular to a method for removing foreign matter in a washing machine, a device for removing foreign matter in a washing machine, a computer readable storage medium and a computer program product. BACKGROUND

[0002] Modern consumers' demand for washing machines has not only met the basic cleaning function, but also pays more attention to washing effect and clothes care. The washing machines on the market currently lack effective paper scrap detection and removal mechanism, which cannot meet users' pursuit of high-quality washing experience. The traditional washing machine design does not have a special detection and removal mechanism for paper scraps mixed in clothes. Users need to manually check and remove paper scraps in clothes before washing, which is not only cumbersome but also easy to miss. Even during the washing process, the washing machine may remove some paper scraps through water flow, but it cannot guarantee complete removal, and the effect on paper scraps already adhered to clothes is limited.

[0003] The existing method determines whether there is foreign matter in the pocket by judging whether the theoretical weight and the actual weight of the clothes are equal. If there is, a foreign matter reminder is issued. It ignores the toilet paper scraps and other small, light and difficult to estimate foreign matter. These foreign matters may have little effect on the overall weight of the clothes, but they can cause headaches during the washing process. In addition, it does not cover how to effectively remove these foreign matters through user interaction or automatic adjustment of washing parameters after detecting the foreign matters, resulting in a lack of effective response strategy when facing small and difficult to estimate paper scraps. SUMMARY

[0004] The main purpose of the present application is to provide a method for removing foreign matter in a washing machine, a device for removing foreign matter in a washing machine, a computer readable storage medium and a computer program product to at least solve the problem of residual foreign matter in the washing process of the washing machine in the prior art.

[0005] According to an aspect of the present application, a foreign matter removing method in a washing machine is provided, the method comprising: processing laundry to be washed in the washing machine to unfold the laundry to be washed; obtaining a target image of the laundry to be washed, inputting the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of the historical data comprising: a historical image and a detection result corresponding to the historical image, the historical image being an image of the laundry to be washed obtained before the current time, and the detection result being that the target image includes foreign matter or that the target image does not include the foreign matter; and in the case that the detection result is that the target image includes the foreign matter, adjusting an operating parameter of the washing machine to remove the foreign matter, the operating parameter at least including one of a water temperature of the washing machine, a rotation speed of the washing machine, and a running time of the washing machine.

[0006] Optionally, the processing of the laundry to be washed to unfold the laundry to be washed comprises: obtaining a weight of the laundry to be washed to obtain a target weight; determining a first target rotation speed according to the target weight, wherein the target weight is positively correlated with the first target rotation speed; controlling the rotation speed of the washing machine to rotate at the first target rotation speed; controlling the washing machine to rotate at a second target rotation speed in a first direction, wherein the second target rotation speed is less than the first target rotation speed; and controlling the washing machine to rotate at the second target rotation speed in a second direction, wherein the first direction is opposite to the second direction.

[0007] Optionally, the obtaining of the target image of the laundry to be washed comprises: obtaining an image of the laundry to be washed to obtain an initial image; processing the initial image using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image; determining a part of the first processed image with brightness greater than a brightness threshold value as a reflection region, and determining a pixel value of the reflection region as an average value of pixel values of a surrounding region adjacent to the reflection region in the first processed image, the center of the surrounding region being less than a distance threshold value from the center of the reflection region, to obtain a second processed image; and performing morphological processing on the second processed image to obtain the target image, wherein the morphological processing comprises dilation processing or erosion processing.

[0008] Optionally, in the case that the detection result is that the target image includes the foreign matter, adjusting a running parameter of the washing machine to remove the foreign matter, comprising: obtaining a number of the foreign matter and an unfolded area of the foreign matter; in the case that at least one of the number is greater than a number threshold and the unfolded area is greater than an area threshold, obtaining a washing stage of the washing machine at a current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the washing stage, increasing a rotating speed of the washing machine to a first predetermined rotating speed to remove the foreign matter, wherein the first predetermined rotating speed is less than a maximum rotating speed of the washing machine in the washing stage; in the case that the washing stage is the rinsing stage, increasing a rinsing number of the washing machine to a first predetermined number or increasing a rinsing time length of the washing machine to a first predetermined time length to remove the foreign matter; in the case that the washing stage is the dehydration stage, increasing the rotating speed of the washing machine to a second predetermined rotating speed or increasing a dehydration time length of the washing machine to a second predetermined time length to remove the foreign matter, wherein the second predetermined rotating speed is less than a maximum rotating speed of the washing machine in the dehydration stage.

[0009] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: increasing a rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than a maximum temperature of the washing machine in the washing stage.

[0010] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: adjusting a water outlet direction of the washing machine to a predetermined direction, and increasing a water outlet amount of the washing machine, wherein the predetermined direction is a direction in which a water outlet of the washing machine points to at least one of the foreign matters.

[0011] Optionally, in the case that the detection result is that the target image includes the foreign matter, adjusting a running parameter of the washing machine to remove the foreign matter, comprising: obtaining a material of the laundry to be washed, and determining whether the material is a predetermined material, the predetermined material comprising a silk material or a wool material; in the case that the material of the laundry to be washed is the predetermined material, obtaining a washing stage of the washing machine at a current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the rinsing stage, increasing a rinsing number of the washing machine to a first predetermined number or increasing a rinsing time length of the washing machine to a third predetermined time length to remove the foreign matter.

[0012] According to another aspect of the present application, a foreign matter removing device in a washing machine is provided, comprising: a processing unit configured to process laundry to be washed in the washing machine so as to unfold the laundry to be washed; an acquisition unit configured to acquire a target image of the laundry to be washed, input the target image into a detection model, and obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of the historical data comprising a historical image and a detection result corresponding to the historical image, the historical image being an image of the laundry to be washed acquired before a current time, and the detection result being whether the target image includes foreign matter or does not include the foreign matter; and an adjustment unit configured to, in a case where the detection result is that the target image includes the foreign matter, adjust an operating parameter of the washing machine so as to remove the foreign matter, the operating parameter at least including one of a water temperature of the washing machine, a rotating speed of the washing machine, and a running time length of the washing machine.

[0013] According to still another aspect of the present application, a computer readable storage medium is provided, comprising a stored program, wherein the program, when executed, controls a device on which the computer readable storage medium is located to perform any of the foreign matter removing methods in the washing machine.

[0014] According to still another aspect of the present application, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the steps of any of the foreign matter removing methods in the washing machine.

[0015] By applying the technical solution of the present application, the real-time detection of foreign matter in the washing process of the washing machine is realized by applying the machine learning technology to the detection model, the foreign matter on the laundry can be accurately identified and located, and further, in a case where the laundry has foreign matter, the operating parameter of the washing machine is adjusted in real time during the washing process, so that the paper scraps can be effectively removed. BRIEF DESCRIPTION OF DRAWINGS

[0016] The accompanying drawings, which form a part of the present application, are intended to provide further understanding of the present application, and the illustrative embodiments of the present application, together with their description, are intended to explain the present application, and are not intended to limit the present application in any manner. In the drawings:

[0017] Figure 1 is a hardware structure block diagram of a mobile terminal of a foreign matter removing method in a washing machine according to an embodiment of the present application;

[0018] Figure 2 is a flowchart of a foreign matter removing method in a washing machine according to an embodiment of the present application;

[0019] Figure 3This is a flowchart of an optional method for removing foreign objects from a washing machine according to an embodiment of this application;

[0020] Figure 4 This is a schematic diagram of the installation position of the camera inside the washing machine according to an embodiment of this application;

[0021] Figure 5 This is a schematic diagram of image acquisition inside a washing machine according to an embodiment of this application;

[0022] Figure 6 This is a flowchart illustrating the training and deployment of a deep learning model according to an embodiment of this application;

[0023] Figure 7 This is a schematic diagram of the dynamic adjustment curve of washing parameters based on images captured inside a washing machine according to an embodiment of this application;

[0024] Figure 8 This is a schematic diagram of a foreign object removal device inside a washing machine according to an embodiment of this application.

[0025] The above figures include the following reference numerals:

[0026] 102. Processor; 104. Memory; 106. Transmission device; 108. Input / output device. Detailed Implementation

[0027] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0028] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not have to be limited to only those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] As introduced in the background, the existing laundry washing machine has a cleaning problem when facing small and light foreign matters such as toilet paper scraps, which are difficult to be effectively identified by the traditional weight detection method. To solve the problem of residual foreign matters in the laundry washing process of the laundry washing machine, the embodiments of the present application provide a foreign matter removal method in a laundry washing machine, a foreign matter removal device in a laundry washing machine, a computer readable storage medium and a computer program product.

[0031] The technical solutions in the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application.

[0032] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking the case of running on a mobile terminal, Figure 1 is a hardware structure block diagram of a mobile terminal of a laundry washing machine foreign matter removal method according to an embodiment of the present application. As shown in Figure 1 , the mobile terminal can include one or more (only one is shown in Figure 1 ) processor 102 (the processor 102 can include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned mobile terminal can further include a transmission device 106 for communication function and an input and output device 108. Those skilled in the art can understand that Figure 1 the structure shown is only schematic, which does not limit the structure of the above-mentioned mobile terminal. For example, the mobile terminal can include more or less components than Figure 1 shown, or have a different configuration from Figure 1 shown.

[0033] The memory 104 can be used to store computer programs, such as software programs of application software and modules, such as the computer program corresponding to the foreign matter removing method in the washing machine according to the embodiments of the present application. The processor 102 can execute various functional applications and data processing, i.e., implement the above method, by running the computer programs stored in the memory 104. The memory 104 can include a high-speed random access memory, and can further include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory 104 can further include memories disposed remotely with respect to the processor 102, which can be connected to the mobile terminal through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof. The transmission device 106 is used to receive or send data via a network. The specific examples of the above network can include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet in a wireless manner.

[0034] In the present embodiment, a foreign matter removing method in a washing machine running on a mobile terminal, a computer terminal or a similar computing device is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown.

[0035] Figure 2 is a flowchart of the foreign matter removing method in a washing machine according to the embodiments of the present application. As shown in Figure 2 , the method comprises the following steps:

[0036] Step S201, processing the laundry to be washed in the washing machine so as to unfold the laundry to be washed.

[0037] Specifically, by rotating the laundry to be washed, the laundry to be washed is unfolded and dispersed in the washing machine, so as to obtain a better cleaning effect during the washing process. The unfolded laundry to be washed can be better contacted with the detergent and water, so as to ensure that each piece of laundry can be fully cleaned, and the washing process is more efficient.

[0038] In step S202, a target image of the laundry to be washed is obtained, and the target image is input into a detection model to obtain a detection result corresponding to the target image. The detection model is trained by machine learning using a plurality of sets of historical data. Each set of historical data includes a historical image and a detection result corresponding to the historical image. The historical image is an image of the laundry to be washed obtained before the current time. The detection result indicates whether the target image includes a foreign object or not.

[0039] Specifically, the detection model can be used to determine whether the laundry to be washed contains a foreign object. By inputting the target image of the laundry to be washed into the detection model, the detection result can be quickly and accurately obtained to determine whether the target image contains a foreign object. The foreign object can be found in time during the washing process to avoid damage to the washing machine and the laundry caused by the foreign object. The detection model trained using the plurality of sets of historical data can improve the accuracy and stability of detection. The model can learn the characteristics of foreign objects in various situations through historical data to better determine whether the laundry to be washed contains a foreign object, effectively avoid misjudgment or missed detection, and ensure the smooth progress of the washing process.

[0040] In step S203, if the detection result indicates that the target image includes a foreign object, the operating parameters of the washing machine are adjusted to remove the foreign object. The parameters include at least one of the water temperature, the rotation speed, and the operating duration of the washing machine.

[0041] Specifically, by increasing the rotation speed of the washing machine, the water flow speed and washing intensity in the washing drum can be increased, so that the foreign object can be more easily flushed out of the washing machine. The operating duration of the washing machine can also be appropriately increased to ensure that the foreign object is completely removed. The cleaning effect of the washing machine can be improved to ensure that the foreign object does not damage the washing machine or affect the washing effect during the washing process. By adjusting the operating parameters of the washing machine, the foreign object can be effectively removed to ensure the normal operation and washing effect of the washing machine.

[0042] Through the present embodiment, the machine learning technology can be applied to the detection model to realize real-time detection of foreign objects during the washing process of the washing machine. The foreign object on the laundry can be accurately identified and located. Further, if a foreign object exists on the laundry, the operating parameters of the washing machine can be adjusted in time during the washing process to effectively remove the foreign object.

[0043] Specifically, the operating parameters of the washing machine can include, but are not limited to, the rotation speed, a specific water flow mode, a water flow direction, the number of rinsing times, the time, the water temperature, and the like.

[0044] In the implementation process, the laundry to be washed is processed to unfold the laundry to be washed, which can be achieved by the following steps: obtaining the weight of the laundry to be washed to obtain a target weight; determining a first target speed according to the target weight, wherein the target weight is positively correlated with the first target speed; controlling the rotation speed of the washing machine to rotate at the first target speed; controlling the washing machine to rotate in a first direction at a second target speed, wherein the second target speed is less than the first target speed; and controlling the washing machine to rotate in a second direction at the second target speed, wherein the first direction is opposite to the second direction.

[0045] In this scheme, by determining the target weight according to the weight of the laundry to be washed, and determining the first target speed according to the target weight, the rotation speed of the washing machine can be more accurately controlled to ensure that the laundry is properly impacted and agitated during the washing process, thereby better cleaning the laundry. By controlling the washing machine to rotate in two directions at different speeds, foreign matter can be effectively removed from the surface of the laundry or the fabric fibers, improving the washing effect and making the laundry cleaner and more comfortable.

[0046] Figure 3 is an optional flowchart of a foreign matter removal method in a washing machine according to an embodiment of the present application, as shown in Figure 3 At the main washing stage, the rotation speed of the laundry attached to the inner cylinder wall (i.e., the first target speed) is set based on the weighing data (i.e., the target weight), which is beneficial for the separation of the laundry and the toilet paper. After the main washing stage ends, the laundry is loosened through a low-speed rotation program, and a 1-minute forward rotation (i.e., the first direction) and a 1-minute reverse rotation (i.e., the second direction) are performed at a speed of 20 revolutions per minute (i.e., the second target speed), so that the laundry changes from a compact state to a loose state, facilitating subsequent paper clip detection. Through the above rotation, a unified laundry distribution reference standard can be established, irrelevant features in image recognition can be reduced, and the accuracy of the subsequent processing process can be ensured.

[0047] In some embodiments, the target image of the laundry to be washed is obtained, which can be achieved by the following steps: obtaining an image of the laundry to be washed to obtain an initial image; processing the initial image using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image; determining a part in the first processed image with a brightness greater than a brightness threshold as a reflection region, and determining the pixel value of the reflection region as the average value of the pixel values of the surrounding region, to obtain a second processed image, the surrounding region being a part adjacent to the reflection region in the first processed image, and the distance between the center of the surrounding region and the center of the reflection region being less than a distance threshold; and performing morphological processing on the second processed image to obtain the target image, wherein the morphological processing includes dilation processing or erosion processing.

[0048] In the scheme, by performing average processing on the pixel values of the reflection area, the interference caused by reflection can be effectively reduced, the accuracy of foreign matter detection is improved, the image can be further optimized through morphological processing, the foreign matter is more easily detected and distinguished, the image contrast and brightness can be enhanced, the foreign matter in the laundry can be more clearly detected, the foreign matter removal efficiency in the washing machine can be improved, and the smooth progress of the washing process can be ensured.

[0049] As shown in Figure 3 , after the main washing stage processing is completed, the built-in sensor of the washing machine measures and records the stacking height (h) of the laundry, the spread area (s) of the laundry, the total mass (g) of the laundry, and the distribution state parameter (θ) of the laundry, creates a unified article distribution standard, reduces the influence of irrelevant factors in image recognition, and ensures the accuracy of paper scrap detection.

[0050] Figure 4 is a schematic diagram of the installation position of the camera inside the washing machine according to the embodiment of the application, as shown in Figure 4 , two cameras are installed in the washing machine, camera 1 is installed in front of the inner drum of the washing machine, which is used to capture the image in front of the laundry to identify the paper scraps on the laundry, and camera 2 is installed above the inner drum of the washing machine, which is used to identify the spread area and distribution state of the laundry. In the rinsing stage, camera 1 captures the front view of the laundry for fine identification of the specific distribution of paper scraps and measurement of the stacking height (h) of the laundry, and camera 2 captures the image at an angle, which is used to calculate the spread area (s) and distribution state parameter (θ) of the laundry, and focuses on the possible scattering of paper scraps in the high-speed rotating state, Figure 5 is a schematic diagram of image acquisition inside the washing machine according to the embodiment of the application.

[0051] Figure 6 is a flowchart of the training and deployment of the deep learning model according to the embodiment of the application, as shown in Figure 6As shown, first, a large number of image data of laundry and paper scraps in the washing machine is collected, and the image data is preprocessed, including cleaning, format conversion, size adjustment, etc., to ensure that the data quality is suitable for model training. In the washing machine inner drum, due to the change of light, some parts of the L (Luminance, brightness) channel color space of the image are overexposed, causing image mirror reflection, and some images are underexposed, causing dark areas, and some images are overexposed, causing white spots. Through image lighting preprocessing technology, to solve the mirror reflection and lighting change of the washing machine internal image, use contrast constrained adaptive histogram equalization to enhance the contrast, brightness, details and texture of the input image, mark the pixels with brightness greater than the set threshold as the reflection area, and set the pixel value of the reflection area to the average value of the surrounding pixels, adopt morphological closing operation to eliminate possible noise, manually or automatically label the image to distinguish clothes, paper scraps and irrelevant background; construct a lightweight semantic segmentation model through a convolutional neural network and train it, evaluate the model performance on the validation set, and optimize the model; finally, the trained model is packaged and deployed to the control software of the washing machine or the cloud server. The deployed model can analyze the internal image of the washing machine in real time, realize accurate detection and positioning of paper scraps.

[0052] Specifically, the above-mentioned contrast limited adaptive histogram equalization (CLAHE) is a technique for enhancing image contrast, which divides the image into many small blocks (called "sub-regions") and performs histogram equalization within each sub-region to avoid over-enhancing contrast across the entire image, which can lead to loss of details and increase of noise; the above-mentioned L (Luminance, brightness) channel color space is a way to convert an image to a grayscale image, the L channel represents the brightness value of the image, and does not contain color information. By converting a color image to an L channel color space, the brightness and contrast of the image can be highlighted, so that the details and textures of the image can be better represented.

[0053] Specifically, the above semantic segmentation model is to classify each pixel point in the image and determine the category of each point to divide the region. The semantic segmentation not only needs to have discriminative ability at the pixel level, but also needs a mechanism to project the discriminative features learned by the encoder at different stages to the pixel space (i.e., map back to the original image size). The adopted semantic segmentation model is an encoder and decoder (Encoder-Decoder) network. The encoder (Decoder) is responsible for extracting high-level feature representation from the input image and is a pre-trained convolutional neural network. Through multi-layer convolution and pooling operations, the spatial resolution of the feature map is gradually reduced, and more and more abstract features are extracted. Different encoder structures can be selected according to the computing resources. The decoder (Decoder) is responsible for gradually restoring the high-level feature map extracted by the encoder to the resolution of the input image, projecting the discriminative features (lower resolution) learned by the encoder to the pixel space (higher resolution) semantically, to obtain dense classification, and generating the final segmentation map.

[0054] Optionally, the above encoder structure can include but is not limited to ResNet (Residual Network), VGG (Visual Geometry Group), DenseNet (Densely Connected Convolutional Networks), ResNeXt (Residual Neural Network with Cardinality), etc. The encoder structure can be implemented through upsampling (such as deconvolution operation), convolution layer and jump connection, etc.

[0055] Optionally, the above pixel point category can include but is not limited to background, laundry, and toilet paper scraps, etc.

[0056] Specifically, the pre-trained semantic segmentation network model is then used to perform real-time analysis and processing on the images captured by the camera device, to achieve accurate segmentation of clothes and paper scraps, and to pay special attention to the small distribution changes of paper scraps during the rinsing process, to ensure that paper scraps can still be accurately detected in a high-speed rotating environment.

[0057] In the specific implementation process, in the case that the detection result is that the target image includes foreign matter, the operation parameters of the washing machine are adjusted to remove the foreign matter, which can be achieved through the following steps: obtaining the number of foreign matter and the unfolded area of foreign matter; in the case that at least one of the number is greater than the number threshold and the unfolded area is greater than the area threshold, obtaining the washing stage of the washing machine at the current time, wherein the washing stage includes the washing stage, the rinsing stage and the dehydration stage; in the case that the washing stage is the washing stage, the speed of the washing machine is increased to a first predetermined speed to remove the foreign matter, wherein the first predetermined speed is less than the maximum speed of the washing machine in the washing stage; in the case that the washing stage is the rinsing stage, the number of rinsing of the washing machine is increased to a first predetermined number or the rinsing time of the washing machine is increased to a first predetermined time to remove the foreign matter; in the case that the washing stage is the dehydration stage, the speed of the washing machine is increased to a second predetermined speed or the dehydration time of the washing machine is increased to a second predetermined time to remove the foreign matter, wherein the second predetermined speed is less than the maximum speed of the washing machine in the dehydration stage.

[0058] In the scheme, by monitoring the number and unfolded area of foreign matter, the washing machine is adjusted and processed in time to ensure the washing effect and service life. In the washing stage, increasing the speed can help remove the foreign matter. In the rinsing stage, increasing the number or time of rinsing can also help remove the foreign matter. In the dehydration stage, increasing the speed or dehydration time is also effective. Thus, the foreign matter in the washing machine is effectively removed, the washing machine can run normally when cleaning clothes, faults and damage caused by foreign matter are avoided, the cleaning effect of the washing machine is improved, the influence of foreign matter on the washing machine is reduced, and the service life of the washing machine is prolonged.

[0059] Specifically, after entering the rinsing stage, the washing machine continuously monitors the image captured by the camera in real time, and identifies the paper scraps in real time through the trained model. After detecting the paper scraps, the model highlights the identified paper scrap area, and according to the image of the inner drum of the washing machine, the difficulty of the paper scraps adhering to the clothes is inferred and provided to the control system for processing.

[0060] Figure 7 is a schematic diagram of a washing parameter dynamic adjustment curve of the washing machine internal image acquisition according to the embodiments of the present application, as Figure 7 shown, the control system automatically adjusts the washing parameters, for example, adjusts the speed, increases a specific water flow mode, adjusts the water flow direction, adjusts the number of rinsing, time and water temperature, to promote the shedding and removal of paper scraps.

[0061] In the specific implementation process, in the case that the washing stage is the rinsing stage, the above method can also be achieved through the following steps: increasing the rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than the highest temperature of the washing machine in the washing stage.

[0062] In the scheme, by increasing the rinse water temperature of the washing machine, the foreign matter remaining on the clothes during the washing stage can be effectively removed. By increasing the water temperature, the chemical reaction during the cleaning process can be accelerated, making the washing liquid more easily decompose the foreign matter and wash it away, ensuring that the washed articles are clean and free of residues, improving the washing effect and the cleanliness of the clothes. The predetermined temperature is less than the highest temperature of the washing machine during the washing stage, which can avoid damage to the clothes or the washing machine, and ensure the safety and reliability of the washing process.

[0063] In the specific implementation process, in the case that the washing stage is the rinsing stage, the above method can also be implemented by the following steps: adjusting the water outlet direction of the washing machine to a predetermined direction, and increasing the water outlet amount of the washing machine, wherein the predetermined direction is the direction in which the water outlet of the washing machine points to at least one foreign matter.

[0064] In the scheme, by pointing the water outlet of the washing machine to the foreign matter and increasing the water outlet amount, the cleaning power can be enhanced to help flush the foreign matter out of the washing machine, effectively removing the foreign matter in the washing machine and avoiding the influence of the foreign matter on the normal operation of the washing machine and the washing effect, maintaining the performance and efficiency of the washing machine.

[0065] Specifically, when the washing machine is in the rinsing stage, the water outlet of the washing machine is adjusted to the position of the paper scraps, the water outlet amount is increased, and the water flow is directly flushed onto the paper scraps. After a period of rinsing, the paper scraps are flushed away, and the foreign matter is removed to avoid the paper scraps blocking the drain of the washing machine and ensure the normal operation of the washing machine.

[0066] In the specific implementation process, in the case that the detection result is that the target image includes foreign matter, the operation parameters of the washing machine are adjusted to remove the foreign matter, which can be implemented by the following steps: obtaining the material of the clothes to be washed, and determining whether the material is a predetermined material, the predetermined material including silk material or wool material; in the case that the material of the clothes to be washed is the predetermined material, obtaining the washing stage of the washing machine at the current time, wherein the washing stage includes the washing stage, the rinsing stage and the dehydration stage; in the case that the washing stage is the rinsing stage, increasing the rinsing times of the washing machine to a first predetermined number or increasing the rinsing time of the washing machine to a third predetermined time length to remove the foreign matter.

[0067] In the scheme, by adjusting the washing machine according to the material of the clothes to be washed and the current washing stage of the washing machine to increase the rinsing times or time length, the foreign matter can be more effectively removed. For clothes of a predetermined material, the clothes can be more thoroughly cleaned by increasing the rinsing stage, avoiding damage or affecting the material texture caused by residual foreign matter.

[0068] Specifically, first, the material of the laundry to be washed is acquired, and it is determined whether it is a predetermined material, and if the material of the laundry to be washed is the predetermined material, the washing stage of the washing machine at the current moment is acquired, and if the washing stage is the rinsing stage, the operation is performed according to the predetermined requirement: if the predetermined number of rinsing is the first time, the number of rinsing of the washing machine is increased to the first time; if the predetermined rinsing duration is the third duration, the rinsing duration of the washing machine is increased to the third duration.

[0069] For example, when the washing machine is processing a batch of silk clothes and currently enters the rinsing stage, according to the predetermined requirement, the first rinsing is required, at this time, the system will automatically increase the number of rinsing of the washing machine to the first time, so as to ensure that the foreign matter in the washing machine is completely removed and the quality of the silk clothes is protected.

[0070] The technical scheme provided by the above-mentioned embodiments of the present application solves the following problems: 1) The existing washing machine cannot effectively detect and remove paper scraps in the laundry during the washing process, resulting in residual materials after washing, which reduces the washing quality. The present application is committed to improving the efficiency of paper scrap detection and removal, reducing the impact of paper scraps on the cleanliness of the laundry, optimizing the rinsing and dehydration performance, maintaining the cleanliness of the drum and the filtration system, and improving the overall washing effect and user experience of the washing machine; 2) Lack of efficient and intelligent detection means, which cannot monitor the paper scrap situation in real time during the washing process, affecting the automation and intelligentization process of the washing program, and wasting water resources and detergents.

[0071] At the same time, the following beneficial effects are achieved:

[0072] 1) By applying semantic segmentation technology, real-time detection of paper scraps during the washing process is realized, which improves the washing accuracy and cleanliness, and can accurately identify and locate the paper scraps on the laundry and evaluate their distribution and quantity, which enables the washing machine to adjust the washing mode in real time during the washing process to effectively remove the paper scraps.

[0073] 2) After detecting the paper scraps, the key parameters (such as temperature, speed, time and water flow direction) in the dehydration program are intelligently adjusted, so as to maximize the removal efficiency of the paper scraps while ensuring sufficient rinsing and dehydration of the laundry, avoiding the difficulty of subsequent washing and drum cleaning, and the intelligent algorithm can predict and handle the washing program under suboptimal conditions, such as increasing the number of rinsing or increasing the water temperature, to maximize the removal effect of the paper scraps, which not only reduces the residual paper scraps, but also reduces the workload of the filtration system.

[0074] 3) The automation and intelligence level of the washing machine is enhanced, water resources and detergents are saved, and a more environmentally friendly washing method is realized. By accurately identifying and responding to the presence of paper scraps, the washing conditions can be adjusted without human intervention, saving unnecessary water and detergent use, which is friendly to the environment and conforms to the concept of sustainable development.

[0075] 4) Ensures long-term stable operation of the washing machine, reduces maintenance costs, reduces the impact of paper scraps on the internal structure of the washing machine, avoids problems such as pipe blockage, prolongs the service life of the washing machine, and effectively reduces the user's expenditure on equipment maintenance.

[0076] As can be seen from the above, in the embodiment of the present application, in the aspect of deep learning driven semantic segmentation algorithm, an image segmentation algorithm dedicated to the washing machine environment and an efficient paper scrap detection mechanism are developed. A convolutional neural network (CNN) is used to construct a semantic segmentation core model. This model can accurately distinguish paper scraps and clothing materials after being trained with a large number of clothing and paper scrap samples, and can realize automatic recognition and positioning of paper scraps. By using a high-resolution camera built-in the washing machine, real-time capture of clothing images can be realized, and paper scraps on the clothing can be accurately and quickly identified. This algorithm can maintain a high recognition rate even under complex texture and lighting conditions. A dynamic adjustment intelligent washing program is provided. According to the semantic segmentation result, the intelligent algorithm evaluates the amount and distribution of paper scraps, and dynamically adjusts various parameters of the washing program, such as increasing the number of rinsing in a specific stage to more thoroughly remove paper scraps, and adjusting the water temperature to optimize paper scrap dissolution and separation. In addition, the algorithm also considers the balance between clothing material and washing efficiency to avoid excessive use of water resources and affect environmental protection, while ensuring clothing protection. This dynamic adjustment mechanism not only improves the efficiency of paper scrap removal, but also takes into account resource conservation and the integrity of the clothing. In the aspect of intelligent washing process optimization, an automatic paper scrap removal function and a user interaction system are proposed. After detecting paper scraps, the user can be reminded and provided with processing suggestions, and the washing program can be automatically adjusted to determine the water inflow and washing speed. Through specific water flow mode and mechanical action, paper scraps can be effectively separated and removed from the clothing. At the same time, the frequency and effect of paper scrap treatment are recorded to enable the user to understand the usage of the washing machine. If the user does not provide timely feedback, the washing time and water temperature can be intelligently adjusted according to the paper scrap detection result to ensure that the clothing is removed from the paper scraps while achieving the best washing effect.

[0077] In order to enable those skilled in the art to more clearly understand the technical solutions of the present application, the implementation process of the foreign matter removal method in the washing machine of the present application will be described in detail below in conjunction with specific embodiments.

[0078] The present embodiment relates to a specific foreign matter removal method in a washing machine, as shown in Figure 3 The method comprises the following steps:

[0079] 1. Pre-treatment stage: During the main wash stage, the rotational speed of the laundry against the inner drum wall is set based on the weighing data. Then, through a low-speed rotation program, the laundry is loosened, and a uniform laundry distribution reference standard is established, reducing irrelevant features in image recognition. The built-in sensor of the washing machine measures and records the stack height (h), spread area (s), total mass of laundry (g), and laundry distribution state parameters (θ), creating a uniform item distribution standard.

[0080] 2. Image acquisition and processing device: During the rinse stage, the built-in camera of the washing machine captures image data. A pre-trained semantic segmentation network model is used to analyze and process the images captured by the camera in real time, achieving accurate separation of laundry and paper scraps.

[0081] 3. Paper scrap removal and washing control process: After entering the rinse stage, the washing machine continuously monitors the images captured by the camera in real time and identifies paper scraps in real time through the trained model. After detecting paper scraps, the model highlights the identified paper scrap area, estimates the difficulty of paper scraps adhering to the laundry based on the image of the inner drum, and provides it to the control system for processing. The control system automatically adjusts the washing parameters.

[0082] 4. User interaction and feedback: Through the built-in display screen or mobile application, the user is provided with real-time feedback on the paper scrap detection during the rinse stage, including paper scrap area, distribution, and snapshot images. Based on real-time feedback, the user can choose to extend the dehydration time or adjust the dehydration intensity to ensure the cleanliness of the laundry and the inside of the drum. If the user does not make adjustments, the system will follow the optimal solution to perform subsequent washing processes such as rinsing and dehydration.

[0083] 5. Record and model update: The system records the paper scrap detection results and adjustment measures during each dehydration operation for subsequent model optimization algorithm to continuously improve the efficiency of paper scrap detection and removal during the dehydration stage.

[0084] The embodiments of the present application also provide a foreign matter removal device in a washing machine. It should be noted that the foreign matter removal device in the washing machine of the embodiments of the present application can be used to execute the foreign matter removal method for the washing machine provided by the embodiments of the present application. The device is used to implement the above embodiments and preferred embodiments, and will not be described again. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware is also possible and contemplated.

[0085] The foreign matter removal device in the washing machine provided by the embodiments of the present application is described below.

[0086] Figure 8is a schematic diagram of a foreign matter removing device in a washing machine according to an embodiment of the present application. As shown in Figure 8 The device includes a processing unit 801, an acquisition unit 802, and an adjustment unit 803.

[0087] The processing unit 801 is configured to process the laundry in the washing machine to unfold the laundry.

[0088] The acquisition unit 802 is configured to acquire a target image of the laundry, input the target image into a detection model, and obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of data in the plurality of sets of historical data includes a historical image and a detection result corresponding to the historical image, the historical image is an image of the laundry acquired before the current time, and the detection result is whether the target image includes foreign matter or not.

[0089] The adjustment unit 803 is configured to adjust a running parameter of the washing machine to remove the foreign matter in a case where the detection result is that the target image includes foreign matter, and the parameter at least includes one of a water temperature of the washing machine, a rotation speed of the washing machine, and a running time length of the washing machine.

[0090] Through the embodiment, the real-time detection of foreign matter in the washing process of the washing machine can be realized by applying the machine learning technology to the detection model, the foreign matter on the laundry can be accurately identified and located, and further, in a case where the laundry has foreign matter, the running parameter of the washing machine can be adjusted in real time during the washing process, so that the paper scraps can be effectively removed.

[0091] In the specific implementation process, the processing unit includes a first acquisition module, a first determination module, a first control module, a second control module, and a third control module. The first acquisition module is configured to acquire a weight of the laundry to obtain a target weight. The first determination module is configured to determine a first target rotation speed according to the target weight, wherein the target weight is positively correlated with the first target rotation speed. The first control module is configured to control the rotation speed of the washing machine to rotate at the first target rotation speed. The second control module is configured to control the washing machine to rotate at a second target rotation speed in a first direction, wherein the second target rotation speed is less than the first target rotation speed. The third control module is configured to control the washing machine to rotate at the second target rotation speed in a second direction, wherein the first direction is opposite to the second direction.

[0092] In the scheme, the target weight is determined according to the weight of the laundry, and the first target rotation speed is determined according to the target weight, so that the rotation speed of the washing machine can be more accurately controlled, and the laundry can be properly impacted and agitated during the washing process, so that the laundry can be better cleaned. By controlling the washing machine to rotate at different speeds in two directions, the foreign matter can be effectively removed from the surface of the laundry or the fabric fibers, the washing effect can be improved, and the laundry can be cleaner and more comfortable.

[0093] In some embodiments, the obtaining unit includes a second obtaining module, a first processing module, a second determining module, and a second processing module. The second obtaining module is configured to obtain an image of the laundry to be washed to obtain an initial image. The first processing module is configured to perform processing on the initial image using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image. The second determining module is configured to determine a part of the first processed image with a brightness greater than a brightness threshold as a reflection region, and determine a pixel value of the reflection region as an average of pixel values of surrounding regions, to obtain a second processed image. The surrounding regions are parts of the first processed image adjacent to the reflection region, and the center of the surrounding region is less than a distance threshold from the center of the reflection region. The second processing module is configured to perform morphological processing on the second processed image to obtain a target image, wherein the morphological processing includes dilation processing or erosion processing.

[0094] In this scheme, by performing average processing on the pixel values of the reflection region, the interference caused by reflection can be effectively reduced, and the accuracy of foreign object detection can be improved. Through morphological processing, the image can be further optimized, making it easier to detect and distinguish foreign objects. The image contrast and brightness can be enhanced, which helps to more clearly detect foreign objects in the laundry to be washed, and can improve the efficiency of foreign object removal in the washing machine, ensuring the smooth progress of the washing process.

[0095] In the specific implementation process, the adjusting unit includes a third obtaining module, a fourth obtaining module, a first increasing module, a second increasing module, and a third increasing module. The third obtaining module is configured to obtain the number of foreign objects and the unfolded area of the foreign objects. The fourth obtaining module is configured to obtain the washing stage of the washing machine at the current time under the condition that at least one of the number is greater than a number threshold and the unfolded area is greater than an area threshold. The washing stage includes a washing stage, a rinsing stage, and a dehydration stage. The first increasing module is configured to increase the rotation speed of the washing machine to a first predetermined rotation speed to remove foreign objects when the washing stage is the washing stage. The first predetermined rotation speed is less than the maximum rotation speed of the washing machine in the washing stage. The second increasing module is configured to increase the number of rinsing times of the washing machine to a first predetermined number or increase the rinsing time of the washing machine to a first predetermined time to remove foreign objects when the washing stage is the rinsing stage. The third increasing module is configured to increase the rotation speed of the washing machine to a second predetermined rotation speed or increase the dehydration time of the washing machine to a second predetermined time to remove foreign objects when the washing stage is the dehydration stage. The second predetermined rotation speed is less than the maximum rotation speed of the washing machine in the dehydration stage.

[0096] In the scheme, by monitoring the number and spread area of foreign matters, the washing machine is adjusted and processed in time to ensure the washing effect and service life. In the washing stage, increasing the rotating speed can help remove foreign matters. In the rinsing stage, increasing the rinsing times or length can also help remove foreign matters. In the dehydration stage, increasing the rotating speed or dehydration length is also effective. Thus, foreign matters in the washing machine can be effectively removed, the washing machine can run normally when cleaning clothes, faults and damages caused by foreign matters can be avoided, the cleaning effect of the washing machine can be improved, the influence of foreign matters on the washing machine can be reduced, and the service life of the washing machine can be prolonged.

[0097] In the specific implementation process, in the case that the washing stage is the rinsing stage, the device further comprises a raising module, the raising module being configured to raise the rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than the maximum temperature of the washing machine in the washing stage.

[0098] In the scheme, by raising the rinsing water temperature of the washing machine, foreign matters remaining on clothes in the washing stage can be effectively removed. By raising the water temperature, the chemical reaction in the cleaning process can be accelerated, the washing liquid can be more easily decomposed to remove foreign matters and wash them away, the washing effect and the cleanliness of clothes can be improved, the predetermined temperature being less than the maximum temperature of the washing machine in the washing stage can avoid damage to clothes or the washing machine, and the safety and reliability of the washing process can be ensured.

[0099] In the specific implementation process, in the case that the washing stage is the rinsing stage, the device further comprises an adjusting module, the adjusting module being configured to adjust the water outlet direction of the washing machine to a predetermined direction and increase the water outlet amount of the washing machine, wherein the predetermined direction is a direction in which the water outlet of the washing machine points to at least one foreign matter.

[0100] In the scheme, by pointing the water outlet of the washing machine to foreign matters and increasing the water outlet amount, the cleaning power can be enhanced to help wash the foreign matters out of the washing machine, foreign matters in the washing machine can be effectively removed, the influence of foreign matters on the normal operation of the washing machine and the washing effect can be avoided, and the performance and efficiency of the washing machine can be maintained.

[0101] In the specific implementation process, the adjusting unit comprises a fifth acquisition module, a sixth acquisition module and a fourth increasing module. The fifth acquisition module is configured to acquire the material of the clothes to be washed and determine whether the material is a predetermined material, the predetermined material including silk material or wool material. The sixth acquisition module is configured to acquire the washing stage of the washing machine at the current time in the case that the material of the clothes to be washed is the predetermined material, wherein the washing stage includes the washing stage, the rinsing stage and the dehydration stage. The fourth increasing module is configured to increase the rinsing times of the washing machine to a first predetermined number or increase the rinsing length of the washing machine to a third predetermined length in the case that the washing stage is the rinsing stage, so as to remove foreign matters.

[0102] In the scheme, by adjusting the washing machine to increase the number of rinsing or the length of rinsing according to the material of the laundry and the current washing stage of the washing machine, the foreign matter can be removed more effectively, and the laundry of the predetermined material can be cleaned more thoroughly by increasing the rinsing stage, so as to avoid damage or affect the material texture caused by the residual foreign matter.

[0103] The foreign matter removing device in the washing machine includes a processor and a memory, the processing unit, the acquisition unit and the adjustment unit are stored in the memory as program units, and the corresponding functions are realized by executing the program units stored in the memory by the processor. The modules are located in the same processor, or the modules are located in different processors in any combination.

[0104] The processor includes a core, and the core calls the corresponding program unit from the memory. The core can be one or more, and the problem of residual foreign matter in the washing process of the washing machine in the prior art can be solved by adjusting the core parameters.

[0105] The memory can include non-permanent memory in a computer readable medium, random access memory (RAM) and / or non-volatile memory such as read-only memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.

[0106] The embodiment of the application provides a computer readable storage medium, which includes a stored program, wherein when the program runs, the computer readable storage medium controls the device where the computer readable storage medium is located to execute the foreign matter removing method in the washing machine.

[0107] Specifically, the foreign matter removing method in the washing machine includes:

[0108] Step S201, processing the laundry in the washing machine to unfold the laundry.

[0109] Specifically, by rotating the laundry, the laundry is unfolded and dispersed in the washing machine, so that better cleaning effect can be obtained in the washing process. The unfolded laundry can better contact with the detergent and water, so that each piece of laundry can be cleaned sufficiently, and the washing process is more effective.

[0110] Step S202, acquiring a target image of the laundry, inputting the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of data in the plurality of sets of historical data includes a historical image and a detection result corresponding to the historical image, the historical image is an image of the laundry obtained before the current time, and the detection result is whether the target image includes foreign matter or not.

[0111] Specifically, using the detection model can help determine whether the laundry contains foreign matter. By inputting the target image of the laundry into the detection model, a detection result can be quickly and accurately obtained to determine whether the target image contains foreign matter. In the laundry process, foreign matter can be discovered in time to avoid damage to the washing machine and the laundry. The detection accuracy and stability can be improved by using the detection model trained by multiple sets of historical data. The model can learn the characteristics of foreign matter in various situations through historical data to better determine and effectively avoid misjudgment or missed detection, ensuring the smooth progress of the laundry process.

[0112] In step S203, if the detection result is that the target image includes foreign matter, the operating parameters of the washing machine are adjusted to remove the foreign matter. The parameters include at least one of the water temperature of the washing machine, the rotation speed of the washing machine, and the running time of the washing machine.

[0113] Specifically, by increasing the rotation speed of the washing machine, the water flow speed and washing intensity in the washing barrel can be increased, so that the foreign matter can be more easily washed out of the washing machine. The running time of the washing machine can also be appropriately increased to ensure that the foreign matter is completely removed. The cleaning effect of the washing machine can be improved to ensure that the foreign matter does not damage the washing machine or affect the washing effect during washing. By adjusting the operating parameters of the washing machine, the foreign matter can be effectively removed to ensure the normal operation and washing effect of the washing machine.

[0114] Optionally, the laundry is processed to unfold the laundry, including: obtaining the weight of the laundry to obtain a target weight; determining a first target rotation speed according to the target weight, wherein the target weight is positively correlated with the first target rotation speed; controlling the rotation speed of the washing machine to rotate at the first target rotation speed; controlling the washing machine to rotate in a first direction at a second target rotation speed, wherein the second target rotation speed is less than the first target rotation speed; and controlling the washing machine to rotate in a second direction at the second target rotation speed, wherein the first direction is opposite to the second direction.

[0115] Optionally, the target image of the laundry is obtained, including: obtaining an image of the laundry to obtain an initial image; processing the initial image using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image; determining a part of the first processed image with a brightness greater than a brightness threshold as a reflection area, and determining the pixel value of the reflection area as the average value of the pixel values of the surrounding area to obtain a second processed image, the surrounding area being a part of the first processed image adjacent to the reflection area, and the distance between the center of the surrounding area and the center of the reflection area being less than a distance threshold; and performing morphological processing on the second processed image to obtain the target image, wherein the morphological processing includes dilation processing or erosion processing.

[0116] Optionally, in the case that the detection result is that the target image includes foreign matter, adjusting the operation parameter of the washing machine to remove the foreign matter, comprising: obtaining the number of the foreign matter and the unfolded area of the foreign matter; in the case that at least one of the number is greater than a number threshold and the unfolded area is greater than an area threshold, obtaining the washing stage of the washing machine at the current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the washing stage, increasing the rotation speed of the washing machine to a first predetermined rotation speed to remove the foreign matter, wherein the first predetermined rotation speed is less than the maximum rotation speed of the washing machine in the washing stage; in the case that the washing stage is the rinsing stage, increasing the rinsing times of the washing machine to a first predetermined number or increasing the rinsing time of the washing machine to a first predetermined time length to remove the foreign matter; in the case that the washing stage is the dehydration stage, increasing the rotation speed of the washing machine to a second predetermined rotation speed or increasing the dehydration time of the washing machine to a second predetermined time length to remove the foreign matter, wherein the second predetermined rotation speed is less than the maximum rotation speed of the washing machine in the dehydration stage.

[0117] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: increasing the rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than the highest temperature of the washing machine in the washing stage.

[0118] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: adjusting the water outlet direction of the washing machine to a predetermined direction, and increasing the water outlet amount of the washing machine, wherein the predetermined direction is the direction in which the water outlet of the washing machine points to at least one foreign matter.

[0119] Optionally, in the case that the detection result is that the target image includes foreign matter, adjusting the operation parameter of the washing machine to remove the foreign matter, comprising: obtaining the material of the laundry to be washed, and determining whether the material is a predetermined material, the predetermined material comprising silk material or wool material; in the case that the material of the laundry to be washed is the predetermined material, obtaining the washing stage of the washing machine at the current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the rinsing stage, increasing the rinsing times of the washing machine to a first predetermined number or increasing the rinsing time of the washing machine to a third predetermined time length to remove the foreign matter.

[0120] The embodiment of the present application provides a processor, which is used for running a program, wherein the processor executes a foreign matter removing method in a washing machine when the program is running.

[0121] The embodiment of the present application provides a device, which comprises a processor, a memory and a program stored in the memory and capable of running on the processor, and the processor executes the program to implement at least the following steps: (method right step, independent right). The device herein can be a server, a PC, a PAD, a mobile phone or the like.

[0122] The application also provides a computer program product, which, when executed on a data processing device, is adapted to execute a program that is initialized with at least the following method steps: processing the laundry to be washed in the washing machine to unfold the laundry to be washed; obtaining a target image of the laundry to be washed, inputting the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of data in the plurality of sets of historical data includes a historical image and a detection result corresponding to the historical image, the historical image is an image of the laundry to be washed obtained before the current time, and the detection result is whether the target image includes a foreign object or the target image does not include a foreign object; in the case where the detection result is that the target image includes a foreign object, adjusting the operating parameters of the washing machine to remove the foreign object, the parameters at least including one of the water temperature of the washing machine, the rotation speed of the washing machine, and the running time of the washing machine.

[0123] Optionally, the processing of the laundry to be washed to unfold the laundry to be washed includes: obtaining the weight of the laundry to be washed to obtain a target weight; determining a first target rotation speed according to the target weight, wherein the target weight is positively correlated with the first target rotation speed; controlling the rotation speed of the washing machine to rotate at the first target rotation speed; controlling the washing machine to rotate in a first direction at a second target rotation speed, wherein the second target rotation speed is less than the first target rotation speed; and controlling the washing machine to rotate in a second direction at the second target rotation speed, wherein the first direction and the second direction are opposite.

[0124] Optionally, the obtaining of the target image of the laundry to be washed includes: obtaining an image of the laundry to be washed to obtain an initial image; processing the initial image using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image; determining a part of the first processed image with a brightness greater than a brightness threshold value as a reflection region, and determining the pixel value of the reflection region as the average value of the pixel values of the surrounding region to obtain a second processed image, the surrounding region being a part of the first processed image adjacent to the reflection region, and the distance between the center of the surrounding region and the center of the reflection region being less than a distance threshold value; and performing morphological processing on the second processed image to obtain the target image, wherein the morphological processing includes dilation processing or erosion processing.

[0125] Optionally, in the case that the detection result is that the target image includes foreign matter, adjusting the operation parameter of the washing machine to remove the foreign matter, comprising: obtaining the number of the foreign matter and the unfolded area of the foreign matter; in the case that at least one of the number is greater than a number threshold and the unfolded area is greater than an area threshold, obtaining the washing stage of the washing machine at the current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the washing stage, increasing the rotation speed of the washing machine to a first predetermined rotation speed to remove the foreign matter, wherein the first predetermined rotation speed is less than the maximum rotation speed of the washing machine in the washing stage; in the case that the washing stage is the rinsing stage, increasing the rinsing number of the washing machine to a first predetermined number or increasing the rinsing time of the washing machine to a first predetermined time to remove the foreign matter; in the case that the washing stage is the dehydration stage, increasing the rotation speed of the washing machine to a second predetermined rotation speed or increasing the dehydration time of the washing machine to a second predetermined time to remove the foreign matter, wherein the second predetermined rotation speed is less than the maximum rotation speed of the washing machine in the dehydration stage.

[0126] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: increasing the rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than the maximum temperature of the washing machine in the washing stage.

[0127] Optionally, in the case that the washing stage is the rinsing stage, the method further comprises: adjusting the water outlet direction of the washing machine to a predetermined direction, and increasing the water outlet amount of the washing machine, wherein the predetermined direction is the direction in which the water outlet of the washing machine points to at least one foreign matter.

[0128] Optionally, in the case that the detection result is that the target image includes foreign matter, adjusting the operation parameter of the washing machine to remove the foreign matter, comprising: obtaining the material of the laundry to be washed, and determining whether the material is a predetermined material, the predetermined material including silk material or wool material; in the case that the material of the laundry to be washed is the predetermined material, obtaining the washing stage of the washing machine at the current time, wherein the washing stage comprises a washing stage, a rinsing stage and a dehydration stage; in the case that the washing stage is the rinsing stage, increasing the rinsing number of the washing machine to a first predetermined number or increasing the rinsing time of the washing machine to a third predetermined time to remove the foreign matter.

[0129] It should be apparent to those skilled in the art that the modules or steps of the application described above can be implemented with a general purpose computer, and can be centralized in a single computer or distributed among a network of computers, and can be implemented with program code executable by a computer, and thus can be stored in a storage device and executed by a computer, and in some cases, the steps shown or described can be executed in a different order than shown or described, or can be implemented as separate integrated circuit modules or as a single integrated circuit module, and thus the application is not limited to any particular combination of hardware and software.

[0130] Those skilled in the art will appreciate that embodiments of the application can be devised for a method, a system, or a computer program product. Accordingly, the application can be embodied in the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the application can be embodied in the form of a computer program product on one or more computer readable storage media (including, but not limited to, disk memory, CD-ROMs, optical storage media, etc.) having computer usable program code embodied thereon.

[0131] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks or in conjunction with the flowcharts described above. Figure 1 The flowchart blocks or steps can also represent a means for implementing the functions specified in the flowchart block(s) or step(s). Figure 1 The flowchart blocks or steps can also represent a means for implementing the functions specified in the flowchart block(s) or step(s).

[0132] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks or in conjunction with the flowcharts described above. Figure 1 The flowchart blocks or steps can also represent a means for implementing the functions specified in the flowchart block(s) or step(s). Figure 1 The flowchart blocks or steps can also represent a means for implementing the functions specified in the flowchart block(s) or step(s).

[0133] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks or in conjunction with the flowcharts described above.Figure 1 one or more processes and / or functions specified in one or more blocks Figure 1 one or more processes and / or functions specified in one or more blocks

[0134] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0135] Memory can include non-persistent memory and / or volatile memory, random access memory (RAM), and / or non-volatile memory, e.g., read only memory (ROM) or flash memory. Memory is an example of computer readable media.

[0136] Computer readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital versatile disc (DVD), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer readable media does not include transitory media, such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "comprising", "containing", or any other similar term are intended to encompass non-exclusive inclusions, such that a process, method, article or apparatus that comprises a list of elements does not necessarily include only those elements in the list, but can include other elements not expressly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the phrase "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus including the element.

[0138] The above merely provides preferred embodiments of the present application and is not intended to limit the present application. The present application can have various modifications and changes for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for removing foreign matter in a washing machine, characterized by, The method comprises: processing the laundry to be washed in the washing machine to unfold the laundry to be washed; obtaining a target image of the laundry to be washed, inputting the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of data in the plurality of sets of historical data comprising a historical image and a detection result corresponding to the historical image, the historical image being an image of the laundry to be washed obtained before the current time, and the detection result being that the target image includes a foreign object or that the target image does not include the foreign object; in the case where the detection result is that the target image includes the foreign object, adjusting an operating parameter of the washing machine to remove the foreign object, the operating parameter comprising at least one of a water temperature of the washing machine, a rotation speed of the washing machine, and a running time of the washing machine, in the case where the detection result is that the target image includes the foreign object, adjusting an operating parameter of the washing machine to remove the foreign object, comprising: obtaining a number of the foreign objects and an unfolded area of the foreign objects; in the case where at least one of the number is greater than a number threshold and the unfolded area is greater than an area threshold, obtaining a washing stage of the washing machine at the current time, wherein the washing stage comprises a washing stage, a rinsing stage, and a dehydration stage; in the case where the washing stage is the washing stage, increasing the rotation speed of the washing machine to a first predetermined rotation speed to remove the foreign object, wherein the first predetermined rotation speed is less than a maximum rotation speed of the washing machine in the washing stage; in the case where the washing stage is the rinsing stage, increasing a rinsing number of the washing machine to a first predetermined number or increasing a rinsing time of the washing machine to a first predetermined time to remove the foreign object; in the case where the washing stage is the dehydration stage, increasing the rotation speed of the washing machine to a second predetermined rotation speed or increasing a dehydration time of the washing machine to a second predetermined time to remove the foreign object, wherein the second predetermined rotation speed is less than a maximum rotation speed of the washing machine in the dehydration stage.

2. The method of claim 1, wherein, processing the laundry to be washed to unfold the laundry to be washed, comprising: obtaining a weight of the laundry to be washed to obtain a target weight; determining a first target rotation speed according to the target weight, wherein the target weight is positively correlated with the first target rotation speed; controlling the rotation speed of the washing machine to rotate at the first target rotation speed; controlling the washing machine to rotate in a first direction at a second target rotation speed, wherein the second target rotation speed is less than the first target rotation speed; controlling the washing machine to rotate in a second direction at the second target rotation speed, wherein the first direction and the second direction are opposite.

3. The method of claim 1, wherein, obtaining a target image of the laundry to be washed, comprising: obtaining an image of the laundry to be washed to obtain an initial image; processing the initial image by using a limited contrast self-adaptive histogram equalization algorithm to enhance the contrast and brightness of the initial image to obtain a first processed image; determine a part of the first processed image with a brightness greater than a brightness threshold as a reflection region, and determine a pixel value of the reflection region as an average of pixel values of a surrounding region, to obtain a second processed image, the surrounding region being a part of the first processed image adjacent to the reflection region, and a center of the surrounding region being less than a distance threshold from a center of the reflection region; perform morphological processing on the second processed image to obtain the target image, wherein the morphological processing includes dilation processing or erosion processing.

4. The method of claim 1, wherein, In a case where the laundry stage is the rinsing stage, the method further includes: increasing a rinsing water temperature of the washing machine to a predetermined temperature, wherein the predetermined temperature is less than a maximum temperature of the washing machine in the washing stage.

5. The method of claim 1, wherein, In a case where the laundry stage is the rinsing stage, the method further includes: adjusting a water outlet direction of the washing machine to a predetermined direction, and increasing a water outlet amount of the washing machine, wherein the predetermined direction is a direction in which a water outlet of the washing machine points to at least one of the foreign matters.

6. The method of claim 1, wherein, In a case where the detection result is that the target image includes the foreign matter, adjusting an operating parameter of the washing machine to remove the foreign matter, including: obtaining a material of the laundry to be washed, and determining whether the material is a predetermined material, the predetermined material including a silk material or a wool material; in a case where the material of the laundry to be washed is the predetermined material, obtaining a laundry stage of the washing machine at a current time, wherein the laundry stage includes a washing stage, a rinsing stage, and a dehydration stage; in a case where the laundry stage is the rinsing stage, increasing a rinsing number of the washing machine to a first predetermined number or increasing a rinsing time length of the washing machine to a third predetermined time length, to remove the foreign matter.

7. A method of removing foreign matter in a washing machine, characterized by, including: a processing unit, configured to process laundry to be washed in the washing machine, so that the laundry to be washed is unfolded; an obtaining unit, configured to obtain a target image of the laundry to be washed, input the target image into a detection model to obtain a detection result corresponding to the target image, wherein the detection model is trained by machine learning using a plurality of sets of historical data, each set of data in the plurality of sets of historical data including a historical image and a detection result corresponding to the historical image, the historical image being an image of the laundry to be washed obtained before a current time, and the detection result being that the target image includes a foreign matter or that the target image does not include the foreign matter; an adjusting unit, configured to, in a case where the detection result is that the target image includes the foreign matter, adjust an operating parameter of the washing machine to remove the foreign matter, the operating parameter including at least one of a water temperature of the washing machine, a rotation speed of the washing machine, and a running time length of the washing machine, The adjusting unit comprises a third obtaining module, a fourth obtaining module, a first increasing module, a second increasing module and a third increasing module. The third obtaining module is configured to obtain the number of the foreign matters and the spread area of the foreign matters. The fourth obtaining module is configured to obtain a washing stage of the washing machine at a current time, if at least one of the number being greater than a number threshold and the spread area being greater than an area threshold is satisfied. The washing stage comprises a washing stage, a rinsing stage and a dehydration stage. The first increasing module is configured to increase a rotating speed of the washing machine to a first predetermined rotating speed to remove the foreign matters, if the washing stage is the washing stage. The first predetermined rotating speed is less than a maximum rotating speed of the washing machine in the washing stage. The second increasing module is configured to increase a rinsing number of the washing machine to a first predetermined number or increase a rinsing time length of the washing machine to a first predetermined time length to remove the foreign matters, if the washing stage is the rinsing stage. The third increasing module is configured to increase a rotating speed of the washing machine to a second predetermined rotating speed or increase a dehydration time length of the washing machine to a second predetermined time length to remove the foreign matters, if the washing stage is the dehydration stage. The second predetermined rotating speed is less than a maximum rotating speed of the washing machine in the dehydration stage.

8. A computer-readable storage medium, characterized in that, The computer readable storage medium comprises a stored program, wherein the program, when executed, controls a device in which the computer readable storage medium is located to perform the method of any one of claims 1 to 6.

9. A computer program product comprising a computer program, characterized in that, The computer program, when executed by a processor, implements the steps of the method of any one of claims 1 to 6.

Images