Method and control unit for operating a cleaning device

Abstract

The invention relates to a method (300) for operating a cleaning device (100), wherein the method (300) comprises a step of activating (310) a lighting unit (115) to illuminate a textile (105) with ultraviolet light and a step of reading (320) an image signal (130) representing an image of the textile (105) illuminated with ultraviolet light. Furthermore, the method (300) comprises a step of evaluating (330) the image using an evaluation algorithm (145) to determine a soiling signal (150) representing an identified and / or typed soiling location (155) on the textile (105), and a step of controlling (340) the cleaning device (105) using the soiling signal (155).

Description

[0001] The invention relates to a method and a control unit for operating a cleaning device according to the main claims.

[0002] Washing clothes is one of the least favorite household chores. People want to spend as little time on it as possible. However, specific stains, such as grass, blood, or red wine, often force people to deal with the issue more thoroughly. Improper treatment of laundry can lead to irreversible damage to the clothing.

[0003] Selecting the right wash program also significantly contributes to the washing result. Many washing machines now have more than 20 programs, each with various options. Users are often overwhelmed by the number of programs and therefore frequently use only one (e.g., "Easy Care"), which doesn't always lead to optimal results. To improve this, an automatic selection of a wash or cleaning program could be implemented, based on the detected characteristics of the laundry or textiles to be cleaned or washed. However, if the normal loading process of the washing machine, or the rotating drum, is detected by a sensor (e.g., a camera), some items are usually obscured, and not all laundry items are visible.If, on the other hand, the user has to hold each item of laundry individually in front of the sensor, this means an additional effort that is unacceptable to the user.

[0004] In order for a user to select the optimal washing program, he or she should have appropriate expertise in the subject of laundry, know the available programs and settings of the washing machine or cleaning appliance in general, and / or use an assistant, which, however, means additional effort.

[0005] Furthermore, the washing machine cannot verify the user's input or knowledge. If the user makes an incorrect entry or assumption, the washing machine lacks the sensors to detect and correct this.

[0006] The approach presented here aims to create an improved method and control unit for operating a cleaning device. According to the invention, this objective is achieved by a method and a control unit with the features of the main claims. Advantageous embodiments and further developments of the invention are described in the dependent claims.

[0007] The approach presented here creates a method for operating a cleaning device, the method comprising the following steps: Activating the illumination of a textile with ultraviolet light; reading an image signal representing an image of the textile illuminated with ultraviolet light; and evaluating the image using an evaluation algorithm to determine a contamination signal representing an identified and / or typed contamination point on the textile; and controlling the cleaning device using the contamination signal.

[0008] In this context, a cleaning device can be understood as a device for washing or, more generally, cleaning textile goods, such as laundry. Such a textile item could therefore be, for example, a shirt, T-shirt, trousers, or the like, which is to be placed in a washing machine (the cleaning device) and cleaned or washed there using a cleaning program. An image signal can be understood, for example, as information about an image in which a textile item or items are depicted or represented. This image could, for instance, represent a picture that a sensor has captured of the textile item(s) in the optically visible wavelength range.An evaluation algorithm can be understood as an image processing algorithm, for example, based on an artificial intelligence algorithm, that is capable of recognizing and evaluating different structures or patterns on the textile(s) so that the position and / or type of soiling on the textile(s) can be identified, and a suitable soiling signal is then output. This soiling signal can represent a specific type of soiling, allowing, for example, a comparison of the currently used cleaning program in the cleaning device with its suitability for removing the detected type of soiling at the point of soiling.Accordingly, in the step of controlling the cleaning device, the contamination signal can be used to initiate the process, so that, for example, the cleaning device can clean the textile item(s) in such a way that the contamination on the textile item is removed.

[0009] The approach presented here is based on the finding that certain types of soiling are particularly visible under ultraviolet light. If the textile(s) are illuminated with such ultraviolet light and an image of the textile(s) is then created under this illumination, the different reflection or fluorescence behavior of un-soiled areas compared to soiled areas of the textile(s) allows the identification of both the presence and type of soiling. Once this evaluation algorithm identifies the substance that caused the soiling, the cleaning device can be easily and user-friendly configured to execute a cleaning program specifically designed to remove that type of soiling from the textile.

[0010] The approach presented here offers the advantage of automatically recognizing types of soiling on textiles. This relieves the user of the burden of selecting the most suitable cleaning program and also prevents damage to the textiles, which would otherwise occur if the user were unaware of the most appropriate cleaning program or selected a seemingly optimal but unsuitable program for the specific textiles. This requires only an image signal representing the textile illuminated with ultraviolet light, allowing a suitably trained evaluation algorithm to analyze the corresponding soiling location.

[0011] According to a particularly advantageous embodiment, the image signal can be read in the acquisition step from a sensor operating in the optical wavelength range, in particular a camera. Such an embodiment offers the advantage that such sensors can be provided cost-effectively and, in addition, a fluorescence effect can be utilized, whereby, with certain types of contamination, incident ultraviolet light leads to the emission of light in the visible wavelength range.

[0012] A further advantageous embodiment of the approach proposed here involves reading the image signal from a sensor designed to detect textiles within a detection range extending from or outside the cleaning machine. Alternatively, the image signal can be read from a sensor located in a loading door of the cleaning machine and / or designed to detect textiles within a detection range extending into a cleaning chamber of the machine. It is also conceivable that the image signal is read from a sensor at least partially surrounded by an (ultraviolet) illumination unit. For example, the sensor can be enclosed by the (ultraviolet) illumination unit on at least two sides.This design offers the advantage of allowing the sensor to scan textiles without difficulty, or ensuring sufficient ultraviolet light falls on the textiles when the image sensor captures them, thanks to the proximity of the lighting unit. At the same time, a clever arrangement of the sensor and / or lighting unit can also ensure that as little ambient light as possible enters the measurement setup and potentially leads to distorted results during evaluation by the algorithm.

[0013] Another conceivable embodiment of the approach proposed here involves activating a lighting unit to illuminate the textile with light in the visible wavelength range during the activation step. In particular, the activation of the textile with ultraviolet light is independent of the activation of the textile with light in the optically visible wavelength range. Furthermore, in the evaluation step, the soiling signal is determined taking into account the reflection and / or fluorescence behavior of the textile in visible light. In this context, reflection behavior can also be understood as fluorescence behavior, such that when light of a first wavelength is incident, light of a second wavelength is emitted.In this context, it can be advantageously exploited, for example, that such reflection behavior can be recorded very easily from a technical point of view if, for example, the light output emitted by the lighting unit on the one hand and received by the sensor from a specific position of the textile is known on the other.

[0014] According to another embodiment of the approach proposed here, the point of contamination can be identified during the evaluation step by the fact that, at this position, the textile material exhibits a different reflection and / or fluorescence behavior under ultraviolet light than under visible light, in particular, the textile material exhibits a greater or lesser reflection and / or fluorescence behavior under ultraviolet light than under visible light. Such an embodiment offers the advantage of enabling a very precise identification of the type or nature of the contamination on the textile material by comparing the different reflection and / or fluorescence behaviors in different wavelength ranges.

[0015] A particularly advantageous embodiment of the approach proposed here is one in which, during the evaluation step, a soiling caused by bodily fluids is detected if the textile exhibits a higher reflectance of ultraviolet light in the area of ​​the soiling than of light in the visible wavelength range. Bodily fluids can be understood to be, for example, urine, saliva, blood, or the like. Such an embodiment offers the advantage that bodily fluids containing proteins, in particular, exhibit strong reflectance or fluorescence, making soiling with these substances highly identifiable using the approach presented here. Furthermore, especially with these types of soiling, the activation of specific hygiene cleaning programs is advantageous in order to effectively remove such soiling from the textiles.

[0016] Furthermore, according to another embodiment of the approach proposed here, an image of the textile can be captured during the scanning step while the textile is in a stationary state. This embodiment offers the advantage, particularly with larger quantities of textiles to be cleaned in a cleaning machine, of being able to capture clear and unambiguous images of the textiles with a sufficient exposure time. If, on the other hand, a drum containing the laundry or textiles were rotating during the image capture, the typically poor lighting conditions would prevent the capture of a sufficiently high-quality image.

[0017] A particularly user-friendly embodiment of the approach proposed here involves controlling the cleaning device with one of several available cleaning programs, depending on the contamination signal, during the activation step. This embodiment offers the advantage of being able to select a suitable cleaning program based on the detected contamination, thereby relieving the user of the cleaning device and ensuring a good cleaning result.

[0018] One particularly flexible embodiment of the approach proposed here involves adjusting, in the control step and depending on the contamination signal, a temperature, quantity and / or timing of the addition of cleaning agent and / or water (set in the cleaning device for a cleaning process), the rotational speed of a drum in the cleaning device, and / or the duration of a phase of a cleaning process. These parameters, in particular, usually make a significant contribution to the cleaning result, making their adjustment particularly advantageous depending on the type of contamination detected.

[0019] To avoid errors in the detection of soiling, for example on textiles that were covered when the cleaning program started, the steps of the method can be repeated during the execution of a cleaning program, according to a particular embodiment of the approach proposed here. Such an embodiment offers the advantage of being able to detect soiling even during the running of a cleaning program and, for example, to adjust or modify the cleaning program while it is still running in order to achieve the best possible cleaning result.

[0020] The approach presented here further creates a control unit designed to execute, control, and implement the steps of a variant of the method presented here in appropriate devices. This embodiment of the invention, in the form of a device, also allows the underlying problem to be solved quickly and efficiently.

[0021] The control unit can be configured to read input signals and use these input signals to determine and provide output signals. An input signal can, for example, be a sensor signal readable via an input interface of the control unit. An output signal can be a control signal or a data signal that can be provided at an output interface of the control unit. The control unit can be configured to determine the output signals using a processing instruction implemented in hardware or software. For example, the control unit can include a logic circuit, an integrated circuit, or a software module and may be implemented as a discrete component or comprised of a discrete component.

[0022] A cleaning device with a variant of the control unit presented here is also advantageous. The advantages presented here can also be realized quickly and efficiently with such a design.

[0023] A computer program product or computer program with program code that can be stored on a machine-readable medium such as semiconductor memory, hard disk memory, or optical memory is also advantageous. If the program product or program is executed on a computer or control unit, it can be used to carry out, implement, and / or control the steps of the method according to one of the embodiments described herein.

[0024] Although the described approach is based on a household appliance, the approach described here can be used accordingly in connection with a commercial or professional device, for example a medical device, such as a cleaning or disinfection device, a small sterilizer, a large-capacity disinfector or a container washing system.

[0025] Exemplary embodiments of the invention are shown purely schematically in the drawings and are described in more detail below. It shows Figure 1 is a schematic representation of a cleaning device; an embodiment of the approach presented here; Figure 2 is a schematic representation of another embodiment of a cleaning device; and Figure 3 is a flowchart of an embodiment of a method for operating a cleaning device.

[0026] Figure 1Figure 1 shows a schematic representation of a cleaning device 100, an embodiment of the approach presented here. The cleaning device 100 is designed as a washing machine in which laundry items or textiles can be cleaned as textile goods 105. To implement the approach presented here, it comprises a sensor 110 and a lighting unit 115 to illuminate the textile goods 105 and to capture an optical image of this illuminated textile goods 105 using the sensor 110. The lighting unit 115 is specially designed to illuminate the textile goods 105 with ultraviolet light. The sensor 110 is designed, for example, as a camera to capture an image of this textile goods 105 in the spectral range of visible light.The interaction of the lighting unit 115 with the sensor 110 can be controlled by a control unit 120. In the control unit 120, the lighting unit 115 is first activated in an activation unit 125 to emit ultraviolet light. Subsequently, the image signal 130 is read in via an input interface 135 of the control unit 120. The image signal 130 is then evaluated in an evaluation unit 140 using an evaluation algorithm 145 to determine a contamination signal 150, which represents an identified and / or typed contamination point 155 on the textile 105. Finally, the cleaning device 100 is controlled in a control unit 160 of the control unit 120 using the contamination signal 150.

[0027] In the Figure 1In the illustrated embodiment of the cleaning device 100, the sensor 110 and the lighting unit 115 are arranged in the area of ​​a control panel on the front of the cleaning device 105, such that the camera's detection area 165 is oriented away from the cleaning device. This allows a user of the washing machine (which acts as the cleaning device 100) to hold the laundry items or textiles 105 in front of the camera to capture the image. However, it is also conceivable that the camera 110 is oriented so that the detection area 165 is directed towards a floor area in front of the cleaning device 105, so that, for example, laundry items 105 in a laundry basket placed in front of the cleaning device 105 can also be captured.Such an arrangement has the advantage that a large amount of light falls on the textile goods 105, so that a quick and unambiguous detection of the structure or surface texture of these textile goods 105 can be achieved.

[0028] Figure 2Figure 1 shows a schematic representation of another embodiment of a cleaning device 100. This embodiment includes a loading opening 200 and a loading door 210. The camera, acting as a sensor 110, is arranged directly in or on the loading door 210 and is oriented, for example, such that the detection area 165 (when the loading door 210 is closed) is directed into an interior space or the drum of the cleaning device 105. This allows for continuous monitoring of the laundry items or textiles 105, even during the cleaning program. Such an embodiment also offers advantages such that textiles 105 with previously concealed soiling 155 can be moved during the cleaning program, and these soiling 155 may then become visible or detectable later.It is also possible, for example, to make timely corrections to individual parameters during the execution of the cleaning program, which is controlled by the control unit 120 via the control signal. These parameters include adjusting the temperature, the quantity and / or timing of the addition of cleaning agent and / or water during a cleaning process performed by the cleaning device 105, the rotational speed of a drum in the cleaning device 105, and / or the duration of a phase of a cleaning process in the cleaning device 105. In this way, the cleaning result can be optimized.

[0029] Furthermore, the lighting unit 115 can also be arranged at least partially, in this case in a ring shape, around the sensor 110. This allows for optimal illumination of the detection area 165, so that the detection or identification of the contamination point 155 is clearly possible. At the same time, interference effects that would be caused by extraneous light entering the drum can also be avoided or suppressed.

[0030] It is also conceivable that the in the Figure 1 and 2The described lighting unit 115 is designed to emit light in the visible spectral range, advantageously allowing for independent control or activation of the output of ultraviolet (UV) and / or visible light. Thus, for example, pure UV light can be emitted, as can pure visible light, or both UV and visible light simultaneously. Separate control of the output light intensity is also possible. Furthermore, an embodiment is conceivable in which the lighting unit 115 has two separate light sources, each controllable independently, for emitting light from different spectral ranges. The [details of the description] Figure 1The described evaluation unit 140 can, for example, also be designed to jointly evaluate the spectral components of the visible light and UV light contained in the image signal 130, thus enabling a further improved detection or identification of the contamination point 155 on the textile material 105.

[0031] Essentially, the approach presented here offers the possibility of improved data analysis using a camera when, in addition to visible light, the textile material 105 is irradiated with UV light. This allows for the determination of further relevant information for the optimal cleaning of the laundry batch. The aforementioned disadvantages can be overcome by analyzing data from additional sensors. Since individual sensors often have system-related limitations, it is advantageous to combine several different sensors into a single sensor unit. A central sensor, designed as a camera, can be used for this purpose. A typical camera, for example, as sensor 110, captures the spectrum visible to humans. However, for determining the laundry characteristics, it is also advantageous to capture other spectra using appropriate cameras, e.g., in the ultraviolet range.It should be noted that CMOS sensors for the UV spectrum, as well as the corresponding UV-transmitting lenses, are relatively expensive and not widely available compared to cameras for the visible spectrum. To nevertheless be able to use commercially available cameras, the fluorescence of certain substances under UV light can be utilized, as many objects illuminated with UV light, especially white cotton, fluoresce in the visible spectrum with a blue-violet color (similar to the glow of a white shirt in a nightclub). For the context of "washing," the following fluorescent objects are particularly important, as they exhibit very advantageous behavior for detecting soiling. Therefore, the approach presented here is specifically suitable for soiling white textiles, the use of bleach in detergents, and the identification of bodily fluids (e.g., urine, sweat, etc.).Blood or urine), cosmetics, olive oil, rapeseed oil, highlighters, pens, ketchup and / or honey are suitable, as this combination allows for particularly good identification of different types of substances or soiling.

[0032] If the camera sensor is integrated into the washing machine door, for example, the UV light can advantageously be arranged in a ring around the camera. This position allows the camera to capture the inside of the drum when the door is closed and the area in front of the washing machine when it is open. The door placement is considered advantageous because, with the door closed and opaque, no ambient light can enter the drum. The same advantage is achieved if the camera and UV light source are arranged around a section of the door seal, facing into the drum.

[0033] The camera and UV lighting can also be installed in other locations, e.g., in the control panel or on the front of the washing machine, as described in relation to... Figure 1 This is illustrated. In this case, additional measures can advantageously be taken to minimize ambient light from the visible spectrum. This can be achieved, for example, by holding the individual items of laundry in front of a sensor window for image capture. The sensor window is completely covered so that little or no ambient light reaches the textile.

[0034] Since, as previously described, a camera operating in the visible spectrum of light can be used, this camera can be used not only as a sensor for fluorescence under black light. Color detection is also possible with the camera as a sensor. For this purpose, for example, additional lighting in the visible spectrum can be used. In order for the camera to operate in both the UV and visible spectrum, both light sources should be controllable independently. The lighting can be controlled directly via the camera (as a so-called trigger signal) or via a higher-level control system.

[0035] Especially when classifying stains, combining images taken with fluorescent black light and visible light is considered advantageous. If a stain is not visible under visible light but is visible under black light, it is likely to be bodily fluids such as urine. If a stain that appears red in the visible spectrum fluoresces, it is probably blood. If it did not fluoresce, it could be, for example, tomato sauce. This information allows for optimal treatment of the identified stains.

[0036] In addition to stain detection, the system can also detect individual laundry items. Detecting laundry items requires longer camera exposure times because the light emitted by the fluorescent objects loses energy. Therefore, it is considered advantageous to capture a stationary scene, such as one where the drum is not rotating.

[0037] The following three examples illustrate the possible use cases: Example 1:

[0038] The bleach in the detergent is fluorescent, so its type can be identified after the detergent has been added to the wash. Furthermore, it's possible to determine whether the detergent has been completely rinsed out during the rinsing process. This ensures that the detergent is fully rinsed away and that no more water than necessary has been used. Example 2:

[0039] If there are only white laundry items in the washing machine, the process technology can be adapted and a higher proportion of bleach can be used as an additive to a cleaning agent. Example 3:

[0040] Identifying stains on laundry items allows you to determine the degree of soiling. Furthermore, by identifying the type of stain, you can adjust the washing parameters accordingly. For example, if a red, fluorescent stain is blood, it can initially be washed out at low temperatures. If bodily fluids such as urine are detected, the laundry should be classified as hygiene laundry.

[0041] The approach presented here allows for the automation of the selection of the washing or cleaning program, or at least individual parameters of that program. Essentially, the system can recognize washing-relevant characteristics for individual items of laundry, such as color, fabric type, composition, and potentially even the shape of the garment. If individual items cannot be identified, the system can at least determine the dominant color components for the entire load.

[0042] The approach presented here allows users with limited laundry knowledge or interest to be professionally supported and relieved of the burden of laundry through the cleaning machine's sensor technology and control system. On the one hand, sorting is simplified for users, requiring them to differentiate based on only a few criteria (light / dark, new / old, hygiene / standard laundry, hand wash / normal laundry). On the other hand, users benefit from reduced anxiety, as the cognitive burden of potentially damaging the laundry is lessened, since the process technology and control system adapt to the specific load of laundry being cleaned.

[0043] On the other hand, the approach presented here saves users time, as they no longer need to make any or very few adjustments to the washing machine themselves. This system gives people with disabilities the opportunity to wash their clothes independently and to clean them intuitively and self-explanatorily. Furthermore, it ensures that only the correct amount of detergent and bleach is used. Thanks to color recognition, for example, environmentally harmful bleach can be dosed correctly, and less chemical is rinsed out.

[0044] Figure 3Figure 300 shows a flowchart of an embodiment of the approach presented here as method 300 for operating a cleaning device. The method includes a step 310 of activating the illumination of a textile with ultraviolet light. Furthermore, method 300 includes a step 320 of reading an image signal representing an image of the textile illuminated with ultraviolet light, and a step 330 of evaluating the image using an evaluation algorithm to determine a contamination signal representing an identified and / or typed contamination point on the textile. Finally, method 300 includes a step 340 of controlling the cleaning device using the contamination signal.

Claims

1. A method (300) for operating a cleaning device (100), the method (300) comprising the following steps: - activating (310) a lighting unit (115) for illuminating a textile item (105) with ultraviolet light; - reading (320) an image signal (130) representing an image of the textile item (105) illuminated with ultraviolet light; and - evaluating (330) the image using an evaluation algorithm (145) to determine a soiling signal (150) representing an identified and / or typified soiling location (155) on the textile item (105); and - controlling (340) the cleaning device (105) using the soiling signal (155).

2. Method (300) according to claim 1, wherein in the step (312) of reading in the image signal (130) is read in by a sensor (110) detecting in the optical wavelength range, in particular a camera.

3. Method (300) according to claim 2, wherein in the step (320) of reading in, the image signal (130) is read in by a sensor (110) which is designed to detect textile goods (105) in a detection area (165) extending out of the cleaning device (100) and / or wherein the image signal (130) is read in by a sensor (110) which is arranged in a loading door (210) of the cleaning device (100) and / or which is designed to detect textile goods (105) in a detection area (165) extending into a cleaning chamber (200) of the cleaning device (100) and / or wherein the image signal (130) is read in by a sensor (110) which is at least partially surrounded by the lighting unit (115).

4. Method (300) according to one of the preceding claims, wherein in the step (310) of activation, an illumination unit (115) of the textile material (105) is controlled for illumination with light in the visible wavelength range, in particular wherein the activation of the illumination of the textile material (105) with ultraviolet light takes place independently of an activation of the illumination of the textile material (105) with light in the optically visible wavelength range and wherein in the step (330) of evaluation, the contamination signal (155) is further determined taking into account a reflection behavior and / or fluorescence behavior of the textile material (105) in visible light.

5. Method (300) according to one of the preceding claims, wherein in the step (330) of evaluating the contamination point (155) is detected at a position in that at this position the textile material (105) has a different reflection behavior and / or fluorescence behavior when illuminated by ultraviolet light than in optically visible light, in particular wherein the textile material (105) has a greater or lesser reflection behavior and / or fluorescence behavior when illuminated by ultraviolet light than in optically visible light.

6. Method (300) according to claim 5, wherein in the step (330) of evaluating, a contamination point (155) caused by the action of a body fluid is detected if the textile material (105) in the region of the contamination point (155) has a greater reflection behavior and / or fluorescence behavior for ultraviolet light than for light in the visible wavelength range.

7. Method (300) according to one of the preceding claims, wherein in the step (320) of reading in an image of the textile material (105) is read in, during the recording of which image the textile material (105) is in a resting state.

8. Method (300) according to one of the preceding claims, wherein in the step (340) of controlling the cleaning device (100) is controlled with one of a plurality of available cleaning programs depending on the contamination signal (150).

9. Method (300) according to one of the preceding claims, wherein in the step (340) of controlling, depending on the contamination signal (150), a temperature to be set in the cleaning device (100) for a cleaning process, an amount and / or a time of addition of cleaning agent and / or water during a cleaning process carried out by the cleaning device (100), a rotational speed of a drum of the cleaning device (100) and / or a duration of a phase of a cleaning process in the cleaning device (100) is changed.

10. Method (300) according to one of the preceding claims, wherein the steps (310, 320, 330, 340) of the method (300) are repeatedly executed during the execution of a cleaning program.

11. Control unit (120) which is designed to carry out and / or control the steps of the method (300) according to one of the preceding claims in corresponding units (125, 135, 140, 160).

12. Cleaning device (100) with a control unit (120) according to claim 11.

13. Computer program product with program code for carrying out the method (300) according to one of claims 1 to 10, when the computer program product is executed on a control unit (120) according to claim 11.

Images