Method and control unit for operating a cleaning device and cleaning device

The method and control unit in cleaning devices use image capture technology to inform users about load cleanliness, addressing the challenge of determining load status and optimizing the loading and unloading process by preventing unnecessary rinsing and improving sustainability.

EP4491089A1Pending Publication Date: 2025-01-15MIELE & CO KG
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
EP2024185588
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-10
Filing Date
2024-07-01
Publication Date
2025-01-15

AI Technical Summary

Technical Problem

Users of cleaning devices, such as dishwashers, face challenges in determining the load cleaning status, leading to potential unnecessary rinsing of already clean dishes and inefficiencies in loading and unloading processes, due to the lack of clear visibility into the cleanliness of the load.

Method used

A method and control unit that utilize an image capture device, such as a camera, to detect the load status by comparing images of the washing compartment with reference images and device parameters, providing a control signal for a user interface to display the loading status through color coding or text, ensuring users are informed about the cleanliness and readiness for loading or unloading.

Benefits of technology

This solution enhances user convenience by providing real-time information on load cleanliness and readiness, preventing unnecessary rinsing and improving sustainability by ensuring only dirty dishes are washed, thus optimizing the loading and unloading process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure IMGAF001_ABST
    Figure IMGAF001_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating a cleaning device (100) comprising a washing chamber (104) for receiving load material (102), a washing chamber door (106) for closing the washing chamber (104), and an image acquisition device (108) for capturing the washing chamber (104), wherein the method includes a step of reading image data via an interface from the image acquisition device (108) in response to a door actuation signal representing the opening or closing of the washing chamber door (106), a step of evaluating the image data using reference image data and at least one device parameter representing a current operating status of the cleaning device (100) to obtain an evaluation result, and a step of providing a control signal, depending on the evaluation result, for output to a user interface (112).wherein the control signal represents signaling information for signaling a recommendation for action to a user regarding a loading status of the cleaning device (100).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method and a control unit for operating a cleaning device and a cleaning device.

[0002] The approach presented here aims to create an improved method and an improved control unit for operating a cleaning device as well as an improved cleaning device.

[0003] According to the invention, this object is achieved by a method and a control unit for operating a cleaning device, as well as by a cleaning device having the features of the main claims. Advantageous embodiments and further developments of the invention are set forth in the following subclaims.

[0004] A method is created to display the soiling status of the load to a user of a cleaning appliance after each loading and cleaning cycle, for example, in the form of a load cleaning status. The display can inform the user whether and when they can load or unload the dishwasher. The corresponding detection can take place in the background, for example, using existing sensors.

[0005] The approach presented provides a method for operating a cleaning appliance having a wash chamber for receiving loads, a wash chamber door for closing the wash chamber, and an image capture device for capturing the wash chamber, wherein the method comprises a step of reading image data via an interface from the image capture device in response to a door actuation signal representing an opening or closing of the wash chamber door, a step of evaluating the image data using reference image data and at least one appliance parameter representing a current operating status of the cleaning appliance to obtain an evaluation result, and a step of providing a control signal dependent on the evaluation result for output to a user interface,wherein the control signal represents signaling information for signaling a recommended action for a user regarding a loading status of the cleaning device.,

[0006] The method can be used, for example, for a dishwasher, a washing machine, a washer-dryer, or other cleaning appliances that have a wash chamber, for example. The wash chamber can be described, for example, as a receiving space that can be closed off by the wash chamber door, into which loads to be cleaned can be placed. The load can be, for example, dishes or, for example, technical or medical tools, such as those used in laboratories. For example, the image capture device can be designed as a camera that can be arranged, for example, in an area of ​​the wash chamber door. The position of the image capture device advantageously makes it possible to capture as much of the wash chamber as possible, thus creating an image of the wash chamber.Advantageously, this can always occur when the wash cabinet door has been opened and additionally or alternatively closed. The reference image data can, for example, be stored on a device-internal storage unit or read from a device-external cloud. In addition, the device parameter, which can be detected by a device sensor of the cleaning device, can be read. The current operating status can represent the switched-on cleaning device, the switched-off cleaning device, a cleaning process of the cleaning device, a program start time of a cleaning program of the cleaning device or, for example, an end of the cleaning program and can be incorporated accordingly into the evaluation step and thus into the evaluation result. Furthermore, the control signal can be generated in the provision step before provision using the evaluation result.The user interface to which the control signal is output can advantageously be designed as a display device, an input device, or an operating device combining both. The user interface or operating device can also be implemented, for example, as part of a mobile device, such as a smartphone or a tablet. Advantageously, a user of the cleaning device can thus be provided with information regarding the load, which they can then act on. This means that they can be informed, for example, when there is dirty dishes in the cleaning device and there is still sufficient space for additional dishes.In this case, the user can be shown a corresponding message regarding the load cleaning status via the user interface, which can be embodied as an LED or a display, for example. Advantageously, the user interface can immediately display the current load cleaning status of the dishes in the machine each time the door is opened. This can prevent unnecessary wash cycles in which already clean dishes would be rewashed, thus improving sustainability.

[0007] According to one embodiment, the reference image data used in the evaluation step can be an empty still image representing an empty loading status of the cleaning device, and additionally or alternatively, image data read in a previous reading step. The reference image data can be stored, for example, on a storage unit of the cleaning device or retrieved, for example, via a cloud. Furthermore, the image data read in the previous reading step can, for example, be stored on the storage unit or stored in the cloud. This advantageously allows a currently relevant evaluation result to be obtained.

[0008] Furthermore, in the providing step, the control signal can be provided for output to the user interface, which can be integrated into the cleaning appliance. The user interface can, for example, be designed as an internal display unit or operating device. The user interface can, for example, additionally comprise an LED in order to be able to indicate, for example, the cleaning status of the load. This allows the status display to be clearly visible to the user at all times, so that even when dishes are being loaded, it is advantageously immediately clear whether the load in the cleaning appliance is clean or still dirty. In this way, a sustainability concept can also be pursued by displaying the load cleaning status at any time and in any situation.

[0009] According to one embodiment, in the providing step, the control signal can be provided for output to the user interface, which can be implemented as part of a mobile device. The mobile device can be implemented, for example, as a smartphone or a tablet. In this case, the user interface can be implemented, for example, as a display external to the cleaning device, to which the control signal can be wirelessly output.

[0010] In the provision step, the control signal can be provided to signal the user the signaling information via the user interface using color coding, text, or a symbol. With color coding, a color can be assigned to a loading status and a recommended action. For example, the color green can be assigned to a status "empty and ready to load." Yellow can be assigned to a status "dirty and further loading possible." Orange can advantageously indicate a status "rinsing process and reloading possible." Red can, for example, indicate a status "cleaning process and no further reloading." Blue can signal a status "clean and ready to unload." The colors are chosen here only as examples. Other colors can also be advantageously used for color coding.Advantageously, these can be colors that are intuitively interpretable for a user.

[0011] Furthermore, the method can comprise a step of processing the image data prior to the evaluation step in order to obtain processed image data. In the evaluation step, the processed image data can be evaluated using the reference image data and the at least one device parameter in order to obtain the evaluation result. In the processing step, the acquired image data can be corrected, for example, with regard to sharpness, brightness, black and white coloring, and edges or contours. This advantageously allows for a more precise evaluation in the evaluation step.

[0012] According to one embodiment, the method may include a step of storing the image data as new reference image data. Advantageously, the storing step may be performed or triggered before or after the evaluating step.

[0013] Furthermore, in a repeated acquisition step, new image data can be acquired via the interface to the image acquisition device in response to another door activation signal, representing another opening or closing of the wash chamber door. In a repeated evaluation step, the new image data can be evaluated using the new reference image data and at least one device parameter that can represent a current operating status of the cleaning appliance to obtain a new evaluation result. In a repeated provisioning step, another control signal can be provided to the user interface depending on the new evaluation result. This additional control signal can represent new signaling information to indicate a recommended action to the user regarding a new load status of the cleaning appliance.This means that the steps of the procedure can be advantageously repeated, so that the user is always offered an up-to-date recommendation for action depending on the load status. This improves user convenience, as they can immediately see whether loading or reloading the cleaning device is currently possible. The procedure also allows the current load cleaning status to be determined and displayed to the user.

[0014] The approach presented here further creates a control unit designed to execute, control, and implement the steps of a variant of the method presented here in appropriate devices. This embodiment of the invention, in the form of a device, also allows the underlying problem to be solved quickly and efficiently.

[0015] The control unit can be configured to read input signals and use these input signals to determine and provide output signals. An input signal can, for example, be a sensor signal readable via an input interface of the control unit. An output signal can be a control signal or a data signal that can be provided at an output interface of the control unit. The control unit can be configured to determine the output signals using a processing instruction implemented in hardware or software. For example, the control unit can include a logic circuit, an integrated circuit, or a software module and may be implemented as a discrete component or comprised of a discrete component.

[0016] Also advantageous is a computer program product or computer program with program code that can be stored on a machine-readable carrier or storage medium such as a semiconductor memory, a hard disk memory, or an optical memory. If the program product or program is executed on a computer or a control unit, the program product or program can be used to carry out, implement, and / or control the steps of the method according to one of the embodiments described here.

[0017] A cleaning device for cleaning loads is presented. The cleaning device comprises a washing chamber for receiving the load, a washing chamber door for closing the washing chamber, an image capture device mounted on the washing chamber door for scanning the washing chamber, and a control unit in one of the previously mentioned variants. The control unit is connected to the image capture device via a data transmission connection.

[0018] The cleaning device can, for example, be designed as an everyday household appliance or, alternatively, can be used in conjunction with a commercial or professional device, for example a medical device, such as a cleaning or disinfection device, a small sterilizer, a large-capacity disinfector, or a container washing system. The washing chamber can also be referred to as a receiving chamber. For example, the cleaning device can have one or more receiving baskets, which can be shaped and designed as inserts to accommodate the load. The cleaning device can, for example, be designed as a built-in device, the front side of which, when installed, can correspond to an outer side of the washing chamber door. The image capture device can advantageously be a camera, which can be arranged on the washing chamber door.This allows the image capture device to advantageously capture the washing area, for example when the washing area door is opened or closed.

[0019] Furthermore, the cleaning device can have a user interface for signaling a recommended action to a user regarding the cleaning device's load status. The user interface can be designed as an internal display device or as an internal input device. The user interface can advantageously be designed as a touch-sensitive display and, for example, comprise at least one LED that can illuminate in different colors.

[0020] An embodiment of the invention is shown purely schematically in the drawings and is described in more detail below. It shows Figure 1: A schematic sectional view of a cleaning device according to an embodiment; Figure 2: A schematic sectional view of an embodiment of a cleaning device; Figure 3: A schematic representation of an embodiment of a wash chamber door for a cleaning device; Figure 4: A schematic representation of an embodiment of captured image data for a cleaning device; Figure 5: A schematic representation of an embodiment of captured image data for a cleaning device; Figure 6: A schematic representation of an embodiment of captured image data for a cleaning device; Figure 7: A schematic representation of an embodiment of captured image data for a cleaning device; Figure 8: A flowchart of an embodiment of a method for operating a cleaning device; Figure 9: A block diagram of a control unit according to an embodiment of a cleaning device;and Figure 10 shows a flowchart of an embodiment of a decision chain for a method for operating a cleaning device. ;

[0021] Figure 1 shows a schematic sectional view of a cleaning appliance 100 according to an embodiment. The cleaning appliance 100 is designed here, for example, as a dishwasher, which is designed to clean load 102, such as dishes, using a method as described, for example, in Figure 8is described in more detail. The method accordingly detects a dirty, clean, and / or not yet emptied dishwasher, or load, and thus a load cleaning status of the dishes. The cleaning appliance 100 has a wash cabinet 104 for receiving the load 102, a wash cabinet door 106 for closing the wash cabinet 104, an image capture device 108 arranged on the wash cabinet door 106 for capturing the wash cabinet 104, and a control unit 110 that is connected to the image capture device 108 for data transmission.

[0022] More precisely, according to this embodiment, the image acquisition device 108 is arranged centrally on an inner side of the wash chamber door 106. The control unit 110 is designed to control and / or execute the aforementioned procedure. According to this embodiment, the cleaning device 100 additionally has a user interface 112, which is designed to signal a recommendation for action to a user regarding the load status of the cleaning device, wherein the user interface 112 is implemented as an internal display device or as an internal input device. In an alternative embodiment, the user interface 112 can be implemented as part of a mobile device.

[0023] Furthermore, the cleaning appliance 100 according to this exemplary embodiment has an illumination device 114 designed to illuminate the wash cabinet 104. The illumination device 114 is activated, for example, when the image capture device 108 is intended to capture the wash cabinet 104. In other words, the illumination device 114 is switched on when the image capture device 108 captures an image of the wash cabinet 104. By using the illumination device 114 and the resulting illumination of the wash cabinet 104, even areas in the wash cabinet 104 that are difficult to see can be captured by the image capture device 108. The image is then read in and processed in the form of image data by the control unit 110, and based thereon, a control signal for outputting the recommended action is provided from the control unit 110 to the user interface 112.

[0024] According to this embodiment, the cleaning device 100 additionally has a plurality of receiving baskets, which are designed here as a cutlery basket 116, an upper basket 118, and a lower basket 120. The receiving baskets 116, 118, 120 are arranged one above the other as inserts.

[0025] In other words, cleaning appliances 100, such as dishwashers, are used daily in households. On the one hand, they are loaded with dirty dishes 102, and once the dish racks, described here as baskets 116, 118, and 120, are sufficiently full, a corresponding wash program is started. On the other hand, after the wash cycle, the clean and dry dishes 102 are put away in kitchen cabinets for reuse. During this entire loading and unloading process, which can extend over several days, it is not easy for the user to tell whether the items 102 in the cleaning appliance 100 are clean or still dirty. With most dishes, the dirt is located at the bottom and is therefore not immediately visible. If different people are loading and unloading the cleaning appliance 100 or switching it on and off, the situation can become confusing.In the worst case, cargo 102, which has already been washed once, will be washed again, which is not sustainable.

[0026] It would be advantageous if a sensor, such as the image capture device 108 as an integrated camera in the dishwasher, detected this and presented it clearly and quickly to the user. The image capture device 108 monitors the dishes in such a way that the user can see whether the load 102 is still dirty or is already clean enough to be removed. For this purpose, the user interface 112 is used, for example, as a control panel or as a mobile device. A status indicator on the display or on the panel is the quickest way to recognize this.

[0027] Figure 2 Figure 1 shows a schematic sectional view of an exemplary embodiment of a cleaning device 100. The cleaning device 100 shown here corresponds, for example, to the one in Figure 100. Figure 1The cleaning device described. According to this embodiment, the wash chamber door 106 is shown only partially open. Here too, the cleaning device 100 has the image capture device 108 and the lighting device 114. Furthermore, the cleaning device 100 is different from the one described in Figure 1 The described cleaning device 100 is reloaded with further load material, which according to this embodiment is dirty and is represented here as a pan 200.

[0028] Figure 3 shows a schematic representation of an embodiment of a wash chamber door 106 for a cleaning device, as is found, for example, in at least one of the Figures 1 to 2described. According to this exemplary embodiment, the user interface 112 is arranged as a control panel on the wash cabinet door 106, more precisely on a door edge 300. According to this exemplary embodiment, the control panel includes a display unit 301, a lighting unit 302, a menu selection unit 304, and a program selection unit 306. Furthermore, the user interface 112 includes a switch-on unit 308 for switching the cleaning appliance on and off.

[0029] In this embodiment, the menu selection unit 304 and the program selection unit 306 are designed as buttons or, for example, as touch-sensitive areas on the door edge 300. The menu selection unit 304 is designed to change or adjust appliance settings. Using the program selection unit 306, the user can, for example, select a cleaning program from a number of available programs for the next wash cycle. These programs differ, for example, in their resource consumption and / or cleaning temperature. In this embodiment, the display unit 301 is designed as a display that shows the user information, such as the load cleaning status or load status, in text form or as a symbol. The light unit 302 is designed, for example, as an LED that can illuminate in different colors.Each color is assigned to a specific loading status, allowing the user to identify the loading status even from a distance.

[0030] For example, a green LED is linked to a loading status displayed or displayable on the display unit 301: "Machine empty! Loading possible". Furthermore, a yellow LED indicates a loading status of "Dirty! Loading possible", an orange LED indicates a loading status of "Wash process! Reloading possible", a red LED indicates a loading status of "Wash process! Do not load", and a blue LED indicates a loading status of "Clean! Please unload machine".

[0031] Figure 4 shows a schematic representation of an embodiment of captured image data 400 for a cleaning device, such as is used, for example, in at least one of the Figures 1 to 2The image data 400 represents an image of the empty wash cabinet 104 captured by the image capture device of the cleaning device, which image corresponds, for example, to an empty still image. The empty still image is used, for example, as a reference image for the Figure 1 mentioned and in Figure 8 The method described is used or can be used for this purpose. For example, the image data 400 according to this exemplary embodiment are corrected with regard to their sharpness, brightness, black and white coloring, and edges, and are thus only optionally displayed. The wash cabinet 104 is also captured here starting from the wash cabinet door, as shown, for example, in Figure 3 was described.

[0032] Figure 5 shows a schematic representation of an embodiment of captured image data 500 for a cleaning device, as described, for example, in at least one of the Figures 1 to 2 The image data 500 is similar to the data in Figure 4 described image data, wherein in Figure 5 Cargo 102 was recorded in the washing room 104.

[0033] Figure 6 shows a schematic representation of an embodiment of captured image data 600 for a cleaning device, as described for example in at least one of the Figures 1 to 2 The image data 600 is similar to the data in Figure 5 described image data. According to this embodiment, more load 102 is shown than in Figure 5 This means that the cleaning device must be switched off in the time between the shots Figure 5 and Figure 6 was reloaded.

[0034] Figure 7 shows a schematic representation of an embodiment of captured image data 700 for a cleaning device, as described for example in at least one of the Figures 1 to 2 The image data 700 are similar to those described in Figure 6described image data. According to this embodiment, more load 102 is shown than in Figure 6 This means that the cleaning device must be switched off in the time between the shots Figure 6 and Figure 7 was reloaded. Furthermore, optionally, the load 102 according to this embodiment is shown after a cleaning process and thus clean. This means that according to this embodiment, the cleaning device is ready for an unloading process by the user.

[0035] Figure 8 shows a flowchart of an embodiment of a method 800 for operating a cleaning device, as is found, for example, in at least one of the Figures 1 to 2 as described. The 800 procedure is controlled and / or executed by a control unit, such as those found in Figure 1The method 800 comprises a step 802 of reading in image data via an interface from the image capture device in response to a door actuation signal representing an opening or closing of the wash cabinet door. This means that a door actuation signal is always received when the appliance door has been opened or closed. Furthermore, the method 800 comprises a step 804 of evaluating the image data using reference image data and at least one appliance parameter representing a current operating status of the cleaning appliance in order to obtain an evaluation result. According to this exemplary embodiment, the reference image data represents an empty image representing an empty load status of the cleaning appliance and / or is image data read in in a previous reading step.The operating status indicates, for example, whether the cleaning device is switched on, switched off, and / or which cleaning program is activated. In a step 806 of providing, a control signal is provided depending on the evaluation result for output to a user interface, for example, to a display device or input device integrated into the cleaning device, or to part of a mobile terminal and thus external to the device and wirelessly. The control signal represents signaling information for signaling a recommended action for a user regarding a load status of the cleaning device. This recommended action is thus related, for example, to a load cleaning state.

[0036] According to one embodiment, the control signal is provided to indicate signaling information to the user via the user interface using color coding, text, or symbols. For example, green represents an empty and ready cleaning device. Yellow represents, for example, dirty dishes and the possibility of further loading. Orange represents, for example, an ongoing washing process where reloading is possible, and red represents, for example, a cleaning process where reloading is no longer possible. Blue represents, for example, clean items ready for unloading. These exemplary states implicitly include a recommendation for the user.

[0037] In addition, according to one embodiment, the method 800 comprises a step 808 of processing the image data before the evaluation step 804 in order to obtain processed image data, wherein in the evaluation step 804, the processed image data are evaluated using the reference image data and the at least one device parameter in order to obtain the evaluation result. The device parameter can, for example, relate to an operating state of the cleaning device. Furthermore, the method 800 optionally comprises a step 810 of storing the image data as new reference image data. The storing step 810 takes place, for example, as shown here, before or alternatively after the evaluation step 804.

[0038] According to one embodiment, steps 802, 804, 806, 808, 810 of method 800 are repeatable or are performed repeatedly, so that in a repeated reading step 802, new image data is read in via the interface to the image capture device in response to a further door actuation signal representing a further opening or closing of the wash cabinet door. In a repeated evaluation step 804, the new image data is then evaluated using the new reference image data and at least one device parameter representing a current operating status of the cleaning device to obtain a new evaluation result.In a further step 806 of the provisioning process, another control signal is provided to the user interface depending on the new evaluation result. This additional control signal represents new signaling information to indicate a recommended action for the user regarding a new loading status of the cleaning device. In this way, the user is always provided with up-to-date signaling information and thus an up-to-date recommendation for action.

[0039] Figure 9 shows a block diagram of a control unit 110 according to an embodiment of a cleaning device, as is shown for example in at least one of the Figures 1 to 2 The control unit 110 is designed to control or carry out a method for operating a cleaning device, as described, for example, in Figure 8The control unit 110 has a reading unit 900 for reading in image data 400, 500, 600, 700 via an interface from the image capture device 108, in response to a door actuation signal 902 representing the opening or closing of the wash cabinet door, as well as an evaluation unit 904 and a provision unit 906. The evaluation unit 904 is designed to evaluate the image data 400, 500, 600, 700 using reference image data 908 and at least one device parameter 910 representing a current operating status of the cleaning device, in order to obtain an evaluation result 912.The provisioning unit 906 is designed to provide a control signal 914 depending on the evaluation result 912 for output to the user interface 112, wherein the control signal 914 represents signaling information to signal a recommendation for action for a user regarding a loading status of the cleaning device.

[0040] According to one embodiment, the input unit 900 is further configured to process the input image data 400, 500, 600, 700 and provide it to the evaluation unit 904 as processed image data 916. Furthermore, the image data 400, 500, 600, 700 are stored and used as new reference image data for a subsequent run of the process, as described in Figure 8The procedure described above is used. A subsequent iteration of the process is triggered by a further door actuation signal 918, representing a further opening or closing of the wash chamber door. Accordingly, the reading unit 900 is designed to read new image data 920 via the interface to the image acquisition device 108 in response to the further door actuation signal 918. Consequently, the evaluation unit 904 is designed to evaluate the new image data 920 using the new reference image data and at least one device parameter 910, which represents a current operating status of the cleaning device, in order to obtain a new evaluation result 922.The provisioning unit 906 is designed, for example, to provide a further control signal 924 to the user interface 112 depending on the new evaluation result 922, wherein the further control signal 924 represents new signaling information to signal a recommendation for action for a user regarding a new loading status of the cleaning device.

[0041] Figure 10 shows a flowchart of an exemplary embodiment of a decision chain 1000 for a method for operating a cleaning device, as is found, for example, in Figure 8 as described. The decision chain 1000 therefore also includes the one described in Figure 8 The described steps of the procedure are related to them and are merely described in an extended manner according to this embodiment. Accordingly, the decision chain 1000 is feasible for a cleaning device, such as one found in the Figures 1 to 2was described.

[0042] A block 1002 represents a user loading or unloading the cleaning appliance with or of loads. Subsequently, in a block 1004, the opening and / or closing of the wash cabinet door is registered by a door movement sensor, after which image data is recorded and processed in a block 1006. This data is stored in a block 1008. After the loading or unloading of the cleaning appliance described in block 1002 and additionally or optionally after the recording and processing of the image data described in block 1006, an image comparison takes place in a block 1010, which is part of an evaluation of the captured images. For this purpose, the decision chain 1000 further comprises a block 1012, in which a last image and an empty image are retrieved as reference image data. In a block 1014, at least one device parameter is queried, which corresponds, for example, to a machine status.This status refers, for example, to whether the cleaning device is switched on, switched off, or in operation and represents, for example, a currently running rinsing phase. According to this embodiment, block 1010 is followed by block 1016, which checks whether the cleaning device is switched on or off.

[0043] If the cleaning device is switched off, then, according to this embodiment, a comparison of the image data with a previous image and / or with an empty image, and thus with the reference image data, follows in block 1018. In block 1020, a decision is then made as to whether the current image data is the same as the empty image, whereupon a signaling information is provided in block 1022 to indicate a recommendation for action to a user regarding the loading status of the cleaning device. The signaling information indicates, for example, that the cleaning device is empty and ready for loading. If the current image data is the same as the previous image, a signaling information is provided in block 1024, which indicates, for example, that the loading has not changed, the load is dirty, and further loading of the cleaning device is possible.If, however, the current image data differs from the empty image and the last image, block 1026 determines that the cleaning device has been further loaded and the load is contaminated. Further loading is still possible.

[0044] If the cleaning appliance is switched on, according to this exemplary embodiment, block 1016 is followed by block 1028, in which a check is made to determine whether the cleaning appliance is in dishwashing mode. More precisely, a check is made to determine whether the dishwashing program has started or ended. If the program has been started, a comparison of a current image with a most recently taken image follows in block 1030. If both images are identical, a conclusion is drawn in block 1032 that the load has not changed. If both images are different, a conclusion is drawn in block 1034 that dishes have been added. Subsequently, for both cases, signaling information is provided in block 1036, which indicates, for example, that the cleaning appliance is in dishwashing mode and that reloading is possible.However, this is no longer possible from a cleaning phase onwards, so from the beginning of the cleaning phase in block 1038 the signaling information that represents this is updated.

[0045] Once the program has finished, block 1028 is followed by block 1040, which compares the current image with the last captured image. If both images are identical, block 1042 concludes that the load has not changed. Subsequently, block 1044 infers that the load is clean and the dishes can be unloaded. If, however, the two images differ, block 1046 performs another comparison of the current image with the empty image. If the compared images are also different, block 1048 infers that the load has been removed, followed again by block 1044. If the images in the comparison performed in block 1046 are identical, block 1050 infers that the wash chamber, also referred to as the dishwasher interior, has been emptied.Subsequently, in a block 1052, signaling information is provided which indicates, for example, that the cleaning device is empty and ready for a loading process.

[0046] According to this embodiment, following the signaling information provided by blocks 1026, 1024, 1022, 1036, 1038, 1044, and 1052, a display and LED indicator, previously described as a user interface or part thereof, are updated in block 1054. For example, a variable for a mobile device can be updated in block 1056 following block 1054. Furthermore, block 1058 can represent the loading or unloading of dishes by a user following block 1054.

[0047] In other words, a camera inside the dishwasher can monitor the loading and unloading of dishes and determine the load cleaning status. Images taken at different times are compared. Based on the image information from the loading and washing process, as well as other machine parameters such as start time, operation, wash phase, and end of the wash cycle, the load cleaning status is determined. For this purpose, a photo is taken from inside the dishwasher after each loading step—that is, after the door is opened and closed—and stored along with the corresponding time and process data. During the loading process, these images are compared to provide an initial load status prediction, for example, outside of the wash cycle.Once the dishwasher is fully loaded and a wash program has started, a current image of the dishwasher's interior is captured. This image is used for several important evaluations, such as determining the load status at the start of the dishwasher (i.e., before cleaning); determining the reload status during the cleaning process to determine whether anything new has been added during the wash cycle; and using the last captured image as the start image for the subsequent machine unloading after cleaning. This image monitors the unloading process and estimates and visibly displays the load cleaning status of the dishes.

[0048] During each of these phases, an image comparison is performed, and the load status display is updated. The display can be presented in various ways, for example, using a simple color LED, the display, or directly on a mobile device such as a smartphone or tablet. On the control panel of the cleaning device, the control unit displays the status, for example, using five easy-to-understand symbols or text and / or color-coding via a color LED. The statuses are listed below with an example color coding: "Dishwasher is empty and ready to load!" [Green]; "Load is dirty, further loading possible!" [Yellow]; "Washing is in progress, reloading possible!" or [Orange]; "Washing is in progress, please do not reload!" [Red]; "Load is clean and ready to unload!" [Blue].

[0049] The colored LED display is particularly easy to see from a distance, especially in fully integrated dishwashers, in the gap between the wooden fronts, for example when the door is closed.

Claims

1. Method (800) for operating a cleaning appliance (100), wherein the cleaning appliance (100) has a washing chamber (104) for receiving load (102), a washing chamber door (106) for closing the washing chamber (104) and an image capture device (108) for capturing the washing chamber (104), wherein the method (800) comprises the following steps: - reading (802) image data (400; 500; 600; 700) via an interface from the image capture device (108) in response to a door actuation signal (902) representing an opening or closing of the washing chamber door (106); - evaluating (804) the image data (400; 500; 600; 700) using reference image data (908) and at least one device parameter (910) representing a current operating status of the cleaning device (100) in order to obtain an evaluation result (912);and - providing (806) a control signal (914) depending on the evaluation result (912) for output to a user interface (112), wherein the control signal (914) represents signaling information for signaling a recommended action for a user with regard to a loading status of the cleaning device (100); 2. Method (800) according to claim 1, wherein the reference image data (908) used in the step (804) of evaluating is an empty still image representing an empty loading status of the cleaning device (100) and / or image data (400; 500; 600; 700) read in a previous step (802) of reading in.

3. Method (800) according to one of the preceding claims, wherein in the step (806) of providing, the control signal (914) is provided for output to the user interface (112) which is integrated into the cleaning device (100).

4. The method (800) according to any one of the preceding claims, wherein in the step (806) of providing, the control signal (914) is provided for output to the user interface (112) which is implemented as part of a mobile terminal.

5. The method (800) according to any one of the preceding claims, wherein in the step (906) of providing, the control signal (914) is provided to signal the signaling information to the user by means of a color coding, as text or as a symbol via the user interface (112).

6. Method (800) according to one of the preceding claims, comprising a step (808) of processing the image data (400; 500; 600; 700) before the step (806) of evaluating in order to obtain processed image data (400; 500; 600; 700), wherein in the step (806) of evaluating the processed image data (400; 500; 600; 700) are evaluated using the reference image data (908) and the at least one device parameter (910) in order to obtain the evaluation result (912).

7. Method (800) according to one of the preceding claims, comprising a step (810) of storing the image data (400; 500; 600; 700) as new reference image data.

8. The method (800) according to claim 7, wherein, in a repeated step (802) of reading in response to a further door actuation signal (918) representing a further opening or closing of the wash cabinet door (106), new image data (920) are read in via the interface to the image capture device (108), wherein, in a repeated step (804) of evaluating, the new image data (920) are evaluated using the new reference image data and at least one device parameter (910) representing a current operating status of the cleaning device (100) to obtain a new evaluation result (922), and wherein, in a repeated step (806) of providing, a further control signal (924) is provided to the user interface (112) depending on the new evaluation result (922),wherein the further control signal (924) represents new signaling information for signaling a recommended action for a user with regard to a new loading status of the cleaning device (100).

9. Control unit (110) which is designed to carry out and / or control the steps (802, 804, 806, 808, 810) of the method (800) according to one of the preceding claims in corresponding units (900, 904, 906).

10. Computer program product with program code for carrying out the method (800) according to one of claims 1 to 8, when the computer program product is executed on a control unit (110) according to claim 9.

11. A cleaning appliance (100) for cleaning loads (102), comprising the following features: - a wash chamber (104) for receiving the load (102); - a wash chamber door (106) for closing the wash chamber (104); - an image capture device (108) arranged on the wash chamber door (106) for capturing the wash chamber (104); and - a control unit (110) according to claim 9, wherein the control unit (110) is connected to the image capture device (108) in a data-transmitting manner.

12. Cleaning device (100) according to claim 11, comprising a user interface (112) for signaling a recommended action for a user with regard to a loading status of the cleaning device (100), in particular wherein the user interface (112) is designed as a device-internal display device or as a device-internal input device.

Citation Information

Patent Citations

  • Apparatus and method for treating laundry

    US20200018005A1

  • Dishwasher with an image capture device and method for operating such a dishwasher

    DE102019110795A1

  • Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine

    EP3427630A1