OPERATING DEVICE AND METHOD FOR OPERATING A CLEANING DEVICE AND CLEANING DEVICE

Description

[0001] The approach presented here relates to an operating device and a method for operating a cleaning device and a cleaning device.

[0002] DE 10 2014 011 771 A1 describes an operating device for an electronic household appliance.

[0003] EP 3 543 390 B1 discloses an operating device for operating a cleaning device which has a camera in the region of the display unit, wherein a camera signal from the camera can be read in by means of a reading unit.

[0004] DE 10 2015 222 580 A1 discloses a dishwasher with an image recognition device for detecting the presence of a living being in a specific area in front of the dishwasher, whereby a user gesture in the vicinity of the dishwasher can be recognized and an automatic opening of the door can be initiated.

[0005] US 2017 / 205891 A1 discloses a device control system with a camera for recording user gestures.

[0006] US 2021 / 127943 A1 discloses a dishwasher with an interior camera for monitoring the interior of the dishwasher. A control unit of the dishwasher is configured to detect a hand movement from outside into the interior of the dishwasher based on camera signals and subsequently determine whether a piece of crockery is being inserted into the dishwasher. Depending on the type of crockery inserted, a corresponding indication regarding the appropriate placement of the piece of crockery in a dish basket of the dishwasher can then be issued.

[0007] The approach presented here is based on the task of creating an improved operating device for operating a cleaning device, an improved method for operating a cleaning device and an improved cleaning device.

[0008] According to the invention, this object is achieved by an operating device for operating a cleaning device, a method for operating a cleaning device, and a cleaning device having the features and steps of the main claims. The present approach also relates to a computer program. Advantageous embodiments and further developments of the approach are set out in the following subclaims.

[0009] The advantages achievable with the approach presented here are that an intuitively feasible way of operating a cleaning device is created for a user of the cleaning device.

[0010] An operating device for operating a cleaning device with at least one movable device component and at least one camera comprises a read-in unit and an output unit. The read-in unit is configured to read a camera signal from the camera, wherein the camera signal represents an image of a user's hand against a defined background. The output unit is configured to output a control signal for moving the device component of the cleaning device depending on the camera signal.

[0011] The camera is an interior camera for monitoring the interior of the cleaning device. The cleaning device can be a household appliance, a commercial or professional device, such as a dishwasher / dishwasher or dishwashing system, or a medical device, such as a cleaning or disinfection device, a small-scale sterilizer, a large-capacity disinfector, or a container washing system. If the cleaning device is a dishwasher, the camera can serve as an interior camera, for example, to monitor a washing chamber of the cleaning device. The control device can also have several interior cameras and, optionally, several exterior cameras.The camera signal can represent the image of any portion of the user's hand against the defined background. This means that the presence of the hand against the defined background is sufficient for the camera to generate the camera signal, and, for example, no defined position or gesture of the hand against the background is necessary to generate the camera signal. The operating device can also be referred to as a so-called "classifier" or have such a classifier, which is designed to classify, for example, distinguish, different camera signals from the camera. The device component can be a device component that can be operated by the user, such as an appliance door or a dish basket of the cleaning appliance.The operating device presented here makes it possible to trigger a movement of the device component, for example, closing and / or opening the device door and / or retracting and / or extending the dish racks, using an optical pattern composed of a defined area of ​​a background image and an image of the user's hand. This advantageously enables intuitive, automated operation of the device component for the user, whereby the user advantageously does not have to memorize specific gestures to operate the cleaning device. Thanks to the operating device, physical exertion for the user can be avoided. This is particularly advantageous in commercial applications where the cleaning device is used frequently.

[0012] The reading unit can be designed to read in a first camera signal which, as the image, represents a user's hand in the region of a door pushrod in front of a loading opening of the cleaning device, wherein the output unit is designed to output a door closing signal for closing a device door of the cleaning device using the first camera signal as the control signal. The first camera signal can be provided by a first camera of the cleaning device, wherein the first camera can be designed as an interior camera. If the defined background therefore represents the loading opening, it can be concluded that the device door is open if the interior camera images the loading opening. The presence of the user's hand in the region of the door pushrod can indicate that operation of the device door is desired.This allows an automated and easy-to-use door closing function for the cleaning device to be implemented.

[0013] The reading unit can additionally be configured to read in a second camera signal, which represents, as the image, a user's hand in the region of a display unit of the cleaning device in front of an environment arranged externally of the cleaning device. The output unit is configured to output a door opening signal for opening a device door of the cleaning device using the second camera signal as the control signal. The second camera signal can be provided by a second camera of the cleaning device, wherein the second camera can be configured as an external camera. If the defined background therefore represents the environment, it can be concluded that the device door is closed when the external camera images this environment.In this context, a floor that would be depicted when the appliance door is open is not to be understood as an environment; rather, the environment is to be understood as a living environment, for example a defined living area arranged opposite the cleaning appliance, such as a piece of furniture arranged opposite.

[0014] The reading unit can additionally be configured to read in a second or further second camera signal, which represents an image of a user's foot or shoe in the area of ​​a display unit of the cleaning device in front of a floor, wherein the output unit is configured to output a door closing signal for closing a device door of the cleaning device using the second or further second camera signal as the control signal. The second camera signal can be provided by a second camera of the cleaning device, wherein the second camera can be configured as an external camera. If the defined background therefore represents the floor, it can be concluded that the device door is open if the external camera images this environment.

[0015] The display unit can be part of a control panel of the cleaning appliance or arranged in the area of ​​such a control panel. The control panel can be provided for manual adjustment of cleaning functions of the cleaning appliance by the user. The presence of the user's hand and / or foot or a shoe in the area of ​​the display unit can indicate that operation of the appliance door is desired. In this way, an automated and easy-to-use door opening and / or closing function for the cleaning appliance can be implemented. The door opening signal can be designed to cause the appliance door to open completely or merely to open the appliance door a crack. The door closing signal can be designed to cause the appliance door to close or to close the appliance door with subsequent automatic program start of a washing program.

[0016] The reading unit can additionally or alternatively be designed to read in a further camera signal which, as the image, represents a user's hand in the area of ​​a dish basket of the cleaning appliance in front of a loading opening of the cleaning appliance, wherein the output unit is designed to output a dish basket signal for moving the dish basket using the further camera signal as the dish basket signal. The further camera signal can be provided by the first camera or a further first camera of the cleaning appliance, wherein the further first camera can be designed as a further interior camera. If the defined background therefore represents the loading opening, it can be concluded that the appliance door is open if the interior camera images the loading opening.The presence of the user's hand in the area of ​​the dish basket can indicate that the user wants to operate the dish basket. This allows for an automated and easy-to-use movement function for the dish basket to be implemented.

[0017] For example, the reading unit can be designed to read in a first further camera signal as the further camera signal, which represents the image of the user's hand in front of the loading opening in the region of the dish basket arranged in a state protruding from a washing chamber of the cleaning appliance, wherein the output unit is designed to output a first dish basket signal for retracting the dish basket into the washing chamber using the first further camera signal as the dish basket signal. If the dish basket is arranged in the state protruding from a washing chamber, it can be assumed that the user wishes the dish basket to be retracted into the washing chamber. In this way, an automated and easy-to-operate retraction function for the dish basket can be implemented.

[0018] According to one embodiment, the reading unit can additionally or alternatively be configured to read in a second camera signal as the additional camera signal, which represents the user's hand in front of the loading opening in the region of the dish basket arranged in a pushed-in state in the washing compartment of the cleaning appliance, wherein the output unit is configured to output a second dish basket signal for extending the dish basket out of the washing compartment using the second camera signal as the dish basket signal. If the dish basket is arranged in the pushed-in state in the washing compartment of the cleaning appliance, it can be assumed that the user wishes the dish basket to be extended into the washing compartment. In this way, an automated and easy-to-operate extension function for the dish basket can be implemented.If the cleaning appliance has multiple dish racks, different regions within the dish rack area, for example, different regions within the wash cabinet, can be defined for outputting the first and / or second dish rack signal. For example, one corner of the wash cabinet can be assigned to a first dish rack, and an opposite corner of the wash cabinet can be assigned to a second dish rack. If the camera detects the user's hand in one of the two corners, the corresponding dish rack is retracted or extended. If both areas are occupied by both hands simultaneously, a rack movement device moves both the first and second dish racks in response to the first and / or second dish rack signal.

[0019] It is further advantageous if the reading unit is configured, according to one embodiment, to query the camera signal when a program termination signal is present, representing a completed or interrupted cleaning program of the cleaning device. This ensures that the user can move the device component automatically using the operating device when the program is completed or aborted.

[0020] The reading unit can further be configured to read in an image signal from the camera, which represents a camera image from the camera, and to perform a function of the cleaning device using the image signal that is independent of any movement of the device component, in particular to control a unit for load detection according to type and / or quantity, soiling detection, drying monitoring, and / or detection of a spray arm blockage of the cleaning device. The image signal can represent a camera image from the camera that does not depict a hand and / or is read in when an operating signal is present, which represents a cleaning operation of the cleaning device. The reading unit can thus be configured to further use image signals from the camera for other functions.

[0021] A cleaning device comprises an operating device in one of the variants described above, at least one movable device component, and at least one camera. The camera is configured to capture the image and provide the camera signal representing the image. A cleaning device presented here can serve as a replacement for known cleaning devices, with the cleaning device presented advantageously realizing the advantages of the operating device.

[0022] The cleaning device can be designed as a dishwasher, also called a "dishwasher".

[0023] A method for operating a cleaning device with at least one camera and at least one movable device component comprises a reading step and an output step. In the reading step, a camera signal is read from the camera, wherein the camera signal represents an image of a user's hand against a defined background. In the output step, a control signal for moving the device component of the cleaning device is output depending on the camera signal.

[0024] The method can be implemented, for example, in software or hardware, or in a combination of software and hardware, for example, in the previously described operating device, which can be part of a control unit. Such a method can also realize the previously described advantages of the device in a technically simple and cost-effective manner.

[0025] Also advantageous is a computer program product or computer program with program code that can be stored on a machine-readable carrier or storage medium such as a semiconductor memory, a hard disk memory, or an optical memory. If the program product or program is executed on a computer or device, the program product or program can be used to carry out, implement, and / or control the steps of the method according to one of the embodiments described above.

[0026] Examples of the approach are shown purely schematically in the drawings and are described in more detail below. Figure 1 shows a side view of a cleaning device; Figure 2 shows a perspective view of a cleaning device with an operating device according to an embodiment for operating the cleaning device; Figure 3 shows a side view of a cleaning device with an operating device according to an embodiment; Figure 4 shows an environment arranged externally of the cleaning device for use with an operating device according to an embodiment; Figure 5 shows a side view of a cleaning device with an operating device according to an embodiment; Figure 6 shows a side view of a cleaning device with an operating device according to an embodiment; Figure 7 shows a side view of a cleaning device with an operating device according to an embodiment; Figure 8 shows a perspective front view of a cleaning device with an operating device according to an embodiment;Figure 9 shows a perspective front view of a cleaning device with an operating device 200 according to an exemplary embodiment; Figure 10 shows a section of a perspective front view of a cleaning device with an operating device according to an exemplary embodiment; Figure 11 shows a perspective front view of a cleaning device with an operating device according to an exemplary embodiment; Figure 12 shows a schematic representation of an operating device according to an exemplary embodiment; Figure 13 shows a flow diagram of a method according to an exemplary embodiment for operating a cleaning device with at least one camera and at least one movable device component; and Figure 14 shows a block diagram of a method according to an exemplary embodiment for operating a cleaning device.

[0027] In the following description of advantageous embodiments of the present approach, the same or similar reference numerals are used for the elements shown in the various figures and having a similar effect, whereby a repeated description of these elements is omitted.

[0028] Figure 1 shows a side view of a cleaning device 100.

[0029] The cleaning appliance 100 is configured as a dishwasher and comprises a washing chamber 105 for receiving and cleaning dishes, an appliance door 110 for opening and closing the washing chamber 105, an automatic door movement device 112 with a door opening device 115 with a door pusher 120, an interior camera 125 directed, here for example, into the washing chamber 105, a lighting device 130 arranged in the washing chamber 105, an appliance control 135, and / or a worktop 137. The door opening device 115 comprises, for example, a door lock, a camera, and / or a motor.

[0030] In the washing compartment 105, three dish baskets 140 are arranged, for example, which can also be automatically retracted and extended by a basket movement device 145. The appliance door 110 can be automatically opened by means of the door opening device 115 with door plunger 120. The appliance door 110 can be automatically closed by means of the automatic door movement device 112. Operating processes can be triggered, for example, by gestures. In order to capture the gestures of an operator's hand, a camera is usually located in the control panel of the dishwasher or household appliance. Overall, the basket movement device 145, door movement device 112, and / or door opening device 115 can be activated by physically present sensors. The movement of the automated basket movement device 145, door movement device 112, and / or door opening device 115 is activated by a trigger sensor system.This trigger sensor system is not directly visible, cannot be operated intuitively, and often cannot be identified as such. Therefore, different sensors are provided for the different automated devices 112, 115, and 145.

[0031] Figure 2 shows a perspective view of a cleaning device 100 with an operating device 200 according to an embodiment for operating the cleaning device 100. The cleaning device 100 can be the one shown in Fig. 1 The cleaning device 100 described in this document is different from Fig. 1 As described, thanks to the operating device 200, the movement processes of the automated door movement device 112, door opening device 115 and / or basket movement device 145 of the cleaning device 100 are triggered by means of pattern recognition from a specific background image and the hand 225 of the operator.

[0032] For example only, the operating device 200 according to this embodiment is arranged in or on the cleaning device 100, for example in the Fig. 1 The cleaning device 100 has at least one movable device component, here in the form of the appliance door 110 and / or at least one dish basket 140, and at least one camera, which is designed here as the interior camera 125. Here in Fig. 2 is an application example of the operating device 200 using the Fig. 1 The interior camera 125 of the cleaning appliance 100 is described. According to this exemplary embodiment, the interior camera 125 is arranged on an inside of the appliance door 110 facing the washing compartment 105. In addition, the operating device 200 is controlled using a control device shown, for example, in Fig. 3shown external camera for monitoring an environment of the cleaning device 100 arranged outside the cleaning device 100.

[0033] The operating device 200 has a reading unit 210 and an output unit 215. The reading unit 210 is configured to read a camera signal 220 from the camera 125, wherein the camera signal 220 represents an image of a user's hand 225 against a defined background. The output unit 215 is configured to output a control signal 230 for moving the device component of the cleaning device 100 depending on the camera signal 220.

[0034] According to various embodiments, the cleaning device 100 is configured either as a household appliance or as a commercial or professional device. According to this embodiment, the camera signal 220 represents the image of any portion of the user's hand 225 against the defined background. This means that, for the camera 125, the presence of the hand 225 against the defined background is sufficient to generate the camera signal 220, and, for example, no defined position or gesture of the hand 225 against the background is necessary to generate the camera signal 220.

[0035] According to this exemplary embodiment, the reading unit 210 is designed to read in a first camera signal 235, which represents, as the image, a hand 225 of a user in the area 237 of the door plunger 120 in front of a loading opening 240 of the cleaning device 100. The output unit 215 is designed to output a door closing signal 245 for closing 250 an appliance door 110 of the cleaning device 100 using the first camera signal 235 as the control signal 230. The first camera signal 235 is provided by the interior camera 125 according to this exemplary embodiment. For opening and / or closing 250 the appliance door, the door movement device 112 has the door opening device 115 with at least one motor M coupled to the appliance door 110 and / or one motor M coupled to the door plunger 120.

[0036] According to this exemplary embodiment, the reading unit 210 is designed to query the camera signal 220 upon the presence of a program termination signal, which represents a completed or interrupted cleaning program of the cleaning device 100. Furthermore, according to this exemplary embodiment, the reading unit 210 is designed to read in an image signal from the interior camera 125 and / or exterior camera, which represents a camera image of the interior camera 125 and / or exterior camera, and to use the image signal to perform a function of the cleaning device 100 that is independent of a movement of the device component, in particular to control a unit for load detection by type and / or quantity, soiling detection, drying monitoring, and / or detection of a spray arm blockage of the cleaning device.According to one embodiment, the image signal represents a camera image of the interior camera 125 and / or exterior camera, which does not depict a hand and / or is read in when an operating signal is present which represents a cleaning operation of the cleaning device 100.

[0037] In the following, examples of implementation are given based on the Figure 2 Described again in other words: The operating device 200 presented here makes it possible, in conjunction with at least one camera 125 intended for use with a dishwasher, to realize an automated dishwasher with virtual sensors.

[0038] Automated devices in dishwashers, such as an automatic door closing device and / or door opening device 115, contribute significantly to improving operating convenience. Thanks to the operating device 200, these automated devices are activated via sensors that are not directly visible or recognizable as such, but are intuitively operable. The operating device 200 presented here advantageously enables the activation sensor system to be improved in terms of accessibility, visibility, and operability.

[0039] A core idea of ​​the approach presented here is to trigger the closing 250 and opening of the appliance door 110 and / or the retraction and extension of the baskets 140 by detecting a specific optical pattern composed of a defined area of ​​a background image and the image of the hand 225 and / or a foot or shoe of the operator. The specific area from the background image represents a virtual sensor or a virtual zone, here the area 237, which is virtually actuated, for example by overlapping with the image of the operator's hand 225. The background image and the operator's hand 225 are recorded by at least one camera, preferably arranged on the inside of the appliance door 110, here the interior camera 125.

[0040] According to this embodiment, the virtual sensors / virtual zones are provided in the upper area of ​​the loading opening 240 and / or in the two corners and / or in the middle, see also the Figures 9 to 11 . According to one embodiment, further virtual sensors / zones are located in front of the dish baskets 140, in the Fig. 2 shown as an example on the upper dish basket 140, see also Fig. 6 . Another virtual sensor / zone with an outdoor camera is positioned in the control panel according to one embodiment, see Fig. 3 . The interior camera 125 captures the background image when the door 110 is open, in the Fig. 2This is the loading opening 240 or its contour with the baskets 140 and the door handle 120, as well as the operator's hand 225 when it is moved in front of the virtual sensor, here in front of the area 237. The specific pattern of background image and hand 225 is evaluated by the operating device 200, for example using a classifier, which, according to one embodiment, communicates with the device control, as also in Fig. 12shown in principle. According to one embodiment, the appliance control or operating device 200 then activates the door movement device 112 or the respective basket movement device depending on the detected pattern. When the door 110 is open, the interior camera 125 detects the loading opening 240 and the extended door plunger 120. If the operator moves their hand 225 in front of or into the area 237 of the door plunger 120, the classifier / operating device 200 detects this specific pattern or image and preferably activates the door movement device 112, and the appliance door 110 is closed.

[0041] Advantages of the operating device 200 presented here are: No additional triggering sensors are required to activate the door movement device 112 and / or the basket movement device. Depending on the design, this additional triggering sensor would be expensive and / or prone to failure. No different gestures are required to trigger the door movement device 112 and the basket movement device, meaning the operator does not have to memorize different gestures. The system is adapted to the individual background or environment, see Fig. 4, adaptable. The risk of incorrect operation is minimized because two patterns are always queried, namely the corresponding component to be moved, for example, the door 110, the basket 140, etc., and the operator's hand 225. No differentiation is made between different gestures to trigger the movement of the components or the door 110 or the baskets 140. The operating device 200 not only recognizes one hand 225 / gesture, but also this in connection with a predetermined background image, which depends, for example, on the opening position of the door 110 or the basket position of the basket 140.

[0042] Figure 3 shows a side view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the Figure 1 or 2 cleaning device 100 described and the Fig. 2This may be the operating device 200 described above, with the difference that the cleaning appliance 100 according to this exemplary embodiment has several of the interior cameras 125 and / or at least one or more exterior cameras 300. According to this exemplary embodiment, the exterior camera 300 is arranged on an outer side of the appliance door 110 facing away from the washing chamber.

[0043] According to this exemplary embodiment, the reading unit 210 is designed to read in a second camera signal 305, which represents, as the image, a hand 225 of a user in the area 307 of a display unit 310 of the cleaning device 100 in front of an environment arranged externally of the cleaning device 100. The output unit 215 is designed to output a door opening signal 315 for opening the device door 110 of the cleaning device 100 using the second camera signal 305 as the control signal. The second camera signal 305 is provided by the external camera 300 according to this exemplary embodiment. The environment arranged externally of the cleaning device 100 is in Fig. 4shown and is to be understood as a living environment of the cleaning device 100, for example, a defined living area arranged opposite the cleaning device 100, such as a piece of furniture arranged opposite. According to one embodiment, the display unit 310 is part of a control panel of the cleaning device 100 or is arranged in the region of such a control panel. According to one embodiment, the control panel is provided for the manual adjustment of cleaning functions of the cleaning device 100 by the user. The door opening signal 315 is designed, according to various embodiments, to cause the device door 110 to open completely or merely to open the device door 110 by a gap.

[0044] In other words, in the embodiment shown here, another camera, here the external camera 300, is located in the control panel of the dishwasher. The virtual sensor is now created from a Fig. 4The foreground image of the dishwasher shown, which contains, for example, a specific piece of kitchen furniture, is formed. If the operator's hand 225 is held in front of the virtual sensor, here in the area 307, the door opening device 115 opens the appliance door 110 in a first exemplary embodiment, a gap at a time. In a second exemplary embodiment, the appliance door 110 is additionally fully opened or moved into the horizontal position by the door movement device, for example, in order to be able to load the baskets 140.

[0045] Figure 4 shows an environment 400 arranged externally of the cleaning device 100 for use with an operating device according to an embodiment. This can be the environment shown in Fig. 3 described operating device.

[0046] The Fig. 3The second camera signal described represents, according to this exemplary embodiment, an image of a user's hand in the area of ​​a display unit of the cleaning device in front of the environment 400 shown here, which is arranged externally of the cleaning device 100. According to this exemplary embodiment, the environment 400 represents a living environment of the cleaning device 100, for example a defined living area arranged opposite the cleaning device 100, such as a piece of furniture 405 arranged opposite. No area of ​​the cleaning device is shown in the image of the environment 400.

[0047] Figure 5 shows a side view of a cleaning device 100 with a half-open door and an operating device 200 according to an embodiment. This can be the Fig. 2 or 3 described cleaning device 100 with the operating device 200.

[0048] Figure 6shows a side view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the Fig. 2 , 3 or 5 described cleaning device 100 with the operating device 200.

[0049] According to this exemplary embodiment, the reading unit 210 is configured to read in a further camera signal 600, which represents, as the image, a hand 225 of a user in the area 605 of a dish basket 140 of the cleaning appliance 100 in front of a loading opening 240 of the cleaning appliance 100. The output unit 215 is configured to output a dish basket signal 610 for moving the dish basket 140 using the further camera signal 600 as the control signal. According to this exemplary embodiment, the further camera signal 600 is provided by the interior camera 125.

[0050] To move the crockery basket 140, the cleaning device 100 according to this embodiment has the Fig. 1 described basket movement device with at least one motor M coupled to the dish basket 140. According to this embodiment, the cleaning appliance 100 has three dish baskets 140 and the basket movement device has one motor M per dish basket 140.

[0051] According to this exemplary embodiment, the reading unit 210 is designed to read in a first further camera signal as the further camera signal 600, which represents, as the image, the user's hand 225 in front of the loading opening 240 in the region of the dish basket 140, which is arranged in a state 620 protruding from a washing chamber of the cleaning appliance 100. The output unit 215 is designed to output a first dish basket signal for inserting the dish basket 140 into the washing chamber using the first further camera signal as the dish basket signal 610. According to this exemplary embodiment, the first further camera signal is output by the interior camera 125 when the hand 225 is arranged in an area 622 in the area 605 of the dish basket 140 that is remote from the loading opening 240.

[0052] According to this exemplary embodiment, the reading unit 210 is additionally or alternatively configured to read in a second further camera signal as the further camera signal 600, which represents, as the image, the user's hand 225 in front of the loading opening 240 in the region of the dish basket 140, which is arranged in a pushed-in state into the washing chamber of the cleaning appliance 100. The output unit 215 is configured to output a second dish basket signal for extending the dish basket 140 out of the washing chamber using the second further camera signal as the dish basket signal 610. According to this exemplary embodiment, the second further camera signal is output by the interior camera 125 when the hand 225 is arranged in a loading area 625 facing the loading opening 240 in the region 605 of the dish basket 140.

[0053] If the cleaning appliance 100, as shown here, has a plurality of dish racks 140, according to one embodiment, different regions in the area of ​​the dish racks 140, for example, different regions in the dishwashing chamber, are defined for outputting the first and / or second dish rack signal. For example, according to one embodiment, a corner of the dishwashing chamber is assigned to a first dish rack and an opposite corner of the dish rack is assigned to a second dish rack. If the camera 125 detects the user's hand 225 in one of the two corners, the corresponding dish rack 140 is retracted or extended. If both areas are occupied by both hands 225 simultaneously, the rack movement device moves both the first and the second dish rack 140 in response to the first and / or second dish rack signal, see also Fig. 9 .

[0054] According to this exemplary embodiment, the cleaning device 100 has at least one further interior camera 630, which is directed towards the door handle 120 and / or arranged in the washing compartment. The reading unit 210 is designed according to this exemplary embodiment to Figure 2 described first camera signal and / or the one in Figure 3 to read in the second camera signal described from the further interior camera 630.

[0055] Figure 7 shows a side view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the Fig. 2 , 3 or 6 described cleaning device 100 with the operating device 200.

[0056] Figure 8 shows a perspective front view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the Fig. 6described cleaning appliance 100 with the operating device 200, with the difference that the crockery basket 140 according to this embodiment is arranged in the pushed-into-the-washing-cabinet state 800 and the hand 225 is arranged in the loading area 625.

[0057] According to this exemplary embodiment, the reading unit 210 reads in the second further camera signal as the further camera signal, which represents the hand 225 of the user in front of the loading opening 240 in the region of the crockery basket 140 as the image, which is arranged in the pushed-in state 800 in the washing chamber of the cleaning appliance 100, wherein the output unit is designed to output a second crockery basket signal for extending the crockery basket 140 out of the washing chamber using the second further camera signal as the crockery basket signal.

[0058] In the exemplary embodiment shown here, virtual sensors or virtual zones, in this case the loading area 625, are also assigned to each of the dish baskets 140, as shown here using the example of the upper dish basket 140. In this exemplary embodiment, the interior camera 125 also detects the loading opening 240 with the inserted or extended baskets 140. If the operator moves his hand 225 in front of the upper dish basket 140, the basket is retracted or extended by the basket movement device depending on its position.

[0059] Figure 9 shows a perspective front view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the Fig. 6 , 7 or 8 described cleaning device 100 with the operating device 200, with the difference that the hand 225 according to this embodiment is arranged in an upper corner 900 of the loading opening 240.

[0060] According to this exemplary embodiment, the upper corner 900 of the loading opening 240 is assigned to one of the three dish baskets 140 shown here as an example, so that the interior camera 125 according to this exemplary embodiment provides the first and / or second dish basket signal for moving a first dish basket 140 to the reading unit when the image represents the hand 225 of a user in the region of the upper corner 900 in front of the loading opening 240.

[0061] According to this exemplary embodiment, the interior camera 125 further provides the first and / or second dish basket signal for moving a second dish basket 140 to the reading unit when the image represents the hand 225 of a user in the region of an opposite upper corner 905 in front of the loading opening 240.

[0062] According to this exemplary embodiment, the interior camera 125 further provides the first and / or second dish basket signal for moving a third dish basket 140 to the reading unit when the image represents the hand 225 of a user in the region of an upper center 910 in front of the loading opening 240.

[0063] In other words, according to this exemplary embodiment, upper regions of the loading opening 240, in particular the two corners 900, 905, are occupied with virtual sensors / zones. Preferably, according to this exemplary embodiment, the left corner 900 is assigned to the upper dish basket 140, and the right corner 905 to the lower dish basket (not shown here). If the camera 125 detects the operator's hand 225 in one of the two corners 900, 905, the corresponding dish basket 140 is retracted or extended. If both regions 900, 905 are occupied simultaneously by both hands 225, the basket movement device moves both the lower and upper dish baskets 140.

[0064] Figure 10 shows a section of a perspective front view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the one shown in one of the Figures 2 , 3 , 5 , 6 , 7 , 8or 9 described cleaning device 100 with the operating device 200.

[0065] According to this embodiment, the hand 225 is arranged in the area 237 of the door plunger 120. The Fig. 10 illustrates the approach presented here using the example of the closing of the appliance door triggered by the detection of the operator's hand 225 at the virtual sensor or in the virtual zone, here the area 237, in the area of ​​the door plunger 120.

[0066] Figure 11 shows a perspective front view of a cleaning device 100 with an operating device 200 according to an embodiment. This can be the device shown in one of the Figures 6 , 7 , 8 or 9 described cleaning device 100 with the operating device 200. Shown in Fig. 11Furthermore, an external surveillance area 1100 monitored by the external camera 300, here, for example, in the open state of the appliance door 110. According to this exemplary embodiment, the reading unit 210 is designed to read in a second camera signal 305, which represents an image of a user's foot or shoe in the external surveillance area 1100 in front of an environment arranged externally of the cleaning appliance 100. The output unit 215 is designed to output a door closing signal for closing the appliance door 110 of the cleaning appliance 100 using the second camera signal as the control signal. According to this exemplary embodiment, the second camera signal is provided by the external camera 300. The environment arranged externally of the cleaning appliance 100 is to be understood as the floor. According to one exemplary embodiment, the display unit 310 is part of a control panel of the cleaning appliance 100 or is arranged in the region of such a control panel.According to one embodiment, the control panel is provided for the user to manually adjust cleaning functions of the cleaning device 100. According to various embodiments, the door closing signal is configured to cause the device door 110 to close or the device door 110 to close followed by an automatic program start.

[0067] Figure 12 shows a schematic representation of an operating device 200 according to an embodiment. This can be the one shown in one of the Figures 2 to 11 described operating device 200.

[0068] The operating device 200, which may also be referred to as a "classifier" or has one, is designed to read in the camera signals 220 from the camera 1200 and classify them in order to output the control signals 230. According to this embodiment, the control signals 230 are sent to the Fig. 1The control unit of the cleaning device shown in FIG. 1 is output, which in turn outputs corresponding control signals 1205 for controlling the door movement device 112 and / or basket movement device 145 to the door movement device 112 and / or basket movement device 145. According to an alternative embodiment, the control signals 230 are output by the operating device 200 directly to the door movement device 112 and / or basket movement device 145.

[0069] According to one embodiment, the camera 1200 is not only used to operate the door and / or baskets as described here, but it also fulfills additional functions when the door is closed and possibly outside of a washing program and / or during the washing program, e.g., for load detection according to type and quantity, soiling detection, drying monitoring, and / or detection of a wash arm blockage.

[0070] Figure 13shows a flowchart of a method 1300 according to an embodiment for operating a cleaning device with at least one camera and at least one movable device component. This can be the Fig. 1 The cleaning device shown in Figure 1300 is different from the one shown in one of the Figures 2 to 11 described operating devices can be controlled or executed.

[0071] The method 1300 comprises at least one input step 1305 and one output step 1310. In input step 1305, a camera signal is input from the camera, wherein the camera signal represents, for example, an image of a user's hand against a defined background. In output step 1310, a control signal for moving the device component of the cleaning device is output depending on the camera signal.

[0072] The procedural steps presented here can be repeated and carried out in a different order than described.

[0073] Figure 14 shows a block diagram 1400 of a method according to an embodiment for operating a cleaning device. This can be a block diagram 1400 that is shown in Fig. 13 described procedure with additional blocks 1405, 1410, 1415, 1420, 1425, 1430, 1435.

[0074] A first block 1405 queries whether a cleaning appliance program has ended. When the cleaning appliance program has ended, a second block 1410 queries whether a camera signal is present in which the image represents the surroundings arranged externally of the cleaning appliance and the hand in front of the display unit. If a camera signal is present in which the image represents the surroundings and the hand in front of the display unit, the appliance door is opened in a third block 1415. If no camera signal is present in which the image represents the surroundings and the hand in front of the display unit, a fourth block 1420 queries whether a camera signal is present in which the image represents the loading opening and the hand in front of the dish basket. If a camera signal is present in which the image represents the loading opening and the hand in front of the dish basket, the dish basket is retracted or extended in a fifth block 1425.If no camera signal is present in which the image represents the loading opening and the hand in front of the dish basket, a sixth block 1430 queries whether a camera signal is present in which the image represents the loading opening and the hand in front of the door handle. If a camera signal is present in which the image represents the loading opening and the hand in front of the door handle, the appliance door is closed in a seventh block 1435.

[0075] In other words, Fig. 14The basic or exemplary method steps starting from a completed dishwashing program. At the end of the program, the second block 1410 uses the virtual sensor in the appliance's control panel to query whether the door should be opened partially or completely. If the operator's hand is in front of the virtual sensor, the door is opened or tilted, represented by the third block 1415. The operator now opens the appliance door manually. Following this method step, the classifier evaluates the virtual sensors in the loading opening, represented by the fourth block 1420. Upon detection of the hand, the corresponding basket is extended, represented by the fifth block 1425. In this state, the basket can be loaded or unloaded. If the camera or the classifier detects the operator's hand on the virtual sensor or in the area in front of the basket, the basket is moved back into the dishwasher by the basket movement device.Finally, the classifier uses the camera to query the virtual sensor or virtual zone in the area of ​​the door handle, represented by the sixth block 1430. If the operator's hand is detected in this area, the door movement device closes the appliance door, see seventh block 1435.

[0076] A block sequence other than the exemplary block sequence 1405, 1410, 1415, 1420, 1425, 1430, 1435 described above results analogously.

[0077] If an embodiment includes an "and / or" link between a first feature and a second feature, this should be read as meaning that the embodiment according to one embodiment has both the first feature and the second feature and according to another embodiment has either only the first feature or only the second feature.

Claims

1. Operating device (200) for operating a cleaning apparatus (100) comprising at least one movable apparatus component and at least one camera (125; 630; 1200), the operating device (200) having the following features: - a reading-in unit (210) which is designed to read in a camera signal (220) from the camera (125; 630; 1200); and - an output unit (215) which is designed to output, depending on the camera signal (220), a control signal (230) for moving the apparatus component of the cleaning apparatus (100), characterised in that the camera (125; 630; 1200) is an interior camera for monitoring an interior of the cleaning apparatus (100), and in that the camera signal (220) represents an image of a hand (225) of a user in front of a defined background.

2. Operating device (200) according to claim 1, in which the reading-in unit (210) is designed to read in a first camera signal (235) from the camera (125; 630; 1200), which represents, as the image, a hand (225) of a user, in the region of a door pusher (120), in front of a loading opening (240) of the cleaning apparatus (100), wherein the output unit (215) is designed to output a door closing signal (245) for closing an apparatus door (110) of the cleaning apparatus (100) using the first camera signal (235) as the control signal (230).

3. Operating device (200) according to either of the preceding claims, in which the reading-in unit (210) is designed to read in a second camera signal (305) from a second camera (300), which represents, as the image, a hand (225) of a user, in the region of a display unit (310) of the cleaning apparatus (100), in front of an environment (400) located externally of the cleaning apparatus (100), wherein the second camera (300) is an external camera, and wherein the output unit (215) is designed to output a door opening signal (315) for opening an apparatus door (110) of the cleaning apparatus (100) using the second camera signal (305) as the control signal (230).

4. Operating device (200) according to any of the preceding claims, in which the reading-in unit (210) is designed to read in a further camera signal (600) from the camera (125; 630; 1200), which represents, as the image, a hand (225) of a user, in the region of a dish rack (140) of the cleaning apparatus (100), in front of a loading opening (240) of the cleaning apparatus (100), wherein the output unit (215) is designed to output a dish rack signal (610) for moving the dish rack (140) using the further camera signal (600) as the control signal (230).

5. Operating device (200) according to claim 4, in which the reading-in unit (210) is designed to read in a first further camera signal as the further camera signal (600), which represents, as the image, the hand (225) of the user in front of the loading opening (240) in the region of the dish rack (140) which is arranged in a state (620) protruding from a washing chamber (105) of the cleaning apparatus (100), wherein the output unit (215) is designed to output a first dish rack signal for retracting the dish rack (140) into the washing chamber (105) using the first further camera signal as the dish rack signal (610).

6. Operating device (200) according to either of claims 4 or 5, in which the reading-in unit (210) is designed to read in a second further camera signal as the further camera signal (600), which represents, as the image, the hand (225) of the user in front of the loading opening (240) in the region of the dish rack (140) which is arranged in the state (800) in which it is pushed into the washing chamber (105) of the cleaning apparatus (100), wherein the output unit (215) is designed to output a second dish rack signal for extending the dish rack (140) out of the washing chamber (105) using the second further camera signal as the dish rack signal (610).

7. Operating device (200) according to any of the preceding claims, in which the reading-in unit (210) is designed to query the camera signal (220) when a program termination signal, which represents a terminated or interrupted cleaning program of the cleaning apparatus (100), is present.

8. Operating device (200) according to any of the preceding claims, in which the reading-in unit (210) is designed to read in an image signal from the camera (125; 630; 1200), which image signal represents a camera image of the camera (125; 630; 1200), and, using the image signal, to carry out an additional function of the cleaning apparatus (100) which is independent of a movement of the apparatus component, in particular to control a unit for load detection according to type and / or quantity, dirt detection, drying monitoring and / or detection of a washing arm blockage of the cleaning device (100).

9. Cleaning apparatus (100) comprising at least one movable apparatus component, at least one camera (125; 630; 1200) designed as an interior camera for monitoring an interior of the cleaning apparatus (100), and an operating device (200) according to any of the preceding claims.

10. Cleaning apparatus (100) according to claim 9, which is in the form of a dishwasher.

11. Method (1300) for operating a cleaning apparatus (100) comprising at least one camera (125; 630; 1200) and at least one movable apparatus component, the method (1300) comprising the following steps: reading in (1305) a camera signal (220) from the camera (125; 630; 1200); and outputting (1310), depending on the camera signal (220), a control signal (230) for moving the apparatus component of the cleaning apparatus (100), characterised in that the camera (125; 630; 1200) is an interior camera for monitoring an interior of the cleaning apparatus (100), and in that the camera signal (220) represents an image of a hand (225) of a user in front of a defined background.

12. Computer program product comprising program code for carrying out the method (1300) according to claim 11 when the computer program product is executed on an operating device (200) according to any of claims 1 to 8.

13. Machine-readable storage medium on which the computer program product according to claim 12 is stored.