SYSTEM WITH A DISHWASHER AND METHOD FOR OPERATING A DISHWASHER

Description

[0001] The present invention relates to a system with a dishwasher and a method for operating a dishwasher.

[0002] The cleaning performance of conventional dishwashers depends on the selected wash program, which should ideally be set and started by the user based on the dishwasher load. Experience has shown that users are overwhelmed by the multitude of options available. This leads to many users usually only starting a "standard program" despite the wide range of options. Dishwashers are known that use various sensors to automatically determine, for example, the load size of the dishwasher and the dirt load on the items, and then adjust the wash program accordingly. This can lead to savings and improved wash results compared to manual operation.However, optimal control of the washing program is not possible because, for example, information about the arrangement of the items to be washed or the condition of the items to be washed is not determined.

[0003] WO 2018 103 958 A1 describes a dishwasher that can communicate with a server via a network connection. Using a mobile device, an image of the dishes arranged in the dishwasher is captured and transmitted to the server. The server compares the received image with stored reference images to determine the type of load. Based on this, the server selects a suitable washing program and transmits it to the dishwasher.

[0004] CN 109 620 078 A discloses a dishwasher with a camera, wherein on the basis of a captured camera image of a dishware holder of the dishwasher, the dishes arranged in the dishware holder are determined and a correspondingly optimized dishwashing program is determined.

[0005] US 2012 / 138092 A1 discloses a dishwasher with a camera configured to capture a partial area of ​​a dishware holder of the dishwasher. By capturing a plurality of images of different partial areas, the entire dishware holder is captured. Based on the multiple images, an arrangement of dishes in the dishware holder is determined, and the dishwashing program is optimized accordingly.

[0006] EP 3 485 794 A1, DE 10 2017 21233 A1, DE 10 2017 212323 A1 and DE 100 48 081 A1 disclose further conventional dishwashers.

[0007] Against this background, one object of the present invention is to further improve the operation of a dishwasher.

[0008] According to a first aspect, a system comprising a dishwasher, preferably a household dishwasher, is proposed, comprising a control device for executing a washing program that can be parameterized using a number of different washing program parameters, and comprising an image capture device for capturing an image of a dishware receptacle of the dishwasher. The system further comprises an image analysis unit for classifying dishes arranged in the dishware receptacle based on the captured image of the dishware receptacle and for outputting a classification result to the control device. The classification result comprises information regarding the quantity, type, and / or position of the dishes arranged in the dishware receptacle. The control device is configured to parameterize the washing program based on the classification result.The dishwasher has a position sensor unit for detecting a position of the dishware holder and for outputting a position signal to the image capture device. The image capture device is configured to capture the image in response to the position signal. The position sensor unit is configured to output the position signal when the dishware holder is fully visible in an image field of the image capture device.

[0009] This system has the advantage that the properties of the items arranged in the washware holder, such as the material, can be taken into account when parameterizing the wash program. In addition, the spatial arrangement of the items in the washware holder can be taken into account. Overall, the wash program can therefore be optimally parameterized even for very different situations, such as different items to be washed and / or different arrangements of the items in the washware holder, which contributes to improved wash results. In addition, resources such as water, time, energy and cleaning agents can be saved because the wash program can be parameterized very specifically. For example, it can be detected that only a lower washware holder contains items to be washed, while an upper washware holder is empty. The wash program can then be parameterized so that only a lower spray arm is supplied with wash water during execution.The dishwashing program therefore requires less water, energy, and detergent and can also be completed in a shorter time. Advantageously, the dishwashing program is parameterized fully automatically and specifically each time a user starts the dishwasher, without the user having to make any selections. These advantages are achieved, in particular, with only a single image capture device, even when the dishwasher has multiple dishware holders.

[0010] The control device can be implemented in hardware and / or software. In a hardware implementation, the control device can be embodied, for example, as a computer or a microprocessor. In a software implementation, the control device can be embodied as a computer program product, as a function, as a routine, as part of a program code, or as an executable object.

[0011] It can be provided that a number of different dishwashing programs are predefined, with a user or the control device selecting one of the dishwashing programs. The predefined dishwashing programs are, for example, an intensive program, a short program, a gentle program, an energy-saving program or even a glass program. These dishwashing programs differ in particular with regard to their parameter ranges for individual or all dishwashing program parameters in order to best enable the respective key aspect. For example, in the intensive program the key aspect is a particularly high cleaning effect, which may be necessary, for example, when the dishes are very heavily soiled. This is achieved, for example, by means of a high dishwashing solution temperature, a high amount of added detergent, a longer program running time and / or a high pump speed.For example, the energy-saving program focuses on the lowest possible energy consumption, which can be achieved, for example, by using a low wash water temperature, a low pump speed, and a longer program runtime. The wash program parameters for each of the wash programs are not fixed but can be selected within predetermined limits, for example. To parameterize the respective wash program, the control device then selects a value within the respective predetermined value range.

[0012] The image capture device preferably comprises a digital sensor with a sensor surface having a plurality of light-sensitive pixels, such as a CMOS ( complementary metal-oxide-semiconductor ) or CCD ( charge-coupled-device ). The resolution of the digital sensor is preferably at least 0.3 MP (MP = megapixel), preferably at least 1 MP, more preferably up to 8 MP, more preferably between 8 - 16 MP, more preferably over 16 MP. The image capture device is thus configured to output a digital image, preferably as a data set, which can be further processed by means of digital data or signal processing. The image capture device is fixedly arranged on the dishwasher. The image capture device can also comprise an optical element, such as a lens or a mirror, in order to optimize a detection range of the image capture device. Individual elements of the image capture device can also be movably mounted so that, for example, a focal plane and / or the detection range can be changed.Furthermore, the image capture device can have a control which, for example, carries out focusing, selects a detection area and / or sets exposure settings and triggers the image capture device.

[0013] The dishwasher preferably has one or more dishware receptacles. The dishware receptacles can also be referred to as a dish basket. The dishwasher has, for example, a wash tub that can be closed by a door. The dishware receptacles are arranged in the wash tub when the door is closed and can preferably be moved out of the wash tub, for example, using a rail and / or roller system. This allows the dishware receptacles to be pulled out of the wash tub for convenient loading with dishes.

[0014] The image analysis unit can be implemented in hardware and / or software. In a hardware implementation, the image analysis unit can be embodied, for example, as a computer or a microprocessor, preferably a graphics processor. In a software implementation, the image analysis unit can be embodied as a computer program product, as a function, as a routine, as part of a program code, or as an executable object.

[0015] The image analysis unit is preferably a component of the dishwasher, but it can also be provided that the image analysis unit is arranged externally to the dishwasher.

[0016] The image analysis unit is configured to perform image recognition in order to classify the washware arranged in the washware holder. In particular, the image analysis unit can perform classification, localization, object detection and / or Instance Segmentation of the image. The image analysis unit is configured to apply various digital signal processing methods, such as filtering methods, data analysis algorithms, and the like.

[0017] The classification result includes, for example, information regarding the distribution and type of washware in the washware holder. In particular, material classes of the washware, such as glass, metal, plastic, wood, or ceramic, are distinguished. Additionally, an "Empty" class is also distinguished if no washware is located at a specific location. An additional class, for example, is "Unspecified" if the image analysis unit does not produce a clear result.

[0018] The classification result is preferably pixel-accurate for each captured image, meaning that each pixel of the captured image contains an assignment to one of the designated classes. This allows the control device to achieve very precise parameterization of the washing program. The classification is therefore preferably quantitative.

[0019] Classification is preferably performed only after a user has started the dishwasher to run a wash program. This prevents classification from being performed before the final load of the dishwasher has been determined. Furthermore, there is sufficient time immediately after the start of a wash program to perform classification, since, for example, water is first added and heated.

[0020] To parameterize the washing program, the control device sets a value for at least one washing program parameter depending on the classification result. This does not preclude individual washing program parameters from having, for example, a default value. Examples of parameterizable washing program parameters are a water temperature, a duration of a sub-program step, a pump speed of a circulation pump, a dosing of a detergent of an automatic dosing system, which can include both a dosing time and a dosed amount, a control of a water diverter, an activation and / or control of a special washing zone, and an activation and / or control of a drying device. The aforementioned washing program parameters can be individually set by the control device for each sub-program step of a respective washing program.The control device can be configured to generate the entire washing program, i.e., to compile a washing program from individual sub-program steps, such as soaking, pre-washing, main wash, final rinse, drying, and the like, with the washing program parameters being defined individually for each of the sub-program steps. It can also be said that the control device defines a sub-program step parameter matrix for each sub-program step when parameterizing the washing program.

[0021] The control device is designed to carry out the rinsing program parameterized in this way.

[0022] The dishwasher has a position sensor unit for detecting a position of the dishware holder and for outputting a position signal to the image capture device, wherein the image capture device is configured to capture the image as a function of the position signal.

[0023] This has the advantage that the image capture device captures the image of the dishware holder when it is arranged in a predetermined position, in particular within a detection range of the image capture device. As explained above, the dishware holder is mounted so that it can be displaced out of the washing container. The position sensor unit is preferably configured to output the position signal such that the image capture device captures the image when the dishware holder is in a displaced position, i.e., pulled out of the washing container for loading.

[0024] The position sensor unit can comprise a mechanical switch or button, a proximity sensor, a magnetic sensor, a capacitive sensor, an ultrasonic sensor, a light barrier, an inclination angle sensor, a marker on the dishware holder, or the like. For example, the position sensor unit comprises a magnetic sensor arranged near a loading opening of the washing container, with a corresponding magnet arranged on the dishware holder. When the dishware holder is pulled out, the magnet in the extended position of the dishware holder comes close to the magnetic sensor or is moved past it. The position sensor unit then outputs a signal that causes the image capture device to capture an image, which in this case then shows the dishware holder.The position sensor unit may also comprise a combination of several of the aforementioned sensors or take into account the sensor signals of several of the sensors when outputting the position signal.

[0025] The position sensor unit is configured to output the position signal when the dishware holder is completely visible in an image field of the image capture device.

[0026] In embodiments, it may be provided that a user manually triggers the capture of an image. This can be done using a gesture, a voice command, and / or an input device such as a button or a touch-sensitive key or the like.

[0027] According to a further embodiment, the image capture device is configured to capture an extended spectral range comprising at least the visual spectral range and the near infrared range.

[0028] This embodiment is advantageous because the captured image contains more information available to the image analysis unit. Furthermore, the near-infrared range, which, for example, covers a range from 800 nm to 2500 nm, can be used even under unfavorable visual lighting conditions.

[0029] In embodiments, the image capture device can be designed as a monochrome camera or a two-color camera. In one embodiment, the monochrome camera, for example, captures the entire spectrum but only outputs a grayscale image. In a further embodiment, a filter is arranged in front of a sensor of the camera, which filter only allows a narrow range of the spectrum to pass through, for example a wavelength range with a half-width of 10 nm, 20 nm, 30 nm, 40 nm, or up to 50 nm, around a central wavelength. A two-color camera, for example, has two different filters, each of which covers different pixels of the image sensor, so that the captured image has two color channels.

[0030] In embodiments, the image analysis unit is configured to select two sub-ranges (color channels) from the entire spectral range of the captured image, which preferably do not overlap. The selection is made in particular such that contrasts between the different dishware materials, each assigned to a class, are particularly high. Preferably, the color channels to be used are predetermined for a dishwasher and then remain fixed. However, different color channels can also be selected for different dishwashers. It can further be provided that the color channels are selected anew each time depending on certain parameters, such as ambient brightness, a color temperature of the ambient light, or the like. It can also be provided that a color channel is widened or narrowed.In this way, the reliability of the classification by the image analysis unit can be increased.

[0031] In embodiments, a lighting unit is further provided, which illuminates the dishware holder for capturing the image by the image capture device. The lighting unit comprises, for example, a flash unit that emits a broadband flash. Alternatively or additionally, a laser scanner can also be provided, which scans the dishware holder during image capture. Individual wavelengths particularly suitable for classification can be selectively selected for the respective laser. In particular, the lighting unit can use an infrared spectral range for illumination, since this is imperceptible to the human eye and therefore does not irritate a user of the dishwasher.

[0032] According to a further embodiment, the dishwasher further comprises a washing container with a washing container flange running around a loading opening of the washing container, wherein the image capture device is arranged in or on an upper flange section of the washing container flange associated with a ceiling of the washing container, and wherein the image capture device points away from the washing container and obliquely in the direction of a plane spanned by a bottom of the washing container.

[0033] The arrangement of the image capture device is advantageous because it is located outside an area accessible to the wash liquor, making it relatively easy to control the ambient conditions, even for sensitive electronic components. The wash tank flange is preferably located outside a wash chamber sealed by a sealing device.

[0034] According to a further embodiment, a cavity is provided in or on the rinsing container flange, in which the image capture device is accommodated at least in sections, wherein the cavity is delimited, preferably in the direction of the plane, by a transparent element.

[0035] This embodiment ensures that the image capture device is arranged on the dishwasher in such a way that it does not protrude or be perceived as obtrusive. Furthermore, a dishwasher that has the wash tub flange with the cavity but is not equipped with an image capture device can be retrofitted relatively easily.

[0036] The transparent element is designed, for example, as a plastic pane, a mineral glass pane, a glass pane, or the like. The transparent element preferably ensures that the cavity is sealed downwards, in the direction of the plane, so that steam from the washing chamber cannot enter the cavity when the door is opened after a washing program has ended. For example, a corresponding sealing device is provided for this purpose. The transparent element is preferably transparent for the entire spectral range captured by the image capture device. In embodiments, however, it can also be provided that the transparent element is only selectively transparent for certain regions of the spectral range. In this case, the transparent element additionally acts as a filter.

[0037] In some embodiments, the image capture device is arranged entirely within the cavity, with the cavity being sealed entirely. This means that, in particular, no moisture can penetrate into the cavity, which is advantageous for the service life of the image capture device.

[0038] According to a further embodiment, the image capture device has a vertical image angle of at least 90° and a horizontal image angle of at least 120°.

[0039] This ensures that the entire dish rack can be captured without individual areas, such as the edges, being hidden from the captured image. The respective angle of view is preferably provided by appropriate optical elements. This can also be referred to as an ultra-wide-angle lens.

[0040] The classification result includes information regarding the quantity, type and / or position of the wash ware arranged in the wash ware holder.

[0041] In embodiments, the image analysis unit is configured to classify the wash ware arranged in the wash ware holder into the classes empty, plastic, metal, glass or ceramic depending on the captured image of the wash ware holder.

[0042] "Empty" means that no items are located or detected at the corresponding position. An "Unknown" class can also be provided if a pixel cannot be clearly assigned to one of the defined classes.

[0043] According to a further embodiment, the image analysis unit is configured to classify the items to be washed arranged in the items to be washed in the dishwasher as a function of the captured image of the items to be washed in the dishwasher by means of a neural network.

[0044] In particular, the neural network was trained before normal operation of the dishwasher, for example in a household, using a training data set that includes, for example, 10,000 - 100,000 images including associated classification.

[0045] According to a further embodiment, a storage unit is provided for storing a number of captured images, wherein the image analysis unit is configured to classify the items to be washed arranged in the items to be washed in the washware holder depending on at least one of the stored images of the number.

[0046] For example, several of the stored images are used by the image analysis unit for classification. This allows complementary information to be captured, which can increase the overall information content or improve the signal-to-noise ratio.

[0047] According to a further embodiment, the image analysis unit is integrated into the dishwasher.

[0048] According to a further embodiment, the image capture device and the image analysis unit are arranged together on a substrate in an integrated circuit.

[0049] This arrangement is particularly compact.

[0050] According to a further embodiment, the image analysis unit is integrated in a device arranged externally to the dishwasher, wherein the dishwasher is configured to have a communication unit for transmitting the captured image to the image analysis unit, for receiving the classification result from the image analysis unit, and for outputting the received classification result to the control device.

[0051] The external device is, for example, a server accessible via the Internet. The communication unit is configured to establish a communication connection with the external device via WLAN, mobile radio, Bluetooth ®< , LAN, or the like. The communication connection can be mediated via third-party devices, such as a router, and various communication protocols can also be used.

[0052] This embodiment has the advantage that the image analysis unit can access very high computing power, provided, for example, by the server. This allows for faster classification and, for example, allows for the use of more complex algorithms or neural networks.

[0053] According to a further embodiment, the dishwasher has a plurality of dishware holders, wherein the image capture device is configured to capture an image of each of the dishware holders.

[0054] The image capture device is preferably configured to assign a captured image to the respective dishware receptacle. The assignment can be made, for example, as a function of a position signal provided by the position sensor unit. Furthermore, a distance between the image capture device and the dishware receptacle can be detected as a function of the image, for example, by determining the focus, from which the respective dishware receptacle can then be determined. Furthermore, for example, an inclination angle sensor arranged on the door of the dishwasher can be read, whereby, if the door is tilted, it can be ruled out that a lower dishware receptacle is extended.

[0055] According to a second aspect, a method for operating a dishwasher, preferably a household dishwasher, is proposed. In a first step, an image of a dishware holder of the dishwasher is captured. In a second step, the dishes arranged in the dishware holder are classified based on the captured image. In a third step, a classification result is output. In a fourth step, a dishwashing program for washing the dishes is parameterized based on the classification result.

[0056] In a further step, the control device can carry out the rinsing program parameterized in this way.

[0057] The method is preferably carried out with a system according to the first aspect. The method has the same advantages as those explained for the system.

[0058] The embodiments and features described for the proposed system apply accordingly to the proposed method.

[0059] According to a third aspect, a computer program product is proposed which comprises instructions which, when the program is executed by a computer, cause the computer to carry out the method described above.

[0060] A computer program product, such as a computer program means, can be provided or delivered, for example, as a storage medium, such as a memory card, USB stick, CD-ROM, DVD, or in the form of a downloadable file from a server in a network. This can be done, for example, in a wireless communications network by transmitting a corresponding file with the computer program product or the computer program means.

[0061] Further possible implementations of the invention also include combinations of features or embodiments described above or below with respect to the exemplary embodiments not explicitly mentioned. In this case, the person skilled in the art will also add individual aspects as improvements or additions to the respective basic form of the invention.

[0062] Further advantageous embodiments and aspects of the invention are the subject of the dependent claims and the exemplary embodiments of the invention described below. The invention is explained in more detail below using preferred embodiments with reference to the accompanying figures. Fig. 1 shows a schematic perspective view of an embodiment of a system with a dishwasher; Fig. 2 shows a schematic sectional view of a detail of a dishwasher; Fig. 3 shows a schematic side view of a dishwasher; Fig. 4 shows another schematic side view of a dishwasher; Fig. 5 shows another schematic side view of a dishwasher; Fig. 6 shows a schematic example of a captured image and a classification result; Fig. 7 shows a schematic block diagram of an arrangement with a dishwasher; and Fig. 8 shows a schematic block diagram of an exemplary method for operating a dishwasher.

[0063] In the figures, identical or functionally equivalent elements have been given the same reference numerals unless otherwise stated.

[0064] The Fig. 1 shows a schematic perspective view of a system with a dishwasher 1, which is designed here as a household dishwasher. The household dishwasher 1 comprises a washing container 2, which can be closed by a door 3, in particular in a watertight manner. For this purpose, a sealing device 17 (see Fig. 2 ) may be provided. The washing container 2 is preferably cuboid-shaped. The washing container 2 can be arranged in a housing of the household dishwasher 1. The washing container 2 and the door 3 can form a washing chamber 4 for washing items 51, 52, 53, 54 (see Fig. 6 ) form.

[0065] Door 3 is in the Fig. 1 shown in its open position. The door 3 can be closed or opened by pivoting about a pivot axis 5 provided at a lower end of the door 3. With the help of the door 3, a loading opening 6 of the washing container 2 can be closed or opened. A circumferential washing container flange 16 is provided on a front side of the washing container 2 and frames the loading opening 6, for example. The washing container 2 has a base 7, a ceiling 8 arranged opposite the base 7, a rear wall 9 arranged opposite the closed door 3, and two side walls 10, 11 arranged opposite one another. The base 7, the ceiling 8, the rear wall 9 and the side walls 10, 11 can be made, for example, from a stainless steel sheet. Alternatively, the base 7 can, for example, be made from a plastic material.

[0066] The household dishwasher 1 further comprises at least one dishware receptacle 12 to 14. Preferably, several, for example three, dishware receptacles 12 to 14 can be provided, wherein the dishware receptacle 12 can be a lower dishware receptacle or a lower basket, the dishware receptacle 13 can be an upper dishware receptacle or an upper basket, and the dishware receptacle 14 can be a cutlery drawer. Fig. 1 As further shown, the dishware receptacles 12 to 14 are arranged one above the other in the washing container 2. Each dishware receptacle 12 to 14 can be selectively moved into or out of the washing container 2. In particular, each dishware receptacle 12 to 14 can be pushed or moved into the washing container 2 in an insertion direction E and pulled or moved out of the washing container 2 in an extension direction A, opposite to the insertion direction E.

[0067] Furthermore, a control device 15 and an image analysis unit 25 are arranged in the door 3 of the household dishwasher 1. The control device 15 is configured to carry out a washing program. An image capture device 20 is arranged in or on the washing container flange 16, which is configured to capture an image IMG (see Fig. 6 ) of the washware holders 12, 13, 14. The captured image IMG is output by the image capture device 20 to the image analysis unit 25. The image analysis unit 25 is configured to classify the image IMG and output a classification result KR (see Fig. 6 ) to the control device 15. The control device 15 is configured to parameterize the rinsing program depending on the classification result KR.

[0068] Fig. 2 shows a schematic sectional view of a detail of a dishwasher 1, for example the household dishwasher of Fig. 1 . In the Fig. 2 is a section through one of the ceiling 8 of the rinsing tank 2 (see Fig. 1 ) associated upper flange section of the washing compartment flange 16. The door 3 is shown in the closed position, wherein a sealing device 17 is arranged between the door 3 and the washing compartment 2 and closes the washing chamber 4 in a fluid-tight manner. A cavity 18 is arranged in the washing compartment flange 16, which is delimited in the direction of the door 3 by a transparent element 19, which is designed here as a glass pane. The cavity 18 is preferably sealed fluid-tight from its surroundings. In this example, an image capture device 20 and an image analysis unit 25 are arranged in the cavity 18. The image capture device 20 and the image analysis unit 25 are integrated on a common substrate. In the arrangement shown, the image capture device 20 is advantageously used for capturing an image IMG (see Fig. 6 ) of the dishware holders 12, 13, 14 (see Fig. 1 ) through the transparent element 19. The cavity 18 is arranged as close as possible to a center point of the upper flange section, preferably exactly in its center, so that the image capture device 20 can image the washware holder 12, 13, 14 as symmetrically as possible.

[0069] Fig. 3 shows a schematic side view of a dishwasher 1, for example the household dishwasher 1 of Fig. 1 or 2 The door 3 is shown in the open position. The image capture device 20 is preferably as shown in Fig. 2 explained in a cavity 18 (see Fig. 2 ) of the washing container flange 16. The dishwasher 1 of the Fig. 3 has two washware holders 12, 13, which can be moved in or out of the washing container 2. The lower washware holder 12 is in a relocated position, where it can be easily loaded with washware 51, 52, 53, 54 (see Fig. 6 ) can be loaded. In addition, the dishwasher 1 has two position sensor units 21A, 22A, which are arranged on a front edge of the washing container 2, where the washing container flange 16 is also attached. The position sensor units 21A, 22A are designed as magnetic sensors. Each of the dishware receptacles 12, 13 has a magnet 21B, 22B, which is arranged in a rear region of the respective dishware receptacle 12, 13.

[0070] When the respective dishware holder is pulled out of the washing container 2, the magnet 21B, 22B is moved past the respective magnetic sensor 21A, 22A, which is detected by the respective magnetic sensor 21A, 21B. In this case, the magnetic sensor 21A, 22A can, for example, also detect a direction of movement of the magnet 21B, 22B. When the lower magnetic sensor 22A detects that the magnet 22B of the lower dishware holder 12 is moved past, it outputs, for example, a position signal to the image capture device 20, whereupon the latter generates an image IMG (see Fig. 6 ). The image IMG is preferably captured when the respective dishware holder 12, 13 is moved into the washing tub 2, since it can then be assumed that the current loading process is complete. By using a position sensor unit 21A, 22A assigned to each dishware holder 12, 13, 14, it is possible to assign a captured image IMG to the respective dishware holder 12, 13, 14.

[0071] Fig. 4 shows a further schematic side view of a dishwasher 1, for example the household dishwasher of Fig. 1 , 2 or 3 . Door 3 is shown here in its open position. In the Fig. 4 The vertical angle of view V of the image capture device 20 is shown schematically. The vertical angle of view V is preferably 90°, but can also be larger. The image capture device 20 is preferably aligned such that an angle between an optical axis and a horizontal direction is 120° - 135° (the acute angle of change in this direction is correspondingly in the range of 45° - 60°). This ensures that the image capture device 20 can capture each of the washware holders 12, 13, 14 (see Fig. 1 or 3 ) in their respective total length.

[0072] Fig. 5 shows a schematic front view of a dishwasher1, for example the household dishwasher of Fig. 1 , 2 or 3 . Door 3 is shown here in its open position. In the Fig. 4 The horizontal image angle H of the image capture device 20 is shown schematically. The horizontal image angle H is preferably at least 120°, but can also be larger. This ensures that the image capture device 20 can capture each of the washware holders 12, 13, 14 (see Fig. 1 or 3 ) in their respective total width.

[0073] Fig. 6 shows a schematic example of a captured (digital) image IMG and a classification result KR. The image IMG was, for example, captured by the image capture device 20 (see Fig. 1 - 5 or 7 ) one of the dishwashers 1 of the Fig. 1 - 5 or 7 recorded and the classification result KR was, for example, obtained by the image analysis unit 25 (see Fig. 1 , 2 or 6 ) the Fig. 1 , 2 or 6The captured image IMG shows, for example, the lower dishware holder 12 with the dishes 51, 52, 53, 54 arranged therein. These are plates 51 made of ceramic or porcelain, a metal pan 52 with a plastic handle, a metal pot 53, and a glass beer mug 54. The image capture device 20 captures a color image with an extended spectral range of 360 nm - 2500 nm.

[0074] The image analysis unit 25 (see Fig. 1 , 2 or 6) is configured to classify the wash ware 51, 52, 53, 54 based on the image IMG captured by the image capture device 20. The image analysis unit 25 preferably selects two non-overlapping sub-ranges (color channels) from the entire spectral range. The selection is made in particular such that contrasts between the different wash ware materials, each assigned to a class, are particularly high. Preferably, the color channels to be used are predetermined for a dishwasher 1 and then remain fixed. However, different color channels can also be selected for different dishwashers 1. It can further be provided that the color channels are selected anew each time depending on certain parameters, such as ambient brightness, a color temperature of the ambient light, or the like. It can also be provided that a color channel is widened or narrowed.In this way, it is ensured that the image analysis unit 25 performs a reliable classification based on the high contrasts.

[0075] In this example, the wash ware 51, 52, 53, 54 is classified into the classes empty K0, ceramic K1, metal K2, glass K3, and plastic K4. Furthermore, a class for wood can be provided. This is done, for example, using a neural network that performs object recognition. The classification is preferably pixel-accurate. The classification result KR can, as shown in the Fig. 6 represented as a two-dimensional matrix with as many rows and columns as the digital image IMG. Each entry of the matrix is ​​assigned to one of the classes K0 - K4.

[0076] The classification result KR thus comprises a quantitative classification including a respective position of the wash ware 51, 52, 53, 54 arranged in the wash ware holder 12.

[0077] Fig. 7 shows a schematic block diagram of an arrangement with a dishwasher 1 and an external device 100. The dishwasher 1 has, for example, all the features of the Fig. 1 - 5 illustrated dishwashers. In addition, the dishwasher 1 comprises a communication unit 30 for establishing a communication connection COMM to the external device 100, which is, for example, a server operated by a manufacturer of the dishwasher 1 and accessible via the Internet. The server 100 comprises an image analysis unit 25, which is used to classify items in the dishware holder 12, 13, 14 (see Fig. 1 or 3 ) of the dishwasher 1 arranged wash ware 51, 52, 53, 54 (see Fig. 6 ) depending on the captured image IMG (see Fig. 6 ) of the washware holder 12, 13, 14 and to output a classification result KR (see Fig. 6 ) to the communication unit 30 of the dishwasher 1. The communication unit 30 receives the captured image IMG from the image capture device 20 and transmits it via the communication connection KOMM to the image analysis unit 25. The communication unit 30 then receives the classification result KR from the image analysis unit 25 via the communication connection KOMM and outputs it to the control device 15 of the dishwasher 1. The control device 15 is configured to parameterize the washing program depending on the classification result KR.

[0078] Fig. 8 shows a schematic block diagram of an exemplary method for operating a dishwasher 1, for example the dishwasher of Fig. 1 - 5 or 7 . In a first step S1, an image IMG (see Fig. 6 ) a dishwashing rack 12, 13, 14 See Fig. 1 , 3 or6 ) of the dishwasher 1. This is done, for example, by an image capture device 20 arranged on the dishwasher 1 (see Fig. 1 - 5 or 7 ). In a second step S2, the items 51, 52, 53, 54 arranged in the items holder 12, 13, 14 (see Fig. 6 ) depending on the captured image IMG. This is done, for example, by an image analysis unit 25 (see Fig. 1 , 3 or 7 ). In a third step S3, a classification result KR (see Fig. 6 ), preferably to a control device 15 (see Fig. 1 or 6 ). In a fourth step S4, a washing program for washing the wash items 51, 52, 53, 54 is parameterized depending on the classification result KR.

[0079] Although the present invention has been described using exemplary embodiments, it is susceptible to numerous modifications. In particular, elements not shown in one figure may be present in the same way as described in another figure. For example, every dishwasher has a control device, even though these may be designed differently in different dishwashers. Reference symbols used:

[0080] 1 Dishwasher 2 Wash tub 3 Door 4 Wash chamber 5 Swivel axis 6 Loading opening 7 Floor 8 Ceiling 9 Rear wall 10 Side wall 11 Side wall 12 Dishware holder 13 Dishware holder 14 Dishware holder 15 Control device 16 Dishware flange 17 Sealing device 18 Cavity 19 Transparent side 20 Image capture device 21A Position sensor 21B Position sensor 22A Position sensor 22B Position sensor 25 Image analysis device 30 Communication unit 51 Dishware 52 Dishware 53 Dishware 54 Dishware 100 External device A Pull-out direction E Insertion direction H Horizontal image angle IMG Image K0 Class K1 Class K2 Class K3 Class K4 Class COMM Communication connection KR Classification result S1 Process step S2Process step S4Process step S1Process step VVertical angle of view

Claims

1. System comprising a dishwasher (1), preferably a household dishwasher, comprising a control device (15) for carrying out a washing program, which can be parameterised by means of a number of different washing program parameters, and comprising an image-capturing device (20) for capturing an image (IMG) of a receptacle for items to be washed (12, 13, 14) of the dishwasher (1), wherein the system also comprises an image analysis unit (25) for classifying items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14), depending on the captured image (IMG) of the receptacle for items to be washed (12, 13, 14) and for outputting a classification result (KR) to the control device (15), wherein the classification result (KR) comprises information regarding the quantity, the type and / or the position of the items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14), wherein the control device (15) is designed to parameterise the washing program depending on the classification result (KR), wherein the dishwasher (1) has a position sensor unit (21A, 21B, 22A, 22B) for capturing a position of the receptacle for items to be washed (12, 13, 14), characterised in that the position sensor unit (21A, 21B, 22A, 22B) is also designed for outputting a position signal to the image-capturing device (20), wherein the image-capturing device (20) is designed to capture the image (IMG) depending on the position signal, and wherein the position sensor unit (21A, 21B, 22A, 22B) is designed to output the position signal when the receptacle for items to be washed (12, 13, 14) is completely visible, in a field of view of the image-capturing device (20).

2. System according to claim 1, characterised in that the image-capturing device (20) is designed to capture an extended spectral range which comprises at least the visual spectral range and the near infrared range.

3. System according to claim 1 or 2, wherein the dishwasher (1) also comprises a washing container (2) with a peripheral washing container flange (16) around a loading opening (6) of the washing container (2), wherein the image-capturing device (20) is arranged in or on an upper flange portion of the washing container flange (16) assigned to a ceiling (8) of the washing container (2), and wherein the image-capturing device (20) faces away from the washing container (2) and obliquely in the direction of a plane spanned by a bottom (7) of the washing container (2).

4. System according to one of claims 1 - 3, characterised by a cavity (18), in which the image-capturing device (20) is received at least in some sections, provided in or on the washing container flange (16), wherein the cavity (18) is defined by a transparent element (19), preferably in the direction of the plane.

5. System according to one of claims 1 - 4, characterised in that the image-capturing device (20) has a vertical image angle (V) of at least 90° and a horizontal image angle (H) of at least 120°.

6. System according to one of claims 1 - 5, characterised in that the image analysis unit (25) is designed to classify the items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14), depending on the captured image (IMG) of the receptacle for items to be washed (12, 13, 14) by means of a neural network.

7. System according to one of claims 1 - 6, characterised in that a memory unit is provided for storing a number of captured images (IMG), wherein the image analysis unit (25) is designed to classify the items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14), depending on at least one of the stored images of the number of images.

8. System according to one of claims 1 - 7, characterised in that the image analysis unit (25) is integrated in the dishwasher (1).

9. System according to claim 8, characterised in that the image-capturing device (20) and the image analysis unit (25) are arranged together on a substrate in an integrated circuit.

10. System according to one of claims 1 - 9, characterised in that the image analysis unit (25) is integrated in a device (100) arranged externally relative to the dishwasher (1), wherein the dishwasher (1) is designed as a communication unit (30) for transmitting the captured image (IMG) to the image analysis unit (25), for receiving the classification result (KR) from the image analysis unit (25) and for outputting the received classification result (KR) to the control device (15).

11. System according to one of claims 1 - 10, characterised in that the dishwasher (1) has a plurality of receptacles for items to be washed (12, 13, 14), wherein the image-capturing device (20) is designed to capture at least one image (IMG) of each of the receptacles for items to be washed (12, 13, 14).

12. Method for operating a dishwasher (1), preferably a household dishwasher, comprising: capturing a position of a receptacle for items to be washed (12, 13, 14) and outputting a position signal when the receptacle for items to be washed (12, 13, 14) is completely visible in a field of view of the image-capturing device (20), capturing (S1) an image (IMG) of a receptacle for items to be washed (12, 13, 14) of the dishwasher (1) depending on the position signal, classifying (S2) the items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14) depending on the captured image (IMG), outputting (S3) a classification result (KR), wherein the classification result (KR) comprises information regarding the quantity, the type and / or the position of the items to be washed (51, 52, 53, 54) arranged in the receptacle for items to be washed (12, 13, 14), and parameterising (S4) a washing program for washing the items to be washed (51, 52, 53, 54) depending on the classification result (KR).