System with a dishwasher, method for operating a dishwasher, and computer program product

Abstract

The invention relates to a system (100) having a dishwasher (1), in particular a household dishwasher, the system having an image detection device (110) for detecting an image (IMG) of a rinsing object receiving part (12, 13, 14) of the dishwasher (1); an image processing device (120) for determining a rinsing object layout map (MAP) based on the detected image (IMG), wherein the rinsing object layout map (MAP) includes a division that divides the rinsing object receiving part (12, 13, 14) into a plurality of regions (A1 - A5), and wherein a corresponding region (A1 - A5) includes a predetermined rinsing object layout (D1 - D9) from a plurality of predetermined rinsing object layouts (D1 - D9); a correlation unit (130) for determining a cleaning matrix (MX) and for outputting the cleaning matrix (MX), the cleaning matrix including the correlation of processing instructions (T1 - T5) with each of the regions (A1 - A5) in the rinsing object layout map (MAP); and a control device (140) for executing a rinsing program based on the cleaning matrix (MX).

Description

Field of the Invention

[0001] The present invention relates to a system having a dishwasher, a method for operating a dishwasher, and a computer program product. Background Art

[0002] In order to improve the cleaning efficiency of dishwashers, it is advantageous to selectively adjust the rinsing program parameters for specific rinsing objects or specific arrangements of rinsing objects. Conventional dishwashers typically operate with hydraulically driven spray arms that uniformly apply the rinsing liquid to the rinsing space and the rinsing objects arranged therein, i.e., without local selectivity. This can cause, for example, the rinsing liquid pressure to be insufficient to deliver a sufficient amount of rinsing liquid into the intermediate space between two dishes when the dishes are in close proximity.

[0003] EP 1 238 622 B1 discloses a dishwasher having a rotatably supported spraying device, wherein a control device is provided which controls the rotation of the spraying device according to an angle, i.e., the angular velocity of the spraying device is related to the instantaneous angle of the spraying device, and the angle is between 0 and 360° during rotation. In this way, locally different treatment intensities can be achieved.

[0004] A dishwasher is also known which has a locally fixedly arranged intensive rinsing zone, wherein particularly dirty rinsing objects are placed in the intensive rinsing zone for intensive cleaning thereof. Summary of the Invention

[0005] In this context, the object of the present invention is to further improve the cleaning of rinsing objects by means of a dishwasher.

[0006] According to a first aspect, a system having a dishwasher, in particular a household dishwasher, is proposed. The system includes: an image detection device for detecting an image of the rinsing object receiving part of the dishwasher; an image processing device for determining a rinsing object layout diagram based on the detected image, wherein the rinsing object layout diagram includes a division dividing the rinsing object receiving part into a plurality of regions, and wherein a corresponding region includes a predetermined rinsing object arrangement from a plurality of predetermined rinsing object arrangements; a correlation unit for determining and outputting a cleaning matrix, the cleaning matrix including the association of processing instructions with each of the regions in the rinsing object layout diagram. The control device of the dishwasher is designed to execute a rinsing program based on the cleaning matrix.

[0007] The system has the following advantages: Each area of the rinse object receptacle is processed according to a processing instruction that is particularly well-suited for rinsing the currently arranged rinse objects, based on the arrangement of the rinse objects. Here, the corresponding processing instruction is determined such that the cleaning of the correspondingly arranged rinse objects is particularly effective. It can be said that the system implements spatially selective processing, which is performed in an efficiency-optimized manner. Overall, this enables optimized cleaning of the rinse objects while increasing the efficiency of the dishwasher.

[0008] The image detection device is, for example, a digital camera that is designed to detect and output digital images having a resolution of, for example, at least 1 MP (MP = megapixel), preferably at least 5 MP, and more preferably more than 8 MP. The image detection device preferably includes an image sensor with an extended spectral range, which, for example, has a sensitivity in the range between 2500 nm and 250 nm. The image detection device preferably also includes a lens that is designed to image the rinse object receptacle (or, if the dishwasher has multiple rinse object receptacles, the multiple rinse object receptacles) onto the image sensor. The image detection device preferably detects an image of the rinse object receptacle when the rinse object receptacle is arranged in a predetermined position. The image detection device can also include an illumination unit for illuminating the rinse object receptacle during image detection.

[0009] The image processing device can be implemented in a hardware technology and / or software technology manner. In the case of implementation in a hardware technology manner, the image processing device can, for example, be configured as a computer or a microprocessor. In the case of implementation in a software technology manner, the image processing device can be configured as a computer program product, a function, a routine, a part of a program code, or an executable object.

[0010] The image processing device receives the image of the rinse object receptacle detected by the image detection device and, for example, performs image analysis. The image analysis can particularly include model recognition, distinguishing image regions based on spectral information, image transformation, etc. In this way, the image processing device determines the rinse object layout diagram.

[0011] In order to determine the rinse object layout diagram, the image processing device, for example, analyzes the detected image, where the rinse object arrangement is detected in the image. The corresponding rinse object arrangement can particularly include information about the spatial orientation of the rinse objects, the type of rinse objects, the shape of the rinse objects, and / or the material of the rinse objects. The detected rinse object arrangement particularly corresponds to the predetermined arrangement of the rinse objects here.

[0012] A predetermined rinse object arrangement is determined, for example, by a set of parameters. Among them, for example, an orientation parameter for describing the spatial orientation of the rinse object, a type parameter for describing the type of the rinse object, a shape parameter for describing the shape of the rinse object, and / or a material parameter for describing the material of the rinse object can be provided.

[0013] The rinse object layout diagram includes a division that divides the rinse object accommodation part into multiple areas. Here, each corresponding area has a predetermined rinse object arrangement from among a plurality of predetermined rinse object arrangements. For example, each pixel of the image of the rinse object accommodation part is associated with a predetermined rinse object arrangement. All the pixels associated with the first predetermined rinse object arrangement form the first area, all the pixels associated with the second predetermined rinse object arrangement form the second area, and so on. Here, each pixel of the image corresponds to a position in the rinse object accommodation part.

[0014] For example, a first area is determined in which a plurality of porcelain plates are arranged upright in sequence in the rinse object accommodation part, and a second area is determined in which an iron pot is arranged with its cooking surface facing down in the rinse object accommodation part.

[0015] The plurality of predetermined rinse object arrangements especially include predetermined arrangements preset, for example, by the manufacturer of the dishwasher and / or by the user of the dishwasher. Here, for example, similar rinse object arrangements that can effectively clean the rinse objects with the same or similar processing instructions are combined into a predetermined arrangement. On the other hand, different rinse object arrangements that can be effectively cleaned with different processing instructions can be considered through different predetermined rinse object arrangements. For example, it is advantageous to distinguish between upright plates and frying pans because they can be cleaned particularly effectively with different processing instructions.

[0016] The association unit can be implemented in a hardware technology and / or software technology manner. In the case of implementation in a hardware technology manner, the association unit can be configured as a computer or a microprocessor, for example. In the case of implementation in a software technology manner, the association unit can be configured as a computer program product, a function, a routine, a part of the program code, or an executable object.

[0017] The association unit is designed to associate a corresponding processing instruction with each area in the rinse object layout diagram that has been obtained by the image processing device. It can also be said that a specific processing instruction is associated with each area. Here, the specific processing instruction especially includes a set of processing parameters, and the processing instruction is determined by the processing parameters. The processing parameters include, for example, rinse liquid pressure, spray angle of rinse liquid output, processing duration, rinse liquid temperature, detergent dosage, etc. Each processing parameter that affects the cleaning result can be preset in the processing instruction.

[0018] Since the arrangement of the rinsing material in the corresponding area is known, it is possible to determine the treatment instructions for this area, so that the cleaning is optimized. If the predetermined rinsing material arrangement is determined by one or more parameters, it is possible, for example, to determine the treatment parameters for determining the treatment instructions as a function of said parameters. Additionally and / or alternatively, a specific treatment instruction can be associated with the predetermined rinsing material arrangement, and said specific treatment instruction is subsequently associated with the corresponding area.

[0019] Here, the treatment instructions for the corresponding area preferably include the complete rinsing program for this area. Here, for example, the different treatment instructions for different areas are the same in each subroutine step, that is, for example, in pre-rinsing, main rinsing, rinsing clean and drying.

[0020] The cleaning matrix obtained by said association can also be referred to as a treatment map, because a specific treatment instruction and thus a spatially selective rinsing program are associated with each position in the rinsing material receptacle.

[0021] The control device can be implemented in a hardware technology and / or a software technology manner. In the case of implementation in a hardware technology manner, the control device can, for example, be configured as a computer or a microprocessor. In the case of implementation in a software technology manner, the control device can be configured as a computer program product, a function, a routine, a part of a program code or an executable object.

[0022] The control device is designed to execute the washing program based on the cleaning matrix. For this purpose, the control device correspondingly controls the corresponding components of the dishwasher, such as the circulation pump, the water distributor, the regulating motor, the heating device, the automatic dosing system, the drying device, the valve, etc. Here, the areas of the rinsing material receptacle are processed according to the division according to the rinsing material arrangement diagram and according to the corresponding treatment instructions.

[0023] The image processing device and the associated unit can in particular be implemented together with the control device and / or share common resources with the control device, such as a computing unit, a data bus, a working memory, etc.

[0024] Through said spatially selective treatment, the dishwasher can operate very efficiently. For example, even if the rinsing material is only partially loaded, the dishwasher can effectively execute the reprogramming by selectively treating only the areas in the rinsing material receptacle where the rinsing material is arranged.

[0025] According to an embodiment of the system, the system includes a transformation unit, which is designed to transform the detected image and to output the transformed image and / or to generate an image based on the detected image and to output the generated image, wherein the image processing device is designed to determine the rinsing material arrangement diagram based on the transformed image or the generated image.

[0026] The transformed image and / or the generated image can be advantageously created such that the determination of the rinsing object layout by the image processing device is improved.

[0027] The transformation unit is preferably part of the image processing device.

[0028] Transforming the image includes, for example, correcting a distorted image, converting the image from a first coordinate system to a second coordinate system, enhancing the contrast, performing edge recognition, etc.

[0029] Generating an image particularly includes generating an image by means of a generation instruction. The generation instruction can be learned by the transformation unit through machine learning here. In particular, the generation instruction can be adaptively adjusted by the transformation unit. In this way, the generation instruction can be matched to the individual requirements of the dishwashers in each household.

[0030] The generation instruction can additionally include the transformation of the image.

[0031] According to another embodiment of the system, the transformation unit includes a neural network, in particular a generative general network.

[0032] The neural network can preferably be trained by a training data set.

[0033] According to another embodiment of the system, the image detection device is arranged at the dishwasher such that the image detection device detects an image of the rinsing object receptacle from the upper hemisphere relative to the rinsing object receptacle.

[0034] Here, the upper hemisphere relates to the normal arrangement of the dishwasher with respect to gravity, where the dishwasher stands upright on the floor with its lower side or bottom.

[0035] For example, the dishwasher includes a rinsing container having a rinsing container flange surrounding the loading opening of the rinsing container, wherein the image detection device is arranged in or at an upper flange section of the rinsing container flange associated with the top of the rinsing container, and wherein the image detection device faces away from the rinsing container and is inclined in the direction of the plane extended by the bottom of the rinsing container.

[0036] This arrangement of the image detection device is advantageous because it is thus arranged outside the area that can be reached by the rinsing liquid, and thus the environmental conditions for the sensitive electronic components can also be relatively easily controlled. The rinsing container flange is preferably located outside the rinsing chamber sealed by a sealing device.

[0037] According to another embodiment of the system, the transformation unit is designed to generate an image of the rinsing object receptacle that corresponds to a view of the rinsing object receptacle from the lower hemisphere, particularly in a vertical manner from below.

[0038] Here, the lower hemisphere relates to the normal arrangement of the dishwasher with respect to gravity, where the dishwasher stands on the floor with its lower side or its bottom. It can also be said that the transformation unit is designed to generate a lower view of the rinsing object receiving part based on the upper view of the rinsing object receiving part.

[0039] This embodiment is particularly advantageous in dishwashers where the spraying device of the dishwasher is arranged below the rinsing object receiving part. In addition, it is difficult to arrange the image detection device such that the image detection device directly detects the image of the rinsing object receiving part from below, because it is almost impossible to observe the spacing required for image detection and dirt will accumulate on the correspondingly arranged image detection device, which will interfere with image detection.

[0040] According to another embodiment of the system, the system includes a model recognition unit, which is designed to recognize models present in the detected image, the transformed image or the generated image and output a model image including the recognized models, wherein the image processing device is designed to obtain a rinsing object layout based on the model image.

[0041] The model recognition unit is preferably a component of the image processing device.

[0042] For example, the model is composed of parallel lines that can also have a certain angle with respect to a preset reference direction, curves, vertical lines, geometric shapes such as circles, rectangles, ellipses, etc., and combinations thereof.

[0043] For example, the orientation of the rinsing object can be deduced from the model. For example, the arrangement of plates standing in sequence can be deduced from parallel lines.

[0044] According to another embodiment of the system, the image processing device is designed to obtain the type, shape and / or material of the rinsing object.

[0045] The more these characteristics of the rinsing object are known, the more precisely the processing rules for the rinsing object can be defined. For example, it is advantageous that rinsing objects made of glass are selected with different processing parameters from those made of metal.

[0046] According to another embodiment of the system, the rinsing object layout includes information about the type, material, shape and / or spatial orientation of the rinsing object at each point.

[0047] Based on the information that can exist as parameter values related to a preset scale, for example, a predetermined rinsing object arrangement can be obtained for each point of the rinsing object layout.

[0048] The type of the rinsing object includes information such as whether the rinsing object is a pot, a bowl, a plate, tableware, drinking utensils, etc.

[0049] According to another embodiment of the system, the dishwasher has a spraying device, in particular a spraying arm, associated with the rinsing article receiving part, which spraying device is used to apply rinsing liquid to the rinsing articles arranged in the associated rinsing article receiving part, wherein the position of the spraying device can be adjusted, in particular controlled, relative to the rinsing article receiving part.

[0050] This position includes both the spatial position of the spraying device in the rinsing container, such as the rotation angle of the spraying arm, and the orientation of the spraying device, such as the inclination of the spraying arm perpendicular to its extension direction. By adjusting the inclination, for example, the spraying direction of the rinsing liquid can be adjusted.

[0051] For this purpose, the dishwasher preferably includes a spraying device that can be controlled in a motorized manner, which spraying device has at least one axis, preferably at least two axes, and the spraying device has an adjustable adjustment position for the corresponding axis.

[0052] According to another embodiment of the system, the dishwasher has a hydraulic system, which hydraulic system includes at least one intensive rinsing zone that can be selectively activated according to the rinsing article layout.

[0053] The intensive rinsing zone can be fixedly positioned, for example, arranged at a specific position in the rinsing article receiving part or related to this position, and / or the intensive rinsing zone can be a locally variable intensive rinsing zone. In the case of a locally variable intensive rinsing zone, the intensive rinsing zone is preferably also capable of being controlled in a motor-driven manner, for example, controlling its position and / or orientation.

[0054] The intensive rinsing zone can operate independently or in combination with the spraying device, that is, apply rinsing liquid.

[0055] According to another embodiment of the system, the processing instructions associated with the corresponding area include determining a parameter value from a predetermined value range and / or determining the temporal variation of the parameter values of one or more processing parameters, which processing parameters include the applied pressure, rinsing liquid temperature, spraying device position, spraying device orientation, and / or application duration.

[0056] The applied pressure is affected, for example, by the rotational speed of the circulation pump. The temporal variation of the parameter values includes, for example, the reciprocating movement of the spraying device within the determined area, wherein, for example, a specific speed for the movement can be provided. In addition, a specific number of repetitions can be provided.

[0057] According to another embodiment of the system, a specific processing instruction among a plurality of processing instructions is associated with a corresponding predetermined rinsing article layout.

[0058] This is particularly understood as: fixedly presupposing an association. This has the following advantages: for example, based on empirical tests, the best processing instructions can be determined for the corresponding predetermined rinse object arrangement, and the processing instructions are accordingly used. In particular, such an association particularly reduces the resources required for the association unit.

[0059] In an embodiment of the system, the image processing device includes an incorrect loading detection unit, which is designed to detect an object arrangement that is not suitable for rinsing the rinse object, a transformed image, and / or a generated image based on the detected image and output a detection signal, wherein the dishwasher has an output unit for outputting a notification signal to the user of the dishwasher based on the detection signal.

[0060] In particular, incorrect loading is understood as an object arrangement that foreseeably leads to an insufficient rinsing result. An example of this is the highly overlapping arrangement of two rinse object components, such that the rinsing liquid does not reach or only very insufficiently reaches the intermediate space between the rinse object components. A pot with an opening facing upwards and in which rinsing liquid can accumulate in the opening is also an example of incorrect loading.

[0061] According to another embodiment of the system, the system has a device outside the dishwasher, which at least integrates the image processing device, wherein the dishwasher has a communication unit designed to transmit the detected image to the external device and receive an object arrangement diagram from the external device.

[0062] According to another embodiment, the image processing device is configured as part of an App that can be installed on the external device.

[0063] The external device is, for example, a mobile device, which can also be referred to as a mobile terminal device, or a server. The mobile device is, for example, a smartphone, a tablet computer, or a tablet PC. The App can also be referred to as an application, an application software, or an application program. The application can in particular be configured as a computer program product, a function, a routine, a part of the program code, or an executable object.

[0064] In particular, the dishwasher includes a communication unit that can be coupled to the external device, for example, by means of a network. Here, the network particularly includes a cellular network, a WLAN, the Internet, and / or another wireless or wired data network.

[0065] According to a second aspect, a method for operating a dishwasher, in particular a household dishwasher, is proposed. In a first step, an image of the rinsing compartment is detected. In a second step, a rinsing object layout is determined based on the detected image, wherein the rinsing object layout has a division that divides the rinsing compartment into a plurality of regions, and wherein a corresponding region includes a predetermined rinsing object layout from a plurality of predetermined rinsing object layouts. In a third step, a cleaning matrix is determined, the cleaning matrix including an association of a processing instruction with each of the regions in the rinsing object layout. In a fourth step, the cleaning matrix is output. In a fifth step, a rinsing program is executed based on the cleaning matrix.

[0066] The method is preferably executed by means of a dishwasher according to the first aspect. The method has the same advantages as those explained for the dishwasher according to the first aspect.

[0067] The embodiments and features described for the proposed dishwasher are correspondingly applicable to the proposed method.

[0068] Furthermore, a computer program product is proposed, which includes instructions that, when the program is executed by a computer, cause the computer to execute the above method.

[0069] The computer program product, i.e., for example, a computer program medium, can be provided or delivered, for example, in the form of a storage medium, i.e., for example, a memory card, a USB flash drive, a CD-ROM, a DVD, or also in the form of a file that can be downloaded from a server in a network. For example, this can be done by transmitting a corresponding file with the computer program product or the computer program medium in a wireless communication network.

[0070] Other possible embodiments of the present invention also include combinations of features or embodiments not explicitly presented before and hereinafter described with respect to the embodiments. Here, a person skilled in the art will also add individual aspects as improvements or supplements to the corresponding basic form of the present invention. Description of the Drawings

[0071] Other advantageous designs and aspects of the present invention are the subject matter of the embodiments described hereinafter and the dependent claims. Furthermore, the present invention is elaborated in detail with reference to the accompanying drawings according to preferred embodiments.

[0072] Figure 1 A schematic perspective view showing an embodiment of a system with a dishwasher;

[0073] Figure 2 Schematically shows how an exemplary cleaning matrix is determined from an exemplary image of the rinsing compartment;

[0074] Figure 3 Shows an exemplary number of predetermined rinsing object layouts;

[0075] Figure 4 Schematic block diagram showing an arrangement for training a neural network;

[0076] Figure 5 Schematic view showing a system having a dishwasher with a spraying device;

[0077] Figure 6 Schematically shows a system including a dishwasher;

[0078] Figure 7 Schematic view showing a system having a dishwasher and an external device; and

[0079] Figure 8 Schematic block diagram showing an embodiment of a method for operating a dishwasher.

[0080] In the drawings, unless otherwise stated, the same or functionally identical elements are provided with the same reference numerals. Detailed Description

[0081] Figure 1 Schematic perspective view showing an embodiment of a dishwasher 1, which is configured as a household dishwasher here. The household dishwasher 1 includes a rinsing container 2, which can be enclosed especially watertightly by a door 3. For this purpose, a sealing device can be provided between the door 3 and the rinsing container 2. The rinsing container 2 is preferably square. The rinsing container 2 can be arranged in the housing of the household dishwasher 1. The rinsing container 2 and the door 3 can form a rinsing chamber 4 for rinsing the rinsing objects 21 - 25 (see Figure 2 or Figure 6 ).

[0082] The door 3 is shown in its open state in Figure 1 . The door 3 can be opened or closed by pivoting about a pivot axis 5 provided at the lower end of the door 3. By means of the door 3, the loading opening 6 of the rinsing container 2 can be closed or opened. The rinsing container 2 has a bottom 7, a top 8 arranged opposite the bottom 7, a rear wall 9 arranged opposite the closed door 3, and two side walls 10, 11 arranged opposite each other. The bottom 7, the top 8, the rear wall 9 and the side walls 10, 11 can be made of high-quality steel, for example. Alternatively, for example, the bottom 7 can be made of a plastic material.

[0083] The household dishwasher 1 also has at least one rinsing object receiving part 12 to 14. Preferably, a plurality of, for example three, rinsing object receiving parts 12 to 14 can be provided, wherein the rinsing object receiving part 12 can be the lower rinsing object receiving part or the bottom basket, the rinsing object receiving part 13 can be the upper rinsing object receiving part or the upper basket and the rinsing object receiving part 14 can be the cutlery drawer. As Figure 1It is also shown that the rinse article receptacles 12-14 are arranged one above the other in the rinse container 2. Each rinse article receptacle 12-14 can be selectively moved into or out of the rinse container 2. In particular, each rinse article receptacle 12-14 can be pushed or moved into the rinse container 2 in the pushing direction E and can be withdrawn or moved out of the rinse container 2 in the pulling direction A opposite to the pushing direction E.

[0084] The image detection device 110 is arranged in the upper region of the rinse container flange around the loading opening 6 of the rinse container. The image detection device 110 is configured as a digital camera. The digital camera 110 is arranged centrally relative to the loading opening 6 and has, for example, a wide-angle lens (not shown), which enables each rinse article receptacle 12-14 to be completely detected in the image IMG when the rinse article receptacle is in the withdrawn state (see Figure 2 or Figure 7 ).

[0085] An image processing device 120, a correlation unit 130, and a control device 140 are also arranged at the door 3. They are shown separately here, but they can also be integrated together in one element. In addition, the arrangement at the door 3 is only exemplary.

[0086] The image processing device 120 is designed to determine a rinse article layout map MAP based on the detected image IMG (see Figure 2 or Figure 7 ). The rinse article layout map MAP includes a division of the respective rinse article receptacles 12-12 into a plurality of regions A1-A5 (see Figure 2 ), where the respective regions (A1-A5) include a predetermined rinse article arrangement D1-D9 from a plurality of predetermined rinse article arrangements D1-D9 (see Figure 3 ). The correlation unit 130 is designed to determine a cleaning matrix MX (see Figure 2 ) and output the cleaning matrix MX, which includes the association of the processing instructions T1-T5 (see Figure 2 ) with each of the regions A1-A5 in the rinse article layout map MAP. The control device 140 is designed to execute a rinse program based on the cleaning matrix MX.

[0087] Figure 2 It is schematically shown how, for example, Figure 1 from the digital camera 110 of a household dishwasher 1 (see Figure 1)An image IMG of the detected rinse item receptacle 12 is used to determine a cleaning matrix MX. The image IMG shows the rinse item receptacle 12 and the rinse items 21 - 25 arranged on the rinse item receptacle. The image IMG has a specific perspective, so the rinse items 21 - 25 partially overlap. The rinse item 21 is, for example, a lid of a pot, where the rinse item 22 is, for example, three large drinking glasses, where the rinse item 23 is, for example, a food storage box, the rinse item 24 is, for example, a pot, and the rinse item 25 is, for example, a plurality of plates arranged in sequence.

[0088] An image processing device 120 (see Figure 1 ) determines a rinse item layout map MAP, which includes a division of the rinse item receptacle 12 into regions A1 - A5 having a predetermined rinse item layout D1 - D9 (see Figure 3 ). In this example, the rinse item layout map MAP corresponds to a view of the rinse item receptacle 12 from below. For example, to do this, the image processing device 120 generates an image based on the detected image IMG, which shows the rinse item receptacle 12 from below, and then associates each pixel in the generated image with a predetermined rinse item layout D1 - D9. In this way, different regions A1 - A5 are formed. The predetermined rinse item layouts D1 - D9 can differ from each other especially in terms of the type, shape, and orientation of the rinse items 21 - 25, but the material of the rinse items 21 - 25 can also be taken into account.

[0089] Processing instructions T1 - T5 are associated with each of these regions A1 - A5 in the rinse item layout map MAP. The corresponding associated processing instructions T1 - T5 are selected such that the rinse items 21 - 25 arranged in the regions A1 - A5 are cleaned especially effectively. For example, the drinking vessels 22 are made of glass, which is why relatively low application pressure and relatively low rinse liquid temperature are advantageous for the drinking vessels, because otherwise the glass would be more strongly worn. In contrast, in the case of the plates 25, increased application pressure would be advantageous in order to completely apply the rinse liquid 154 to the intermediate spaces (see Figure 6 ). In the case where the pot lid 21 is arranged slightly inclined, an inclined spraying direction (inclined with respect to the vertical axis) can be advantageous in order to wet all areas of the pot lid 21 well with the rinse liquid 154.

[0090] For example, the cleaning matrix MX has the associations described in Table 1.

[0091] Table 1: Association of parameter values of different processing parameters with different regions. Thus, the corresponding rows correspond to the processing instructions.

[0092] Area Spraying pressure Spraying angle Duration Temperature A1 60 (+30°，-30°) 1 minute 60℃ A2 40 0° 1 minute 45℃ A3 60 +10° 1 minute 45℃ A4 80 0° 2 minutes 60℃ A5 100 0° 4 minutes 60℃

[0093] In Table 1, the spray pressure is described, for example, as a percentage value relative to the maximum spray pressure. The spray angle relates, for example, to the angle by which the spray arms 150, 152 (see Figure 5 or Figure 6 ) are inclined from a horizontal orientation, where a spray angle of 0° represents a vertical spray direction. The spray angle data for the A1 area is an interval, in which the spray arms 150, 152 preferably pivot multiple times in said area. The duration relates to the duration of applying the flushing liquid 154 to the corresponding area at the processing temperature being processed. The temperature relates to the temperature of the flushing liquid during application in the corresponding area.

[0094] The control device 140 executes a flushing program based on the cleaning matrix MX, that is to say: each of the areas A1 - A5 is processed according to the associated processing instructions T1 - T5.

[0095] Figure 3 Examples of a plurality of predetermined flushing object arrangements D1 - D9 are shown. The flushing object arrangements D1 - D9 shown here are different especially in terms of the orientation and shape of the flushing objects. It can be said that the shown flushing object arrangements D1 - D9 each correspond to a basic type, based on which, for example, the preferred spray direction of the flushing liquid 154 (see Figure 6 ) can be determined. Such a basic type can be determined, for example, by model recognition. Other processing parameters can be determined according to other characteristics of the flushing object, such as the type and material of the flushing object. In this regard, there can be multiple different predetermined flushing object arrangements for the corresponding basic type.

[0096] It should be noted that the number of the predetermined flushing object arrangements D1 - D9 is not limited to nine, and it can also be provided with up to thirty, up to fifty, up to one hundred or even more than one hundred different predetermined flushing object arrangements.

[0097] Figure 4 A schematic block diagram of an arrangement for training the neural networks 122, 124 is shown. For example, the neural network 122 is trained such that the neural network generates an image gIMG based on the detected image IMG. The neural network 122 is an example of the transformation unit 122. For example, there is an image IMG of the flushing object receptacle 12 (see Figure 2 ), which is detected from an oblique upper direction and thus has a three-dimensional distortion, etc., and the generated image gIMG should show the flushing object receptacle 12 and the flushing objects 21 - 25 arranged therein (see Figure 2 ) from a perspective from below.

[0098] For example, there is a GAN (Generative Adversarial Network). Here, two neural networks 122 and 124 are trained. The image pair is preset as training data, where the image IMG of the rinsing object accommodating part 12 and another image IMG* showing the rinsing object accommodating part 12 from below form a pair. The training data is preferably real images, where the rinsing objects on the two images are arranged identically. The neural network 122 is also called a generator because it generates artificial images gIMG. The generated image gIMG below the rinsing object accommodating part 12 and the real image IMG* are fed to the neural network 124. The neural network 124 is also called a discriminator. The discriminator 124 determines which of the two fed images IMG*, gIMG is the real image and outputs the corresponding result R. The generator 122 and the discriminator 124 are in a competitive state: the generator 122 tries to generate an image gIMG that the discriminator 124 considers to be the real image IMG*. When the amount of training data is large enough, the generator 122 can generate an image gIMG corresponding to the actual view from below of the rinsing object accommodating part 12. The training method explained above is known, for example, as the Pix2Pix model.

[0099] The generator 122 is, for example, a component of the image processing device 122. Advantageously, a rinsing object layout map MAP is determined based on the generated image gIMG (see Figure 2 or Figure 6 ), because no other transformations, etc. are required to determine a cleaning matrix MX based on the rinsing object layout map MAP (see Figure 2 ).

[0100] Figure 5 A schematic view of a system 100 with a dishwasher 1 having a spraying device 150 is shown from above. For example, this is Figure 1 a household dishwasher. The spraying device 150 is configured, for example, as a spraying arm, at the top of which a satellite spraying arm 152 is arranged. The spraying arm 150 is arranged, for example, at the bottom 7 of the dishwasher 1 and is designed to apply to the rinsing objects 21 - 25 (see Figure 1 , Figure 2 or Figure 6 ) arranged above the spraying arm 150 in the rinsing object accommodating part 12 (see Figure 2 ). The spraying arm 150 can be placed in a predetermined rotational position by means of a motor (not shown) and held there and / or it can be moved by the motor according to a specific movement path. The satellite spraying arm 152 can be arranged rotatably freely at the spraying arm 150, where, for example, the sprayed rinsing liquid 154 (see Figure 6) The reaction force of () drives the satellite spray arm 152. By controlling the rotation angle of the spray arm 150, each area of the rinsing object receiving part 12 can be rinsed individually, that is, processed according to specific processing instructions.

[0101] By placing the spray arm 150 in a specific rotational position and by applying the rinsing liquid 154 to the spray arm 150 including the satellite spray arm 152, a strong rinsing zone is obtained in the area of the satellite spray arm 152. The spray arm 150 is preferably additionally rotatably supported about an axis extending in the radial direction with respect to the rotational direction, which will be explained in more detail below with reference to Figure 3 Explained in more detail.

[0102] Figure 6 Schematically shows a system 100 including a dishwasher 1. This is for example Figure 1 A household dishwasher. The spray arm 150 that can be rotated in a motor-driven manner and the satellite spray arm 152 at its tip are arranged at the bottom 7 of the dishwasher 1, as explained above according to Figure 6 As explained. The rinsing object receiving part 12 and the rinsing objects 24, 25 arranged therein are arranged above the spray arm 150. The image processing device 120 (see Figure 1 ) has obtained the rinsing object layout MAP (see Figure 2 Or Figure 7 ), and the correlation unit 130 (see Figure 1 ) has obtained the cleaning matrix MX (see Figure 2 ). For the area of the plate 25, the processing instructions of the cleaning matrix MX include the following provisions: the spray arm 150 should be tilted at an angle α such that the rinsing liquid 154 is applied to the rinsing object 25 in the area at the angle α. Through this angle, the rinsing liquid 154 can better enter the intermediate space between the plates 25, and thus the cleaning of the plates 25 can be improved. The control device 140 (see Figure 1 ) controls the spray arm 150 according to the provisions of the processing instructions for the area.

[0103] Figure 7 Schematically shows a system 100 having a dishwasher 1 and an external device 200. This is for example Figure 1 A household dishwasher 1. The external device 200 can be configured as a server or a mobile device. The dishwasher 1 includes a communication unit 160, by means of which a communication connection with the communication unit 202 of the external device 200 can be established. In this example, the external device 200 integrates the image processing device 160.

[0104] The dishwasher 1 transmits the detected image IMG to the external device 200 by means of the communication unit 160, and the external device determines the rinsing object layout MAP based on the received image IMG. The dishwasher 1 then receives the determined rinsing object layout MAP via the communication unit 160.

[0105] This can be advantageous because determining the rinsing object layout MAP based on the detected image IMG can be a computationally intensive process. In this case, there is no need for the dishwasher 1 itself to provide such computing power, so the dishwasher can be constructed less complexly.

[0106] Additionally, the external device 200 can also integrate the correlation unit 130 (see Figure 1 ) and directly determine the cleaning matrix MX (see Figure 2 ) instead of the rinsing object layout MAP and send it to the dishwasher 1.

[0107] The presence of the external device 200 does not exclude the dishwasher 1 from having an image processing device 160.

[0108] Figure 8 Shows a schematic block diagram of an embodiment of a method for operating a dishwasher 1, for example Figure 1 a household dishwasher. In a first step S1, an image IMG of the rinsing object receiving part 12 - 14 is detected (see Figure 2 or Figure 7 ). In a second step S2, the rinsing object layout MAP is determined based on the detected image IMG (see Figure 2 or Figure 7 ), where the rinsing object layout MAP includes a division of the rinsing object receiving part 12 - 14 into a plurality of regions A1 - A5. The corresponding regions A1 - A5 include one of a plurality of predetermined rinsing object layouts D1 - D9 (see Figure 3 ). In a third step S3, the cleaning matrix MX is determined (see Figure 2 ), which includes the association of the processing instructions T1 - T5 (see Figure 2 ) with each of the regions A1 - A5 in the rinsing object layout MAP. In a fourth step S4, the cleaning matrix MX is output, and in a fifth step S5, a rinsing program is executed based on the cleaning matrix MX.

[0109] Although the present invention has been described according to embodiments, various modifications can be made to the present invention.

[0110] List of reference numerals

[0111] 1 Dishwasher

[0112] 2 Rinsing container

[0113] 3 doors

[0114] 4 flushing chambers

[0115] 5 pivot axes

[0116] 6 loading openings

[0117] 7 bottom

[0118] 8 top

[0119] 9 rear wall

[0120] 10 side walls

[0121] 11 side walls

[0122] 12 flushing material containers

[0123] 13 flushing material containers

[0124] 14 flushing material containers

[0125] 21 flushing materials

[0126] 22 flushing materials

[0127] 23 flushing materials

[0128] 24 flushing materials

[0129] 25 flushing materials

[0130] 100 system

[0131] 110 image detection device

[0132] 120 image processing device

[0133] 122 transformation unit

[0134] 124 neural network

[0135] 130 correlation unit

[0136] 140 control device

[0137] 150 spraying device

[0138] 152 spraying device

[0139] 154 flushing liquid

[0140] 160 communication unit

[0141] 200 external device

[0142] 202 communication unit

[0143] α angle

[0144] A extraction direction

[0145] Area A1

[0146] Area A2

[0147] Area A3

[0148] Area A4

[0149] Area A5

[0150] D1 rinse arrangement

[0151] D2 rinse arrangement

[0152] D3 rinse arrangement

[0153] D4 rinse arrangement

[0154] D5 rinse arrangement

[0155] D6 rinse arrangement

[0156] D7 rinse arrangement

[0157] D8 rinse arrangement

[0158] D9 rinse arrangement

[0159] E push-in direction

[0160] gIMG-generated image

[0161] IMG image

[0162] IMG* image

[0163] R result

[0164] S1 method step

[0165] S2 method step

[0166] S3 method step

[0167] S4 method step

[0168] S5 method step

[0169] T1 processing instruction

[0170] T2 processing instruction

[0171] T3 processing instruction

[0172] T4 processing instruction

[0173] T5 processing instruction.

Claims

1. A system (100) having a dishwasher (1), the system having: an image detection device (110) for detecting an image (IMG) of a rinsing object receiving part (12, 13, 14) of the dishwasher (1); an image processing device (120) for obtaining a rinsing object layout map (MAP) based on the detected image (IMG), wherein, the rinsing object layout map (MAP) includes a division that divides the rinsing object receiving part (12, 13, 14) into a plurality of regions (A1 - A5), wherein the corresponding regions (A1 - A5) include one of a plurality of predetermined rinsing object layouts (D1 - D9); a correlation unit (130) for obtaining a cleaning matrix (MX) and outputting the cleaning matrix (MX), the cleaning matrix including the association of processing instructions (T1 - T5) with each of the regions (A1 - A5) in the rinsing object layout map (MAP); and a control device (140) for performing a rinsing program based on the cleaning matrix (MX), wherein the image detection device (110) is arranged at the dishwasher (1) such that the image detection device (110) detects an image (IMG) of the rinsing object receiving part (12, 13, 14) from the upper hemisphere relative to the rinsing object receiving part (12, 13, 14), wherein the system is further provided with a transformation unit (122) for generating an image based on the detected image (IMG) and outputting the generated image (gIMG), wherein the transformation unit (122) is arranged to generate an image (gIMG) corresponding to a view of the rinsing object receiving part (12, 13, 14) as observed from the lower hemisphere.

2. The system according to claim 1, characterized in that, the dishwasher is a household dishwasher.

3. The system according to claim 1, characterized in that, the image (gIMG) corresponds to a view of the rinsing object receiving part (12, 13, 14) observed vertically from below.

4. The system according to claim 1, characterized in that, the transformation unit is designed to transform the detected image (IMG) and output the transformed image (gIMG), wherein the image processing device (120) is arranged to obtain the rinsing object layout map (MAP) based on the transformed image (gIMG) or the generated image (gIMG).

5. The system according to claim 4, characterized in that, the transformation unit (122) includes a neural network (122, 124).

6. The system according to claim 5, characterized in that, the transformation unit (122) includes a generated general network.

7. The system according to any one of claims 1 to 6, characterized in that, A model recognition unit is provided, which is designed to recognize models present in the detected image (IMG), the transformed image (gIMG), or the generated image (gIMG) and output a model image including the recognized models, wherein the image processing device (120) is configured to determine the rinsing object layout diagram (MAP) based on the model image.

8. The system according to any one of claims 1 to 6, characterized in that the image processing device (120) is configured to determine the type of the rinsing object (21 - 25), the shape of the rinsing object (21 - 25), and / or the material of the rinsing object (21 - 25).

9. The system according to any one of claims 1 to 6, characterized in that the rinsing object layout diagram (MAP) includes information about the type of the rinsing object (21 - 25), the material of the rinsing object (21 - 25), the shape of the rinsing object (21 - 25), and / or the spatial orientation of the rinsing object (21 - 25) at the corresponding point at each point.

10. The system according to any one of claims 1 to 6, characterized in that the dishwasher (1) has a spraying device (150, 152) associated with the rinsing object receiving part (12, 13, 14), and the spraying device is used to apply a rinsing liquid (154) to the rinsing objects (21 - 25) arranged in the associated rinsing object receiving part (12, 13, 14), wherein the position of the spraying device (150, 152) can be adjusted relative to the rinsing object receiving part (12, 13, 14).

11. The system according to claim 10, characterized in that the spraying device is a spraying arm.

12. The system according to any one of claims 1 to 6, characterized in that the dishwasher (1) has a hydraulic system, and the hydraulic system includes at least one strong rinsing area, and the strong rinsing area can be selectively activated according to the rinsing object layout diagram (MAP).

13. The system according to any one of claims 1 to 6, characterized in that the processing instructions (T1 - T5) associated with the corresponding areas (A1 - A5) include determining parameter values from a predetermined value range and / or determining the temporal variation of parameter values for one or more processing parameters, and the processing parameters include applied pressure, rinsing liquid temperature, spraying device position, spraying device orientation, and / or applied duration.

14. The system according to any one of claims 1 to 6, characterized in that specific processing instructions (T1 - T5) are assigned to the corresponding predetermined rinsing object layouts (D1 - D9) among a plurality of rinsing object layouts.

15. The system according to any one of claims 1 to 6, characterized in that The system has a device (200) outside the dishwasher (1), which at least integrates the image processing device (120), wherein the dishwasher (1) has a communication unit (160) designed to transmit the detected image (IMG) to the external device (200) and receive the rinse item layout map (MAP) from the external device (200).

16. A method for operating a dishwasher (1), the method having the steps of: Detecting (S1) an image (IMG) of the rinse item receptacles (12, 13, 14); Deriving (S2) a rinse item layout map (MAP) from the detected image (IMG), wherein, the rinse item layout map (MAP) has a division of the rinse item receptacles (12, 13, 14) into a plurality of regions (A1 - A5), wherein the respective regions (A1 - A5) each include a predetermined rinse item arrangement (D1 - D9) from a plurality of predetermined rinse item arrangements (D1 - D9), wherein an image (IMG) of the rinse item receptacles (12, 13, 14) from the upper hemisphere relative to the rinse item receptacles (12, 13, 14) is detected, and an image (gIMG) corresponding to a view of the rinse item receptacles (12, 13, 14) as seen from the lower hemisphere is generated; Deriving (S4) a cleaning matrix (MX) that includes an association of processing instructions (T1 - T5) with each of the regions (A1 - A5) in the rinse item layout map (MAP); Outputting (S4) the cleaning matrix (MX), and Performing (S5) a rinsing program based on the cleaning matrix (MX).

17. The method according to claim 16, characterized in that, the dishwasher is a household dishwasher.

18. The method according to claim 16, characterized in that, the image (gIMG) corresponds to a view of the rinse item receptacles (12, 13, 14) as seen vertically from below.

19. A computer program product, comprising instructions which, when executed by a computer, cause the computer to perform the method according to any one of claims 16 - 18.

Images