System for optical dishware detection in a dishwasher

Abstract

The disclosure relates to a system for optical dishware detection in a dishwasher (1), the system comprising: an optical detection system (16), the detection system (16) comprising: a heatable disc (15) having a fastening means for releasably fastening the disc (15) to the dishwasher (1), and an optical unit (2) designed to record an image of at least part of a dishware container (3) arranged in a treatment chamber (11) within the dishwasher (1) through the disc (15); and a computing unit (6) designed to determine a state of loading of the dishware container (3) with dishware (14) based on the image of the part of the dishware container (3) recorded by the optical unit (2), wherein the computing unit (6) is designed to output the determined state of loading of the dishware container (3) with dishware (14).

Description

Technical field of the invention

[0001] The present invention relates to a system for optical dishware detection in a dishwasher, a dishwasher with such a system, and a corresponding method for operating a dishwasher. Background of the invention

[0002] In dishwashers, the items are typically cleaned with soapy water and then rinsed with clean fresh water. Depending on the design, a distinction is made between conveyor dishwashers (basket or belt-type dishwashers), hood-type dishwashers, and programmable dishwashers.

[0003] Dishwashers typically have a treatment chamber in which the items to be washed are treated with water and detergent, as well as a zone for loading the dishwasher with items to be washed. This zone for loading items to be washed usually comprises a curtain or a door in the case of a conveyor dishwasher, a hood type dishwasher and a door in the case of a programmable dishwasher, through which the items to be washed are introduced into the treatment zone.

[0004] To apply rinsing liquid to the items to be cleaned, the dishwasher has a dispensing opening in the treatment chamber, such as spray nozzles.

[0005] To load the dishwasher with items to be cleaned, washware containers, such as dish baskets, are usually used, which are designed to be removable from the dishwasher or treatment zone for the user.

[0006] Particularly for environmental protection and cost reasons, increasing demands are being placed on the economical use of resources in such dishwashers. In addition to the operating parameters such as the temperature of the wash liquid, the type and proportion of the lye, the wash mechanism, and the contact time, the wash result is highly dependent on the soiling in the wash water, which is introduced into the dishwasher by the dirty dishes.

[0007] In existing systems, energy, clean water and detergent are often wasted by washing incompletely loaded wash containers, especially by washing them in the same way as fully loaded wash containers.

[0008] DE102019111848A1 describes a system for optical detection of wash ware in commercial dishwashers (1) designed as conveyor dishwashers or as automatic programmers, which comprises an optical detection system for an evaluation device for locating and classifying wash ware in the dishwasher. Summary of the invention

[0009] The inventors have recognized that such optical detection systems for the optical detection of wash ware in a dishwasher, as mentioned at the beginning, often fog up due to water vapor condensation in the wash curtain and that as a result the optical detection of the wash ware, and thus also a resource-saving dishwashing operation, can hardly or not take place.

[0010] The inventors have recognized that the conventional approach of rinsing the toys before washing to reduce water vapor condensation during the optical detection system wastes liquid and energy, which negatively affects the overall resource-related balance of the dishwasher.

[0011] It is therefore an object of the present invention to provide a system for optical dishware detection in a dishwasher that enables the dishwasher to be operated in the most resource-efficient way possible while maintaining consistently good dishwashing results and at the same time offering a high level of user-friendliness.

[0012] This object is achieved by a system according to claim 1, a dishwasher according to claim 21, a method according to claim 32, and a use according to claim 36. Particularly advantageous embodiments are described in the subclaims, in the description, and in the figures.

[0013] The invention solves this problem because the system according to the invention for optical detection of wash ware in a dishwasher comprises the following: an optical detection system, the detection system comprising: a heatable disc having a fastening means for releasably fastening the disc to the dishwasher, and an optical unit designed to record an image of at least part of a wash ware container arranged in a treatment chamber within the dishwasher through the disc; and a computing unit designed to determine a state of loading of the wash ware container with wash ware based on the image of the part of the wash ware container recorded by the optical unit, wherein the computing unit is designed to output the determined state of loading of the wash ware container with wash ware.Because the pane through which the optical unit captures an image is heated and features a fastener for removably attaching the pane to the dishwasher, heating the pane can remove fog, steam, and water droplets from the pane. In the event of pane corrosion, the pane can be replaced very easily and cost-effectively. This has been shown to result in less downtime for the actual dishwashing and lower costs than the conventional approach of regularly pre-waking the optical detection system.

[0014] The invention also achieves this object because the dishwasher according to the invention comprises the following: the treatment chamber; one or more dispensing openings arranged in the treatment chamber for dispensing washing liquid onto the washware container (e.g., applying pressure to the washware) in an active area within the treatment chamber; and the system according to the invention for optical washware detection, wherein the optical unit is spatially separated from the active area by the disc. Preferably, the dishwasher comprises the washware container and the washware arranged therein in the active area.

[0015] The invention also achieves this object because the method according to the invention for operating the dishwasher according to the invention comprises the following: capturing an image of a washware container located in the treatment chamber by means of the optical unit; on the basis of the image of the washware container captured by the optical unit, determining a state of loading of the washware container with washware by means of the computing unit; and outputting the determined state of loading of the washware container with washware by means of the computing unit.

[0016] The invention also solves this problem because the system according to the invention is used for optical dishware detection in a dishwasher.

[0017] These objects and methods according to the invention can each ecologically and economically improve the program sequence in the dishwasher through the optical recognition system for optical dishware recognition and simplify operation for the dishwashing staff. In particular, because the disc of the optical recognition system is heatable and has a fastening means for releasably attaching the disc to the dishwasher, dishware can be optically recognized consistently and reliably over time, since the optical recognition system is kept operational. This occurs with low cost and resource consumption, since low heating outputs are sufficient and replacement of the disc due to corrosion rarely occurs and then requires little interruption to dishwashing operation. The system is thus easy to integrate and highly maintenance-free, while at the same time offering significant ecological and economic benefits for the overall system.These measures for the optical detection system, in combination with the optical ware detection, consistently and reliably prevent incompletely loaded ware containers from being placed in the dishwasher, from being washed in the same way as fully loaded ware containers, or from using an unsuitable wash program for the specific ware. By determining the load status of the ware container, the dishwasher can react to the ware and / or the remaining capacity in the ware container in such a way that the resources required by the dishwasher are used optimally, thus ensuring resource-efficient warewashing.The invention also allows for simplified use of the dishwasher, obtaining statistics on usage behavior, optimizing dishwashing operations by adapting Sinner's parameters, and improving the training of dishwashing personnel through optimization suggestions.

[0018] The optical unit can preferably be designed to record an image of at least part of the window, and the computing unit can be designed to determine a condition of the window based on the image of the part of the window recorded by the optical unit, wherein the computing unit is designed to output the determined condition of the window. The determined condition of the window can indicate whether the window is dirty and / or corroded. In other words, through the interaction of the optical detection system and the computing unit, the window can be checked to determine whether it needs to be cleaned or replaced due to dirt, or whether it needs to be replaced due to corrosion. This also makes it very user-friendly to ensure reliable operation of the dishwasher and avoid incorrect detection of the wash items and unnecessary downtime of the dishwasher.Preferably, this interaction of the optical recognition system and the computing unit also determines the condition of the walls of the treatment room, such as the degree of soiling, which also ensures reliable and effective operation of the dishwasher.

[0019] The optical unit can have a rolling shutter, which is cheaper and may be sufficient for applications that do not require real-time capability.

[0020] The window can preferably be heated actively, since passive heating requires a constant heat source, which is not possible or unfavorable, especially in the upper area of ​​the dishwasher (especially under-counter dishwashers).

[0021] The optical unit can preferably be located inside the treatment room, but spatially separated from the active area where the washware is exposed to the rinse liquid by means of a glass panel. Outdoors, the optical unit takes up more space and may become contaminated by the kitchen atmosphere.

[0022] Dirt detection can be achieved through fluorescence using ultraviolet (UV) light from a light source in the treatment room. The interior of the treatment room can be illuminated with wavelengths in the UV range, which causes dirt to fluoresce. This light emitted by fluorescence can be detected by the optical unit and evaluated by the processing unit. As soon as fluorescence is no longer detected, the washware can be considered clean. Glasses that themselves fluoresce can be ignored using artificial intelligence. If the optical unit is mounted outside the treatment room, for example on the outside of a dishwasher casing, infrared light is preferred over white light to avoid blinding users and guests with bright lighting. For this purpose, the optical unit can be used without an infrared filter.

[0023] Preferably, a marking or identifier, such as a QR code, can be applied to a container for a cleaning fluid (for example, on the lid of the container). Detergent recognition can then be activated. The marking or identifier is held in the field of view of the optical unit, which detects and evaluates the marking or identifier to identify the cleaning fluid. The machine can now suggest procedures for changing the detergent. For example, some detergents react aggressively with one another. The system should then be cleaned by one detergent before the new detergent is added. Rinsing parameters can also be adjusted based on the detergent used.

[0024] These and other features and advantages of the invention will become particularly clear from the following detailed description of further preferred aspects and embodiments. Short description of the drawings Fig. 1 shows a schematic functional representation of a dishwasher in which its components and their interaction are shown. Fig. Figure 2 shows, using a dishwasher as an example, two preferred options for where and how the optical detection system can be arranged within the treatment room. Fig. Figure 3 shows a schematic representation of possible designs for the markings on the wash ware and the type indicator on the wash ware container. Fig. 4 shows an exemplary arrangement of the markings and type indicators on the wash ware or wash ware container. Fig. 5 shows two preferred image processing methods for determining the loading state of a flushing corps. Fig. 6 shows a flowchart indicating essential and optional operations of the method according to the invention. Detailed description

[0025] Fig. 1 shows a schematic functional representation of a dishwasher 1 in which its components and their interaction are shown.

[0026] The dishwasher 1 can be designed, for example, as a conveyor dishwasher, a hood dishwasher or as a program-controlled dishwasher with a door. Fig. The dishwasher 1 shown in Figure 1 may comprise one or more treatment chambers 11 with one or more dispensing openings 12 (e.g. spray nozzles) arranged therein.

[0027] The dishwasher 1 comprises an optical unit 2 designed to capture an image of a portion of a wash container 3 in its field of view 17. For example, the wash container 3 can be equipped with one or more magnets that are detected by magnetic sensors in the dishwasher to trigger the optical unit 2. This allows the wash container 3 to be segmented into different images, which can then be combined. Depending on where and how many magnets are attached to the wash container 3, a corresponding number of images can be captured at the corresponding positions of the magnets.

[0028] An optical detection system 16 comprises, in addition to the optical unit 2, a heatable pane 15 having a fastening means for releasably fastening the pane 15 to the dishwasher 1. The optical unit 2 is designed to record the image of at least part of the washware container 3 arranged in a treatment chamber 11 within the dishwasher 1 through the pane 15. While the washware is exposed to washing liquid in an active area within the treatment chamber 11, the optical unit 2 is spatially separated from the active area by the pane 15 and is thus protected. Condensation on the pane is removed by heating the pane or is prevented from forming in the first place. Should the pane 15 become corroded, it can be replaced thanks to its releasable fastening means.

[0029] The dishwasher 1 can be Fig. 1, which is designed to actively heat the window 15. The heater may comprise an electrical resistance wire and / or a heating cable, wherein the heating cable conducts heat from a water tank of the dishwasher to the window 15.

[0030] The dishwasher 1 further comprises a computing unit 6 which is designed to determine a state of loading of the wash ware container 3 with wash ware 14 on the basis of the image of the wash ware container 3 recorded by the optical unit 2, wherein the computing unit 6 is designed to output the determined state of loading of the wash ware container 3 with wash ware 14 (output 13).

[0031] This dishwasher 1 can further comprise an optional control unit 7 which is designed to select a washing program and / or a value of one or more operating parameters, preferably of the dispensing openings 12, of the dishwasher 1 on the basis of the determined state of the loading of the wash ware container 3 with wash ware 14 output by the computing unit 6, which is adapted to the determined state of the loading of the wash ware container 3.

[0032] Alternatively or additionally, the dishwasher 1 can further comprise an optional display device 8 on which the determined status of the loading of the washware container 3 with washware 14, output by the computing unit 6, is graphically displayed. In response, the user can make a user input 9 via the display device 8, which causes a corresponding adjustment of one or more operating parameters of the dishwasher 1. These optional means 7 and 8 of the dishwasher 1 can improve the program sequence in the dishwasher ecologically and economically while keeping operation simple for the dishwashing staff.

[0033] In particular, the display device 8 can prevent incompletely loaded washware containers 3 from being introduced into the dishwasher 1 at all. For example, the display device 8 can graphically highlight sections in the washware container 3 that are not fully occupied by washware 14, enabling the user to purposefully increase and optimize the loading of the washware container 3 with washware 14, thereby contributing to the ecology and economy of the dishwasher 1.

[0034] Furthermore, the control unit 7 can adapt the operating parameters of the dishwasher 1 to the actual state of the load of the wash ware container 3 with wash ware 14 on the basis of the output 13 - either automatically or by triggering by the user input 9 - so that the ecology and economy of the dishwasher 1 are also improved.

[0035] The display device 8 can, for example, be designed to graphically display the selected washing program and / or the selected value of one or more operating parameters. The display device 8 can, for example, also be designed to receive an input 9 from a user, and the control unit 7 can be designed to change the selected washing program and / or the selected value of one or more operating parameters of the dishwasher based on the received input 9.

[0036] For example, a predefined program could be selected in a first step. The user can then switch between wash programs, for example, between the glass and plate programs, based on output 13 using user input 9. Additionally, operating parameters in the "sinner circle" of the individual wash programs could then be changed in the background to achieve even better adaptation to the load status of the washware container 3 with washware 14. The sinner circle contains the four segments: time, chemicals, temperature, and mechanics.

[0037] The one or more operating parameters (e.g. of the Sinner circle) can comprise the following from the following list individually or in any combination: a nozzle pressure at the dispensing openings 12 (here also called dispensing nozzles), a volume flow of the cleaning liquid used by the dishwasher 1 to rinse the dishes 14, a distribution of sprayed rinsing liquid within one of the one or more treatment zones 11, a rinse quantity of the rinse liquid sprayed in a rinse zone, a temperature of the rinsing liquid sprayed at the dispensing nozzles 12, a dosage of a dishwashing detergent within the rinsing liquid sprayed at the dispensing nozzles 12, a speed of a conveyor belt which transports dishes through one of the one or more treatment zones 11 of the dishwasher 1 and / or an exposure time of a rinsing liquid sprayed by the dispensing nozzles 12 on the dishes 14 located in the dishes container 3.The one or more operating parameters are selected in such a way that the program sequence in the dishwasher is improved and, in particular, that the resources required by the dishwasher (energy, water, chemicals) are used optimally and thus a dishwashing operation that is specifically adapted to the load condition of the dishwashing container and thus saves resources can be provided.

[0038] In addition to these ecological and economic advantages, there are also further advantages in the area of ​​data processing. The described computing unit 6 is designed to determine the loading status of the washware container 3 with washware 14 by comparing the image of the washware container 3 recorded by the optical unit 2 with a stored reference image. In particular, a pixel comparison between the reference image and the recorded image (e.g., using a subtraction method, see Fig. 4). Such a comparison of images, and in particular of their pixels, can be reliably and efficiently determined by using common algorithms (e.g., Open Computer Vision, possibly with additional integration of artificial intelligence, such as a Yolov8 network with its own dataset) for image processing and / or object detection in the image. For example, Open Computer Vision can be used solely for image processing and can detect shapes and outlines as well as markings or identifiers (e.g., QR codes), as described in Fig. 4. An AI used can recognize objects. The computing unit 6 can run one or more such algorithms over the captured image to determine the status of the load of the washware container 3 with washware 14.

[0039] The image of the part of the wash ware container 3 recorded by the optical unit 2 can depict wash ware 14 arranged in the wash ware container 3, to which one or more markings 4 are applied, wherein the computing unit 6 is designed to recognize the markings 4 based on the image and to determine a type of marked wash ware 14 based on the recognized one or more markings and / or to clearly recognize the marked wash ware 14 and / or to determine the location of the wash ware 14 within the wash ware container 3.

[0040] The computing unit 6 can further be designed to recognize one or more optional type indicators 5 attached to the washware container on the basis of the image of the washware container 3 recorded by the optical unit 2 and to recognize a washware container or to determine a type of washware container 3 on the basis of the recognized one or more type indicators 5, wherein the computing unit 6 is further designed to read out a stored reference value for marking 4, 5 from an optional storage medium 10, which reference value is assigned to the determined (type of) washware container 3.The dishwasher 1 can thus respond optimally to different types of washware container 3, whereby the number of possible types of washware container 3 is small compared to the number of possible types of washware 14 and their possible arrangement in the washware container 3, so that a high degree of reliability and high flexibility can be provided for determining the marking 5 on the wash basket. Using the type indicator, a maximum washware capacity of the washware container and / or a type of marking 4 on the washware container can be specified, which can be used to determine the load status of the washware container.

[0041] The image can be a two-dimensional image. The optical unit 2 can comprise or be a camera.

[0042] The optical unit 2 can be mounted either inside or outside the dishwasher 1 or treatment chamber 11. The optical unit 2 can be mounted outside the dishwasher 1, directly on the housing or a door of the dishwasher 1. In the case of a hood-type dishwasher, the optical unit 2 can be attached directly to the hood from the outside. In the case of a conveyor dishwasher, the optical unit 2 can be attached above the loading zone. In the case of a programmable dishwasher with a door, the optical unit 2 can be attached to the dishwasher on the ceiling of the treatment chamber 11 (cf. Fig. 2) above the door, with the optical unit 2 then directed diagonally downwards on the door side.

[0043] The computing unit 6 can be configured to filter or post-process the image of the washware container 3 captured by the optical unit 2 and to detect markings 4, 5 applied to the washware container 3 or the washware 14 in the filtered or post-processed image. Such filtering or post-processing can, for example, comprise one or more of edge sharpening, contrast modification, or artifact removal. Furthermore, the dishwasher can comprise a light source 20 that illuminates the washware container or treatment chamber, allowing the optical unit 2 to detect the light emitted, reflected, or transmitted from there.

[0044] Fig. 2A and Fig. 2B show that the optical unit 2 is arranged behind the pane 15, viewed from the center of the treatment chamber 11. The optical unit 2 can be arranged inside or outside the treatment chamber 11 or the dishwasher 1. For example, the pane 15 can be arranged in the region of the ceiling or wall of the treatment chamber 11 and spatially separate the optical unit 2 from the interior of the treatment chamber 11; for example, the optical unit 2 can be attached from the outside to an outer side of the housing of the dishwasher 1. The pane 15 can be replaceable by means of the fastening means. For example, a thread of a socket of the fastening means of the pane 15 can be detachably screwed into the dishwasher 1.

[0045] The wash ware container 3 with the wash ware 14 can be introduced into the field of view 17 of the optical unit 2 located behind the window 15 in order to record an image of the wash ware container 3 before the dispensing openings 12 are controlled accordingly by means of the control unit 7 of the dishwasher 1 on the basis of the loading state of the wash ware container 3 detected from the image.

[0046] As in Fig. 3, various markings 4, 4a-4e can be applied to the washware 14, which preferably identify the nature or type of the washware 14 and / or uniquely identify the specific washware 14. The determined state of the loading of the washware container 3 with washware 14 can include a degree of loading of the washware container 3 with washware 14. These markings 4 can be designed in various shapes, colors and materials, each with different optical properties, and can be permanently attached or retrofitted to the lid, base or side wall of the washware 14. The marking applied to the washware can include a symbol 4a, 4b, 4c, a QR code 4e, Aruco Marker 4d (Aruco - Augmented Reality University of Cordoba) and / or an RFID code.

[0047] In Fig. 2 shows some examples of different shapes and sizes. The triangle 4a, for example, can be intended for flat plates, the square 4b for deep plates. A large circle 4c could be used for wine glasses. In the case of glasses, the recognition of the marking 4 can be such that a distinction is noticeable for the computing unit 6 even when the glasses are transparent. This can be achieved, for example, through different optical properties, such as refraction, reflection or absorption of light (for example, of the light source 20). A simple example would be if the optical refraction alone changed the marking 4, 4a-c in such a way that it could no longer be recognized with complete precision by the computing unit 6. The at least one marking 4 applied to the washware 14 recognized by the computing unit 6 can be completely visible to the optical unit 2.

[0048] The computing unit 6 can be designed to determine a number, a size, a shape, or a color of the recognized at least one marking 4, 4a-4e applied to the washware 14 within the image of the washware container 3 recorded by the optical unit 2 and, based on a specific number, surface area, size, shape, or color, to determine the state of loading of the washware container 3 with washware 14. The computing unit 6 can be designed to determine the state of loading of the washware container 3 with washware 14 by comparing a specific number, surface area, size, shape, or color with a stored reference.

[0049] As already mentioned, in addition to the markings 4 in the wash bin 3, type indicators 5 can be attached to each wash bin 3 in such a way that they are always visible to the computing unit 6. This allows the computing unit 6 to identify the type of wash bin 3. The type can indicate the markings 4 and / or the size of the wash bin 3.

[0050] For example, the recognition of the washware container can be carried out based on Aruco markers, such as marker 4d in Fig. 3. Marker 5 can therefore be in the form of one, two or more markers 4d. The Aruco markers contain an ID, for example 1 or 499 in the case of two markers, and the coordinates of the four corners. The wash ware container can be provided with two such markers 5, 4d. As soon as both Aruco markers 4d are recognized, a check sum is calculated. This happens by adding ID 1 and ID 2. Let's assume the check sum is set to 500, then one marker has the ID 1 and the other the ID 499. 1 + 499 equals 500. The result would therefore be valid. The ID of the wash ware container can now be determined based on the position of the left or right marker. The marker recognition and analysis can be done using common image processing software, such as Open Computer Vision.

[0051] The computing unit 6 can be designed to determine a number of the recognized at least one marking 4 applied to the wash ware 14 within the image of the wash ware container 3 recorded by the optical unit 2 and to determine the state of loading of the wash ware container 3 with wash ware 14 on the basis of this determined number, wherein the determined state of loading of the wash ware container 3 with wash ware comprises a degree of loading of the wash ware container 3 with wash ware and the degree of loading of the wash ware container 3 with wash ware 14 is determined by the computing unit 6 by comparing this determined number with a reference value from a reference image.

[0052] However, the shapes shown here for Mark 4 and Type Indicator 5 are only examples that do not limit the claimed marks and type indicators, since other shapes can also be used for Mark 4 and Type Indicator 5.

[0053] Fig. 4 shows how the markings 4, 5 can be arranged on the items to be washed 14 or the washing container 3.

[0054] Preferably, the image of the part of the washware container 3 captured by the optical unit 2 can depict washware 14 arranged in the washware container, to which one or more markings 4, 4a-4e are applied, wherein the computing unit 6 is designed to recognize the markings 4, 4a-4e based on the image and to determine the loading state of the washware container 3 based on the recognized one or more markings 4, 4a-4e. The determined state can indicate a type of marked washware 14 and / or uniquely identify the marked washware 14 and / or indicate the location of the marked washware 14 within the washware container 3 and / or indicate a degree of loading of the washware container 3 with the marked washware 14.

[0055] Fig. 5A and Fig. 5B each show steps of an image processing algorithm for determining the load status of the washware container. The condition of the walls of the treatment chamber 11 or the condition of the window 15 can also be determined in the same way.

[0056] Starting point in the procedure according to Fig. 5A is an image as a reference, here of a washware container unloaded with washware. In the case of the other states, this can be an image of an empty and clean treatment chamber or an image of a clean window. Furthermore, an image recorded through the heatable window by means of the optical unit is obtained, here of a washware container at least partially loaded with washware. In the other states, this can be an image of an empty, possibly dirty treatment chamber or an image of a dirty or corroded window. Then, preferably, both the reference image and the recorded image are each transformed into a binary representation. In Fig. 5 the image “reference” and the image “basket filled” are binarized.

[0057] The two binarized images are then subtracted from each other (in Fig. 5 (see "Subtraction of Binary Images"). The two binarized images can be logically linked with an XOR. This way, only the differences remain in the resulting difference image. The differences correspond to objects that are not present in the reference image.

[0058] The difference image resulting from the subtraction can then be filtered. The difference image can then be denoised to filter out individual white pixels. A Gaussian blur function can be used for this purpose. Optionally, the gaps in the silhouettes in the difference image resulting from the subtraction can be closed. The white pixels in Fig. 5 can provide information about the loading status (fill level). The subsequent edge detection of the objects in the difference image resulting from subtraction is optional.

[0059] The process can utilize common image recognition software (e.g., Open Computer Vision), possibly with the aid of artificial intelligence. The subtraction method can indicate the load status (fill level) of the dishwasher basket.

[0060] Alternatively to the Fig. 5A, a procedure according to Fig. 5B can be selected, where the two wash ware containers in the illustrations do not have to have essentially the same position.

[0061] First, an image of a dishwashing container empty of dishes is taken and then binarized (see image “Reference binary” in Fig. 5B). A scalar value of pixels is assigned to the image. For example, the black pixels in the binarized reference image are counted, quantity: X. This value X is stored in a database under the corresponding ID of the image. An at least partially filled wash basket is scanned by the optical unit, and this image is also binarized (see image "Binary filled basket" in Fig. 5B). A scalar value of pixels is also assigned to this image. For example, the black pixels in this image are counted. Fig. has more black pixels than Fig. . From the difference between the scalar values ​​for the pixels of the binary reference image and the binary image of the filled wash ware container, a conclusion can be drawn about the loading status (filling level) of the wash ware container.

[0062] Analogously, the procedure according to Fig. 5A or Fig. 5B for the other determined conditions (e.g. window or walls of the treatment room).

[0063] Fig. Figure 6 shows a flow chart showing essential and optional (in Fig. 6 dashed) indicates operations of the method 100 according to the invention for operating a dishwasher 1.

[0064] In operation 101, the method 100 first begins by taking an image of a washware container 3 using an optical unit 2.

[0065] In the optional operation 102, on the basis of the image of the wash ware container 3 recorded by the optical unit 2, a recognition of a type indicator 5 attached to the wash ware container 3 is carried out by means of the computing unit 6.

[0066] In the optional operation 103, a type of the washware container 3 is then determined by means of the computing unit 6 based on the recognized type indicator 5. The determined type of the washware container can be used as a basis for further image processing, for example, to specify a maximum capacity of the washware container for washing items and / or to define boundary boxes for this image processing and / or to specify an expected maximum number of markings 4 on the washware and / or to specify the type of markings 4 on the washware.

[0067] In operation 104, on the basis of the image of the wash ware container 3 recorded by the optical unit 2, a determination of a state of loading of the wash ware container 3 with wash ware 14 is carried out by means of the computing unit 6.

[0068] Operation 104 may include one or more sub-operations 105, such as one or more of operations 105a through 105d.

[0069] The determination 104 of a state of loading of the wash ware container 3 with wash ware 14 by means of the computing unit 6 can optionally comprise the following: converting 105a the recorded image and a reference image (e.g. of a wash ware container unloaded with wash ware) each into a binary representation (the reference image can already be present in the binary representation).

[0070] Determining 104 a state of loading of the washware container 3 with washware 14 by means of the computing unit 6 may optionally further comprise the following: comparing 105b the binary representation of the recorded image with the binary representation of the reference image.

[0071] Determining 104 a state of loading of the washware container 3 with washware 14 by means of the computing unit 6 may optionally further comprise the following: comparing 105c the pixels of objects in the binary reference image with the pixels of objects in the binary recorded image.

[0072] The determination 104 of a state of loading of the washware container 3 with washware 14 by means of the computing unit 6 may optionally further comprise the following: applying 105d a subtraction method to the binary recorded image and the binary reference image, for example for step 105c, as in Fig. 5A.

[0073] The determination 104 of a state of loading of the wash ware container 3 with wash ware 14 by means of the computing unit 6 may optionally further comprise the following: comparing the number of pixels of objects in the binary version of the reference image with the number of pixels of objects in the binary version of the recorded image in order to detect wash ware in the wash ware container (as in Fig. 5B), for example for step 105c.

[0074] Alternatively or in addition to steps 105a-105d, step 104 may comprise the image of the part of the wash ware container 3 recorded by the optical unit 2 depicting wash ware 14 arranged in the wash ware container, to which one or more markings 4, 4a-4e are applied, wherein the computing unit 6 recognizes the markings 4, 4a-4e based on the image and determines the loading state of the wash ware container 3 based on the recognized one or more markings 4, 4a-4e, preferably wherein the determined state indicates a type of marked wash ware 14 and / or uniquely identifies the marked wash ware 14 and / or indicates the location of the marked wash ware 14 within the wash ware container 3 and / or indicates a degree of loading of the wash ware container 3 with the marked wash ware 14. As an alternative to marking the washware 14, an AI can be used to identify the washware 14.

[0075] In operation 106, after operation 104 or after operation 105c or after operation 105d, the determined state of the loading of the wash ware container 3 with wash ware 14 is output by means of the computing unit 6.

[0076] In the optional operation 107, the control unit 7 can monitor the dishwasher operation according to the determined load status output. Operation 107 can include the following: based on the determined load status of the washware container 3 with washware 14 output by the computing unit 6, using the control unit 7 to (automatically) select a wash program and / or a value of an operating parameter of the dishwasher 1 that is adapted to the determined load status of the washware container 3.

[0077] The one or more operating parameters (e.g. of the Sinner circle) can comprise the following from the following list individually or in any combination: a nozzle pressure at the dispensing nozzles 12, a volume flow of the cleaning liquid used by the dishwasher 1 to rinse the dishes 14, a distribution of sprayed rinsing liquid within one of the one or more treatment chambers 11, a rinse quantity of the rinse liquid sprayed in a rinse zone, a temperature of the rinsing liquid sprayed at the dispensing nozzles 12, a dosage of a dishwashing detergent within the rinsing liquid sprayed at the dispensing nozzles 12, a speed of a conveyor belt which transports dishes through one of the one or more treatment chambers 11 of the dishwasher 1 and / or an exposure time of a rinsing liquid sprayed by the dispensing nozzles 12 on the dishes 14 located in the dishes container 3.The one or more operating parameters are selected in such a way that the program sequence in the dishwasher is improved and, in particular, that the resources required by the dishwasher (energy, water, chemicals) are used optimally and thus a dishwashing operation that is specifically adapted to the load condition of the dishwashing container and thus saves resources can be provided.

[0078] Alternatively or in addition to the (automatic) control by the control unit 7, the dishwasher 1 can further comprise an optional display device 8 on which the determined status of the loading of the washware compartment 3 with washware 14 during operation 106, as output by the computing unit 6, is graphically displayed. In response, the user can make a user input 9 via the display device 8, which causes an adjustment of one or more of the operating parameters of the dishwasher 1 in operation 107. Furthermore, the display device 8 can graphically highlight sections of the washware compartment 3 that are not completely occupied by washware in operation 106, enabling the user to purposefully increase and optimize the loading of the washware compartment 3 with washware 14 and thereby contribute to the ecology and economy of the dishwasher.Thus, by operations 106 and / or 107, the operating parameters of the dishwasher 1 can be adapted to the actual state of loading of the washware container 3 with washware 14, so that the ecology and economy of the dishwasher 1 are improved.

[0079] These and other (optional) features disclosed in the above description, the claims and the drawings can be used both individually and in any combination for the implementation of the invention in its various embodiments. LIST OF REFERENCE SYMBOLS 1 dishwasher 2 optical unit 3 washware containers 4 Marking (optional) 5 Type indicator (optional) 6 Computing unit 7 Control unit (optional) 8 Display device (optional) 9 User input (optional) 10 Storage media (optional) 11 Treatment room (optional) 12 Discharge opening (optional) 13 Output of the load status 14 Dishes (optional) 15 slices 16 optical recognition system 17 Field of view of the optical unit 20 light source QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 102019111848A1

[0008]

Claims

[1] A system for optical dishware detection in a dishwasher (1), the system comprising: an optical detection system (16), the detection system (16) comprising: a heatable disc (15) having a fastening means for releasably fastening the disc (15) to the dishwasher (1), and an optical unit (2) designed to record an image of at least part of a washware container (3) arranged in a treatment chamber (11) within the dishwasher (1) through the pane (15); and a computing unit (6) which is designed to determine a state of loading of the wash ware container (3) with wash ware (14) on the basis of the image of the part of the wash ware container (3) recorded by the optical unit (2), wherein the computing unit (6) is designed to output the determined state of loading of the wash ware container (3) with wash ware (14). [2] The system according to claim 1, characterized byin that the optical unit (2) is designed to record an image of at least a part of the pane (15) and the computing unit (6) is designed to determine a state of the pane (15) on the basis of the image of the part of the pane (15) recorded by the optical unit (2), wherein the computing unit (6) is designed to output the determined state of the pane (15). [3] The system according to claim 2, characterized by that the determined condition of the disc (15) indicates whether the disc (15) is dirty and / or corroded. [4] The system according to any one of claims 1 to 3, characterized bythat the determined state of the loading of the wash ware container (3) indicates to what extent the wash ware container (3) is loaded with the wash ware (14) and / or with which type of wash ware (14) the wash ware container (3) is loaded and / or at which location within the wash ware container (3) the wash ware (14) is arranged and / or what degree of soiling the wash ware (14) arranged in the wash ware container (3) has. [5] The system according to any one of the preceding claims, characterized by that the optical unit (2) is designed to record an image of at least part of the walls of the treatment room (11) through the pane (15) and the computing unit (6) is designed to determine a state of the walls of the treatment room (11) on the basis of the image of the part of the walls of the treatment room (11) recorded by the optical unit (2), wherein the computing unit (6) is designed to output the determined state of the walls of the treatment room (11). [6] The system according to claim 5, characterized by that the determined condition of the walls of the treatment room (11) indicates where and / or to what extent the walls are dirty and / or corroded. [7] The system according to any one of the preceding claims, characterized by in that the computing unit (6) is designed to recognize a type of the wash ware container (3) or to clearly recognize the wash ware container (3) on the basis of the image of the part of the wash ware container (3) recorded by the optical unit (2), preferably on the basis of a marking (5) shown in the image and applied to the wash ware container, wherein the computing unit (6) is designed to determine the determined state of the loading of the wash ware container (3) with wash ware on the basis of the recognized wash ware container (type). [8] The system according to any one of the preceding claims, characterized by that the optical unit (2) has a rolling shutter. [9] The system according to any one of the preceding claims, characterized by in that the optical detection system (16) comprises a light source (20), preferably a white light source, an ultraviolet light source or an infrared light source, which is designed to illuminate the treatment chamber (11) and / or the wash ware container (3) and / or the pane (15) in such a way that light emitted and / or reflected and / or transmitted thereby reaches the optical unit (2), preferably through the pane (15), in order to record the image of the treatment chamber (11) and / or the wash ware container (3) and / or the pane (15). [10] The system according to any one of the preceding claims, characterized byin that the image of the part of the wash ware container (3) recorded by the optical unit (2) depicts wash ware (14) arranged in the wash ware container, to which one or more markings (4, 4a-4e) are applied, wherein the computing unit (6) is designed to recognize the markings (4, 4a-4e) from the image and to determine the loading state of the wash ware container (3) from the recognized one or more markings (4, 4a-4e), preferably wherein the determined state indicates a type of marked wash ware (14) and / or unambiguously identifies the marked wash ware (14) and / or indicates the location of the marked wash ware (14) within the wash ware container (3) and / or indicates a degree of loading of the wash ware container (3) with the marked wash ware (14). [11] The system according to claim 10, characterized by that the markings (4, 4a-4e) comprise a symbol and / or a unique identifier, preferably a QR code, Aruco Marker and / or an RFID code. [12] The system according to any one of the preceding claims, characterized by that the fastening means of the disc (15) has a socket with a thread, wherein the socket with the thread can be screwed into the dishwasher (1). [13] The system according to any one of the preceding claims, characterized by that the pane (15) can be heated in such a way that condensation, steam and water droplets are removed from the pane (15) by heating the pane (15). [14] The system according to any one of the preceding claims, characterized by that the computing unit (6) is designed to determine each of the states by means of a comparison of the image recorded by the optical unit (2), or a binary variant thereof, with a stored reference image, or a binary variant thereof. [15] The system according to claim 14, characterized bythat the comparison comprises the following in order to determine the state: a) a subtraction process in which a difference image of the reference image, or a binary variant thereof, and the recorded image, or a binary variant thereof, is created and one or more objects in the recorded image are recognized on the basis of the difference image, and / or b) a comparison of the number of pixels of objects in the reference image, or a binary variant thereof, with the number of pixels of objects in the recorded image, or a binary variant thereof. [16] The system according to any one of the preceding claims, characterized by that the computing unit (6) is designed to determine a number of zero, one or more pixels of objects in the image recorded by the optical unit (2) and to determine the state on the basis of the determined number of pixels of the objects and a stored number of pixels of the reference image. [17] The system according to claim 16, characterized by that the stored number of pixels indicates a total number of pixels of one or more visible objects that are visible to the optical unit (2) in the case of a washware container (3) that is unloaded with washware (14). [18] The system according to any one of claims 16 to 17, characterized by that the stored number of pixels indicates a total number of pixels of one or more visible objects that are visible to the optical unit (2) in the case of an unsoiled and / or non-corroded pane (15). [19] The system according to any one of the preceding claims, characterized byin that the computing unit (6) is designed to recognize one or more type indicators (5) attached to the wash ware container (3) on the basis of the image of the wash ware container (3) recorded by the optical unit (2) and to determine a type of the wash ware container (3) on the basis of the recognized one or more type indicators (5), wherein the computing unit (6) is further designed to read out the stored reference value from a storage medium which is assigned to the determined type of the wash ware container (3). [20] The system according to claim 19, characterized by that the markings (4, 4a-4e) applied to the wash ware (14) differ in colour, shape and / or material from the type indicators (5) applied to the wash ware container (3). [21] A dishwasher (1) comprising: the treatment room (11); one or more dispensing openings (12) arranged in the treatment chamber (11) for dispensing rinsing liquid onto the washware container (3) in an active area within the treatment chamber (11); and the system (16) for optical dishware detection according to one of the preceding claims, wherein the optical unit (2) is spatially separated from the active area by means of the disc (15). [22] Dishwasher (1) according to claim 21, characterized by in that the dishwasher (1) further comprises a control unit (7) which is designed to select a washing program and / or a value of one or more operating parameters of the dishwasher (1), preferably of the dispensing openings, on the basis of at least one of the one or more determined states output by the computing unit (6), which is adapted to the determined state (3). [23] Dishwasher (1) according to one of claims 21 to 22, characterized bythat the dishwasher (1) further comprises a display device (8) on which at least one of the one or more determined states of the loading of the wash ware container (3) with wash ware (14) output by the computing unit (6) is graphically displayed, preferably wherein the graphic display of the at least one state comprises a warning. [24] Dishwasher according to one of claims 21 to 23, characterized by that the dishwasher comprises a heater which is designed to actively heat the disc (15). [25] Dishwasher according to claim 24, characterized by that the heater comprises an electrical resistance wire and / or a heating line, wherein the heating line conducts heat from a water tank of the dishwasher to the disc (15). [26] Dishwasher according to one of claims 21 to 25, characterized by that the disc (15) is replaceable. [27] Dishwasher according to one of claims 21 to 26, characterized bythat a thread of a socket of the fastening means of the disc (15) is detachably screwed into the dishwasher (1). [28] Dishwasher according to one of claims 21 to 27, characterized by that the optical unit (2) is arranged behind the disc (15) when viewed from the center of the treatment room (11). [29] Dishwasher according to claim 28, characterized by that the pane (15), and preferably the optical unit (2), is arranged in an upper region of the treatment room (11), preferably on the ceiling and / or a corner of the treatment room (11). [30] Dishwasher according to one of claims 21 to 29, characterized by that the optical unit (2) is arranged within the treatment room (11). [31] Dishwasher according to one of claims 21 to 29, characterized by that the optical unit (2) is arranged outside the treatment room (11). [32] A method for operating the dishwasher (1) according to any one of claims 21 to 31, the method comprising: Recording an image of a wash ware container (3) by means of the optical unit (2); on the basis of the image of the wash ware container (3) recorded by the optical unit (2), determining a state of loading of the wash ware container (3) with wash ware (14) by means of the computing unit (6); and Outputting the determined status of the loading of the wash ware container (3) with wash ware (14) by means of the computing unit (6). [33] Method according to claim 32, wherein determining a state of loading of the washware container (3) with washware (14) by means of the computing unit (6) comprises the following: Determining a number of zero, one or more pixels of objects contained in the image captured by the optical unit (2); and Comparing this specific number of pixels with a stored reference value. [34] The method of claim 32 or 33, further comprising: on the basis of the image of the wash ware container (3) recorded by the optical unit (2), detecting a type indicator (5) attached to the wash ware container (3) by means of the computing unit (6); on the basis of the recognized type indicator (5), determining a type of the wash ware container (3) by means of the computing unit (6); Querying the stored reference value associated with the determined type of wash ware container (3) by means of the computing unit (6), wherein the reference value indicates a total number of one or more markings (4, 4a-4e) applied to wash ware (14) within the wash ware container (3) of the determined type. [35] A method according to any one of claims 32 to 34, further comprising: on the basis of the determined state of the loading of the washware container (3) with washware output by the computing unit (6), select a wash program and / or a value of an operating parameter of the dishwasher (1) by means of a control unit, which is adapted to the determined state of the load of the wash ware container (3). [36] Use of the system according to one of claims 1 to 20 for optical detection of wash ware in a dishwasher.

Images