LOADING METHOD FOR LOADING WASHING RACKS, TESTING METHOD, AUGMENTED REALITY DEVICE, LOADING SYSTEM AND CLEANING METHOD - Patent application

Augmented reality devices improve the efficiency and accuracy of loading cleaning racks in purification systems by providing interactive, 3D visual guidance for correct placement, addressing the inefficiencies and errors of traditional methods.

JP2025515320APending Publication Date: 2025-05-14BELIMED LIFE SCI AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024563150
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2022-04-25
Publication Date
2025-05-14

AI Technical Summary

Technical Problem

Existing methods for loading cleaning racks in purification systems are inefficient and prone to errors, requiring manual interpretation of two-dimensional drawings and lacking guidance on efficient and ergonomic loading procedures.

Method used

The use of augmented reality devices, including mixed reality glasses, to provide visual and audio loading teachings for correctly and efficiently loading cleaning racks, allowing users to interact with virtual 3D models of the cleaning rack and articles to be purified.

Benefits of technology

This approach enables quick and accurate loading of cleaning racks, reducing errors and improving efficiency by allowing users to visualize the correct placement of articles and interact with virtual representations while keeping their hands free for loading.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025515320000001_ABST
    Figure 2025515320000001_ABST
Patent Text Reader

Abstract

The present invention relates to a loading method (10) for loading cleaning article carriers (41) for cleaning in a cleaning system, comprising providing an augmented reality device (1), in particular with augmented reality glasses, providing a cleaning rack (41), providing loading instructions by the augmented reality device (1) for loading the cleaning rack (41), in particular by visual representations and / or audio instructions, capturing the completed loading steps, in particular by input by a user and / or by at least one recording device (3) of the augmented reality device (1), and loading the cleaning rack (41) with articles to be cleaned (42b) by the user according to the provided loading instructions.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a loading method for loading a washing rack, a testing method for testing the loading, an augmented reality device, a loading system and a cleaning method. [Background technology]

[0002] In various sectors such as the chemical industry, the pharmaceutical industry and medicine, the thorough cleaning of materials such as ampoules is of great importance. To ensure thorough automatic cleaning of these items in a cleaning system, they must be arranged in a specific and correct way on the cleaning rack.

[0003] This is done, for example, in laboratories or production facilities, by manuals, printed or digital drawings that show the loading of the washing racks using two-dimensional drawings. These drawings or images must be interpreted by the user so that they know where the items to be cleaned must be placed on the washing rack. This requires spatial imagination, and the operator must know from the drawing or image which items to be cleaned must be placed where and how. In most cases, the drawings do not show the order in which the loading should be done to make the loading as efficient and ergonomic as possible. Also, it is often difficult to recognize special features that are important for the loading, such as whether the glass should be placed with the opening facing up or down. Summary of the Invention [Problem to be solved by the invention]

[0004] Therefore, the object of the present invention is to provide a loading method, a testing method, a cleaning method, an augmented reality device, a loading system and a cleaning method that overcome the disadvantages of the prior art and enable simple, fast and correct loading of a cleaning rack so that the items to be cleaned can be completely cleaned. [Means for solving the problem]

[0005] The problem is solved by a loading method for loading washing racks for purification in a purification system. The loading method comprises: providing an augmented reality device, preferably a mixed reality device, in particular comprising glasses, providing a washing rack; providing loading instructions for loading the washing rack by means of an augmented reality device, in particular by visual representations and / or audio instructions; - capturing the completed loading steps, preferably by input by a user and / or by at least one capturing device of the augmented reality apparatus; loading the cleaning rack with articles to be cleaned by a user in accordance with published loading instructions; Includes.

[0006] This allows the washing rack to be loaded quickly and accurately. In this case, augmented reality means that virtual information is superimposed on the real world. Mixed reality is a subtype of augmented reality, in this case meaning that real and virtual elements interact with each other and the user can interact with the virtual elements as in the real world. By using an augmented reality device, the user can better perceive and quickly understand how the items to be cleaned are arranged.

[0007] Loading instructions are instructions to the user on how to properly load the items to be cleaned into the washing rack. The washing racks are designed to hold the items to be cleaned so that they can be thoroughly cleaned. They have openings sufficient to allow the cleaning liquid to pass through. The washing racks can be trolleys, baskets and similar containers.

[0008] The article to be cleaned is the object to be cleaned. The article to be cleaned can be an ampule, a tool, a clip, and similar objects.

[0009] The loading method may include a step in which the user must identify himself. This can be done by a recording device, for example by the user speaking his name or identification number, or by showing his badge. Identification can also be performed by visual gestures or movements made by the user.

[0010] The glasses free the user's hands to load the washing rack according to the loading instructions and / or interact with the loading instructions.

[0011] Preferably, the loading instructions are displayed to the user by a virtual representation of the items to be cleaned and / or the cleaning rack, preferably a 3D model of the loaded cleaning rack, in particular the position and / or arrangement of the items to be cleaned on the cleaning rack, and / or the loading steps are displayed to the user, in particular by glasses.

[0012] This allows the user to quickly and easily identify the items to be cleaned and the cleaning rack.

[0013] Preferably, the loading steps are displayed in an animated format. This allows placement to be tracked quickly and easily.

[0014] Preferably, the virtual loading instructions are projected by an augmented reality device, in particular by glasses, onto or next to the real position of the washing rack. Preferably, the virtual washing rack and / or the virtual articles to be cleaned are projected by an augmented reality device onto or next to the real washing rack. In particular, animated loading steps are projected onto or next to the washing rack.

[0015] This allows the position and arrangement of the articles to be cleaned to be quickly and easily mimicked and verified. In particular, the user performs the loading step to place the real articles to be cleaned on the real washing rack such that the virtual articles to be cleaned are superimposed on the real articles to be cleaned. Preferably, the user adjusts the position and / or arrangement of the real articles to be cleaned to the position and / or arrangement of the virtual articles to be cleaned while the virtual loading instruction is projected by the augmented reality device onto the real position of the washing rack.

[0016] In particular, during loading, the user positions the items to be cleaned so that the projected and real items to be cleaned have the same position and arrangement, or when a virtual washing rack is projected next to a real washing rack, the position is recognized by the fact that the real washing rack and the virtual washing rack appear nearly identical.

[0017] Preferably, the method comprises: - visualizing the items to be cleaned and / or the cleaning rack; - collecting the articles to be cleaned and / or the cleaning racks to be used, preferably by a user and / or by a sorting device; Includes.

[0018] This allows quick and easy finding of the required items to be cleaned. They can be visualized using virtual 3D models and / or as icons.

[0019] Preferably, the augmented reality apparatus comprises at least one recording device for recording information, in particular a camera for recording still and / or moving images and / or a microphone for recording acoustic instructions from the user.

[0020] This allows for easy operation of the augmented reality device. The camera may be adapted to record gestures from the user.

[0021] Preferably, the articles to be cleaned and / or the cleaning rack are provided with positioning features for recognising the orientation of the articles to be cleaned and / or the cleaning rack, in particular the positioning features are physical features and / or labels, preferably the positioning features are adapted to be captured by a recording device of the augmented reality apparatus.

[0022] This allows the actual location of the article to be cleaned to be easily and quickly compared to the correct location.

[0023] Preferably, the method comprises: - Aligning the 3D model by gestures captured by the user, preferably by a recording device of the augmented reality device, in particular according to the positioning features. Includes.

[0024] This allows the user to more easily recognize the real items to be cleaned matching the 3D model and the correct placement. Alternatively, the virtual washing rack can be freely placed in space by gestures.

[0025] Preferably, the method comprises: - selection of a loading instruction by a user by interaction with the augmented reality device, in particular by input by an input device and / or by recognition of a gesture by a recording device and / or by recognition of a voice by a recording device; - Visualizing the selected loading instruction; Includes.

[0026] This allows for easy and quick operation of the augmented reality device. When gesture input is used, the user can operate the device by hand movements, such as "clicking" a virtually displayed selection button to access loading instructions. This allows the user to intuitively operate the device. When voice input is used, the user can operate the device by speaking specific words and / or phrases, such as "step back" to go back one loading step. This frees the user's hands to load the washing rack.

[0027] Preferably, the method comprises: - capturing the articles to be cleaned and / or the washing rack to be used, in particular by recognition of the washing rack by input by a user and / or by a recording device; In particular, determining the ideal loading of at least one washing rack with captured articles to be cleaned; Includes.

[0028] This allows the loading of the washing rack to be configured to the articles to be cleaned. "Ideal loading" here means that as many articles to be cleaned as possible are placed on the washing rack to ensure thorough cleaning of the articles to be cleaned. Alternatively or additionally, a loading optimized and matched to the operator's situation can be selected by the user or specification. For example, optimization in the sense that certain articles to be cleaned should not be mixed with other articles to be cleaned. This may relate to tools from a certain production process that are cleaned and stored together.

[0029] Preferably, the method comprises: - recognizing positioning features of the captured cleaning rack and / or the article to be cleaned; - Aligning a virtual 3D model of the cleaning rack and / or the articles to be cleaned according to these positioning features; - visualizing an overlaid representation of the real cleaning rack and / or the articles to be cleaned with the registered virtual 3D model; Includes.

[0030] This allows for easy alignment of the virtual 3D model with the real items to be cleaned. The augmented reality device can be designed to perform this alignment while the user is loading the cleaning rack.

[0031] Preferably, the method comprises: - recognizing positioning features of the captured cleaning rack and / or the article to be cleaned; - indicating a positional correction of the article to be cleaned by a positioning feature; - correcting the position of the article to be purified according to a position correction instruction from a user; Includes.

[0032] This allows the user to easily make corrections. The augmented reality device can provide an end position indication so that the user knows when the article to be cleaned has reached the correct end position. This end indication can be provided by a color change and / or an audio signal.

[0033] Preferably, the augmented reality device comprises at least one speaker and / or one earphone for reproducing the audio loading instructions.

[0034] Alternatively, or in addition to visualizing the position correction, audible correction instructions can be output, which can point out detailed or specific positioning features.

[0035] Preferably, the article to be cleaned and / or the cleaning rack are provided with at least one identification feature, in particular a marking and / or physical feature and / or label, for identifying the article to be cleaned and / or the cleaning rack, which can preferably be detected by a recording device.

[0036] This makes it possible to be sure where on the washing rack the article to be cleaned has been loaded and cleaned. The identification feature can be a QR code. However, the articles to be cleaned can also be identified by their optical features alone.

[0037] Preferably, the method of loading comprises: Providing a database, the database comprising loading instructions for loading the washing rack. Includes.

[0038] This allows quick access to the correct positioning of the article to be cleaned. The database may be part of the augmented reality device and / or part of the server. The augmented reality device may include a communication device for communicating with the server.

[0039] Furthermore, the augmented reality device may have a digital interface to the purification system so that data can be transmitted to the purification system. In particular, the augmented reality device may issue a release for purification to the purification system. This may, for example, prevent the purification system from starting the purification process even if the augmented reality device has not yet logged the final loading process. The purification system may provide an option to save the data logged by the augmented reality device in order to link the purification data with the loading data. This does not have to be done directly on the purification system, but may also be done on an external server or computer that processes and / or stores the data.

[0040] Preferably, the database comprises a virtual 3D model of the real articles to be cleaned and / or the real washing rack. Preferably, the virtual 3D model comprises the same positioning features and / or identification features as the real articles to be cleaned and / or the real washing rack.

[0041] This allows easy and quick recognition of the articles to be cleaned and the cleaning racks and their correct placement.

[0042] Preferably, the loading instructions include information regarding an additional cleaning device, preferably an additional nozzle, to be used for a particular article to be cleaned. In particular, the loading instructions include details regarding the positioning and / or arrangement and / or mounting of the additional cleaning device to be used. The loading method comprises: - positioning and / or arranging and / or mounting at least one additional purification device to be used by the user according to the loading instructions; Includes.

[0043] In this way, correct cleaning of difficult to clean items can be easily ensured.The loading instructions may include warnings, in particular audible warnings, to indicate particular difficulties in correct placement.

[0044] Preferably, the washing rack and the articles to be cleaned are recorded by a recording device, particularly during loading of the washing rack and / or after completion of loading of the washing rack. Preferably, the recording is initiated by input from a user. The recording is stored in a log server on the recording device and / or on the cleaning system.

[0045] This allows later tracking of whether the item being cleaned has been properly cleaned.

[0046] Preferably, the user interacts with the loading instructions by means of gestures or verbal commands, which can preferably be recorded by a recording device and / or input by an input device.

[0047] For example, the user can rotate and flip the cleaning carrier to easily see where and how the articles to be cleaned are located. The input device can be a watch, a mouse, a keyboard, etc. The augmented reality device may comprise an input device, in particular one or more tactile input features (such as buttons or a keyboard), for interacting with the augmented reality device, in particular the glasses.

[0048] The problem is further solved by a test method for testing the loading of the washing rack. - loading a washing rack, in particular by a loading method according to any one of the preceding claims, - initiating the test, preferably by input from a user, in particular by a recording device of the augmented reality device, preferably by a camera and / or a microphone, capturing the loading of the washing rack, preferably by means of an augmented reality device, in particular by means of a recording device of the augmented reality device and / or a recording device of the cleaning system; - Check that the wash rack is loaded correctly and - issuing a warning if the washing rack is not loaded correctly and, if not, issuing a release for cleaning, especially by means of an augmented reality device; Includes.

[0049] This allows for quick verification of the loading of the washing rack. Release for cleaning can be given to the user and / or the cleaning system.

[0050] Preferably, the test method comprises: - visualizing the correct loading of the washing rack and / or loading instructions for correcting the loading, in particular by means of an augmented reality device, in particular if an incorrect loading of the washing rack is detected, and / or visualizing the incorrectly positioned washing rack, - correcting the loading of the washing rack; Includes.

[0051] This allows the user to quickly and easily correct the placement of the articles to be purified. Preferably, capturing the loading of the washing rack and / or checking the loading is performed during loading of the washing rack.

[0052] This makes it easier for the user to ensure proper loading. Preferably, the test method is recorded by a recording device of the augmented reality apparatus.

[0053] This allows for easy retesting if the article being cleaned is insufficiently cleaned. The calculations of the test method can be calculated either on the device capturing the data (such as an augmented reality device) and / or on an external device or server which can be located on site and / or in the cloud.

[0054] The problem is solved by an augmented reality device designed to carry out the steps of the above mentioned method, in particular comprising a visualization device, preferably mixed reality glasses, for visualizing pictorial and / or animated loading instructions, and / or a playback device, preferably speakers and / or headphones, for playing back audio loading instructions, and / or a recording device for capturing the real washing rack and the real articles to be cleaned, preferably identification features and / or positioning features.

[0055] Such an augmented reality device allows for quick and accurate loading of the washing racks. The augmented reality device may comprise a fastener for attaching the augmented reality device to the user's head. The fastener may be an elastic band with an adjustable length. The augmented reality device may comprise a database of loading instructions and / or a 3D model of the items to be cleaned and / or the cleaning rack and / or may be connected to the database via a cable and / or wirelessly. The augmented reality device may be designed to allow the user to interact with the 3D model of the items to be cleaned and / or the cleaning rack, in particular by gestures and / or audio instructions. In particular, the augmented reality device is a mixed reality device.

[0056] The problem is also solved by a loading system, which comprises at least one augmented reality device as described above and at least one cleaning rack, in particular the loading system comprises a database with loading instructions and / or with virtual 3D models of real items to be cleaned and / or of real cleaning racks.

[0057] The system allows for fast and accurate loading of the cleaning racks. The loading system may comprise a capture device designed to capture the articles to be cleaned, and / or the recording device of at least one augmented reality device may be designed to capture the articles to be cleaned. The loading system may be designed to select loading instructions for the captured articles to be cleaned, preferably calculate the ideal distribution of the articles to be cleaned on one or more cleaning racks, select corresponding loading instructions, and transmit them to one or more augmented reality devices. A separate capture device allows for fast and easy capture of the incoming articles to be cleaned and distribution to different cleaning racks. Once the articles to be cleaned are captured by the augmented reality device recording device, the augmented reality device may select and play back loading instructions for the articles to be cleaned, speeding up the process while ensuring the correct selection of loading instructions. The loading system may comprise a database of all individually identifiable articles to be cleaned.

[0058] The loading system may be adapted to log the cleaning of each individually identifiable article to be cleaned, particularly with a still image of the loading of the cleaning rack or racks used. The loading system may be designed to log loading data, such as the date and / or time of loading and / or cleaning and / or the identification of the cleaning system and / or user used, together with an image of the recording device and / or cleaning data. The loading system may be designed to identify the article to be cleaned. The loading system may include a server configured to collect the loading data. The server may be designed to detect inefficient processes and / or optimize the loading instruction.

[0059] The problem is finally solved by a method for cleaning an article to be cleaned, the method comprising: - loading the washing rack according to the loading method described above; - testing the loading of the washing rack, preferably during and / or after the completion of the loading, by a test method as described above; - introducing the loaded washing rack into a purification system; - Purifying the item to be purified by the purification system; Includes.

[0060] In this manner, complete cleaning of the item being cleaned is easily ensured. The step of cleaning the item to be cleaned may be designed to occur only when released for cleaning, preferably by the user and / or the augmented reality device.

[0061] The cleaning system can perform several cleaning steps. The cleaning system may also be equipped with a recording device that allows verification of correct loading of the cleaning rack and / or correct execution of the cleaning. Cleaning may include washing and / or sterilizing and / or drying the articles to be cleaned. The cleaning system may be designed to wash and / or sterilize and / or dry the articles to be cleaned.

[0062] The present invention will now be described in detail with reference to the drawings. [Brief description of the drawings]

[0063] [Figure 1] FIG. 1 is a schematic diagram of a loading method. [Diagram 2] FIG. 1 is a schematic diagram of a test method. [Diagram 3] FIG. 1 is a schematic diagram of a purification method. [Figure 4] 1 is a schematic diagram of an augmented reality device; [Diagram 5] FIG. 2 is a schematic diagram of a loading system. [Figure 6] FIG. 11 is a diagram of a first loading teaching. [Figure 7]FIG. 11 is a diagram of a second loading teaching. [Figure 8] FIG. 13 is a diagram of a superimposed representation of a washing rack with a rotated virtual washing rack. [Figure 9] FIG. 13 is a diagram of a superimposed representation of a washing rack with a shifted virtual washing rack. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0064] FIG. 1 shows a schematic diagram of a loading method 10 for loading articles to be cleaned onto a washing rack in a cleaning system.

[0065] In the loading method 10, in a first step 11 an augmented reality device is provided, which is then designed to allow interaction of the user with virtual reality, i.e. to achieve mixed reality.

[0066] In a further step 12, a cleaning rack is provided. The cleaning rack is designed to hold the articles to be cleaned so that they can be thoroughly cleaned. For example, they may have openings sufficient to allow the cleaning liquid to pass through. Rotating arms may also be arranged on the cleaning rack. The cleaning rack may be a trolley, a basket and similar container.

[0067] In the next step 13, the loading instruction is loaded and initiated by input from the user. This is done by the user's gestures, which are recorded and evaluated by the recording device of the augmented reality device, as well as by the user's audio instruction. The recording device comprises at least one camera and at least one microphone. Furthermore, the real washing rack can be captured by the recording device, and thus a representation of the virtual washing rack can be projected on or next to the real washing rack.

[0068] In step 14, the augmented reality device then issues loading instructions for loading the articles to be cleaned onto the washing rack. This is done by visual representation and / or audio instruction by the augmented reality device. For this purpose, the augmented reality device comprises at least one display device for visually representing the loading instructions, in this case glasses worn by the user, and a playback device for playing the audio instructions, in this case a speaker.

[0069] The article to be cleaned is the object to be cleaned. The article to be cleaned can be an ampule, a tool, a clip, and similar objects.

[0070] The augmented reality device is equipped with a 3D model of the items to be cleaned and the cleaning rack, so that the real cleaning rack and items to be cleaned can be easily superimposed on or visualized next to the 3D model by a display device.

[0071] Next, in step 15, the washing rack is loaded with the articles to be cleaned by the user according to the provided loading instructions. The user can easily transfer the desired location of the virtual 3D model to the real location of the articles to be cleaned using the overlay or adjacent display. By overlaying the real washing rack loading with the correct virtual washing rack loading, the user can easily identify which location is correct and where the real articles to be cleaned are incorrectly placed.

[0072] In step 16, the completed loading step is captured by input from the user, which is made by an audio or visual command from the user, which is recorded by a recording device of the augmented reality device, here at least a microphone or a camera, and which is executed by the augmented reality device.

[0073] In step 17, the loading instructions for another loading step are loaded. Compared with conventional loading methods, the loading method of the present invention is less error-prone and faster to execute. By using glasses worn by the user, the user can easily use his / her hands to load the washing rack and interact with the virtual representation.

[0074] FIG. 2 shows a schematic diagram of the test method for checking correct loading of the washing rack. In a first step 21, the washing rack is loaded according to the loading method 10 shown in FIG.

[0075] Next, in step 22, the test is initiated with input from the user via audio commands recorded by a recording device of the augmented reality device.

[0076] In step 23, the loading of the washing rack is captured by a camera of the recording device of the augmented reality apparatus.

[0077] Then, in step 24, it is checked whether the washing rack is correctly loaded. Here, the real loaded washing rack is recorded by the recording device and compared with the correctly loaded washing rack by the augmented reality device. If the washing rack is not correctly loaded, a warning is issued. The misaligned position is highlighted in the overlay display, so that the user can see at a glance which articles to be cleaned are incorrectly positioned. The user corrects the position of the incorrectly positioned articles to be cleaned based on the display. If the washing rack is correctly loaded, an acoustic signal gives approval for cleaning.

[0078] The test method 20 is documented by taking still images of the wash racks correctly or incorrectly loaded.

[0079] FIG. 3 shows a schematic diagram of a purification method 30 . In a first step 31, the washing rack is loaded by loading method 10 (shown in FIG. 1).

[0080] In a second step 32, the loading is checked by the test method 20 (see FIG. 3). If the correct or corrected loading is determined, then in step 33 the loaded washing rack is introduced into the purification system.

[0081] In step 34, the article to be cleaned is cleaned by the purification system. 4 shows a schematic diagram of an augmented reality device 1. The augmented reality device 1 comprises a visualization device 2, a recording device 3, a playback device 4 and a computer 5.

[0082] The visualization device 2 is here a pair of glasses having two display surfaces 7 onto which the representation of the loading instructions is projected.

[0083] The recording device 3 comprises at least one camera and at least one microphone. The camera is designed to recognize both the washing rack and the article to be cleaned and to record the gestures made by the user. The at least one microphone is designed to record the acoustic commands from the user. The user can use gestures to interact with the virtual 3D model, thus achieving mixed reality.

[0084] The playback device 4 is a speaker that plays back the audio loading instruction. The computer 5 comprises a database of loading instructions and is adapted to execute the loading method 10 (Figure 1), the testing method (Figure 2) and the cleaning method (Figure 3). The database also includes 3D models and images of the cleaning racks and the articles to be cleaned. The computer is configured to evaluate the audio and visual signals from the recording device 3 and to load, play, pause, check and log the loading instructions accordingly.

[0085] The augmented reality device 1 comprises a clasp 6 for attachment to the user's head. Here, the clasp 6 is a bracket for attachment to the user's ear. This allows quick attachment and detachment of the device. However, elastic adjustable straps or similar clasps are also conceivable if a more secure attachment is found.

[0086] A user wears the augmented reality device 1 and selects loading in the menu using gestures. Loading instructions for this loading are retrieved from a database in the computer 5 and shown to the user using the display device 2.

[0087] 5 shows a schematic diagram of a loading system 40. The loading system 40 comprises an augmented reality device 1 and a cleaning rack 41. In a first step, a user has already loaded the cleaning rack 41 with items to be cleaned 43. The augmented reality device 1 now superimposes loading instructions 42a for real items to be cleaned 42b onto the real cleaning rack 41.

[0088] Figure 6 shows a diagram of a first loading instruction, where the augmented reality device 1 (see Figure 4) overlays a real table with a virtual representation of the washing rack 51 and the articles to be cleaned 44a.

[0089] During loading, the user follows these loading instructions and places the real items to be cleaned on the real washing rack in positions that correspond to the placement of the virtual items to be cleaned 44a on the virtual washing rack 51. The user completes the loading step with voice commands. The augmented reality device 1 (see FIG. 4) switches to the second loading instruction for the second loading step.

[0090] Figure 7 shows a diagram of the second loading instruction. Here again, as in Figure 6, the real table is superimposed by the augmented reality device 1 with a virtual representation of the washing rack 51 and the second loading instruction 45a. Furthermore, this virtual representation shows the completed first loading instruction 44, which may be shown in a different colour than the pending loading instruction 45a.

[0091] 8 shows a diagram of a superimposed representation of a washing rack 52 with a rotated virtual washing rack 51. The user can rotate the virtual washing rack 52 using an interaction (see 53) so that the representation of the virtual washing rack 51 matches the alignment of the real washing rack 51.

[0092] 9 shows a diagram of a superimposed representation of a washing rack 52 with a shifted virtual washing rack 51. The user can shift the virtual washing rack 52 using interactions (see 53) so that the representation of the virtual washing rack 51 matches the alignment of the real washing rack 51.

Claims

1. A method (10) for loading a washing rack (41) for cleaning in a cleaning system, comprising: Providing an augmented reality device (1), preferably a mixed reality device, in particular comprising glasses, Providing a washing rack (41); providing loading instructions (42a) for loading the washing rack (41) by means of the augmented reality device (1), in particular by visual representations and / or audio instructions; - capturing the completed loading steps, preferably by input by said user and / or by at least one recording device (3) of said augmented reality device (1); loading said washing rack (41) with articles to be cleaned (42b) by a user according to said loading instructions (42a) provided; A loading method (10) comprising:

2. The loading method (10) according to claim 1, wherein the loading instruction (42a) is visualized to the user, in particular by means of glasses, by virtually displaying a 3D model of the loaded cleaning rack (51), in particular the position and / or arrangement of the items to be cleaned (42a) on the cleaning rack (51) and / or the loading step.

3. The loading method (10) of claim 2, wherein the loading steps are visualized in an animated format.

4. The loading method (10) according to claim 2 or 3, wherein a virtual loading instruction (42a) is projected by the augmented reality device (1), in particular by the glasses, onto the real position of the cleaning rack (41), preferably a virtual cleaning rack (51) and / or a virtual item to be cleaned is projected by the augmented reality device onto the real cleaning rack (41), in particular animated loading steps are projected onto the cleaning rack (41).

5. visualizing the article to be cleaned and / or the cleaning rack; collecting the articles to be cleaned and / or the cleaning racks to be used, preferably by a user and / or by a sorting device; The method (10) of any one of claims 1 to 4, comprising:

6. The loading method (10) according to any one of the preceding claims, wherein the augmented reality device (1) comprises at least one recording device (3) for recording information, in particular at least one camera for recording still and / or moving images and / or at least one microphone for recording audio instructions from the user.

7. The loading method (10) according to any one of the preceding claims, wherein the articles to be cleaned (43, 42b) and / or the cleaning rack (41) are provided with positioning features for recognizing the alignment of the articles to be cleaned (43, 42b) and / or the cleaning rack (41), in particular the positioning features are physical features and / or labels, preferably the positioning features are designed to be captured by the at least one recording device (3) of the augmented reality device (1).

8. The method comprises: Aligning the 3D model according to gestures captured by the user, preferably by a recording device (3) of the augmented reality device (1), in particular according to positioning features. A method (10) according to any of the preceding claims 2 to 7, characterised in that it comprises:

9. The method comprises: - selection of a loading instruction by the user by interaction with the augmented reality device (1), in particular by inputting by an input device and / or by recognizing a gesture by the recording device (3); visualizing the selected loading teachings; 2. A method (10) according to any one of the preceding claims, characterized in that it comprises:

10. The method comprises: - capturing the articles to be cleaned (42b) and / or the washing rack to be used, in particular by input by a user and / or by recognition of the washing rack (42b) by the recording device (3); In particular, determining an ideal loading of at least one washing rack (41) with the captured articles to be cleaned (42b); 2. A method (10) according to any one of the preceding claims, characterized in that it comprises:

11. The method comprises: Recognizing positioning features of the captured cleaning rack (41) and / or the article to be cleaned (42b); Aligning the virtual 3D model of the washing rack (51) and / or the articles to be cleaned (42a) according to these positioning features; visualizing a superimposed representation of the real washing rack (51) and / or articles to be cleaned using the registered virtual 3D model; The method (10) of claim 10, comprising:

12. The method comprises: Recognizing positioning features of the captured cleaning rack (41) and / or the article to be cleaned (43); indicating a positional correction of the article to be purified (43) by the positioning feature; correcting the position of the article to be purified (43) in accordance with the position correction instruction by the user; 12. The method (10) according to claim 10 or 11, characterized in that it comprises:

13. The loading method (10) according to any one of the preceding claims, characterized in that the augmented reality device (1) comprises at least one speaker and / or one earphone for playing back the audio loading instruction.

14. The method (10) according to any one of the preceding claims, characterized in that the articles to be cleaned (42b, 43) and / or the cleaning rack (41) are provided with at least one identification feature, in particular a marking and / or a physical feature and / or a label, for identifying the articles to be cleaned and / or the cleaning rack, which is preferably detectable by the recording device (3).

15. The loading method (10) comprises: Providing a database, said database comprising loading instructions for loading a washing rack (41).

2. A method (10) according to any one of the preceding claims, characterized in that it comprises:

16. The loading method (10) according to claim 15, characterized in that the database comprises a virtual 3D model of a real item to be cleaned and / or a real cleaning rack, preferably the virtual 3D model comprises the same positioning features and / or identification features as the real item to be cleaned and / or the real cleaning rack.

17. The loading instructions include information regarding an additional cleaning device, preferably an additional nozzle, to be used for a particular article to be cleaned, in particular regarding the positioning and / or arrangement and / or mounting of the additional cleaning device to be used, and the loading method comprises: Positioning and / or arranging and / or attaching at least one additional purification device to be used by said user in accordance with said loading instructions.

2. A method (10) according to any one of the preceding claims, characterized in that it comprises:

18. A loading method (10) according to any one of the preceding claims, characterized in that the washing rack (41) and the articles to be cleaned (42) are recorded by the recording device (43), in particular during the loading of the washing rack and / or after completion of the loading of the washing rack, preferably the recording being initiated by input from the user and the recording being stored on a log server and / or on the cleaning system.

19. The loading method (10) according to any one of the preceding claims, characterized in that the user interacts with the loading instructions, preferably by means of a recording device (3) and / or by means of gestures or verbal commands recorded by an input device.

20. A test method (20) for testing the loading of a washing rack, comprising: - loading a washing rack (41) by a loading method (10) in particular according to any one of the preceding claims, - initiating a check, preferably by an input by said user, in particular by a recording device (3) of the augmented reality device (1), preferably by at least one camera and / or at least one microphone; - capturing said loading of said washing rack (41), preferably by means of an augmented reality device (1), in particular by means of a recording device (3) of said augmented reality device (1) and / or by means of a recording device of said cleaning system; Checking whether the washing rack (41) is correctly loaded; issuing a warning if the washing rack (41) is not correctly loaded, and issuing a release for cleaning if this is not the case, in particular by means of the augmented reality device (1); A test method (20).

21. The test method (20) comprises: displaying, in particular by means of an augmented reality device (1), the correct loading of the washing rack (41) and / or the loading instructions for correcting said loading and / or displaying the incorrectly positioned cleaning articles, in particular if an incorrect loading of the washing rack (41) is detected; correcting the loading of the washing rack (41); 21. The test method (20) according to claim 20, characterized in that it comprises:

22. 22. Testing method (20) according to claim 20 or 21, characterized in that the capturing of the loading of the washing rack (41) and / or the checking of the loading are performed during the loading of the washing rack (41).

23. Test method (20) according to any of claims 20 to 22, characterized in that the test method (20) is recorded by the recording device (3) of the augmented reality device (1).

24. An augmented reality device (1) adapted to carry out the steps of the method according to any one of the preceding claims, in particular comprising a visualization device (7) for visualising pictorial and / or animated loading instructions, preferably mixed reality glasses, and / or a playback device (4) for playing back audio loading instructions, preferably speakers and / or headphones, and / or a recording device (3) for capturing a real cleaning rack (41) and real articles to be cleaned (42b, 43), preferably identification features and / or positioning features.

25. A loading system (40) comprising at least one augmented reality device (1) as described in claim 24 and at least one cleaning rack (41), in particular the loading system (40) comprising a database having loading instructions and / or having a virtual 3D model of real items to be cleaned and / or a real cleaning rack.

26. A method (30) for cleaning an article to be cleaned (43), comprising: - loading a washing rack (41) by a loading method (10) according to any one of claims 1 to 19; - testing the loading of the washing rack by a test method (20) according to any one of claims 20 to 23, in particular during and / or after completion of the loading, and introducing the loaded washing rack into a purification system; Cleaning the item to be cleaned (43) by the cleaning system; A method (30), comprising:

Citation Information

Patent Citations

  • System comprising a dishwasher and method for operating a dishwasher

    DE102020202502A1

  • Automatic dishwashing system, automatic dishwashing method, automatic dishwashing program, and storage medium

    WO2021006306A1