Visual energy-saving channel type dish-washing machine control method, dish-washing machine, device, equipment and medium

Abstract

The invention discloses a visual energy-saving channel type dish-washing machine control method, a dish-washing machine, a device, equipment and a medium, and the method comprises the steps: obtaining visual data and channel speed information corresponding to a channel, carrying out tableware recognition according to the visual data, and obtaining target tableware information; target time data is calculated according to the target tableware information and the channel speed information, a first control command is generated according to the target time data, and the first control command is used for controlling a cleaning mechanism to start a cleaning state when the to-be-cleaned tableware enters the cleaning mechanism and stop the cleaning state when the to-be-cleaned tableware does not reach the cleaning mechanism. The channel type dish washing machine can be automatically controlled, and water and electricity are saved.

Description

Technical Field

[0001] The present application relates to the field of tableware cleaning, and particularly to a visual energy-saving channel dishwasher control method, dishwasher, device, equipment and medium. Background Art

[0002] A dishwasher is an electrical appliance used for automatically cleaning kitchen utensils such as bowls, dishes, etc. Using a dishwasher can greatly save labor in families or restaurants. A channel dishwasher, also often referred to as a conveyor belt dishwasher, continuous dishwasher, long conveyor dishwasher or basket conveyor dishwasher, is a commercial dishwashing device designed to meet high-flow requirements. They are widely used in places such as restaurants, hotels, school canteens, hospital canteens, etc. that require rapid and efficient cleaning of a large number of tableware. Compared with household dishwashers, conveyor belt dishwashers can continuously process tableware, greatly improving work efficiency.

[0003] In the related art, a channel dishwasher has emerged on the market, which has one or more conveyor belts, and the tableware to be cleaned is conveyed to the cleaning mechanism through the conveyor belt for cleaning.

[0004] However, the channel dishwasher in the related art lacks means of automatic control. In actual use, regardless of the number of tableware on the conveyor belt, the cleaning mechanism always remains in a water spraying and cleaning state, resulting in a great waste of water and electricity when the number of tableware is small. Summary of the Invention

[0005] The present application aims to propose a visual energy-saving channel dishwasher control method, dishwasher, device, equipment and medium, which can realize the automatic control of the channel dishwasher and save water and electricity.

[0006] In a first aspect, an embodiment of the present application provides a visual energy-saving channel dishwasher control method. The channel dishwasher includes one or more channels, and each channel includes a conveyor belt for transporting the tableware to be cleaned and a cleaning mechanism arranged at the end of the conveyor belt. The method includes the following steps:

[0007] Obtain visual data of the channel and channel speed information. The visual data is generated by a camera shooting one or more channels of the channel dishwasher, and the channel speed information is used to indicate the conveying speed of the channel;

[0008] Perform tableware recognition according to the visual data to obtain target tableware information, where the target tableware information is used to indicate the position information of one or more pieces of tableware to be cleaned on the conveyor belt;

[0009] Calculate target time data according to the target tableware information and the channel speed information, where the target time data is used to indicate the time when each piece of tableware to be cleaned reaches the cleaning mechanism;

[0010] Generate a first control command according to the target time data, where the first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism and stop the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism.

[0011] According to some embodiments of the present application, the through-channel dishwasher includes multiple channels, the visual data is generated by a single camera, and the visual area of the camera covers all conveyor belts of the through-channel dishwasher. Obtaining the visual data corresponding to the channel includes:

[0012] Obtain the visual area of the camera;

[0013] Segment the visual area of the camera to obtain sub-visual areas corresponding to each channel;

[0014] Obtain visual data including all sub-visual areas.

[0015] According to some embodiments of the present application, after obtaining the target tableware information by identifying according to the visual data, it further includes:

[0016] Perform personnel identification according to the visual data to obtain cleaning port personnel information, where the cleaning port personnel information is used to indicate whether there is a person at the cleaning port at the front end of the conveyor belt;

[0017] When the cleaning port personnel information indicates that there is no person at the cleaning port, generate a pause command for the corresponding channel, and the pause command is used to stop the working states of the conveyor belt and the cleaning mechanism.

[0018] According to some embodiments of the present application, before performing tableware identification according to the visual data, it further includes:

[0019] Obtain tableware image data and an initial recognition model, where the tableware image data is used to represent tableware images of different types, and the initial recognition model is used to identify tableware;

[0020] Perform blurring processing on the tableware image data to obtain blurred tableware image data, where the blurred tableware image data is used to represent tableware images to be cleaned of different types;

[0021] Divide the blurred tableware image data into a training set and a validation set;

[0022] Train the initial recognition model according to the training set and the validation set to obtain a target recognition model, and the model recognition model is used to perform tableware identification according to the visual data.

[0023] According to some embodiments of the present application, after generating the cleaning control command according to the target time data, it further includes:

[0024] Perform tableware recognition based on the visual data to obtain tableware-free channel information, where the tableware-free channel information is used to indicate that there are no tableware to be cleaned on the conveyor belt of the corresponding channel;

[0025] Generate a second control command according to the obtained tableware-free channel information, where the second control command is used to indicate cleaning the conveyor belt where there are no tableware to be cleaned.

[0026] According to some embodiments of the present application, after obtaining the visual data corresponding to the channel, it further includes:

[0027] Perform clarity analysis on the visual data to generate lens status information, where the lens status information is used to indicate whether the lens of the camera is fogged;

[0028] In the case where the lens status information indicates that the lens of the camera is fogged, generate a defogging command, where the defogging command is used to indicate heating the lens glass of the camera to eliminate the fog;

[0029] If the lens status information still indicates that the lens of the camera is fogged within a preset time after generating the defogging command, generate fog alarm information.

[0030] In a second aspect, an embodiment of the present application provides a channel dishwasher, which includes a control module and one or more channels. The channel includes a conveyor belt for transporting tableware to be cleaned and a cleaning mechanism provided at the end of the conveyor belt. The control module controls the tableware cleaning through the visual energy-saving channel dishwasher control method described in the first aspect.

[0031] In a third aspect, an embodiment of the present application provides a visual energy-saving channel dishwasher control device, including:

[0032] A data acquisition module, configured to acquire visual data of the channel and channel speed information, where the visual data is generated by a camera shooting one or more channels of the channel dishwasher, and the channel speed information is used to indicate the conveying speed of the channel;

[0033] A tableware recognition module, configured to perform tableware recognition based on the visual data to obtain target tableware information, where the target tableware information is used to indicate the position information of one or more tableware to be cleaned on the conveyor belt;

[0034] A time calculation module, configured to calculate target time data according to the target tableware information and the channel speed information, where the target time data is used to indicate the time when each tableware to be cleaned reaches the cleaning mechanism,

[0035] A control command generation module, configured to generate a first control command according to the target time data, where the first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and stop the cleaning state when the tableware to be cleaned does not reach the cleaning mechanism.

[0036] Fourthly, an embodiment of the present application provides an electronic device, which includes: a processor and a memory storing computer program instructions;

[0037] When the processor executes the computer program instructions, the visual energy-saving channel type dishwasher control method described in the first aspect is implemented.

[0038] Fifthly, an embodiment of the present application provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the visual energy-saving channel type dishwasher control method described in the first aspect is implemented.

[0039] The visual energy-saving channel type dishwasher control method, dishwasher, device, equipment and medium of the embodiments of the present application have at least the following beneficial effects:

[0040] In this embodiment, first, the visual data of the channel and the channel speed information are obtained; then, tableware recognition is performed according to the visual data to obtain target tableware information; the target time data is calculated according to the target tableware information and the channel speed information, and the first control command is generated according to the target time data. In the present application, the tableware to be cleaned on each conveyor belt is recognized by a camera, and then the target time data is calculated and the first control command is generated. The dishwasher controls the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and stop the cleaning state when the tableware to be cleaned does not reach the cleaning mechanism, so as to realize the automatic control of the channel type dishwasher and save water and electricity.

[0041] The additional aspects and advantages of the present application will be partially given in the following description, partially become obvious from the following description, or be understood through the practice of the present application. Description of the Drawings

[0042] The following further describes the present application with reference to the drawings and embodiments, where:

[0043] Figure 1 is a schematic flowchart of an embodiment of the visual energy-saving channel type dishwasher control method provided by the present application;

[0044] Figure 2 is a schematic structural diagram of an embodiment of the visual energy-saving channel type dishwasher control device provided by the present application;

[0045] Figure 3Schematic structural diagram of the electronic device provided by this application. Detailed implementation manners

[0046] The embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and are only used to explain the present invention and should not be construed as a limitation to the present invention.

[0047] It should be noted that although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different module division in the device or a different order in the flowchart. Terms such as "first" and "second" in the specification, claims and the above drawings are used to distinguish similar objects and do not necessarily have to be used to describe a specific order or sequence.

[0048] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0049] In addition, the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, many specific details are provided to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will realize that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, well-known methods, devices, implementations or operations are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0050] The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0051] The flowcharts shown in the drawings are only exemplary illustrations and do not necessarily include all content and operations / steps, nor do they necessarily have to be executed in the described order. For example, some operations / steps can be decomposed, while some operations / steps can be combined or partially combined, so the actual execution order may change according to the actual situation.

[0052] A dishwasher is an electrical appliance used to automatically clean kitchen utensils such as bowls, dishes, etc. Using a dishwasher can greatly save labor in families or restaurants. A conveyor-type dishwasher, also often referred to as a belt-type dishwasher, continuous dishwasher, long conveyor dishwasher, or basket conveyor dishwasher, is a commercial dishwashing device designed to meet high-volume requirements. They are widely used in restaurants, hotels, school canteens, hospital canteens and other places where a large number of tableware need to be quickly and efficiently cleaned. Compared with household dishwashers, belt-type dishwashers can continuously process tableware, greatly improving work efficiency.

[0053] In related technologies, a conveyor-type dishwasher has emerged on the market, which has one or more conveyor belts, and the tableware to be cleaned is conveyed to the cleaning mechanism through the conveyor belts for cleaning.

[0054] However, the conveyor-type dishwashers in related technologies lack means of automatic control. In actual use, regardless of the number of tableware on the conveyor belt, the cleaning mechanism always remains in the state of spraying water for cleaning. When the number of tableware is small, it will cause great waste of water and electricity.

[0055] To solve the problems of the prior art, the embodiments of the present application provide a control method, device, equipment and medium for a vision energy-saving conveyor-type dishwasher. First, the control method for a vision energy-saving conveyor-type dishwasher provided by the embodiments of the present application will be introduced below.

[0056] Reference Figure 1 As shown, a control method for a vision energy-saving conveyor-type dishwasher is applied to the control module of the conveyor-type dishwasher, which can be the controller of the conveyor-type dishwasher or the control main board. The conveyor-type dishwasher includes one or more channels. Each channel includes a conveyor belt for transporting the tableware to be cleaned and a cleaning mechanism arranged at the end of the conveyor belt. The method includes the following steps:

[0057] S101. Obtain the vision data corresponding to the channel and the channel speed information. The vision data is generated by a camera shooting the channel of the conveyor-type dishwasher, and the channel speed information is used to indicate the conveying speed of the corresponding channel;

[0058] S102. Identify tableware according to the vision data to obtain target tableware information, and the target tableware information is used to indicate the position information of one or more pieces of tableware to be cleaned on the conveyor belt;

[0059] S103. Calculate target time data according to the target tableware information and the channel speed information, and the target time data is used to indicate the time when each piece of tableware to be cleaned reaches the cleaning mechanism.

[0060] S104. Generate a first control command according to the target time data. The first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and to stop the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism.

[0061] In this embodiment, first, obtain the visual data corresponding to the channel and the channel speed information; then perform tableware recognition according to the visual data to obtain the target tableware information; calculate the target time data according to the target tableware information and the channel speed information, and generate a first control command according to the target time data. In this application, the tableware to be cleaned on each conveyor belt is recognized by a camera, and then the target time data is calculated and the first control command is generated. The dishwasher controls the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and to stop the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism, so as to realize the automatic control of the through-type dishwasher and save water and electricity.

[0062] The visual data in the above step S101 refers to the video or image data captured by the camera. When there is one channel, the shooting range of the camera covers this channel. When there are multiple channels, the shooting range of the camera covers all the channels of the dishwasher. Since the shooting range of the camera covers the channels of the dishwasher, the visual data includes the conveyor belt and all the tableware to be cleaned on the conveyor belt. When there are multiple channels, the camera can be one or multiple. It can be that only one camera shoots all the conveyor belts, and then the visual area of this camera is processed by channel, and each area corresponds to one channel. It can also be that multiple cameras are used, and each camera corresponds to one channel respectively. Then, by receiving the video or image data captured by each camera, the visual data of all the conveyor belts and all the tableware to be cleaned on the conveyor belts can be obtained.

[0063] The channel speed information in the above step S101 refers to the conveying speed of the conveyor belt obtained by the controller, that is, the speed of the tableware to be cleaned on the conveyor belt. The real-time conveying speed can be obtained by directly reading the driving controller of the conveyor belt, or the conveying speed of the current conveyor belt can be obtained by reading the working gear of the conveyor belt and according to the default speed of the current gear, or the conveying speed can be calculated by the running speed of the conveyor belt. Exemplarily, in this application, the conveyor belt of the dishwasher includes three gears: fast, medium, and slow. The controller can know the running speed of the current conveyor belt, that is, the conveying speed, according to the gear of the conveyor belt operation.

[0064] In the above step S102, tableware recognition is performed based on visual data to obtain target tableware information, which refers to analyzing the visual data obtained in step S101 to identify the tableware to be cleaned and the position information of these tableware to be cleaned. The position information refers to the position on the conveyor belt, such as the arrangement order of these tableware to be cleaned on the conveyor belt and the distance from the cleaning mechanism at the end of the conveyor belt.

[0065] In the above step S103, the target time data is calculated based on the target tableware information and the channel speed information, which refers to the position information of the identified tableware to be cleaned and the conveying speed of the conveyor belt, and calculates the time for each tableware to be cleaned to reach the cleaning mechanism at the end of the conveyor belt. Obviously, as long as the distance between a certain tableware to be cleaned and the cleaning mechanism and the conveying speed of the tableware to be cleaned on the conveyor belt are known, the time for the tableware to be cleaned to reach the cleaning mechanism at the end of the conveyor belt can be calculated. Exemplarily, for example, there are three tableware A, B, and C to be cleaned on a certain conveyor belt at the same time. Then, according to the position information of the three tableware A, B, and C to be cleaned and the current conveyor belt speed, the times for A, B, and C to reach the cleaning mechanism are calculated respectively.

[0066] It should be noted that the conveyor belt in this application refers to the conveyor belt that transports the tableware to be cleaned to the entrance of the cleaning mechanism, that is, the part of the conveyor belt before entering the cleaning mechanism.

[0067] In the above step S104, a first control command is generated based on the target time data. The first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism and stop the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism. It means that the controller controls the intermittent operation of the corresponding cleaning mechanism according to the time when each tableware to be cleaned reaches the cleaning mechanism obtained in step S103, starts the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and stops the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism to save water and electricity. Exemplarily, when a tableware enters, the controller controls the water pump of the cleaning mechanism to start running. When the previous tableware to be cleaned has been cleaned and left the cleaning mechanism and entered the placement area, and the next tableware to be cleaned has not entered the cleaning mechanism, that is, when no tableware enters, the controller controls the water pump of the cleaning mechanism to stop running, thereby saving the power consumption and water consumption of the water pump and the power consumption of heating, achieving the effect of energy saving.

[0068] Exemplarily, in this application, by using methods such as single-chip microcomputer or PLC program control, the output points are used to control the water pumps of each module respectively (such as point 1 controls the slag removal pump, point 2 controls the main washing pump, point 3 controls the pre-rinsing pump, and point 4 controls the rinsing pump). For example, when the controller detects that there is tableware to be cleaned on the conveyor belt of channel 1 through visual data, and then the controller calculates the time for the tableware to be cleaned to reach the cleaning mechanism through time calculation, and gives the running signal to the water pump of the corresponding module.

[0069] In some embodiments, a tunnel dishwasher includes multiple channels. Visual data is generated by a single camera, and the visual area of the camera covers the entire conveyor belt of the tunnel dishwasher. Obtaining the visual data corresponding to each channel may include:

[0070] Obtain the visual area of the camera;

[0071] Segment the visual area of the camera to obtain sub-visual areas corresponding to each channel;

[0072] Obtain visual data including all sub-visual areas.

[0073] In this embodiment, by segmenting the visual area of the camera, sub-visual areas corresponding to each channel are obtained, and visual data including all sub-visual areas is obtained. Multi-channel control can be achieved through a single camera, saving costs.

[0074] It should be understood that for the above-mentioned obtaining of the visual area of the camera, the visual area of the camera needs to encompass all channels, that is, the lens area of the camera covers all conveyor belts.

[0075] The above-mentioned segmentation of the visual area of the camera refers to performing area segmentation on the visual area through a visual area division algorithm to achieve multi-channel monitoring of a single camera. Since the entrance widths and lengths of the conveyor belt dishwashers are different, first obtain the visual area of the camera, and then segment the visual area of the camera. The sub-visual areas can be flexibly adapted according to the sizes of each channel to suit the channel shapes of different dishwashers, avoiding misidentification when there are tableware in areas outside the conveyor belt of the dishwasher detected by the camera.

[0076] The above-mentioned obtaining of visual data including all sub-visual areas refers to obtaining the visual data of all channels according to the segmented sub-visual areas.

[0077] In some embodiments, after obtaining target tableware information by identifying based on the visual data, it may further include:

[0078] Perform personnel identification based on the visual data to obtain cleaning port personnel information, where the cleaning port personnel information is used to indicate whether there is a person at the cleaning port at the front end of the conveyor belt;

[0079] When the cleaning port personnel information indicates that there is no person at the cleaning port, generate a pause command for the corresponding channel, and the pause command is used to stop the working states of the conveyor belt and the cleaning mechanism.

[0080] In this embodiment, first, personnel identification is performed based on visual data to obtain the information of the personnel at the cleaning port. Then, when the information of the personnel at the cleaning port indicates that there is no personnel at the cleaning port, a pause command for the corresponding channel is generated. It can automatically identify whether there are personnel at the cleaning port of the channel, and pause the operation of the corresponding channel when there is no personnel at the cleaning port, further achieving the effect of energy conservation.

[0081] The above-mentioned cleaning port refers to the entrance located at the front end of the conveyor belt for placing the tableware to be cleaned on the conveyor belt. Since the dishwasher needs to manually place the tableware to be cleaned at the front end of the conveyor belt, and then the conveyor belt transports the tableware to be cleaned to the cleaning mechanism. Therefore, if it is found through visual data that there is no personnel at the cleaning port, the conveyor belt and the cleaning mechanism of the corresponding channel are controlled to pause operation, which can prevent the dishwasher from wasting energy and make the dishwasher more energy-efficient.

[0082] In some embodiments, before performing tableware identification based on visual data, it may further include:

[0083] Obtain tableware image data and an initial recognition model. The tableware image data is used to represent tableware images of different types, and the initial recognition model is used to identify tableware;

[0084] Perform blurring processing on the tableware image data to obtain blurred tableware image data, which is used to represent tableware images of different types to be cleaned;

[0085] Divide the blurred tableware image data into a training set and a validation set;

[0086] Train the initial recognition model according to the training set and the validation set to obtain a target recognition model, which is used to perform tableware identification based on visual data.

[0087] In this embodiment, first, tableware image data and an initial recognition model are obtained, then the tableware image data is blurred to obtain blurred tableware image data, then the blurred tableware image data is divided into a training set and a validation set, and finally the initial recognition model is trained according to the training set and the validation set to obtain a target recognition model. An AI large model capable of performing tableware identification based on visual data can be obtained, improving the accuracy and speed of tableware identification.

[0088] The above-mentioned acquisition of tableware image data refers to acquiring images of a large number of tableware taken or collected, such as plates, bowls, cups, etc., which need to cover different colors, angles, and placement methods, such as stacked, tilted, etc. Then, preprocessing steps such as removing invalid data and normalization processing are performed on the tableware image data.

[0089] The above-mentioned initial recognition model refers to selecting an object detection model that can achieve object position and category recognition, such as YOLOv8 or Faster R-CNN, etc.

[0090] The above-mentioned blurring of tableware image data to obtain blurred tableware image data refers to simulating the situation where tableware is covered with residues by adding occluders to the picture through means such as PS. For example, stains, water stains can be randomly added, or other forms of adding occluders can be used to simulate the blurring effect to obtain the image of blurred tableware.

[0091] The above-mentioned division of blurred tableware image data into a training set and a validation set means that according to actual needs, a part of the blurred tableware image data can be divided into the training set, and the other part into the validation set. The division ratio can be set arbitrarily according to actual needs. For example, 70% of the image data is divided into the training set, and 30% of the image data is divided into the validation set.

[0092] The above-mentioned training of the initial recognition model according to the training set and the validation set to obtain the target recognition model means that according to the selected initial recognition model, the initial recognition model is trained through the training set and the validation set until a target recognition model that can accurately recognize the tableware to be cleaned is obtained.

[0093] Specifically, first, parameter settings are made for the initial recognition model, such as setting the learning rate, batch size, number of training rounds, etc.; then the model is trained with the labeled training set, and the parameters are adjusted until the model performs stably on the validation set, that is, it can accurately recognize the tableware to be cleaned.

[0094] In some embodiments, after generating the cleaning control command according to the target time data, it may further include:

[0095] Performing tableware recognition based on visual data to obtain no-tableware channel information, where the no-tableware channel information is used to indicate that there is no tableware to be cleaned on the conveyor belt of the corresponding channel;

[0096] Generating a second control command according to the obtained no-tableware channel information, where the second control command is used to indicate cleaning the conveyor belt where there is no tableware to be cleaned.

[0097] In this embodiment, first, tableware recognition is performed based on visual data to obtain no-tableware channel information, and then a second control command is generated according to the obtained no-tableware channel information. It can realize automatic cleaning of the conveyor belt of the no-tableware channel, ensure the cleanliness of the conveyor belt, and further improve the cleaning effect.

[0098] The above-mentioned performing tableware recognition based on visual data to obtain no-tableware channel information means that if it is determined based on visual data that there is no tableware to be cleaned on the conveyor belt of a certain channel, then it is determined that the channel belongs to the no-tableware channel, and the no-tableware channel information of the corresponding channel is generated.

[0099] The above-mentioned second control command refers to a control command for cleaning the conveyor belt of the tableware-free channel. For example, scraping slag + flushing treatment is performed on the conveyor belt to ensure the cleanliness of the conveyor belt.

[0100] Exemplarily, when there are tablewares being cleaned in Channel 1 and there are no tablewares in Channel 2, it is possible that the food residues of the tablewares in Channel 1 will be washed onto the conveyor belt of Channel 2. Therefore, by controlling the operation of the slag removal water pump in Channel 2, the food residues are effectively washed away into the trash can, ensuring that the conveyor belt of Channel 2 is always clean in the future, thereby ensuring the cleaning effect of Channel 2 subsequently.

[0101] In some embodiments, after obtaining the visual data corresponding to each channel, it may further include:

[0102] Analyze the clarity of the visual data to generate lens status information, which is used to indicate whether the lens of the camera is fogged;

[0103] In the case where the lens status information indicates that the lens of the camera is fogged, generate a defogging command, which is used to indicate heating the lens glass of the camera to eliminate the fog;

[0104] If the lens status information still indicates that the lens of the camera is fogged within a preset time after generating the defogging command, generate a fog alarm message.

[0105] In this embodiment, analyze the clarity of the visual data to generate lens status information. In the case where the lens status information indicates that the lens of the camera is fogged, generate a defogging command. If the lens status information still indicates that the lens of the camera is fogged within a preset time after generating the defogging command, generate a fog alarm message. It can avoid the influence of camera lens fogging on visual clarity and improve the recognition accuracy.

[0106] Since a large amount of water vapor is generated during the operation of the dishwasher, it is very easy to cause the lens to fog, thereby affecting visual clarity. Therefore, the controller analyzes the clarity of the visual data. When it is found that the clarity is lower than the threshold, it is determined that the lens is fogged. At this time, the glass of the camera is controlled to be heated, and the temperature is controlled at 50 - 60 degrees Celsius, so that the water vapor cannot form fog on the glass.

[0107] In addition, if the lens status information still indicates that the lens of the camera is fogged within a preset time after generating the defogging command, generating a fog alarm message means generating an alarm after a certain time when the fog cannot be eliminated, prompting that it is necessary to manually check whether the camera is abnormal.

[0108] The present application also relates to a tunnel dishwasher, and the tunnel dishwasher controls the dishwashing through the vision energy-saving tunnel dishwasher control method of the above embodiment.

[0109] Specifically, the tunnel dishwasher includes a plurality of channels. Each channel includes a conveyor belt for transporting the tableware to be washed and various cleaning mechanisms arranged along the path of the conveyor belt. It also includes a camera and a controller. The controller is used to run the vision energy-saving tunnel dishwasher control method of the above embodiment.

[0110] Based on the vision energy-saving tunnel dishwasher control method provided in the above embodiment, correspondingly, the present application also provides a specific implementation manner of the vision energy-saving tunnel dishwasher control device.

[0111] As Figure 2 shown, the vision energy-saving tunnel dishwasher control device 200 provided in the embodiment of the present application may include:

[0112] A data acquisition module 201, configured to acquire vision data corresponding to each channel and channel speed information. The vision data is generated by the camera shooting a plurality of channels of the tunnel dishwasher, and the channel speed information is used to indicate the conveying speed of the corresponding channel;

[0113] A tableware recognition module 202, configured to perform tableware recognition based on the vision data to obtain target tableware information, and the target tableware information is used to indicate the position information of one or more pieces of tableware to be washed on the conveyor belt;

[0114] A time calculation module 203, configured to calculate target time data according to the target tableware information and the channel speed information, and the target time data is used to indicate the time when each piece of tableware to be washed reaches the cleaning mechanism.

[0115] A control command generation module 204, configured to generate a first control command according to the target time data. The first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be washed enters the cleaning mechanism, and to stop the cleaning state when the tableware to be washed has not reached the cleaning mechanism.

[0116] The vision energy-saving tunnel dishwasher control device 200 of the embodiment of the present application is used to execute the vision energy-saving tunnel dishwasher control method in the above embodiment. Its specific processing process is the same as that of the vision energy-saving tunnel dishwasher control method in the above embodiment, and will not be elaborated here one by one.

[0117] Figure 3 shows a schematic hardware structure diagram of an electronic device provided in an embodiment of the present application.

[0118] The electronic device may include a processor 301 and a memory 302 storing computer program instructions.

[0119] Specifically, the above-mentioned processor 301 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured as one or more integrated circuits for implementing the embodiments of the present application.

[0120] The memory 302 may include a mass storage for data or instructions. By way of example and not limitation, the memory 302 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. In a suitable case, the memory 302 may include a removable or non-removable (or fixed) medium. In a suitable case, the memory 302 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 302 is a non-volatile solid-state memory.

[0121] In some embodiments, the memory 302 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage media device, an optical storage media device, a flash memory device, an electrical, optical, or other physical / tangible memory storage device. Thus, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0122] The processor 301 reads and executes the computer program instructions stored in the memory 302 to implement any one of the visual energy-saving channel dishwasher control methods in the above embodiments.

[0123] In one example, the electronic device may further include a communication interface 303 and a bus 310. Among them, as Figure 3 shown, the processor 301, the memory 302, and the communication interface 303 are connected through the bus 310 and complete communication with each other.

[0124] The communication interface 303 is mainly used to implement communication between each module, device, unit, and / or device in the embodiments of the present application.

[0125] The bus 310 includes hardware, software, or both, and couples the components of the online data flow metering device to each other. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or a combination of two or more of these. Where appropriate, the bus 310 may include one or more buses. Although the embodiments of the present application describe and illustrate specific buses, the present application contemplates any suitable bus or interconnect.

[0126] In addition, in combination with the visual energy-saving channel dishwasher control method in the above embodiments, the embodiments of the present application can provide a computer storage medium to implement. Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by a processor, any one of the visual energy-saving channel dishwasher control methods in the above embodiments is implemented.

[0127] It should be clear that the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and illustrated as examples. However, the method process of the present application is not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions, or change the order between steps after understanding the spirit of the present application.

[0128] The functional blocks shown in the above structure block diagrams can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), appropriate firmware, a plug-in, a function card, and so on. When implemented in software, the elements of the present application are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium or transmitted via a data signal carried in a carrier wave on a transmission medium or a communication link. A "machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical discs, hard disks, fiber optic media, radio frequency (RF) links, and so on. The code segment can be downloaded via a computer network such as the Internet, an intranet, and so on.

[0129] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps. That is to say, the steps can be executed in the order mentioned in the embodiments, or different from the order in the embodiments, or several steps can be executed simultaneously.

[0130] As described above with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each block in the flowchart and / or block diagram, and the combination of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the functions / actions specified in one or more blocks of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It should also be understood that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can also be implemented by dedicated hardware that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0131] As mentioned above, the above is only the specific implementation manner of this application. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed in this application can easily think of various equivalent modifications or replacements, and these modifications or replacements should all be covered within the protection scope of this application.

Claims

1. A control method for a vision energy-saving through-type dishwasher, the through-type dishwasher comprising one or more channels, the channel comprising a conveyor belt for transporting tableware to be washed and a cleaning mechanism arranged at the end of the conveyor belt, characterized in that, Including the following steps: Obtain the visual data of the channel and the channel speed information, where the visual data is generated by a camera capturing one or more channels of a channel-type dishwasher, and the channel speed information is used to indicate the conveying speed of the channel; Perform tableware recognition based on the visual data to obtain target tableware information, where the target tableware information is used to indicate the position information of one or more tableware to be cleaned on the conveyor belt; Calculate target time data based on the target tableware information and the channel speed information, where the target time data is used to indicate the time when each tableware to be cleaned reaches the cleaning mechanism; Generate a first control command according to the target time data, where the first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism and stop the cleaning state when the tableware to be cleaned has not reached the cleaning mechanism.

2. The visual energy-saving channel dishwasher control method according to claim 1, wherein The channel-type dishwasher includes multiple channels, the visual data is generated by a single camera, and the visual area of the camera covers the entire conveyor belt of the channel-type dishwasher. Obtaining the visual data corresponding to the channel includes: Obtain the visual area of the camera; Segment the visual area of the camera to obtain sub-visual areas corresponding to each channel; Obtain the visual data including all sub-visual areas.

3. The visual energy-saving channel type dishwasher control method according to claim 1, characterized in that, After performing recognition based on the visual data to obtain the target tableware information, it further includes: Perform personnel recognition based on the visual data to obtain cleaning port personnel information, where the cleaning port personnel information is used to indicate whether there is a person at the cleaning port at the front end of the conveyor belt; Generate a pause command for the corresponding channel in the case where the cleaning port personnel information indicates that there is no person at the cleaning port, and the pause command is used to stop the working states of the conveyor belt and the cleaning mechanism.

4. The visual energy-saving channel dishwasher control method according to claim 1, wherein, Before performing tableware recognition based on the visual data, it further includes: Obtain tableware image data and an initial recognition model, where the tableware image data is used to represent tableware images of different types, and the initial recognition model is used to recognize tableware; Perform blurring processing on the tableware image data to obtain blurred tableware image data, where the blurred tableware image data is used to represent tableware images of different types to be cleaned; Divide the blurred tableware image data into a training set and a validation set; Train the initial recognition model according to the training set and the validation set to obtain a target recognition model, and the model recognition model is used to perform tableware recognition based on the visual data.

5. The visual energy-saving channel type dishwasher control method according to claim 1, characterized in that, After generating the cleaning control command according to the target time data, it further includes: Perform tableware recognition based on the visual data to obtain tableware-free channel information, where the tableware-free channel information is used to indicate that there is no tableware to be cleaned on the conveyor belt of the channel; Generate a second control command according to the obtained tableware-free channel information, and the second control command is used to indicate cleaning treatment of the conveyor belt where there is no tableware to be cleaned.

6. The visual energy-saving channel dishwasher control method according to claim 1, wherein After obtaining the visual data corresponding to each channel, it further includes: Perform clarity analysis on the visual data to generate lens state information, where the lens state information is used to indicate whether the lens of the camera is fogged; When the lens status information indicates that the lens of the camera is fogged, a defogging command is generated, and the defogging command is used to indicate heating the lens glass of the camera to eliminate the fog; If the lens status information still indicates that the lens of the camera is fogged within a preset time after the defogging command is generated, a fog alarm information is generated.

7. A channel type dishwasher, characterized in that, The channel type dishwasher includes a control module and one or more channels. The channel includes a conveyor belt for transporting the tableware to be cleaned and a cleaning mechanism provided at the end of the conveyor belt. The control module controls the tableware cleaning through the visual energy-saving channel type dishwasher control method according to any one of claims 1 to 6.

8. A control device for a visual energy-saving channel dishwasher, characterized in that, Including: A data acquisition module, configured to acquire visual data of the channel and channel speed information. The visual data is generated by a camera photographing one or more channels of the channel type dishwasher, and the channel speed information is used to indicate the conveying speed of the channel; A tableware recognition module, configured to recognize tableware according to the visual data to obtain target tableware information, and the target tableware information is used to indicate the position information of one or more pieces of tableware to be cleaned on the conveyor belt; A time calculation module, configured to calculate target time data according to the target tableware information and the channel speed information, and the target time data is used to indicate the time when each piece of tableware to be cleaned reaches the cleaning mechanism, A control command generation module, configured to generate a first control command according to the target time data. The first control command is used to control the cleaning mechanism to start the cleaning state when the tableware to be cleaned enters the cleaning mechanism, and to stop the cleaning state when the tableware to be cleaned does not reach the cleaning mechanism.

9. An electronic device, characterized in that, The device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, it implements the visual energy-saving channel type dishwasher control method according to any one of claims 1-6.

10. A computer-readable storage medium, characterized in that, Computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by the processor, they implement the visual energy-saving channel type dishwasher control method according to any one of claims 1-6.

Images