Method for visually detecting whether a beverage machine is out of material and beverage machine

Abstract

The application provides a method for detecting whether a beverage machine is out of material through visual identification, comprising: controlling the beverage machine to enter a detection mode of being out of material; controlling the beverage machine to discharge material from a discharge port; collecting an image at the discharge port of the beverage machine; and analyzing and processing the image to confirm whether the beverage machine is out of material. The application also provides a beverage machine capable of detecting whether it is out of material through visual identification and a computer readable storage medium. The method of the application can accurately detect whether the beverage machine is out of material, accurately determine the type of material that is out of stock, and realize linkage alarm, so as to timely supply material, save labor, and improve customer experience.

Description

TECHNICAL FIELD

[0001] The present application relates generally to the field of visual recognition, and in particular to a method for detecting whether a beverage machine is out of material by visual recognition, a beverage machine, and a computer readable storage medium. BACKGROUND

[0002] In recent years, visual recognition technology has been widely used in various fields. Machine vision recognition system uses high-resolution industrial CCD to take detection images and converts them into digital signals. Advanced computer hardware and software technology are used to process image data signals, so as to obtain various target image characteristic values needed, and thus realize product part recognition or defect detection. At present, it is mainly used for defect detection, size measurement, angle measurement, character recognition, etc.

[0003] The existing beverage machine material detection method is non-contact liquid level sensor detection or manual inspection. Non-contact liquid level sensor detection can monitor water level change through water, but has the problem of inaccurate detection and false reporting. Manual inspection cannot accurately determine which material is lacking when there are multiple discharge outlets in the beverage machine, and affects work efficiency.

[0004] The contents of the background section merely represent the knowledge of the discloser and do not necessarily constitute the prior art in the field. SUMMARY

[0005] In view of at least one defect of the prior art, the present application provides a method for detecting whether a beverage machine is out of material by visual recognition, comprising: controlling the beverage machine to enter a detection material shortage mode; controlling the discharge outlet of the beverage machine to discharge material; collecting an image at the discharge outlet of the beverage machine; and analyzing and processing the image to determine whether the beverage machine is out of material.

[0006] According to one aspect of the present application, the beverage machine includes one or more cameras, and the camera is one or more of a fixed focus camera, an automatic focus camera and a zoom camera, wherein the camera focuses on the discharge outlet, and the step of collecting an image at the discharge outlet of the beverage machine includes collecting an image at the discharge outlet of the beverage machine by the camera.

[0007] According to one aspect of the present application, the step of controlling the beverage machine to enter the detection material shortage mode includes: selecting through the display screen and / or the buttons of the beverage machine to control the beverage machine to enter the detection material shortage mode.

[0008] According to one aspect of the present application, the step of controlling the beverage machine to enter the detection material shortage mode further includes: controlling the beverage machine to turn on the lighting system.

[0009] According to an aspect of the present application, wherein the step of controlling the dispensing of the beverage machine comprises: controlling the dispensing of one and / or multiple and / or all of the dispensing outlets of the beverage machine according to a preset dispensing strategy, and the duration of the dispensing of each dispensing outlet is determined according to a preset threshold.

[0010] According to an aspect of the present application, wherein the step of collecting image information at the dispensing outlets of the beverage machine comprises: collecting images at the dispensing outlets of the beverage machine, and the images comprise photos and / or videos.

[0011] According to an aspect of the present application, wherein the step of analyzing the images to determine whether the beverage machine is out of material comprises: extracting information features of the images, comparing the information features of the images with information features of images of a corresponding dispensing outlet when the dispensing outlet is full of material, and when the difference between the information features is greater than a preset threshold, it is determined that the corresponding dispensing outlet is out of material, wherein the information features comprise one or more of color, shape, quantity, and diameter.

[0012] According to an aspect of the present application, wherein the step of analyzing the images to determine whether the beverage machine is out of material further comprises: extracting information features of images at different times at the same dispensing outlet, comparing the difference between the previous frame of image and the next frame of image, and when the difference is greater than a preset threshold, it is determined that the corresponding dispensing outlet is out of material.

[0013] According to an aspect of the present application, when it is detected that the corresponding dispensing outlet is out of material, the beverage machine alarms, displays the type of material that is out of material, and shuts down the lighting system, and the single detection ends.

[0014] The present application also relates to a computer readable storage medium comprising computer executable instructions stored thereon, which when executed by a processor implement the method as described above.

[0015] The present application also relates to a beverage machine capable of detecting whether it is out of material through visual recognition, comprising: one or more material storage containers, which are in communication with dispensing outlets; an image collection unit configured to collect images at the dispensing outlets; an industrial control unit configured to control the beverage machine to enter a detection mode of being out of material, and to control the dispensing outlets and the image collection unit, wherein the industrial control unit is configured to determine whether the material storage containers are out of material according to images obtained by the image collection unit.

[0016] According to an aspect of the present application, further comprising: a display unit configured to receive operation instructions of a user and display detection results; and a dispensing control unit comprising one or more dispensing controllers, which are coupled to the industrial control unit and the dispensing outlets, and control the dispensing of the dispensing outlets according to instructions of the industrial control unit.

[0017] According to one aspect of the present application, further comprising: a lighting system coupled with the industrial control unit and configured to light up when the beverage machine enters the detection of material shortage mode.

[0018] Through the method of the present application, it can be accurately detected whether the beverage machine is short of material, and the material shortage category is accurately judged, and the linkage alarm is realized, so that the material is timely supplied, the labor is saved, and the customer experience is improved. BRIEF DESCRIPTION OF DRAWINGS

[0019] The accompanying drawings are included to provide a further understanding of the present application, and constitute a part of the specification, illustrate the present application, and are used to explain the present application together with the embodiments of the present application, and do not constitute a limitation on the present application. In the drawings:

[0020] Figure 1 A flow chart of a method for detecting whether a beverage machine is short of material through visual recognition according to one embodiment of the present application is shown;

[0021] Figure 2 A system principle diagram of a beverage machine according to one embodiment of the present application is shown;

[0022] Figure 3 A schematic diagram of the working mode of a beverage machine according to one embodiment of the present application is shown;

[0023] Figure 4 A schematic diagram of controlling the discharge of a discharge port according to one embodiment of the present application is shown; and

[0024] Figures 5 to 8 A schematic diagram of judging whether a beverage machine is short of material according to the information features of an image according to one embodiment of the present application is shown. DETAILED DESCRIPTION

[0025] In the following, only certain exemplary embodiments are simply described. As those skilled in the art can recognize, the described embodiments can be modified in various different ways without departing from the spirit or scope of the present application. Therefore, the drawings and the description are considered to be essentially exemplary rather than limiting.

[0026] In the description of the application, it is to be understood that the orientations or positional relationships indicated by the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", and the like are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the application and simplifying the description, and do not indicate or imply that the devices or elements indicated thereby must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the application. In addition, the terms "first", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated thereby. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the application, the meaning of "a plurality of" is two or more, unless otherwise explicitly specified and limited.

[0027] In the description of the application, it should be noted that, unless otherwise explicitly specified and limited, the terms "mounting", "connecting", "connection" should be understood broadly, for example, it can be fixed connection, or detachable connection, or integral connection; it can be mechanical connection, or electrical connection or can communicate with each other; it can be directly connected, or indirectly connected through intermediate medium; it can be the internal communication of two elements or the interaction relationship between two elements. For those skilled in the art, the specific meaning of the above terms in the application can be understood according to the specific circumstances.

[0028] In the present application, unless otherwise explicitly specified and limited, the "upper" or "lower" of the first feature to the second feature can include that the first and second features are in direct contact, or that the first and second features are not in direct contact but are in contact through another feature between them. Moreover, the "upper", "above" and "on" of the first feature to the second feature includes that the first feature is directly above and obliquely above the second feature, or only indicates that the horizontal height of the first feature is higher than that of the second feature. The "under", "below" and "under" of the first feature to the second feature includes that the first feature is directly above and obliquely above the second feature, or only indicates that the horizontal height of the first feature is less than that of the second feature.

[0029] The following disclosure provides many different embodiments or examples for implementing various structures of the invention. To simplify the disclosure, specific examples of components and arrangements are described below. These are merely examples and are not intended to limit the invention. Furthermore, reference numerals and / or letters may be repeated in different examples; such repetition is for simplification and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed. In addition, examples of various specific processes and materials are provided in this invention, but those skilled in the art will recognize the application of other processes and / or the use of other materials.

[0030] The embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0031] Figure 1 A method 10 for detecting whether a beverage machine is out of stock by visual recognition according to an embodiment of the present invention is shown, including steps S11-S14. Before describing the various steps of method 10, a beverage machine 20 that can employ method 10 is first introduced.

[0032] Figure 2 The system schematic diagram of beverage machine 20 is shown. Figure 2 As shown, the beverage machine 20 includes one or more material storage containers 21, an image acquisition unit 22, an industrial control unit 23, and a display unit 24. The material storage container 21 is connected to the discharge port 211; the image acquisition unit 22 is configured to acquire images at the discharge port 211; the industrial control unit 23 is configured to control the beverage machine 20 to enter a material shortage detection mode, control the discharge port 211 and the image acquisition unit 22, and is configured to determine whether there is a material shortage in the material storage container 21 based on the images acquired by the image acquisition unit 22. In addition, the beverage machine 20 also includes: a display unit 24, configured to receive user operation commands and display detection results; and a discharge control unit 231, which includes one or more discharge controllers 2311, coupled to the industrial control unit 23 and the discharge port 211, and controls the discharge port 211 to discharge material according to the commands of the industrial control unit 23. In addition, the beverage machine 20 also includes a lighting system 232, which is coupled to the industrial control unit 23 and configured to illuminate when the beverage machine 20 enters the low-material detection mode. The steps of method 10 are described in detail below.

[0033] In step S11, the beverage machine is controlled to enter the low-material detection mode.

[0034] Figure 3 A schematic diagram illustrating the operating mode of the beverage machine 20 is shown. Figure 3As shown, the beverage machine 20 includes various working modes such as ordering mode, low-material detection mode, standby mode, cleaning mode, etc., which can be displayed by the display unit 24 (see reference). Figure 2 The user can select different operating modes for the beverage machine 20. Specifically, the display unit 24 includes one or more displays, which can be any one or more of LCD, LED, OLED, and ULED displays, used to receive user operation commands. This invention does not limit the specific type, number, or position of the displays on the beverage machine 20. Preferably, the display is an LED touch screen, allowing the user to select the operating mode of the beverage machine 20 by directly touching the LED touch screen, which is simple, energy-saving, and economical. Optionally, the user can also select the operating mode of the beverage machine via buttons and / or a remote control and / or an APP program (not shown in the figure). When the user selects the "low-material detection mode," the beverage machine 20 enters the low-material detection mode. It should be understood that the above are merely illustrative examples and do not constitute a limitation of the invention.

[0035] In step S12, the beverage machine's outlet is controlled to dispense beverage.

[0036] Figure 4 A schematic diagram showing the control of material discharge from the outlet is shown. Figure 4 As shown, the beverage machine 20 includes one or more material storage containers 21 and one or more dispensing ports 211, with each material storage container 21 connected to a corresponding dispensing port 211. The beverage machine 20 also includes an industrial control unit 23 (see reference). Figure 2 The industrial control unit 23 includes one or more discharge control units 231 (see reference). Figure 2 The dispensing control unit 231 includes one or more dispensing controllers 2311. The dispensing control unit 231 is coupled to the industrial control unit 23 and the dispensing port 211, and selects the corresponding dispensing controller 2311 according to the instructions of the industrial control unit 23 to control the corresponding dispensing port 211 to dispense material. When the beverage machine 20 enters the low-material detection mode, the dispensing port 211 can dispense material according to the user-preset dispensing strategy. The dispensing strategy includes allowing only one dispensing port 211 to dispense material, allowing only a few dispensing ports 211 to dispense material, and / or allowing all dispensing ports 211 to dispense material.

[0037] Specifically, according to one embodiment of the present invention, refer to Figure 4 For example, when only discharge port 211-A is allowed to discharge, discharge controller 2311-A controls discharge port 211-A to discharge, while other discharge controllers 2311-B, 2311-C, and 2311-D control their respective discharge ports 211-B, 211-C, and 211-D to not discharge.

[0038] According to an embodiment of the present application, when only the discharge ports 211-A and 211-B are allowed to discharge, the discharge controller 2311-A controls the discharge port 211-A to discharge, the discharge controller 2311-B controls the discharge port 211-B to discharge, and the other discharge controllers 2311-C and 2311-D respectively control the corresponding discharge ports 211-C and 211-D not to discharge.

[0039] According to an embodiment of the present application, when all the discharge ports (211-A, 211-B, 211-C, 211-D) are allowed to discharge, the corresponding discharge ports (211-A, 211-B, 211-C, 211-D) are respectively controlled by the corresponding discharge controllers (2311-A, 2311-B, 2311-C, 2311-D) to discharge.

[0040] In addition, the discharge strategy further includes setting the order and time interval of the discharge of each discharge port 211. According to an embodiment of the present application, for example, the discharge port 211-C starts to discharge, and the discharge port 211-B discharges again after an interval of 2 seconds or 4 seconds.

[0041] The discharge strategy further includes setting the duration of the discharge of each discharge port 211, which can be determined according to a preset threshold, such as 2 seconds, 4 seconds, 6 seconds, etc. According to an embodiment of the present application, referring to Figure 4 For example, the discharge controller 2311-A first controls the discharge port 211-A to discharge, and after 2 seconds, the discharge port 211-B starts to discharge.

[0042] The above illustrates the discharge strategy of the beverage machine 20, and the user can set it at will according to actual needs. If the discharge strategy is not deliberately set, when the beverage machine 20 enters the detection of lack of material mode, all the discharge ports 211 will discharge at the same time and last for 2 seconds by default. It should be understood that the above discharge strategy is only illustrative and does not constitute a limitation on the present application.

[0043] In step S13, an image of the discharge port of the beverage machine is collected.

[0044] The beverage machine 20 further includes an image collection unit 22 (refer to Figure 2), the image acquisition unit 22 includes one or more cameras, which can be one or more of a fixed-focus camera, an autofocus camera, and a zoom camera, and the present application does not limit the type, number, and specific position of the camera on the beverage machine 20. The camera focuses on the discharge port 211 of the beverage machine 20 and acquires images at the discharge port 211, which can be photos or videos. In addition, the beverage machine 20 also includes a lighting system 232, which includes one or more light bulbs. When the beverage machine 20 enters the detection of lack of material mode, the lighting system 232 can automatically turn on and light up the discharge port, and can dynamically adjust the brightness of the light bulb according to the change in the intensity of the ambient light, so that the image acquired by the camera is clearer. The present application does not limit the specific power and type of the light bulb of the lighting system 232. When the beverage machine 20 is in a non-detection of lack of material mode, the image acquisition unit 22 and the lighting system 232 of the beverage machine 20 can be automatically turned off to facilitate energy saving; or they can not be turned off, which can be used for customers to pay by face recognition. Of course, the image acquisition unit 22 and the lighting system 232 can also be manually controlled, and preferably, they are automatically controlled by the beverage machine 20 to save labor.

[0045] In step S14, the images are analyzed and processed to determine whether the beverage machine 20 is lacking material.

[0046] Before determining whether the beverage machine 20 is lacking material, it is necessary to determine whether the beverage machine 20 has a discharge action. Specifically, the image acquired by the image acquisition unit 22 at the discharge port can be compared with the image of the discharge port previously stored when the material is sufficient, and when the difference between the two is greater than a predetermined threshold (for example, 15%), it can be considered that the discharge port has a discharge action. Specifically, the information features of the image acquired by the image acquisition unit 22 at the discharge port are extracted by the industrial control unit 23, compared with the information features of the image of the discharge port previously stored when the material is sufficient, and the difference between the two is calculated. When the difference is greater than a predetermined threshold, it is determined that the corresponding discharge port is lacking material. According to an embodiment of the present application, when the absolute value of the difference between the two is greater than a predetermined threshold (for example, 50%, or 60%, or 70%), it can be considered that the corresponding discharge port is lacking material. Alternatively, the relative difference between the two can also be calculated, for example, the difference between the two is calculated When the result is greater than a predetermined threshold (for example, 30%, or 40%, or 50%), it is considered that the corresponding discharge port is lacking material. The information features include one or more of the color, shape, number, and diameter of the material. In addition, the information features of the images at different times at the same discharge port can also be extracted, and the difference between the latter image and the former image is compared. When the difference is greater than a predetermined threshold (for example, 10%, or 5%, or 1%), it is determined that the corresponding discharge port is lacking material. The present application does not limit the method of extracting the information features of the images, which will be described in detail below.

[0047] According to a preferred embodiment of the present application, the beverage machine 20 can be determined whether it is out of material according to the color of the material. Referring to Figure 5 For example, the material storage containers 21-A, 21-B, 21-C, 21-D store watermelon juice, orange juice, milk and cucumber juice respectively. By default, all the outlets (211-A, 211-B, 211-C, 211-D) discharge material at the same time and continuously for 2 seconds. During the discharging period, the image acquisition unit 22 (see Figure 2 ) continuously acquires images at each outlet (211-A, 211-B, 211-C, 211-D) and the industrial control unit 23 (see Figure 2 ) analyzes and processes the images. The industrial control unit 23 extracts the color features of the images acquired at each outlet (211-A, 211-B, 211-C, 211-D), compares them with the color of the images of the corresponding outlet with sufficient material stored in advance, and calculates the absolute value of the difference between them. When the calculation result is greater than a predetermined threshold (for example, 50%, or 60%, or 70%), it is considered that the corresponding outlet is out of material. Specifically, for example, when the calculation result at the outlet 21-B is greater than 50%, it is considered that the outlet 211-B is out of material, i.e. the beverage machine 20 is out of orange juice. When the calculation result at the outlet 211-C is 20%, it is considered that the outlet 211-C is not out of material, i.e. the beverage machine 20 is not out of milk. Alternatively, the relative difference between the color features of the images acquired at the outlet and the color of the images of the corresponding outlet with sufficient material stored in advance can also be calculated, which will not be described in detail. It should be understood that the present embodiment is only an example and does not constitute a limitation on the present application. The present embodiment is particularly suitable for materials with unique color comparison.

[0048] According to a preferred embodiment of the present application, the beverage machine 20 can be determined whether it is out of material according to the shape of the material. Referring to Figure 6For example, material storage containers 21-E and 21-F store bubble tea and coconut milk tea respectively. By default, dispensing ports 211-E and 211-F dispense simultaneously for 2 seconds. During this dispensing period, image acquisition unit 22 continuously acquires images from both dispensing ports (211-E and 211-F), which are then analyzed and processed by industrial control unit 23. Specifically, industrial control unit 23 extracts the shape features of the images acquired from the two dispensing ports (211-E and 211-F), compares them with the pre-stored images of the corresponding dispensing ports when they are full, and calculates the absolute value of the difference between the two. When the calculated result is greater than a preset threshold (e.g., 50%, 60%, or 70%), it is considered that the corresponding dispensing port is short of material. For instance, if the absolute value of the difference at dispensing port 21-E is greater than 50%, it is considered that beverage machine 20 is short of bubble tea. Alternatively, the relative difference between the shape features of the image captured at the discharge port and the shape of the corresponding image when the material is fully supplied can be calculated, which will not be elaborated further. It should be understood that this embodiment is only illustrative and does not constitute a limitation of the present invention. This embodiment is particularly applicable to materials with relatively unique shapes.

[0049] According to a preferred embodiment of the present invention, it is also possible to determine whether the beverage machine 20 is short of materials based on the quantity of materials. (See reference) Figure 7 For example, material storage container 21-G stores bubble tea. By default, the discharge port 211-G discharges material continuously for 2 seconds. During this discharge period, the image acquisition unit 22 continuously acquires images at the discharge port 211-G, which are then analyzed and processed by the industrial control unit 23. Specifically, the industrial control unit 23 extracts the quantity characteristics of the images acquired at the discharge port 211-G, compares them with the pre-stored quantity of coconuts at the discharge port when there is sufficient material, and calculates the absolute value of the difference between the two. When the calculated result is greater than a preset threshold (e.g., 50%, 60%, or 70%), it is considered that the corresponding discharge port is short of material. Alternatively, the relative difference between the quantity characteristics of the images acquired at the discharge port and the pre-stored quantity of corresponding images when there is sufficient material can also be calculated, which will not be elaborated further. It should be understood that this embodiment is only illustrative and does not constitute a limitation of the invention. This embodiment is particularly applicable to solid materials or solid-liquid mixtures.

[0050] According to a preferred embodiment of the present invention, the presence or absence of material in the beverage machine 20 can also be determined based on the diameter of the material. (See reference) Figure 8For example, the material storage container 21-H stores watermelon juice. When the beverage machine 20 enters the detection of material shortage mode, the outlet 211-H continuously discharges for 2 seconds to form a liquid column. During this period, the image acquisition unit 22 acquires images at the outlet 211-H. The industrial control unit 23 extracts the diameters of the liquid column at different time points and calculates the average value. The absolute value or relative difference of the difference between the average value and the diameter of the outlet 211-H when the material is sufficient is compared. When the difference is greater than a preset threshold value (for example, 40%, or 50%, or 60%), it is determined that the outlet 211-H is short of material, that is, the beverage machine 20 is short of watermelon juice. In addition, the information features of images at different time points at the same outlet can also be extracted. The difference between the latter image and the former image is compared. When the difference is greater than a preset threshold value (for example, 10%, or 5%, or 1%), it is determined that the corresponding outlet is short of material. For example, at t1, the diameter of the liquid column at the same outlet is d2; at t2, the diameter of the liquid column is d2, and the change amount Δd of the diameter of the liquid column is d2-d1. When the change amount Δd of the diameter of the liquid column is 20%, which is greater than the preset threshold value 10%, it is determined that the corresponding outlet is short of material. The embodiment is particularly suitable for liquid materials. It should be understood that the embodiment is only illustrative and does not limit the present application.

[0051] The above lists four examples of information features. The four examples can be used as information features alone or in any combination of two or more, which are within the protection scope of the present application. The following describes whether the beverage machine 20 is short of material according to multiple information features.

[0052] According to a preferred embodiment of the present application, the industrial control unit 23 extracts the color, shape, number, and diameter of the images acquired at the outlet 211, respectively, compares them with the color, shape, number, and diameter of the images of the corresponding outlet when the material is sufficient which are stored in advance, and calculates the absolute value or relative difference of the difference of each information feature. When the difference of the color and / or shape is not greater than a preset threshold value, the difference of the number and / or diameter is further compared to determine whether the beverage machine 20 is short of material and the type of material shortage. It should be understood that the embodiment is only illustrative and does not limit the present application.

[0053] According to a preferred embodiment of the present application, the images of the beverage machine 20 when the material is sufficient and / or short can also be stored in the beverage machine 20, which includes but is not limited to the various embodiments above, so that the beverage machine 20 can learn deeply and build a neural network, thereby improving the accuracy of detecting whether the beverage machine 20 is short of material.

[0054] When the beverage machine 20 detects that the material is out of the outlet according to the above method, the beverage machine 20 alarms, the display unit 24 displays the out-of-material category, the lighting system 232 is turned off, the single detection is ended, and the staff timely replenishes the out-of-material category. In addition to entering the detection mode of the out-of-material by manually inputting the instruction, the beverage machine 20 can also start to enter the detection mode of the out-of-material at a fixed time.

[0055] The present application also relates to a beverage machine 20, referring to Figure 2 The beverage machine 20 comprises one or more material storage containers 21, which are in communication with the outlet 211; an image acquisition unit 22 configured to acquire images at the outlet 211; an industrial control unit 23 configured to control the beverage machine 20 to enter the detection mode of the out-of-material, and control the outlet 211 and the image acquisition unit 22, wherein the industrial control unit 23 is configured to determine whether the material storage container 21 is out of material according to the images acquired by the image acquisition unit 22. In addition, the beverage machine 20 further comprises a display unit 24 configured to receive the operation instruction of the user and display the detection result; and a discharge control unit 231 comprising one or more outlet controllers 2311 coupled to the industrial control unit 23 and the outlet 211, and configured to control the discharge of the outlet 211 according to the instruction of the industrial control unit 23. In addition, the beverage machine 20 further comprises a lighting system 232 coupled to the industrial control unit 23 and configured to be turned on when the beverage machine 20 enters the detection mode of the out-of-material.

[0056] The present application also relates to a computer readable storage medium comprising computer executable instructions stored thereon, which, when executed by a processor, implement the method 10 as described above.

[0057] The method of the present application can accurately detect whether the beverage machine is out of material, accurately determine the out-of-material category, realize the linkage alarm, timely replenish the material, save the labor, and improve the customer experience.

[0058] Finally, it should be noted that: the above only describes the preferred embodiments of the present application and is not used to limit the present application, although the present application has been described in detail with reference to the foregoing embodiments, and for those skilled in the art, the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced. Any modification, equivalent replacement, improvement, etc. within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for detecting whether a beverage machine is out of ingredients using visual recognition, comprising: The beverage machine is controlled to enter the low-material detection mode; Control the dispensing of the beverage machine from its outlet; Capture an image of the beverage machine's dispensing port; and The image is analyzed and processed to confirm whether the beverage machine is out of ingredients; The step of analyzing and processing the image to confirm whether the beverage machine is out of stock includes: Extract information features from the image, and compare the difference between the information features of the image and the information features of a pre-stored image of a material-sufficient outlet. If the difference is greater than a preset threshold, it is determined that the corresponding outlet is short of material. The information features include one or more of color, shape, quantity, and diameter; and / or Extract information features from images at different times at the same discharge port, compare the difference between the next frame and the previous frame, and determine that the corresponding discharge port is short of material when the difference is greater than a preset threshold.

2. The method according to claim 1, wherein the beverage machine includes one or more cameras, the cameras being one or more of a fixed-focus camera, an autofocus camera, and a zoom camera, wherein the camera is focused on the dispensing port, and the step of acquiring an image at the dispensing port of the beverage machine includes acquiring an image at the dispensing port of the beverage machine through the camera.

3. The method according to claim 1, wherein the step of controlling the beverage machine to enter the low-material detection mode includes: The beverage machine can be controlled to enter the low-material detection mode by selecting via its display screen and / or buttons.

4. The method according to any one of claims 1-3, wherein the step of controlling the beverage machine to enter the low-material detection mode further includes: Control the beverage machine to turn on the lighting system.

5. The method according to any one of claims 1-3, wherein the step of controlling the dispensing from the beverage machine's outlet includes: The beverage machine is controlled to dispense beverages from one and / or more and / or all of its outlets according to a preset dispensing strategy, and the duration of dispensing from each outlet is determined according to a preset threshold.

6. The method according to any one of claims 1-3, wherein the step of acquiring image information at the beverage machine outlet includes: Images of the beverage machine's dispensing port are captured, including photos and / or videos.

7. According to any one of claims 1-3, when a shortage of material is detected at the corresponding dispensing port, the beverage machine alarms, displays the category of the product lacking material, turns off the lighting system, and the single detection ends.

8. A computer-readable storage medium comprising computer-executable instructions stored thereon, the executable instructions, when executed by a processor, performing the method as described in any one of claims 1-7.

9. A beverage machine capable of visually identifying whether an ingredient is missing using the method described in any one of claims 1-7, comprising: One or more material storage containers, wherein the material storage containers are connected to a discharge port; The image acquisition unit is configured to acquire images at the discharge port; An industrial control unit is configured to control the beverage machine to enter a material shortage detection mode and to control the dispensing port and the image acquisition unit, wherein the industrial control unit is configured to determine whether there is a material shortage in the material storage container based on the image acquired by the image acquisition unit.

10. The beverage machine according to claim 9, further comprising: The display unit is configured to receive user operation commands and display the detection results; The discharge control unit includes one or more discharge controllers, coupled to the industrial control unit and the discharge port, and controls the discharge port to discharge material according to the instructions of the industrial control unit.

11. The beverage machine according to claim 9 or 10, further comprising: A lighting system is coupled to the industrial control unit and configured to illuminate when the beverage machine enters a low-material detection mode.

Images