Robot-based beverage pickup method, device and electronic equipment
By acquiring beverage images and comparing their appearance features with standard parameters, alternative solutions were generated, solving the problem of abnormal food retrieval by unattended robots and improving user experience and food retrieval quality.
Patent Information
- Application Number
- CN202611129713.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-28
- Publication Date
- 2026-11-03
AI Technical Summary
Existing unattended robots lack verification functions during beverage and food dispensing, leading to abnormal dispensing, an inability to provide effective response strategies, impacting user experience, and potentially causing complaints.
By acquiring images of beverages, extracting their appearance features and comparing them with standard parameters, alternative solutions are generated. In abnormal situations, multimodal reminders and dynamic alternative solutions are provided, including changing beverages, delaying preparation, or offering refunds, combined with robot body movements to reassure users.
It enables automatic verification and anomaly handling of beverages, ensuring that meals meet standards, dynamically providing alternative solutions, improving user experience, and avoiding complaints.
Smart Images
Figure CN123033302A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of computer science, and specifically relates to a robot-based beverage serving method, device, and electronic device. Background Technology
[0002] In relevant technical solutions, in unattended robot operation scenarios, robots can automatically complete the preparation of drinks and the serving of meals according to preset programs. However, current robots lack the function of verifying the food pickup, which leads to problems such as abnormal food pickup. Furthermore, when abnormal food pickup occurs, there is no corresponding response strategy to appease users, which can easily cause user complaints and a decline in the food pickup experience. Summary of the Invention
[0003] The purpose of this application is to provide a robot-based beverage serving method, device, and electronic device to overcome or at least partially solve the above-mentioned problems.
[0004] To solve the above-mentioned technical problems, this application is implemented as follows: A robot-based beverage serving method, the method comprising: Get an image of the finished beverage; Extract the appearance features of the beverage from the beverage image; Obtain the standard parameters corresponding to the beverage based on the order label of the beverage; When the appearance characteristics of the beverage are inconsistent with the standard parameters, it is determined that the beverage is abnormal. Obtain the current raw material inventory status and equipment status of the robot; Based on the current raw material inventory status and the equipment status, an alternative solution is generated and pushed to the user.
[0005] In one embodiment of this application, the robot includes a cup-dispensing spout, and the spout is equipped with multi-angle cameras; acquiring an image of the prepared beverage includes: When the robot finishes making the beverage selected by the user, it pushes the beverage out through the dispensing spout. Images of the beverage are captured from different angles using multi-angle cameras; the multi-angle cameras include at least a top-view camera, a side camera, and a front camera.
[0006] In one embodiment of this application, after determining that the beverage is abnormal, the method further includes: The robot is controlled to perform a preset apology gesture towards the user.
[0007] In one embodiment of this application, the method further includes: When the appearance of the beverage is consistent with the standard parameters, or when the beverage is remade according to an alternative and there are no abnormalities in the beverage, the user is reminded through a preset multimodal method, and the robot is controlled to perform a preset guiding action to guide the user to pick up the food; the preset multimodal method includes at least voice and screen display.
[0008] In one embodiment of this application, the alternative includes at least replacing the beverage with another beverage whose price is within a preset price range, delaying the preparation of the beverage and offering a coupon, and providing a full refund; the appearance characteristics of the beverage include at least color, milk foam height, latte art pattern, and cup shape; the standard parameters include at least beverage category, cup shape, and customization requirements; the beverage category has corresponding standard color, standard milk foam height, and standard latte art pattern; the customization requirements include at least sugar content and temperature; The step of pushing the alternative solution to the user includes: The alternative solution is pushed to the user through a preset method; the preset method includes at least proactive push. In response to the user's selection of the alternative, a target alternative is determined from the alternatives; The proposed alternative is to replace the beverage with another beverage whose price is within a preset price range, delay the preparation of the beverage and offer a coupon, or provide a full refund. When the target alternative is to replace it with another beverage whose price is within a preset price range or to delay the production of the beverage, the other beverage or the beverage to be replaced or delayed is added to the priority production queue for priority production.
[0009] In one embodiment of this application, the method further includes: The anomaly type corresponding to the anomaly is determined based on the current raw material inventory status and the equipment status. Execute the corresponding exception handling scheme according to the exception type.
[0010] In one embodiment of this application, executing the corresponding exception handling scheme according to the exception type includes: When the anomaly type is a warning fault, the robot is controlled to stop making the target suspended beverage based on the current raw material inventory status and the equipment status, and the robot is controlled to stop making the target suspended beverage and notify the designated object. The step of determining beverages that cannot be produced based on the current raw material inventory status and the equipment status as target paused beverages includes: Determine the missing raw materials based on the current raw material inventory status; Determine the beverage flavors that cannot be made based on the equipment status; Based on the missing ingredients and the flavor of the beverage, beverages that cannot be made are designated as target pause beverages. Stop making beverages with the flavor of the beverage in question, as well as other beverages with the flavor of the beverage in question; When the anomaly is classified as a serious malfunction, the robot is controlled to stop making drinks and notify the designated recipient.
[0011] A robot-based beverage dispensing device, the device comprising: The beverage image acquisition module is used to acquire images of the prepared beverages. A beverage appearance feature extraction module is used to extract beverage appearance features from the beverage image; The standard parameter acquisition module is used to acquire the standard parameters corresponding to the beverage based on the order label of the beverage; An anomaly determination module is used to determine that the beverage is abnormal when the appearance characteristics of the beverage are inconsistent with the standard parameters; The data acquisition module is used to acquire the current raw material inventory status and equipment status of the robot; The alternative solution generation module is used to generate alternative solutions based on the current raw material inventory status and the equipment status, and push the alternative solutions to the user.
[0012] An electronic device includes: a processor; and a memory for storing processor-executable instructions. The processor is configured to execute the instructions to implement the above-described robot-based beverage serving method.
[0013] A computer-readable storage medium, when the instructions in the storage medium are executed by a processor, enables the execution of the above-described robot-based beverage dispensing method.
[0014] The embodiments of this application have at least the following beneficial effects: In this embodiment, the robot acquires an image of the completed beverage, extracts its appearance features from the image, and then obtains the beverage's standard parameters based on the order label. If the appearance features do not match the standard parameters, the beverage is considered abnormal. Next, the robot obtains its current raw material inventory and equipment status to generate alternative solutions, which are then pushed to the user for selection. This embodiment automatically checks whether the beverage meets the standard parameters upon completion. If it does, the beverage is considered normal and can be served to the user, ensuring that all beverages served meet the standards. If it does not meet the standard parameters, the beverage is considered abnormal. In this case, alternative solutions are generated based on the current raw material inventory and equipment status and pushed to the user. Dynamically providing alternative solutions effectively reassures users, prevents complaints, and improves the user's dining experience. Attached Figure Description
[0015] Figure 1 This is a flowchart illustrating the steps of a robot-based beverage serving method provided in this application embodiment; Figure 2 This is a flowchart illustrating the workflow of a robot-based beverage dispensing system provided in this application embodiment. Figure 3 This is a schematic diagram of the structure of a robot-based beverage dispensing device provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0016] The embodiments of this application will be described below with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be understood that the preferred embodiments are only for illustrating this application and are not intended to limit the scope of protection of this application.
[0017] Reference Figure 1 The diagram illustrates a flowchart of a robot-based beverage serving method provided in an embodiment of this application, specifically including the following steps: Step 101: Obtain an image of the finished beverage.
[0018] Step 102: Extract the appearance features of the beverage from the beverage image.
[0019] In specific implementations, the robot (robot control system) can be a humanoid robot, or it can be other types of robots capable of providing anthropomorphic interactive services. This application embodiment does not impose any restrictions on this.
[0020] In this embodiment, when the robot receives a user's order request for a beverage (such as coffee), it will prepare the corresponding beverage based on the beverage information in the order request. The beverage information may include at least the beverage category, flavor, size, temperature, and sweetness. After preparing the beverage, the robot will acquire an image of the prepared beverage and extract its appearance features from the image. In some embodiments, the appearance features may include at least color, milk foam height, latte art pattern, and cup shape.
[0021] Step 103: Obtain the standard parameters corresponding to the beverage based on the order label of the beverage.
[0022] Step 104: When the appearance characteristics of the beverage are inconsistent with the standard parameters, it is determined that the beverage is abnormal.
[0023] In practice, the finished beverages are labeled with order tags, either affixed or printed. These tags can be QR codes or RFID (Radio Frequency Identification), allowing the robot to retrieve the corresponding standard parameters for the beverage from the backend order system. In some embodiments, the standard parameters may include at least the beverage category, cup type, and customization requirements. Beverage categories have corresponding standard colors, standard milk foam heights, and standard latte art patterns. Customization requirements may include at least sugar content and temperature.
[0024] In this embodiment, the robot can extract beverage appearance features from beverage images and compare them with standard parameters in multiple dimensions. Specifically, this comparison can include beverage category, cup type, customization requirements, and other dimensions to determine if the beverage meets the standards. When a beverage's appearance features are inconsistent with the standard parameters, typically even a single discrepancy indicates an anomaly. In such cases, the beverage will not be served to the user to avoid a poor dining experience. For example, if the robot determines through multi-dimensional comparison that the latte art is blurry or that a osmanthus latte lacks osmanthus syrup, it will avoid serving beverages with blurry latte art or missing osmanthus syrup to the user, preventing the user from questioning the beverage's quality and experiencing a poor dining experience.
[0025] Step 105: Obtain the current raw material inventory status and equipment status of the robot.
[0026] Step 106: Generate an alternative solution based on the current raw material inventory status and the equipment status, and push the alternative solution to the user.
[0027] In this embodiment, when the robot determines that a beverage is abnormal, it can obtain the current raw material inventory status and equipment status. Specifically, the current raw material status refers to the remaining amount of raw materials the robot uses to make various beverages, such as leftover coffee beans, milk, osmanthus syrup, water, ice cubes, and cups. The equipment status refers to the status of the various hardware components used by the robot to make beverages, such as whether the robot's grinder, water pump, temperature sensor, ice maker, camera, and network communication module are functioning properly to make the beverages.
[0028] Subsequently, the robot can dynamically generate suitable alternatives based on the current raw material inventory status and the aforementioned equipment status, and push these alternatives to the user via screen and voice prompts for the user to choose from. In some embodiments, the alternatives may include at least replacing the beverage with another beverage within a preset price range, delaying beverage preparation and offering a coupon, or providing a full refund.
[0029] In this embodiment, the robot acquires an image of the completed beverage, extracts its appearance features from the image, and then obtains the beverage's standard parameters based on the order label. If the appearance features do not match the standard parameters, the beverage is considered abnormal. Next, the robot obtains its current raw material inventory and equipment status to generate alternative solutions, which are then pushed to the user for selection. This embodiment automatically checks whether the beverage meets the standard parameters upon completion. If it does, the beverage is considered normal and can be served to the user, ensuring that all beverages served meet the standards. If it does not meet the standard parameters, the beverage is considered abnormal. In this case, alternative solutions are generated based on the current raw material inventory and equipment status and pushed to the user. Dynamically providing alternative solutions effectively reassures users, prevents complaints, and improves the user's dining experience.
[0030] In one embodiment of this application, pushing the alternative to the user includes: pushing the alternative to the user through a preset method; the preset method includes at least active pushing; in response to the user's selection of the alternative, determining a target alternative from the alternatives; replacing the beverage with another beverage whose price is within a preset price range, delaying the preparation of the beverage and giving a coupon, or providing a full refund according to the target alternative; When the target alternative is to replace it with another beverage whose price is within a preset price range or to delay the production of the beverage, the other beverage or the beverage to be replaced or delayed is added to the priority production queue for priority production.
[0031] In this embodiment of the invention, when it is determined that the beverage is abnormal, alternative solutions are proactively pushed to the user through preset methods such as screen touch, voice, etc., for the user to select.
[0032] In response to user selections of alternatives via screen touch, voice, or other means, the system can identify the target alternative and then execute corresponding actions based on it. For example, if the user selects another beverage within a preset price range as the target alternative, the system can add that beverage or delay its preparation to the priority preparation queue to ensure the user's beverage is prepared first and avoids a poor experience due to long waiting times. Furthermore, if the user selects a delayed preparation option, a coupon can be offered. If the user selects a full refund, the amount already paid can be returned to the user.
[0033] In one embodiment of this application, the robot may include a cup-dispensing spout, which is equipped with multi-angle cameras; acquiring an image of the prepared beverage may include: When the robot finishes making the beverage selected by the user, it pushes the beverage out through the dispensing spout. Images of the beverage are captured from different angles using multi-angle cameras; the multi-angle cameras include at least a top-view camera, a side camera, and a front camera.
[0034] In its implementation, the robot is equipped with a multi-angle visual acquisition system. This system includes multi-angle cameras installed at the dispensing spout of the robot. For example, a top-down camera, a side camera (45-degree side camera), and a front camera are installed at the dispensing spout to form a multi-angle visual acquisition array. This array comprehensively acquires images of the beverage, thereby comprehensively capturing its appearance features. This allows for accurate determination of whether the beverage is abnormal based on its appearance features, ensuring comprehensive detection of beverage anomalies and guaranteeing a positive user experience.
[0035] In one embodiment of this application, after determining that the beverage is abnormal, the method may further include: The robot is controlled to perform a preset apology gesture towards the user.
[0036] In this embodiment of the application, the robot may include a limb feedback module. After determining that there is an abnormality in the beverage, the robot can be controlled to perform a corresponding preset apology action. For example, for a humanoid robot, it can perform corresponding limb actions. For example, when an abnormality is detected in the beverage, it can perform an apology bowing action to enhance the naturalness of human-computer interaction.
[0037] For example, suppose that due to a robot malfunction, a user's latte is incorrectly made into an Americano. The robot obtains an image of the finished drink and, through color analysis (Americanos are darker and have no milk foam), determines that the drink is not the user's latte. This indicates an anomaly has been detected. Upon comparison with the order and confirmation that the drink does not match the user's order, the robot will perform an apologetic bow and display "We are very sorry, there was a problem with your drink preparation" on the screen, offering three alternatives: ① Wait for the latte to be remade (approximately 3 minutes) and receive a coupon for the next order; ② Accept the current Americano and receive a 50% refund; ③ Full refund. If the user chooses option ①, the system will add the latte to the priority preparation queue to expedite the drink's preparation.
[0038] In one embodiment of this application, the method may further include: When the appearance of the beverage is consistent with the standard parameters, or when the beverage is remade according to an alternative and there are no abnormalities in the beverage, the user is reminded through a preset multimodal method, and the robot is controlled to perform a preset guiding action to guide the user to pick up the food; the preset multimodal method includes at least voice and screen display.
[0039] In this embodiment, when the appearance of the beverage is consistent with the standard parameters, or when the user selects an alternative and the robot remakes the beverage according to the alternative and the beverage is found to be normal, the robot can remind the user to pick up the food through preset multimodal methods such as voice and screen display. At the same time, the robot can also make preset guiding gestures when guiding the user to pick up the food, such as pointing to the position of the cup opening with a gesture, so that the user can quickly complete the food pick-up.
[0040] For example, when the beverage is ready, the robot points to the spout with a gesture and says in voice, "Hello, your latte is ready, please pick it up," while the order information is displayed on the screen to ensure that the user picks up the correct beverage.
[0041] In one embodiment of this application, the method may further include: The anomaly type corresponding to the anomaly is determined based on the current raw material inventory status and the equipment status. Execute the corresponding exception handling scheme according to the exception type.
[0042] In this embodiment, the robot can determine the type of anomaly based on the current raw material inventory status and equipment status. Then, it can report the anomaly to the robot's background early warning system based on the different anomaly types, triggering the execution of the corresponding anomaly handling scheme, thereby completing the anomaly handling quickly and accurately.
[0043] In one embodiment of this application, executing the corresponding exception handling scheme according to the exception type may include: When the anomaly type is a warning fault, based on the current raw material inventory status and the equipment status, a beverage that cannot be made is determined as a target suspended beverage, and the robot is controlled to stop making the target suspended beverage and a designated object is notified; the step of determining a beverage that cannot be made as a target suspended beverage based on the current raw material inventory status and the equipment status includes: Determine the missing raw materials based on the current raw material inventory status; Determine the beverage flavors that cannot be made based on the equipment status; Based on the missing ingredients and the flavor of the beverage, beverages that cannot be made are designated as target pause beverages. Stop making beverages with the flavor of the beverage in question, as well as other beverages with the flavor of the beverage in question; When the anomaly is classified as a serious malfunction, the robot is controlled to stop making drinks and notify the designated recipient.
[0044] In practical implementations, there can be multiple exception types, and the urgency of different exception types varies. Therefore, corresponding exception handling schemes will be executed for different exception types. In some embodiments, exception types may include different types of faults such as warning faults and critical faults. Different faults have different urgency levels, so different handling methods can be adopted to handle the faults accordingly.
[0045] When the anomaly type is a warning or fault, the robot can identify beverages that cannot be made due to missing ingredients or malfunctioning hardware based on the current raw material inventory and equipment status. These beverages can be designated as target paused beverages. For example, if osmanthus syrup is missing, osmanthus-flavored beverages can be designated as target paused beverages, and the robot can be controlled to stop making them. Furthermore, the robot can determine the flavor of beverages that cannot be made based on equipment status. For instance, if the ice maker malfunctions, all beverages requiring ice will be designated as target paused beverages, and their production will be stopped. Simultaneously, designated recipients (such as maintenance personnel) are notified via SMS or in-app notifications to replenish raw materials or repair the robot, allowing the production of these target paused beverages to resume and ensuring a normal beverage supply.
[0046] When the anomaly type is a serious fault, it means that the robot is unable to make most or all of the drinks. In this case, the robot can be controlled to stop making all drinks. At the same time, the designated person (such as maintenance personnel) can be urgently notified via telephone or other multimodal means to replenish raw materials or repair the robot.
[0047] For example, if the robot detects a shortage of milk and is unable to make a latte, the anomaly type can be determined as a warning fault. All beverages requiring milk (lattes, cappuccinos, flat whites, etc.) will be suspended, while other beverages (Americanos, pour-overs, etc.) will continue to be supplied normally. The system will also notify maintenance personnel via SMS to replenish the milk. For users who have already ordered lattes, the system can proactively send notifications offering alternative solutions.
[0048] Of course, the above-mentioned exception types are merely examples. In practical applications, they can be extended to other exception types as needed, and corresponding processing methods can be set for the extended exception types. This application embodiment does not impose any restrictions on this.
[0049] Reference Figure 2 This is a flowchart of a robot-based beverage and food dispensing system provided in this application embodiment. The specific process may include: After the beverage is prepared, it is delivered to the dispensing spout; a multi-angle visual acquisition system captures images; order feature extraction: label scanning + image recognition, which is then verified against the order system by a multi-dimensional comparison engine; if the verification result is completely consistent, the screen and voice prompt the user to pick up the food, the robot executes a guiding gesture, and the food is picked up; if the verification result is that the beverage is abnormal / incorrect, the robot performs an apology bow, the dynamic alternative solution generation module generates optional solutions, and the screen and voice present alternative solutions to the user, who can choose an alternative beverage (re-make the alternative beverage), choose a refund (trigger the refund process), or wait for delayed production (join the priority production queue); if the verification result is that there is a shortage of ingredients / equipment failure, a graded warning is triggered according to the type of failure; for example, if the failure level is Warning, the single device is suspended and maintenance personnel are notified via SMS, in-app, etc.; if the failure level is a serious failure, the entire machine is stopped, and maintenance personnel are urgently notified by telephone.
[0050] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of this application are not limited to the described order of actions, because according to the embodiments of this application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily necessary for the embodiments of this application.
[0051] Reference Figure 3The diagram shows a structural block diagram of a robot-based beverage dispensing device provided in an embodiment of this application. The device may specifically include the following modules: The beverage image acquisition module 301 is used to acquire beverage images of the prepared beverages; The beverage appearance feature extraction module 302 is used to extract beverage appearance features from the beverage image; The standard parameter acquisition module 303 is used to acquire the standard parameters corresponding to the beverage based on the order label of the beverage; The anomaly determination module 304 is used to determine that the beverage is abnormal when the appearance characteristics of the beverage are inconsistent with the standard parameters; The data acquisition module 305 is used to acquire the current raw material inventory status and equipment status of the robot; The alternative solution generation module 306 is used to generate alternative solutions based on the current raw material inventory status and the equipment status, and push the alternative solutions to the user.
[0052] In one embodiment of this application, the robot includes a cup-dispensing spout, and the spout is equipped with a multi-angle camera; the beverage image acquisition module 301 is used for: When the robot finishes making the beverage selected by the user, it pushes the beverage out through the dispensing spout. Images of the beverage are captured from different angles using multi-angle cameras; the multi-angle cameras include at least a top-view camera, a side camera, and a front camera.
[0053] In one embodiment of this application, the device further includes: a first robot control module, configured to: The robot is controlled to perform a preset apology gesture towards the user.
[0054] In one embodiment of this application, the device further includes: a second robot control module, used for: When the appearance of the beverage is consistent with the standard parameters, or when the beverage is remade according to an alternative and there are no abnormalities in the beverage, the user is reminded through a preset multimodal method, and the robot is controlled to perform a preset guiding action to guide the user to pick up the food; the preset multimodal method includes at least voice and screen display.
[0055] In one embodiment of this application, the alternative includes at least replacing the beverage with another beverage whose price is within a preset price range, delaying the preparation of the beverage and offering a coupon, and providing a full refund; the appearance characteristics of the beverage include at least color, milk foam height, latte art pattern, and cup shape; the standard parameters include at least beverage category, cup shape, and customization requirements; the beverage category has corresponding standard color, standard milk foam height, and standard latte art pattern; the customization requirements include at least sugar content and temperature; The step of pushing the alternative to the user includes: pushing the alternative to the user through a preset method; the preset method includes at least active pushing; in response to the user's selection of the alternative, determining a target alternative from the alternatives; replacing the beverage with another beverage whose price is within a preset price range, delaying the preparation of the beverage and giving a coupon, or providing a full refund, according to the target alternative; when the target alternative is replaced with another beverage whose price is within a preset price range or the preparation of the beverage is delayed, adding the other beverage or the beverage to the priority preparation queue for priority preparation.
[0056] In one embodiment of this application, the apparatus further includes: an exception handling module, configured to: The anomaly type corresponding to the anomaly is determined based on the current raw material inventory status and the equipment status. Execute the corresponding exception handling scheme according to the exception type.
[0057] In one embodiment of this application, the exception handling module is used for: When the anomaly type is a warning fault, based on the current raw material inventory status and the equipment status, a beverage that cannot be made is determined as a target suspended beverage, and the robot is controlled to stop making the target suspended beverage and a designated object is notified; the step of determining a beverage that cannot be made as a target suspended beverage based on the current raw material inventory status and the equipment status includes: Determine the missing raw materials based on the current raw material inventory status; Determine the beverage flavors that cannot be made based on the equipment status; Based on the missing ingredients and the flavor of the beverage, beverages that cannot be made are designated as target pause beverages. Stop making beverages with the flavor of the beverage in question, as well as other beverages with the flavor of the beverage in question; When the anomaly is classified as a serious malfunction, the robot is controlled to stop making drinks and notify the designated recipient.
[0058] In this embodiment, the robot acquires an image of the completed beverage, extracts its appearance features from the image, and then obtains the beverage's standard parameters based on the order label. If the appearance features do not match the standard parameters, the beverage is considered abnormal. Next, the robot obtains its current raw material inventory and equipment status to generate alternative solutions, which are then pushed to the user for selection. This embodiment automatically checks whether the beverage meets the standard parameters upon completion. If it does, the beverage is considered normal and can be served to the user, ensuring that all beverages served meet the standards. If it does not meet the standard parameters, the beverage is considered abnormal. In this case, alternative solutions are generated based on the current raw material inventory and equipment status and pushed to the user. Dynamically providing alternative solutions effectively reassures users, prevents complaints, and improves the user's dining experience.
[0059] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment. This application also provides an electronic device, such as... Figure 4 As shown, it includes a processor 1001, a device interface 1002, a memory 1003, and a bus 1004; Memory 1003 is used to store computer programs; The processor 1001 executes the above steps when executing the program stored in the memory 1003.
[0060] The bus mentioned in the above terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.
[0061] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.
[0062] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0063] This application also provides a storage medium that, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to perform the robot-based beverage dispensing method of the foregoing embodiments.
[0064] The algorithms and displays provided herein are not inherently related to any particular computer, virtual device, or other equipment. The structure required to construct such a device is obvious from the above description. Furthermore, this application is not directed to any particular programming language. It should be understood that the content of this application described herein can be implemented using various programming languages, and the above description of specific languages is for the purpose of disclosing the best mode of implementation of this application.
[0065] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of this application may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.
[0066] Similarly, it should be understood that, in order to simplify this application and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of this application, various features of this application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this method of disclosure should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as reflected in the following claims, inventive aspects lie in fewer than all features of a single foregoing disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of this application.
[0067] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.
[0068] The various component embodiments of this application can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components in the sequencing device according to this application. This application can also be implemented as a device or apparatus program for performing part or all of the methods described herein. Such an implementation of this application can be stored on a computer-readable medium, or can take the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
[0069] It should be noted that the above embodiments are illustrative of this application and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. This application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.
[0070] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, apparatuses, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0071] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the protection scope of this application.
[0072] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0073] It should be noted that the various data-related processes in the embodiments of this application are carried out in compliance with the relevant data protection laws and policies of the country where the location is located, and with the authorization granted by the owner of the corresponding device.
Claims
1. A robot-based beverage serving method, characterized in that, The method includes: Get an image of the finished beverage; Extract the appearance features of the beverage from the beverage image; Obtain the standard parameters corresponding to the beverage based on the order label of the beverage; When the appearance characteristics of the beverage are inconsistent with the standard parameters, it is determined that the beverage is abnormal. Obtain the current raw material inventory status and equipment status of the robot; Based on the current raw material inventory status and the equipment status, an alternative solution is generated and pushed to the user.
2. The method according to claim 1, characterized in that, The robot includes a cup-dispensing spout, which is equipped with multi-angle cameras; acquiring images of the prepared beverage includes: When the robot finishes making the beverage selected by the user, it pushes the beverage out through the dispensing spout. Images of the beverage are captured from different angles using multi-angle cameras; the multi-angle cameras include at least a top-view camera, a side camera, and a front camera.
3. The method according to claim 1, characterized in that, After determining that the beverage is abnormal, the method further includes: The robot is controlled to perform a preset apology gesture towards the user.
4. The method according to claim 1, characterized in that, The method further includes: When the appearance of the beverage is consistent with the standard parameters, or when the beverage is remade according to an alternative and there are no abnormalities in the beverage, the user is reminded through a preset multimodal method, and the robot is controlled to perform a preset guiding action to guide the user to pick up the food; the preset multimodal method includes at least voice and screen display.
5. The method according to claim 1, characterized in that, The alternative solutions include at least replacing the beverage with another beverage within a preset price range, delaying the preparation of the beverage and offering a coupon, and providing a full refund; the beverage's appearance features include at least color, milk foam height, latte art pattern, and cup shape; the standard parameters include at least beverage category, cup shape, and customization requirements; the beverage category has corresponding standard colors, standard milk foam height, and standard latte art patterns. The customization requirements include at least sugar content and temperature; The step of pushing the alternative solution to the user includes: The alternative solution is pushed to the user through a preset method; the preset method includes at least proactive push. In response to the user's selection of the alternative, a target alternative is determined from the alternatives; The proposed alternative is to replace the beverage with another beverage whose price is within a preset price range, delay the preparation of the beverage and offer a coupon, or provide a full refund. When the target alternative is to replace it with another beverage whose price is within a preset price range or to delay the production of the beverage, the other beverage or the beverage to be replaced or delayed is added to the priority production queue for priority production.
6. The method according to claim 1, characterized in that, The method further includes: The anomaly type corresponding to the anomaly is determined based on the current raw material inventory status and the equipment status. Execute the corresponding exception handling scheme according to the exception type.
7. The method according to claim 6, characterized in that, The step of executing the corresponding exception handling scheme according to the exception type includes: When the anomaly type is a warning fault, the robot is controlled to stop making the target suspended beverage based on the current raw material inventory status and the equipment status, and the robot is controlled to stop making the target suspended beverage and notify the designated object. The step of determining beverages that cannot be produced based on the current raw material inventory status and the equipment status as target paused beverages includes: Determine the missing raw materials based on the current raw material inventory status; Determine the beverage flavors that cannot be made based on the equipment status; Based on the missing ingredients and the flavor of the beverage, beverages that cannot be made are designated as target paused beverages. Stop making beverages with the flavor of the beverage in question, as well as other beverages with the flavor of the beverage in question; When the anomaly is classified as a serious malfunction, the robot is controlled to stop making drinks and notify the designated recipient.
8. A robot-based beverage dispensing device, characterized in that, The device includes: The beverage image acquisition module is used to acquire images of the prepared beverages. A beverage appearance feature extraction module is used to extract beverage appearance features from the beverage image; The standard parameter acquisition module is used to acquire the standard parameters corresponding to the beverage based on the order label of the beverage; The anomaly determination module is used to determine that the beverage is abnormal when the appearance characteristics of the beverage are inconsistent with the standard parameters; The data acquisition module is used to acquire the current raw material inventory status and equipment status of the robot; The alternative solution generation module is used to generate alternative solutions based on the current raw material inventory status and the equipment status, and push the alternative solutions to the user.
9. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the instructions to implement the robot-based beverage serving method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor, the robot-based beverage serving method as described in any one of claims 1 to 7 is enabled to be performed.