Intelligent judgment method and device for end of meal serving and meal serving equipment

Abstract

The invention relates to the technical field of self-service catering service equipment, and discloses an intelligent judgment method and device for the end of meal serving and meal serving device.Firstly, whether a user possibly ends meal serving is preliminarily judged by monitoring whether a face image of a diner on a displayer of the meal serving equipment disappears or not; and then the distance sensor is used for collecting distance data between the user and the equipment, and if the distance exceeds the preset meal-taking distance, meal-taking completion is finally confirmed, so that the accuracy and real-time performance of meal-taking completion judgment are improved, accurate triggering of non-inductive payment settlement is guaranteed, meal-taking monitoring and meal-taking completion judgment on the next diner are facilitated, and the meal-taking efficiency is improved. And the service efficiency and the user experience of the self-service meal-ordering terminal are optimized.

Description

Technical Field

[0001] This invention relates to the field of self-service catering equipment technology, and in particular to an intelligent method, device and equipment for determining when food dispensing is finished. Background Technology

[0002] With the rapid development of the smart catering industry, self-service meal dispensing equipment has been widely used in various canteens and catering establishments to achieve automatic meal dispensing and automatic settlement of fees. Therefore, a key aspect of achieving accurate settlement of meal fees is accurately determining when the user has finished dispensing their meal.

[0003] In existing technologies, the main methods for determining when food service is finished are either manual confirmation by staff after the user has finished ordering, or confirmation that the user has finished ordering when the user's tray has moved away from the recognition area of ​​the food service terminal.

[0004] However, practice has shown that manually determining when food service is complete not only increases labor costs but is also prone to delays due to human error, such as failing to promptly release the equipment for subsequent users or misjudging the process, like mistakenly marking users who haven't finished ordering as complete. Conversely, using tray recognition to indicate completion is susceptible to errors when diners temporarily remove their trays, such as adjusting portion sizes, leading to premature payment. Therefore, regardless of the method, the accuracy of determining when diners have finished ordering is low. Consequently, proposing a new method for determining the end of food service to improve accuracy and thus enhance the accuracy of food payment settlement is crucial. Summary of the Invention

[0005] This invention provides an intelligent method, device, and equipment for determining the end of meal service. It can combine a distance sensor and an image acquisition device to accurately determine the end of meal service, thereby improving the accuracy of meal service billing. At the same time, it facilitates the monitoring and determination of the end of meal service for the next diner.

[0006] The first aspect of this invention discloses a method for intelligently determining when food service is finished, the method comprising: During the process of diners getting their meals, the face on the display of the food serving device is monitored based on the diners' facial images to obtain the diners' facial monitoring results. The diners' faces are displayed on the display in real time during the meal serving process. The food serving device contains dishes for the diners to eat. When the face detection result of the diner is used to indicate that the face image of the diner has disappeared from the display, the distance data between the diner and the location of the food serving device is collected based on the distance sensor of the food serving device; When the distance data of the diner is used to indicate that the diner's current distance exceeds the preset food serving distance, it is determined that the diner has finished serving food.

[0007] As an optional implementation, in a first aspect of the invention, when the face monitoring result of the diner is used to indicate that the face image of the diner has disappeared from the display, the method further includes: The first duration during which the facial image of the diner disappears from the display screen; When the first duration is greater than or equal to the first preset duration, the weight change of the food on the serving device is monitored to obtain the weight change monitoring result of the food. The start time of the first duration is determined based on the time when the face image of the diner disappears from the display. When the monitoring result of the change in food weight indicates that the weight of the food on the serving device has not changed for a second duration greater than or equal to a second preset duration, the operation of collecting distance data between the diners and the location of the serving device based on the distance sensor of the serving device is performed. The start time of the second duration is determined based on the time when the face image of the diners disappears from the display or based on the time when the first duration reaches the first preset duration.

[0008] As an optional implementation, in a first aspect of the invention, when the distance data of the diner is used to indicate that the diner's current distance exceeds a preset food serving distance, the method further includes: The change in weight of the dish served by the diner to the serving device during this serving is obtained; Based on the facial image of the diner and the dish identifier of the dish on the food serving device, the historical weight of the dish served by the diner on the food serving device is obtained. Calculate the absolute value of the weight difference between the changed weight of the food on the food dispensing device and the historical food dispensing weight; Determine whether the absolute value of the weight difference is within the preset weight difference range. If the result is yes, execute the operation of determining that the diner has finished getting their meal.

[0009] As an optional implementation, in a first aspect of the present invention, the method further includes: The target area where the face image of the diner appears on the display of the food serving device when the face image of the diner has not disappeared from the display of the food serving device. Based on the target area corresponding to the face image and the entire display area of ​​the display, determine whether the preset serving distance needs to be adjusted; When it is determined that the preset food serving distance does not need to be adjusted, the operation of collecting distance data between the diner and the location of the food serving equipment based on the distance sensor of the food serving equipment is performed.

[0010] As an optional implementation, in a first aspect of the present invention, the method further includes: When it is determined that the preset food serving distance needs to be adjusted, the distance correction parameters for the diner are determined based on the target area corresponding to the face image and the entire display area of ​​the monitor. Based on the distance correction parameters of the diners, the preset food serving distance is corrected, and the operation of collecting distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment is performed.

[0011] As an optional implementation, in a first aspect of the present invention, the entire display area of ​​the display is composed of an upper display area, a middle display area and a lower display area, and the distances between the upper display area, the middle display area and the lower display area and the bottom position of the serving device decrease in that order. The step of determining whether the preset serving distance needs to be adjusted based on the target area corresponding to the face image and the entire display area of ​​the display includes: Analyze the proportion of the target region corresponding to the face image in the upper display area and the middle display area, or the proportion of the target region in the upper display area and the lower display area. When the proportion of the upper display area is greater than the proportion of the middle display area, or when the proportion of the lower display area is greater than the proportion of the middle display area, it is determined that the preset serving distance needs to be adjusted. Wherein, when the proportion of the upper display area is greater than the proportion of the middle display area, the preset serving distance after adjustment is greater than the preset serving distance before adjustment; When the proportion of the lower display area is greater than the proportion of the middle display area, the adjusted preset serving distance is less than the original preset serving distance.

[0012] As an optional implementation, in a first aspect of the present invention, the method further includes: When the object sensor of the food serving device detects that a diner is approaching the food serving device within a preset distance range, the image acquisition device and display of the food serving device are activated. The object sensor of the food serving device includes a distance sensor and / or an infrared thermal imaging sensor. During the process of diners getting their meals, the image acquisition device captures the diners' facial images in real time and displays the captured facial images on the monitor in real time.

[0013] A second aspect of the present invention discloses an intelligent device for determining the end of food service, the device comprising: The monitoring module is used to monitor the face on the display of the food serving device based on the face image of the diner during the food serving process, and obtain the face monitoring result of the diner. The face of the diner is displayed on the display in real time during the food serving process. The food serving device contains food and the food is used for the diner to serve and eat. The data acquisition module is used to acquire distance data between the diner and the location of the food serving device based on the distance sensor of the food serving device when the face monitoring result of the diner indicates that the face image of the diner has disappeared from the display. The determination module is used to determine that the diner has finished getting food when the distance data of the diner indicates that the diner's current distance exceeds the preset food serving distance.

[0014] As an optional implementation, in a second aspect of the invention, the monitoring module is further configured to monitor a first duration for which the face image of the diner disappears from the display when the face monitoring result of the diner is used to indicate that the face image of the diner has disappeared from the display. The monitoring module is further configured to monitor the weight change of the food on the serving device and obtain a food weight change monitoring result when the first duration is greater than or equal to the first preset duration, wherein the start time of the first duration is determined based on the time when the face image of the diner disappears from the display; when the food weight change monitoring result indicates that the weight of the food on the serving device has not changed and the second duration is greater than or equal to the second preset duration, the acquisition module is triggered to perform the operation of acquiring distance data between the diner and the location of the serving device based on the distance sensor of the serving device, wherein the start time of the second duration is determined based on the time when the face image of the diner disappears from the display or based on the time when the first duration reaches the first preset duration.

[0015] As an optional implementation, in a second aspect of the invention, the apparatus further includes: The first acquisition module is used to acquire the change in weight of the dish that the diner picks up from the serving device this time when the distance data of the diner is used to indicate that the current distance of the diner exceeds the preset serving distance. The first acquisition module is further configured to acquire the historical weight of the food served by the diner on the food serving device based on the diner's facial image and the acquired food item identifier on the food serving device; The calculation module is used to calculate the absolute value of the weight difference between the changed weight of the food on the serving device and the historical serving weight; The first judgment module is used to determine whether the absolute value of the weight difference is within a preset weight difference range. When the judgment result is yes, the determination module is triggered to perform the operation of determining that the diner has finished getting their meal.

[0016] As an optional implementation, in a second aspect of the invention, the apparatus further includes: The second acquisition module is used to acquire the target area where the face image of the diner appears on the display of the food serving device when the face image of the diner has not disappeared from the display of the food serving device. The second judgment module is used to determine whether the preset food serving distance needs to be adjusted based on the target area corresponding to the face image and the entire display area of ​​the display. When it is determined that the preset food serving distance does not need to be adjusted, the acquisition module is triggered to perform the operation of acquiring distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment.

[0017] As an optional implementation, in a second aspect of the present invention, the determining module is further configured to, when it is determined that the preset serving distance needs to be adjusted, determine a distance correction parameter for the diner based on the target area corresponding to the face image and the entire display area of ​​the display. The device further includes: The correction module is used to perform a correction operation on the preset food serving distance based on the distance correction parameters of the diners, and to trigger the acquisition module to perform the operation of acquiring distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment.

[0018] As an optional implementation, in a second aspect of the present invention, the entire display area of ​​the display is composed of an upper display area, a middle display area and a lower display area, and the distance between the upper display area, the middle display area and the lower display area and the bottom position of the serving device decreases accordingly; The second judgment module determines, based on the target area corresponding to the face image and the entire display area of ​​the monitor, whether the specific method for adjusting the preset serving distance needs to be adjusted, including: Analyze the proportion of the target region corresponding to the face image in the upper display area and the middle display area, or the proportion of the target region in the upper display area and the lower display area. When the proportion of the upper display area is greater than the proportion of the middle display area, or when the proportion of the lower display area is greater than the proportion of the middle display area, it is determined that the preset serving distance needs to be adjusted. Wherein, when the proportion of the upper display area is greater than the proportion of the middle display area, the preset serving distance after adjustment is greater than the preset serving distance before adjustment; When the proportion of the lower display area is greater than the proportion of the middle display area, the adjusted preset serving distance is less than the original preset serving distance.

[0019] As an optional implementation, in a second aspect of the invention, the apparatus further includes: The wake-up module is used to wake up the image acquisition unit and display of the food serving equipment when the object sensor of the food serving equipment senses that a diner is approaching the food serving equipment within a preset distance range. The object sensor of the food serving equipment includes a distance sensor and / or an infrared thermal imaging sensor. The acquisition module is also used to acquire the face image of the diner in real time based on the image acquisition device during the diner's meal serving process; The display module is used to display the collected facial images of the diners on the monitor in real time.

[0020] A third aspect of the present invention discloses a food serving device, the food serving device comprising: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute some or all of the steps in any of the methods described in the first aspect of the present invention.

[0021] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute some or all of the steps in any of the methods described in the first aspect of the present invention.

[0022] Compared with the prior art, the present invention has the following beneficial effects: In this embodiment of the invention, during the process of a diner getting food, the face on the display of the food serving device is monitored based on the diner's facial image to obtain the diner's face monitoring result. The diner's face is displayed on the display in real time during the food serving process, and the food serving device contains food for the diner to eat. When the diner's face monitoring result indicates that the diner's facial image disappears from the display, the distance data between the diner and the location of the food serving device is collected based on the distance sensor of the food serving device. When the diner's distance data indicates that the diner's current distance exceeds the preset food serving distance, it is determined that the diner's food serving has ended. As can be seen, implementing this invention firstly determines whether a user is likely to finish ordering food by monitoring whether the facial image of the diner disappears from the display of the food dispensing device; then, it uses a distance sensor to collect distance data between the user and the device. If the distance exceeds the preset food dispensing distance, it finally confirms that the food dispensing has ended, thus improving the accuracy and real-time nature of the food dispensing end judgment, ensuring the accurate triggering of contactless payment settlement, and facilitating the monitoring of the next diner's food dispensing and the determination of the end of food dispensing, thereby optimizing the service efficiency and user experience of the self-service food dispensing terminal. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0024] Figure 1 This is a flowchart illustrating a method for intelligently determining the end of food ordering, as disclosed in an embodiment of the present invention. Figure 2 This is a flowchart illustrating another method for intelligently determining the end of food ordering, as disclosed in an embodiment of the present invention. Figure 3 This is a schematic diagram of the structure of an intelligent device for determining the end of meal service, as disclosed in an embodiment of the present invention. Figure 4 This is a schematic diagram of another intelligent device for determining the end of meal service, as disclosed in an embodiment of the present invention. Figure 5 This is a schematic diagram of the structure of a food serving device disclosed in an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0026] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0027] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will understand, explicitly and implicitly, that the embodiments described herein can be combined with other embodiments.

[0028] This invention discloses an intelligent method, device, and food dispensing equipment for determining when food dispensing has ended. First, it monitors whether the diner's facial image disappears from the display of the food dispensing equipment to preliminarily determine if the user is likely to have finished dispensing their food. Then, it uses a distance sensor to collect distance data between the user and the equipment. If the distance exceeds a preset dispensing distance, the dispensing is finally confirmed to be complete. This improves the accuracy and real-time nature of the dispensing end determination, ensures the precise triggering of contactless payment settlement, and facilitates the monitoring and dispensing end determination for the next diner, optimizing the service efficiency and user experience of self-service food dispensing terminals. Detailed descriptions follow.

[0029] Example 1 Please see Figure 1 , Figure 1 This is a flowchart illustrating a method for intelligently determining the end of food ordering, as disclosed in an embodiment of the present invention. Figure 1 The described method can be applied to scenarios requiring completion of meal service, such as school cafeterias and factory cafeterias. Figure 1 As shown, the method may include the following operations: 101. During the process of diners getting their meals, the face on the display screen of the food serving equipment is monitored based on the diners' facial images to obtain the diners' facial monitoring results. The diners' faces are displayed on the display screen in real time during the meal serving process. The food serving equipment contains food that is intended for diners to eat.

[0030] In this embodiment of the invention, the facial image of the diner can be captured by the image acquisition device on the food serving equipment, or by the image acquisition device in other locations.

[0031] 102. When the face monitoring results of diners are used to indicate that the face image of diners has disappeared from the display, the distance data between the diners and the location of the food serving equipment is collected based on the distance sensor of the food serving equipment.

[0032] In this embodiment of the invention, optionally, "disappearance" here can be understood as the face completely disappearing from the display, or as the face being represented as a dot on the display. Optionally, when the face monitoring result of the diner indicates that the diner's face image is still displayed on the display, step 101 continues to be executed.

[0033] 103. When the distance data of the diners is used to indicate that the current distance of the diners exceeds the preset food serving distance, it is determined that the diners have finished serving their food.

[0034] In this embodiment of the invention, when the distance data of the diners is used to indicate that the current distance of the diners is less than the preset food serving distance, step 102 is continued.

[0035] It is evident that implementation Figure 1 The described method first monitors whether the user's facial image on the food dispensing device's display disappears to preliminarily determine whether the user is likely to finish dispensing their food. Then, it uses a distance sensor to collect distance data between the user and the device. If the distance exceeds the preset food dispensing distance, it finally confirms that the food dispensing has ended. This improves the accuracy and real-time nature of the food dispensing end judgment, ensures the accurate triggering of contactless payment settlement, and facilitates the monitoring and dispensing end judgment of the next user, thus optimizing the service efficiency and user experience of the self-service food dispensing terminal.

[0036] In an optional embodiment, when the face detection results of a diner are used to indicate that the diner's face image has disappeared from the display, the method may further include the following steps: The first duration (e.g., 5 seconds) during which the facial images of diners disappear from the display is monitored, wherein the start time of the first duration is determined based on the time when the facial images of diners are detected to disappear from the display; When the first duration is greater than or equal to the first preset duration, the weight change of the food on the serving device is monitored to obtain the weight change monitoring results of the food; When the monitoring result of the change in food weight is used to indicate that the weight of the food on the serving device has not changed for a second duration greater than or equal to a second preset duration (e.g., 5 seconds), the operation of collecting distance data between the diners and the location of the serving device based on the distance sensor of the serving device is performed. The start time of the second duration is determined based on the time when the diners' face image disappears from the display or based on the time when the first duration reaches the first preset duration.

[0037] In this optional embodiment, the start time of the first duration is determined based on the moment when the face image of the diner disappears from the display. This can be understood as taking the moment when the face image of the diner disappears from the display as the start time of the first duration, or N seconds after the disappearance moment, such as 1 second.

[0038] In this optional embodiment, multiple pressure sensors are installed under the food placement area on the serving device. By detecting the pressure changes sensed by the multiple pressure sensors, the change in the weight of the food on the serving device is determined.

[0039] As can be seen, this optional embodiment uses the disappearance of the diner's face from the display as the initial signal, sets a first duration to filter out short-lived disappearance scenarios (such as looking down to pick up a phone), then monitors weight changes through a pressure sensor under the food, and verifies weight stability with a second duration to rule out the possibility of the diner still taking food; finally, it links a distance sensor to confirm that the user has exceeded the preset food serving distance, forming a multi-dimensional cross-verification, which greatly improves the accuracy of food serving completion judgment, reduces misjudgments caused by a single sensor (such as using only distance or face), and at the same time, automatic and accurate judgment reduces human intervention, speeds up the release speed of food serving equipment, and facilitates seamless connection of subsequent settlement, tableware collection, equipment scheduling and other links, thereby improving the accuracy and orderliness of dining management in canteens, smart restaurants and other scenarios.

[0040] In another optional embodiment, when the diner's distance data is used to indicate that the diner's current distance exceeds a preset food serving distance, the method may further include the following steps: Obtain the change in weight of the dish served by the diner at the food dispensing equipment during this serving; Based on the facial images of diners and the dish labels obtained from the food dispensing equipment, the historical weight of the dishes dispensed by the diners on the food dispensing equipment is obtained; Calculate the absolute value of the weight difference between the changed weight of the food on the serving equipment and the historical serving weight; The system determines whether the absolute value of the weight difference is within a preset weight difference range, such as 10g. If the result is yes, it executes the operation to confirm that the diner has finished getting their food. Furthermore, if the result is no, it can output a confirmation message to the diner that they have finished getting their food. When a confirmation message is detected from the diner, such as a triggered confirmation button on the display or the diner typing the word "end," the system executes the operation to confirm that the diner has finished getting their food.

[0041] In this optional embodiment, the portion of food taken by the diner is the weight of the food reduced from the serving device. By analyzing the weight reduction of the food on the serving device, the change in weight of the food taken by the diner from the serving device can be obtained.

[0042] In this optional embodiment, based on the diner's facial image and the obtained dish identifiers on the serving device, the historical weight of the dishes served by the diner is obtained. Specifically: based on the diner's facial image, the diner's identity identifier is obtained, and based on the relationship between identity identifier, dish identifier, and dish weight, the historical weight of the dishes served corresponding to the dish identifiers on the serving device is filtered from all the diner's historical dish identifiers. This can be done by statistically analyzing the historical weight of dishes served over a certain period of time, such as tracing back 30 days from the current day. The historical weight of dishes served can be the weight of a single serving of that dish within that period, or the average historical weight of all servings of that dish within that period.

[0043] As can be seen, when this optional embodiment detects that a diner has exceeded the distance sensing area of ​​the food dispensing equipment, it further associates the diner's identity with their facial image, extracts the historical weight of the corresponding dish based on the dish identifier, and calculates the absolute value of the difference between the historical weight and the weight of the dish being dispensed. If the difference is within a preset range, it indicates that the portion size is in line with the user's usual habits, and the system automatically confirms the end of the dispensing process, reducing potential misjudgments based on a single distance. If the user temporarily moves away but does not complete a reasonable portion size, and the difference exceeds the range (e.g., due to changes in the user's needs today leading to an abnormal portion size), the system guides the user to manually confirm via a button on the display or text input. This respects the user's individual needs while preventing a poor user experience caused by the system forcibly ending the dispensing process. It not only significantly reduces the misjudgment rate of dispensing end but also enhances user autonomy and satisfaction through a flexible interaction mechanism. At the same time, accurate end judgment ensures smooth connection of subsequent settlement, equipment scheduling, and other processes, thereby improving the accuracy and orderliness of dining management in scenarios such as canteens and smart restaurants.

[0044] In yet another optional embodiment, the method may further include the following steps: When it is determined that the absolute value of the weight difference is not within the preset weight difference range and the weight taken by the diner this time is less than a preset multiple of the historical weight, such as 0.3 times, it is determined whether there are any new dishes added that day. When a new dish is detected, determine whether any inquiries from diners regarding the new dish are detected. When a food order inquiry is detected, the system retrieves the food data for the new food item and the food data from the serving device. Based on the dish data of both, analyze the similarity of the dishes and determine whether the similarity is greater than or equal to the preset similarity. When it is determined that the similarity is greater than or equal to the preset similarity, the process of determining the diners and ending the meal service is executed.

[0045] In this optional embodiment, the dish data may include one or more of the following: dish name, dish flavor, dish color, and dish nutrition.

[0046] In this optional embodiment, if no new dishes are served, or if no inquiry from the diners regarding new dishes is detected, the system outputs a confirmation message indicating that the meal service is complete to the diners.

[0047] For example, if a diner only takes 30g of scrambled eggs with tomatoes, while their usual portion size is 150g, the absolute weight difference is 150g - 30g = 120g, far exceeding the preset range. Furthermore, the system detects a new dish, braised beef brisket with tomatoes, and records the diner asking before taking their food if there were any new dishes available. The system then retrieves the data for both dishes: scrambled eggs with tomatoes: a home-style dish, sweet and sour, containing egg protein; braised beef brisket with tomatoes: a home-style dish, sweet and sour, containing beef protein. The preset similarity threshold is 65%. The calculated similarity is 82%, both being sweet and sour and containing tomatoes, exceeding the 65% threshold. Therefore, the two dishes are considered similar, and the diner's decision to reduce their portion size due to trying the new braised beef brisket with tomatoes is accepted. The food order is then completed.

[0048] As can be seen, when implementing this optional embodiment determines that the weight of the food ordered by the diner this time is much less than the historical weight, it further checks whether a new dish is currently being served. If so, it continues to analyze the similarity between the two dishes. Only when they are relatively similar can it be determined that the diner's meal ordering has ended. Furthermore, when a new dish is detected, it first determines whether the diner has inquired about the new dish. If so, it continues to analyze the similarity between the two dishes. That is, through cross-validation of historical weight comparison, new dish-related inquiries, and similarity analysis, it reduces the possibility that the diner may mistakenly believe that the meal ordering has not ended due to ordering less food to try new dishes, thus further improving the accuracy and reliability of the judgment that the meal ordering has ended. In addition, for special behaviors of diners who want to try new dishes, such as reducing the original portion size, it can determine the personalized dietary needs of diners through dish similarity and improve the user's dining experience.

[0049] In yet another optional embodiment, the method may further include the following steps: When the object sensor of the food serving equipment detects that a diner is approaching the food serving equipment within a preset distance range, such as 0.4m-1.2m from the display of the food serving equipment, the image acquisition unit and display of the food serving equipment are activated. The object sensor of the food serving equipment includes a distance sensor and / or an infrared thermal imaging sensor. During the process of diners getting their meals, facial images of diners are captured in real time by an image acquisition device and displayed on a monitor.

[0050] As can be seen, this optional embodiment, through an object sensor composed of a distance sensor and an infrared thermal imaging sensor, automatically wakes up the image acquisition device and display when diners enter the preset range, achieving multiple benefits of energy saving, experience optimization, and process intelligence. It reduces the power consumption of the image acquisition device and display during long standby periods, effectively reducing equipment energy consumption and extending component lifespan; and real-time display of faces allows users to intuitively confirm their identity and association status, reducing manual operation steps and improving the convenience of interaction. Furthermore, the automatic triggering of equipment startup and collection of facial data helps to further improve the accuracy and reliability of subsequent food portion statistics and termination judgment.

[0051] Example 2 Please see Figure 2 , Figure 2 This is a flowchart illustrating another method for intelligently determining the end of food ordering, as disclosed in an embodiment of the present invention. Figure 2 The described method can be applied to scenarios requiring completion of meal service, such as school cafeterias and factory cafeterias. Figure 2 As shown, the method may include the following operations: 201. During the process of diners getting their meals, the face on the display of the food serving equipment is monitored based on the diners' facial images to obtain the diners' facial monitoring results. The diners' faces are displayed on the display in real time during the meal serving process. The food serving equipment contains food that is intended for diners to eat.

[0052] 202. When the face image of a diner does not disappear from the display of the food serving equipment, the target area where the face image of the diner appears on the display of the food serving equipment.

[0053] 203. Based on the target area corresponding to the face image and the entire display area of ​​the monitor, determine whether the preset serving distance needs to be adjusted; if it is determined that the preset serving distance does not need to be adjusted, proceed to step 204; if it is determined that the preset serving distance needs to be adjusted, proceed to step 206.

[0054] 204. When the face monitoring results of diners are used to indicate that the face image of diners has disappeared from the display, the distance data between the diners and the location of the food serving equipment is collected based on the distance sensor of the food serving equipment.

[0055] 205. When the distance data of the diners is used to indicate that the current distance of the diners exceeds the preset food serving distance, it is determined that the diners have finished serving their food.

[0056] 206. Determine the distance correction parameters for diners based on the target area corresponding to the face image and the entire display area of ​​the monitor.

[0057] 207. Based on the distance correction parameters of the diners, perform a correction operation on the preset food serving distance, and proceed to step 204.

[0058] In this embodiment of the invention, for a detailed description of steps 201, 204, and 205, please refer to the other descriptions of steps 101-103 in Embodiment 1. This embodiment of the invention will not repeat them.

[0059] It is evident that implementation Figure 2The described method first monitors whether the user's facial image disappears from the display of the food dispensing device to preliminarily determine if the user is likely to finish dispensing their food. Then, a distance sensor collects distance data between the user and the device. If the distance exceeds a preset dispensing distance, the dispensing process is confirmed to be complete, improving the accuracy and real-time nature of the dispensing completion determination, ensuring precise triggering of contactless payment settlement, and facilitating the monitoring and completion determination of the next user's dispensing, thus optimizing the service efficiency and user experience of the self-service food dispensing terminal. Furthermore, during the dispensing process, by analyzing the area of ​​the face on the display and the overall display area, the preset dispensing distance is dynamically adapted to each user, improving the accuracy of the dispensing device's dispensing completion sensing distance. It intelligently adapts to the user's position and height, reducing interruptions to the dispensing process due to distance misjudgments, further enhancing the accuracy and reliability of the dispensing completion determination.

[0060] In this embodiment of the invention, optionally, the entire display area of ​​the display consists of an upper display area, a middle display area, and a lower display area, and the distance between the upper display area, the middle display area, and the lower display area and the bottom position of the serving device decreases accordingly; Among these steps, based on the target area corresponding to the facial image and the entire display area of ​​the monitor, it is determined whether the preset serving distance needs to be adjusted, including: Analyze the proportion of the target region corresponding to the face image in the upper and middle display areas, or the proportion of the target region in the upper and lower display areas. When the proportion of the upper display area is greater than that of the middle display area, or when the proportion of the lower display area is greater than that of the middle display area, it is determined that the preset serving distance needs to be adjusted. Among them, when the proportion of the upper display area is greater than that of the middle display area, the adjusted preset serving distance is greater than the original preset serving distance; When the current display area occupies a larger proportion than the central display area, the adjusted preset serving distance will be less than the original preset serving distance.

[0061] In this embodiment of the invention, an example is given. Assume that the initial preset food serving distance is 1 meter. The display is vertically divided into three equal areas: upper, middle, and lower, each occupying 1 / 3 of the space. The distances from the bottom of the device are 1.5m, 1.2m, and 0.9m, respectively. For a tall diner, such as 185cm tall, standing at 1 meter to serve food, the face image is mainly displayed in the upper area of ​​the display. At this time, the upper area accounts for 60%, the middle area for 30%, and the lower area for 10%. The system automatically detects that the upper area accounts for more than the middle area. At this point, it is determined that the preset food serving distance needs to be adjusted from 1 meter to 1.2 meters. For shorter diners, such as children 120cm tall, standing 0.8 meters to get their food, the facial image is concentrated in the lower area of ​​the monitor. At this time, the lower area accounts for 55%, the middle area 35%, and the upper area 10%. The system automatically detects that the lower area accounts for more than the middle area and adjusts the preset food-getting distance from 1 meter to 0.7 meters. For diners of average height, such as 165cm tall, standing 1 meter to get their food, the facial image is mainly distributed in the middle area. At this time, the middle area accounts for 60%, the upper area 25%, and the lower area 15%. The system automatically determines that there is no need to adjust the preset distance and keeps it unchanged at 1 meter.

[0062] As can be seen, the embodiments of the present invention can also divide the entire display area of ​​the display into three sub-display areas: upper, middle, and lower. The invention automatically compares and analyzes the proportion of the diner's face on the display with that of the three sub-display areas, improving the accuracy of determining the preset serving distance. Based on the proportion of the face with the three sub-display areas, appropriate parameters are selected to adjust the preset serving distance, achieving dynamic adaptation to meet the needs of diners of different heights. This improves the accuracy of adjusting the preset serving distance, reduces misjudgments of serving completion due to diners being too tall or too short, and further enhances the accuracy and reliability of determining when a diner has finished serving. This further improves the accuracy and reliability of subsequent automatic settlement or serving monitoring and serving completion monitoring for the next diner.

[0063] Example 3 Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of an intelligent device for determining the end of meal service, as disclosed in an embodiment of the present invention. Figure 3 The described device can be applied to scenarios requiring completion of meal service, such as school cafeterias and factory cafeterias. Figure 3 As shown, the device may include: The monitoring module 301 is used to monitor the face on the display of the food serving device based on the face image of the diner during the process of the diner serving food, and obtain the face monitoring result of the diner. The diner's face is displayed on the display in real time during the process of serving food. The food serving device contains food and the food is used for the diner to serve food. The acquisition module 302 is used to acquire distance data between the diner and the location of the food serving device based on the distance sensor of the food serving device when the face monitoring result of the diner is used to indicate that the face image of the diner has disappeared from the display. The determination module 303 is used to determine that the diner has finished getting food when the diner's distance data indicates that the diner's current distance exceeds the preset food serving distance.

[0064] In this embodiment of the invention, the facial image of the diner can be captured by the image acquisition device on the food serving equipment, or by the image acquisition device in other locations.

[0065] In this embodiment of the invention, optionally, "disappearance" here can be understood as the face completely disappearing from the display, or as the face being represented as a dot on the display. Optionally, when the face monitoring result of the diner indicates that the diner's face image is still displayed on the display, the monitoring module 301 is further triggered to perform face monitoring on the display of the food serving device based on the diner's face image, thereby obtaining the diner's face monitoring result.

[0066] In this embodiment of the invention, when the distance data of the diners is used to indicate that the current distance of the diners is less than the preset food serving distance, the acquisition module 302 is triggered to continue to collect the distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment.

[0067] It is evident that implementation Figure 3 The described device first monitors whether the face image of the diner disappears from the display of the food dispensing equipment to preliminarily determine whether the user is likely to finish dispensing their food. Then, it uses a distance sensor to collect distance data between the user and the equipment. If the distance exceeds the preset food dispensing distance, it finally confirms that the food dispensing has ended. This improves the accuracy and real-time nature of the food dispensing end judgment, ensures the accurate triggering of contactless payment settlement, and facilitates the monitoring and food dispensing end judgment of the next diner, thus optimizing the service efficiency and user experience of the self-service food dispensing terminal.

[0068] In an optional embodiment, such as Figure 3As shown, the monitoring module 301 is further configured to monitor a first duration for which the face image of a diner disappears from the display when the face monitoring result of the diner is used to indicate that the face image of the diner has disappeared from the display, wherein the start time of the first duration is determined based on the time when the face image of the diner is detected to have disappeared from the display. The monitoring module 301 is also used to monitor the weight change of the dishes on the serving device when the first duration is greater than or equal to the first preset duration, and obtain the weight change monitoring result of the dishes; when the weight change monitoring result of the dishes indicates that the weight of the dishes on the serving device has not changed for a second duration greater than or equal to the second preset duration, the acquisition module 302 is triggered to perform the operation of collecting distance data between the diners and the location of the serving device based on the distance sensor of the serving device, wherein the start time of the second duration is determined based on the time when the face image of the diners disappears from the display or based on the time when the first duration reaches the first preset duration.

[0069] In this optional embodiment, the start time of the first duration is determined based on the moment when the face image of the diner disappears from the display. This can be understood as taking the moment when the face image of the diner disappears from the display as the start time of the first duration, or N seconds after the disappearance moment, such as 1 second.

[0070] In this optional embodiment, multiple pressure sensors are installed under the food placement area on the serving device. By detecting the pressure changes sensed by the multiple pressure sensors, the change in the weight of the food on the serving device is determined.

[0071] It is evident that implementation Figure 3 The described device uses the disappearance of a diner's face from the display as the initial signal, sets a first duration to filter out brief disappearance scenarios (such as looking down to pick up a phone), then monitors weight changes through a pressure sensor under the food, and verifies weight stability with a second duration to rule out the possibility of the diner still taking food; finally, it links with a distance sensor to confirm that the user has exceeded the preset food serving distance, forming a multi-dimensional cross-verification, which greatly improves the accuracy of food serving completion judgment, reduces false judgments caused by a single sensor (such as using only distance or face), and at the same time, automatic and accurate judgment reduces human intervention, speeds up the release speed of food serving equipment, and facilitates seamless connection of subsequent settlement, tableware collection, equipment scheduling and other links, thereby improving the accuracy and orderliness of dining management in canteens, smart restaurants and other scenarios.

[0072] In another alternative embodiment, such as Figure 4 As shown, the device may also include; The first acquisition module 304 is used to acquire the change in weight of the dish when the distance data of the diner is used to indicate that the current distance of the diner exceeds the preset food serving distance. The first acquisition module 304 is also used to acquire the historical weight of the food served by the diner on the food serving device based on the diner's facial image and the food item identification on the food serving device. Calculation module 305 is used to calculate the absolute value of the weight difference between the changed weight of the food on the serving device and the historical serving weight; The first judgment module 306 is used to determine whether the absolute value of the weight difference is within a preset weight difference range. When the judgment result is yes, the confirmation module 303 is triggered to perform the operation of confirming that the diner has finished serving their meal. Further, when the judgment result is no, a confirmation operation of finishing serving the meal can be output to the diner. When the confirmation of finishing serving the meal is detected by the diner, such as the confirmation button on the display being triggered, or the word "finish" being entered by the diner, the confirmation module 303 is triggered to perform the operation of confirming that the diner has finished serving their meal.

[0073] In this optional embodiment, the portion of food taken by the diner is the weight of the food reduced from the serving device. By analyzing the weight reduction of the food on the serving device, the change in weight of the food taken by the diner from the serving device can be obtained.

[0074] In this optional embodiment, the first acquisition module 304 acquires the historical weight of dishes served by the diner on the serving device based on the diner's facial image and the acquired dish identifiers on the serving device. Specifically, based on the diner's facial image, the module acquires the diner's identity identifier, and based on the relationship between the identity identifier, dish identifier, and dish weight, it filters the historical weights corresponding to the dish identifiers corresponding to the serving device from all the diner's historical dish identifiers. This can be done by statistically analyzing historical weights over a certain period, such as tracing back 30 days from the current day. The historical weight can be the weight of a single serving of that dish within that period, or the average historical weight of all servings of that dish within that period.

[0075] It is evident that implementation Figure 4The described device, when detecting that a diner has exceeded the distance sensing area of ​​the food dispensing equipment, further associates the diner's identity with their facial image, extracts the historical weight of the corresponding dish based on the dish's identifier, and calculates the absolute value of the difference between the historical weight and the current weight. If the difference is within a preset range, it indicates that the portion size conforms to the user's usual habits, and the system automatically confirms the end of the dispensing process, reducing potential misjudgments based on distance alone. If the user temporarily moves away but does not complete a reasonable portion, and the difference exceeds the range (e.g., due to changes in the user's needs), the system guides the user to manually confirm via a button on the display or text input. This respects the user's individual needs while preventing a poor user experience caused by the system forcibly ending the dispensing process. It not only significantly reduces the misjudgment rate of dispensing end but also enhances user autonomy and satisfaction through a flexible interaction mechanism. At the same time, accurate end judgment ensures smooth connection of subsequent settlement, equipment scheduling, and other processes, thereby improving the accuracy and orderliness of dining management in scenarios such as canteens and smart restaurants.

[0076] In yet another alternative embodiment, such as Figure 4 As shown, the first acquisition module 304 is also used to determine whether there are any new dishes on the day when it is determined that the absolute value of the weight difference is not within the preset weight difference range and the weight taken by the diner this time is less than a preset multiple of the historical weight, such as 0.3 times. The first judgment module 306 is also used to determine whether a diner's inquiry about the new dish is detected when it is determined that a new dish exists; The first acquisition module 304 is also used to acquire the dish data of the new dish and the dish data of the dish on the serving device when it is determined that a dish query has been detected. The first judgment module 306 is also used to analyze the similarity of the dishes of the two based on the dish data of the two, and to determine whether the similarity of the dishes is greater than or equal to the preset similarity of the dishes. When it is determined that the similarity of the dishes is greater than or equal to the preset similarity of the dishes, the determination module 303 is triggered to execute the determination of the end of the meal service for the diners.

[0077] In this optional embodiment, the dish data may include one or more of the following: dish name, dish flavor, dish color, and dish nutrition.

[0078] In this optional embodiment, if no new dishes are served, or if no inquiry from the diners regarding new dishes is detected, the system outputs a confirmation message indicating that the meal service is complete to the diners.

[0079] For example, if a diner only takes 30g of scrambled eggs with tomatoes, while their usual portion size is 150g, the absolute weight difference is 150g - 30g = 120g, far exceeding the preset range. Furthermore, the system detects a new dish, braised beef brisket with tomatoes, and records the diner asking before taking their food if there were any new dishes available. The system then retrieves the data for both dishes: scrambled eggs with tomatoes: a home-style dish, sweet and sour, containing egg protein; braised beef brisket with tomatoes: a home-style dish, sweet and sour, containing beef protein. The preset similarity threshold is 65%. The calculated similarity is 82%, both being sweet and sour and containing tomatoes, exceeding the 65% threshold. Therefore, the two dishes are considered similar, and the diner's decision to reduce their portion size due to trying the new braised beef brisket with tomatoes is accepted. The food order is then completed.

[0080] It is evident that implementation Figure 4 The described device, when determining that the weight of the food ordered by a diner is significantly less than the historical weight, further checks whether a new dish is currently being served. If so, it analyzes the similarity between the two dishes. Only when they are relatively similar can the device determine that the diner's meal ordering has ended. Furthermore, upon detecting the presence of a new dish, it first determines whether the diner has inquired about it. If so, it continues to analyze the similarity between the two dishes. This cross-validation, through historical weight comparison, inquiries related to the new dish, and similarity analysis, reduces the likelihood of diners mistakenly believing their meal ordering is not finished due to ordering less food to try a new dish, thus improving the accuracy and reliability of the ordering completion determination. Additionally, it addresses special behaviors of diners wanting to try new dishes, such as reducing the original portion size, by using dish similarity to determine and match the diner's personalized dietary needs, enhancing the user's dining experience.

[0081] In yet another alternative embodiment, such as Figure 4 As shown, the second acquisition module 307 is used to acquire the target area where the face image of the diner appears on the display of the food serving device when the face image of the diner has not disappeared from the display of the food serving device. The second judgment module 308 is used to determine whether the preset food serving distance needs to be adjusted based on the target area corresponding to the face image and the entire display area of ​​the display. When it is determined that the preset food serving distance does not need to be adjusted, the acquisition module 302 is triggered to perform the operation of acquiring distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment. The determination module 303 is also used to determine the distance correction parameters for diners based on the target area corresponding to the face image and the entire display area of ​​the monitor when it is determined that the preset food serving distance needs to be adjusted. like Figure 4 As shown, the device may further include: The correction module 309 is used to perform a correction operation on the preset food serving distance based on the distance correction parameters of the diners, and to trigger the acquisition module 302 to perform the operation of collecting distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment.

[0082] It is evident that implementation Figure 4 The described device analyzes the area of ​​a person's face on the display screen and the overall display area during the meal serving process. It dynamically adapts the preset meal serving distance to each person, improving the accuracy of determining the sensing distance at the end of meal serving. It intelligently adapts to the person's position and height, reducing interruptions in the meal serving process due to misjudgment of distance, and further improving the accuracy and reliability of judging the end of meal serving.

[0083] In this optional embodiment, the entire display area of ​​the display consists of an upper display area, a middle display area, and a lower display area, and the distance between the upper display area, the middle display area, and the lower display area and the bottom position of the serving device decreases accordingly; The second judgment module 308 determines, based on the target area corresponding to the face image and the entire display area of ​​the monitor, whether the preset serving distance needs to be adjusted, including: Analyze the proportion of the target region corresponding to the face image in the upper and middle display areas, or the proportion of the target region in the upper and lower display areas. When the proportion of the upper display area is greater than that of the middle display area, or when the proportion of the lower display area is greater than that of the middle display area, it is determined that the preset serving distance needs to be adjusted. Among them, when the proportion of the upper display area is greater than that of the middle display area, the adjusted preset serving distance is greater than the original preset serving distance; When the current display area occupies a larger proportion than the central display area, the adjusted preset serving distance will be less than the original preset serving distance.

[0084] The food dispenser is vertically divided into three equal areas: upper, middle, and lower, each occupying 1 / 3 of the space. The distances from the bottom of the device are 1.5m, 1.2m, and 0.9m, respectively. For tall diners, such as those who are 185cm tall, standing 1 meter away from the food dispenser, their facial image is mainly displayed on the upper area of ​​the monitor. At this time, the upper area occupies 60%, the middle area 30%, and the lower area 10%. The system automatically detects that the upper area occupies more than the middle area and determines that the preset food dispensing distance needs to be adjusted from 1 meter to 1.2 meters. For shorter diners, such as children 120cm tall, standing 0.8 meters to get their food, the facial image is concentrated in the lower area of ​​the monitor. At this time, the lower area accounts for 55%, the middle area 35%, and the upper area 10%. The system automatically detects that the lower area accounts for more than the middle area and adjusts the preset food-getting distance from 1 meter to 0.7 meters. For diners of average height, such as 165cm tall, standing 1 meter to get their food, the facial image is mainly distributed in the middle area. At this time, the middle area accounts for 60%, the upper area 25%, and the lower area 15%. The system automatically determines that there is no need to adjust the preset distance and keeps it unchanged at 1 meter.

[0085] It is evident that implementation Figure 4 The described device divides the entire display area of ​​the screen into three sub-display areas: upper, middle, and lower. It automatically compares and analyzes the proportion of the diner's face on the screen with that of the three sub-display areas, improving the accuracy of determining the preset serving distance. Based on the proportion of the face with the three sub-display areas, it selects appropriate parameters to adjust the preset serving distance, achieving dynamic adaptation to accommodate diners of different heights. This improves the accuracy of the preset serving distance adjustment, reduces misjudgments of serving completion due to diners being too tall or too short, and further enhances the accuracy and reliability of determining when a diner has finished serving. This also improves the accuracy and reliability of subsequent automatic settlement or serving and serving monitoring for the next diner.

[0086] In yet another alternative embodiment, such as Figure 4 As shown, the device may further include: The wake-up module 310 is used to wake up the image acquisition unit and display of the food serving equipment when the object sensor of the food serving equipment senses that a diner is approaching the food serving equipment within a preset distance range. The object sensor of the food serving equipment includes a distance sensor and / or an infrared thermal imaging sensor. The acquisition module 302 is also used to acquire facial images of diners in real time based on the image acquisition device during the process of diners getting their meals. Display module 311 is used to display the collected facial images of diners on a monitor in real time.

[0087] It is evident that implementation Figure 4The described device uses an object sensor composed of a distance sensor and an infrared thermal imaging sensor to automatically wake up the image acquisition unit and display when diners enter a preset range. This achieves multiple benefits, including energy saving, user experience optimization, and process intelligence. It reduces the power consumption of the image acquisition unit and display during long standby periods, effectively lowering energy consumption and extending component lifespan. Real-time facial recognition allows users to intuitively confirm their identity and associated status, reducing manual operation steps and improving interaction convenience. Automatically triggering device startup and facial data collection further improves the accuracy and reliability of subsequent food portion control and termination decisions.

[0088] Example 4 Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a food serving device disclosed in an embodiment of the present invention. Figure 5 The described device can be applied to scenarios requiring completion of meal service, such as school cafeterias and factory cafeterias. Figure 5 As shown, the food serving device may include: Memory 401 storing executable program code; Processor 402 coupled to memory 401; The processor 402 calls the executable program code stored in the memory 401 to execute some or all of the steps in any of the intelligent judgment methods for the end of meal ordering in Embodiment 1 of the present invention.

[0089] Example 5 This invention discloses a computer storage medium storing computer instructions. When these computer instructions are invoked, they are used to execute some or all of the steps in any of the intelligent methods for determining the end of meal ordering disclosed in Embodiment 1 of this invention.

[0090] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0091] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0092] Finally, it should be noted that the above embodiments are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for intelligently determining when food ordering has ended, characterized in that, The method includes: During the process of diners getting their meals, the face on the display of the food serving device is monitored based on the diners' facial images to obtain the diners' facial monitoring results. The diners' faces are displayed on the display in real time during the meal serving process. The food serving device contains dishes for the diners to eat. When the face detection result of the diner is used to indicate that the face image of the diner has disappeared from the display, the distance data between the diner and the location of the food serving device is collected based on the distance sensor of the food serving device; When the distance data of the diner is used to indicate that the diner's current distance exceeds the preset food serving distance, it is determined that the diner has finished serving food.

2. The method according to claim 1, characterized in that, When the face detection result of the diner is used to indicate that the face image of the diner has disappeared from the display, the method further includes: The first duration of the monitoring of the disappearance of the face image of the diner from the display is determined based on the time when the face image of the diner is detected to have disappeared from the display; When the first duration is greater than or equal to the first preset duration, the weight change of the food on the serving device is monitored to obtain the food weight change monitoring result; When the monitoring result of the change in food weight indicates that the weight of the food on the serving device has not changed for a second duration greater than or equal to a second preset duration, the operation of collecting distance data between the diners and the location of the serving device based on the distance sensor of the serving device is performed. The start time of the second duration is determined based on the time when the face image of the diners disappears from the display or based on the time when the first duration reaches the first preset duration.

3. The method according to claim 1 or 2, characterized in that, When the distance data of the diner is used to indicate that the diner's current distance exceeds the preset food serving distance, the method further includes: The change in weight of the dish served by the diner to the serving device during this serving is obtained; Based on the facial image of the diner and the dish identifier of the dish on the food serving device, the historical weight of the dish served by the diner on the food serving device is obtained. Calculate the absolute value of the weight difference between the changed weight of the food on the food dispensing device and the historical food dispensing weight; Determine whether the absolute value of the weight difference is within the preset weight difference range. If the result is yes, execute the operation of determining that the diner has finished getting their meal.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The target area where the face image of the diner appears on the display of the food serving device when the face image of the diner has not disappeared from the display of the food serving device. Based on the target area corresponding to the face image and the entire display area of ​​the display, determine whether the preset serving distance needs to be adjusted; When it is determined that the preset food serving distance does not need to be adjusted, the operation of collecting distance data between the diner and the location of the food serving equipment based on the distance sensor of the food serving equipment is performed.

5. The method according to claim 4, characterized in that, The method further includes: When it is determined that the preset food serving distance needs to be adjusted, the distance correction parameters for the diner are determined based on the target area corresponding to the face image and the entire display area of ​​the monitor. Based on the distance correction parameters of the diners, the preset food serving distance is corrected, and the operation of collecting distance data between the diners and the location of the food serving equipment based on the distance sensor of the food serving equipment is performed.

6. The method according to claim 5, characterized in that, The entire display area of ​​the display consists of an upper display area, a middle display area, and a lower display area, and the distances between the upper display area, the middle display area, and the lower display area and the bottom of the serving device decrease in that order. The step of determining whether the preset serving distance needs to be adjusted based on the target area corresponding to the face image and the entire display area of ​​the display includes: Analyze the proportion of the target region corresponding to the face image in the upper display area and the middle display area, or the proportion of the target region in the upper display area and the lower display area. When the proportion of the upper display area is greater than the proportion of the middle display area, or when the proportion of the lower display area is greater than the proportion of the middle display area, it is determined that the preset serving distance needs to be adjusted. Wherein, when the proportion of the upper display area is greater than the proportion of the middle display area, the preset serving distance after adjustment is greater than the preset serving distance before adjustment; When the proportion of the lower display area is greater than the proportion of the middle display area, the adjusted preset serving distance is less than the original preset serving distance.

7. The method according to any one of claims 1-3, 5, and 6, characterized in that, The method further includes: When the object sensor of the food serving device detects that a diner is approaching the food serving device within a preset distance range, the image acquisition device and display of the food serving device are activated. The object sensor of the food serving device includes a distance sensor and / or an infrared thermal imaging sensor. During the process of diners getting their meals, the image acquisition device captures the diners' facial images in real time and displays the captured facial images on the monitor in real time.

8. A device for intelligently determining the end of meal service, characterized in that, The device includes: The monitoring module is used to monitor the face on the display of the food serving device based on the face image of the diner during the food serving process, and obtain the face monitoring result of the diner. The face of the diner is displayed on the display in real time during the food serving process. The food serving device contains food and the food is used for the diner to serve and eat. The data acquisition module is used to acquire distance data between the diner and the location of the food serving device based on the distance sensor of the food serving device when the face monitoring result of the diner indicates that the face image of the diner has disappeared from the display. The determination module is used to determine that the diner has finished getting food when the distance data of the diner indicates that the diner's current distance exceeds the preset food serving distance.

9. A food serving device, characterized in that, The food serving equipment includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the intelligent determination method for the end of food ordering as described in any one of claims 1-7.

10. A computer storage medium, characterized in that, The computer storage medium stores computer instructions, which, when invoked, are used to execute the intelligent determination method for the end of meal service as described in any one of claims 1-7.

Images