Water outlet method and system based on face payment, medium and beverage equipment

Through the water effluent method based on face payment, combined with user input and behavioral analysis, the vending machine has realized the water effluent based on user needs, solving the problem of insufficient or excessive net beverage content in the existing technology, reducing waste and pollution, and improving user experience And improve service efficiency.

CN118942182APending Publication Date: 2024-11-12SURFSUN HOME APPLIANCES (NINGBO) MANUFACTURING CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202410944616.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing vending machines can only provide fixed bottled beverages, resulting in insufficient or excessive net content of beverages, affecting the user experience, and having problems with waste and pollution.

Method used

Using a water effluent method based on face payment, the face images are collected through the camera for verification, combined with user input operations and behavioral analysis, the beverage equipment is controlled to provide personalized beverage services according to the user's needs, including type, net content and temperature. .

Benefits of technology

It realizes the generation of beverages based on the actual needs of users, meets the needs of different users, reduces waste and pollution, improves user experience, and quickly prepares beverages in the case of multiple people, and improves service efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118942182A_ABST
    Figure CN118942182A_ABST
Patent Text Reader

Abstract

The invention relates to a face payment water outlet method and system, a medium and beverage equipment, and relates to the technical field of drinking equipment, and the method comprises the steps: obtaining water outlet information in response to a received type input operation, the water outlet information comprising at least one of a target water outlet type, a target water outlet amount and a target water outlet temperature; in response to the received face payment operation, receiving a face image collected by a camera; under the condition that the face image passes verification, determining a payment account corresponding to the face image; controlling the beverage equipment to discharge water according to the water discharge information; and controlling the beverage equipment to stop discharging water and displaying a payment result of the payment account in response to the received water discharging stopping operation or when the water discharging amount of the beverage equipment reaches the target water discharging amount. The water dispenser has the effects of meeting the actual water drinking requirement of a user and reducing waste and pollution.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of drinking water equipment technology, and in particular to a water dispensing method, system, medium and beverage equipment based on facial payment. Background Art

[0002] With the progress of society, various machines for selling drinks appear in more and more occasions to facilitate people's daily life.

[0003] The relevant technology requires the user to first select the drink he wants to drink on the vending machine. After the selection is completed, the vending machine will display a QR code for the user to scan. After the user scans the code and pays the fee, the vending machine will place the corresponding bottled drink at the exit for the user to take.

[0004] Regarding the above-mentioned related technologies, the inventors believe that the related technologies can only provide bottled drinks, that is, the net content of the drinks is fixed, so that the net content of the drinks is insufficient or excessive for users, affecting the user experience. Summary of the invention

[0005] In order to meet the actual drinking water needs of users and reduce waste and pollution, the present application provides a water delivery method, system, medium and beverage equipment based on facial payment.

[0006] In the first aspect, the present application provides a water dispensing method based on face payment, which adopts the following technical solution: A water outlet method based on face payment, comprising: in response to receiving a type input operation, obtaining water outlet information, the water outlet information including at least one of a target water outlet type, a target water outlet amount, and a target water outlet temperature; In response to receiving a facial payment operation, receiving a facial image captured by a camera; If the facial image passes the verification, determine the payment account corresponding to the facial image; Control water discharge of beverage equipment according to water discharge information; In response to receiving a stop water discharge operation or the water discharge amount of the beverage device reaching a target water discharge amount, the beverage device is controlled to stop discharging water, and a payment result of the payment account is displayed.

[0007] By adopting the above technical solution and combining facial payment with automatic water dispensing, the beverage equipment can produce beverages according to the actual needs of users, meet the needs of different users for different types, net content and temperature of different beverages, and improve the user experience.

[0008] Optionally, performing detection processing on the face image to obtain a candidate face; Calculate the depth information and area ratio of the candidate face according to the face image, where the depth information is used to indicate the distance from the candidate face to the camera, and the area ratio is used to indicate the ratio of the area of ​​the candidate face to the area of ​​the face image; The weighted mean of the depth information and the area ratio is calculated to obtain the weighted mean; The candidate face corresponding to the maximum value in the weighted mean is determined as the payee face, and feature extraction is performed on the payee face to obtain the features of the face to be inspected; Compare the facial features to be inspected with the facial database; If the target facial feature exists in the facial database, and the feature distance between the target facial feature and the facial feature to be checked is less than the preset distance, it is determined that the facial image has passed the verification; and the account corresponding to the target facial feature is determined as the payment account.

[0009] By adopting the above technical solution, when the beverage device detects multiple faces, the paying user can be determined from the multiple faces and the payment account of the user can be obtained to promote the subsequent payment process.

[0010] Optionally, performing object recognition processing on the face image to obtain candidate users and items held by the candidate users; Performing an item detection on the held item to obtain the item type of the held item; Conduct behavioral analysis on candidate users to obtain their current behaviors; The candidate user whose item type is the target type and whose current behavior is the target behavior is identified as a water-drawing user; The face region of the water-drawing user is extracted from the face image to obtain a candidate face.

[0011] By adopting the above technical solution, it is determined whether the user is taking water in combination with the user's behavior and the object held by the user, thereby avoiding incorrect water discharge due to user's misoperation.

[0012] Optionally, when at least two candidate faces are detected in the face image, the candidate face corresponding to the second largest value in the weighted mean is taken as the candidate face, and feature extraction processing is performed on the candidate face to obtain candidate face features; When there are candidate facial features in the facial database, determine the candidate account corresponding to the candidate facial features, and obtain the historical water withdrawal record of the candidate account; Generate alternate water outflow information based on historical water intake records; Add beverages corresponding to the alternate water output information to the alternate water tank.

[0013] By adopting the above technical solution, users who are waiting in line for water can be detected, and drinks can be prepared in advance for the users in line, so that the users in line can quickly obtain the drinks they may need.

[0014] Optionally, a feature extraction operation is performed on the face image to obtain a physiological state feature, where the physiological state feature is used to represent the physiological state of the water user; Based on the physiological status characteristics and the historical water withdrawal records of the payment account, recommended drinks are displayed on the display screen and a prompt voice is played.

[0015] By adopting the above technical solution, the required beverages can be recommended to the user according to the user's physiological state to cater to the user's physiological needs and preferences.

[0016] Optionally, obtain time information and occupation information of water users; Extract facial features from facial images to obtain facial features of water users; According to the time information and occupation information, the expression features are updated to obtain the physiological state features.

[0017] By adopting the above technical solution, after the user's expression features are extracted, the expression features will be corrected according to time and occupation, so that the physiological state features are closer to the user's actual state.

[0018] Optionally, capture the sight line information of the water user; When the line of sight information points to the target recommended drink on the display screen and the water-collecting user's line of sight stays on the target recommended drink for a preset time, the detailed content of the target recommended drink is displayed on the display screen, and similar drinks of the target recommended drink are displayed. The detailed content includes at least one of the nutritional elements, functions, taste, recommended population, and allergen information of the target recommended drink.

[0019] By adopting the above technical solution, the drink that the user is interested in can be determined, and the detailed information of the drink can be displayed for the user to view, and similar drinks can be displayed for the user to choose.

[0020] In the second aspect, the present application provides a water dispensing system based on face payment, which adopts the following technical solution: A water dispensing system based on face payment, comprising: an acquisition module for acquiring type input operation, face payment operation, face image, water dispensing stop operation, time information, occupation information and sight information; A memory, used to store a program of the water dispensing method based on face payment as described above; The program in the processor and the memory can be loaded and executed by the processor to implement the water dispensing method based on face payment as described above.

[0021] In a third aspect, the present application provides a beverage device, which adopts the following technical solution: A beverage device comprises a memory and a processor, wherein the memory stores a computer program which can be loaded and executed by the processor as described above.

[0022] In a fourth aspect, the present application provides a computer storage medium capable of storing corresponding programs, which is convenient for realizing the actual needs of users and reduces waste and pollution, and adopts the following technical solutions: A computer-readable storage medium stores a computer program that can be loaded by a processor and execute any of the above-mentioned water delivery methods based on face payment.

[0023] In summary, the present application includes at least one of the following beneficial technical effects: 1. Combining facial payment with automatic water dispensing enables beverage equipment to produce beverages according to the actual needs of users, meet the needs of different users for different types, net content and temperature of different beverages, and improve the user experience; 2. When the beverage device detects multiple faces, it can determine the user who pays from the multiple faces and obtain the user's payment account to facilitate the subsequent payment process; 3. It can detect users who are waiting in line for water and prepare drinks for them in advance so that they can also quickly get the drinks they need. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a structural schematic diagram of a beverage device provided in an embodiment of the present application.

[0025] Figure 2 This is a schematic diagram of an interface of a display screen provided in an embodiment of the present application. Figure 1 .

[0026] Figure 3 This is a schematic diagram of an interface of a display screen provided in an embodiment of the present application. Figure 2 .

[0027] Figure 4 It is a flow chart of a water delivery method based on face payment provided in an embodiment of the present application.

[0028] Figure 5 It is a flow chart of a method for determining a payment account provided in an embodiment of the present application.

[0029] Figure 6 It is a flowchart of a method for determining a candidate face provided in an embodiment of the present application.

[0030] Figure 7 It is a flow chart of a method for pre-preparing a beverage provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solutions and advantages of this application more clear, the following Figure 1-7It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0032] The present application embodiment discloses a beverage device. Figure 1 , a display screen 110 is provided on the beverage device. In some embodiments, please refer to Figure 2 , Figure 2 1 is a schematic diagram of an interface of a display screen provided in an embodiment of the present application, in which a hot water control 112 and a normal temperature control 113 are displayed. The hot water control 112 is used to trigger the beverage device to produce hot water, and the normal temperature control 113 is used to trigger the beverage device to produce normal temperature water. Exemplarily, in response to the triggering operation on the hot water control 112, the face payment interface shown in 3 is displayed, in which the user is required to place the face in the detection area 114; when the beverage device detects the face and the face passes the verification, the beverage device will use the water outlet 120 to flow out hot water.

[0033] In some embodiments, a camera 111 is further disposed above the display screen 120 , and the camera 111 is used to collect a facial image of the user, where the facial image refers to an image having a facial area.

[0034] The present application embodiment discloses a water delivery method based on face payment. Figure 4 , the water dispensing method based on face payment includes: Step S410: in response to receiving a type input operation, obtaining water outlet information, the water outlet information including at least one of a target water outlet type, a target water outlet volume, and a target water outlet temperature.

[0035] The type input operation is triggered by the user on the display screen of the beverage device. Figure 2 In the embodiment, the user can select to trigger the hot water control 112 or the normal temperature control 113 on the display screen to select normal temperature water or hot water. It should be noted that in the present application, the beverage device can produce other types of beverages besides water, such as soda water, orange juice, milk beverage, sparkling water, etc.

[0036] Step S420: In response to receiving a facial payment operation, receiving a facial image captured by a camera.

[0037] The face payment operation refers to the operation in which the user chooses to use face payment. In some embodiments, after the beverage device obtains the water output information, the payment options are displayed on the display screen, and the payment options include face payment options, code scanning payment options, and cash payment options; in response to the triggering operation of the face payment option, the camera is started and the face image is collected.

[0038] In this application, a face image refers to an image with a face area. The face image may include a complete face or a partial face. In some embodiments, even if the face area in the image is blocked, the image can be considered a face image. For example, when a user wears a mask, although the mask blocks part of the user's face area, as long as the user's face is in the image, the image can be considered a face image.

[0039] Step S430: When the facial image passes the verification, determine the payment account corresponding to the facial image.

[0040] In some embodiments, since beverage equipment is placed in places with large traffic, such as train stations and airports, multiple faces may appear in the face image during face payment, thus affecting the user's normal payment. To solve this problem, a flow chart of a method for determining a payment account provided in an embodiment of the present application is provided. Please refer to Figure 5 The method includes steps S501 to S506, the specific contents of which are as follows: Step S501: Detect and process the face image to obtain a candidate face.

[0041] In some embodiments, in order to prevent the user from incurring unnecessary fees due to misoperation, the beverage device of the present application will determine whether the user is willing to use the beverage device based on the user's actions and handheld objects. Figure 6 The embodiment shown, Figure 6 A schematic diagram of a flow chart of a method for determining a candidate face provided in an embodiment of the present application is shown, and the specific contents are as follows: Sub-step S5011: Perform object recognition processing on the face image to obtain candidate users and items held by the candidate users.

[0042] Optionally, the object recognition processing includes human body recognition and object recognition, wherein the human body recognition processing is used to recognize human body structure in the face image, and the object recognition processing is used to recognize objects in the face image.

[0043] Sub-step S5012: Perform an item detection on the held item to obtain the type of the held item.

[0044] Optionally, the held items are detected by an item recognition model to obtain the type of the held items. The item recognition model may be any one of a convolutional neural network, a deep residual network, and a recurrent neural network.

[0045] Sub-step S5013: Performing behavior analysis on the candidate user to obtain the current behavior of the candidate user.

[0046] Optionally, the action recognition model is used to analyze the behavior of the candidate user to obtain the current behavior of the candidate user. The action recognition model is a convolutional neural network or a recurrent neural network.

[0047] Sub-step S5014: Identify the candidate user whose item type is the target type and whose current behavior is the target behavior as a water-drawing user.

[0048] In some embodiments, the target type includes at least one of a cup, a bottle, a pot, and a bag.

[0049] In some embodiments, the target behavior includes at least one of a water fetching behavior, a waiting behavior, and a cup holding behavior.

[0050] For example, if it is detected that the held object is a cup and the current behavior is to fetch water, it means that the user needs to use a beverage device, and the user is listed as a water fetching user. For example, if it is detected that the held object is a mobile phone and the current behavior is to make a call, it means that the user is unlikely to use a beverage device, so the user is not listed as a water fetching user.

[0051] Sub-step S5015: extract the face area of ​​the water-collecting user from the face image to obtain a candidate face.

[0052] In some embodiments, a face detection model is called to select a face area of ​​a water-drawing user in a face image to obtain a candidate face.

[0053] By adopting the above technical solution, it is determined whether the user is taking water in combination with the user's behavior and the object held by the user, thereby avoiding incorrect water discharge due to user's misoperation.

[0054] Step S502: Calculate the depth information and area ratio of the candidate face based on the face image, where the depth information is used to indicate the distance from the candidate face to the camera, and the area ratio is used to indicate the ratio of the area of ​​the candidate face to the area of ​​the face image.

[0055] Depth information is used to indicate the distance from the candidate face to the camera.

[0056] In some embodiments, the candidate face in the face image is determined by a detection frame. In this case, when calculating the area ratio, the area of ​​the detection frame can be used instead of the area of ​​the candidate face. Step S503: weighted calculation of the mean of the depth information and the area ratio to obtain a weighted mean.

[0057] In some embodiments, since the depth information and the area ratio are not the same physical quantities and cannot be directly weighted and calculated, the depth information needs to be converted. Optionally, the ratio of the depth information to the preset depth is calculated to obtain the depth ratio; the average of the depth ratio and the area ratio is weighted and calculated to obtain a weighted average. The preset depth is a pre-set depth value.

[0058] Step S504: the candidate face corresponding to the maximum value in the weighted mean is determined as the payee face, and feature extraction is performed on the payee face to obtain the features of the face to be detected.

[0059] In some embodiments, a facial feature extraction model is used to perform feature extraction processing on the payer's face to obtain facial features to be detected.

[0060] Step S505: Compare the facial features to be detected with the facial database.

[0061] In the form of traversal, the facial features to be tested are compared with the face database.

[0062] Step S506: If the target facial feature exists in the facial database, such that the feature distance between the target facial feature and the facial feature to be checked is less than a preset distance, it is determined that the facial image has passed the verification, and the account corresponding to the target facial feature is determined as the payment account.

[0063] In other embodiments, if the target facial feature does not exist in the facial database, so that the feature distance between the target facial feature and the facial feature to be checked is less than a preset distance, it is determined that the facial image has not passed the verification, and a request to activate the facial payment function is displayed on the display screen; in response to the consent operation on the facial payment function activation request, user information is obtained and the facial payment function is activated; in response to the cancellation operation on the facial payment function activation request, the process ends.

[0064] In some embodiments, when multiple people want to use the beverage device, in order to enable the users in the queue behind to get the beverages they want as soon as possible, the embodiments of the present application can also prepare the beverages that the users can choose when they are in the queue. Figure 7 , Figure 7 A flow chart of a method for preparing a drink in advance provided in an embodiment of the present application is shown. The method includes steps S701 to S704. The specific contents are as follows: Step S701: when it is detected that there are at least two candidate faces in the face image, the candidate face corresponding to the second largest value in the weighted mean is taken as the candidate face, and feature extraction processing is performed on the candidate face to obtain the candidate face features.

[0065] In some embodiments, feature extraction processing is performed on the candidate faces through a facial feature extraction model to obtain candidate facial features.

[0066] Step S702: When there are candidate facial features in the facial database, determine the candidate account corresponding to the candidate facial features, and obtain the historical water withdrawal record of the candidate account.

[0067] In some embodiments, candidate facial features are searched in facial data in a traversal manner; when the candidate facial features exist in the facial database, the candidate account corresponding to the candidate facial features is determined, and the historical water withdrawal record of the candidate account is obtained.

[0068] Step S703: Generate candidate water output information according to historical water intake records.

[0069] In some embodiments, water output information corresponding to the most recent water intake record in the historical water intake records is taken as candidate water output information.

[0070] In some embodiments, the water intake record that appears most frequently in the historical water intake records is used as candidate water output information.

[0071] In some embodiments, the historical water extraction records also include user evaluations, and the candidate water output information is determined based on the scores of the user evaluations in the historical water extraction records.

[0072] Step S704: Add beverages corresponding to the candidate water output information to the candidate water tank.

[0073] In some embodiments, the standby water tank is used to temporarily store beverages. If the user corresponding to the standby face does not select the beverage, the beverage in the standby water tank is returned to the original water tank.

[0074] Optionally, the beverage device is built with at least two standby water tanks. The beverage adding operation in this step will only add beverages to the empty standby water tanks. If all the standby water tanks are full, the beverage adding operation will not be performed.

[0075] By adopting the above technical solution, users who are waiting in line for water can be detected, and drinks can be prepared in advance for the users in line, so that the users in line can also quickly obtain the drinks they need.

[0076] Step S440: Control the water output of the beverage device according to the water output information.

[0077] In some embodiments, based on the target water outlet temperature and the target water outlet volume, the first water outlet flow rate of the first water tank and the first water outlet flow rate of the second water tank are calculated, the first water tank and the second water tank are used to store liquid of the target water outlet type, and the temperatures of the liquids in the first water tank and the second water tank are different; based on the distance from the liquid level of the first water tank to the first valve, a first pressure difference is calculated, and the first valve is set on the first water tank; based on the distance from the liquid level of the second water tank to the second valve, a second pressure difference is calculated, and the second valve is set on the second water tank; the product of the first pressure difference and the first flow coefficient is calculated to obtain the first valve opening of the first valve, and the first flow coefficient is related to the first valve; the product of the second pressure difference and the second flow coefficient is calculated to obtain the second valve opening of the second valve, and the second flow coefficient is related to the second valve; the first valve is controlled to open with the first valve opening, and the second valve is controlled to open with the second valve opening. Optionally, the first flow coefficient is a constant related to the first valve, and factors affecting the first flow coefficient include at least one of the structure, usage time, and blockage condition of the first valve; the second flow coefficient is a constant related to the structure of the second valve, and factors affecting the second flow coefficient include at least one of the structure, usage time, and blockage condition of the second valve.

[0078] In some embodiments, a target water outlet duration corresponding to a target water outlet volume is searched in a preset mapping table, and the preset mapping table is used to record the correspondence between the water outlet volume and the water outlet duration; a first temperature difference is obtained according to a difference between a first temperature and a second temperature; a first water volume is obtained according to a difference between a target water outlet temperature and a second temperature, a reciprocal of the first temperature difference and a target water outlet volume; a second water volume is obtained according to a difference between a first temperature and a target water outlet temperature, a reciprocal of the first temperature difference and a target water outlet volume; a first water outlet flow rate is obtained by calculating a ratio of the first water volume and the water outlet duration; a second water outlet flow rate is obtained by calculating a ratio of the second water volume and the water outlet duration.

[0079] In some embodiments, the beverage device can also recommend beverages to the user in real time based on the user's physiological state. Exemplarily, a feature extraction operation is performed on the face image to obtain physiological state features, which are used to represent the physiological state of the user who draws water; the physiological state features and the historical water withdrawal records of the payment account are combined to display recommended beverages on the display screen and play a prompt voice. For example, if the user's physiological state features are used to represent fatigue, the recommended beverages displayed may be green tea and coffee.

[0080] In some embodiments, different users in the same physiological state have different needs for drinks, so it is necessary to optimize the user's physiological state characteristics in combination with time and occupation. Exemplarily, the time information and occupation information of the user who fetches water are obtained; the expression feature of the face image is extracted to obtain the expression feature of the user who fetches water; the expression feature is updated according to the time information and occupation information to obtain the physiological state characteristics. For example, if the time information indicates late at night, the occupation information indicates a driver, and the expression feature indicates fatigue, then the physiological state characteristic is fatigue caused by driving, and the drink recommended to the user may be coffee; if the time information indicates afternoon, the occupation information indicates a student, and the expression feature indicates fatigue, then the physiological state characteristic is fatigue caused by exercise, and the drink recommended to the user may be a sports drink.

[0081] In this embodiment, the beverage device can also determine which recommended beverage the user is interested in based on his line of sight, and display the details of the beverage on the display screen. Capture the line of sight information of the water-drawing user; when the line of sight information points to the target recommended beverage on the display screen, and the water-drawing user's line of sight stays for a preset time, display the details of the target recommended beverage on the display screen, and display similar beverages of the target recommended beverage, and the details include at least one of the nutritional elements, functions, tastes, recommended groups, and allergen information of the target recommended beverage. Among them, similar beverages refer to beverages that have the same nutritional elements or functions or recommended groups as the target recommended beverage. Exemplarily, if the target recommended beverage is sports drink A, then the similar beverage may be sports drink B of another brand.

[0082] Optionally, a camera is used to capture a sequence of eye images of the user getting water; the gaze point of the eye is calculated based on the position change of the eye of the user getting water in the sequence of eye images; and a target recommended beverage is determined on the display screen based on the gaze point.

[0083] In some embodiments, some users need to manage their own physical conditions and avoid excessive calorie intake. The current calorie intake is calculated according to the target water output; the candidate calorie intake corresponding to various liquids in the beverage device is calculated according to the target water output; a calorie intake request is sent to the server, and the calorie intake request is related to the payment account; the recommended calorie intake returned by the server is received; the calorie difference between the current calorie intake and the recommended calorie intake is calculated; the target calorie intake less than the recommended calorie intake is searched in the candidate calorie intake, and the liquid corresponding to the target calorie intake is determined as the recommended liquid; the recommended liquid is displayed on the display screen of the beverage device, and a calorie report is displayed according to the calorie difference.

[0084] Step S450: In response to receiving a stop water discharge operation or the water discharge of the beverage device reaching a target water discharge, controlling the beverage device to stop discharging water, and displaying a payment result of the payment account.

[0085] In some embodiments, in response to receiving a stop water output operation, the total water output is obtained based on the product of the water output duration and the flow rate; the payment amount is obtained based on the total water output; the virtual resources corresponding to the payment amount in the payment account are deducted, and a payment result is generated.

[0086] In some embodiments, beverage equipment will be distributed in different areas of the target location. Based on the different flow of people in different areas and the different types of users entering the water dispenser, the types and total amount of beverages consumed by each beverage equipment per day will also be different. For example, when the beverage equipment is set up in a school, the beverage equipment will be distributed in teaching buildings, sports fields, etc., and the user needs in the teaching building are different from the user needs on the sports field. Therefore, it is necessary to adjust the water output strategies of different beverage equipment according to the different user needs in different places. Then, the beverage equipment is classified according to the type of area where the beverage equipment corresponds to, and the equipment grouping is obtained; for the target equipment group in the equipment grouping, the historical water output records of the target equipment group in the historical time period are counted, and the historical water output records are used to indicate the water output and water temperature of the beverage equipment in different time periods of each day; based on the historical water output records, the average water output and average water temperature of the target equipment group in different time periods of each day are calculated, and a time period-water output mapping table and a time period-water temperature mapping table are obtained; when there is a preset time left before the target time period, the preheating power is obtained according to the time period-water output mapping table, the time period-water temperature mapping table, and the volume and temperature of the residual liquid; the preheating power is used to heat the liquid in the water tank.

[0087] In some embodiments, a predicted water output corresponding to a target time period is determined in a time period-water output curve diagram; a predicted water temperature corresponding to the target time period is determined in a time period-water temperature curve diagram; the difference between the predicted water output and the volume of the residual liquid is calculated to obtain the volume of the supplementary liquid; the temperature of the mixed liquid is obtained based on the product of the temperature of the residual liquid and the volume of the residual liquid and the product of the volume of the supplementary liquid and the temperature of the supplementary liquid; the heat energy consumption value is predicted based on the difference between the temperature of the mixed liquid and the predicted water temperature; the ratio of the heat energy consumption value to the preset time length is calculated to obtain the preheating power.

[0088] To sum up, this embodiment combines facial payment with automatic water dispensing, so that the beverage device can produce beverages according to the actual needs of users, meet the needs of different users for different types, net content and temperature of different beverages, and improve the user experience.

[0089] Based on the same inventive concept, the embodiment of the present application provides a water dispensing system based on face payment, including: An acquisition module is used to acquire type input operation, face payment operation, face image, stop water discharge operation, time information, occupation information and sight line information; A memory, used to store a program of the water dispensing method based on face payment as in the above-mentioned embodiment; The program in the processor and the memory can be loaded and executed by the processor to implement the water delivery method based on face payment as described in the above embodiment.

[0090] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0091] An embodiment of the present application provides a computer-readable storage medium storing a computer program that can be loaded by a processor and execute a water dispensing method based on facial payment.

[0092] Computer storage media include, for example, various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0093] Based on the same inventive concept, an embodiment of the present application provides a beverage device, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute a water dispensing method based on facial payment.

[0094] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0095] The above are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in this specification (including the abstract and drawings), unless otherwise stated, can be replaced by other equivalent or alternative features with similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.

Claims

1. A water dispensing method based on face payment, It is characterized in that The method comprises: In response to receiving the type input operation, obtaining water outlet information, the water outlet information including at least one of a target water outlet type, a target water outlet amount, and a target water outlet temperature; In response to receiving a facial payment operation, receiving a facial image captured by a camera; If the facial image passes the verification, determining the payment account corresponding to the facial image; controlling water discharge from the beverage device according to the water discharge information; In response to receiving a stop water discharge operation or the water discharge amount of the beverage device reaching the target water discharge amount, the beverage device is controlled to stop discharging water, and a payment result of the payment account is displayed.

2. The water dispensing method based on face payment according to claim 1, It is characterized in that The step of determining the payment account corresponding to the facial image when the facial image passes the verification includes: Performing detection processing on the face image to obtain a candidate face; Calculating the depth information and area ratio of the candidate face according to the face image, wherein the depth information is used to indicate the distance from the candidate face to the camera, and the area ratio is used to indicate the ratio of the area of ​​the candidate face to the area of ​​the face image; Weighted calculation of the mean of the depth information and the area ratio to obtain a weighted mean; Determine the candidate face corresponding to the maximum value in the weighted mean as the payee face, and perform feature extraction processing on the payee face to obtain the face features to be detected; Comparing the facial features to be detected with the facial database; If the target facial feature exists in the facial database, so that the feature distance between the target facial feature and the facial feature to be checked is less than a preset distance, it is determined that the facial image has passed the verification, and the account corresponding to the target facial feature is determined as the payment account.

3. The method according to claim 2, It is characterized in that The step of detecting and processing the face image to obtain a candidate face includes: Performing object recognition processing on the face image to obtain candidate users and items held by the candidate users; Performing an object detection on the held object to obtain the type of the held object; Performing behavior analysis on the candidate user to obtain the current behavior of the candidate user; Identify the candidate user whose item type is the target type and whose current behavior is the target behavior as a water-drawing user; The face region of the water-drawing user is extracted from the face image to obtain the candidate face.

4. The method according to claim 2, It is characterized in that The method further comprises: When at least two candidate faces are detected in the face image, the candidate face corresponding to the second largest value in the weighted mean is selected as a candidate face, and feature extraction processing is performed on the candidate face to obtain candidate face features; In the case where the candidate facial features exist in the facial database, determining a candidate account corresponding to the candidate facial features, and obtaining a historical water withdrawal record of the candidate account; generating candidate water output information according to the historical water intake record; Add beverages corresponding to the candidate water output information into the candidate water tank.

5. The water dispensing method based on face payment according to claim 1, It is characterized in that Before the step of controlling the water discharge of the beverage device according to the water discharge information, the method further includes: Performing a feature extraction operation on the face image to obtain physiological state features, wherein the physiological state features are used to represent the physiological state of the water collection user; In combination with the physiological status characteristics and the historical water withdrawal records of the payment account, recommended drinks are displayed on the display screen and a prompt voice is played.

6. The water dispensing method based on face payment according to claim 5, It is characterized in that The performing of a feature extraction operation on the face image to obtain physiological state features includes: Acquiring time information and occupation information of the water user; Extracting facial features from the facial image to obtain facial features of the water-drawing user; The expression feature is updated according to the time information and the occupation information to obtain the physiological state feature.

7. The water dispensing method based on face payment according to claim 6, It is characterized in that After the step of displaying the recommended drink on the display screen, the method further comprises: Capturing the sight line information of the water intake user; When the line of sight information points to the target recommended drink on the display screen and the water-drawing user's line of sight stays on the target recommended drink for a preset time, the detailed content of the target recommended drink is displayed on the display screen, and similar drinks of the target recommended drink are displayed, and the detailed content includes at least one of the nutritional elements, functions, taste, recommended population, and allergen information of the target recommended drink.

8. A water dispensing system based on face payment, It is characterized in that include: An acquisition module is used to acquire type input operation, face payment operation, face image, stop water discharge operation, time information, occupation information and sight line information; A memory, used to store a program of the water dispensing method based on face payment according to any one of claims 1 to 7; The program in the memory can be loaded and executed by the processor to implement the water delivery method based on face payment as described in any one of claims 1 to 7.

9. A beverage device, It is characterized in that The method comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes any one of the methods of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Control method, device and system for water vending machine, water vending machine and storage medium

    CN109672649A

  • Display device and camera tracking method in multi-person scene

    CN112866773A

  • Vending machine management method and device, electronic equipment and storage medium

    CN113128898A

  • Picture processing method and device

    CN113887451A

  • Intelligent safety water vending machine

    CN204229523U