A water adding prompting method based on an intelligent dining table and the intelligent dining table
By using cameras and controllers on the smart dining table to detect diners' drinking actions and obtain their location information, the problem of waiters not refilling water in a timely manner is solved, thus improving the dining experience.
Patent Information
- Application Number
- CN202211084131.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-06
- Publication Date
- 2026-02-03
- Estimated Expiration
- 2042-09-06
AI Technical Summary
In a dining setting, if a waiter fails to notice in time that a diner's water glass is low, the diner has to call out to the waiter or leave their seat to find one, which negatively impacts the dining experience.
The smart dining table uses a camera to capture images of diners. The controller determines whether there is any action of drinking water and obtains the location information of the target diners. The communication module sends the location information to the waiter to automatically prompt for water refills.
It automatically informs the server where to refill water when it detects that a diner is drinking water, thus improving diner satisfaction and dining experience.
Smart Images

Figure CN115439889B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of smart dining table technology, and in particular to a water-filling prompt method based on a smart dining table and a smart dining table. Background Technology
[0002] Currently, in certain dining scenarios, such as in some private dining rooms, there are usually dedicated waiters responsible for serving tea and water. However, sometimes the waiters may not notice that the diners' water cups are low and fail to refill them, requiring diners to call out to the waiters or leave their seats to find them, which affects the diners' dining experience. Summary of the Invention
[0003] The purpose of this invention is to provide a water-refilling reminder method based on a smart dining table and a smart dining table, in order to solve the problem in the prior art where waiters do not notice that the water level in a diner's cup is low and do not go to refill it, thus requiring the diner to call out loudly for the waiter or get up to find the waiter, which affects the diner's dining experience.
[0004] To achieve the above objectives, this embodiment provides a water-filling prompt method based on a smart dining table, wherein the smart dining table includes a camera, a controller, and a communication module;
[0005] The method includes:
[0006] The camera captures images of diners.
[0007] The controller determines whether the diner is drinking water based on the image of the diner; if so, the diner who is drinking water is the target diner, and the location information of the target diner is obtained.
[0008] The communication module transmits the location information of the target diners.
[0009] Optionally, after the controller determines that the diner has made a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: determining whether the number of times the target diner makes a drinking action reaches a preset number threshold; if so, proceeding to the step of obtaining the location information of the target diner.
[0010] Optionally, after the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: determining whether the drinking time of the target diner reaches a first preset time threshold; if so, proceeding to the step of obtaining the location information of the target diner.
[0011] Optionally, the smart dining table further includes a timer. After the controller determines that the diner has made a drinking motion based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: starting the timer to keep track of the time. When the timer reaches a second preset time threshold, the method proceeds to the step of obtaining the location information of the target diner.
[0012] Optionally, after the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: detecting whether the target diner has taken a water container from the smart dining table and then placed it back on the table using the camera; if so, proceeding to the step of obtaining the location information of the target diner.
[0013] Optionally, after the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: capturing an image of a water container located on the smart dining table using the camera; the controller obtains the distance between the water level in the water container and the opening of the water container based on the image of the water container; and when the distance between the water level in the water container and the opening of the water container is greater than or equal to a preset distance threshold, the method proceeds to the step of obtaining the location information of the target diner.
[0014] Optionally, after the controller determines that the diner has a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: if the number of water containers for the same diner is greater than or equal to 2, the controller determines the type of water container used by the diner who has a drinking action based on the image of the diner; the communication module also sends out the type of water container used by the target diner when drinking.
[0015] Optionally, determining whether a diner has taken a drinking action based on the image of the diner includes: if in the image of the diner captured by the camera, the water container is in contact with the diner's lips, and the tilt angle of the water container is greater than or equal to a preset angle threshold, then it is determined that the diner has taken a drinking action.
[0016] Optionally, the location information of the target diner is represented by at least one of the following six methods: Method 1, represented by the unique location information of the seat corresponding to each dining area of the smart dining table; Method 2, represented by the location number, reference number, and numbering rule of the target diner; Method 3, represented by an image of the target diner taking a drink from the camera; Method 4, represented by highlighting the target diner in the image of diners captured by the camera; Method 5, represented by a single image of the target diner captured by the camera; Method 6, represented by the features of the target diner captured by the camera.
[0017] To achieve the above objectives, this embodiment also provides a smart dining table, including: a camera, a controller, and a communication module;
[0018] The camera is used to capture images of diners;
[0019] The controller is used to determine whether the diner is drinking water based on the image of the diner; if so, the diner who is drinking water is the target diner, and the location information of the target diner is obtained.
[0020] The communication module is used to transmit the location information of the target diners.
[0021] Compared to the aforementioned background technology, this invention provides a water refill prompt method based on a smart dining table and a smart dining table itself. The smart dining table includes a camera, a controller, and a communication module. The method includes: capturing images of diners through the camera; determining whether the diners are drinking water based on the images; if so, identifying the diners as the target diners and obtaining their location information; and transmitting the location information of the target diners through the communication module. By using this method, when a diner is detected drinking water, the location of that diner is automatically communicated to the server, indicating which diner needs water, thus providing convenience for both diners and servers and improving diner satisfaction. Attached Figure Description
[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely embodiments of the present invention, and those skilled in the art can obtain other drawings based on the provided drawings without creative effort.
[0023] Figure 1This is a flowchart of a water-filling prompt method based on a smart dining table, provided in Embodiment 1 of the present invention. Detailed Implementation
[0024] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0025] To enable those skilled in the art to better understand the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
[0026] Example 1
[0027] This embodiment provides a water-filling prompt method based on a smart dining table, which includes a tabletop, a camera, a controller, and a communication module.
[0028] See Figure 1 The methods include:
[0029] S1. Capture images of diners using a camera;
[0030] Optionally, the camera in this embodiment can be installed on the wall or ceiling of the room where the smart dining table is located; or the camera can be positioned in the middle of the smart dining table. The camera can be either a lift-up type or a fixed-height type. For a lift-up type camera, when the smart dining table is in use, the camera extends above the smart dining table, and the extension height can be set according to actual needs to ensure that it can capture images of diners sitting on the outer edge of the smart dining table. When the smart dining table is not in use, the camera is retracted under the smart dining table. The camera can be a wired camera or a wireless camera, and the camera communicates with the controller of the smart dining table. The number of cameras in this embodiment can be set according to actual needs, for example, it can be 1, 2, 3, etc.
[0031] S2. The controller determines whether the diner is drinking water based on the image of the diner; if yes, proceed to S3; if no, proceed to step S1.
[0032] Optionally, the following describes three parallel methods for determining whether a diner is drinking: Method 1: If the water container is in contact with the diner's lips in the image captured by the camera, then the diner is determined to be drinking. Method 2: If the tilt angle of the water container in the image captured by the camera is greater than or equal to a preset angle threshold, then the diner is determined to be drinking. Since there are cases where the water container does not touch the lips when the diner drinks, and the water is poured into the mouth from a distance, the tilt angle of the water container can be used to determine whether the diner is drinking. It is worth noting that the method of determining whether the diner is drinking by tilt angle is applicable not only to the case where the water container does not touch the lips and the water is poured into the mouth from a distance, but also to the case where the water container is in contact with the lips when drinking. Method 3: If the water container is in contact with the diner's lips in the image captured by the camera, and the tilt angle of the water container is greater than or equal to a preset angle threshold, then the diner is determined to be drinking.
[0033] S3. Target diners who drink water and obtain their location information.
[0034] S4. The communication module sends out the location information of the target diners.
[0035] By using the above method, when a diner is detected drinking water, the system automatically informs the server of the diner's location, thus prompting the server to identify which diner needs water. This provides convenience for both diners and servers and improves diner satisfaction.
[0036] Optionally, the location information of the target diners can be represented in at least one of the following six ways: Method 1: Represented by the fixed and unique location information of each seating position in each dining area of the smart dining table; the seating positions in each dining area are fixed and have unique location information pre-set. The server knows the location information of each seating position in each dining area, so by setting fixed and unique location information for each seating position, the location of the diners who need water can be determined. Method 2: Represented by the target diners' location number, reference number, and numbering rule; the camera captures images of diners after they are seated, assigning them location numbers. While sending the target diners' location numbers to the server, the reference number and numbering rule are also sent to the server. For example, the reference number for a position at the entrance of a private room is location number 1. The numbering rule is, for example, ascending clockwise. This allows the server to know the location of the diners who need water. Method 3: Represent the target diners by capturing images of them drinking water using a camera. These images are then sent directly to the server, allowing the server to clearly see the location of the diners who need water. Method 4: Highlight the target diners in the images captured by the camera. This highlighting can be done by circling them with a red line or using an arrow. The highlighted images are then sent to the server, allowing the server to clearly see the location of the diners who need water. Method 5: Represent the target diners by capturing individual images of them using a camera. The camera can be adjusted to focus on each individual diner, and these individual images are sent to the server, allowing the server to know which diner needs water. Method Six: Feature representation of target diners through camera data collection; After diners are seated, the camera collects the features of each diner, such as clothing type (e.g., shirt, dress, suit), clothing color, hair style (e.g., updo, loose hair, ponytail, buzz cut), watch style, and jewelry style. These features are then sent to the server, allowing the server to know which diner to refill their water. Optionally, for multiple smart tables, each smart table can be distinguished by its location information. The location information can be represented by numbers, such as Smart Table 1, Smart Table 2, etc. When sending the target diner's location information to the server, this information includes both the location of the smart table and the location of the smart table where the target diner is currently seated.
[0037] Optionally, when the communication module sends the location information of the target diner to the waiter, it can send it to the waiter's mobile phone, PAD or other terminal for notification.
[0038] This embodiment has multiple implementation methods. The first implementation method is as follows: Steps S1 to S4 above describe a solution where a waiter is prompted to add water to a diner's table when the camera detects that the diner is drinking water.
[0039] The second implementation method: Optionally, a diner may only take a small sip of water each time, leaving a considerable amount remaining in the water container, or the water container may be quite large, leaving a significant amount remaining after each sip. In these cases, it is not necessary to refill the water after the diner has taken a sip. In this embodiment, after the S2 controller determines that the diner has taken a sip based on the diner's image, and before the S3 controller obtains the location information of the target diner, the method further includes: determining whether the number of times the target diner has taken a sip has reached a preset threshold. If so, the method proceeds to the step of obtaining the location information of the target diner in S3. That is, only when the camera detects that the diner has taken a sip, and the number of times the same diner has taken a sip is greater than or equal to the preset threshold (e.g., 2 times, 3 times, etc.), will the server be prompted to refill the water for the target diner.
[0040] The third implementation method: Optionally, a diner may only take a small sip of water, leaving a significant amount remaining in the water container, or the water container may be large enough to leave a considerable amount of water after drinking. In these cases, it is not necessary to refill the water after the diner takes a sip. In this embodiment, after the S2 controller determines that the diner has taken a sip based on the diner's image, and before the S3 controller obtains the location information of the target diner, the method further includes: determining whether the drinking time of the target diner has reached a first preset time threshold; if so, proceeding to the step of obtaining the location information of the target diner in S3; that is, only after the camera detects that the diner has taken a sip of water and detects that the drinking time of the diner has reached the first preset time threshold (e.g., 2 seconds, 3 seconds, 4 seconds, etc.) will the waiter be prompted to refill the water for the target diner.
[0041] Fourth implementation: Optionally, a diner may only take a small sip of water, leaving a significant amount in the container. In this case, it is unnecessary to refill the water after the diner takes a sip. However, if the diner does not drink water for a long time after taking a sip, the cup may be empty. In this embodiment, the smart dining table also includes a timer. After the S2 controller determines that the diner has taken a sip based on the diner's image, and before the S3 controller obtains the location information of the target diner, the system further includes: starting the timer to keep track of the time. When the timer reaches a second preset time threshold, the system proceeds to the step of obtaining the location information of the target diner in S3. That is, only after the camera detects that the diner has taken a sip, and after the second preset time threshold (e.g., 60 seconds, 100 seconds, 150 seconds, etc.) has elapsed, will the server be prompted to refill the water for the target diner.
[0042] Fifth implementation method: Optionally, a diner may only take a small sip of water, leaving a significant amount in the water container. In this case, it is unnecessary to refill the water container after the diner takes a sip. However, if the diner takes the water container from the smart dining table and then puts it back down after taking a sip, it may indicate that the container is empty. In this embodiment, after the S2 controller determines that the diner has taken a sip based on the diner's image, and before the S3 controller obtains the location information of the target diner, the method further includes: detecting whether the target diner has taken the water container from the smart dining table and then put it back down using a camera. If so, the method proceeds to the S3 step of obtaining the location information of the target diner. That is, only after the camera detects that the diner has taken a sip of water, and subsequently detects that the diner has taken the water container from the smart dining table and then put it back down, will the server be prompted to refill the water container for the target diner.
[0043] Sixth implementation: Optionally, if a diner only takes a small sip of water, leaving a significant amount remaining in the water container, or if the container is large enough to hold a considerable amount of water after drinking, then it's unnecessary to refill the water container after each diner's drinking action. In this embodiment, the solution may further include, after the S2 controller determines that the diner has taken a drink based on their image, and before the S3 controller obtains the location information of the target diner, capturing an image of the water container located on the smart dining table via a camera; the controller... The distance between the water level in the water container and its opening is obtained from the image of the container. If this distance is greater than or equal to a preset distance threshold, the process proceeds to step S3, obtaining the location information of the target diner. In other words, only when the camera detects that a diner is drinking water, and after the diner places their water container on the table, and the distance between the water level and the opening is greater than or equal to the preset distance threshold, will the server be prompted to refill the diner's water. Different preset distance thresholds can be set for different container heights.
[0044] Optionally, the water-holding containers in this embodiment include water cups, tea cups, white wine cups, red wine cups, beverage cups, soup bowls (which can be used to hold soup), etc., and the number of water-holding containers for the same diner is greater than or equal to 1. In the case where the number of water-holding containers for the same diner is greater than or equal to 2, in order to distinguish which type of water-holding container needs to be refilled, in this embodiment, after the controller in S2 determines that the diner has a drinking action based on the image of the diner, and before the location information of the target diner in S3 is obtained, the following is also included: in the case where the number of water-holding containers for the same diner is greater than or equal to 2, the controller determines the type of water-holding container when the diner with the drinking action is drinking based on the image of the diner; the communication module also sends out the type of water-holding container when the target diner is drinking. In other words, the camera can also identify the type of water that needs to be refilled, such as hot water, tea, liquor, red wine, beverages, and soup. It can distinguish them by the shape of the container, or by combining the shape of the container with the color of the water, or by identifying the type of water being poured and associating it with the container (for example, if the camera identifies that a liquor bottle is being used to pour water into a glass, then the glass is identified as a liquor glass). When informing the server of the location where water needs to be refilled, the type of water also needs to be specified, such as which diner's red wine glass needs refilling. This embodiment also has no limitation on the number of people needing water refills. Besides identifying multiple containers for a single diner, it can also simultaneously identify whether multiple diners need water refills. For example, if multiple diners at the same table are drinking alcohol, it can simultaneously identify whether all of them need refills.
[0045] Optionally, water refill prompts can be provided for the large teapots at multiple smart dining tables. Generally, each dining table is equipped with a large teapot, which is used to refill water for multiple diners at the same table. If the camera detects that the large teapot is being poured more than X times, the location of the dining table where the teapot is located can be sent to the waiter to remind them that the large teapot needs to be refilled. Alternatively, if the camera detects that the distance between the water level in the large teapot and the spout is greater than or equal to a first preset distance threshold, the location of the dining table where the teapot is located can be sent to the waiter to remind them that the large teapot needs to be refilled. It can also prompt for refilling large bottles of beverages and bottled wine at multiple smart dining tables. Generally, each table is equipped with one large bottle of beverage and / or one bottle of wine for multiple diners at the same table. If the camera detects that the large bottle of beverage or bottled wine is being poured more than Y times, the location of the table containing the large bottle of beverage or bottled wine will be sent to the waiter to prompt that a refill is needed. Alternatively, if the camera detects that the distance between the water level in the large bottle of beverage or bottled wine and the bottle opening is greater than or equal to a second preset distance threshold, the location of the table containing the large bottle of beverage or bottled wine will be sent to the waiter to prompt that a refill is needed.
[0046] Example 2
[0047] This embodiment provides a smart dining table, including: a camera, a controller, and a communication module;
[0048] The camera is used to capture images of diners;
[0049] The controller is used to determine whether a diner is drinking water based on the image of the diner; if so, the diner who is drinking water is the target diner, and the location information of the target diner is obtained.
[0050] The communication module is used to transmit the location information of the target diners.
[0051] The smart dining table in this embodiment adopts any of the smart dining tables in Embodiment 1, and the functions of each module are also described in Embodiment 1, which will not be repeated here.
[0052] The embodiments of the present invention have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the embodiments above are merely for the purpose of helping to understand the solution and core ideas of the present invention. It should be noted that those skilled in the art can make various improvements and modifications to the present invention without departing from its principles, and these improvements and modifications also fall within the protection scope of the claims of the present invention.
Claims
1. A method for prompting water refill on a smart dining table, characterized in that, The smart dining table includes a camera, a controller, and a communication module; The method includes: The camera captures images of diners. The controller determines whether the diner is drinking water based on the image of the diner; if so, the diner who is drinking water is the target diner, and the location information of the target diner is obtained. The communication module transmits the location information of the target diners. After the controller determines that the diner has made a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: determining whether the number of times the target diner makes a drinking action reaches a preset number threshold; if so, proceeding to the step of obtaining the location information of the target diner.
2. The water-filling prompt method based on a smart dining table according to claim 1, characterized in that, After the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: determining whether the drinking time of the target diner reaches a first preset time threshold; if so, proceeding to the step of obtaining the location information of the target diner.
3. The water-filling prompt method based on a smart dining table according to claim 1, characterized in that, The smart dining table also includes a timer. After the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: starting the timer to keep track of the time. When the timer reaches a second preset time threshold, the method proceeds to the step of obtaining the location information of the target diner.
4. The water-filling prompt method based on a smart dining table according to claim 1, characterized in that, After the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: detecting whether the target diner has taken a water container from the smart dining table and then put the water container back on the table using the camera; if so, the method proceeds to the step of obtaining the location information of the target diner.
5. The water-filling prompt method based on a smart dining table according to claim 1, characterized in that, After the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: capturing an image of a water container located on the smart dining table using the camera; the controller obtains the distance between the water level in the water container and the opening of the water container based on the image of the water container; and when the distance between the water level in the water container and the opening of the water container is greater than or equal to a preset distance threshold, the method proceeds to the step of obtaining the location information of the target diner.
6. The water-filling prompt method based on a smart dining table according to any one of claims 1 to 5, characterized in that, After the controller determines that the diner has taken a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: if the number of water containers for the same diner is greater than or equal to 2, the controller determines the type of water container used by the diner who took a drinking action based on the image of the diner; the communication module also sends out the type of water container used by the target diner when drinking water.
7. The water-filling prompt method based on a smart dining table according to any one of claims 1 to 5, characterized in that, The step of determining whether a diner is drinking water based on the image of the diner includes: if the water container is in contact with the diner's lips in the image of the diner captured by the camera, and the tilt angle of the water container is greater than or equal to a preset angle threshold, then it is determined that the diner is drinking water.
8. The water-filling prompt method based on a smart dining table according to any one of claims 1 to 5, characterized in that, The location information of the target diners is represented by at least one of the following six methods: Method 1: Represented by the fixed and unique location information of the seating position corresponding to each dining area of the smart dining table; Method 2: Represented by the location number, reference number, and numbering rule of the target diners; Method 3: Represented by the image of the target diners taking a drink, captured by the camera; Method 4: Represented by highlighting the target diners in the image of diners captured by the camera; Method 5: Represented by the image of the target diners alone, captured by the camera; Method 6: Represented by the features of the target diners captured by the camera.
9. A smart dining table, characterized in that, include: Camera, controller, communication module; The camera is used to capture images of diners; The controller is used to determine whether the diner is drinking water based on the image of the diner; if so, the diner who is drinking water is the target diner, and the location information of the target diner is obtained. The communication module is used to transmit the location information of the target diners. After the controller determines that the diner has made a drinking action based on the image of the diner, and before obtaining the location information of the target diner, the method further includes: determining whether the number of times the target diner makes a drinking action reaches a preset number threshold. If so, proceed to the step of obtaining the location information of the target diner.
Citation Information
Patent Citations
Liquid level detection method and liquid level detection device
CN104065904A
Chat robot and chat system
CN104994013A
Method and system for providing dish or drink in restaurant
JP2004252497A