Tableware tracking and monitoring method based on restaurant sofa, restaurant sofa and storage medium

Abstract

The embodiment of the invention discloses a tableware tracking and monitoring method based on a restaurant sofa, the restaurant sofa and a storage medium, and the method comprises the steps: in response to a first pressing operation of a user on a key arranged on the restaurant sofa, recognizing target tableware designated by the user through a camera device above a dining table, and carrying out tracking and monitoring; in response to a second pressing operation of the user on the key, a first obtaining request is sent to the camera device through the restaurant sofa so as to obtain a tracking monitoring result of the camera device, and the tracking monitoring result is used for representing whether the target tableware is moved by other people or not; receiving a tracking monitoring result returned by the camera device; displaying the tracking and monitoring result to the user; tableware used by diners who temporarily leave the restaurant sofa is tracked and monitored by using the restaurant sofa, so that the dining safety of the restaurant is improved.

Description

Technical Field

[0001] The present application relates to the technical field of sofas, and in particular to a tableware tracking and monitoring method based on a dining room sofa, a dining room sofa and a storage medium. Background Art

[0002] In modern society, people dine out more and more. For example, when dining in a restaurant (hotel restaurant) (e.g., a large gathering), when a diner temporarily leaves a sofa in a restaurant that is attached to the dining table (e.g., to go to the restroom), it is usually impossible to know whether the cup used by the diner has been touched by others (e.g., used or drugged) during the time when the diner left the sofa in the restaurant, which is not conducive to improving the safety of dining in restaurants. Summary of the invention

[0003] The embodiments of the present application disclose a tableware tracking and monitoring method based on a restaurant sofa, a restaurant sofa and a storage medium, which are used to improve the safety of dining in a restaurant.

[0004] In a first aspect, an embodiment of the present application discloses a tableware tracking and monitoring method based on a restaurant sofa, the method comprising:

[0005] In response to a first pressing operation of a button set on a sofa in a dining room by a user, a camera device above the dining table is used to identify target tableware designated by the user and to perform tracking monitoring;

[0006] In response to the user's second pressing operation on the button, a first acquisition request is sent to the camera device through the dining room sofa to obtain a tracking monitoring result of the camera device, wherein the tracking monitoring result is used to indicate whether the target tableware has been moved by others;

[0007] Receiving the tracking and monitoring result returned by the camera device;

[0008] The tracking and monitoring results are displayed to the user.

[0009] In some feasible implementations, in response to the user's first pressing operation on a button set on the sofa in the restaurant, using a camera device above the dining table to identify the target tableware specified by the user and perform tracking monitoring includes:

[0010] In response to the first pressing operation, a connection is established between the dining room sofa and the smartphone according to a communication request sent by the user's smartphone, the target tableware specified by the user is identified by the camera device and tracked and monitored, and the sofa is used in conjunction with the dining table;

[0011] The displaying the tracking and monitoring result to the user includes:

[0012] The tracking and monitoring result is sent to the smart phone.

[0013] In some feasible implementations, the method further includes:

[0014] During the tracking and monitoring process of the camera device, receiving a first warning notification sent by the camera device, wherein the first warning notification is sent to the sofa when the camera device identifies that the target tableware has been moved by others during the tracking and monitoring process;

[0015] The alarm device arranged on the sofa is controlled to sound an alarm.

[0016] In some feasible implementations, during the tracking and monitoring process of the camera device, after receiving a first warning notification sent by the camera device, the method further includes:

[0017] Sending a second acquisition request to the camera device to request the camera device to send a monitored picture or video clip indicating that the target tableware has been touched by another person, and the picture or video clip also includes the face of the other person who has touched the target tableware, and the picture or video clip carries a time tag;

[0018] A second warning notification carrying the picture or video clip is sent to the smart phone.

[0019] In some feasible implementations, the method further includes:

[0020] During the tracking and monitoring process of the camera device, obtaining real-time monitoring video from the camera device;

[0021] The real-time monitoring video is sent to a smart phone.

[0022] In some feasible implementations, the step of using the camera device to identify the target tableware specified by the user and perform tracking monitoring includes:

[0023] Using the camera device to detect the tableware pointed to by the finger on the dining table, and identifying it as the target tableware, and starting tracking and monitoring the target tableware;

[0024] Alternatively, all the tableware on the dining table is scanned using the camera device, and image information of all the scanned tableware is pushed to the smart phone for selection, and after receiving the selection information returned by the smart phone, an identity acquisition request is sent to the tableware indicated by the selection information, the identity identification returned by the tableware indicated by the selection information is received, and the tableware is identified as the target tableware, and tracking and monitoring of the target tableware is started; wherein, identity identification is set on the bottom of all the tableware on the dining table.

[0025] In some feasible implementations, after identifying the target tableware, the method further includes:

[0026] After identifying the target tableware, establishing a connection between the dining room sofa and the target tableware, and sending a first capacity acquisition request to the target tableware;

[0027] receiving first feedback information sent by the target tableware, where the first feedback information indicates a first capacity, and the first capacity is obtained by the target tableware through a built-in sensor after receiving the first capacity acquisition request;

[0028] During the tracking and monitoring process of the camera device, after receiving a first warning notification sent by the camera device, the method further includes:

[0029] Sending a second capacity acquisition request to the target tableware;

[0030] receiving second feedback information sent by the target tableware, where the second feedback information indicates a second capacity, and the second capacity is obtained by the target tableware through a built-in sensor after receiving the second capacity acquisition request;

[0031] The second capacity and the first capacity are sent to the smart phone.

[0032] In a second aspect, the present application discloses a dining room sofa, including:

[0033] A monitoring module, for responding to a first pressing operation of a button set on a sofa in a dining room by a user, using a camera device above the dining table to identify target tableware designated by the user and to perform tracking monitoring;

[0034] a communication module, configured to respond to the user's second pressing operation on the button, and to send a first acquisition request to the camera device through the dining room sofa, so as to acquire a tracking and monitoring result of the camera device, wherein the tracking and monitoring result is used to indicate whether the target tableware has been moved by others;

[0035] The communication module is further used to receive the tracking and monitoring result returned by the camera device;

[0036] A display module is used to display the tracking and monitoring results to the user.

[0037] In a third aspect, the present application discloses a dining room sofa, which may include:

[0038] A memory storing executable program code;

[0039] a processor coupled to the memory;

[0040] The processor calls the executable program code stored in the memory to execute a tableware tracking and monitoring method based on a dining room sofa disclosed in the first aspect of the embodiment of the present application.

[0041] In a fourth aspect, an embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute a tableware tracking and monitoring method based on a restaurant sofa disclosed in the first aspect of the embodiment of the present application.

[0042] In a fifth aspect, an embodiment of the present application discloses a computer program product. When the computer program product is run on a computer, the computer is enabled to execute part or all of the steps of any one of the methods of the first aspect.

[0043] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0044] In an embodiment of the present application, the restaurant sofa responds to a first press operation of a button set on the restaurant sofa by a user, and uses a camera device above the dining table to identify the target tableware specified by the user and track and monitor it. Then, in response to a second press operation of the button by the user, a first acquisition request is sent to the camera device through the restaurant sofa to obtain the tracking and monitoring results of the camera device, which are used to indicate whether the target tableware has been moved by others, receive the tracking and monitoring results returned by the camera device, and then display the tracking and monitoring results to the user. It can be seen that the embodiment of the present application uses the restaurant sofa to track and monitor the tableware used by diners who temporarily leave the restaurant sofa, so that after the diner returns, he can know whether the tableware used by the diner has been moved by others (such as used or drugged, etc.) during the period when the diner left the restaurant sofa, which is beneficial to improving the safety of dining in the restaurant. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 A schematic diagram of an application scenario of the tableware tracking and monitoring method based on a restaurant sofa disclosed in an embodiment of the present application;

[0047] Figure 2 This is a flow chart of a tableware tracking and monitoring method based on a restaurant sofa disclosed in Example 1 of the present application;

[0048] Figure 3This is a flow chart of a tableware tracking and monitoring method based on a restaurant sofa disclosed in Example 2 of the present application;

[0049] Figure 4 This is a flow chart of a tableware tracking and monitoring method based on a restaurant sofa disclosed in Example 3 of the present application;

[0050] Figure 5 This is a structural schematic diagram of a dining room sofa disclosed in Example 1 of the present application;

[0051] Figure 6 This is a structural schematic diagram of a dining room sofa disclosed in Example 2 of the present application;

[0052] Figure 7 This is a schematic diagram of the structure of the dining room sofa disclosed in Example 3 of the present application. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0054] It should be noted that the terms "first", "second", "third" and "fourth" in the specification and claims of the present application are used to distinguish different objects rather than to describe a specific order. The terms "including" and "having" in the embodiments of the present application and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device including a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0055] like Figure 1 As shown, Figure 1 Schematic diagram of the application scenario of the tableware tracking and monitoring method based on the sofa in the restaurant disclosed in the embodiment of the present application, such as Figure 1 As shown, taking the dining cup as an example, a button is set on the armrest of the restaurant sofa, and an alarm is also set on the restaurant sofa ( Figure 1 Not shown), and the dining room sofa has a built-in controller ( Figure 1(not shown), the button is connected to the controller, and the restaurant sofa is connected to the camera in the restaurant through the controller, such as the camera installed on the ceiling or wall above the dining table. Multiple cameras can be installed in the restaurant, and the restaurant sofa is connected to multiple cameras. However, when tracking and monitoring the dining cups, the restaurant sofa can select one or more cameras closest to the dining table to track the dining cups. Among them, according to the appearance classification, the camera can be an ordinary gun-type digital camera, an infrared night vision waterproof digital camera, an integrated digital camera, a spherical digital camera, and the camera and the restaurant sofa can be connected by wire or wirelessly. In order to facilitate the layout of the restaurant, it is preferred to connect the restaurant sofa and the camera wirelessly in the embodiment of the present application. The camera can be connected to the restaurant sofa through a camera controller, and the camera and the camera controller constitute a camera device.

[0056] The mobile phone can download the corresponding application (APP) and connect and communicate with the restaurant sofa through the APP. Among them, the two-dimensional graphic of the corresponding APP can be set on the armrest of the restaurant sofa, and the mobile phone user can download and install the APP by scanning the two-dimensional graphic of the APP.

[0057] The dining cup may be built with a smart chip, which can read the relevant information of the liquid in the dining cup in real time. The dining cup is connected to the dining sofa via a wireless network, and the dining sofa can obtain relevant information of the liquid from the dining cup, such as capacity (which can be reflected as height), etc. An identity mark (such as identity information) may be set on the bottom of the dining cup, and the smart chip also stores its identity mark.

[0058] When the user needs to leave temporarily during the meal, he can press the button on the dining room sofa. The dining room sofa responds to the pressing operation and uses the camera above the dining table to identify the dining cup specified by the user for tracking and monitoring. At the same time, a communication connection is established between the dining room sofa and the user's mobile phone to determine the user. Before the tracking and monitoring ends, if a change of user is detected, a warning notification needs to be sent to the connected user to improve the reliability of tracking and monitoring, and prevent others from attempting to change the user to perform other improper operations (such as taking medicine, etc.) before the tracking and monitoring ends. Afterwards, if the button is pressed again, the dining room sofa sends a request to the camera, and then receives the tracking and monitoring results returned by the camera. The tracking and monitoring results are used to indicate whether the dining cup has been moved by others, and the tracking and monitoring results are displayed to the user.

[0059] The sofa sends the tracking and monitoring results to the user's mobile phone, and the user can view them through the mobile phone APP.

[0060] Moreover, during the camera tracking and monitoring process, the user can send a demand request to the restaurant sofa through the mobile phone, requesting the restaurant sofa to send the real-time monitoring video to the mobile phone during the camera tracking and monitoring process so that the user can monitor in real time.

[0061] If the camera recognizes that the dining cup has been moved by someone else during the tracking monitoring process, it will send a warning notification to the dining sofa, and the dining sofa will sound an alarm through the alarm. After receiving the warning notification, the dining sofa can also obtain the corresponding picture or video clip from the camera, which also contains the face of the person who moved the dining cup. The picture or video clip carries a time tag and is then sent to the user.

[0062] It is understandable that this application Figure 1 The disclosed application scenarios do not constitute a specific limitation of the present application. Figure 1 The scene shown can be deformed or other devices can be added to achieve the combination.

[0063] Therefore, the embodiment of the present application discloses a tableware tracking and monitoring method based on a restaurant sofa, a restaurant sofa and a storage medium, which utilizes the restaurant sofa to track and monitor the tableware used by diners who temporarily leave the restaurant sofa, which is conducive to improving the safety of restaurant dining. The following is a detailed description of the technical solution of the present application from the perspective of the restaurant sofa through specific embodiments.

[0064] See also Figure 2 , Figure 2 Schematic diagram of the process of the tableware tracking and monitoring method based on the sofa in the restaurant disclosed in the first embodiment of the present application; Figure 2 As shown, the tableware tracking and monitoring method based on the restaurant sofa may include:

[0065] 201. In response to a first pressing operation of a button set on a sofa in a restaurant by a user, a camera device above the dining table is used to identify target tableware designated by the user and perform tracking monitoring.

[0066] Among them, the execution subject of the embodiment of the present application is a dining room sofa. For example, the dining room sofa is as follows Figure 1 A button is provided on the sofa in the restaurant. If a first pressing operation on the button is detected, the camera device above the dining table is used to identify the target tableware specified by the user and track and monitor it.

[0067] The first pressing operation refers to the first detection of a pressing operation on the key, or the first detection of a pressing operation on the key after any tracking and monitoring is completed.

[0068] For example, Figure 1As shown, the camera device above the dining table includes a camera controller and a camera. The camera can be installed on the ceiling or wall of the restaurant. One or more cameras close to the target tableware can be used to track and monitor the target tableware.

[0069] Optionally, the restaurant sofa is wirelessly connected to the camera controller of the restaurant through its own controller, and the camera controller controls all cameras in the restaurant area. After the restaurant sofa responds to the first pressing operation, it sends a first monitoring instruction to the camera controller, and the identity of the restaurant sofa can be carried in the first monitoring instruction. Correspondingly, after receiving the first monitoring instruction, the camera controller determines the placement of the restaurant sofa according to the identity of the restaurant sofa, and further determines the camera (which can be one or more) near the placement of the restaurant sofa, and controls the determined camera to scan the dining table corresponding to the restaurant sofa, and then identifies the target tableware and tracks and monitors it. It should also be noted that the camera controller pre-saves the correspondence between the identity of the restaurant sofa and the placement position, and also saves the identity and placement position of the dining table itself, and the restaurant sofa and the dining table are also associated and matched and saved in the controller of the restaurant sofa and the controller of the camera. Through this embodiment, the camera can accurately identify the position of the dining table corresponding to the restaurant sofa.

[0070] It should also be noted that the main purpose of selecting one or more cameras is to be able to monitor the condition of the target tableware 360 ​​degrees and improve the reliability of monitoring.

[0071] Among them, the target tableware can be one or more, and the tableware disclosed in the embodiment of the present application can be a dining cup, a dining plate, a rice bowl, a soup bowl, etc.

[0072] 202. In response to a second pressing operation of the button by the user, a first acquisition request is sent to the camera device through the dining room sofa to obtain a tracking monitoring result of the camera device, where the tracking monitoring result is used to indicate whether the target tableware has been moved by others.

[0073] After step 201, in response to the first pressing operation of the button, the target tableware is tracked and monitored by using the camera device. After detecting the second pressing operation of the button, in response to the second pressing operation, a first acquisition request is sent to the camera device to request the tracking and monitoring results of the camera device.

[0074] Among them, in step 202, after the user comes back, he can press the button for the second time, and the restaurant sofa responds to the second pressing operation and then sends a first acquisition request to the camera device to obtain the tracking monitoring result.

[0075] 203. Receive the tracking monitoring result returned by the camera device.

[0076] Correspondingly, after receiving the first acquisition request, the camera device sends the tracking monitoring result to the sofa in the restaurant.

[0077] It should be noted that the tracking monitoring result in the embodiment of the present application can be a result information obtained by the camera device based on the tracking monitoring analysis to directly indicate whether the target tableware has been moved by others, such as "Your tableware has been moved by others, please pay attention to safety", etc., or the tracking monitoring result is directly a video taken by the camera device during the tracking monitoring period. It can be understood that no matter what form the tracking monitoring result is in, it can clearly inform the user whether the target tableware has been moved by others, which is helpful to help improve the safety of users when dining out.

[0078] 204. Display the tracking and monitoring results to the user.

[0079] The restaurant sofa displays the tracking monitoring results to the user for the user to review.

[0080] It should be noted that the tracking and monitoring results of the embodiment of the present application are only displayed to the user who utilizes the tracking and monitoring to improve the reliability of the tracking and monitoring.

[0081] It can be seen that, in the implementation of the embodiment of the present application, the restaurant sofa responds to the first pressing operation of the button set on the restaurant sofa by the user, and uses the camera device above the dining table to identify the target tableware specified by the user and track and monitor it. Then, in response to the second pressing operation of the button by the user, a first acquisition request is sent to the camera device through the restaurant sofa to obtain the tracking and monitoring results of the camera device, which are used to indicate whether the target tableware has been moved by others, receive the tracking and monitoring results returned by the camera device, and then display the tracking and monitoring results to the user; the restaurant sofa can be used to track and monitor the tableware used by the diners who temporarily leave the restaurant sofa, so that after the diners return, they can know whether the tableware used by the diner has been moved by others (such as used or drugged, etc.) during the period when the diner left the restaurant sofa, which is conducive to improving the safety of dining in the restaurant.

[0082] See also Figure 3 , Figure 3 Schematic diagram of the process of the tableware tracking and monitoring method based on the sofa in the restaurant disclosed in the second embodiment of the present application; Figure 3 As shown, the tableware tracking and monitoring method based on the restaurant sofa may include:

[0083] 301. In response to a first pressing operation on a button on a dining room sofa, a connection is established between the dining room sofa and the smartphone according to a communication request sent by the user's smartphone, and a camera device is used to identify target tableware designated by the user and perform tracking monitoring.

[0084] Among them, the execution subject of the embodiment of the present application is a dining room sofa. For example, the dining room sofa is as follows Figure 1 A button is provided on the sofa in the restaurant. If a first pressing operation on the button is detected, the camera device above the dining table is used to identify the target tableware specified by the user and track and monitor it.

[0085] In step 301, in response to the first pressing operation, a communication connection between the user's smartphone and the dining room sofa will also be established. Optionally, the user can download the APP through the two-dimensional graphic set on the armrest, and then select the dining room sofa corresponding to the identity identifier on the APP according to the identity identifier on the dining room sofa and send a communication request to it, so that after the dining room sofa responds to the communication request, the communication connection between the dining room sofa and the user's smartphone is completed.

[0086] 302. In response to a second pressing operation of the button by the user, a first acquisition request is sent to the camera device through the dining room sofa to obtain a tracking monitoring result of the camera device, where the tracking monitoring result is used to indicate whether the target tableware has been moved by others.

[0087] After step 301, in response to the first pressing operation of the button, the target tableware is tracked and monitored by using the camera device. After detecting the second pressing operation of the button, in response to the second pressing operation, a first acquisition request is sent to the camera device to request the tracking and monitoring results of the camera device.

[0088] Optionally, after responding to the second pressing operation on the button, the dining room sofa sends a confirmation request to the smartphone to confirm with the smartphone user whether it is the user who terminates the tracking and monitoring of the target tableware. If the confirmation information returned by the smartphone is received, and the confirmation information indicates that the termination operation is performed by the user, steps 303-304 are executed, and then the tracking and monitoring process is terminated. If the confirmation information indicates that the termination operation is not performed by the user, the tracking and monitoring is continued, and then step 302 is executed.

[0089] 303. Receive the tracking monitoring result returned by the camera device.

[0090] 304. Send the tracking and monitoring results to the smart phone.

[0091] In step 304, the tracking and monitoring results are directly sent to the smart phone, which is conducive to accurately sending the tracking and monitoring results to the right person, ensuring that the tracking and monitoring is effective.

[0092] Therefore, by implementing the embodiments of the present application, the user can use the camera device through the restaurant sofa to track and monitor the tableware used by the user who temporarily leaves the restaurant sofa, and accurately send the tracking and monitoring results to the user, so that after the user returns, he can know whether the tableware used by the user has been touched by other people (such as used or drugged, etc.) while he was away from the restaurant sofa, which is conducive to improving the safety of dining in the restaurant.

[0093] See also Figure 4 , Figure 4 Schematic diagram of the process of the tableware tracking and monitoring method based on the sofa in the restaurant disclosed in the third embodiment of the present application; Figure 4 As shown, the tableware tracking and monitoring method based on the restaurant sofa may include:

[0094] 401. In response to a first pressing operation on a button on a dining room sofa, a connection is established between the dining room sofa and the smartphone according to a communication request sent by the user's smartphone, and a camera device is used to identify target tableware designated by the user and perform tracking monitoring.

[0095] Among them, the execution subject of the embodiment of the present application is a dining room sofa. For example, the dining room sofa is as follows Figure 1 A button is provided on the sofa in the restaurant. If a first pressing operation on the button is detected, the camera device above the dining table is used to identify the target tableware specified by the user and track and monitor it.

[0096] In some feasible implementations, during the tracking and monitoring process of the camera device, real-time monitoring video is obtained from the camera device; and the real-time monitoring video is sent to the smart phone.

[0097] In the above implementation, during the tracking and monitoring process of the camera device, the dining room sofa also sends a request to the camera device to obtain the real-time monitoring video. Correspondingly, after receiving the request, the camera device will send the real-time monitoring video to the dining room sofa during the tracking and monitoring process.

[0098] Furthermore, obtaining real-time monitoring video from the camera device means: receiving each frame of the image collected in real time from the camera device, and then forwarding it to the smart phone, so that the smart phone can view the status of the target tableware in real time.

[0099] Correspondingly, each frame of the image captured by the camera device in real time is sent to the sofa in the restaurant.

[0100] In some feasible implementations, the above-mentioned use of a camera device to identify the target tableware specified by the user and perform tracking monitoring may include:

[0101] The camera device is used to detect the tableware pointed to by the finger on the dining table and identify it as the target tableware, and then track and monitor the target tableware.

[0102] Among them, for the user, after pressing the button on the dining room sofa, the user points to the tableware on the dining table with his finger. For the dining room sofa, the dining room sofa detects the user's first pressing operation on the button, and uses the camera device above the dining table to identify the tableware pointed to by the finger. For the camera device, the dining table is scanned, and when the user's finger is scanned, the target tableware pointed to by the finger is scanned and analyzed, and then the target tableware is tracked and monitored.

[0103] In the above embodiment, the target tableware pointed by the finger is tracked and monitored directly by the camera device. The camera device can lock and track the target tableware. Therefore, when the user leaves, the target tableware will not be unable to be tracked due to others moving it. Of course, the situation where others remove the target tableware out of its monitoring range is excluded.

[0104] Correspondingly, optionally, when the camera device starts tracking and monitoring the target tableware, if the restaurant sofa receives an instruction from the camera device that the target is removed from the monitoring range, the camera device obtains the tracking monitoring video and then sends it to the smartphone. In the tracking and monitoring process, the camera device can zoom out to capture the person who removed the target tableware in the image, and send a corresponding instruction to the restaurant sofa so that the restaurant sofa can send it to the smartphone in time.

[0105] In some other feasible implementations, the above-mentioned use of a camera device to identify the target tableware specified by the user and perform tracking monitoring may include:

[0106] A camera device is used to scan all the tableware on the dining table, and the image information of all the scanned tableware is pushed to a smart phone for selection. After receiving the selection information returned by the smart phone, an identity acquisition request is sent to the tableware indicated by the selection information, the identity identification returned by the tableware indicated by the selection information is received, and it is identified as the target tableware, and the camera device is used to start tracking and monitoring the target tableware; wherein, identity identification is set on the bottom of all the tableware on the dining table.

[0107] Among them, for the restaurant sofa, in response to the first pressing operation, the camera device is used to scan all the tableware in the restaurant, and then the picture information of all the tableware sent by the camera device is received and pushed to the smart phone. After receiving the selection information returned by the smart phone, an identity acquisition request is sent to the tableware indicated by the selection information, and then it is identified as the target tableware, and the camera device is informed to track and monitor the target tableware using the camera device.

[0108] Optionally, the bottom of the tableware in the restaurant may be provided with an identity tag, and the smart chip built into the tableware stores the identity tag of the tableware. After the tableware receives the identity acquisition request, the smart chip sends the identity tag to the sofa in the restaurant. Furthermore, the smart phone can send the indication information of the target tableware to the camera device, and the camera device starts tracking and monitoring it.

[0109] After executing step 401 , the process proceeds to executing steps 402 - 404 , or proceeds to step 405 .

[0110] 402. In response to a second pressing operation of the button by the user, a first acquisition request is sent to the camera device through the dining room sofa to obtain a tracking monitoring result of the camera device, where the tracking monitoring result is used to indicate whether the target tableware has been moved by others.

[0111] 403. Receive the tracking monitoring result returned by the camera device.

[0112] 404. Send the tracking monitoring result to the smart phone.

[0113] After executing step 404, this process ends.

[0114] 405 During the tracking and monitoring process of the camera device, a first warning notification sent by the camera device is received. The first warning notification is sent to the sofa in the restaurant when the camera device identifies that the target tableware has been moved by others during the tracking and monitoring process.

[0115] In step 405, during the tracking and monitoring process, if the camera device recognizes that the target tableware has been moved by others, a first warning notification is sent to the sofa in the restaurant.

[0116] After executing step 405 , the process may proceed to step 406 and / or step 407 .

[0117] In some feasible implementations, after the target tableware is identified, the method further includes:

[0118] After identifying the target tableware, a connection is established between the restaurant sofa and the target tableware, and a first capacity acquisition request is sent to the target tableware;

[0119] receiving first feedback information sent by the target tableware, where the first feedback information indicates a first capacity, and the first capacity is obtained by the target tableware through a built-in sensor after receiving the first capacity acquisition request;

[0120] Furthermore, during the tracking and monitoring process of the camera device, after receiving the first warning notification sent by the camera device, the method further includes:

[0121] Sending a second capacity acquisition request to the target tableware;

[0122] receiving second feedback information sent by the target tableware, where the second feedback information indicates a second capacity, and the second capacity is obtained by the target tableware through a built-in sensor after receiving a second capacity acquisition request;

[0123] The second capacity and the first capacity are sent to the smartphone.

[0124] In the above implementation, after identifying the target tableware, the dining room sofa can also send a first capacity acquisition request to the target tableware in response to the first pressing operation to acquire the first capacity.

[0125] Optionally, the first capacity is read by the target tableware through a built-in sensor. For example, the first capacity may include the height of the liquid, that is, the height of the liquid in the cup is read by the built-in sensor and then fed back to the dining room sofa.

[0126] After receiving the first warning notification sent by the camera device, a second capacity acquisition request is also sent to the target tableware to acquire the second capacity. The second capacity is read by the target tableware through the built-in sensor. For example, the second capacity may include the height of the liquid, that is, the height of the liquid in the cup is read by the built-in sensor and then fed back to the dining room sofa.

[0127] Through the above implementation, the user can further determine whether the target tableware has been touched by others based on the change in the volume of the liquid in the target tableware, which is more conducive to improving dining safety.

[0128] 406 controls the alarm installed on the sofa in the restaurant to sound an alarm.

[0129] like Figure 1 As introduced, an alarm is installed on the sofa in the restaurant. After receiving the first warning notification, the alarm is sounded through the alarm so that the user or restaurant staff can check it in time.

[0130] Optionally, the dining tableware can also obtain real-time collected video frames from the camera device, and the dining tableware can analyze the video frames to detect whether the target tableware has been moved by others. When it is moved by others, an alarm can be promptly sounded through the alarm.

[0131] When executing step 406 , if the second pressing operation is not received, the tracking monitoring is continued, and then step 402 is executed.

[0132] 407. Send a second acquisition request to the camera device to request the camera device to send a monitored picture or video clip indicating that the target tableware has been touched by others, and the picture or video clip also includes the face of the other person who has touched the target tableware, and the picture or video clip carries a time tag.

[0133] Among them, when the camera device takes pictures or videos, it will carry a time tag. Therefore, the pictures or video clips sent to the restaurant sofa include the time tag, so that the user can determine the specific time when it was touched by others based on the time tag.

[0134] After executing step 407, execute step 408.

[0135] 408. Send a second warning notification carrying the picture or video clip to the smart phone.

[0136] Among them, the restaurant sofa sends pictures or video clips directly to the smartphone for users to view.

[0137] When executing step 406 , if the second pressing operation is not received, the tracking monitoring is continued, and then step 402 is executed.

[0138] The dining sofa can be used to track and monitor the tableware used by diners who temporarily leave the sofa, so that when the diners return, they can know whether the tableware used by the diner has been touched by others (such as used or drugged, etc.) during the period when the diner left the sofa, which is conducive to improving the safety of dining in the restaurant.

[0139] See also Figure 5 , Figure 5 This is a structural diagram of a dining room sofa disclosed in Example 1 of this application; Figure 5 As shown, the dining room sofa may include:

[0140] Monitoring module 510, for responding to a first pressing operation of a button set on a sofa in a dining room by a user, identifying target tableware designated by the user by using a camera device above the dining table and performing tracking monitoring;

[0141] The communication module 520 is used for sending a first acquisition request to the camera device through the dining room sofa in response to the second pressing operation of the button by the user, so as to obtain the tracking monitoring result of the camera device, wherein the tracking monitoring result is used to indicate whether the target tableware has been moved by others;

[0142] The communication module 520 is further used to receive the tracking and monitoring result returned by the camera device;

[0143] The display module 530 is used to display the tracking and monitoring results to the user.

[0144] When implementing the above-mentioned restaurant sofa, the monitoring module 510 responds to the user's first pressing operation on the button set on the restaurant sofa, and uses the camera device above the dining table to identify the target tableware specified by the user and track and monitor it. Then, the communication module 520 responds to the user's second pressing operation on the button, and sends a first acquisition request to the camera device through the restaurant sofa to obtain the tracking and monitoring result of the camera device, which is used to indicate whether the target tableware has been moved by others, receives the tracking and monitoring result returned by the camera device, and then the display module 530 displays the tracking and monitoring result to the user; it can be seen that the embodiment of the present application uses the restaurant sofa to track and monitor the tableware used by the diners who temporarily leave the restaurant sofa, so that the diners can know after returning whether the tableware used by the diner has been moved by others (such as used or drugged, etc.) during the period when the diner left the restaurant sofa, which is conducive to improving the safety of restaurant dining.

[0145] In some feasible implementations, the monitoring module 510 is used to respond to the user's first pressing operation on the button set on the sofa in the restaurant, and use the camera device above the dining table to identify the target tableware specified by the user and perform tracking monitoring in the following manner:

[0146] In response to the first pressing operation, a connection is established between the dining room sofa and the smartphone according to a communication request sent by the smartphone of the user, the target tableware specified by the user is identified by the camera device and tracked and monitored, and the dining room sofa is used in conjunction with the dining table;

[0147] The display module 530 is used to display the tracking and monitoring results to the user in the following specific manners:

[0148] The tracking and monitoring result is sent to the smart phone.

[0149] like Figure 6 As shown, Figure 6 This is a structural schematic diagram of a dining room sofa disclosed in Example 2 of this application. Figure 6 The dining room sofa shown is in Figure 5 The optimization is performed on the basis of the restaurant sofa shown in FIG. Figure 6 As shown, the dining room sofa also includes: an alarm module 610.

[0150] The communication module 520 is further used to receive a first warning notification sent by the camera device during the tracking and monitoring process of the camera device, wherein the first warning notification is sent to the sofa in the restaurant when the camera device identifies that the target tableware has been moved by others during the tracking and monitoring process;

[0151] The alarm module 610 is used to control the alarm device installed on the sofa in the restaurant to sound an alarm.

[0152] In some feasible implementations, the communication module 520 is further used to send a second acquisition request to the camera device after receiving a first warning notification sent by the camera device during the tracking and monitoring process of the camera device, so as to request the camera device to send a monitored picture or video clip indicating that the target tableware has been moved by others, and the picture or video clip also includes the face of the other person who has moved the target tableware, and the picture or video clip carries a time tag;

[0153] The communication module 520 is further configured to send a second warning notification carrying the picture or video clip to the smart phone.

[0154] In some feasible implementations, the communication module 520 is also used to obtain real-time monitoring video from the camera device during the tracking and monitoring process of the camera device, and send the real-time monitoring video to the smart phone, so that the smart phone can view the status of the target tableware in real time.

[0155] In some feasible implementations, the monitoring module 510 is used to use a camera device to identify the target tableware specified by the user and perform tracking monitoring in the following specific manners:

[0156] Using the camera device to detect the tableware pointed to by the finger on the dining table, and identifying it as the target tableware, and starting tracking and monitoring the target tableware;

[0157] Alternatively, all the tableware on the dining table is scanned using the camera device, and image information of all the scanned tableware is pushed to the smart phone for selection, and after receiving the selection information returned by the smart phone, an identity acquisition request is sent to the tableware indicated by the selection information, the identity identification returned by the tableware indicated by the selection information is received, and the tableware is identified as the target tableware, and tracking and monitoring of the target tableware is started; wherein, identity identification is set on the bottom of all the tableware on the dining table.

[0158] In the above embodiment, the target tableware pointed by the finger is tracked and monitored directly by the camera device. The camera device can lock and track the target tableware. Therefore, when the user leaves, the target tableware will not be unable to be tracked due to others moving it. Of course, the situation where others remove the target tableware out of its monitoring range is excluded.

[0159] In some feasible implementations, the communication module 520 is further used to establish a connection between the dining room sofa and the target tableware after identifying the target tableware, and send a first capacity acquisition request to the target tableware; receive first feedback information sent by the target tableware, the first feedback information indicating a first capacity, and the first capacity is obtained by the target tableware through a built-in sensor after receiving the first capacity acquisition request;

[0160] Furthermore, the communication module 520 is also used to send a second capacity acquisition request to the target tableware after receiving a first warning notification sent by the camera device during the tracking and monitoring process of the camera device; and, receive second feedback information sent by the target tableware, the second feedback information indicating a second capacity, and the second capacity is obtained by the target tableware through a built-in sensor after receiving the second capacity acquisition request; and, send the second capacity and the first capacity to the smart phone.

[0161] See also Figure 7 , Figure 7 This is a structural diagram of a dining room sofa disclosed in Example 3 of this application; Figure 7 As shown, the dining room sofa may include:

[0162] A memory 701 storing a computer program;

[0163] a processor 702 coupled to the memory;

[0164] The processor calls the computer program stored in the memory to execute Figures 2 to 4 Any partial or complete steps of a tableware tracking and monitoring method based on a restaurant sofa.

[0165] The present application also discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute Figures 2 to 4 A tableware tracking and monitoring method based on a restaurant sofa is disclosed.

[0166] The present application also discloses a computer program product, which, when executed on a computer, enables the computer to execute Figures 2 to 4 Part or all of the steps of any disclosed method.

[0167] The embodiment of the present application also discloses an application publishing platform, which is used to publish a computer program product, wherein when the computer program product is run on a computer, the computer executes Figures 2 to 4 Part or all of the steps of any disclosed method.

[0168] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0169] The above is a detailed introduction to a tableware tracking and monitoring method based on a dining room sofa, a dining room sofa and a storage medium disclosed in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for a general technician in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A tableware tracking and monitoring method based on a restaurant sofa, characterized in that: The method comprises: In response to a first pressing operation of a button set on a sofa in a dining room by a user, a camera device above the dining table is used to identify target tableware designated by the user and to perform tracking monitoring; In response to the user's second pressing operation on the button, a first acquisition request is sent to the camera device through the dining room sofa to obtain a tracking monitoring result of the camera device, wherein the tracking monitoring result is used to indicate whether the target tableware has been moved by others; Receiving the tracking and monitoring result returned by the camera device; The tracking and monitoring results are displayed to the user.

2. The method according to claim 1, characterized in that In response to the user's first pressing operation on a button set on the sofa in the restaurant, the camera device above the dining table is used to identify the target tableware specified by the user and perform tracking monitoring, including: In response to the first pressing operation, a connection is established between the dining room sofa and the smartphone according to a communication request sent by the smartphone of the user, and the target tableware specified by the user is identified by the camera device and tracked and monitored; The displaying the tracking and monitoring result to the user includes: The tracking and monitoring result is sent to the smart phone.

3. The method according to claim 2, characterized in that The method further comprises: During the tracking and monitoring process of the camera device, receiving a first warning notification sent by the camera device, wherein the first warning notification is sent to the sofa in the restaurant when the camera device identifies that the target tableware has been moved by others during the tracking and monitoring process; The alarm device arranged on the sofa in the dining room is controlled to sound an alarm.

4. The method according to claim 3, characterized in that: During the tracking and monitoring process of the camera device, after receiving a first warning notification sent by the camera device, the method further includes: Sending a second acquisition request to the camera device to request the camera device to send a monitored picture or video clip indicating that the target tableware has been touched by another person, and the picture or video clip also includes the face of the other person who has touched the target tableware, and the picture or video clip carries a time tag; A second warning notification carrying the picture or video clip is sent to the smart phone.

5. The method according to any one of claims 2 to 4, characterized in that: The method further comprises: During the tracking and monitoring process of the camera device, obtaining real-time monitoring video from the camera device; The real-time monitoring video is sent to a smart phone.

6. The method according to claim 2, characterized in that The method of using the camera device to identify the target tableware specified by the user and perform tracking monitoring includes: Using the camera device to detect the tableware pointed to by the finger on the dining table, and identifying it as the target tableware, and starting tracking and monitoring the target tableware; Alternatively, all the tableware on the dining table is scanned using the camera device, and image information of all the scanned tableware is pushed to the smart phone for selection, and after receiving the selection information returned by the smart phone, an identity acquisition request is sent to the tableware indicated by the selection information, the identity identification returned by the tableware indicated by the selection information is received, and the tableware is identified as the target tableware, and tracking and monitoring of the target tableware is started; wherein, identity identification is set on the bottom of all the tableware on the dining table.

7. The method according to claim 3, characterized in that After identifying the target tableware, the method further includes: Establishing a connection between the dining room sofa and the target tableware, and sending a first capacity acquisition request to the target tableware; receiving first feedback information sent by the target tableware, where the first feedback information indicates a first capacity, and the first capacity is obtained by the target tableware through a built-in sensor after receiving the first capacity acquisition request; During the tracking and monitoring process of the camera device, after receiving a first warning notification sent by the camera device, the method further includes: Sending a second capacity acquisition request to the target tableware; receiving second feedback information sent by the target tableware, where the second feedback information indicates a second capacity, and the second capacity is obtained by the target tableware through a built-in sensor after receiving the second capacity acquisition request; The second capacity and the first capacity are sent to the smart phone.

8. A dining room sofa, characterized in that: include: A monitoring module, for responding to a first pressing operation of a button set on a sofa in a dining room by a user, using a camera device above the dining table to identify target tableware designated by the user and to perform tracking monitoring; a communication module, configured to send a first acquisition request to the camera device through the dining room sofa in response to the second pressing operation of the button by the user, so as to obtain a tracking and monitoring result of the camera device, wherein the tracking and monitoring result is used to indicate whether the target tableware has been moved by others; The communication module is further used to receive the tracking and monitoring result returned by the camera device; A display module is used to display the tracking and monitoring results to the user.

9. A dining room sofa, characterized in that: include: a memory storing a computer program; a processor coupled to the memory; The processor calls the computer program stored in the memory to execute the tableware tracking and monitoring method based on a dining room sofa as described in any one of claims 1-7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images