Control method, device and equipment for use permission of refrigerator

Abstract

The embodiment of the invention relates to the field of smart home equipment control, and discloses a control method, device and equipment for use permission of a refrigerator, and the method comprises the steps: collecting user image features of a first user who opens the refrigerator at present, and querying whether limiting information for limiting the use of the refrigerator corresponding to the first user is stored in a preset permission library or not; when the first limit information corresponding to the first user is inquired, whether the storage area limited to be used by the first user reaches the use upper limit value or not is judged according to the historical behavior information of the first user using the refrigerator; when it is judged that the first user does not reach the use upper limit value for the storage area limited to be used, the storage area is controlled to be in an openable state; when it is judged that the use upper limit value of the storage area limited to be used by the first user is reached, the storage area is set to be in an unopenable state. According to the technical scheme, flexible control over the use permission of the refrigerator can be achieved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of smart home device control, and in particular to a method, device and equipment for controlling the use authority of a refrigerator. Background Art

[0002] Children have poor self-control over the intake of foods such as candy and cold drinks. In order to ensure their children's healthy diet, parents will limit the number of times their children eat such foods. Smart refrigerators with child lock function can help parents control their children's diet.

[0003] Current refrigerators with the function of restricting opening rights usually directly authenticate the identity of the user in front of the refrigerator by setting an identity recognition module on the refrigerator door, and then automatically control whether to open the refrigerator access permission based on the user's identity. In this way, the refrigerator automatically controls the refrigerator access permission through pre-set rules, and lacks the flexibility to control the refrigerator access permission. Summary of the invention

[0004] The purpose of the present invention is to at least provide a method, device and equipment for controlling the use rights of a refrigerator, which can at least solve the problem that current refrigerators lack the flexibility to control the use rights of the refrigerator, and at least achieve the effect of being able to flexibly control the use rights of the refrigerator.

[0005] In order to solve the above technical problems, at least one embodiment of the present application provides a method for controlling the use authority of a refrigerator, comprising:

[0006] Collecting the user image feature of the first user who currently opens the refrigerator, and querying whether the preset permission library stores restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library stores multiple restriction information, each of which includes the user image feature, storage area and upper limit value of the use restricted by the user;

[0007] After the first restriction information corresponding to the first user is queried, judging whether the first user has reached the upper limit of the storage area restricted from use according to the historical behavior information of the first user using the refrigerator;

[0008] When it is determined that the first user has not reached the upper limit of the storage area that is restricted from use, controlling the storage area to be in an openable state;

[0009] When it is determined that the first user has reached an upper limit of usage of the storage area that is restricted from use, the storage area is set to a non-openable state.

[0010] At least one embodiment of the present application further provides a device for controlling the use authority of a refrigerator, comprising:

[0011] A collection module, used to collect the user image features of the first user who currently opens the refrigerator, and query whether the preset permission library stores the restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library stores a plurality of restriction information, each of which includes the user image features, storage area and upper limit value of the use of the restricted user;

[0012] a judgment module, configured to, after querying the first restriction information corresponding to the first user, judge whether the first user has reached the upper limit of the storage area restricted from use according to the historical behavior information of the first user using the refrigerator;

[0013] A control module, configured to control the storage area to be in an openable state when it is determined that the storage area restricted for use by the first user has not reached an upper limit of usage;

[0014] The setting module is used to set the storage area to a non-openable state when it is determined that the storage area restricted for use by the first user has reached an upper limit of usage.

[0015] At least one embodiment of the present application also provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the above-mentioned method for controlling the use authority of the refrigerator.

[0016] At least one embodiment of the present application further provides a computer-readable storage medium storing a computer program, wherein the computer program implements the above-mentioned method for controlling the use authority of the refrigerator when executed by a processor.

[0017] The embodiment of the present application provides a method, device and equipment for controlling the use right of a refrigerator, which collects the user image features of the first user who currently opens the refrigerator, and queries whether the preset permission library stores the restriction information corresponding to the first user for limiting the use of the refrigerator, wherein the permission library stores multiple restriction information, each of which includes the image features of the user whose use is restricted, the storage area and the upper limit of use; after the first restriction information corresponding to the first user is queried, it is determined whether the storage area restricted by the first user has reached the upper limit of use according to the historical behavior information of the first user using the refrigerator; when it is determined that the storage area restricted by the first user has not reached the upper limit of use, the storage area is controlled to be in an openable state; when it is determined that the storage area restricted by the first user has reached the upper limit of use, the storage area is set to a non-openable state. Flexible control of the use right of the refrigerator can be achieved.

[0018] In some optional embodiments, the method for controlling the use authority of the refrigerator further includes:

[0019] Receive the remote control setting of the authority management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the authority library.

[0020] The restriction information for limiting the use of the refrigerator is set by remote control of the permission management device, which is not affected by time and geographical location, and the restriction information can be set regardless of the time and location of the user holding the permission management device. The restriction information for limiting the use of the refrigerator is generated locally and stored in the permission library, which can facilitate the user to query and call the restriction information.

[0021] In some optional embodiments, the receiving remote control setting of the permission management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the permission library includes:

[0022] receiving an image of a user who is restricted from using the refrigerator, a storage area and an upper limit value of usage entered by the authority management device in a preset authority setting interface of the authority management device;

[0023] generating a user image feature of the user image, and associating the user image feature with the received storage area and usage upper limit value to form a piece of restriction information, and storing the piece of restriction information in the permission library;

[0024] The usage upper limit value includes at least one of the number of times of use, the number of days of use, the period of use and the frequency of use.

[0025] Among them, by associating the user image features with the received storage area and usage upper limit value to form the restriction information, and storing it in the permission library, a correspondence can be established between the first user using the refrigerator and the restriction information, which is stored in the permission library for easy viewing and calling, thereby facilitating the permission control of the first user's use of the refrigerator and ensuring the first user's healthy diet.

[0026] In some optional embodiments, when it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes:

[0027] In response to the request operation for opening the storage area, executing a request process for initiating a request to the authority management device to open the storage area;

[0028] When the request process is completed and an instruction to open the storage area is received from the authority management device, the storage area is opened;

[0029] When the request process is completed and an instruction to not open the storage area is received from the authority management device, the storage area is kept in a non-openable state.

[0030] Among them, the refrigerator controls the storage area of ​​the refrigerator to switch to an open state or remain in a closed state according to the instruction to open the storage area or the instruction to close the storage area sent by the permission management device, which can realize flexible control of the use authority of the refrigerator storage area, which is beneficial to the user's dietary health.

[0031] In some optional embodiments, the request process includes:

[0032] A video call requesting to open the storage area is initiated to the authority management device, and an instruction of whether to open the storage area is received from the authority management device based on the video call.

[0033] Among them, it is convenient and quick to contact the user who holds the permission management device through video call to discuss changing the upper limit of the usage of the restricted refrigerator.

[0034] In some optional embodiments, when it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes:

[0035] When it is detected that the first user attempts to open the storage area, a reminder message is sent to the permission management device, the reminder message including: information of the first user, information of the storage area attempted to be opened, and the upper limit value of the first user's usage of the storage area attempted to be opened.

[0036] Among them, when it is detected that the first user attempts to open the storage area, a reminder message is sent to the permission management device. When the first user exceeds the permission to use the refrigerator, a reminder can be sent to the user holding the permission management device, so that the user holding the permission management device can know the use of the refrigerator by the first user in time and take action.

[0037] In some optional embodiments, after sending the reminder information to the rights management device, the method further includes:

[0038] After receiving the instruction from the permission management device to allow the storage area to be opened this time, controlling the storage area to be in an openable state, and sending a reminder through the refrigerator that the storage area is in an openable state;

[0039] Upon receiving an adjustment value of the usage upper limit for the storage area that the first user attempts to open sent by the permission management device, the usage upper limit is updated according to the adjustment value, and when the updated usage upper limit is greater than the original usage upper limit, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued through the refrigerator.

[0040] Among them, flexible control of the storage area of ​​the refrigerator can be achieved by adjusting the upper limit of the use of the refrigerator. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] One or more embodiments are exemplarily described by the pictures in the corresponding drawings, and these exemplary descriptions do not constitute limitations on the embodiments.

[0042] Figure 1 is a flow chart of a method for controlling the use authority of a refrigerator provided in an embodiment of the present application;

[0043] Figure 2 is a schematic diagram of a flow chart for setting refrigerator use permissions provided in an embodiment of the present application;

[0044] Figure 3 is another flow chart of a method for controlling the use authority of a refrigerator provided in an embodiment of the present application;

[0045] Figure 4 It is a module schematic diagram of a refrigerator usage authority control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. However, it will be appreciated by those skilled in the art that in the present application, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can also be implemented. The division of the following embodiments is for the convenience of description, and the specific implementation of the present application should not be construed as any limitation, and the various embodiments can be combined and referenced with each other under the premise of no contradiction.

[0047] This application adopts a design mode of front-end and back-end separation, with the front-end responsible for user interface display and interaction logic, and the back-end responsible for data processing and storage. Cloud computing and big data technologies are introduced to realize real-time analysis and processing of data; this application adopts deep learning algorithms, combined with image data captured by the camera, to achieve high-precision face recognition and body shape recognition, store access permission settings for each area in the database, and allow administrators to customize settings through the front-end interface; this application integrates voice recognition and synthesis technology to realize the recognition and feedback of voice commands, and at the same time, remote control and monitoring are realized through network communication protocols; video call SDK (Software Development Kit) and instant messaging protocols are integrated to realize video calls and instant messaging functions between parents and children. Data encryption technology is used to protect the security of stored and transmitted data, while complying with relevant privacy protection laws and regulations; this application designs a simple and easy-to-use user interface to ensure that both parents and children can operate easily, and provides detailed operation guides and troubleshooting manuals to reduce the user's learning cost.

[0048] This application can identify the situation of users opening the refrigerator through the camera set on the refrigerator. The administrator can customize the opening and closing time and number limit of the popsicle area. For example, set a restriction command that children at home can open the popsicle area three times within five days. However, if it is necessary to open it due to special circumstances and want to continue to maintain this permission command, the user can use the smart voice to say "open" or select special circumstances on the APP (Application) to modify the refrigerator's usage permissions, open the refrigerator's storage area, and reply to the previous restriction command again after use. If the administrator is not present when the user's usage permissions are restricted, the user can click on the screen on the refrigerator to connect to the administrator for a voice or video call. With the administrator's consent, the storage area of ​​the refrigerator can be opened and the user can take food by himself.

[0049] In order to solve the above-mentioned technical problem that current refrigerators lack flexibility in controlling refrigerator usage permissions, the present invention proposes a method for controlling refrigerator usage permissions. The implementation details of the method for controlling refrigerator usage permissions of this embodiment are specifically described below. The following content is only the implementation details provided for ease of understanding and is not necessary for implementing this solution.

[0050] Embodiment 1:

[0051] The method for controlling the use authority of a refrigerator in this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The specific process can be as follows: Figure 1 As shown, including:

[0052] Step 101, collecting the user image feature of the first user who currently opens the refrigerator, and querying whether the preset permission library stores restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library stores multiple restriction information, each restriction information includes the user image feature, storage area and upper limit value of the restricted use;

[0053] Step 102, after the first restriction information corresponding to the first user is queried, judging whether the storage area restricted for use by the first user has reached the upper limit value according to the historical behavior information of the first user using the refrigerator;

[0054] Step 103, when it is determined that the storage area restricted for use by the first user has not reached the upper limit of use, controlling the storage area to be in an openable state;

[0055] Step 104 : when it is determined that the storage area restricted for use by the first user has reached the upper limit of usage, the storage area is set to a non-openable state.

[0056] In this embodiment, by collecting the user image features of the first user who currently opens the refrigerator, and querying whether the preset permission library stores the restriction information corresponding to the first user for limiting the use of the refrigerator, the permission library pre-stores multiple restriction information, each restriction information includes the image features of the user whose use is restricted, the storage area and the upper limit of use; after querying the first restriction information corresponding to the first user, according to the historical behavior information of the first user using the refrigerator, it is judged whether the storage area restricted by the first user has reached the upper limit of use; when it is judged that the storage area restricted by the first user has not reached the upper limit of use, the storage area is controlled to be in an openable state; when it is judged that the storage area restricted by the first user has reached the upper limit of use, the storage area is set to a non-openable state. Flexible control of the refrigerator use authority can be achieved.

[0057] Embodiment 2:

[0058] The method for controlling the use authority of a refrigerator in this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The implementation details of steps 101 to 104 described in the above embodiment 1 are specifically described below. The following content is only the implementation details provided for ease of understanding and is not necessary for the implementation of this solution.

[0059] The step 101 collects the user image features of the first user who currently opens the refrigerator, and queries whether the preset permission library stores restriction information corresponding to the first user for restricting the use of the refrigerator. The permission library pre-stores multiple restriction information, and each restriction information includes the image features of the user whose use is restricted, the storage area and the upper limit of use.

[0060] The user image features include the user's facial features and body contour features.

[0061] It should be noted that the first user can be a specific person or a specific group of people, such as children or the elderly. By setting usage permissions for the storage area of ​​the refrigerator, the first user's intake of food in the storage area can be controlled, thereby ensuring the first user's healthy diet.

[0062] When the first user opens the refrigerator, the refrigerator starts to collect the user image features of the first user and confirms the user identity of the first user, so that the refrigerator queries the preset permission library based on the identity of the first user to see whether the restriction information on the use of the refrigerator corresponding to the first user is stored, thereby determining the restricted user image features corresponding to the first user, the restricted storage area, and the restricted usage upper limit.

[0063] Specifically, in some embodiments, step 101 may include:

[0064] Step 1011, collecting a face image and a body image of a first user, and extracting face features and body contour features therefrom;

[0065] Step 1012, identifying and scoring the similarity of the facial features and body contour features of the first user with the facial features and body contour features in each of the restriction information in the permission library, to obtain a facial recognition score and a body shape recognition score;

[0066] Step 1013: Determine whether restriction information on refrigerator use corresponding to the first user is stored in the permission library based on the face recognition score and body shape recognition score corresponding to the first user.

[0067] The face image and body image of the first user can be captured by a camera installed on the refrigerator, so that the facial features and body contour features such as height and body shape of the first user can be accurately identified, thereby preventing the user from trying to unlock the storage area of ​​the refrigerator by disguising himself or using tools.

[0068] It should be noted that a physical baffle is provided for the camera, and the user can choose whether to enable the camera function as needed.

[0069] In specific implementation, the processing process of step 101 includes:

[0070] Collecting a user feature image of the user who currently opens the refrigerator;

[0071] Cutting the user feature image, extracting the user's face area image and the body image including the user's upper body area;

[0072] Extracting a user's facial feature vector from the user's face region image, and extracting a user's body shape feature vector from the user's body shape image;

[0073] The feature extraction model is used to calculate the face recognition score and body shape recognition score of the user respectively, wherein the face recognition score is used to represent the similarity between the face feature vector of the user and the face template feature vector pre-stored in the database for describing the face features of the user, and the body shape recognition score is used to represent the similarity between the body shape feature vector of the user and the body shape template feature vector pre-stored in the database for describing the body shape features of the user;

[0074] Calculate a comprehensive identity verification score representing the user's identity using a logistic regression or weighted average algorithm based on the face recognition score and the body shape recognition score;

[0075] If the identity authentication score is greater than a preset threshold, the user identity of the user currently using the refrigerator is identified as the first identity; otherwise, the user identity of the user currently using the refrigerator is identified as the second identity.

[0076] The facial features and body contour features of the first user are respectively identified and scored for similarity with the facial features and body contour features in each piece of restriction information in the permission library to obtain a facial recognition score and a body shape recognition score, including:

[0077] The facial features of the first user and the facial features in the restriction information in the permission library are recognized and scored for similarity using the following formula to obtain the facial recognition score:

[0078] Identity face =sim(f,f i )

[0079] Among them, the Identity face is the face recognition score, f is the feature vector of the face feature of the first user, and f i is the feature vector of the facial features contained in the i-th restriction information in the database; the sim(, *) is a similarity operator;

[0080] The body contour feature of the first user and the body contour feature in the restriction information in the permission library are identified and scored for similarity using the following formula to obtain the body contour recognition score:

[0081] Identity body =sim(t,t j )

[0082] Among them, the Identitybody is the body contour recognition score, t is the feature vector of the body contour feature of the first user, and t j is the feature vector of the body contour feature contained in the j-th restriction information in the database, and the sim(*), *) is a similarity operator.

[0083] The determining, according to the face recognition score and the body recognition score corresponding to the first user, whether the permission library stores restriction information on the use of the refrigerator corresponding to the first user includes:

[0084] The comprehensive recognition score corresponding to the first user is calculated by the following formula:

[0085] Auth=α·Identity face +β·Identity body

[0086] Wherein, Auth is the comprehensive recognition score, α and β are weight parameters, and Identity face is the face recognition score corresponding to the first user, the Identity body The body shape recognition score corresponding to the first user.

[0087] In this way, the identity of the first user can be accurately and quickly identified, and the restriction information on the use of the refrigerator corresponding to the first user can be queried according to the identity of the first user.

[0088] It should be noted that the user's identity can also be verified by asking the user to perform blink detection or facial expression detection, thereby preventing the user from disguising himself by using photos or other means.

[0089] Specifically, in some embodiments, before step 101, the method further includes:

[0090] Step 100, receiving the remote control settings of the authority management device to locally generate restriction information for restricting the use of the refrigerator and store it in the authority library.

[0091] Among them, the permission management device can be a mobile phone in the user's hand, or it can be a tablet computer, computer and other devices. The user can set specific restriction information for the use of the refrigerator for different storage areas through the APP associated with the refrigerator set in the permission management device or directly on the refrigerator touch screen. Specifically, it may include: time period, for example: the storage area is only allowed to be opened after 3 pm, number of visits, for example: the storage area is allowed to be opened three times within five days, etc. A combination of various restriction information can be formulated to meet the actual needs of different user groups.

[0092] Through the APP associated with the refrigerator, users can view the refrigerator's usage records, modify restrictions on the use of the refrigerator, receive abnormal access alarms, and directly initiate video or voice calls with the user in front of the refrigerator through the APP.

[0093] Furthermore, in some embodiments, step 100 may include:

[0094] Step 1001, receiving the user image, storage area and usage upper limit value of the refrigerator that are restricted from using the refrigerator entered by the authority management device in the preset authority setting interface of the authority management device;

[0095] Step 1002, generating a user image feature of the user image, and associating the user image feature with the received storage area and the usage upper limit value to form a restriction information, and storing it in the permission library;

[0096] The upper limit of usage includes at least one of the number of times of usage, the number of days of usage, the period of usage and the frequency of usage.

[0097] Among them, the image features of the generated user image are associated with the pre-set user image of the restricted refrigerator, the restricted storage area, and the restricted usage upper limit to form a restriction information, and stored in the permission library. In this way, a correspondence between the user of the refrigerator and the permission information of the restricted refrigerator can be generated, which is convenient for the user to query the corresponding refrigerator usage permission when using the refrigerator.

[0098] In specific implementation, when the refrigerator camera captures a user approaching the refrigerator, the face recognition function is enabled, and the captured user image features are compared with the pre-stored user image of the refrigerator to confirm the user's identity. If the user using the refrigerator is identified as a child, the restriction information corresponding to the child will be automatically applied. If the user identity identification fails, the user can be prompted to try again or manually confirm the user's identity through the APP of the permission management device. After confirming the user's identity, the restriction information corresponding to the user is automatically applied. The restriction information can be loaded from the refrigerator's local storage or the cloud server. The restriction information can specifically include: the child can open the popsicle area three times within five days.

[0099] In step 102, after the first restriction information corresponding to the first user is queried, it is determined whether the storage area restricted from use by the first user has reached the upper limit of use according to the historical behavior information of the first user using the refrigerator.

[0100] In step 103, when it is determined that the storage area restricted for use by the first user has not reached the upper limit of use, the storage area is controlled to be in an openable state.

[0101] Among them, after the first restriction information corresponding to the first user is queried, the refrigerator can determine whether the first user has reached the upper limit of usage of the storage area that is restricted from use by comparing the first user's historical behavior information of using the refrigerator with the first restriction information. When the judgment result is that the first user has not reached the upper limit of usage of the storage area that is restricted from use, the storage area is controlled to be in an openable state, and the first user can open the storage area and take the food therein by himself.

[0102] In specific implementation, for example: the restriction information for children is that the popsicle area can be opened three times within five days, then the number of times the child has opened the popsicle area within the current five days can be confirmed by querying the refrigerator log. If the number of openings is less than three times, the popsicle area is unlocked. If the number of openings is greater than or equal to three times, the popsicle area is controlled to remain locked.

[0103] The refrigerator log can record the time when the user opens the refrigerator, the user identity, the opening area, and the access results. These data can be used for analysis and to adjust the restriction information based on the analysis results.

[0104] It should be noted that restriction information can be set and updated through the refrigerator touch screen or the APP on the permission management device, and the updated restriction information can be stored locally or in a cloud server. The refrigerator applies the latest restriction information in real time to ensure that the user's behavior of opening the refrigerator complies with the currently set restriction information.

[0105] Specifically, in some embodiments, after step 104, the following steps may also be included:

[0106] Step 105, in response to the request operation for opening the storage area, executing a request process for initiating a request to the authority management device to open the storage area;

[0107] Step 106, when the request process is completed and an instruction to open the storage area is received from the rights management device, the storage area is opened;

[0108] Step 107, when the request process is completed and an instruction to disable the storage area is received from the rights management device, the storage area is kept in a disabled state.

[0109] Among them, when the first user reaches the upper limit of the use of the refrigerator and wants to continue to open the storage area, the first user performs a request operation on the refrigerator to request to open the storage area, so that the refrigerator responds to the request operation to open the storage area, and executes the request process of initiating a request to open the storage area to the authority management device. When the request process ends, if the refrigerator receives an instruction to open the storage area sent by the authority management device, the refrigerator executes the instruction to open the storage area, opens the storage area of ​​the refrigerator, and the storage area of ​​the refrigerator is unlocked. The first user can take food from the storage area independently. If the refrigerator receives an instruction sent by the authority management device not to open the storage area, the refrigerator executes the instruction not to open the storage area, does not open the storage area of ​​the refrigerator, and the storage area of ​​the refrigerator remains locked.

[0110] Furthermore, in some embodiments, in step 105, the request process may include:

[0111] Step 105A: Initiate a video call to request the authority management device to open the storage area, and receive an instruction from the authority management device on whether to open the storage area based on the video call.

[0112] Among them, an intuitive communication interface is designed on the screen of the refrigerator, which has the contact information of the user of the permission management device preset in the communication interface. For example, when the first user is a child, and the child is restricted from opening the storage area of ​​the refrigerator, the child can initiate a video or voice call to the permission management device through the refrigerator with one click to request temporary unlocking. The parent holding the permission management device can confirm the child's needs during the call and decide whether to remotely unlock the storage area of ​​the refrigerator.

[0113] Specifically, in some embodiments, after step 104, the following steps may also be included:

[0114] Step 108, when it is detected that the first user attempts to open a storage area, a reminder message is sent to the permission management device, the reminder message including: information of the first user, information of the storage area attempted to be opened, and an upper limit value of the first user's usage of the storage area attempted to be opened.

[0115] Among them, when the first user reaches the usage upper limit of the refrigerator and still attempts to open the storage area, the refrigerator will send a reminder message to the permission management device, informing the user holding the permission management device that the first user is trying to open the storage area, so that the user holding the permission management device knows that the first user is trying to open the storage area. The user holding the permission management device can persuade the first user in front of the refrigerator through the APP associated with the refrigerator to give up opening the storage area of ​​the refrigerator, or contact the first user by directly calling the first user to persuade him.

[0116] Furthermore, in some embodiments, in step 108, after sending the reminder information to the rights management device, the following may also be included:

[0117] Step 108A, after receiving the instruction from the authority management device to allow the storage area to be opened this time, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued through the refrigerator;

[0118] Step 108B, when the adjustment value of the usage upper limit of the storage area that the first user attempts to open is received from the permission management device, the usage upper limit is updated according to the adjustment value, and when the updated usage upper limit is greater than the original usage upper limit, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued through the refrigerator.

[0119] When receiving the instruction sent by the authority management device to allow the storage area to be opened this time, it means that the first user has not reached the upper limit of the use of the refrigerator, and the refrigerator controls the storage area to be in an openable state, and issues a reminder that the storage area is in an openable state, informing the user holding the authority management device that the storage area of ​​the refrigerator can be opened;

[0120] When an adjustment value of the usage upper limit of the storage area that the first user attempted to open is received from the permission management device, it means that the first user's usage of the refrigerator has reached the usage upper limit, and the user holding the permission management device allows the first user to open the storage area of ​​the refrigerator again, the refrigerator updates the usage upper limit according to the adjustment value, and when the updated usage upper limit is greater than the original usage upper limit, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued, informing the user holding the permission management device that the storage area of ​​the refrigerator can be opened.

[0121] In specific implementation, when the first user has reached the upper limit of usage of the refrigerator and the user holding the permission management device allows the first user to open the storage area of ​​the refrigerator again, the user holding the permission management device can select special situation unlocking through the APP, or use the voice command: "Open storage area" to achieve temporary unlocking. The refrigerator records this unlocking as a special situation and does not count it in the regular opening times. After opening the refrigerator storage area, the refrigerator automatically restores the previous restriction rules.

[0122] Embodiment three:

[0123] The method for controlling the use authority of the refrigerator in this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The refrigerator also has voice assistant, education guidance, and data encryption and anonymity processing functions. The implementation details of these functions are described in detail below. The following content is only the implementation details provided for easy understanding and is not necessary for the implementation of this solution.

[0124] In some embodiments, the refrigerator has a built-in intelligent voice assistant that supports natural language processing. Users holding permission management devices can temporarily unlock specific areas through voice commands, for example: refrigerator, let Xiao Ming eat one more popsicle today. At the same time, the voice assistant confirms the operation and records it as a special case, and automatically restores the original restrictions after the operation.

[0125] Among them, when processing a temporary unlocking request, the voice assistant should confirm the operation to the user, for example: the popsicle area has been temporarily unlocked for you, Xiao Ming can eat a popsicle once today.

[0126] The voice assistant can provide clear feedback through voice prompts after each operation, such as successful unlocking or restored permissions, to ensure that the user knows whether the operation is successful, thereby ensuring the recognition accuracy of voice commands and avoiding misoperation.

[0127] In specific implementation, the user holding the permission management device sends a command to the refrigerator through a voice command, such as "Refrigerator, let Xiao Ming eat one more popsicle today". After receiving the voice command, the voice assistant can use NLP (Natural Language Processing) technology to parse the command content, identify the operation object in the command, that is, the popsicle area, and the user identity, that is, Xiao Ming, check Xiao Ming's current permissions, and confirm that three unlock times have been used up this week. The system marks this operation as a special case and temporarily unlocks the popsicle area, allowing Xiao Ming to open the popsicle area again. The voice assistant confirms the operation to the user: "The popsicle area has been temporarily unlocked for you. Xiao Ming can eat one more popsicle today." The system records this temporary unlocking operation in the log for subsequent tracking and recovery. After this temporary unlocking operation is completed, the system automatically restores Xiao Ming's original permission setting that he can only unlock three times a week. The system can automatically reset permissions at a set time, such as the end of the day, or reset immediately after the user completes the operation.

[0128] The specific implementation process of using NLP technology to parse instruction content may include:

[0129] Use speech recognition to convert speech to text;

[0130] Use NLP libraries to parse and understand user instructions in text;

[0131] Use database to store user permissions and operation logs;

[0132] Implement permission verification and temporary unlocking logic through programming logic;

[0133] Write a scheduled task to regularly check and restore the original permissions;

[0134] Or trigger the permission recovery logic immediately after each temporary unlock operation.

[0135] In some embodiments, the refrigerator has a built-in education guidance module. When the refrigerator refuses to be opened by the user, the refrigerator screen can display educational information, for example: You have eaten popsicles today, remember to drink more water.

[0136] In some implementations, all stored and transmitted data, including facial information, videos, or voice call records, are protected by advanced encryption technology to ensure data security. At the same time, the images captured by the camera are anonymized and used only for identity authentication and anomaly detection, and no identifiable personal images are saved.

[0137] In specific implementation, the data stored and transmitted by the refrigerator is divided into sensitive data, such as face information, video or voice call records, and non-sensitive data, such as temperature records. Formulate data encryption strategies and select appropriate encryption algorithms. For example, use AES-256 (Advanced Encryption Standard) for symmetric encryption and RSA-2048 (asymmetric encryption algorithm) for asymmetric encryption; the system generates one or more symmetric encryption keys (such as AES-256) for encryption and decryption of data, and uses key derivation functions (such as PBKDF2 or HKDF) to derive subkeys from the master key to ensure the security of the key; before the data is stored in the refrigerator's local storage or transmitted to the cloud server, the symmetric encryption key is used to encrypt the data. For example, use AES-256-CBC mode to encrypt video call records, and store the symmetric encryption key in a secure place, such as a hardware security module (HSM) or a trusted platform module (TPM), to ensure that the key is always encrypted during storage and transmission to prevent key leakage.

[0138] When the encrypted data needs to be accessed, the system uses the corresponding symmetric encryption key to decrypt the data. The decryption process is performed in a secure environment to ensure that the key is not leaked.

[0139] Use secure communication protocols (such as TLS / SSL) for data transmission between the refrigerator and the APP or cloud server on the permission management device. Ensure that all transmitted data is encrypted during the transmission process to prevent man-in-the-middle attacks and data eavesdropping.

[0140] Digital certificates can be used to authenticate the identities of both parties in communication, ensuring that the identities of both parties are credible. Certificates should be updated and rotated regularly to prevent them from being cracked or leaked.

[0141] In specific implementation, the anonymization process may include:

[0142] The images of people captured by the refrigerator camera are first anonymized to remove identifiable personal features. Anonymization is achieved using image processing techniques such as blurring, pixelation or facial feature extraction.

[0143] Embodiment 4:

[0144] The method for controlling the use authority of a refrigerator in this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The implementation details of setting the use authority of a refrigerator through a permission management device in the above embodiment are specifically described below. The following content is only the implementation details provided for ease of understanding and is not necessary for the implementation of this solution.

[0145] The specific process can be as follows Figure 2 As shown, including:

[0146] The user opens the APP on the permission management device, or opens the display screen of the refrigerator;

[0147] Set restriction information to limit the use of refrigerator;

[0148] By taking photos or album photos, the user image features of the user who uses the refrigerator are recorded;

[0149] Select the permission form; the permission form may include: number of uses, number of days of use, time period of use, frequency of use, and custom permissions;

[0150] Confirm to import refrigerator system;

[0151] Complete the refrigerator access permission setting.

[0152] You can view, modify, delete, and turn on or off the refrigerator usage permissions.

[0153] In this embodiment, permission is set through an APP associated with the refrigerator, or directly on the display screen of the refrigerator. The process is simple, convenient, fast and effective.

[0154] Embodiment five:

[0155] The method for controlling the use authority of a refrigerator in this embodiment can be applied to electronic devices with communication, computing and data storage capabilities. The implementation details of the method for controlling the use authority of a refrigerator are described in detail below. The following content is only the implementation details provided for the convenience of understanding and is not necessary for the implementation of this solution.

[0156] When a child opens the refrigerator, the specific process of the method for controlling the use authority of the refrigerator can be as follows: Figure 3 As shown, including:

[0157] Children opening the refrigerator;

[0158] The refrigerator camera is turned on to collect user image features of children;

[0159] The refrigerator recognizes the user as a child and records it in the APP on the permission management device;

[0160] Based on the user image features of the child, determine whether the child’s opening of the refrigerator exceeds the scope of authority;

[0161] If the authority is not exceeded, the storage area of ​​the refrigerator is opened;

[0162] If the authority is exceeded, the storage area of ​​the refrigerator will not be opened;

[0163] If the child gives up opening the storage area of ​​the refrigerator, the program will be exited;

[0164] If the child wants to continue to open the storage area of ​​the refrigerator, he or she can initiate a voice or video call request to the APP on the permission management device held by the parent through the refrigerator screen;

[0165] After connecting to the APP, parents can decide whether to allow the refrigerator storage area to be opened based on the child's situation;

[0166] If the parents allow, the usage permission of the refrigerator's storage area can be remotely modified through the APP to open the refrigerator's storage area. Otherwise, if the parents do nothing, the refrigerator's storage area will remain locked and children will not be able to open the refrigerator's storage area.

[0167] In this embodiment, the method for controlling the permission to use the refrigerator can realize flexible control over the permission to use the refrigerator.

[0168] Embodiment six:

[0169] Another embodiment of the present application relates to a control device for the use authority of a refrigerator. The implementation details of the control device for the use authority of a refrigerator in this embodiment are specifically described below. The following content is only for the convenience of understanding the implementation details provided, and is not necessary for the implementation of this solution. The schematic diagram of the control device for the use authority of a refrigerator in this embodiment can be as follows Figure 4 As shown, it includes a collection module 401, a judgment module 402, a control module 403 and a setting module 404.

[0170] The acquisition module 401 is used to acquire the user image feature of the first user who currently opens the refrigerator, and query whether the preset permission library stores the restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library stores a plurality of restriction information, each of which includes the user image feature, storage area and upper limit value of the use of the restricted user;

[0171] A judgment module 402 is used to judge whether the storage area restricted from use by the first user has reached an upper limit value according to the history behavior information of the first user using the refrigerator after the first restriction information corresponding to the first user is queried;

[0172] A control module 403, configured to control the storage area to be in an openable state when it is determined that the storage area restricted for use by the first user has not reached an upper limit of usage;

[0173] The setting module 404 is configured to set the storage area to a non-openable state when it is determined that the storage area restricted for use by the first user has reached an upper limit of usage.

[0174] In some optional embodiments, the control device for the use authority of the refrigerator may also be used for:

[0175] Receive the remote control setting of the authority management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the authority library.

[0176] In some optional embodiments, the receiving remote control setting of the permission management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the permission library includes:

[0177] receiving an image of a user who is restricted from using the refrigerator, a storage area and an upper limit value of usage entered by the authority management device in a preset authority setting interface of the authority management device;

[0178] generating a user image feature of the user image, and associating the user image feature with the received storage area and usage upper limit value to form a piece of restriction information, and storing the piece of restriction information in the permission library;

[0179] The usage upper limit value includes at least one of the number of times of use, the number of days of use, the period of use and the frequency of use.

[0180] In some optional embodiments, when it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes:

[0181] In response to the request operation for opening the storage area, executing a request process for initiating a request to the authority management device to open the storage area;

[0182] When the request process is completed and an instruction to open the storage area is received from the authority management device, the storage area is opened;

[0183] When the request process is completed and an instruction to not open the storage area is received from the authority management device, the storage area is kept in a non-openable state.

[0184] In some optional embodiments, the request process includes:

[0185] A video call requesting to open the storage area is initiated to the authority management device, and an instruction of whether to open the storage area is received from the authority management device based on the video call.

[0186] In some optional embodiments, when it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes:

[0187] When it is detected that the first user attempts to open the storage area, a reminder message is sent to the permission management device, the reminder message including: information of the first user, information of the storage area attempted to be opened, and the upper limit value of the first user's usage of the storage area attempted to be opened.

[0188] In some optional embodiments, after sending the reminder information to the rights management device, the method further includes:

[0189] After receiving the instruction from the permission management device to allow the storage area to be opened this time, controlling the storage area to be in an openable state, and sending a reminder through the refrigerator that the storage area is in an openable state;

[0190] Upon receiving an adjustment value of the usage upper limit for the storage area that the first user attempts to open sent by the permission management device, the usage upper limit is updated according to the adjustment value, and when the updated usage upper limit is greater than the original usage upper limit, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued through the refrigerator.

[0191] In this embodiment, by collecting the user image features of the first user who currently opens the refrigerator, and querying whether the preset permission library stores the restriction information corresponding to the first user for limiting the use of the refrigerator, the permission library pre-stores multiple restriction information, each restriction information includes the image features of the user whose use is restricted, the storage area and the upper limit of use; after querying the first restriction information corresponding to the first user, according to the historical behavior information of the first user using the refrigerator, it is judged whether the storage area restricted by the first user has reached the upper limit of use; when it is judged that the storage area restricted by the first user has not reached the upper limit of use, the storage area is controlled to be in an openable state; when it is judged that the storage area restricted by the first user has reached the upper limit of use, the storage area is set to a non-openable state. Flexible control of the refrigerator use authority can be achieved.

[0192] It should be noted that the control device for the permission to use the refrigerator described in this embodiment is a control device for the permission to use the refrigerator corresponding to the control method for the permission to use the refrigerator described in the above embodiments, and all implementation methods of the control method for the permission to use the refrigerator described in the above embodiments are applicable to the embodiments of the control device for the permission to use the refrigerator, and can achieve the same effect.

[0193] It is worth mentioning that all modules involved in this embodiment are logic modules. In practical applications, a logic unit can be a physical unit, a part of a physical unit, or a combination of multiple physical units. In addition, in order to highlight the innovative part of this application, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by this application, but this does not mean that there are no other units in this embodiment.

[0194] Embodiment seven:

[0195] Another embodiment of the present application relates to an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for controlling the use authority of the refrigerator in the above-mentioned embodiments.

[0196] Among them, the memory and the processor are connected in a bus manner, and the bus may include any number of interconnected buses and bridges, and the bus connects various circuits of one or more processors and memories together. The bus can also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface between the bus and the transceiver. The transceiver can be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on a transmission medium. The data processed by the processor is transmitted on a wireless medium via an antenna, and further, the antenna also receives data and transmits the data to the processor.

[0197] The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. Memory can be used to store data used by the processor when performing operations.

[0198] Embodiment eight:

[0199] Another embodiment of the present application relates to a computer-readable storage medium storing a computer program, which implements the above method embodiment when executed by a processor.

[0200] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as: ROM), random access memory (Random Access Memory, referred to as: RAM), disk or optical disk and other media that can store program codes.

[0201] Those skilled in the art will appreciate that the above embodiments are specific embodiments for implementing the present application, and in actual applications, various changes may be made thereto in form and detail without departing from the spirit and scope of the present application.

Claims

1. A method for controlling the use authority of a refrigerator, characterized in that: include: Collecting the user image feature of the first user who currently opens the refrigerator, and querying whether the preset permission library stores restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library pre-stores a plurality of restriction information, each of which includes the user image feature, storage area and upper limit value of the use of the restricted user; After the first restriction information corresponding to the first user is queried, judging whether the first user has reached the upper limit of the storage area restricted from use according to the historical behavior information of the first user using the refrigerator; When it is determined that the first user has not reached the upper limit of the storage area that is restricted from use, controlling the storage area to be in an openable state; When it is determined that the first user has reached an upper limit of usage of the storage area that is restricted from use, the storage area is set to a non-openable state.

2. The method for controlling the use authority of a refrigerator according to claim 1, characterized in that: The method further comprises: Receive the remote control setting of the authority management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the authority library.

3. The method for controlling the use authority of a refrigerator according to claim 2, characterized in that: The receiving remote control setting of the permission management device to locally generate the restriction information for restricting the use of the refrigerator and store it in the permission library includes: receiving an image of a user who is restricted from using the refrigerator, a storage area and an upper limit value of usage entered by the authority management device in a preset authority setting interface of the authority management device; generating a user image feature of the user image, and associating the user image feature with the received storage area and usage upper limit value to form a piece of restriction information, and storing the piece of restriction information in the permission library; The usage upper limit value includes at least one of the number of times of use, the number of days of use, the period of use and the frequency of use.

4. The method for controlling the use authority of a refrigerator according to claim 2, characterized in that: When it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes: In response to the request operation for opening the storage area, executing a request process for initiating a request to the authority management device to open the storage area; When the request process is completed and an instruction to open the storage area is received from the authority management device, the storage area is opened; When the request process is completed and an instruction to not open the storage area is received from the authority management device, the storage area is kept in a non-openable state.

5. The method for controlling the use authority of a refrigerator according to claim 4, characterized in that: The request process includes: A video call requesting to open the storage area is initiated to the authority management device, and an instruction of whether to open the storage area is received from the authority management device based on the video call.

6. The method for controlling the use authority of a refrigerator according to claim 3, characterized in that: When it is determined that the first user has reached the upper limit of the storage area that is restricted from use, setting the storage area to a non-openable state further includes: When it is detected that the first user attempts to open the storage area, a reminder message is sent to the permission management device, the reminder message including: information of the first user, information of the storage area attempted to be opened, and the upper limit value of the first user's usage of the storage area attempted to be opened.

7. The method for controlling the use authority of a refrigerator according to claim 6, characterized in that: After sending the reminder information to the rights management device, the method further includes: After receiving the instruction from the permission management device to allow the storage area to be opened this time, controlling the storage area to be in an openable state, and sending a reminder through the refrigerator that the storage area is in an openable state; Upon receiving an adjustment value of the usage upper limit for the storage area that the first user attempts to open sent by the permission management device, the usage upper limit is updated according to the adjustment value, and when the updated usage upper limit is greater than the original usage upper limit, the storage area is controlled to be in an openable state, and a reminder that the storage area is in an openable state is issued through the refrigerator.

8. A control device for refrigerator usage authority, characterized in that: include: A collection module, used to collect the user image features of the first user who currently opens the refrigerator, and query whether the preset permission library stores the restriction information corresponding to the first user for restricting the use of the refrigerator, wherein the permission library stores a plurality of restriction information, each of which includes the user image features, storage area and upper limit value of the use of the restricted user; a judgment module, configured to, after querying the first restriction information corresponding to the first user, judge whether the first user has reached the upper limit of the storage area restricted from use according to the historical behavior information of the first user using the refrigerator; A control module, configured to control the storage area to be in an openable state when it is determined that the storage area restricted for use by the first user has not reached an upper limit of usage; The setting module is used to set the storage area to a non-openable state when it is determined that the storage area restricted for use by the first user has reached an upper limit of usage.

9. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for controlling the use authority of the refrigerator as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for controlling the use authority of the refrigerator according to any one of claims 1 to 7 is implemented.

Images