Function execution method, device and system

Abstract

The invention discloses a function execution method, device and system. The function execution method comprises the steps that a whole house intelligent device obtains a first face image; sending the first face image to all-house host equipment, wherein the first face image is sent to a first server by the all-house host equipment; a first instruction sent by all-house host equipment is received, a first function is executed according to the first instruction, and the first instruction is generated by the all-house host equipment according to first information sent by the first server; the first information is obtained by the first server according to the cloud album associated with the user account and the first face image, so that the user does not need to input many faces in advance, the operation is simple, and the user experience can be improved.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a function execution method, device and system. Background Art

[0002] The whole-house smart home system includes multiple whole-house smart devices including cameras, such as central control screens, smart door locks, etc. The whole-house smart devices have face recognition functions, but users need to enter their faces in advance on each whole-house smart device in the whole-house smart home system before face recognition can be completed based on the central control screen. The whole-house smart home system includes several whole-house smart devices, and users need to enter their faces several times, resulting in users having to enter many copies of faces, which is more complicated to operate and has a poor user experience. Summary of the invention

[0003] In view of this, the embodiments of the present invention provide a function execution method, device and system, so that users do not need to enter many faces in advance, the operation is simple, and the user experience can be improved.

[0004] In a first aspect, an embodiment of the present invention provides a function execution method, which is applied to a whole-house smart device, and the method includes:

[0005] Acquire a first facial image; send the first facial image to the whole-house host device, and the first facial image is sent by the whole-house host device to the first server; receive a first instruction sent by the whole-house host device, and execute a first function according to the first instruction, wherein the first instruction is obtained by the whole-house host device according to the first information sent by the first server; the first information is obtained by the first server according to the cloud album associated with the user account and the first facial image. In an embodiment of the present invention, the whole-house host device sends the facial image acquired by the whole-house smart device to the first server, and the first server obtains the first information based on the cloud album associated with the user account and the first facial image and returns it to the whole-house host device. The whole-house host device sends a first instruction to the whole-house smart device based on the first information, and the whole-house smart device executes the first function according to the first instruction, thereby enabling the whole-house smart device to directly execute functions according to the acquired facial image, so that the user does not need to enter the face for each whole-house smart device in advance, the operation is simple, and the user experience can be improved.

[0006] In combination with the first aspect, in some implementations of the first aspect, the first information includes that the user corresponding to the first facial image does not belong to a whitelist user;

[0007] The first function includes: prompting the first information. In the embodiment of the present application, when the user in the face image acquired by the whole-house smart device does not belong to the whitelist user, the user is prompted that he does not belong to the whitelist user and therefore cannot use the whole-house smart device.

[0008] In combination with the first aspect, in some implementations of the first aspect, the first information includes user information corresponding to the first facial image;

[0009] The first function includes one or more of the following: prompting the user information, automatically adjusting the preference configuration corresponding to the user information, and turning on the corresponding function. In an embodiment of the present application, when the user in the face image obtained by the whole-house smart device is a whitelist user, the first server returns the user information to the whole-house host device, and the whole-house smart device prompts the user information, automatically adjusts the preference configuration corresponding to the user information, and turns on the corresponding function; the user identity is reflected by prompting the user information, and the user's personalized needs are met by automatically adjusting the preference configuration corresponding to the user information. By turning on the corresponding function, the whitelist user can use the whole-house smart device normally.

[0010] In a second aspect, an embodiment of the present invention provides a function execution method, which is applied to a whole-house host device, and the method includes:

[0011] Receive a first facial image sent by all the smart devices in the house; send the first facial image to the first server; receive the first information sent by the first server, the first information is obtained by the first server based on the cloud album associated with the user account and the first facial image; obtain a first instruction based on the first information; send the first instruction to the whole house smart devices, the first instruction serves as the input for the whole house smart devices to perform a first function. In an embodiment of the present invention, the whole house host device sends the facial image obtained by the whole house smart device to the first server, the first server obtains the first information based on the cloud album associated with the user account and the first facial image and returns it to the whole house host device, the whole house host device sends the first instruction to the whole house smart device based on the first information, and the whole house smart device performs the first function according to the first instruction, thereby enabling the whole house smart device to directly perform functions according to the obtained facial image, so that the user does not need to enter the face for each whole house smart device in advance, the operation is simple, and the user experience can be improved.

[0012] In combination with the second aspect, in some implementations of the second aspect, before receiving the first face image sent by the whole-house smart device, the method further includes:

[0013] Obtain at least one of the user accounts; log in to the first server according to at least one of the user accounts. In the embodiment of the present application, before the whole-house host device receives the first facial image, it logs in to the first server according to the user account of the authorized user, so that the first server is always in a logged-in state during the facial matching process, so that the whole-house host device can directly send the first facial image to the first server after receiving the first facial image, shortening the facial matching process.

[0014] In conjunction with the second aspect, in certain implementations of the second aspect, the at least one user account includes a primary account of the whole-house host device. The primary account is an account bound to the whole-house host device. Users of the primary account are authorized users and whitelist users by default.

[0015] In conjunction with the second aspect, in certain implementations of the second aspect, the at least one user account further includes at least one subordinate account of the primary account. The user of the primary account adds the subordinate account in the first application to authorize the subordinate account, and the user of the subordinate account becomes an authorized user. However, the user of the subordinate account does not have the permission to add a subordinate account, that is, cannot authorize other user accounts. The user of the subordinate account is a whitelist user by default. For example, the user of the subordinate account is the spouse, child, parent, or friend of the user of the primary account.

[0016] In combination with the second aspect, in some implementations of the second aspect, the first information includes user information corresponding to the first facial image;

[0017] The obtaining a first instruction according to the first information includes:

[0018] The first information is sent to the second server; the first instruction sent by the second server is received. In the embodiment of the present application, when the first facial image is matched successfully, the first server returns the user information, and the whole-house host device uploads the user information to the second server. The second server has the usage scenarios and triggering conditions of the whole-house smart home system set by the user uploaded by the terminal device; the second server generates the first instruction according to the user information based on the usage scenarios and triggering conditions of the whole-house smart home system set by the user, and sends the first instruction to the whole-house host device.

[0019] In a third aspect, an embodiment of the present invention provides a function execution method, which is applied to a first server, and the method includes:

[0020] Receiving a first face image sent by a whole-house host device, where the first face image is a face image acquired by a whole-house smart device;

[0021] According to the cloud album associated with the user account and the first facial image, the first information is obtained; the first information is sent to the whole-house host device, the first information is used as the input of the whole-house host device to generate a first instruction, and the first instruction is used as the input of the whole-house smart device to perform the first function. In the embodiment of the present invention, the whole-house host device sends the facial image obtained by the whole-house smart device to the first server, the first server obtains the first information based on the cloud album associated with the user account and the first facial image and returns it to the whole-house host device, the whole-house host device sends the first instruction to the whole-house smart device based on the first information, and the whole-house smart device executes the first function according to the first instruction, thereby enabling the whole-house smart device to directly execute functions according to the obtained facial image, so that the user does not need to enter the face for each whole-house smart device in advance, the operation is simple, and the user experience can be improved.

[0022] In combination with the third aspect, in some implementations of the third aspect, before receiving the first face image sent by the whole-house host device, the method further includes:

[0023] Receive the second face image and its first label sent by the terminal device; store the second face image and its first label in the cloud album associated with the user account. In the embodiment of the present application, the first server includes a cloud album, and the terminal device uploads the image to the cloud album associated with the user account according to the user account; the uploaded image includes the second face image and its first label; the first label includes a whitelist user or a non-whitelist user; the first server stores the second face image and its first label in the cloud album associated with the user account, so as to facilitate the subsequent matching of the second face image with the first face image obtained by the whole house smart device. If the match is successful, it can be known whether the user is a whitelist user through the first label.

[0024] In combination with the third aspect, in certain implementations of the third aspect, the first information is obtained based on the cloud album associated with the user account and the first facial image, including: if the second facial image in the cloud album associated with the user account successfully matches the first facial image, the first information is obtained; the first information includes the user information corresponding to the second facial image that successfully matches the first facial image. In the embodiment of the present application, when the first server matches the first facial image, the matching range is all the second facial images in the cloud album associated with the user accounts of all authorized users. As long as there is a second facial image that successfully matches the first facial image in the cloud album associated with one user account, the facial recognition is considered successful. The cloud album also includes a second tag corresponding to the second facial image, and the second tag includes user information. When the second facial image successfully matches the first facial image, the first server obtains the first information, and the first information includes the user information corresponding to the second facial image that successfully matches the first facial image.

[0025] In conjunction with the third aspect, in certain implementations of the third aspect, the first label of the second facial image is a whitelist user. In an embodiment of the present application, when the first server matches the first facial image, the matching range is the second facial image of the whitelist user in the cloud album associated with the user account of all authorized users, so only the second facial image of the whitelist user is matched with the first facial image, which can simplify the matching process, reduce the computing power of the first server and shorten the matching time, while protecting user privacy.

[0026] In a fourth aspect, an embodiment of the present invention provides a whole-house smart device, comprising at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the program, the whole-house smart device executes the method described in the first aspect above.

[0027] In the fifth aspect, an embodiment of the present invention provides a whole-house host device, comprising at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the at least one program, the whole-house host device executes the method described in the second aspect above.

[0028] In a sixth aspect, an embodiment of the present invention provides a first server, comprising at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the at least one program, the first server executes the method described in the third aspect above.

[0029] In the seventh aspect, an embodiment of the present invention provides a function execution system, which includes the whole-house smart device as described in the fourth aspect, the whole-house host device as described in the fifth aspect, and the first server as described in the sixth aspect.

[0030] In an eighth aspect, an embodiment of the present invention provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is executed by a device, the device executes the method as described above.

[0031] In a ninth aspect, an embodiment of the present invention provides a program product, which includes instructions. When the program product is run on a device or any at least one processor, the device executes the functions / steps in the above method.

[0032] In the technical solutions of the function execution method, device and system provided by the embodiments of the present invention, the function execution method includes: the whole-house smart devices obtain a first facial image; the first facial image is sent to the whole-house host device, and the first facial image is sent by the whole-house host device to the first server; a first instruction sent by the whole-house host device is received, and a first function is executed according to the first instruction, and the first instruction is generated by the whole-house host device according to the first information sent by the first server; the first information is obtained by the first server according to the cloud album associated with the user account and the first facial image, so that the user does not need to enter many faces in advance, the operation is simple, and the user experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 An architecture diagram of a function execution system provided by an embodiment of the present invention;

[0034] Figure 2 A signaling interaction diagram of a function execution method provided by an embodiment of the present invention;

[0035] Figure 3 A schematic diagram of a user setting a whitelist user for a whole-house smart home system in an embodiment of the present invention;

[0036] Figure 4 for Figure 2 A signaling interaction diagram in which the whole-house host device obtains the first instruction according to the first information;

[0037] Figure 5 A flowchart of a function execution method provided by an embodiment of the present invention;

[0038] Figure 6 A schematic diagram of the structure of a device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0040] It should be clear that the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0041] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0042] It should be understood that the term "and / or" used herein is merely a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. Additionally, the character " / " in this text generally indicates that the associated objects before and after are in an "or" relationship.

[0043] The whole-house smart home system includes multiple whole-house smart devices including cameras, such as a central control screen, a smart door lock, etc. Users need to pre-enter their faces on each whole-house smart device in advance before they can complete face recognition based on the central control screen.

[0044] For example, the central control screen supports face entry and face configuration by adding users.

[0045] For example, the video doorbell needs to pre-enter the face on the product page before it can recognize the face.

[0046] Therefore, for the whole-house smart home system including several whole-house smart devices, users need to enter their faces several times, resulting in users needing to enter many copies of their faces, with relatively complex operations and poor user experience.

[0047] Based on the above technical problems, an embodiment of the present invention provides a function execution system. Figure 1 It is an architecture diagram of a function execution system provided by an embodiment of the present invention.

[0048] The function execution system includes a terminal device 210, a whole-house host device 220, a second server 250, at least one first server 240, and at least one whole-house smart device 230.

[0049] Exemplarily, the terminal device 210 includes a mobile phone, a tablet, a wearable device, etc.

[0050] Exemplarily, the whole-house host device 220 includes the host device of the whole-house smart home system.

[0051] Exemplarily, the whole-house smart device 230 includes the smart devices of the whole-house smart home system. For example, a central control screen or a smart door lock, etc.

[0052] Exemplarily, the first server 240 includes a server providing a consumer cloud album (also referred to as "user cloud album" or "cloud album") service.

[0053] Exemplarily, the second server 250 includes a whole-house smart home server.

[0054] Exemplarily, a third server (not shown) includes a device management server.

[0055] The first server 240, the second server 250 and the whole house smart device 230 are all connected to the whole house host device 220 by wire or wireless. The whole house smart device 230 is connected to the second server 250 by wire or wireless. The first server 240 is connected to the terminal device 210 by wire or wireless. The terminal device 210 is connected to the third server ( Figure 1 The third server is connected to the whole-house host device 220 by wire or wireless.

[0056] An embodiment of the present invention provides a function execution method. Figure 2 A signaling interaction diagram of a function execution method provided by an embodiment of the present invention.

[0057] like Figure 2 As shown, the method includes:

[0058] Step 302: The terminal device uploads the image to the cloud album associated with the user account in the first server according to the user account.

[0059] The terminal device 210 uploads the image to the cloud album associated with the user account in the first server 240 according to the user account.

[0060] Exemplarily, the image may be a photo. In a possible implementation, the image may be uploaded in the form of an album. Therefore, the album of the terminal device 210 and the cloud album are synchronized. Exemplarily, the album of the terminal device 210 and the cloud album include a second face image and its corresponding first tag and second tag. The second face image is a face image uploaded to the cloud album by the terminal device 210 after acquisition. For example, the terminal device 210 uploads the face image to the cloud album after collecting the face image through the camera, or uploads the face image sent by other devices to the cloud album after receiving it. The first tag is a whitelist user or a non-whitelist user, and the second tag includes user information, such as the user information including the user's name, so as to facilitate the subsequent matching of the second face image with the first face image acquired by the whole house smart device. If the match is successful, the user information of the user can be obtained through the second tag. It is understandable that the user information may also include other information such as the user's age, gender, user type, etc., which is not limited in the embodiment of the present application. The user type is family, relative or friend, etc., and the user can set the user information in the first application of the terminal device.

[0061] Whitelist users include users who can use the whole-house smart devices 230. Non-whitelist users cannot use the whole-house smart devices 230.

[0062] Whitelist users include authorized users and users added to the whitelist by authorized users. It is understandable that authorized users are whitelist users, and in addition to having the authority to use the whole house smart devices 230, they also have the authority to manage the whole house smart home system, such as the authority to set the personalized scenes of the whole house smart home system and its triggering conditions. Users added to the whitelist by authorized users only have the authority to use the whole house smart devices 230, and do not have the authority to manage the whole house smart home system.

[0063] The terminal device 210 can set the first tag of the second facial image in the album as a whitelist user or a non-whitelist user in response to the user's operation, and synchronize the changes of the first tag to the cloud album, thereby enabling the authorized user to add or remove users in the whitelist.

[0064] Exemplarily, the terminal device 210 is installed with a first application, which is used to set personalized scenes of the whole-house smart home system and their triggering conditions, authorized users, whitelists, etc. in response to user operations. For example, the first application is a smart life application.

[0065] The personalized scenes of the whole-house smart home system can be configured based on user identity. Configuring personalized scenes based on user identity can achieve specific scenes based on users. For example, Xiao Ming sets a personalized scene on his mobile phone, which includes: all the lights on the porch are turned on, the TV is turned on and automatically plays TV series A, the curtains are closed, and the aromatherapy is turned on; the triggering conditions of the personalized scene include: Xiao Ming arrives home between 7 and 9 pm. Therefore, when Xiao Ming arrives at the door of his house between 7 and 9 pm, the door lock automatically unlocks after obtaining Xiao Ming's face image, and Xiao Ming enters the house. At this time, all the lights on the porch are turned on, the TV is turned on and automatically plays TV series A, the curtains are closed, and the aromatherapy is turned on.

[0066] After the user can set the personalized scene and its triggering condition of the whole-house smart home system by operating the first application of the terminal device 210, the first application uploads the set personalized scene and its triggering condition to the second server 250.

[0067] Exemplarily, authorized users include users who can use the whole-house smart devices 230 and can set personalized scenes of the whole-house smart home system and its trigger conditions and whitelist.

[0068] Exemplarily, the authorized user includes a user of a master account. The master account is an account bound to the whole-house host device 220. The user of the master account is an authorized user by default.

[0069] Exemplarily, the authorized user also includes a user of a subordinate account of the main account. The user of the main account adds the subordinate account in the first application to authorize the subordinate account, and the user of the subordinate account can become an authorized user.

[0070] In some possible embodiments, the user of the subordinate account does not have the authority to add a subordinate account, that is, cannot set other users as authorized users.

[0071] In some possible embodiments, the user of the subordinate account has the authority to add subordinate accounts, that is, can set other users as authorized users.

[0072] For example, the user of the subordinate account is the spouse, child, parent, or friend of the user of the primary account.

[0073] Exemplarily, the first application includes a first control, and the first control is used to provide a user with a function of setting a whitelist user of the whole-house smart home system. Figure 3 Schematic diagram of a user setting a whitelist user of the whole-house smart home system in an embodiment of the present invention, as shown in Figure 3 As shown, the interface on the left is the home page interface of the first application, and the home page interface includes a first control, for example, the first control is an "AI configuration" control.

[0074] Exemplarily, in response to a user clicking on a first control, the terminal device displays a first interface including a plurality of second facial images and their corresponding first and second labels.

[0075] Exemplarily, the first tag includes a whitelist user or a non-whitelist user. The second tag includes user information. Figure 3 As shown, after the user clicks the "AI Configuration" control, the terminal device displays a first interface, which includes multiple second face images and their corresponding first labels and second labels.

[0076] In response to the user selecting the second face image on the first interface, the terminal device sets the first tag corresponding to the selected second face image as a whitelist user or a non-whitelist user, and updates the first tag of the second face image in the first server. Figure 3 As shown in the figure, in the first interface, "Xiao Ming" is an authorized user of the whole-house host device, so the first label corresponding to the face image of "Xiao Ming" is "whitelist user" by default, and the first labels of the other face images are "non-whitelist users"; after the user selects the face images of "Xiao Hong" and "Xiao Ai", the first labels corresponding to the face images of "Xiao Hong" and "Xiao Ai" become "whitelist users". After that, if the user selects the face image of "Xiao Hong" again, the first label corresponding to the face image of "Xiao Hong" becomes "non-whitelist users" again.

[0077] The first application is also used to turn on or off the face authorization setting.

[0078] Step 304: All host devices in the house log in to the first server according to at least one user account.

[0079] In this step, the whole-house host device 220 logs in to the first server according to at least one user account.

[0080] Exemplarily, at least one user account is an account of an authorized user of the whole-house smart home system.

[0081] The user account of the authorized user may be sent by the terminal device 210 to the whole-house host device 220 in response to the user's operation. In some possible embodiments, the terminal device 210 sends the user account of at least one authorized user to the whole-house host device 220 via the third server. Figure 1 As shown, the whole-house host device 220 has a storage function for storing user accounts of authorized users.

[0082] Step 306: All smart devices in the house obtain the first facial image.

[0083] In this step, the whole-house smart device 230 is used to obtain the first face image. Exemplarily, the whole-house smart device 230 collects the user's face through a camera to obtain the first face image.

[0084] Step 308: All the smart devices in the house send the first facial image to all the host devices in the house.

[0085] In this step, the whole-house smart device 230 sends the first face image to the whole-house host device 220 .

[0086] Step 310: All host devices in the house send the first facial image to the first server.

[0087] In this step, the whole-house host device 220 sends the first facial image to the first server 240 .

[0088] In the embodiment of the present application, step 304 may also be located between step 308 and step 310. In contrast, step 304 is located before step 308, so that the whole-house host device logs in to the first server according to the user account of the authorized user before receiving the first face image, and the first server is always in a logged-in state, so that the whole-house host device can directly send the first face image to the first server after receiving the first face image, thereby saving the login time and shortening the face matching process.

[0089] It should be understood that step 304 may be located before or after step 306, and this embodiment of the present application does not limit this.

[0090] Step 312: The first server obtains first information based on the cloud photo album associated with the user account and the first facial image.

[0091] In this step, the first server 240 obtains the first information based on the cloud photo album associated with the user account and the first face image.

[0092] In some possible embodiments, step 312 specifically includes: the first server obtains a second facial image in a cloud album associated with at least one user account; matches the second facial image with the first facial image; if there is a second facial image in the cloud album that successfully matches the first facial image, obtain the first information. Among them, the first information includes user information corresponding to the second facial image that successfully matches the first facial image. If the second facial images in the cloud album associated with at least one user account all fail to match the first facial image, obtain the first information, and the first information indicates that the user corresponding to the first facial image does not belong to the whitelist user. Optionally, in step 312, the first server matches the second facial image with the first label as a whitelist user, that is, the scope of matching the first facial image is limited to the whitelist users. Compared with the matching range of all second facial images in the cloud album, it can simplify the matching process, reduce the computing power of the first server and shorten the matching time, and protect user privacy at the same time.

[0093] Step 314: The first server sends the first information to all host devices in the house.

[0094] In this step, the first server 240 sends the first information to the whole-house host device 220 .

[0095] Step 316: All host devices in the house obtain a first instruction according to the first information.

[0096] In this step, the whole-house host device 220 obtains the first instruction according to the first information.

[0097] In some possible embodiments, the first information includes that the user corresponding to the first facial image does not belong to the whitelist user; step 316 specifically includes: the whole-house host device directly obtains the first instruction according to the first information.

[0098] For example, a stranger stands in front of a smart door lock, and the smart door lock obtains the facial image of the stranger and sends it to the first server through the host device of the whole house; because the stranger is not a whitelist user, the first server fails to match the facial image of the stranger, and returns the first information indicating that the user is not a whitelist user to the host device of the whole house; the host device of the whole house obtains the first instruction based on the first information, and the first instruction is used to instruct the smart devices of the whole house to prompt the first information.

[0099] In some possible embodiments, the first information includes user information corresponding to the first face image; Figure 4 As shown, step 316 specifically includes:

[0100] Step 3162: All host devices in the house send the first information to the second server.

[0101] In this step, the whole-house host device 220 sends the first information to the second server 250 .

[0102] For example, Xiao Ming's mother is a whitelist user, and Xiao Ming's mother is standing in front of the smart TV in the living room. The first information may indicate that the user is Xiao Ming's mother.

[0103] Step 3164: The second server sends a first instruction to all host devices in the house according to the first information.

[0104] In this step, the second server 250 sends a first instruction to the whole-house host device 220 according to the first information.

[0105] The second server 250 generates a first instruction according to the first information based on the personalized scenario set by the user and its triggering condition, and sends the first instruction to the whole-house host device 220.

[0106] For example, Xiao Ming sets a personalized scene on his mobile phone. The personalized scene includes: the smart TV displays the text "Happy Birthday, Mom" ​​and plays the voice of "Happy Birthday, Mom"; the triggering condition of the personalized scene includes: the smart TV in the living room acquires the face of Xiao Ming's mother on November 14, 2023. Therefore, when Xiao Ming's mother enters the living room on November 14, 2023 and her face is acquired by the smart TV in the living room, the smart TV sends the facial image of Xiao Ming's mother to the first server through the whole house host device. The first server determines that it is Xiao Ming's mother based on the facial image of Xiao Ming's mother and sends the user information of Xiao Ming's mother to the whole house host device; the whole house host device uploads the user information of Xiao Ming's mother to the second server, and the second server determines that the user information of Xiao Ming's mother and the current time meet the triggering conditions of the personalized scene, and generates the first instruction according to the personalized scene. The first instruction includes the instruction to control the smart TV to display the text of "Happy Birthday, Mom" ​​and play the voice of "Happy Birthday, Mom". As a result, the smart TV automatically turns on, displays the text of "Happy Birthday, Mom" ​​and plays the voice of "Happy Birthday, Mom".

[0107] Exemplarily, the second server stores a table of correspondence between personalized scenarios and their triggering conditions and the first instruction, and determines the first instruction according to the table.

[0108] For example, after the second server determines that Xiao Ming's mother's user information and the current time meet the trigger conditions of the personalized scene, it determines the first instruction based on the correspondence between the personalized scene and its trigger conditions and the first instruction shown in Table 1. The first instruction can be an instruction for instructing the smart TV to display the text "Happy Birthday, Mom" ​​and play the voice of "Happy Birthday, Mom".

[0109] Table 1 Correspondence between personalized scenarios and their triggering conditions and the first instruction

[0110]

[0111] Step 318: The whole-house host device sends a first instruction to all the house smart devices.

[0112] In this step, the whole-house host device 220 sends a first instruction to the whole-house smart device 230 .

[0113] Optionally, the second server 250 can directly send the first instruction to the whole-house smart devices 230.

[0114] Step 320: All smart devices in the house execute the first function according to the first instruction.

[0115] In this step, the whole-house smart devices 230 execute the first function according to the first instruction.

[0116] In some possible embodiments, the first information includes that the user corresponding to the first facial image does not belong to the whitelist user; and the first function includes: prompting the first information.

[0117] For example, the first function includes one or more of playing the first information, displaying the first information, and displaying the first picture according to the first information. The first picture includes the first information.

[0118] For example, when a stranger stands in front of a smart door lock, the smart door lock will play a voice message saying "You are not a whitelist user and cannot unlock the door for you."

[0119] In some possible embodiments, the first information includes user information corresponding to the first facial image; the first function includes one or more of the following: prompting user information, automatically adjusting the preference configuration corresponding to the user information, and enabling a corresponding function.

[0120] For example, prompting user information includes playing user information, displaying user information, and displaying one or more of the second picture according to the user information. The second picture includes user information. The whole house smart device reflects the user identity through voice, text and / or image, so that the user feels personalized experience.

[0121] Exemplarily, the corresponding function includes normal device functions of the whole house smart device. For example, the whole house smart device is a door lock, and the corresponding function is that the door lock is unlocked after the face matching is passed.

[0122] For example, the whole house smart device is a door lock, which includes a screen; if the first function includes prompting user information and turning on the corresponding function, the door lock will be unlocked after the face match is passed and "Welcome home Xiao Ming" will be displayed on the screen.

[0123] For example, the smart device in the whole house is a smart TV; if the first function includes prompting user information and automatically adjusting the preference configuration corresponding to the user information, the smart TV will display "Welcome home, Xiao Ming" after the face matching is passed, and automatically adjust to Xiao Ming's preference configuration, such as automatically setting the volume to 30, and automatically switching to the channel or program that Xiao Ming usually watches.

[0124] It should be understood that step 302 and step 304 are optional steps.

[0125] The method provided by the present invention is applied to the whole house scene, and face recognition is performed through the whole house smart devices (such as central control screens, cameras or door locks and other devices containing cameras) to realize the interaction between terminal devices (such as mobile phones, tablets or wearable devices) and the whole house smart devices. The user selects the face image configuration authorized user based on the first application of the terminal device. After the user's authorization, the whole house host device can access the user's cloud album. The pictures in the cloud album match the user's face to determine whether the user is an authorized user or an unauthorized user. If it is an authorized user, the user's name is obtained according to the avatar naming, and it is prompted on the large screen and voice broadcast, and the scene can be configured according to the user name.

[0126] In the technical solution provided by the embodiment of the present invention, there is no need to enter a large number of faces in advance. The faces can be automatically matched according to the album names on the terminal device. The user can set the cloud album of the terminal device based on the association of the terminal device. The user can be recognized by the face of the whole house smart devices. The operation is simple and can improve the user experience.

[0127] An embodiment of the present invention provides yet another function execution method. Figure 5 A flowchart of a function execution method provided by an embodiment of the present invention. Figure 5 As shown, the method includes:

[0128] Step 406: All smart devices in the house obtain the first facial image and send the first facial image to the host devices in the house.

[0129] Step 408: All host devices in the house send the first facial image to the first server.

[0130] Step 410: The first server obtains first information based on the cloud photo album associated with the user account and the first facial image, and sends the first information to host devices throughout the house.

[0131] In some possible embodiments, step 410 includes: if the second face image in the cloud album associated with the user account matches the first face image, the first server obtains first information; the first information includes user information corresponding to the second face image that successfully matches the first face image. Optionally, the first label of the second face image obtained by the first server is a whitelist user.

[0132] Step 412: The whole-house host device obtains a first instruction based on the first information and sends the first instruction to the whole-house intelligent device.

[0133] In some possible embodiments, the first information indicates that the user corresponding to the first face image does not belong to the whitelist users; the whole-house host device directly obtains the first instruction according to the first information.

[0134] In some possible embodiments, the first information includes the user information corresponding to the first face image; for the whole-house host device to obtain the first instruction according to the first information, it includes: the whole-house host device sends the first information to the second server and receives the first instruction sent by the second server.

[0135] Step 414: The whole-house intelligent device executes the first function according to the recognition result.

[0136] In some possible embodiments, the first information indicates that the user corresponding to the first face image does not belong to the whitelist users; the first function includes: prompting the first information.

[0137] In some possible embodiments, the first information includes the user information corresponding to the first face image; the first function includes one or more of the following: prompting the user information, automatically adjusting the preference configuration corresponding to the user information, and enabling the corresponding function.

[0138] Optionally, as Figure 5 shown, before step 406, it further includes: steps 402 - 404.

[0139] Step 402: In response to the user's operation, the terminal device uploads the second face image and its first label to the cloud album associated with the user account in the first server.

[0140] The first server receives the second face image and its first label sent by the terminal device and stores the second face image and its first label in the cloud album associated with the user account.

[0141] Step 404: The whole-house host device obtains at least one user account and logs in to the first server according to the at least one user account.

[0142] Exemplarily, the at least one user account includes the main account of the whole-house host device.

[0143] Optionally, the at least one user account further includes at least one subordinate account of the main account.

[0144] In the technical solution provided by the embodiment of the present invention, all the smart devices in the house obtain a first facial image; the first facial image is sent to the whole-house host device, and the first facial image is sent by the whole-house host device to the first server; a first instruction sent by the whole-house host device is received, and a first function is executed according to the first instruction, and the first instruction is generated by the whole-house host device according to the first information of the first server; the first information is obtained by the first server according to the cloud album associated with the user account and the first facial image, so that the user does not need to enter many faces in advance, the operation is simple, and the user experience can be improved.

[0145] Figure 6 This is a schematic diagram of a device structure provided by an embodiment of the present invention. It should be understood that the device 700 can execute Figure 2 , Figure 4 and Figure 5 To avoid repetition, the steps in the embodiment are not described in detail here. The device 700 includes: a processor 701 and a memory 702.

[0146] The embodiment of the present application also provides a whole-house smart device, including at least one processor 701 and at least one memory 702, wherein the at least one memory 702 is used to store at least one program, and when the at least one processor 701 runs the at least one program, the whole-house smart device executes the method embodiments and Figure 2 , Figure 5 Operations involved in the whole-house smart devices.

[0147] The embodiment of the present application also provides a whole-house host device, including at least one processor 701 and at least one memory 702, wherein the at least one memory 702 is used to store at least one program, and when the at least one processor 701 runs the at least one program, the whole-house host device executes the method embodiments and Figure 2 , Figure 4 , Figure 5 Operations involved in the whole-house host devices.

[0148] The embodiment of the present application further provides a first server, including at least one processor 701 and at least one memory 702, wherein the at least one memory 702 is used to store at least one program, and when the at least one processor 701 runs the at least one program, the first server executes the method embodiment and Figure 2 , Figure 5 The first server in the operation involves.

[0149] The embodiment of the present application also provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is run by the whole-house smart device, the whole-house smart device executes the method embodiment and Figure 2 or Figure 5 Operations involved in the whole-house smart devices.

[0150] The embodiment of the present application also provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is run by the whole-house host device, the whole-house host device executes the method embodiment and Figure 2 , Figure 4 or Figure 5 Operations involved in the whole-house host devices.

[0151] The embodiment of the present application also provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is executed by the first server, the first server executes the method embodiment and Figure 2 or Figure 5 The first server in the operation involves.

[0152] The present application also provides a program product. When the program product is run on a whole-house smart device or at least one processor, the whole-house smart device executes the method embodiments and Figure 2 or Figure 5 Operations involved in the whole-house smart devices.

[0153] The present application also provides a program product. When the program product is run on a whole-house host device or at least one processor, the whole-house host device executes the method embodiments and Figure 2 , Figure 4 or Figure 5 Operations involved in the whole-house host devices.

[0154] The embodiment of the present application also provides a program product, when the program product is run on a first server or at least one processor, the first server executes the method embodiment and Figure 2 or Figure 5 The first server in the operation involves.

[0155] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0156] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a whole-house smart device, a whole-house host device, a terminal device, a computer, or a server, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0157] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for executing a function, It is characterized in that Applied to whole-house smart devices, the method includes: Obtaining a first face image; Sending the first face image to the whole-house host device, and the first face image is sent by the whole-house host device to the first server; Receive a first instruction sent by a whole-house host device, and execute a first function according to the first instruction, wherein the first instruction is obtained by the whole-house host device based on the first information sent by the first server; the first information is obtained by the first server based on the cloud album associated with the user account and the first facial image.

2. The method according to claim 1, It is characterized in that The first information includes that the user corresponding to the first facial image does not belong to the whitelist user; The first function includes: prompting the first information.

3. The method according to claim 1, It is characterized in that The first information includes user information corresponding to the first facial image; The first function includes one or more of the following: prompting the user information, automatically adjusting the preference configuration corresponding to the user information, and enabling the corresponding function.

4. A method for executing a function, It is characterized in that Applied to the whole house host device, the method includes: Receive the first face image sent by all the smart devices in the house; Sending the first facial image to a first server; receiving first information sent by the first server, where the first information is obtained by the first server according to a cloud photo album associated with a user account and the first facial image; Obtaining a first instruction according to the first information; The first instruction is sent to all smart devices in the house.

5. The method according to claim 4, It is characterized in that Before receiving the first face image sent by the whole-house smart devices, the method further includes: Obtaining at least one of the user accounts; The first server is logged in according to at least one of the user accounts.

6. The method according to claim 4 or 5, It is characterized in that The at least one user account includes a primary account of the whole-house host device.

7. The method according to claim 6, It is characterized in that The at least one user account further includes at least one subordinate account of the primary account.

8. The method according to any one of claims 4 to 7, It is characterized in that The first information includes user information corresponding to the first facial image; The obtaining a first instruction according to the first information includes: sending the first information to a second server; Receive the first instruction sent by the second server.

9. A method for performing a function, It is characterized in that Applied to a first server, the method comprises: Receiving a first face image sent by a whole-house host device, where the first face image is a face image acquired by a whole-house smart device; Obtaining first information according to the cloud photo album associated with the user account and the first facial image; The first information is sent to the whole-house host device, and the first information serves as input for the whole-house host device to generate a first instruction.

10. The method according to claim 9, It is characterized in that Before receiving the first face image sent by the whole-house host device, the method further includes: Receiving a second face image and a first label thereof sent by a terminal device; The second facial image and the first label are stored in the cloud album associated with the user account.

11. The method according to claim 9 or 10, It is characterized in that The obtaining of the first information according to the cloud photo album associated with the user account and the first face image includes: If the second facial image in the cloud album associated with the user account matches the first facial image, the first information is obtained; the first information includes user information corresponding to the second facial image that successfully matches the first facial image.

12. The method according to claim 11, It is characterized in that The first label of the second facial image is a whitelist user.

13. A whole-house smart device, It is characterized in that It includes at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the at least one program, the whole-house smart device executes the method as described in any one of claims 1-3.

14. A whole-house host device, It is characterized in that It includes at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the at least one program, the whole-house host device executes the method as described in any one of claims 4-8.

15. A first server, It is characterized in that It comprises at least one processor and at least one memory, wherein the at least one memory is used to store at least one program, and when the at least one processor runs the at least one program, the first server executes the method as described in any one of claims 9-12.

16. A function execution system, It is characterized in that The system includes the whole-house smart device as claimed in claim 13, the whole-house host device as claimed in claim 14 and the first server as claimed in claim 15.

17. A readable storage medium, It is characterized in that The readable storage medium stores a program, and when the program is executed by a device, the device executes the method according to any one of claims 1 to 3, the method according to any one of claims 4 to 8, or the method according to any one of claims 9 to 12.

Images