Door lock authorization method and device, electronic equipment, medium and product
By remotely authorizing the unlocking permission of a second terminal in an emergency, the problem of key protected individuals being unable to operate smart door locks independently is solved, enabling rapid rescue.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2026-03-10
AI Technical Summary
In emergency situations, vulnerable groups such as the elderly or disabled may be unable to operate smart door locks independently, leading to delays in rescue efforts and impacting rescue efficiency and safety.
The door lock client sends a request for help to the cloud platform, receives and executes authorization instructions, and remotely authorizes the second terminal to unlock, enabling emergency unlocking without manual operation by the user.
It greatly shortens rescue time and improves rescue efficiency and safety in emergency situations.
Smart Images

Figure CN121640601A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of Internet of Things, and in particular to a door lock authorization method and device, an electronic device, a medium and a product. BACKGROUND
[0002] With the rapid development of Internet of Things technology, smart home appliances have gradually penetrated into every corner of daily life. As an important part of smart home security, smart door locks are increasingly attracting the attention of consumers. Smart door locks have higher security and convenience. They can be unlocked in various ways, such as fingerprint, password, etc., greatly improving the user experience.
[0003] However, in an emergency, when the key protected population (such as the elderly, the disabled, etc.) falls or has other accidents, the smart door lock may also cause some trouble. Since these groups may not be able to act or operate the smart door lock, it often takes extra time to open the door lock after the rescue personnel arrive on the scene, thus delaying the rescue opportunity. SUMMARY
[0004] To overcome the problems in the related art, the present application provides a door lock authorization method, device, electronic device, medium and product.
[0005] According to a first aspect of any one of the embodiments of the present application, a door lock authorization method is provided, the method is executed by a door lock client, and the method comprises:
[0006] In the case where it is determined that the user needs emergency rescue, sending a help information to a cloud platform; wherein the user identifier is included in the help information;
[0007] Receiving a first authorization instruction sent by the cloud platform; wherein the identifier of the second terminal is included in the first authorization instruction;
[0008] Based on the first authorization instruction, the unlocking permission of the second terminal is authorized.
[0009] According to a second aspect of any one of the embodiments of the present application, a door lock authorization method is provided, the method is executed by a cloud platform, and the method comprises:
[0010] Receiving a help information sent by a door lock client; the user identifier needing emergency rescue is included in the help information;
[0011] In the case where it is determined that the holder of the first terminal cannot rescue, generating a first authorization instruction; wherein the identifier of the second terminal is included in the first authorization instruction, and the first terminal is the terminal bound to the user identifier;
[0012] sending the first authorization instruction to the door lock client, the first authorization instruction being used to instruct the door lock client to authorize the unlocking permission of the second terminal.
[0013] According to a third aspect of any of the embodiments of the present application, a door lock authorization method is provided, the method being performed by a second terminal, and the method comprising:
[0014] receiving authorization information sent by a door lock client or a cloud platform, the authorization information being used to determine an authorization state of opening a door lock.
[0015] According to a fourth aspect of any of the embodiments of the present application, a door lock authorization method is provided, the method being performed by a first terminal, and the method comprising:
[0016] receiving help information sent by a cloud platform;
[0017] in a case where a holder is unable to rescue, sending a second authorization instruction to the cloud platform, the second authorization instruction comprising a user identifier needing emergency rescue and / or an identifier of a second terminal.
[0018] According to a fifth aspect of any of the embodiments of the present application, a door lock authorization method is provided, the method comprising:
[0019] in a case where a user needs emergency rescue, sending help information to a cloud platform, the help information comprising a user identifier;
[0020] authorizing an unlocking permission of a second terminal instructed by the cloud platform.
[0021] According to a sixth aspect of any of the embodiments of the present application, an electronic device is provided, the electronic device comprising:
[0022] a collection module, configured to collect point cloud data of an environment in which a user is located;
[0023] a processing module, configured to determine whether the user needs emergency rescue based on the point cloud data;
[0024] a notification module, configured to, in a case where it is determined that the user needs emergency rescue, send a second notification message to a door lock client, the second notification message being used to instruct that the user needs emergency rescue.
[0025] According to a seventh aspect of any of the embodiments of the present application, a smart health and care system is provided, comprising a plurality of electronic devices, the electronic devices being the electronic device according to any of the embodiments of the present application.
[0026] The plurality of electronic devices are deployed in a house, and the plurality of electronic devices are connected based on a deep learning Matter protocol and share computing power.
[0027] According to an eighth aspect of any of the embodiments of the present application, a door lock client is provided, the door lock client comprising:
[0028] An information sending module is configured to send help information to a cloud platform in a case where it is determined that a user needs emergency assistance; wherein the help information comprises a user identifier.
[0029] An instruction receiving module is configured to receive a first authorization instruction sent by the cloud platform; wherein the first authorization instruction comprises an identifier of a second terminal.
[0030] A terminal authorization module is configured to authorize an unlocking permission of the second terminal based on the first authorization instruction.
[0031] According to a ninth aspect of any of the embodiments of the present application, a cloud platform is provided, the cloud platform comprising:
[0032] An information receiving module is configured to receive help information sent by a door lock client; wherein the help information comprises a user identifier needing emergency assistance.
[0033] An instruction generating module is configured to generate a first authorization instruction in a case where a holder of a first terminal is unable to provide assistance; wherein the first authorization instruction comprises an identifier of a second terminal, and the first terminal is a terminal bound to the user identifier.
[0034] An instruction sending module is configured to send the first authorization instruction to the door lock client, the first authorization instruction being used to instruct the door lock client to authorize an unlocking permission of the second terminal.
[0035] According to a tenth aspect of any of the embodiments of the present application, a second terminal is provided, the second terminal comprising:
[0036] An authorization receiving module is configured to receive authorization information sent by a door lock client or a cloud platform, the authorization information being used to determine an authorization state of opening a door lock.
[0037] According to an eleventh aspect of any of the embodiments of the present application, a first terminal is provided, the first terminal comprising:
[0038] A help receiving module is configured to receive help information sent by a cloud platform.
[0039] An assistance response module is configured to send a second authorization instruction to the cloud platform in a case where a holder is unable to provide assistance; wherein the second authorization instruction comprises a user identifier needing emergency assistance, and / or an identifier of a second terminal.
[0040] According to a twelfth aspect of any of the embodiments of the present application, a computer readable storage medium is provided, having stored thereon computer instructions which, when executed by a processor, implement the method as described in any of the embodiments of the present application above.
[0041] According to a thirteenth aspect of any of the embodiments of the present application, a computer program product is provided, having stored thereon a computer program / instructions which, when executed by a processor, implement the method as described in any of the embodiments of the present application above.
[0042] The technical solutions provided by the present application can include the following beneficial effects:
[0043] According to the above embodiments, in the case that it is determined that the user needs emergency assistance, the help information is sent to the cloud platform, the first authorization instruction sent by the cloud platform is received, and the unlocking permission of the second terminal is authorized based on the first authorization instruction. The door lock client can directly authorize the terminal indicated by the cloud platform, and the second terminal is remotely authorized, without manual operation of the user, thereby greatly shortening the rescue time.
[0044] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS
[0045] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.
[0046] Figure 1 is a flowchart of a door lock authorization method according to an exemplary embodiment of the present application;
[0047] Figure 2 is a flowchart of another door lock authorization method according to an exemplary embodiment of the present application;
[0048] Figure 3 is a flowchart of another door lock authorization method according to an exemplary embodiment of the present application;
[0049] Figure 4 is a flowchart of another door lock authorization method according to an exemplary embodiment of the present application;
[0050] Figure 5 is a schematic diagram of determining that a user needs emergency assistance according to an exemplary embodiment of the present application;
[0051] Figure 6 is a flowchart of another door lock authorization method according to an exemplary embodiment of the present application;
[0052] Figure 7 This is a schematic diagram illustrating a hierarchical response processing according to an exemplary embodiment of this application;
[0053] Figure 8 This is an interactive diagram illustrating a door lock authorization method according to an exemplary embodiment of this application;
[0054] Figure 9 This is a schematic diagram of the structure of a smart elderly care system according to an exemplary embodiment of this application;
[0055] Figure 10 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of this application;
[0056] Figure 11 This is a block diagram illustrating a door lock client according to an exemplary embodiment of this application;
[0057] Figure 12 This is a block diagram of a cloud platform according to an exemplary embodiment of this application;
[0058] Figure 13 This is a block diagram illustrating a second terminal according to an exemplary embodiment of this application;
[0059] Figure 14 This is a block diagram illustrating a first terminal according to an exemplary embodiment of this application. Detailed Implementation
[0060] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0061] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.
[0062] It should be understood that although the terms first, second, third, etc., may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."
[0063] Currently, when critically protected individuals experience emergencies such as falls, their inability to operate door locks to open the doors for rescuers hinders rescue efforts, delaying rescue time and potentially threatening the lives of those under protection.
[0064] To address the aforementioned problems, this application proposes a door lock authorization method. The following embodiments are provided to further illustrate this application:
[0065] Please see Figure 1 , Figure 1 This is a flowchart illustrating a door lock authorization method according to an exemplary embodiment of this application. The door lock authorization method can be applied to a door lock client and may include the following steps:
[0066] Step 102: If it is determined that the user needs emergency rescue, send a request for help to the cloud platform, which includes the user's identifier.
[0067] In this step, the door lock client can determine whether the user has experienced an emergency such as a fall or unconsciousness based on point cloud data collected from the user's environment and body indicators detected by somatosensory devices such as smart bracelets. If an emergency occurs, it can determine that the user needs emergency rescue.
[0068] When the door lock client determines that a user needs emergency assistance, it sends a request for help to the cloud platform. After receiving the request for help from the door lock client, the cloud platform can send a request for help to the first terminal corresponding to the user's identifier, and the owner of the first terminal can determine whether assistance can be provided.
[0069] If the first terminal determines that the holder cannot be rescued, it sends a second authorization command to the cloud platform. Based on the second authorization command, the cloud platform dispatches a second terminal to the user's location for rescue.
[0070] The help request information is used to reflect information about users who need emergency rescue. The help request information may include user identification, user location, emergency situation, etc.
[0071] The first terminal is the terminal bound to the user's identifier. The holder of the first terminal can be the user's emergency response personnel, such as family members or friends.
[0072] The second terminal is the terminal bound to the rescue personnel, who are the people who carry out rescue for this user, such as property management personnel, emergency medical personnel, etc.
[0073] The second authorization instruction is used to instruct the cloud platform to provide rescue to the user. The second authorization instruction may include: the user identifier, and / or, the identifier of the second terminal.
[0074] The cloud platform can determine the assigned second terminal based on the user identifier in the second authorization instruction, according to the user's location, emergency details, etc.; the cloud platform can also determine the assigned second terminal based on the identifier of the second terminal specified by the first terminal in the second authorization instruction.
[0075] Step 104: Receive the first authorization instruction sent by the cloud platform, wherein the first authorization instruction includes the identifier of the second terminal.
[0076] In this step, if the cloud platform determines that the holder of the first terminal is unable to provide assistance, it generates a first authorization command and sends it to the door lock client. The door lock client then receives the first authorization command from the cloud platform.
[0077] The first authorization instruction is used to instruct the door lock client to authorize the unlocking permission of the second terminal. The first authorization instruction may include: the identifier of the second terminal.
[0078] Step 106: Authorize the unlocking permission of the second terminal based on the first authorization instruction.
[0079] In this step, the door lock client, based on the identifier of the second terminal in the first authorization command, matches with the second terminal via Bluetooth, the second terminal's MAC address, and other matching methods. After successful matching, the client authorizes the second terminal's unlocking permissions.
[0080] After successful authorization, the door lock client can directly send authorization information to the second terminal. The door lock client can also synchronize the successful authorization status with the cloud platform, which will then send authorization information to the second terminal. Upon receiving the authorization information from either the door lock client or the cloud platform, the second terminal confirms that it has permission to unlock the door.
[0081] The authorization information is used to determine the authorization status of unlocking the door, such as: unlocking permission authorized successfully.
[0082] The door lock authorization method in this embodiment sends a request for help to the cloud platform when it is determined that the user needs emergency rescue, receives a first authorization instruction from the cloud platform, and authorizes the unlocking permission of the second terminal based on the first authorization instruction. The door lock client can directly authorize the terminal indicated by the cloud platform. By remotely authorizing the second terminal, no manual operation by the user is required, thereby greatly shortening the rescue time.
[0083] Please see Figure 2 , Figure 2 This is a flowchart illustrating another door lock authorization method according to an exemplary embodiment of this application. This door lock authorization method can be applied to a cloud platform and may include the following steps:
[0084] Step 202: Receive a request for help from the door lock client; the request for help includes the user identifier who needs emergency rescue.
[0085] In this step, the cloud platform receives the help request information sent by the door lock client and identifies the user who needs emergency rescue based on the user identifier in the help request information.
[0086] Step 204: If it is determined that the holder of the first terminal is unable to provide assistance, generate a first authorization instruction; wherein the first authorization instruction includes the identifier of the second terminal, and the first terminal is the terminal bound to the user identifier.
[0087] In this step, the cloud platform sends a distress message to the first terminal bound to the user's identifier. After receiving the second authorization instruction from the first terminal, it determines that the holder of the first terminal is unable to provide assistance.
[0088] The cloud platform generates the first authorization command based on the second terminal of the rescue personnel who are rescuing the user.
[0089] In one embodiment, the cloud platform sends a distress message to the first terminal. If no confirmation message is received from the first terminal within a preset time period, it can be determined that the holder of the first terminal is unable to provide assistance, thereby quickly identifying rescue capabilities and shortening the time interval from discovering an emergency to implementing rescue.
[0090] The confirmation message is used to confirm that the first terminal has received the request for help.
[0091] Step 206: Send a first authorization instruction to the door lock client. The first authorization instruction is used to instruct the door lock client to authorize the unlocking permission of the second terminal.
[0092] In this step, the cloud platform sends a first authorization command to the door lock client, instructing the door lock client to authorize the unlocking permission of the second terminal.
[0093] Please see Figure 3 ,Figure 3 This is a flowchart illustrating another door lock authorization method according to an exemplary embodiment of this application. This door lock authorization method can be applied to a second terminal and may include the following steps:
[0094] Step 302: Receive authorization information sent by the door lock client or cloud platform. The authorization information is used to determine the authorization status for opening the door lock.
[0095] In this step, the second terminal can receive authorization information sent by the door lock client or cloud platform to confirm that the second terminal has the authorization status to open the door lock.
[0096] Please see Figure 4 , Figure 4 This is a flowchart illustrating another door lock authorization method according to an exemplary embodiment of this application. The door lock authorization method can be applied to a first terminal and may include the following steps:
[0097] Step 402: Receive the request for help sent by the cloud platform.
[0098] In this step, the first terminal receives a request for help sent by the cloud platform.
[0099] Step 404: If it is determined that the holder is unable to provide assistance, send a second authorization instruction to the cloud platform; the second authorization instruction includes: the user identifier requiring emergency assistance, and / or, the identifier of the second terminal.
[0100] In this step, upon receiving an indication that the holder is unable to provide assistance, or if the holder fails to respond for an extended period, the first terminal determines that the holder is beyond assistance. The first terminal then sends a second authorization command to the cloud platform, instructing the cloud platform to authorize the door lock client to grant the second terminal unlocking permissions.
[0101] In the foregoing embodiments, it was described that after the door lock client sends a request for help to the cloud platform, it authorizes the second terminal indicated by the cloud platform to unlock the door, thereby realizing remote door lock authorization. In the following embodiments, the unlocking process after door lock authorization will be described in detail, and this method can be applied to any of the above embodiments.
[0102] In one embodiment, the door lock client can acquire point cloud data of the user's environment, perform geometric reconstruction on the point cloud data of the user's environment, and obtain point cloud data of geometric shapes such as spheres, cuboids, and cubes.
[0103] For example, a door lock client can vertically project point cloud data to form a plane and obtain the planar coordinates of the point cloud data. Based on this plane, a reverse spherical polar coordinate projection is performed to form a sphere of point cloud data from this vertically projected point cloud data.
[0104] By directly mapping planar coordinates to spherical coordinates or using Lambert's isotropic projection, planar coordinates can be converted into spherical coordinates.
[0105] For example, the door lock client can directly map planar coordinates (x, y) to spherical coordinates according to the following formula 1.
[0106]
[0107] Where θ represents longitude, Let θ represent latitude, x represent the horizontal position in a plane coordinate system, y represent the vertical position in a plane coordinate system, and u and v represent scaling factors. The range of θ is [0, 2π]. The range is
[0108] The door lock client can also add Lambert's isometric projection according to the following formula 2 to map the plane coordinates (x, y) to a sphere with the center of the sphere as the projection point, and obtain the spherical coordinates.
[0109]
[0110] Where θ represents longitude, The x-axis represents latitude, the y-axis represents horizontal position in the plane coordinate system, and the r-axis represents vertical position in the plane coordinate system.
[0111] By incorporating Lambert's conformal projection when converting planar coordinates to spherical coordinates, the distortion problem in the inverse spherical coordinate process can be solved, making the point cloud data of the sphere obtained by geometric reconstruction more accurate.
[0112] The door lock client performs a Cartesian transformation on the obtained spherical coordinates to obtain the Cartesian coordinates on the sphere, thus obtaining the point cloud data of the sphere corresponding to the point cloud data.
[0113] The door lock client can obtain the Cartesian coordinates (X, Y, Z) after Cartesian transformation of the spherical coordinates according to the following formula 3:
[0114]
[0115] Where θ represents longitude, The coordinates represent latitude, X represents the position along the X-axis of the Cartesian coordinate system, Y represents the position along the Y-axis of the Cartesian coordinate system, Z represents the position along the Z-axis of the Cartesian coordinate system, and r represents the radius of the sphere.
[0116] As described above, by vertically projecting the point cloud data, we obtain the planar coordinates of the point cloud data. We then convert the planar coordinates into spherical coordinates and perform a Cartesian transformation on the spherical coordinates to obtain the point cloud data of the sphere corresponding to the point cloud data. The specific shape and details of the point cloud data will be abstracted or generalized to a certain extent, thereby hiding sensitive information such as human body and environment in the point cloud data.
[0117] The door lock client can split the geometrically reconstructed point cloud data to generate the house's door lock password. It can also split the point cloud data of the user's environment to obtain a first point cloud and a second point cloud.
[0118] Taking the geometrically reconstructed point cloud data as a spherical point cloud as an example, the door lock client splits the spherical point cloud based on a preset splitting ratio to obtain the first point cloud and the second point cloud.
[0119] A temporary password is generated based on the first point cloud and cached locally on the door lock client. A first image is generated based on the second point cloud and sent to a second terminal with unlocking authority. The second terminal receives the first image sent by the door lock client.
[0120] The first image is generated from the second point cloud, which is obtained by splitting the point cloud of the user's environment based on the door lock client. It is used for password verification when unlocking.
[0121] The door lock client can also encrypt and send the generated first image, further ensuring that the first image does not leak user privacy and environmental privacy from the point cloud data.
[0122] In one embodiment, the door lock client can send an updated first image to the second terminal via frequency conversion. After authorizing the second terminal, the door lock client obtains the distance between the second terminal and the user. Based on the distance between the second terminal and the user, the time required for rescue personnel to arrive at the house is calculated, and the door lock password update frequency is determined.
[0123] Based on the update frequency, the door lock client selects the point cloud data corresponding to the current timestamp, updates the temporary password and the first image for the point cloud data corresponding to the current timestamp, and sends the updated first image to the second terminal.
[0124] The closer the second terminal is to the user, the faster the update frequency. For example, when rescuers begin their journey, a lower update frequency is maintained, updating and sending new first images. Once the distance reaches within 100 meters, new first images are updated and sent every 30 seconds.
[0125] When the distance between the second terminal and the user reaches 5 to 10 meters, a new first image is updated and sent at the highest update frequency of 1 second.
[0126] As described above, by determining the update frequency of the temporary password and the first image based on the distance between the second terminal and the user, and selecting the point cloud data corresponding to the current timestamp based on the update frequency, the password is updated. When the distance is far, reducing the password update frequency can reduce the consumption of system resources, while when the distance is close, increasing the update frequency can ensure the real-time performance and security of password authorization.
[0127] In one embodiment, the second terminal can collect the holder's second biometric information through fingerprint enrollment, facial scanning, or other methods, and send the collected second biometric information to the door lock client. The door lock client receives the second biometric information sent by the second terminal and generates a temporary password based on the second biometric information.
[0128] The second biometric information is the biometric information of the holder of the second terminal, such as fingerprints or facial features.
[0129] As mentioned above, temporary passwords can be quickly and easily generated using biometric information such as fingerprints and facial features of rescue personnel, eliminating the need for them to carry additional keys or password cards and thus improving the convenience of rescue operations.
[0130] In one embodiment, after the holder of the second terminal arrives at the user's house, the door lock client can obtain a first password provided by the holder of the second terminal. The first password is then matched with a temporary password; if the first password and the temporary password match, the door lock is opened.
[0131] The first password includes: the door lock password provided by the second terminal based on the first image, or the first biometric information collected by the door lock client.
[0132] The door lock client can scan the door lock password provided by the rescuer based on the first image through the camera in the door lock, and obtain the split point cloud data in the door lock password provided by the rescuer.
[0133] The door lock client merges the point cloud data from the first point cloud with the split point cloud data from the password provided by the rescuers to obtain a merged point cloud. Mercator projection is then applied to the merged point cloud to restore it to the original point cloud data before geometric reconstruction.
[0134] Calculate and merge the point cloud data corresponding to the merged point cloud data and the point cloud data of the user's environment that have the same coordinates. If the number of points in the point cloud set exceeds a preset threshold, determine that the password provided by the rescuer is the door lock password and unlock the door.
[0135] The first biometric information is the biometric information collected by the door lock client, such as fingerprints and faces.
[0136] The split ratio is the proportion of point cloud data in the first point cloud to the point cloud data in the user's environment, and the proportion of point cloud data in the second point cloud to the point cloud data in the user's environment. It is used to split point cloud data.
[0137] The splitting ratio can be calculated using N decimal places. The larger the number of decimal places, the higher the confidence level of the generated door lock password. For example, if the splitting ratio is 8 decimal places, the proportion of point cloud data in the first point cloud is 0.51564893, and the proportion of point cloud data in the second point cloud is 0.48435107.
[0138] The first point cloud is used to generate a temporary password, and the second point cloud is used to provide the door lock password to rescuers. The split point cloud data in the second point cloud is the point cloud data that makes up the second point cloud, and the split point cloud data in the password provided by the rescuers is the point cloud data in the first image provided by the rescuers and captured by the door lock.
[0139] Merging the point cloud involves combining the split point cloud data from the password provided by rescuers with the point cloud data from the first point cloud. This process is used to verify the accuracy of the password provided by rescuers. Restoring the point cloud data involves restoring the merged point cloud to obtain 3D point cloud data, which is used to verify the degree of matching with the original point cloud data.
[0140] The preset threshold is used to determine whether the number of points in the point cluster meets the conditions for opening the door lock. The number of digits in the preset threshold can be less than the number of digits in the split ratio. Taking the split ratio as 8 decimal places as an example, the number of digits in the preset threshold only needs to be set to 6.
[0141] Setting the number of bits in the preset threshold to be less than the number of bits in the split ratio can prevent the door lock from failing to open due to minor errors in the dot cloud due to issues such as scanning range and scanning angle when the door lock scans the password provided by the rescue personnel through the camera.
[0142] The door lock client can also collect first biometric information, compare the first biometric information with a temporary password generated based on second biometric information, and unlock the door if the match is successful.
[0143] In one embodiment, the second terminal can perform password verification for the door lock. Based on the request for assistance, the cloud platform generates assignment information, instructing designated personnel to provide emergency assistance to the user. The cloud platform then sends the assignment information to the second terminal.
[0144] The second terminal receives the assignment information sent by the cloud platform. If the fourth biometric information collected by the second terminal matches the third biometric information of the designated person, it sends an unlocking command to the door lock client. Upon receiving the unlocking command, the door lock client unlocks the door.
[0145] Among them, the third biometric information is the biometric information of the designated person, the fourth biometric information is the biometric information collected by the second terminal, and the unlocking command is used to instruct the door lock client to unlock the door.
[0146] The assignment information is used to instruct designated personnel to carry out emergency rescue. Designated personnel may include property management staff who assist users, etc.
[0147] By verifying the fourth biometric information collected by the second terminal and the third biometric information of the designated person, the biometric information does not need to be sent to the door lock client, thus ensuring the security and privacy of the biometric information.
[0148] In one embodiment, the door lock client can detect whether the door lock status has changed. If it is determined that the door lock status has changed, the client can send the door lock status information to the cloud platform.
[0149] Based on the door lock status information received from the door lock client, the cloud platform sends a first notification message to the first terminal, notifying the holder of the first terminal that the door lock status has changed.
[0150] The door lock status information indicates whether the door lock is open or closed. The first notification message indicates a change in the door lock status.
[0151] As mentioned above, any change in the door lock status can be detected and reported instantly, and the cloud platform will then send a notification message to the first terminal to ensure that the holder of the first terminal can quickly understand the latest status of the door lock and the rescue situation.
[0152] In one embodiment, after the door lock is opened, if the distance between the door lock client and the second terminal exceeds a first value, the door lock client stops authorizing the unlocking permission of the second terminal.
[0153] The door lock client can also detect that the user has left the house after a specified period and revoke authorization for unlocking the door on the second terminal. The door lock authorization automatically expires after the rescue mission is completed, ensuring that users don't need to worry about forgetting to lock the door or having their permissions abused.
[0154] The first value is used to limit the distance range between the second terminal and the user.
[0155] The foregoing embodiments described the use of temporary passwords to verify rescue personnel and ensure user security. The following embodiments will provide a more detailed explanation of the emergency situation determination process, which can be applied to any of the above embodiments.
[0156] In one embodiment, please refer to Figure 5 , Figure 5The diagram illustrates a method for determining if a user needs emergency assistance. A smart healthcare system may include electronic devices such as smart vanity mirrors, smart changing tables, smart water heaters, bathroom heaters, smart speakers, and televisions.
[0157] The electronic device may include a millimeter-wave radar system-on-chip (SOC), which is used to acquire point cloud data. The electronic device can be deployed in at least one room, such as a bathroom, balcony, bedroom, or living room.
[0158] Electronic devices are based on advanced millimeter-wave radar technology. They use 3D sensors such as LiDAR and RGB-D cameras to scan and obtain point sets containing a large amount of three-dimensional coordinate information. They use electromagnetic waves to perform non-contact measurement and extract information such as distance, speed and angle of the target object by measuring the signal reflected back from the target object, thereby collecting point cloud data of the user's environment.
[0159] Point cloud data is a data structure used to represent the shape and surface features of objects in three-dimensional space. It is formed by scanning and collecting a large amount of discrete point data. Each point in point cloud data has specific three-dimensional coordinates, and each point represents a specific location in three-dimensional space.
[0160] Electronic devices perform preprocessing on point cloud data, such as filtering to remove noise, to improve the quality of the point cloud data. Methods like voxel grid filtering and statistical outlier removal can also be used to segment or grow regions within the point cloud data to isolate parts that may contain human figures.
[0161] In one embodiment, the electronic device may be located in a first room, which is a room where privacy protection is required, such as a bathroom or bedroom.
[0162] The door lock client performs target detection on the point cloud data collected in the first room. It uses point cloud target detection algorithms, based on 3D convolutional neural network models such as PointNet, PointNet++, Vote3Deep, and Point-based 3DObject Detection with RCNN (PointRCNN), to identify whether there are candidate boxes with human shapes in the point cloud data.
[0163] The door lock client performs feature processing on the point cloud data, extracting human features such as topological structure, size proportions, and posture information. The extracted features are then input into a pre-trained classifier, which can distinguish whether the point cloud data represents a human body or other objects.
[0164] The door lock client performs post-processing on the initially detected human candidate regions, such as checking for typical human body parts like the head, torso, and limbs. It may also combine 2D image information and motion information from point cloud data acquired in consecutive frames to enhance the accuracy of the judgment.
[0165] The door lock client obtains target point cloud data that matches the user's human body characteristics from the point cloud data. The target point cloud data forms the user's human body shape and structure, and is used to describe the user's position and shape in space. This target point cloud data meets a certain confidence threshold, which is set based on pre-stored data such as the user's height and weight.
[0166] The door lock client performs anonymization processing on the target point cloud data, which is used to remove sensitive information from the target point cloud data.
[0167] The door lock client determines that a user needs emergency rescue based on the anonymized target point cloud data. For example, if there are abnormal fluctuations in the point cloud within a very short period of time, or if the location information remains unchanged for a relatively long period of time, it can be determined that the user has fallen and needs emergency rescue.
[0168] In one embodiment, the door lock client can perform anonymization processing on the target point cloud data, and determine whether the user has fallen and whether the user needs emergency rescue based on the anonymized target point cloud data.
[0169] Desensitization processing can involve shifting the position of the point cloud set that constitutes human body features in the target point cloud data, and making a small random shift of the position information that reflects key human body features in the target point cloud data.
[0170] Suppose P represents a spatial data point in the original target point cloud data. Assume it is a point in N-dimensional space, and the coordinates of P are P = (x1, x2, ..., xn). Add a random perturbation vector Δ obtained from a Gaussian distribution with equal probability. Each component Δi is independent and identically distributed, and all follow a normal distribution with a mean of 0 and a standard deviation of σ: Δi ~ N(0, σ²), i = 1, 2, ..., n.
[0171] The point P that is offset from its position after random perturbation is: P' = P + Δ = (x1 + Δ1, x2 + Δ2, ..., xn + Δn).
[0172] Then, the point cloud after the positional shift is locally smoothed, and the locally smoothed spatial data points are obtained by weighted averaging of the points in the neighborhood.
[0173] The door lock client can calculate the locally smoothed spatial data points according to the following formula 4:
[0174]
[0175] Where P′ represents the locally smoothed spatial data point, w(Q) represents the weight of point Q with respect to point P, N(P) represents the neighborhood of point P, and point Q represents a point in N(P).
[0176] Desensitization can be achieved by using spatial downsampling techniques to reduce the resolution of the target point cloud data.
[0177] Desensitization processing can be used to remove facial features from target point cloud data. For example, facial point cloud data can be directly deleted, or synthetic techniques can be used to generate non-realistic facial features to replace real faces.
[0178] Desensitization processing can remove body markers such as tattoos and scars from target point cloud data, and apply deformation algorithms to change the overall shape or proportion of the human body in the target point cloud data, maintaining the human form of the target point cloud data while eliminating individual differences of users.
[0179] As mentioned above, by shifting the position of the point cloud set that constitutes human features in the target point cloud data and performing local smoothing, the precise body contours in the target point cloud data can be blurred; by using spatial downsampling technology to reduce the resolution of the target point cloud data, the details of the point cloud data can be reduced, making individual features less distinguishable; eliminating facial features in the target point cloud data can prevent the leakage of users' facial information and protect users' personal privacy; eliminating tattoos, scars and other body markings in the target point cloud data can reduce the exposure of users' personal features, thereby reducing users' concerns about the leakage of personal privacy and enhancing users' trust and satisfaction with the system.
[0180] In one embodiment, please continue to refer to Figure 5 Since the environment inside a house is permanent, the door lock client can analyze the environmental point cloud data based on the user's surroundings. The portion of the point cloud data with the highest percentage of occurrences is sampled to form the environmental point cloud data.
[0181] By comparing the location information of obstacles such as sharp objects in the environmental point cloud data with the user's location information in the point cloud data, the risk of collision between the user and the user's environment can be detected.
[0182] Based on point cloud data and collision risk, collision risk is used as an auxiliary indicator for fall detection using point cloud data, forming a more comprehensive understanding of the user's status, determining whether a user has fallen, and identifying the user who needs emergency rescue.
[0183] Among them, environmental point cloud data is point cloud data composed of the fixed environment within a building, used to help determine whether a user needs emergency rescue. Environmental point cloud data can also be used to perform differential processing on the collected real-time point cloud data, and the differential point cloud data can be used for target detection and feature processing to obtain target point cloud data.
[0184] As described above, by analyzing environmental point cloud data based on the user's environment, and detecting the risk of collision between the user and the environment, the system can determine whether the user needs emergency rescue based on the point cloud data and the collision risk. Using the risk of collision between the user and the environment as an auxiliary indicator for fall detection can improve the accuracy and reliability of emergency assistance.
[0185] In one embodiment, please continue to refer to Figure 5 The door lock client can apply point cloud pose estimation algorithms to extract the three-dimensional position information of human joints such as head, shoulder, hip, knee, and ankle from point cloud data.
[0186] Based on location information, the user's posture data, composed of human joints, is analyzed and extracted. This posture data is obtained by analyzing point cloud data of the user's environment.
[0187] Posture data may include: the magnitude of the shift in the center of gravity, the tilt angle of the human body, the angle between the legs and the ground, and the difference in angle between the legs and the ground.
[0188] The door lock client can calculate the centroid position of the target point cloud data according to the following formula 5:
[0189]
[0190] Where CG represents the centroid position of the target point cloud data, Pi represents the three-dimensional coordinates of human joints such as the head, chest, buttocks, and feet, and n represents the number of human joints.
[0191] Human body tilt angle is the degree of inclination of a user's body relative to the vertical direction of the ground. It can be obtained by calculating the angle between the vector from the center of gravity of the body to the vertical line of position and the vertical vector. The door lock client can calculate the tilt angle of the human body according to the following formula 6:
[0192]
[0193] Where cos(α) represents the tilt angle of the human body, CG represents the centroid position of the target point cloud data, and Gravity represents the direction pointing towards the Earth's gravity, which is vertically downward in the ideal case.
[0194] The door lock client can calculate the angle between the thigh and the torso using the following formula 7:
[0195]
[0196] Where cos(θ) represents the angle between the thigh and the torso, TH represents the vector connecting the thigh to the hip and knee joints in the target point cloud data, and Vertical represents the vector connecting the thigh to the hip and knee joints.
[0197] When a user is walking or standing normally, their center of gravity is relatively stable. However, when a fall occurs, the center of gravity will suddenly shift significantly, causing the shift to exceed the preset range.
[0198] At the moment of a fall, the angle of inclination of the user's body relative to the vertical direction may exceed a preset angle. When a user falls, the angle between their legs and the ground may exceed a preset angle.
[0199] When a user is standing normally, the height of the head and the hips has a certain fixed ratio. When falling, the height of the head and the hips may change significantly, and the height difference between the head and the hips may exceed the preset difference.
[0200] The door lock client can determine that a user has fallen based on posture data if at least one of the following fall determination rules is met: the offset of the center of gravity exceeds a preset range, the tilt angle of the human body exceeds a preset angle, the clamping angle between the legs and the ground exceeds a preset angle, or the height difference between the legs and the ground exceeds a preset difference.
[0201] The door lock client can also calculate the probability of a user falling based on various fall detection rules using posture data, and determine whether a fall has occurred based on the fall probability.
[0202] As described above, by extracting the position information of human joints from point cloud data, and analyzing the user's posture data based on the position information, if at least one of the following conditions is met: the offset of the center of gravity in the posture data exceeds a preset range, the tilt angle of the human body in the posture data exceeds a preset angle, the angle between the legs and the ground in the posture data exceeds a preset angle, or the height difference between the head and buttocks in the posture data exceeds a preset difference, a fall is determined to have occurred. By comprehensively considering the user's posture data in the point cloud data, the user's posture status can be more comprehensively assessed, reducing misjudgments and omissions, and improving the accuracy of emergency assistance.
[0203] In one embodiment, the door lock client can analyze point cloud data of multiple consecutive frames of the user's environment. If the user's posture data does not change within a preset time period, it can be determined that the user needs emergency rescue.
[0204] The door lock client can collect body indicator data through users' smart bracelets, smartwatches and other motion-sensing devices. If the user's body indicator data shows abnormal changes, it can determine that the user needs emergency rescue.
[0205] If the door lock client detects a leak of harmful gases indoors, it can determine that the user needs emergency assistance.
[0206] If the door lock client detects that someone has entered the room without authorization, it can determine that the user needs emergency rescue.
[0207] Point cloud data can accurately compose the shape of a user and their environment, representing the user's actions and postures. The user's environment refers to the area within a house where the user is located, such as the bathroom or living room.
[0208] Body metrics data are collected through the user's motion-sensing devices, such as blood pressure and heart rate. These body metrics data reflect changes in the user's internal physiological state.
[0209] Understandably, after collecting point cloud data of the user's environment, the electronic device can send the point cloud data to the door lock client, which can then use the point cloud data to determine whether the user needs emergency rescue. Alternatively, the electronic device can use the point cloud data to determine whether the user needs emergency rescue, and if it determines that the user needs emergency rescue, it can send a second notification message to the door lock client, notifying the door lock client to send a request for help to the cloud platform.
[0210] The second notification message is used to indicate to the user that they need emergency assistance.
[0211] In one embodiment, the smart elderly care system includes multiple electronic devices connected via the Matter protocol based on deep learning, sharing computing power. These multiple electronic devices are located in the user's home and can share computing power to jointly perform tasks such as fall detection, door lock authorization, and password generation.
[0212] The Matter protocol is an IPv6-based protocol running on TCP / IP. It serves as the foundation for interoperability between multiple electronic devices and can be further subdivided for different user habits and situations.
[0213] The Matter protocol, based on deep learning, can use AI to assemble real-time protocol content, which is more in line with the characteristics of volume, lighting, and scene, and can more intuitively meet the user's needs for information reception speed and effect.
[0214] It also allows you to select the optimal route in real time, such as whether to use Bluetooth or WIFI, whether to use multi-threaded transmission, and the selection of dynamic Internet Protocol (IP).
[0215] When performing tasks, the smart healthcare system can distribute computing power among different electronic devices and complete corresponding deep learning and scenario adaptation through the Multi-Admin feature.
[0216] As described above, multiple electronic devices connected by the Matter protocol based on deep learning in the house, sharing computing power, jointly perform tasks such as emergency judgment and door lock authorization. The multiple electronic devices work together and use their respective computing power to perform parallel processing, realizing the integration of hardware and software in the smart health care system. This can not only speed up data processing but also improve the overall performance of the system.
[0217] Please see Figure 6 , Figure 6 This is a flowchart illustrating another door lock authorization method according to an exemplary embodiment of this application. This door lock authorization method can be applied to a smart elderly care system and may include the following steps:
[0218] Step 602: If it is determined that the user needs emergency rescue, send a request for help to the cloud platform; the request for help includes the user's identifier.
[0219] In this step, the smart healthcare system determines whether the user needs emergency assistance based on the collected point cloud data and other information. If it determines that the user needs emergency assistance, it sends a request for help to the cloud platform.
[0220] Step 604: Authorize the unlocking permissions of the second terminal as indicated by the cloud platform.
[0221] In this step, the cloud platform instructs the second terminal of the rescue personnel heading to the rescue to the smart health and wellness system, and the smart health and wellness system authorizes the unlocking permission of the second terminal instructed by the cloud platform.
[0222] Please see Figure 7 , Figure 7 A schematic diagram of a hierarchical response processing method is shown. The door lock client can perform hierarchical response processing.
[0223] For example, when the smart elderly care system is handling a Level 1 response, it can push notifications to the first terminal of emergency response personnel, enabling them to contact users by calling peripherals such as virtual sound cards and virtual speakers.
[0224] The smart elderly care system utilizes direct Wi-Fi connection to remotely activate electronic devices with audio playback capabilities, such as cameras and televisions equipped with sound cards or speakers. It also connects to the primary communication terminal of emergency response personnel to make calls and inquire about user needs.
[0225] In the same home environment, hardware devices with the same function are currently coupled; for example, speakers and microphones are commonly found in most home appliances. Therefore, even if an electronic device with a SOC chip does not have a corresponding peripheral, the Matter protocol based on deep learning can be used to dynamically allocate virtual peripherals to meet the needs of proximity interaction, thereby reducing the consumption of hardware resources and improving the system's compatibility and scalability.
[0226] If a timely response is received, it proves that the user has not experienced any abnormality and the fall was a false alarm; however, if the user does not respond for an extended period of time, a secondary response is required.
[0227] When the smart elderly care system initiates a level-two response, it sends alerts to the command centers and emergency response centers of the connected communities or property management companies, pushing the user's specific location and the emergency situation to the relevant community personnel for confirmation and verification, thereby promoting collaboration and cooperation among multiple parties.
[0228] If community staff are unable to communicate with users in a timely manner through video intercom devices such as smart doorbells, or if platforms such as command centers and emergency response centers are unable to respond in a timely manner, and a final response is required after a certain period of time.
[0229] When the smart elderly care system is in the final response phase, it sends a distress request to the cloud platform. The cloud platform then dispatches rescue personnel to the user's residence. It can also distribute full-screen alarms to integrated advertising devices located within the community or under property management.
[0230] By implementing a tiered response system, different levels of response correspond to different resource allocations, which can optimize the utilization of rescue resources. If the initial response is ineffective, it can be quickly escalated to a higher level, avoiding wasted time and improving overall response efficiency.
[0231] To further explain the door lock authorization process, Figure 8 An interactive diagram of a door lock authorization method is shown. This door lock authorization method is executed by a smart elderly care system. Figure 9 A schematic diagram of a smart elderly care system is shown. The smart elderly care system may include: a door lock client 90, an electronic device 91 including a SOC chip, a cloud platform 92, a first terminal 93, and a second terminal 94.
[0232] The door lock authorization method may include the following steps:
[0233] Step 802: Perform target detection on the point cloud data collected in the first room to obtain target point cloud data.
[0234] In this step, electronic device 91, one of the multiple electronic devices in the house, collects point cloud data of the user's environment. The door lock client 90 performs target detection and feature processing on the point cloud data to obtain the target point cloud data.
[0235] Step 804: De-identify the target point cloud data.
[0236] In this step, the door lock client 90 uses methods such as position offset, spatial downsampling, and elimination of point cloud features to desensitize the target point cloud data.
[0237] Step 806: Based on the de-identified target point cloud data, determine if the user needs emergency rescue.
[0238] In this step, the door lock client 90 determines that the user needs emergency rescue by analyzing the user's posture data in the target point cloud data and combining it with the body indicator data collected by the motion sensing device.
[0239] Step 808: If it is determined that the user needs emergency rescue, send a request for help to the cloud platform.
[0240] In this step, if the door lock client 90 determines that the user needs emergency rescue, it sends a request for help to the cloud platform 92.
[0241] Step 810: Send a request for help to the first terminal.
[0242] In this step, the cloud platform 92 sends a request for help to the first terminal 93.
[0243] Step 812: If it is determined that the holder is unable to be rescued, send a second authorization instruction to the cloud platform.
[0244] In this step, if the first terminal 93 determines that the holder cannot be rescued, it sends a second authorization instruction to the cloud platform 92.
[0245] Step 814: Send the first authorization command to the door lock client.
[0246] In this step, if the cloud platform 92 determines that the holder of the first terminal 93 is unable to provide assistance, it generates a first authorization instruction and sends the first authorization instruction to the door lock client 90.
[0247] Step 816: Authorize the unlocking permission of the second terminal based on the first authorization instruction.
[0248] In this step, the door lock client 90 authorizes the unlocking permission of the second terminal 94 based on the first authorization command. The second terminal 94 receives the authorization information sent by the door lock client 90 or the cloud platform 92.
[0249] The door lock client 90 can split the point cloud data of the user's environment to obtain a first point cloud and a second point cloud, generate a temporary password based on the first point cloud, and send the first image generated based on the second point cloud to the second terminal 94 with unlocking authority.
[0250] The door lock client 90 can also receive second biometric information sent by the second terminal 94, and generate a temporary password based on the second biometric information.
[0251] Step 818: Obtain the first password provided by the holder of the second terminal.
[0252] In this step: the door lock client 90 obtains the door lock password provided by the second terminal 94 based on the first image, or the collected first biometric information, to obtain the first password.
[0253] Step 820: If the first password matches the temporary password, unlock the door.
[0254] In this step, the door lock client 90 unlocks the door if the first password matches the temporary password.
[0255] Step 822: After the door lock is opened, and the rescue operation is confirmed to be over, stop authorizing the second terminal to unlock.
[0256] In this step, after the door lock is opened, if the distance between the door lock client 90 and the second terminal 94 exceeds a first value, or if the user has left the house after a specified period of time, the door lock client 90 confirms that the rescue is over and stops authorizing the second terminal to unlock.
[0257] Figure 10 This is a schematic diagram illustrating the structure of an electronic device according to an exemplary embodiment of this application. The electronic device may be, for example, a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, personal digital assistant, server, smart home appliance, in-vehicle system, etc. (Reference) Figure 10 At the hardware level, the electronic device includes a processor 1002, an internal bus 1004, a network interface 1006, memory 1008, and non-volatile memory 1010, and may also include other hardware required for business operations. The processor 1002 reads the corresponding computer program from the non-volatile memory 1010 into the memory 1008 and then runs it, forming a door lock authorization device at the logical level. Of course, in addition to the software implementation, this application does not exclude other implementation methods, such as logic devices or a combination of hardware and software, etc. That is to say, the execution subject of the following processing flow is not limited to individual logic units, but can also be hardware or logic devices.
[0258] Figure 11This is a block diagram illustrating a door lock client according to an exemplary embodiment of this application. (Refer to...) Figure 11 The door lock client may include: an information sending module 1102, an instruction receiving module 1104, and a terminal authorization module 1106, wherein:
[0259] The information sending module 1102 is used to send a request for help to the cloud platform when it is determined that a user needs emergency rescue; wherein the request for help includes a user identifier;
[0260] The instruction receiving module 1104 is used to receive a first authorization instruction sent by the cloud platform; wherein, the first authorization instruction includes the identifier of the second terminal;
[0261] The terminal authorization module 1106 is used to authorize the unlocking permission of the second terminal based on the first authorization instruction.
[0262] In one example, the terminal authorization module 1106 is further configured to split the point cloud data of the user's environment to obtain a first point cloud and a second point cloud; generate a temporary password based on the first point cloud; and send a first image generated based on the second point cloud to the second terminal with unlocking authority.
[0263] In one example, the terminal authorization module 1106 is further configured to receive second biometric information sent by the second terminal with unlocking authority; wherein the second biometric information is the biometric information of the holder of the second terminal; and generate a temporary password based on the second biometric information.
[0264] In one example, the terminal authorization module 1106, after generating a temporary password, further includes: obtaining a first password; wherein the first password includes: a door lock password provided by the second terminal based on a first image, or first biometric information collected by the door lock client; and opening the door lock if the first password matches the temporary password.
[0265] In one example, after authorizing the unlocking permission of the second terminal, the terminal authorization module 1106 further includes: receiving an unlocking command sent by the second terminal and then unlocking the door; wherein the unlocking command is sent by the second terminal when the third biometric information of the designated person matches the collected fourth biometric information.
[0266] In one example, the information sending module 1102, when determining that a user needs emergency rescue, includes at least one of the following: the user's posture data has not changed within a preset time period, the posture data being obtained by analyzing point cloud data of the user's environment; the user's body indicator data shows abnormal changes, the body indicator data being collected by the user's somatosensory device; there is a leak of harmful gas indoors; or unauthorized personnel have entered the room.
[0267] In one example, the user is in a first room, which is a room requiring privacy protection. Before sending a request for help to the cloud platform if it is determined that the user needs emergency assistance, the information sending module 1102 further includes: performing target detection on point cloud data collected in the first room to obtain target point cloud data; performing desensitization processing on the target point cloud data; wherein the desensitization processing is used to remove sensitive information from the target point cloud data; and determining that the user needs emergency assistance based on the desensitized target point cloud data.
[0268] In one example, the desensitization process includes at least one of the following: positionally offsetting the point cloud dataset constituting human features in the target point cloud data; reducing the resolution of the target point cloud data using spatial downsampling techniques; removing facial features from the target point cloud data; and removing body markers from the target point cloud data.
[0269] In one example, the terminal authorization module 1106 is further configured to send door lock status information to the cloud platform if it is determined that the door lock status has changed.
[0270] In one example, the terminal authorization module 1106 is further configured to: after the door lock is opened, if the distance between the user and the second terminal exceeds a first value, stop authorizing the unlocking permission of the second terminal; or after a specified period of time, if the user is detected to have left the house, stop authorizing the unlocking permission of the second terminal.
[0271] Figure 12 This is a block diagram illustrating a cloud platform according to an exemplary embodiment of this application. (Refer to...) Figure 12 The cloud platform may include: an information receiving module 1202, an instruction generation module 1204, and an instruction sending module 1206, wherein:
[0272] The information receiving module 1202 is used to receive a request for help sent by the door lock client; the request for help includes a user identifier who needs emergency rescue;
[0273] The instruction generation module 1204 is used to generate a first authorization instruction when it is determined that the holder of the first terminal is unable to provide assistance; wherein, the first authorization instruction includes the identifier of the second terminal, and the first terminal is the terminal bound to the user identifier;
[0274] The instruction sending module 1206 is used to send the first authorization instruction to the door lock client, the first authorization instruction being used to instruct the door lock client to authorize the unlocking permission of the second terminal.
[0275] In one example, the instruction sending module 1206 is further configured to send a first notification message to the first terminal based on the door lock status information received from the door lock client, the first notification message being used to indicate a change in the door lock status.
[0276] In one example, the instruction generation module 1204, when determining that the holder of the first terminal is unable to provide assistance, includes: sending the request for help to the first terminal; and determining that the holder of the first terminal is unable to provide assistance based on the second authorization instruction sent by the first terminal; wherein the second authorization instruction includes: the user identifier, and / or, the identifier of the second terminal.
[0277] In one example, the instruction generation module 1204, when determining that the holder of the first terminal is unable to provide assistance, includes: sending the request for help to the first terminal; if no confirmation message is received from the first terminal within a preset time period, determining that the holder of the first terminal is unable to provide assistance; wherein, the confirmation message is used to confirm that the first terminal has received the request for help.
[0278] In one example, the instruction sending module 1206 is further configured to generate assignment information based on the request for help information; the assignment information is used to instruct designated personnel to carry out emergency rescue; and send the assignment information to the second terminal.
[0279] Figure 13 This is a block diagram illustrating a second terminal according to an exemplary embodiment of this application. (Refer to...) Figure 13 The second terminal may include: an authorization receiving module 1302, wherein:
[0280] The authorization receiving module 1302 is used to receive authorization information sent by the door lock client or cloud platform, and the authorization information is used to determine the authorization status of opening the door lock.
[0281] In one example, the authorization receiving module 1302 is further configured to receive a first image sent by the door lock client; wherein the first image is generated based on a second point cloud obtained by the door lock client through point cloud decomposition of the user's environment.
[0282] In one example, the authorization receiving module 1302 is further configured to send the collected second biometric information to the door lock client; wherein the second biometric information is the biometric information of the holder of the second terminal.
[0283] In one example, the authorization receiving module 1302 is further configured to receive assignment information sent by the cloud platform; the assignment information is used to instruct designated personnel to carry out emergency rescue; and, if the fourth biometric information matches the third biometric information of the designated personnel, to send an unlocking command to the door lock client; wherein the fourth biometric information is the biometric information collected by the second terminal, and the unlocking command is used to instruct the door lock client to unlock the door.
[0284] Figure 14 This is a block diagram illustrating a first terminal according to an exemplary embodiment of this application. (Refer to...) Figure 14 The first terminal may include: a distress call receiving module 1402 and a rescue response module 1404, wherein:
[0285] The help-receiving module 1402 is used to receive help-receiving information sent by the cloud platform;
[0286] The rescue response module 1404 is used to send a second authorization instruction to the cloud platform when it is determined that the holder is unable to be rescued; the second authorization instruction includes: the user identifier that needs emergency rescue, and / or, the identifier of the second terminal.
[0287] The specific implementation process of the functions and roles of each unit in the above device can be found in the implementation process of the corresponding steps in the above method, and will not be repeated here.
[0288] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to in the description of the method embodiments. The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this application according to actual needs. Those skilled in the art can understand and implement this without creative effort.
[0289] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory including instructions, is also provided, which can be executed by a processor of a door lock authorization device to implement the method as described in any of the above embodiments.
[0290] The non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc., and this application does not limit it.
[0291] In an exemplary embodiment, a computer program product including a computer program / instructions is also provided, which can be executed by a processor of a door lock authorization device to implement the method described in any of the above embodiments.
[0292] The foregoing has described specific embodiments of this application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired results. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0293] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention filed herein. This application is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and alterations can be made without departing from its scope. The scope of this application is limited only by the appended claims.
[0294] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.
Claims
1. A door lock authorization method characterized by, The method is executed by a door lock client, and the method comprises: In the case of determining that the user needs emergency assistance, sending help information to a cloud platform; wherein the help information comprises a user identifier; Receiving a first authorization instruction sent by the cloud platform; wherein the first authorization instruction comprises an identifier of a second terminal; Based on the first authorization instruction, the opening permission of the second terminal is authorized.
2. The method of claim 1, wherein, The method further comprises: Splitting the point cloud data of the environment where the user is located to obtain first point cloud and second point cloud; Generating a temporary password based on the first point cloud; Sending a first image generated based on the second point cloud to the second terminal with opening permission.
3. The method of claim 1, wherein, The method further comprises: Receiving second biological information sent by the second terminal with opening permission; wherein the second biological information is the biological information of the holder of the second terminal; Based on the second biological information, a temporary password is generated.
4. The method according to claim 2 or 3, characterized in that, After generating the temporary password, the method further comprises: Obtaining a first password; wherein the first password comprises: a door lock password provided by the second terminal based on the first image, or first biological information collected by the door lock client; In the case that the first password matches the temporary password, the door lock is opened.
5. The method of claim 1, wherein, After authorizing the opening permission of the second terminal, the method further comprises: After receiving the opening instruction sent by the second terminal, the door lock is opened; wherein the opening instruction is sent by the second terminal in the case that the third biological information of the designated person matches the fourth biological information collected.
6. The method of claim 1, wherein, The determination that the user needs emergency assistance comprises at least one of the following: The user's posture data does not change within a predetermined time period, and the posture data is obtained by analyzing the point cloud data of the environment where the user is located; The user's body index data shows abnormal changes, and the body index data is collected by the user's body sensing device; Indoor harmful gas leakage; Unauthorized personnel enter the indoor.
7. The method of claim 1, wherein, The user is in a first room, and the first room is a room that needs privacy protection; Before sending the help information to the cloud platform, the method further comprises: Performing target detection on the point cloud data collected in the first room to obtain target point cloud data; Performing desensitization processing on the target point cloud data; wherein the desensitization processing is used to remove sensitive information in the target point cloud data; According to the target point cloud data after desensitization processing, it is determined that the user needs emergency assistance.
8. The method of claim 7, wherein, The desensitization processing comprises at least one of the following: Position offset is performed on the point cloud data set in the target point cloud data which constitutes the human body feature; Using spatial downsampling technology, the resolution of the target point cloud data is reduced; Eliminate the facial features in the target point cloud data; Eliminate the body marks in the target point cloud data.
9. The method of claim 1, wherein, The method further comprises: If it is determined that the door lock state changes, send the door lock state information to the cloud platform.
10. The method of claim 1, wherein, The method further comprises any one of the following: After the door lock is opened, if the distance between the second terminal and the second terminal exceeds a first value, the authorization of the opening permission of the second terminal is stopped; Detecting that the user has left the house after a specified duration, and stopping the authorization of the unlocking permission of the second terminal.
11. A door lock authorization method characterized by, The method is executed by a cloud platform, and the method comprises: Receiving help information sent by a door lock client; the help information comprises a user identifier in need of emergency rescue; In a case where a holder of a first terminal is unable to perform rescue, generating a first authorization instruction; the first authorization instruction comprises an identifier of a second terminal, and the first terminal is a terminal bound to the user identifier; Sending the first authorization instruction to the door lock client, so as to instruct the door lock client to authorize an unlocking permission of the second terminal.
12. The method of claim 11, wherein, The method further comprises: Based on receiving door lock state information sent by the door lock client, sending a first notification message to the first terminal, so as to instruct the door lock state change.
13. The method of claim 11, wherein, The determination that the holder of the first terminal is unable to perform rescue comprises: Sending the help information to the first terminal; Based on a second authorization instruction sent by the first terminal, determining that the holder of the first terminal is unable to perform rescue; the second authorization instruction comprises the user identifier and / or the identifier of the second terminal.
14. The method of claim 11, wherein, The determination that the holder of the first terminal is unable to perform rescue comprises: Sending the help information to the first terminal; In a case where no confirmation message sent by the first terminal is received within a preset duration, determining that the holder of the first terminal is unable to perform rescue; the confirmation message is used to confirm that the first terminal receives the help information.
15. The method of claim 11, wherein, The method further comprises: According to the help information, generating assignment information; the assignment information is used to instruct a designated person to perform emergency rescue; Sending the assignment information to the second terminal.
16. A door lock authorization method characterized by, The method is executed by a second terminal, and the method comprises: Receiving authorization information sent by a door lock client or a cloud platform, so as to determine an authorization state of opening a door lock.
17. The method of claim 16, wherein, The method further comprises: Receiving a first image sent by the door lock client; The first image is generated based on a second point cloud obtained by point cloud splitting of the door lock client on an environment in which a user is located.
18. The method of claim 16, wherein, The method further comprises: Sending collected second biological information to the door lock client; the second biological information is biological information of a holder of the second terminal.
19. The method of claim 16, wherein, The method further comprises: Receiving assignment information sent by a cloud platform; the assignment information is used to instruct a designated person to perform emergency rescue; In a case where fourth biological information and third biological information of the designated person match, sending an unlocking instruction to the door lock client; the fourth biological information is biological information collected by the second terminal, and the unlocking instruction is used to instruct the door lock client to open the door lock.
20. A door lock authorization method characterized by, The method is executed by a first terminal, and the method comprises: Receiving help information sent by a cloud platform; In a case where a holder is unable to perform rescue, sending a second authorization instruction to the cloud platform; the second authorization instruction comprises a user identifier in need of emergency rescue and / or an identifier of a second terminal.
21. A door lock authorization method characterized by, The method comprises: In a case where it is determined that the user needs emergency assistance, sending help information to a cloud platform; wherein the help information includes a user identifier; authorizing an unlocking permission of a second terminal indicated by the cloud platform.
22. An electronic device, comprising: The electronic device comprises: a collection module configured to collect point cloud data of an environment in which a user is located; a processing module configured to determine, based on the point cloud data, whether the user needs emergency assistance; a notification module configured to, in a case where it is determined that the user needs emergency assistance, send a second notification message to a door lock client; wherein the second notification message is used to indicate that the user needs emergency assistance.
23. The electronic device of claim 22, wherein, The electronic device is deployed in at least one of a bathroom, a balcony, a bedroom, and a living room.
24. The electronic device of claim 22, wherein, The electronic device further comprises: a millimeter wave radar SOC chip, wherein the SOC chip is configured to collect the point cloud data.
25. A smart health and wellness system, characterized in that, The electronic device comprises a plurality of electronic devices, wherein each of the electronic devices is the electronic device of any one of claims 22-24. The plurality of electronic devices are deployed in a house, and the plurality of electronic devices are connected based on a deep learning Matter protocol and share computing power.
26. A door lock client, comprising: The door lock client comprises: an information sending module configured to, in a case where it is determined that the user needs emergency assistance, send help information to a cloud platform; wherein the help information includes a user identifier; an instruction receiving module configured to receive a first authorization instruction sent by the cloud platform; wherein the first authorization instruction includes an identifier of a second terminal; a terminal authorization module configured to, based on the first authorization instruction, authorize an unlocking permission of the second terminal.
27. A cloud platform, characterized by The cloud platform comprises: an information receiving module configured to receive help information sent by a door lock client; wherein the help information includes a user identifier needing emergency assistance; an instruction generating module configured to, in a case where a holder of a first terminal is unable to provide assistance, generate a first authorization instruction; wherein the first authorization instruction includes an identifier of a second terminal, and the first terminal is a terminal bound to the user identifier; an instruction sending module configured to send the first authorization instruction to the door lock client, wherein the first authorization instruction is used to instruct the door lock client to authorize an unlocking permission of the second terminal.
28. A second terminal, comprising: The second terminal comprises: an authorization receiving module configured to receive authorization information sent by a door lock client or a cloud platform, wherein the authorization information is used to determine an authorization state of opening a door lock.
29. A first terminal, comprising: The first terminal comprises: a help receiving module configured to receive help information sent by a cloud platform; an assistance response module configured to, in a case where a holder is unable to provide assistance, send a second authorization instruction to the cloud platform; wherein the second authorization instruction includes a user identifier needing emergency assistance and / or an identifier of a second terminal.
30. A computer readable storage medium having stored thereon computer instructions, wherein, The instructions, when executed by a processor, implement the method of any one of claims 1-21.
31. A computer program product having stored thereon computer program / instructions, characterized in that, The computer program / instructions, when executed by a processor, implement the method of any one of claims 1-21.