Door lock voice interaction method and device and related product

Abstract

The invention provides a door lock voice interaction method and device and a related product, and relates to the technical field of intelligent interaction. When the method is executed, a PIR passive infrared sensor is triggered, whether a voice instruction of a user is received or not is judged, the voice instruction is a preset voice instruction, and the voice instruction of the user is used for indicating that a first use scene is met, that is, when the first use scene is met, an interaction strategy corresponding to the first use scene is executed, and the interaction strategy corresponding to the first use scene is executed. Obtaining a door lock voice interaction result, and finally outputting the door lock voice interaction result. Thus, in response to the fact that the PIR passive infrared sensor is triggered and the use scene is met, the interaction strategy corresponding to the met use scene is executed, so that a user interacts with the door lock, and the voice interaction experience of the user and the door lock can be improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent interaction technology, and in particular to a door lock voice interaction method, device and related products. Background Art

[0002] At present, with the popularity of smart homes, smart door locks have become an important part of home security. However, traditional smart door locks have certain limitations in user interaction, resulting in poor user interaction experience with door locks.

[0003] In summary, how to improve the voice interaction experience between users and door locks is a problem that technical personnel in this field urgently need to solve. Summary of the invention

[0004] In view of this, the present application provides a door lock voice interaction method, device and related products, aiming to improve the voice interaction experience between the user and the door lock.

[0005] In a first aspect, the present application provides a door lock voice interaction method, comprising:

[0006] In response to the PIR passive infrared sensor being triggered, determining whether a user's voice command is received; the voice command is a preset voice command; the user's voice command is used to indicate that the first usage scenario is satisfied;

[0007] If yes, execute the interaction strategy corresponding to the first usage scenario to obtain the door lock voice interaction result;

[0008] Output the door lock voice interaction result.

[0009] Optionally, executing the interaction strategy corresponding to the first usage scenario to obtain a first door lock voice interaction result includes:

[0010] Collecting audio from the user to obtain audio data;

[0011] Performing speech recognition on the audio data to obtain speech recognition text;

[0012] Matching the speech recognition text with a pre-stored keyword library to obtain target keywords;

[0013] According to the association relationship between the preset keyword and the door lock voice interaction result, the first door lock voice interaction result corresponding to the target keyword is determined.

[0014] Optionally, after collecting audio data from the user, the method further includes:

[0015] Uploading the audio data to a server so that the server generates reply audio data according to the audio data;

[0016] The reply audio data generated by the server is determined as the second door lock voice interaction result.

[0017] Optionally, after collecting audio data from the user, the method further includes:

[0018] Generate response audio data to the audio data using artificial intelligence AI;

[0019] The reply audio data generated by the AI ​​is determined as the third reply audio data.

[0020] Optionally, before determining whether a voice instruction of the user is received, the method further includes:

[0021] Identify the user; the identification method is one or more of face recognition, Bluetooth recognition and voiceprint recognition;

[0022] If the user passes the identity recognition, the step of determining whether a voice command of the user is received is performed.

[0023] In a second aspect, the present application provides a door lock voice interaction device, comprising:

[0024] A judgment module, used for judging whether a user's voice command is received in response to the PIR passive infrared sensor being triggered; the voice command is a preset voice command; the user's voice command is used to indicate that the first usage scenario is satisfied;

[0025] a strategy execution module, configured to execute the interaction strategy corresponding to the first usage scenario to obtain a door lock voice interaction result;

[0026] An output module is used to output the door lock voice interaction result.

[0027] Optionally, the policy execution module includes:

[0028] A collection unit, used to collect audio from the user to obtain audio data;

[0029] A speech recognition unit, used to perform speech recognition on the audio data to obtain speech recognition text;

[0030] A matching unit, used to match the speech recognition text with a pre-stored keyword library to obtain a target keyword;

[0031] The first determination unit is used to determine the first door lock voice interaction result corresponding to the target keyword according to the association relationship between the preset keyword and the door lock voice interaction result.

[0032] Optionally, the device further comprises:

[0033] A first generating unit, configured to upload the audio data to a server, so that the server generates reply audio data according to the audio data;

[0034] The second determination unit is used to determine the reply audio data generated by the server as the second door lock voice interaction result.

[0035] Optionally, the device further comprises:

[0036] A second generating unit, configured to generate reply audio data to the audio data using artificial intelligence AI;

[0037] The third determination unit is used to determine the reply audio data generated by the AI ​​as the third reply audio data.

[0038] Optionally, the device further comprises:

[0039] An identity recognition module, used to identify the user; the identity recognition method is one or more of face recognition, Bluetooth recognition and voiceprint recognition;

[0040] An execution module is used to execute the determination of whether a voice instruction of the user is received if the user passes the identity recognition.

[0041] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device executes the door lock voice interaction method described in any one of the implementation methods in the first aspect of the embodiment of the present application.

[0042] In a fourth aspect, an embodiment of the present application provides a door lock, comprising: a PIR passive infrared sensor and a door lock voice interaction method device introduced in any one of the implementation modes in the second aspect.

[0043] In a fifth aspect, an embodiment of the present application provides a door, comprising the door lock introduced in the fourth aspect.

[0044] The present application provides a door lock voice interaction method. When executing the method, in response to the PIR passive infrared sensor being triggered, it is determined whether a user's voice command is received, wherein the voice command is a preset voice command, and the user's voice command is used to indicate that a first usage scenario is satisfied, that is, when the first usage scenario is satisfied, the interaction strategy corresponding to the first usage scenario is executed, and the door lock voice interaction result is obtained, and finally the door lock voice interaction result is output. In this way, in response to the PIR passive infrared sensor being triggered and the usage scenario being satisfied, the interaction strategy corresponding to the satisfied usage scenario is executed, so that the user interacts with the door lock, which can improve the user's voice interaction experience with the door lock. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in this embodiment or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 A flow chart of a door lock voice interaction method provided in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of the structure of a door lock voice interaction device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. The present application provides a door lock voice interaction method, device and related equipment for use in the field of intelligent interaction technology. The above is only an example and does not limit the application field of the method and device name provided in the present application.

[0049] At present, with the popularity of smart homes, smart door locks have become an important part of home security. However, traditional smart door locks have certain limitations in user interaction, resulting in poor user interaction experience with door locks.

[0050] After research, the inventor proposed the technical solution of the present application. In response to the PIR passive infrared sensor being triggered, it is determined whether a user's voice command is received, wherein the voice command is a preset voice command, and the user's voice command is used to indicate that the first usage scenario is satisfied, that is, when the first usage scenario is satisfied, the interaction strategy corresponding to the first usage scenario is executed, the door lock voice interaction result is obtained, and finally the door lock voice interaction result is output. In this way, in response to the PIR passive infrared sensor being triggered and the usage scenario being satisfied, the interaction strategy corresponding to the satisfied usage scenario is executed, so that the user interacts with the door lock, which can improve the user's voice interaction experience with the door lock.

[0051] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application. It should be noted that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0052] See also Figure 1 , Figure 1 A flow chart of a door lock voice interaction method provided in an embodiment of the present application includes:

[0053] S101: In response to the PIR passive infrared sensor being triggered, determining whether a user's voice command is received.

[0054] Passive infrared sensor (PIR) is an electronic device used to detect infrared radiation. The triggering conditions of the door lock include but are not limited to the triggering of the PIR passive infrared sensor, the door lock state change event, someone ringing the doorbell, recognizing a face, a timed event, and detecting a voice event. Among them, the triggering of the PIR passive infrared sensor means that a person is detected by the PIR passive infrared sensor within the preset range of the door lock.

[0055] When the triggering condition of the door lock is met, it is determined whether there is a usage scenario that is met. The usage scenario and the conditions for meeting the usage scenario are set in advance, and the conditions for meeting different usage scenarios are different. The following is a specific example to illustrate this:

[0056] In some embodiments, it can be determined whether a user's voice command is received, which is a preset voice command. The user's voice command is used to indicate that the first usage scenario is satisfied, that is, the satisfaction condition of the first usage scenario is receiving the user's voice command. If the voice command is "Hello door lock", then when the user says "Hello door lock", the first usage scenario is satisfied.

[0057] In some embodiments, it is possible to determine whether the user is a deliveryman or a courier. The specific method for determining whether the user is a deliveryman or a courier is not specifically limited. For example, the image captured by the door lock camera can be used to determine whether the user is a deliveryman or a courier by using the clothing of the object in the image. The user's identity as a deliveryman or a courier is used to indicate that the second usage scenario is satisfied, that is, when the user's identity is a deliveryman or a courier, the second usage scenario is satisfied.

[0058] In some embodiments, a condition for satisfying the usage scenario is that the door lock is pried open. When the door lock is pried open, the third usage scenario is satisfied.

[0059] In some embodiments, the condition for satisfying the usage scenario is that a doorbell is pressed. When the doorbell is pressed, the fourth usage scenario is satisfied.

[0060] In some embodiments, the condition for satisfying the usage scenario is that the PIR passive infrared sensor is continuously triggered for more than a preset time period, but no voice data of the target is received and the doorbell is not triggered, then the fifth usage scenario is satisfied.

[0061] If there is a usage scenario that is satisfied, step S102 is executed; if there is no usage scenario that is satisfied, step S104 is executed.

[0062] S102: Execute the interaction strategy corresponding to the first usage scenario to obtain a door lock voice interaction result.

[0063] Before executing step S102, the interaction strategies corresponding to the usage scenarios are preset, and different usage scenarios correspond to different interaction strategies.

[0064] In some embodiments, if the satisfied usage scenario is the first usage scenario, the user's audio is collected to obtain audio data, then speech recognition is performed on the collected audio data to obtain speech recognition text, the speech recognition text is matched with the pre-stored keyword library to obtain the target keyword, and the door lock speech interaction result corresponding to the target keyword is determined according to the association between the preset keyword and the door lock speech interaction result. For example, the pre-set keyword library includes the keyword "open the door", and the door lock speech interaction result associated with the keyword "open the door" is "Master, welcome home", then when the user says "please open the door", the collected audio data is "please open the door", and the speech recognition text obtained by performing speech recognition on the audio data is "please open the door", then the speech recognition text is matched with the keyword library to obtain the target keyword "open the door", and the door lock speech interaction result associated with the keyword "open the door" is "Master, welcome home".

[0065] After collecting audio from the user, the collected audio data can also be uploaded to the server, and feedback on the audio data can be generated through the server, that is, reply audio data, and the reply audio data can be used as the door lock voice interaction result. For example, when the user says "please open the door", the collected audio data is "please open the door", and the audio data is uploaded to the server. The server can reply audio data "please wait, the door is being opened" based on the audio data, and use the reply audio data as the door lock voice interaction result. In addition, after collecting audio from the user, artificial intelligence AI can also be used to generate feedback on the audio data.

[0066] After collecting audio from the user, it is also possible to determine whether the collected audio data is valid audio data, for example, whether it is a human voice or a recognizable voice, wherein the method of determining whether it is a recognizable voice is: if the collected audio data contains characters of a natural language, it is determined to be valid audio data, and if it cannot be recognized and parsed as a natural language, it is determined to be invalid audio data. If the audio data is invalid audio data, it is necessary to re-collect the audio data.

[0067] Before executing the above method, in order to improve the security of door lock voice interaction, the user's identity can be identified first. The identification methods include but are not limited to face recognition, vein recognition, Bluetooth recognition, and voiceprint recognition. In some embodiments, multiple identification methods can be combined for comprehensive identity recognition to improve the accuracy of identity recognition. If the recognition is successful, the step of determining whether the user's voice command is received can be executed.

[0068] In some embodiments, if the usage scenario being satisfied is the second usage scenario, a custom voice for the second usage scenario is obtained, such as "Please leave the takeaway at the door, thank you" or "Please leave the express at the door, thank you", and the custom voice is used as the door lock voice interaction result.

[0069] In some embodiments, the usage scenario that is satisfied is the third usage scenario, and alarm audio data for broadcast and alarm information for sending to the mobile device of the user bound to the door lock are generated, and the alarm audio data for broadcast and the alarm information for sending to the mobile device of the user bound to the door lock are used as the door lock voice interaction result.

[0070] In some embodiments, the usage scenario that is satisfied is the fourth usage scenario, and a custom voice for the fourth usage scenario, such as "please wait", is obtained, and a prompt message is generated for sending to the mobile device of the user bound to the door lock, and the custom voice for the fourth usage scenario and the prompt message for sending to the mobile device of the user bound to the door lock are used as the door lock voice interaction results.

[0071] In some implementations, the usage scenario being satisfied is the fifth usage scenario, and a custom voice of the fifth usage scenario is obtained, for example, "Excuse me, what can I do for you?", the target voice data is received, and the door lock voice interaction result for the voice data is generated by using AI. The received voice data is sent to the mobile device of the user bound to the door lock.

[0072] S103: Output the door lock voice interaction result.

[0073] Based on the aforementioned method, when the door lock voice interaction result is a door lock voice interaction result associated with a keyword, the door lock is controlled to output the door lock voice interaction result; when the door lock voice interaction result is a reply audio data, the reply audio data is played; when the door lock voice interaction result is a custom voice, the custom voice is played; when the door lock voice interaction result is alarm audio data for broadcast and alarm information for sending to a mobile device of a user bound to the door lock as the door lock voice interaction result, the alarm audio data is played, and the alarm information is sent to the mobile device of the user bound to the door lock; when the door lock voice interaction result is a custom voice and a prompt information for sending to a mobile device of a user bound to the door lock, the custom voice is played, and the prompt information is sent to the mobile device of the user bound to the door lock; when the door lock voice interaction result is an AI-generated reply to the collected target voice data, the reply is output.

[0074] S104: End the door lock voice interaction.

[0075] Since there is no usage scenario that is satisfied, the door lock voice interaction is ended, and the triggering condition of the door lock is waited for to be satisfied again.

[0076] In the embodiment of the present application, in response to the PIR passive infrared sensor being triggered, it is determined whether a user's voice command is received, wherein the voice command is a preset voice command, and the user's voice command is used to indicate that the first usage scenario is satisfied, that is, when the first usage scenario is satisfied, the interaction strategy corresponding to the first usage scenario is executed, the door lock voice interaction result is obtained, and finally the door lock voice interaction result is output. In this way, in response to the PIR passive infrared sensor being triggered and the usage scenario being satisfied, the interaction strategy corresponding to the satisfied usage scenario is executed, so that the user interacts with the door lock, which can improve the user's interaction experience with the door lock.

[0077] The above are some specific implementations of the door lock voice interaction method provided by the embodiment of the present application. Based on this, the present application also provides a corresponding device. The device provided by the embodiment of the present application will be introduced from the perspective of functional modularization.

[0078] See also Figure 2 , Figure 2 The present invention provides a schematic diagram of the structure of a door lock voice interaction device according to an embodiment of the present invention. The door lock voice interaction device 200 includes:

[0079] The judgment module 210 is used to judge whether a user's voice command is received in response to the PIR passive infrared sensor being triggered; the voice command is a preset voice command; the user's voice command is used to indicate that the first usage scenario is satisfied;

[0080] A strategy execution module 220 is configured to execute the interaction strategy corresponding to the first usage scenario to obtain a door lock voice interaction result;

[0081] The output module 230 is used to output the door lock voice interaction result.

[0082] Optionally, the policy execution module 220 includes:

[0083] A collection unit, used to collect audio from the user to obtain audio data;

[0084] A speech recognition unit, used to perform speech recognition on the audio data to obtain speech recognition text;

[0085] A matching unit, used to match the speech recognition text with a pre-stored keyword library to obtain a target keyword;

[0086] The first determination unit is used to determine the first door lock voice interaction result corresponding to the target keyword according to the association relationship between the preset keyword and the door lock voice interaction result.

[0087] Optionally, the device 200 further includes:

[0088] A first generating unit, configured to upload the audio data to a server, so that the server generates reply audio data according to the audio data;

[0089] The second determination unit is used to determine the reply audio data generated by the server as the second door lock voice interaction result.

[0090] Optionally, the device 200 further includes:

[0091] A second generating unit, configured to generate reply audio data to the audio data using artificial intelligence AI;

[0092] The third determination unit is used to determine the reply audio data generated by the AI ​​as the third reply audio data.

[0093] Optionally, the device 200 further includes:

[0094] An identity recognition module, used to identify the user; the identity recognition method is one or more of face recognition, Bluetooth recognition and voiceprint recognition;

[0095] An execution module is used to execute the determination of whether a voice instruction of the user is received if the user passes the identity recognition.

[0096] Through the description of the above implementation methods, it can be known that those skilled in the art can clearly understand that all or part of the steps in the above-mentioned embodiment method can be implemented by means of software plus a general hardware platform. Based on such an understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a read-only memory (ROM) / RAM, a magnetic disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network communication device such as a router) to execute the methods described in each embodiment of the present application or some parts of the embodiments.

[0097] In addition, an embodiment of the present application further provides a door lock, which includes: a PIR passive infrared sensor and the aforementioned door lock voice interaction device 200.

[0098] In addition, the embodiment of the present application also provides a door, which includes: the door lock and door body introduced in the above embodiment. It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also include elements inherent to such process, method, article or equipment. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements.

[0099] Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0100] The above description is merely an exemplary embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A door lock voice interaction method, characterized in that: include: In response to the PIR passive infrared sensor being triggered, determining whether a user's voice command is received; The voice command is a preset voice command; The user's voice command is used to indicate that the first usage scenario is satisfied; If yes, execute the interaction strategy corresponding to the first usage scenario to obtain the door lock voice interaction result; Output the door lock voice interaction result.

2. The method according to claim 1, characterized in that: The executing the interaction strategy corresponding to the first usage scenario to obtain a first door lock voice interaction result includes: Collecting audio from the user to obtain audio data; Performing speech recognition on the audio data to obtain speech recognition text; Matching the speech recognition text with a pre-stored keyword library to obtain target keywords; According to the association relationship between the preset keyword and the door lock voice interaction result, the first door lock voice interaction result corresponding to the target keyword is determined.

3. The method according to claim 2, characterized in that After collecting audio data from the user, the method further includes: Uploading the audio data to a server so that the server generates reply audio data according to the audio data; The reply audio data generated by the server is determined as the second door lock voice interaction result.

4. The method according to claim 2, characterized in that: After collecting audio data from the user, the method further includes: Generate response audio data to the audio data using artificial intelligence AI; The reply audio data generated by the AI ​​is determined as the third reply audio data.

5. The method according to claim 1, characterized in that Before determining whether a voice instruction of the user is received, the method further includes: Identify the user; the identification method is one or more of face recognition, Bluetooth recognition and voiceprint recognition; If the user passes the identity recognition, the step of determining whether a voice command of the user is received is performed.

6. A door lock voice interaction device, characterized in that: include: A determination module, for determining whether a user's voice command is received in response to the PIR passive infrared sensor being triggered; The voice command is a preset voice command; The user's voice command is used to indicate that the first usage scenario is satisfied; a strategy execution module, configured to execute the interaction strategy corresponding to the first usage scenario to obtain a door lock voice interaction result; An output module is used to output the door lock voice interaction result.

7. The device according to claim 6, characterized in that The policy execution module includes: A collection unit, used to collect audio from the user to obtain audio data; A speech recognition unit, used to perform speech recognition on the audio data to obtain speech recognition text; A matching unit, used to match the speech recognition text with a pre-stored keyword library to obtain a target keyword; The first determining unit is used to determine the first door lock interaction result corresponding to the target keyword according to the association relationship between the preset keyword and the door lock interaction result.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on the terminal device, the terminal device executes the door lock voice interaction method as described in any one of claims 1-5.

9. A door lock, characterized in that: The door lock comprises: a PIR passive infrared sensor and the door lock voice interaction device according to claim 6 or 7.

10. A door, characterized in that: The door comprises the door lock according to claim 9 and a door body.

Images