Equipment control method, equipment information processing method, equipment control device, equipment information processing device and related equipment
By collecting and verifying user biological information in the smart home system and determining the target authentication scenario, the problem of unrestricted identity and single security identification methods in traditional smart home control devices is solved, and the security and reliability of the system are improved.
Patent Information
- Application Number
- CN202411461923.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-18
- Publication Date
- 2025-03-04
AI Technical Summary
In the existing smart home control solutions, traditional remote controls do not restrict the user's identity, or the security identification method is relatively single, resulting in lower security of smart home systems.
In response to the selection operation of the authentication method for the control device, the target authentication scenario is determined, the biological information of the target object in the target authentication scenario is collected, and the target object is authenticated based on the biological information. If the identity verification is passed, the device control information is obtained and sent to the target device associated with the control device, so that it can perform corresponding actions.
It improves the security of smart home systems, avoids the problems of unrestricted user identity and single security identification methods in traditional control devices, and ensures the safety and reliability of the devices.
Smart Images

Figure CN119556579A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart home, and in particular to a device control method, a device information processing method, a device and related equipment. Background Art
[0002] With the rapid development of the Internet of Things technology, the concept of smart home is increasingly appearing in people's lives. Smart home connects various devices in the home (such as audio and video equipment, lighting systems, air conditioning control, network appliances, etc.) through the Internet of Things technology, providing a variety of functions and means such as home appliance control, lighting control, telephone remote control, indoor and outdoor remote control, and programmable timing control. Compared with ordinary homes, smart homes not only have traditional living functions, but also have architecture, network communication, information appliances, equipment automation, provide a full range of information interaction functions, and even save money on various energy costs.
[0003] In existing smart home control solutions, smart homes are generally controlled through control devices. However, traditional control devices do not restrict the identity of the user, or the security identification method is relatively simple. For example, a single signal encoding method, such as a fixed code, is used, which is easy to be copied and cracked, posing a security risk and resulting in low security of the smart home system. Summary of the invention
[0004] Based on this, it is necessary to provide a device control method, apparatus, computer equipment and storage medium to address the above technical problems, which can solve the problem that traditional remote controls do not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system.
[0005] The present application provides a device control method, the method comprising:
[0006] In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario, the target authentication scenario being used to represent the control authority of the target object over the control device;
[0007] Collecting biometric information of the target object in the target authentication scenario;
[0008] authenticating the target object based on the biometric information;
[0009] If the identity authentication of the target object is passed, device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0010] The present application provides a device information processing method, the method comprising:
[0011] Displaying a display interface including a target application, wherein the target application is used to configure a control device associated with the target application;
[0012] In response to the configuration operation of the target application on the display interface, the authentication preference data of the control device is configured, and the identification identity information is entered through the control device, so that in a target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, wherein the authentication preference data includes an authentication method and a device operation time after authentication, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method.
[0013] Accordingly, the present application provides a device control apparatus, the apparatus comprising:
[0014] A determination module, configured to determine a target authentication scenario in response to a selection operation of an authentication mode for the control device;
[0015] A collection module, used to collect biometric information of a target object in the target authentication scenario;
[0016] A verification module, used for performing identity verification on the target object based on the biometric information;
[0017] The sending module is used to obtain device control information if the identity authentication of the target object is passed, and send the device control information to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0018] Optionally, in some embodiments of the present application, the biometric information includes voice information, and the verification module includes:
[0019] A first verification submodule, configured to authenticate the identity of the target object based on the voice information;
[0020] The sending module comprises:
[0021] The first determining submodule is configured to use the voice information as the device control information.
[0022] Optionally, in some embodiments of the present application, the verification module includes:
[0023] A preprocessing submodule, used for preprocessing the voice information to obtain the voice information to be processed;
[0024] An extraction module, used for performing feature extraction on the speech information to be processed to obtain feature parameter information, wherein the feature parameter information is used to characterize the sound features of the target object;
[0025] The second verification submodule is used to authenticate the target object based on the characteristic parameter information.
[0026] Optionally, in some embodiments of the present application, the biometric information includes fingerprint information, and the verification module includes:
[0027] A third verification submodule, configured to authenticate the identity of the target object based on the fingerprint information;
[0028] The sending module comprises:
[0029] The second determining submodule is used to obtain the voice information of the target object if the identity authentication of the target object is passed, and use the voice information as the device control information.
[0030] Optionally, in some embodiments of the present application, the sending module includes:
[0031] A first acquisition submodule is used to acquire the voice control duration of the control device if the identity authentication of the target object is passed, and acquire the voice information of the target object within the voice control duration;
[0032] The third determining submodule is configured to use the voice information as the device control information.
[0033] Optionally, in some embodiments of the present application, the biometric information includes voice information and fingerprint information, and the verification module includes:
[0034] The fourth verification submodule is used to authenticate the identity of the target object based on the voice information and the fingerprint information.
[0035] Optionally, in some embodiments of the present application, the fourth verification submodule includes:
[0036] A first verification unit is configured to verify the fingerprint information if the voice information verification passes, so as to authenticate the identity of the target object; and / or,
[0037] The second verification unit is used to verify the voice information if the fingerprint information is verified, so as to authenticate the identity of the target object.
[0038] Optionally, in some embodiments of the present application, the target authentication scenario includes a first target object and a second target object, and the acquisition module includes:
[0039] A collection submodule, used for collecting first biological information of the first target object and second biological information of the second target object;
[0040] The verification module comprises:
[0041] a fifth verification submodule, configured to authenticate the first target object based on the first biometric information;
[0042] a sixth verification submodule, configured to authenticate the identity of the second target object based on the second biometric information; the first biometric information and the second biometric information include voiceprints and / or fingerprints;
[0043] The sending module comprises:
[0044] A first verification submodule, used to perform identity verification on the first target object and the second target object according to a preset verification priority;
[0045] a comparison submodule, configured to compare the control priorities of the first target object and the second target object if the identity authentications of the first target object and the second target object are passed;
[0046] The fourth determination submodule is used to obtain voice information of a target object with a higher control priority, and use the voice information as device control information.
[0047] Optionally, in some embodiments of the present application, the sending module includes:
[0048] A fifth determination submodule, configured to determine the security level of the target authentication scenario if the identity authentication of the target object passes;
[0049] a sixth determination submodule, configured to determine an operation function of the control device based on the security level;
[0050] A generating submodule is used to generate the device control information based on the operating function.
[0051] Optionally, in some embodiments of the present application, the verification module includes:
[0052] A second acquisition submodule is used to acquire the environment data of the target object;
[0053] A seventh verification submodule is used to authenticate the identity of the target object based on the biological information and the environmental data.
[0054] Optionally, in some embodiments of the present application, the verification module includes:
[0055] an eighth verification submodule, configured to authenticate the identity of the target object based on a biometric recognition model corresponding to the biometric information;
[0056] The device further includes an updating module, which is specifically configured to:
[0057] Acquire historical operation data and user feedback data of the target device, wherein the historical operation data is generated based on historical execution results of the target device;
[0058] The biometric recognition model is updated based on the historical operation data and the user feedback data.
[0059] Optionally, in some embodiments of the present application, the target authentication scenario includes a single-user authentication scenario and a multi-user authentication scenario.
[0060] Optionally, in some embodiments of the present application, the device further includes a first control module, wherein the first control module is specifically configured to:
[0061] In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario as the single-user authentication scenario;
[0062] Collecting voiceprint information and fingerprint information of the target object in the single-user authentication scenario;
[0063] authenticating the target object based on the voiceprint information and the fingerprint information;
[0064] If the identity authentication of the target object is passed, device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0065] Optionally, in some embodiments of the present application, the device further includes a second control module, and the second control module is specifically configured to:
[0066] In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario as the multi-user authentication scenario;
[0067] Collecting voiceprint information of a first target object and fingerprint information of a second target object in the multi-user authentication scenario;
[0068] When the fingerprint information of the second target object is verified, device control information is generated based on the voiceprint information of the first target object, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0069] Accordingly, the present application provides a device control apparatus, the apparatus comprising:
[0070] A determination module, configured to determine a target authentication scenario in response to a selection operation of an authentication mode for the control device;
[0071] A collection module, used to collect biometric information of a target object in the target authentication scenario;
[0072] A verification module, used for performing identity verification on the target object based on the biometric information;
[0073] The sending module is used to obtain device control information if the identity authentication of the target object is passed, and send the device control information to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0074] Accordingly, the present application provides a device information processing apparatus, the apparatus comprising:
[0075] A display module, used to display a display interface including a target application, wherein the target application is used to configure a control device associated therewith;
[0076] A configuration module is used to configure the authentication preference data of the control device in response to the configuration operation of the target application on the display interface, and enter the identification identity information through the control device, so that in a target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, wherein the authentication preference data includes an authentication method and a device operation time after authentication, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method.
[0077] Accordingly, the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the device control method and / or device information processing method of each embodiment of the present application when executing the computer program.
[0078] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the device control method and / or the device information processing method in each embodiment of the present application.
[0079] A computer program product includes a computer program, wherein when the computer program is executed by a processor, the steps of the device control method and / or the device information processing method in each embodiment of the present application are implemented.
[0080] The present application provides a device control method, a device information processing method, an apparatus and related equipment, which responds to the selection operation of the authentication method for the control device, determines the target authentication scenario, and the target authentication scenario is used to indicate the control authority of the target object over the control device; collects the biometric information of the target object in the target authentication scenario; authenticates the target object based on the biometric information; if the identity authentication of the target object is passed, obtains the device control information, and sends the device control information to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information. In the device control scheme provided by the present application, by verifying the biometric information of the target object in the target authentication scenario, when the biometric information verification is passed, indicating that the target object has the control authority, the device control information is obtained and sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information, thereby avoiding the situation where the traditional control device does not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system, thereby improving security. BRIEF DESCRIPTION OF THE DRAWINGS
[0081] Figure 1 An application environment diagram of a device control method and / or a device information processing method in an embodiment;
[0082] Figure 2 is a schematic diagram of the structure of a control device in one embodiment;
[0083] Figure 3 A schematic diagram of a flow chart of a device control method in one embodiment;
[0084] Figure 4 is a flowchart of a method for processing device information in one embodiment;
[0085] Figure 5 is a flow chart of a device control method in another embodiment;
[0086] Figure 6 is a structural block diagram of a device control device in an embodiment;
[0087] Figure 7 is a structural block diagram of a device information processing apparatus in an embodiment;
[0088] Figure 8 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0089] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0090] The device control method provided in this application can be applied to Figure 1 In the application environment shown. Figure 1 A device control system is provided, which includes a smart device 10, a gateway 20 communicatively connected to the smart device 10, a router 30, a server 40, and a terminal 50.
[0091] The smart device 10 accesses the gateway 20 in the device control system, and communicates with the gateway 20 through its own configured communication module, and is then controlled by the gateway 20. In one embodiment, the smart device 10 accesses the gateway 20 through a local area network path or a wide area network path, and is deployed in the gateway 20. The local area network may include ZIGBEE or Bluetooth, and the wide area network may include 2G / 3G / 4G / 5G / WIFI, etc.
[0092] The gateway 20 establishes a network connection with the terminal 50 or the server 40 through the router 30. In one embodiment, the gateway 20 and the terminal 50 may establish a network connection through a local area network or a wide area network path. The network connection interacts with the terminal 50, so that the user can control the smart device 10 connected to the gateway 20 to perform corresponding actions through the terminal 50.
[0093] Among them, the smart device 10 can be a smart remote control, a smart camera, a smart curtain motor, a smart air conditioner, a smart door lock, a smart light, a smart TV, a smart control panel, a smart printer, a smart sweeper, a smart robot, and can also be an electronic device such as a human body sensor, a door and window sensor, a temperature and humidity sensor, a water immersion sensor, a natural gas alarm, a smoke alarm, a wall switch, a wall socket, a wireless switch, a wireless wall switch, a magic cube controller, etc. equipped with a communication module. The terminal 50 can be a smart phone, a laptop, a personal computer, a tablet computer, a smart control panel or other electronic device that can implement network connection, which is not limited here. The server 40 can be implemented by an independent server or a server cluster composed of multiple servers.
[0094] For further information, see Figure 2 , Figure 2 A schematic diagram of the structure of a control device provided in the present application, wherein the control device includes a wireless transceiver module for communicating with an associated electronic device; a display interface of the electronic device includes a target application, the target application is used to configure authentication preference data of the control device, the electronic device enters identification information through the control device, the authentication preference data includes an authentication method and a device operation time after the authentication is completed, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method;
[0095] Adaptive learning algorithm module, used to update the biometric recognition model;
[0096] Voiceprint recognition module, used to collect voiceprint information of the target object;
[0097] Fingerprint recognition module, used to collect fingerprint information of the target object;
[0098] An instruction code storage module, used for storing identification information;
[0099] The central microprocessor is electrically connected to the wireless transceiver module, the adaptive algorithm learning module, the voiceprint recognition module, the fingerprint recognition module and the instruction code storage module, and is used to respond to the selection operation of the authentication method, determine the target authentication scenario, and the target authentication scenario is used to indicate the control authority of the target object over the control device; collect the biometric information of the target object in the target authentication scenario; authenticate the target object based on the biometric information; if the target object identity authentication is passed, obtain the device control information, and send the device control information to the corresponding target device, so that the target device performs the corresponding action based on the device control information.
[0100] The voiceprint recognition module is used to collect and recognize the user's voice data (i.e., voice information). The voiceprint recognition module includes a microphone and a voiceprint processor. The microphone is used to collect the user's voice information, and the voiceprint processor is used to identify, process, and match the voiceprint data. For example, when a user uses the remote control for the first time, he needs to enter the voiceprint. The system stores the user's voiceprint information in the instruction code storage module and associates it with the user's operation authority.
[0101] The fingerprint recognition module is used to collect and identify the user's fingerprint data (i.e. fingerprint information). The module includes a fingerprint sensor and a fingerprint processor. The fingerprint sensor is used to collect the user's fingerprint information, such as fingerprint images, and the fingerprint processor is used to process and match fingerprint data. For example, the user needs to enter the fingerprint before using the remote control. The system stores the user's fingerprint information in the instruction code storage module and associates it with the user's operation authority.
[0102] The adaptive learning algorithm module can be set in the central processing unit to optimize the accuracy of instruction execution and biometric recognition based on the user's historical operation data and user feedback data. This module analyzes the user's historical operation data and user feedback data through machine learning algorithms to gradually improve the speed and accuracy of fingerprint and voiceprint recognition. For example, the system can adjust the recognition threshold and optimize the algorithm parameters based on the user's common instructions and operation frequency.
[0103] The wireless transceiver module is used to establish a wireless connection with an external controlled electrical appliance (i.e., an associated electronic device), and the wireless connection is at least one of FM wireless connection, infrared wireless connection, Bluetooth wireless connection, WIFI wireless network connection, 3G or 4G wireless network connection, Zigbee wireless network connection, and Thread wireless network connection.
[0104] Optionally, the fingerprint recognition module includes: a touch control module and a touch interface module, and the touch control module is electrically connected to the touch interface module to collect fingerprint information of the target object through the touch interface module.
[0105] Optionally, the control device further includes: a display module and / or a playback module, and the display module and the playback module are electrically connected to the central microprocessor.
[0106] In actual device control, when the target object needs to use the control device to control the corresponding target device, the authentication method of the control device is selected; the control device responds to the selection operation, determines the target authentication scenario, which is used to represent the target object's control authority over the control device, and collects the target object's biometric information under the target authentication scenario. Then, the target object is authenticated based on the biometric information; finally, if the target object passes the identity authentication, the device control information is obtained and sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information.
[0107] In the device control solution provided in the present application, the biometric information of the target object in the target authentication scenario is verified. When the biometric information verification is passed, it indicates that the target object has control authority. Then, the device control information is obtained and sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information, thereby avoiding the situation where traditional control devices do not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system, thereby improving security.
[0108] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.
[0109] The present application provides a device control method, comprising: in response to a selection operation of an authentication method for a control device, determining a target authentication scenario, the target authentication scenario being used to indicate the control authority of a target object over the control device; collecting biometric information of the target object under the target authentication scenario; authenticating the target object based on the biometric information; if the target object identity authentication is passed, obtaining device control information, and sending the device control information to a target device associated with the control device, so that the target device performs a corresponding action based on the device control information.
[0110] See also Figure 3 , provides a device control method, which is described by taking the method applied to an electronic device (or a computer device, etc.) as an example. The electronic device (or a computer device, etc.) may specifically be Figure 1 The terminal, gateway, server, etc. in the embodiment specifically include the following steps:
[0111] 101: In response to a selection operation of an authentication method for a control device, determine a target authentication scenario.
[0112] The target authentication scenario is used to indicate the control authority of the target object over the control device. The authentication method may include a voice recognition method and / or a fingerprint recognition method. The target object refers to the object that needs to operate the control device. The target authentication scenario may be a voice authentication scenario, a fingerprint authentication scenario, or a dual authentication scenario of voice and fingerprint.
[0113] The voice authentication scenario is that before using the control device, voice information for verifying the identity of the target object is stored in the control device in advance, which is used to indicate the target object's voice control authority over the control device. For example, the target object controls the TV remote control by voice to turn the TV on and off, change channels, etc.
[0114] The fingerprint authentication scenario is that before using the control device, the fingerprint information used to verify the identity of the target object is stored in the control device in advance, which is used to indicate the target object's fingerprint control authority over the control device. For example, the target object controls the switch of the air conditioner remote control by fingerprint, allowing any user to adjust the temperature of the air conditioner by voice.
[0115] Dual authentication scenario of voice and fingerprint Before using the control device, voice information and fingerprint information for verifying the identity of the target object are stored in the control device in advance, which are used to indicate the target object's fingerprint control authority and voice control authority over the control device. For example, the target object starts the air conditioner remote control with fingerprint, and then controls the air conditioner remote control with voice to turn on and off the air conditioner and adjust the temperature of the air conditioner.
[0116] The control device may be a smart remote controller, which includes a selection control for selecting an authentication method, and the selection control may be a physical key or a virtual key.
[0117] When the selection control is a physical button, the authentication mode selection operation may be an operation when the target object presses the physical button. For example, when the target object presses the physical button once, the target authentication scenario is determined to be a voice authentication scenario corresponding to the voice recognition mode; when the target object presses the physical button twice in succession, the target authentication scenario is determined to be a fingerprint authentication scenario; when the target object presses the physical button three times in succession, the target authentication scenario is determined to be a dual authentication scenario of voice and fingerprint.
[0118] When the selection control is a virtual button, the authentication mode selection operation may be an operation of the target object touching the virtual button. Exemplarily, when the target object touches the virtual button once, the target authentication scene is determined to be a voice authentication scene corresponding to the voice recognition mode; when the target object touches the virtual button twice in succession, the target authentication scene is determined to be a fingerprint authentication scene; when the target object touches the virtual button three times in succession, the target authentication scene is determined to be a dual authentication scene of voice and fingerprint.
[0119] 102: Collect biometric information of a target object in a target authentication scenario.
[0120] Among them, biometric information is used to identify the target object, which includes but is not limited to physiological characteristics such as fingerprints, faces, irises, voiceprints, hand shapes, finger veins / palm veins, retinas, DNA, palm prints, as well as behavioral characteristics such as gait, signatures, and voice.
[0121] 103: Authenticate the target object based on biometric information.
[0122] Specifically, by matching the biometric information with the pre-stored biometric information, if the match is successful, the identity authentication is passed; if the match is unsuccessful, the identity authentication fails, and the target object is prohibited from controlling the corresponding target device through the control device.
[0123] Exemplarily, the biometric information is voice information, and the voice information is matched with pre-stored voice information. If the match is successful, the identity authentication is passed and the smart remote control is started. After that, any user can use the smart remote control to control the corresponding target device (such as air conditioner, TV, etc.).
[0124] Exemplarily, the biometric information is fingerprint information, and the fingerprint information is matched with the pre-stored fingerprint information. If the match is successful, the identity authentication is passed and the smart remote control is started. After that, any user can use the smart remote control to control the corresponding target device (such as air conditioner, TV, etc.).
[0125] Exemplarily, the biometric information is voice information and fingerprint information, which are matched with pre-stored voice information and fingerprint information respectively. If the match is successful, the identity authentication is passed and the smart remote control is started. After that, any user can use the smart remote control to control the corresponding target device (such as air conditioner, TV).
[0126] 104: If the target object identity authentication is passed, the device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs a corresponding action based on the device control information.
[0127] The device control information is used to represent information of a target device associated with the management or operation control device.
[0128] Specifically, when the identity authentication of the target object is passed, the device control information can be obtained in response to the target object's operation on the control device, and the device control information can be sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information. For example, the control device is a smart remote controller for controlling an air conditioner, and the target device is an air conditioner; the smart remote controller is provided with a temperature adjustment button for adjusting the temperature of the air conditioner. When the identity authentication of the target object is passed, it means that the smart remote controller can be used. When the target object or any user other than the target object presses the temperature adjustment button on the smart remote controller, the temperature adjustment instruction corresponding to the pressing operation is obtained, and the temperature adjustment instruction is sent to the air conditioner based on the temperature adjustment instruction, so that the air conditioner adjusts the current air conditioner temperature in response to the temperature adjustment instruction.
[0129] In one embodiment, the biometric information includes voice information, and performing identity authentication on the target object based on the biometric information includes:
[0130] Authentication of the target object based on voice information;
[0131] If the target object passes the identity authentication, the device control information is obtained, including:
[0132] Use voice information as device control information.
[0133] The voice information may be information used to verify the identity of the target object.
[0134] Specifically, the voice information is matched with the pre-stored voice information. If the match is successful, the identity authentication of the target object is passed, and the voice information is used as the device control information.
[0135] Exemplarily, assuming that the text corresponding to the voice information is "lower the temperature", when the voice information successfully matches the pre-stored voice information, the voice information is converted into the corresponding text "lower the temperature", and "lower the temperature" is used as the device control information.
[0136] In one embodiment, performing identity authentication on a target object based on voice information includes:
[0137] Preprocessing the voice information to obtain the voice information to be processed;
[0138] Extract features from the speech information to be processed to obtain feature parameter information, which is used to characterize the sound features of the target object;
[0139] Authenticate the target object based on the characteristic parameter information.
[0140] The speech information to be processed is the pre-processed speech information. The characteristic parameter information is the information that can be used to characterize the individual sound characteristics of the target object, and the information may include Mel frequency cepstral coefficients, linear prediction coefficients, and the like.
[0141] Optionally, the voice information may include the voiceprint features and voice commands of the target object. Based on this, the voiceprint features of the target object may be matched with the voiceprint feature template pre-stored in the database. If the match is successful, the voice command of the target object is sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information. That is, in addition to text, the voice information in this application can also be used to identify the voiceprint of the target object.
[0142] Specifically, the voice signal can be subjected to preprocessing operations such as denoising, normalization, and voice segmentation to obtain voice information to be processed, which is beneficial to improving the quality of the voice information, removing background noise and other interference signals in the voice information, improving the accuracy of identity authentication of the target object, and improving the control stability and reliability of the target device; then, feature parameter information is extracted from the voice information to be processed; the feature parameter information can be matched with the voiceprint feature template pre-stored in the database through voiceprint recognition technologies such as dynamic time warping (DTW), Gaussian mixture model (GMM), and deep neural network (DNN) to generate a similarity score; if the similarity score is higher than a preset threshold, the match is successful, and it is determined that the identity authentication of the target object has passed; otherwise, the match fails, and it is determined that the identity authentication of the target object has failed.
[0143] Optionally, for target objects with similar sounds, high-dimensional feature parameters can be extracted from the speech signal based on a deep learning model, wherein the high-dimensional feature parameters include not only basic Mel-frequency cepstral coefficients (MFCC) and linear prediction coefficients (LPC), but also time-frequency characteristics of the speech signal (such as time-frequency characteristics), vocal tract models (such as stereo, 5.1, 7.1), etc. The deep learning model can be a convolutional neural network (CNN), a recurrent neural network (RNN), etc. In this embodiment, the deep learning model can capture more subtle sound features from the speech signal, which is conducive to distinguishing target objects with similar sounds, improving the accuracy of identity authentication of the target object, and improving the control stability and reliability of the target device.
[0144] In one embodiment, the database of the control device pre-stores voiceprint feature templates of multiple different users, and each user can control the control device through voice information. Based on this, when the voice information of each target object is obtained, the voiceprint feature in each voice information is matched with the voiceprint feature template in the database. If the match is successful, each target object can control the control device through the voice command in the voice information; if the voiceprint feature in the voice information does not match the voiceprint feature template in the database, the identity authentication of the target object corresponding to the voiceprint feature that failed to match fails, and the voice command in the voice information of the target object is refused to be executed.
[0145] In one embodiment, the database of the control device pre-stores voiceprint feature templates of multiple different users, and sets a specific control authority or control time limit for each user. Based on this, when the voice information of each target object is obtained, the voiceprint feature in each voice information is matched with the voiceprint feature template in the database. If the match is successful, it means that the identity authentication is passed, then the control authority of the target object to control the control device is determined, and the control device is controlled based on the control authority and voice command. For example, the voice command of target object 1 is limited to turning on and off the air conditioner, the voice command of target object 2 can turn on and off the air conditioner, and the target object 2 can also be allowed to adjust the temperature of the air conditioner within 5 minutes after the identity authentication of target object 2 is passed. If the voice command of target object 1 is to adjust the temperature of the air conditioner, the voice command is rejected. If the voice command of target object 2 is to turn on the air conditioner, the voice command is sent to the air conditioner so that the air conditioner automatically turns on according to the command. If the voiceprint feature in the voice information does not match the voiceprint feature template in the database, the identity authentication of the target object corresponding to the voiceprint feature fails, and the voice command in the voice information is rejected.
[0146] The biometric information includes fingerprint information. Before obtaining the voice information of the target object, the fingerprint information of the target object needs to be authenticated. After the authentication is passed, the voice information is parsed to obtain the device control information. That is, in one embodiment, the identity authentication of the target object based on the biometric information includes:
[0147] Authentication of the target object based on fingerprint information;
[0148] If the target object passes the identity authentication, the device control information is obtained, including:
[0149] If the target object's identity authentication is passed, the target object's voice information is obtained and used as device control information.
[0150] Specifically, the fingerprint information is matched with the pre-stored fingerprint information. If the match is successful, the identity authentication of the target object is passed, and the voice information of the target object is obtained, and the voice information is used as the device control information.
[0151] Exemplarily, the text corresponding to the voice information is "lower the temperature". After the fingerprint information successfully matches the pre-stored fingerprint information, the voice information of the target object is obtained, the voice information is converted into the corresponding text "lower the temperature", and "lower the temperature" is used as the device control information.
[0152] Optionally, if the identity authentication of the target object is passed, the voice information of any object is obtained, and the arbitrary object may be the target object or another user other than the target object. It should be noted that in this embodiment, since the identity authentication of the target object is passed, the control device is allowed to be remotely controlled by voice. In this case, any object can control the control device through voice information, and there is no need to match the voiceprint features in the voice information of the arbitrary object with the voiceprint feature template in the database.
[0153] In this embodiment, through pre-fingerprint recognition, voice information is directly used to send control instructions (i.e., device control information) to the target device, so that the target device can directly execute the control instructions, avoiding the simultaneous fingerprint authentication and voice information analysis, reducing the speed of voice information analysis, and increasing the speed of the target device's corresponding action, thereby improving the work efficiency of the control device in controlling the target device to perform the corresponding action.
[0154] The user can set the duration of voice control after each fingerprint recognition authentication. That is, in one embodiment, if the identity authentication of the target object is passed, the voice information of the target object is obtained and used as the device control information, including:
[0155] If the target object's identity authentication is passed, the voice control duration of the control device is obtained, and the voice information of the target object is obtained during the voice control duration;
[0156] Use voice information as device control information.
[0157] The voice control duration is the duration that the target object controls the control device through voice.
[0158] Specifically, if the identity authentication of the target object is passed, the voice information of the target object can be obtained within the voice control time, and the voice information can be used as the device control information.
[0159] For example, assuming that the voice control duration is 3 minutes, within 3 minutes, the text corresponding to the target object's voice information collected for the first time is "lower the temperature", and the text corresponding to the target object's voice information collected for the second time is "increase the temperature"; if the target object's identity authentication is passed, the voice information collected for the first time is converted into the corresponding text "lower the temperature", and "lower the temperature" is used as the device control information, and then the target object's voice information collected for the second time can be obtained and converted into the corresponding text "increase the temperature", and "increase the temperature" is used as the device control information. If the voice control duration is exceeded, the target object needs to re-authenticate before continuing to control the control device through voice within the voice control duration; or any object is prohibited from continuing to control the control device through voice.
[0160] In this embodiment, the duration of voice control is increased to limit the duration of the target object controlling the control device by voice, thereby preventing the control device from being maliciously operated and improving the flexibility and security of controlling the control device by voice.
[0161] The dual recognition of voiceprint and fingerprint is suitable for scenarios with high security authority requirements or where users and administrators are separated or need to restrict each other. For example, if a user only uses fingerprint recognition, it may be abused in a passive or disabled state. Based on this, the target object can be authenticated in combination with voice recognition to ensure that the target object has issued a specific control instruction. That is, in one embodiment, the biometric information includes voice information and fingerprint information. The identity authentication of the target object based on the biometric information includes:
[0162] Authentication of the target object is performed based on voice information and fingerprint information.
[0163] The voice information and fingerprint information may come from the same target object or from different target objects.
[0164] Specifically, the voice information and fingerprint information of the target object can be verified at the same time. For example, when the target object wants to control the control device, the voice information and fingerprint information of the target object are collected through the control device, and the voice information is matched with the voice information pre-stored in the control device, and at the same time, the fingerprint information is matched with the fingerprint information pre-stored in the control device; if the voice information and fingerprint information are matched successfully at the same time, the identity authentication of the target object is passed, and the target object is allowed to control the control device by voice, otherwise the identity authentication of the target object is not passed, and the target object is prohibited from controlling the control device by voice. Based on this, voice control can be performed by simultaneously verifying the fingerprint information and voice information of the target object, which greatly improves security. Furthermore, matching the voice information with the voice information pre-stored in the control device can specifically be to extract the voiceprint features from the voice information and match them with the voiceprint feature template corresponding to the voice information pre-stored in the control device.
[0165] In this embodiment, the target object is authenticated by using voice information and fingerprint information to prevent the control device from being used for unauthorized voice control within a controllable time, thereby improving the security and reliability of controlling the control device.
[0166] In one embodiment, identity verification of a target object based on voice information and fingerprint information includes:
[0167] If the voice information verification is successful, the fingerprint information is verified to authenticate the target object; and / or,
[0168] If the fingerprint information is verified, the voice information is verified to authenticate the target object.
[0169] Specifically, the voice information and fingerprint information of the target object can be verified successively. For example, when the target object wants to control the control device, the voice information and fingerprint information of the target object are collected through the control device, and the voice information is first matched with the voice information pre-stored in the control device; if the voice information matches successfully, the fingerprint information is matched with the fingerprint information pre-stored in the control device, if the fingerprint information matches successfully, the target object identity verification is passed, and the target object is allowed to control the control device through voice; otherwise, the target object identity verification fails, and the target object is prohibited from controlling the control device through voice. For another example, when the target object wants to control the control device, the voice information and fingerprint information of the target object are collected through the control device, and the fingerprint information is first matched with the fingerprint information pre-stored in the control device; if the fingerprint information matches successfully, the voice information is matched with the voice information pre-stored in the control device, if the voice information matches successfully, the target object identity verification is passed, and the target object is allowed to control the control device through voice; otherwise, the target object identity verification fails, and the target object is prohibited from controlling the control device through voice.
[0170] In this embodiment, the target object is authenticated by using voice information and fingerprint information to prevent the control device from being used for unauthorized voice control within a controllable time, thereby improving the security and reliability of controlling the control device.
[0171] The target authentication scenario includes a first target object and a second target object, and voice recognition and fingerprint recognition can provide possibilities for situations where dual authentication is required. For example, the control device collects fingerprint information of the first target object and voice information of the second target object. After the fingerprint information of the first target object is verified, if the voice information of the second target object is verified, the second target object can remotely control the control device by voice. That is, in one embodiment, collecting biometric information of the target object in the target authentication scenario includes:
[0172] Collecting first biological information of a first target object and second biological information of a second target object;
[0173] Authentication of the target object based on biometric information, including:
[0174] authenticating the first target object based on the first biometric information;
[0175] Authentication of the second target object is performed based on the second biometric information; the first biometric information and the second biometric information include voiceprint and / or fingerprint;
[0176] If the target object passes the identity authentication, the device control information is obtained, including:
[0177] Authentication of the first target object and the second target object is performed according to a preset authentication priority;
[0178] If the identity authentication of the first target object and the second target object is passed, comparing the control priorities of the first target object and the second target object;
[0179] The voice information of the target object with a higher control priority is obtained, and the voice information is used as the device control information.
[0180] The target authentication scenario may include multiple target objects and the control authority of each target object, for example, a first target object and the control authority of the first target object, a second target object and the control authority of the second target object. The control priority refers to the priority of the target object to control the control device. For example, the corresponding priority can be determined according to the identity of the target object, for example, the administrator has a higher priority, while the ordinary user has a lower priority.
[0181] Specifically, the voiceprint and / or fingerprint of the first target object and the voiceprint and / or fingerprint of the second target object can be collected through the control device. Based on the preset verification priority, the voiceprint and / or fingerprint of the first target object can be matched with the voiceprint template and / or fingerprint template pre-stored in the control device. If the match is successful, the identity authentication of the first target object is passed; then, the voiceprint and / or fingerprint of the second target object is matched with the voiceprint template and / or fingerprint template pre-stored in the control device. If the match is successful, the identity authentication of the second target object is passed; then, the control priority of the first target object and the second target object is compared; finally, if the control priority of the first target object is higher than that of the second target object, the voice information of the first target object is obtained, and the voice information of the first target object is used as the device control information.
[0182] For example, assuming that the administrator is an administrator and the ordinary user is an ordinary user, and the administrator's verification priority and control priority are higher than those of ordinary users, the device control instruction corresponding to the administrator's voice information is "lower the air conditioning temperature", and the device control instruction corresponding to the ordinary user's voice information is "turn off the air conditioning". The control device collects the administrator's voiceprint and the ordinary user's voiceprint, first matches the administrator's voiceprint with the voiceprint template pre-stored in the control device, and then matches the ordinary user's voiceprint with the voiceprint template pre-stored in the control device; when the administrator's voiceprint matches successfully and the ordinary user's voiceprint matches successfully, since the administrator's control priority is higher than that of the ordinary user, the administrator's voice information is obtained and used as the device control information, that is, "lower the air conditioning temperature".
[0183] In this embodiment, identities are authenticated for the first target object and the second target object to achieve dual authentication for different objects, thereby increasing the difficulty for unauthorized users to control the control device and improving security. By controlling the priority, the device control information is determined, and objects of different levels can be flexibly responded to, avoiding control conflicts between different objects and ensuring the stability and reliability of the control device.
[0184] The functions of the control device are increasing, such as supporting additional functions such as motion remote control, and adding multiple verification methods can use functions of different security levels in different levels. That is, in one embodiment, if the identity authentication of the target object is passed, before obtaining the device control information, it also includes:
[0185] If the identity authentication of the target object passes, the security level of the target authentication scenario is determined;
[0186] Determine the operating functions of the control equipment based on the safety level;
[0187] Based on the operation function, device control information is generated.
[0188] The security level of the target authentication scenario is used to indicate the level of the control operation of the target object in the target authentication scenario. For example, the target authentication scenario is a fingerprint authentication scenario, and the operation function of the control device associated with the security level of the fingerprint authentication scenario is shake.
[0189] For example, it is assumed that the target authentication scenario is a fingerprint authentication scenario, and the security level of the fingerprint authentication scenario is that the target object is allowed to operate the control device by shaking the operation function, and the control device is a smart remote control of an air conditioner. Based on this, when the identity authentication of the target object is passed, in response to the shake operation on the control device, a device control instruction corresponding to the shake operation is generated, such as "turn on the air conditioner", and "turn on the air conditioner" is used as the device control information.
[0190] For example, assume that the target authentication scenario is a voice authentication scenario, and the security level of the voice authentication scenario is that the target object is allowed to operate the control device through voice control, and the control device is an intelligent remote controller for an air conditioner. Based on this, when the identity authentication of the target object is passed, the voice information of the target object is obtained, and the device control instruction corresponding to the voice information is "turn on the air conditioner", and "turn on the air conditioner" is used as the device control information.
[0191] In this embodiment, in different target authentication scenarios, the operable functions are determined by the security level of the target authentication scenario, thereby generating corresponding device control information. A variety of flexible combinations of authentication methods can be provided to adapt to the security verification requirements in different target authentication scenarios, and are conducive to improving the security and reliability of the control device.
[0192] In one embodiment, identity verification of a target object based on biometric information includes:
[0193] Obtain the environmental data of the target object;
[0194] Authenticate the target object based on biometric information and environmental data.
[0195] The biological information may be voice information collected in the space where the target object is located, and the environmental data may refer to the environmental noise data of the space where the target object is located, wherein the voice information includes the voice command of the target object (such as turning on the light), tone and other sound feature information. For example, when the target object uses a control device (such as a smart remote control) in the morning and in the evening, the sound features are different. The voice information can be represented in the form of digital signals, analog signals, etc.
[0196] Specifically, the voice information is matched with the voice information pre-stored in the control device, and at the same time, the environmental data is analyzed. If it is determined that the environmental data matches the expected environmental noise, the target object identity authentication passes, otherwise the target object identity authentication fails.
[0197] For example, assuming that the target object is in the study, and the target object's voice information "turn on the lights" in the study is collected, as well as the ambient noise in the study. When the voice information successfully matches the voice information pre-stored in the smart remote control, and at the same time, the ambient noise matches the study ambient noise pre-stored in the smart remote control, the target object's identity authentication is passed.
[0198] In this embodiment, the identity information of the target object is verified simultaneously through environmental noise and voice information, which can effectively improve the quality of the voice signal, remove background noise and other interference, ensure that only specific voiceprints in specific environments can pass verification, prevent unauthorized access, and make subsequent processing more accurate.
[0199] In one embodiment, identity verification of a target object based on biometric information includes:
[0200] Authentication of the target object is performed based on a biometric recognition model corresponding to the biometric information;
[0201] After sending the device control information to the target device associated with the control device so that the target device performs a corresponding action based on the device control information, the method further includes:
[0202] Obtaining historical operation data and user feedback data of the target device, where the historical operation data is generated based on the historical execution results of the target device;
[0203] Update biometric models based on historical operation data and user feedback data.
[0204] When the biometric information is voice information, the biometric recognition model is a voice recognition model; when the biometric information is fingerprint information, the biometric recognition model is a fingerprint recognition model; when the biometric information includes voice information and fingerprint information, the biometric recognition model includes a voice recognition model and a fingerprint recognition model. The voice recognition model can be implemented through deep learning technologies, such as recurrent neural networks (RNN) and convolutional neural networks (CNN); the fingerprint recognition model can be implemented through deep learning technologies, such as convolutional neural networks (CNN) and generative adversarial networks (GAN).
[0205] Specifically, the voiceprint in the voice information can be identified by the voice recognition model, and / or the fingerprint in the fingerprint information can be identified by the fingerprint recognition model, and the identified voiceprint and / or fingerprint can be matched with the voiceprint and fingerprint pre-stored in the control device. If the match is successful, the target object identity authentication is passed, otherwise the target object identity authentication fails.
[0206] Among them, the historical operation data can be the operation data of each time the target object uses the control device to operate its associated target device, which can include the time of each use, voice instructions, execution results, sound changes, and operating habits (such as common instructions and operating frequency), etc. The user feedback data can be the feedback of the target object each time it uses the control device to operate its associated target device. For example, misidentification, recognition delay, etc., wherein misidentification includes incorrect identification or recognition failure of the target object's identity. For example, if the identity of the target object is re-identified and successfully verified in a short period of time, it is determined that the previous identity recognition failed. Recognition delay can refer to a long recognition time, but the identity recognition is successful.
[0207] In one embodiment, the control device automatically records each recognition result of the biometric recognition model and user feedback. Specifically, misrecognition and recognition delay can be marked. When the user is not satisfied with the recognition effect of some device control information, the parameters of the biometric recognition model can be optimized in response to the feedback operation of the target object on the control device (such as clicking the control on the screen of the control device for triggering the update of the biometric recognition model) to improve the recognition accuracy and response speed of the biometric recognition model.
[0208] Specifically, after the identity authentication of the target object is passed, the acquired device control information is sent to the target device associated with the control device so that the target device performs the corresponding action based on the device control information. If the recognition time exceeds the average range (such as 2 minutes), in response to the feedback operation of the target object in the control device, the historical operation data and user feedback data are used as training data, and the biometric recognition model is trained using an adaptive learning algorithm to update the parameters of the biometric recognition model according to the training data, thereby improving the recognition accuracy and response speed of the biometric recognition model in different time periods. The adaptive learning algorithm can be a machine learning algorithm.
[0209] In this embodiment, the recognition threshold and parameters of the biometric recognition model are adjusted according to user feedback data and historical operation data, thereby optimizing the accuracy of device control information execution and biometric recognition, and gradually improving the response speed and recognition accuracy of biometric recognition.
[0210] In one embodiment, the target authentication scenario includes a single-user authentication scenario and a multi-user authentication scenario.
[0211] Among them, the single-user authentication scenario is used to represent the voice authentication, fingerprint authentication, or dual authentication scenario of voice and fingerprint for identity authentication of a target object and the operation authority associated with the target object. The multi-user authentication scenario is used to represent the voice authentication, fingerprint authentication, or dual authentication scenario of voice and fingerprint for identity authentication of at least two target objects and the operation authority associated with each target object. In one embodiment, the device control method also includes:
[0212] In response to a selection operation for an authentication mode of a control device, determining that a target authentication scenario is a single-user authentication scenario;
[0213] Collect the target object's voiceprint and fingerprint information in a single-user authentication scenario;
[0214] Authentication of the target object based on voiceprint information and fingerprint information;
[0215] If the target object identity authentication is passed, the device control information is obtained and sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0216] Specifically, assuming that the control device is an intelligent remote control for an air conditioner, the target device is an air conditioner, and the operating authority of the target object is to control the control device by voice so that the target device associated with the control device performs a corresponding action, the voice command corresponding to the voice information of the target object collected by the control device is "lower the temperature", and voiceprint extraction is performed on the voice information to obtain the voiceprint information, and the fingerprint information of the target object is collected, and the voiceprint information is matched with the pre-stored voiceprint information, and the fingerprint information is matched with the stored fingerprint information. If the voiceprint information matches successfully and the fingerprint information matches successfully, the identity authentication of the target object passes, and "lower the temperature" is used as the device control information, and the voice command "lower the temperature" is sent to the air conditioner associated with the intelligent remote control, so that the air conditioner responds to "lower the temperature" and adjusts the current air conditioning temperature; otherwise, the identity authentication of the target object fails, and the target object is reminded to try again later or the target object is prohibited from using the intelligent remote control.
[0217] In one embodiment, the device control method further includes:
[0218] In response to a selection operation on an authentication mode of a control device, determining that a target authentication scenario is a multi-user authentication scenario;
[0219] Collect voiceprint information of a first target object and fingerprint information of a second target object in a multi-user authentication scenario;
[0220] When the fingerprint information of the second target object is verified, device control information is generated based on the voiceprint information of the first target object, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0221] Specifically, assuming that the control device is an intelligent remote controller for an air conditioner, the operation permission of the first target object is to control the control device by voice so that the target device associated with the control device performs a corresponding action, and the operation permission of the second target object is to grant the first target object control the intelligent remote controller by voice through fingerprint recognition. The voice information of the first target object collected by the control device corresponds to the voice command "lower the temperature", and the voiceprint is extracted from the voice information to obtain the voiceprint information, and the fingerprint information of the second target object is collected, and the voiceprint information is matched with the pre-stored voiceprint information. If the voiceprint information matches successfully, the identity authentication of the first target object is passed, and the fingerprint information is matched with the stored fingerprint information. If the voiceprint information matches successfully and the fingerprint information matches successfully, the identity authentication of the second target object is passed, "lower the temperature" is used as the device control information, and the "cooling temperature" is sent to the air conditioner associated with the intelligent remote controller, so that the air conditioner responds to "lower the temperature" and adjusts the current air conditioning temperature; otherwise, the identity authentication of the target object fails, and the target object is reminded to try again later or the target object is prohibited from using the intelligent remote controller.
[0222] Optionally, assuming that the control device is an intelligent remote controller for an air conditioner, the operation authority of the second target object is fingerprint verification, and the operation authority of the first target object is that after the fingerprint verification of the second target object is passed, the intelligent remote controller can be controlled by voice commands in the voice information of the first target object. For example, the fingerprint information of the second target object is collected by the control device, and the fingerprint features in the fingerprint information of the second target object are matched with the fingerprint feature template in the database. If the match fails, the identity authentication of the second target object fails, and the second target object is reminded to try again later or is prohibited from using the intelligent remote controller; if the match succeeds, it means that the identity authentication of the second target object is passed. Then, the voice information of the first target object is obtained by controlling the device, and the voice information includes voice commands, such as "lower the temperature", and voiceprint extraction is performed on the voice information to obtain voiceprint features, and the voiceprint features are matched with the pre-stored voiceprint feature module; if the match is successful, the identity authentication of the first target object is passed, "lower the temperature" is used as the device control information, and the "cooling temperature" is sent to the air conditioner associated with the smart remote control, so that the air conditioner responds to "lower the temperature" and adjusts the current air conditioning temperature; otherwise, the identity authentication of the first target object fails, and the first target object is reminded to try again later or the first target object is prohibited from controlling the smart remote control by voice.
[0223] See also Figure 4 , provides a device information processing method, which is described by taking the method applied to an electronic device (or a computer device, etc.) as an example. The electronic device (or a computer device, etc.) may specifically be Figure 1 The terminal, gateway, server, etc. in the embodiment specifically include the following steps:
[0224] 201: Displaying a display interface including a target application,
[0225] The target application is used to configure the control device associated with it.
[0226] Before using the control device, the administrator user needs to configure parameters on the target application associated with the control device. Based on this, the terminal displays the display interface containing the target application.
[0227] 202: In response to the configuration operation of the target application on the display interface, the authentication preference data of the control device is configured, and the identification identity information is entered through the control device, so that in the target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, wherein the authentication preference data includes the authentication method and the device operation time after authentication, and the authentication method includes the voiceprint recognition method and / or the fingerprint recognition method.
[0228] The authentication preference data includes authentication method, voice control duration, target authentication scenario, etc. The authentication method includes voice recognition method and / or fingerprint recognition method. The voice control duration indicates the control duration of the control device after the identity authentication of the target object is passed. The authentication identity information is the biometric information pre-entered and stored through the control device, wherein the biometric information may include voiceprint and / or fingerprint.
[0229] The voice recognition method means that in the device processing flow, the target object is authenticated by pure voice in the voice authentication scenario. If the identity authentication is successful, the target object is allowed to control the control device by voice. Exemplarily, the administrator user enters and stores the voice information used to authenticate the user through the smart remote control, and can also extract voiceprint information from the voice information for storage; in the device processing flow, when the target object sends a voice message of a voice command, the control device will authenticate the target object with the voice information and the pre-stored voice information. Specifically, for example, the voiceprint information in the voice information and the pre-stored voiceprint information are used to authenticate the target object. After the identity authentication is successful, the voice command is directly parsed into a control command and sent to the target object (air conditioner) associated with the smart remote control for remote control.
[0230] It should be noted that the administrator user can also record the voice information or fingerprint information of multiple different target objects (including the administrator user and other ordinary users) at the same time, and set the authority of each target object to control the device by voice remote control, or set specific control authority or control time limit for different target objects. Ordinary users can be people other than administrator users, such as parents or other operators with higher control authority.
[0231] The fingerprint recognition method means that in the device processing flow, the target object is authenticated by pure fingerprint recognition. If the identity authentication is passed, the target object is allowed to control the target object by voice. For example, the administrator user enters the fingerprint information for identity authentication through the smart remote control; in the device processing flow, before obtaining the voice information of the target object, it is necessary to first collect the fingerprint information of the target object, and match the fingerprint information with the pre-stored fingerprint information. After the identity authentication of the target object is passed, the voice information of the target object is obtained. After the identity authentication is passed, the voice information is directly parsed into a command and sent to the air conditioner associated with the smart remote control for remote control. The fingerprint recognition method avoids the disadvantage that the simultaneous fingerprint pattern recognition and voice command may affect the voice recognition speed. If the fingerprint recognition is performed in advance and the voice is directly used to send the control command, the command can be executed directly to improve the execution speed.
[0232] It should be noted that the administrator user can also set the duration of voice control after a fingerprint recognition authentication in the target application, that is, the voice control duration.
[0233] The dual recognition method of voiceprint and fingerprint means that in the device processing flow, the two recognition methods of voiceprint and fingerprint are combined to improve the accuracy of identity recognition. Optionally, for the same user, after fingerprint identification, in order to prevent other users except the user from being used for unauthorized voice control during the voice control duration, it can be set in the target application that the fingerprint of user 1 and the voiceprint of user 1 need to be verified at the same time before the control device can be voice controlled, which greatly improves security. Optionally, it can be set in the target application that the fingerprint of user 1 and the voiceprint of user 2 need to be verified. Based on this, before the device processing flow is executed, the fingerprint of user 1 and the voiceprint of user 2 need to be pre-entered and stored through the control device. Based on this, in the device processing flow, only when user 1 passes the identity authentication through fingerprint recognition, user 2 can verify the voice information of user 2 through voice recognition. After the identity authentication of user 2 is passed, the voice information is parsed into a command and sent to the air conditioner associated with the smart remote controller for remote control.
[0234] In one embodiment, the control device may be a smart remote control. When the functions of the smart remote control are increasing, such as supporting additional functions such as motion remote control, for example, a variety of different target authentication scenarios can be set in the target application, and functions of different security levels can be used in different levels. For example, in the fingerprint authentication scenario, if the identity of the target object is successful, the smart remote control can be automatically associated by shaking it. For example, in the voice authentication scenario, the identity of the target object needs to be verified with voiceprint recognition technology before the voice information of the target object can be parsed into a command and sent to the air conditioner associated with the smart remote control for remote control, etc.
[0235] In this embodiment, by configuring the target application, the control device provides a variety of flexible authentication methods to adapt to the security verification requirements in different scenarios. Considering different usage scenarios, different authentication methods have different advantages and disadvantages, and different target authentication scenarios can be selected in the device processing flow.
[0236] In order to better understand the device processing method, this embodiment provides a voiceprint recognition process and further describes the input of identification information by controlling the device, as follows:
[0237] Voiceprint recording stage: When a user uses the smart remote control for the first time, the smart remote control prompts the user to record the voiceprint. The user records voice information through the microphone of the smart remote control, and the smart remote control collects the user's voice characteristics (pitch, frequency, speaking speed, etc.) to obtain voiceprint information.
[0238] Voiceprint registration stage: After obtaining the voiceprint information, the smart remote controller associates the recorded voiceprint features (i.e., voiceprint information) with the user's identity information to form voiceprint registration information (i.e., voice information pre-stored in the smart remote controller). The voiceprint registration information can be stored in the internal memory of the smart remote controller or in a cloud server and associated with the user account.
[0239] Voiceprint recognition stage: After the voiceprint registration information is stored, when the user uses the remote control, the smart remote control collects the user's voice information through the microphone and sends it to the voiceprint recognition module of the smart remote control for processing. The voiceprint recognition module uses the pre-registered voiceprint information as a reference to perform matching analysis on the voice information to determine whether the voice information comes from the registered user.
[0240] Recognition result processing stage: If the voice information matches the registered user's voiceprint information successfully, the smart remote control confirms that the voice information comes from the registered user and continues the subsequent control process. Otherwise, the smart remote control refuses to execute the device control command corresponding to the voice information or requires re-identification.
[0241] In order to better understand the device processing method, this embodiment provides a fingerprint recognition process and further describes the input of identification information by controlling the device, as follows:
[0242] Fingerprint entry stage: When a user uses the remote control for the first time, the smart remote control prompts the user to enter the fingerprint. The user follows the instructions and enters the fingerprint features through the fingerprint sensor, and the smart remote control collects the user's fingerprint image and feature points.
[0243] Fingerprint registration stage: The smart remote controller associates the recorded fingerprint features with the user's identity information to form fingerprint registration information. The registration information is stored in the remote controller's internal memory or cloud server and is associated with the user account.
[0244] Fingerprint recognition stage: When the user uses the remote control, the smart remote control collects the user's fingerprint through the fingerprint sensor and sends it to the fingerprint recognition module for processing. The recognition module uses the pre-registered fingerprint information as a reference to perform a matching analysis on the fingerprint to determine whether the fingerprint comes from a registered user.
[0245] Identification result processing stage: If the fingerprint information matches the registered user's fingerprint successfully, the smart remote control confirms that the command comes from the registered user and continues the subsequent control process. If the fingerprint recognition fails, the smart remote control may refuse to execute the command or require re-authentication.
[0246] In order to better understand the device processing method, this embodiment provides a voiceprint and fingerprint dual recognition process and further describes the input of identification information by controlling the device, as follows:
[0247] Voiceprint and fingerprint entry phase: When a user uses the smart remote control for the first time, the smart remote control prompts the user to enter the voiceprint. The user enters voice information through the microphone of the smart remote control, and the smart remote control collects the user's voice features (pitch, frequency, speaking speed, etc.) to obtain voiceprint information. The smart remote control prompts the user to enter the fingerprint. The user follows the instructions and enters the fingerprint features through the fingerprint sensor, and the smart remote control collects the user's fingerprint image and feature points.
[0248] Voiceprint and fingerprint registration stage: After obtaining the voiceprint information and fingerprint information, the smart remote control associates the recorded voiceprint features (i.e., voiceprint information) with the user's identity information to form voiceprint registration information (i.e., voice information pre-stored in the smart remote control). The voiceprint registration information can be stored in the internal memory of the smart remote control or in a cloud server and associated with the user account. The smart remote control associates the recorded fingerprint features with the user's identity information to form fingerprint registration information. The registration information is stored in the internal memory of the remote control or in a cloud server and associated with the user account.
[0249] Voiceprint and fingerprint recognition stage: After the voiceprint registration information and fingerprint registration information are stored, when the user uses the remote control, the smart remote control collects the user's voice information through the microphone and sends it to the voiceprint recognition module of the smart remote control for processing. The voiceprint recognition module uses the pre-registered voiceprint information as a reference to match and analyze the voice information to determine whether the voice information comes from the registered user. The smart remote control collects the user's fingerprint through the fingerprint sensor and sends it to the fingerprint recognition module for processing. The recognition module uses the pre-registered fingerprint information as a reference to match and analyze the fingerprint to determine whether the fingerprint comes from the registered user.
[0250] Identification result processing stage: If the voice information matches the registered user's voiceprint information and the fingerprint information matches the registered user's fingerprint, the smart remote control confirms that the voice information and fingerprint information are from the registered user and continues the subsequent control process. Otherwise, the smart remote control refuses to execute the device control command corresponding to the voice information or requires re-identification.
[0251] It should be noted that the voiceprint and fingerprint can be multiple and do not belong to the same user. For example, the fingerprint of user 1 is recorded, and the voiceprint of user 2 is recorded. Only after the fingerprint of user 1 and the voiceprint of user 2 are authenticated can the remote control be performed by voice. For another example, for the same user 1, after fingerprint authentication, in order to prevent the fingerprint from being taken away by other non-registered users during the device control time and continued to be used for unauthorized voice control, it can be set that the fingerprint and voiceprint of user 1 must be verified at the same time before voice control can be performed, which greatly improves security.
[0252] In addition, when dual recognition of voiceprint and fingerprint is performed, the voiceprint recognition method and the fingerprint recognition method can be set not necessarily in a strict order, but can be performed almost simultaneously; when both identity authentications are correctly identified, the control instructions corresponding to the voice information can be sent through the smart remote control, ensuring the remote control's efficient recognition and control capabilities and providing a smoother user experience.
[0253] For example, a user wants to control the smart lighting system at home. The user first wakes up the voice remote control to enter the recording state. In the recording state, the smart remote control collects the user's voice information through the microphone. The voice information can be a preset voice command, such as "turn on the living room light." While collecting the user's voice information, the user's fingerprint information can be captured by the fingerprint recognition module of the smart remote control. The fingerprint recognition module verifies that the user's fingerprint information authentication is successful. At the same time, the voiceprint recognition module of the smart remote control verifies the user's voiceprint identity, and also recognizes and parses the voice command. The smart remote control sends a light-on command to the smart lighting system to turn on the light. As a result, the remote control can maintain efficient and accurate recognition capabilities under different environments and conditions, providing a more intelligent and safe user experience.
[0254] In order to better understand the device control method of the present application, Figure 5 As shown, this embodiment is described by applying the device control method to a wireless voice remote controller, which is as follows:
[0255] When user B uses the wireless voice remote control for the first time, he / she enters his / her fingerprint and voiceprint, and stores them in the instruction code storage module of the smart remote control. Specifically, user B says "Smart home system, turn off the lights" according to the prompt of the remote control. The remote control collects user B's voice data through the microphone and extracts the voiceprint features. The extracted voiceprint features include frequency features, time domain features, spectrogram and other information. The remote control stores user B's voiceprint features in the instruction code storage module of the smart remote control and associates them with user B's operation permissions.
[0256] Every time user B uses the remote control, he or she will be authenticated through the fingerprint recognition module and the voiceprint recognition module. Specifically, the remote control collects user B's voice information through the microphone and extracts the voiceprint features. The remote control matches the extracted voiceprint features with the stored voiceprint information of user B. If the match is successful, user B's identity is authenticated, and user B enters the control command through the touch interface of the remote control or the voice input method. For example, user B enters the command "turn off the lights" through voice. The control command input method can be performed simultaneously with the microphone collection, extraction of voiceprint features and verification for identity authentication.
[0257] The remote controller receives the command input by the user, analyzes it, and sends the analyzed command to the corresponding smart home device through the wireless transceiver module. For example, the remote controller sends the command "turn off the lights" to the smart lighting device.
[0258] The remote controller records the operation data according to the execution results of the instructions, that is, the historical operation data.
[0259] The remote controller determines the user's satisfaction with the operation in response to the user B's feedback.
[0260] The remote control further optimizes the adaptive learning algorithm based on the feedback and historical operation data of user B. Specifically, the adaptive learning algorithm analyzes the historical operation data and user feedback of user B, continuously adjusts and optimizes the recognition parameters, and improves the recognition accuracy and command execution efficiency. For example, if the remote control analyzes that user B frequently uses the "turn off the lights" command at night, it will optimize the quick response to the command at night.
[0261] The above is the device control process and device information processing process of this application.
[0262] As mentioned above, the present application provides a device control method, a device information processing method, an apparatus and related equipment, in response to the selection operation of the authentication method for the control device, a target authentication scenario is determined, and the target authentication scenario is used to indicate the control authority of the target object over the control device; the biometric information of the target object in the target authentication scenario is collected; the identity of the target object is authenticated based on the biometric information; if the identity of the target object is authenticated, the device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information. In the device control scheme provided by the present application, by verifying the biometric information of the target object in the target authentication scenario, when the biometric information verification is passed, it indicates that the target object has the control authority, then the device control information is obtained and sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information, thereby avoiding the situation where the traditional remote control does not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system, thereby improving security.
[0263] In one embodiment, Figure 6 As shown, a device control device is provided, including: a determination module 301, a collection module 302, a verification module 303 and a sending module 304, wherein:
[0264] A determination module 301, configured to determine a target authentication scenario in response to a selection operation of an authentication method for a control device;
[0265] A collection module 302 is used to collect biometric information of a target object in a target authentication scenario;
[0266] Verification module 303, used to authenticate the target object based on biometric information;
[0267] The sending module 304 is used to obtain device control information if the target object identity authentication is passed, and send the device control information to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0268] In this embodiment, in response to the selection operation of the authentication method for the control device, a target authentication scenario is determined, and the target authentication scenario is used to indicate the control authority of the target object over the control device; the biometric information of the target object in the target authentication scenario is collected; the identity of the target object is authenticated based on the biometric information; if the identity of the target object is authenticated, the device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information. In the device control scheme provided in the present application, by verifying the biometric information of the target object in the target authentication scenario, when the biometric information verification is passed, it indicates that the target object has the control authority, then the device control information is obtained and sent to the target device associated with the control device, so that the target device performs the corresponding action based on the device control information, thereby avoiding the situation where the traditional remote control does not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system, thereby improving security.
[0269] Optionally, in some embodiments of the present application, the biometric information includes voice information, and the verification module includes:
[0270] A first verification submodule, used for performing identity verification of a target object based on voice information;
[0271] The sending module includes:
[0272] The first determining submodule is used to use the voice information as device control information.
[0273] Optionally, in some embodiments of the present application, the verification module includes:
[0274] The preprocessing submodule is used to preprocess the voice information to obtain the voice information to be processed;
[0275] An extraction module is used to extract features from the speech information to be processed to obtain feature parameter information, and the feature parameter information is used to characterize the sound features of the target object;
[0276] The second verification submodule is used to authenticate the target object based on the characteristic parameter information.
[0277] Optionally, in some embodiments of the present application, the biometric information includes fingerprint information, and the verification module includes:
[0278] A third verification submodule is used to authenticate the target object based on fingerprint information;
[0279] The sending module includes:
[0280] The second determination submodule is used to obtain the voice information of the target object if the identity authentication of the target object is passed, and use the voice information as the device control information.
[0281] Optionally, in some embodiments of the present application, the sending module includes:
[0282] The first acquisition submodule is used to obtain the voice control duration of the control device if the identity authentication of the target object is passed, and obtain the voice information of the target object within the voice control duration;
[0283] The third determining submodule is used to use the voice information as device control information.
[0284] Optionally, in some embodiments of the present application, the biometric information includes voice information and fingerprint information, and the verification module includes:
[0285] The fourth verification submodule is used to authenticate the identity of the target object based on the voice information and fingerprint information.
[0286] Optionally, in some embodiments of the present application, the fourth verification submodule includes:
[0287] A first verification unit is used to verify the fingerprint information if the voice information verification is passed, so as to authenticate the identity of the target object; and / or,
[0288] The second verification unit is used to verify the voice information if the fingerprint information verification is successful, so as to authenticate the identity of the target object.
[0289] Optionally, in some embodiments of the present application, the target authentication scenario includes a first target object and a second target object, and the acquisition module includes:
[0290] A collection submodule, used to collect first biological information of a first target object and second biological information of a second target object;
[0291] The verification modules include:
[0292] a fifth verification submodule, configured to authenticate the identity of the first target object based on the first biometric information;
[0293] A sixth verification submodule, configured to authenticate the identity of the second target object based on the second biometric information; the first biometric information and the second biometric information include voiceprints and / or fingerprints;
[0294] The sending module includes:
[0295] A first verification submodule, used to authenticate the identities of the first target object and the second target object according to a preset verification priority;
[0296] A comparison submodule, configured to compare the control priorities of the first target object and the second target object if the identity authentications of the first target object and the second target object are passed;
[0297] The fourth determination submodule is used to obtain voice information of a target object with a higher control priority, and use the voice information as device control information.
[0298] Optionally, in some embodiments of the present application, the sending module includes:
[0299] A fifth determination submodule is used to determine the security level of the target authentication scenario if the identity authentication of the target object passes;
[0300] a sixth determination submodule, configured to determine an operation function of the control device based on the security level;
[0301] The generation submodule is used to generate device control information based on the operation function.
[0302] Optionally, in some embodiments of the present application, the verification module includes:
[0303] The second acquisition submodule is used to acquire the environment data of the target object;
[0304] The seventh verification submodule is used to authenticate the target object based on biometric information and environmental data.
[0305] Optionally, in some embodiments of the present application, the verification module includes:
[0306] an eighth verification submodule, for performing identity authentication on a target object based on a biometric recognition model corresponding to the biometric information;
[0307] The device also includes an update module, which is specifically used to:
[0308] Obtaining historical operation data and user feedback data of the target device, where the historical operation data is generated based on the historical execution results of the target device;
[0309] Update the biometric model based on historical operation data and user feedback data.
[0310] Optionally, in some embodiments of the present application, the target authentication scenario includes a single-user authentication scenario and a multi-user authentication scenario.
[0311] Optionally, in some embodiments of the present application, the device further includes a first control module, the first control module being specifically configured to:
[0312] In response to a selection operation for an authentication mode of a control device, determining that a target authentication scenario is a single-user authentication scenario;
[0313] Collect the target object's voiceprint and fingerprint information in a single-user authentication scenario;
[0314] Authentication of the target object based on voiceprint information and fingerprint information;
[0315] If the target object identity authentication is passed, the device control information is obtained and sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0316] Optionally, in some embodiments of the present application, the device further includes a second control module, and the second control module is specifically configured to:
[0317] In response to a selection operation on an authentication mode of a control device, determining that a target authentication scenario is a multi-user authentication scenario;
[0318] Collect voiceprint information of a first target object and fingerprint information of a second target object in a multi-user authentication scenario;
[0319] When the fingerprint information of the second target object is verified, device control information is generated based on the voiceprint information of the first target object, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
[0320] For the specific definition of the device information processing device, please refer to the definition of the device control method above, which will not be repeated here. Each module in the above-mentioned device information processing device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0321] In one embodiment, Figure 7 As shown, a device information processing apparatus is provided, including: a display module 401 and a configuration module 402, wherein:
[0322] A display module 401 is used to display a display interface including a target application, where the target application is used to configure a control device associated therewith;
[0323] The configuration module 402 is used to configure the authentication preference data of the control device in response to the configuration operation of the target application on the display interface, and enter the identification information through the control device, so that in the target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification information. The authentication preference data includes the authentication method and the device operation time after authentication. The authentication method includes the voiceprint recognition method and / or the fingerprint recognition method.
[0324] In this embodiment, by displaying a display interface including a target application, the target application is used to configure the control device associated with it; in response to the configuration operation of the target application on the display interface, the authentication preference data of the control device is configured, and the identification identity information is entered through the control device, so that in the target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, and the authentication preference data includes the authentication method and the device operation time after authentication, and the authentication method includes the voiceprint recognition method and / or the fingerprint recognition method. By controlling the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information in the target authentication scenario, the traditional remote control does not restrict the identity of the user, or the security identification method is relatively single, resulting in low security of the smart home system, thereby improving security.
[0325] For the specific definition of the device information processing device, please refer to the definition of the device information processing method above, which will not be repeated here. Each module in the above-mentioned device information processing device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0326] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a device control method and / or a device information processing method is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a key, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.
[0327] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
[0328] In one embodiment, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0329] In one embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.
[0330] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0331] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0332] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A device control method, characterized in that: Applied to control equipment, including: In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario, the target authentication scenario being used to represent the control authority of the target object over the control device; Collecting biometric information of the target object in the target authentication scenario; authenticating the target object based on the biometric information; If the identity authentication of the target object is passed, device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
2. The device control method according to claim 1, characterized in that: The biological information includes voice information, and the identity verification of the target object based on the biological information includes: authenticating the target object based on the voice information; If the identity authentication of the target object is passed, obtaining device control information includes: The voice information is used as the device control information.
3. The device control method according to claim 2, characterized in that: The authenticating the target object based on the voice information includes: Preprocessing the voice information to obtain voice information to be processed; Extracting features from the speech information to be processed to obtain feature parameter information, wherein the feature parameter information is used to characterize the sound features of the target object; The target object is authenticated based on the characteristic parameter information.
4. The device control method according to claim 1, characterized in that: The biometric information includes fingerprint information, and the identity verification of the target object based on the biometric information includes: authenticating the target object based on the fingerprint information; If the identity authentication of the target object is passed, obtaining device control information includes: If the identity authentication of the target object is passed, the voice information of the target object is acquired, and the voice information is used as the device control information.
5. The device control method according to claim 4, characterized in that: If the identity authentication of the target object is passed, acquiring the voice information of the target object and using the voice information as the device control information includes: If the identity authentication of the target object is passed, the voice control duration of the control device is obtained, and the voice information of the target object is obtained within the voice control duration; The voice information is used as the device control information.
6. The device control method according to claim 1, characterized in that: The biometric information includes voice information and fingerprint information, and the identity verification of the target object based on the biometric information includes: The target object is authenticated based on the voice information and the fingerprint information.
7. The device control method according to claim 6, characterized in that: The authenticating the target object based on the voice information and the fingerprint information includes: If the voice information is verified, then verifying the fingerprint information to authenticate the target object; and / or, If the fingerprint information is verified, the voice information is verified to authenticate the target object.
8. The device control method according to claim 1, characterized in that: The target authentication scenario includes a first target object and a second target object, and collecting biometric information of the target object in the target authentication scenario includes: Collecting first biological information of the first target object and second biological information of the second target object; The identity verification of the target object based on the biometric information includes: authenticating the first target object based on the first biometric information; authenticating the second target object based on the second biometric information; the first biometric information and the second biometric information include voiceprints and / or fingerprints; If the identity authentication of the target object is passed, obtaining device control information includes: authenticating the first target object and the second target object according to a preset authentication priority; If the identity authentication of the first target object and the second target object is passed, comparing the control priority of the first target object and the second target object; The voice information of the target object with a higher control priority is obtained, and the voice information is used as the device control information.
9. The device control method according to claim 1, characterized in that: If the identity authentication of the target object is passed, obtaining device control information includes: If the identity authentication of the target object passes, determining the security level of the target authentication scenario; determining an operational function of the control device based on the security level; Based on the operation function, the device control information is generated.
10. The device control method according to claim 1, characterized in that: The identity verification of the target object based on the biometric information includes: Acquiring environmental data of the target object; The target object is authenticated based on the biometric information and the environmental data.
11. The device control method according to claim 1, characterized in that: The identity verification of the target object based on the biometric information includes: authenticating the target object based on a biometric recognition model corresponding to the biometric information; After sending the device control information to a target device associated with the control device so that the target device performs a corresponding action based on the device control information, the method further includes: Acquire historical operation data and user feedback data of the target device, wherein the historical operation data is generated based on historical execution results of the target device; The biometric recognition model is updated based on the historical operation data and the user feedback data.
12. The device control method according to any one of claims 1 to 11, characterized in that: The target authentication scenario includes a single-user authentication scenario and a multi-user authentication scenario.
13. The device control method according to claim 12, characterized in that: Also includes: In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario as the single-user authentication scenario; Collecting voiceprint information and fingerprint information of the target object in the single-user authentication scenario; authenticating the target object based on the voiceprint information and the fingerprint information; If the identity authentication of the target object is passed, device control information is obtained, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
14. The device control method according to claim 12, characterized in that: Also includes: In response to a selection operation of an authentication mode for the control device, determining a target authentication scenario as the multi-user authentication scenario; Collecting voiceprint information of a first target object and fingerprint information of a second target object in the multi-user authentication scenario; When the fingerprint information of the second target object is verified, device control information is generated based on the voiceprint information of the first target object, and the device control information is sent to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
15. A device information processing method, characterized in that: include: Displaying a display interface including a target application, wherein the target application is used to configure a control device associated with the target application; In response to the configuration operation of the target application on the display interface, the authentication preference data of the control device is configured, and the identification identity information is entered through the control device, so that in a target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, wherein the authentication preference data includes an authentication method and a device operation time after authentication, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method.
16. A device control device, characterized in that: The device comprises: A determination module, configured to determine a target authentication scenario in response to a selection operation of an authentication mode for the control device; A collection module, used to collect biometric information of a target object in the target authentication scenario; A verification module, used for performing identity verification on the target object based on the biometric information; The sending module is used to obtain device control information if the identity authentication of the target object is passed, and send the device control information to the target device associated with the control device, so that the target device performs corresponding actions based on the device control information.
17. A device information processing apparatus, characterized in that: include: A display module, used to display a display interface including a target application, wherein the target application is used to configure a control device associated therewith; A configuration module is used to configure the authentication preference data of the control device in response to the configuration operation of the target application on the display interface, and enter the identification identity information through the control device, so that in a target authentication scenario, the control device controls the target device associated with the control device to perform corresponding actions based on the authentication preference data and the identification identity information, wherein the authentication preference data includes an authentication method and a device operation time after authentication, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method.
18. A control device, characterized in that: include: A wireless transceiver module, used to communicate with an associated electronic device; the display interface of the electronic device includes a target application, the target application is used to configure the authentication preference data of the control device, the electronic device enters the identification information through the control device, the authentication preference data includes an authentication method and a device operation time after the authentication is completed, and the authentication method includes a voiceprint recognition method and / or a fingerprint recognition method; Adaptive learning algorithm module, used to update the biometric recognition model; Voiceprint recognition module, used to collect voiceprint information of the target object; Fingerprint recognition module, used to collect fingerprint information of the target object; An instruction code storage module, used for storing the identification information; A central microprocessor is electrically connected to the wireless transceiver module, the adaptive algorithm learning module, the voiceprint recognition module, the fingerprint recognition module and the instruction code storage module, and is used to determine a target authentication scenario in response to an authentication method selection operation, wherein the target authentication scenario is used to indicate the target object's control authority over the control device; collect biometric information of the target object under the target authentication scenario; authenticate the target object based on the biometric information; if the target object's identity is authenticated, obtain device control information, and send the device control information to a corresponding target device, so that the target device performs a corresponding action based on the device control information.
19. The control device according to claim 18, characterized in that The fingerprint recognition module includes: a touch control module and a touch interface module. The touch control module is electrically connected to the touch interface module to collect the fingerprint information of the target object through the touch interface module.
20. The control device according to claim 18, characterized in that Also includes: A display module and / or a playback module, wherein the display module and the playback module are electrically connected to the central microprocessor.
21. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the device control method according to any one of claims 1 to 14 are implemented and / or when the processor executes the computer program, the steps of the device information processing method according to claim 15 are implemented.
22. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by the processor, the steps of the device control method according to any one of claims 1 to 14 are implemented and / or when the processor executes the computer program, the steps of the device information processing method according to claim 15 are implemented.
23. A computer program product comprising a computer program, characterized in that When the computer program is executed by the processor, the steps of the device control method according to any one of claims 1 to 14 are implemented and / or when the processor executes the computer program, the steps of the device information processing method according to claim 15 are implemented.
Citation Information
Patent Citations
Control method and device of smart home system and smart home system
CN114488828A
Smart home voice control method and system based on full duplex voice interaction
CN116047929A
Cited By
Linkage method and device of electronic equipment, equipment, medium and program product
CN120897190A
Electronic device linkage method, apparatus, device, medium, and program product
CN120897190B
Environmental equipment control system and method, control panel, medium and product
CN121750395A
Device control method, and device
WO2026082133A1