Information processing method and device, electronic equipment and storage medium

Abstract

The invention discloses an information processing method and device, electronic equipment and a storage medium, and belongs to the technical field of information processing. The method comprises the steps of obtaining first identity information of a user in response to first input of the user, and receiving first voice information of the user under the condition of determining that the first identity information is obtained; when it is determined that the verification of the first identity information is passed, encrypting the parameter information of the first input to generate a first signature; under the condition of determining that the parameter information in the first signature passes verification, encrypting the parameter information and an execution instruction corresponding to the first voice information to obtain a second signature; and verifying the first signature and the second signature respectively, and executing the execution instruction when it is determined that the first signature and the second signature both pass verification.

Description

Technical Field

[0001] The present application belongs to the field of artificial intelligence technology, and specifically relates to an information processing method, device, electronic device and storage medium. Background Art

[0002] Artificial Intelligence Agent (AIAgent) is an intelligent agent that can perceive the environment, understand it autonomously, make decisions and execute actions. And with the rapid development of Large Language Model (LLM), AIAgent based on LLM has gradually appeared in the public's field of vision. It can use LLM to perform operations such as memory retrieval, decision reasoning and action sequence selection, and finally complete the tasks given by users.

[0003] When the existing terminals configured with the AIAgent architecture call the AIAgent, there is a problem that data is easily leaked, causing great damage to the user's privacy. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide an information processing method, device, electronic device and storage medium to protect the user's privacy data from being leaked.

[0005] In a first aspect, an embodiment of the present application provides an information processing method, the method comprising:

[0006] In response to a first input of a user, acquiring first identity information of the user, and receiving first voice information of the user when it is determined that the target control acquires the first identity information;

[0007] If it is determined that the verification of the first identity information passes, encrypting the first input parameter information to generate a first signature;

[0008] When it is determined that the parameter information in the first signature is verified, encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature;

[0009] The first signature, the parameter information, the execution instruction and the second signature are verified respectively, and when it is determined that the first signature, the parameter information, the execution instruction and the second signature are all verified, the execution instruction is executed.

[0010] In a second aspect, an embodiment of the present application provides an information processing method, the method comprising:

[0011] Responding to a first input of the user through the target control, obtaining the first identity information of the user, and receiving the first voice information of the user based on the voice collection device when it is determined that the first identity information is obtained,

[0012] When determining that the verification of the first identity information passes, the first execution environment encrypts the first input parameter information to generate a first signature;

[0013] Based on the virtual execution environment, when it is determined that the parameter information in the first signature is verified, encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature;

[0014] The first signature and the second signature are respectively verified based on the second execution environment, and when it is determined that both the first signature and the second signature are verified successfully, the execution instruction is executed.

[0015] In a third aspect, an embodiment of the present application provides an information processing device, the device comprising:

[0016] A first acquisition module, configured to acquire first identity information of the user in response to a first input of the user, and receive first voice information of the user if it is determined that the first identity information is acquired;

[0017] A first determination module is used to encrypt the first input parameter information and generate a first signature when it is determined that the verification of the first identity information passes;

[0018] A second determination module is used to encrypt the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature when it is determined that the parameter information in the first signature is verified.

[0019] An execution module is used to verify the first signature and the second signature respectively, and execute the execution instruction when it is determined that the first signature and the second signature are both verified.

[0020] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect and / or the second aspect are implemented.

[0021] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect and / or the second aspect are implemented.

[0022] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect and / or the second aspect are implemented.

[0023] In the seventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the first aspect and / or the second aspect.

[0024] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect and / or the second aspect.

[0025] In the embodiment of the present application, the first identity information of the user is obtained in response to the first input of the user, and then the first voice information of the user can be received only after the first identity information of the user is determined to be obtained, and then the first identity information of the user is verified, so as to ensure that the execution instruction of the first voice information is the voice information sent by the user in the real physical world, and ensure the security of the voice information data. In addition, when it is determined that the first identity information is verified, the parameter information of the first input is encrypted to obtain the first signature, and when it is determined that the parameter information in the first signature is verified, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain the second signature, and then the first signature and the second signature are verified respectively, and when it is determined that both the first signature and the second signature are verified, the execution instruction is executed, so that the parameter information of the first identity information and the first voice information is encrypted multiple times to prevent the encryption calculation result from being tampered with, and at the same time protect the user's personal privacy data. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a structural schematic diagram of an electronic device provided in the prior art;

[0027] Figure 2 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0028] Figure 3 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0029] Figure 4 is a flowchart of an information processing method provided by some embodiments of the present application;

[0030] Figure 5 is a flowchart of an information processing method provided by some embodiments of the present application;

[0031] Figure 6 It is a schematic diagram of a specific execution flow of the setting phase in the information processing method provided in some embodiments of the present application;

[0032] Figure 7 It is a schematic diagram of a specific execution flow in the execution phase of the information processing method provided in some embodiments of the present application;

[0033] Figure 8 is a schematic diagram of the structure of an electronic device shown in some embodiments of the present application;

[0034] Fig. 9 It is a schematic diagram of the hardware structure of an electronic device shown in some embodiments of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0036] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0037] Before introducing the technical solution of the embodiment of the present application, the background technology of the embodiment of the present application is first introduced:

[0038] refer to Figure 1 , Figure 1 It is a structural diagram of an electronic device in the prior art, in which an AIAgent architecture is configured. The AIAgent architecture runs in the REE of the electronic device. The AIAgent architecture may include: a hardware layer, a framework layer and an application layer, wherein the hardware layer may include a microphone, the framework layer may include an AIAgent module, the AIAgent module may include a speech recognition unit, an LLM unit, an execution center, a memory center and a decision center, and the application layer may include different application services.

[0039] The following is a detailed description of the above Figure 1 The functions of each module in the AIAgent architecture involved are:

[0040] Microphone: used to receive voice data input by the user.

[0041] Speech recognition unit: used to recognize the speech data input by the user, extract the features of the speech data, and convert the speech data into text information.

[0042] Memory center: collects and stores user information, such as the user's historical behavior information and the user's surrounding environment information.

[0043] LLM unit: used to complete task analysis and decomposition based on the text information obtained by the speech recognition unit and the user information stored in the memory center.

[0044] Decision-making center: Make corresponding decisions based on the analysis and decomposition of tasks given by the LLM unit.

[0045] Execution center: used to issue execution instructions based on the decisions output by the decision center.

[0046] Application layer: According to the execution instructions issued by the execution center, the corresponding application service is matched and the execution instructions are executed using the corresponding application service.

[0047] The following is a specific example to illustrate the above Figure 1 The operation process of the AIAgent architecture in the electronic device shown:

[0048] For example, if a user wants to order a takeaway, the user inputs voice data "Order a takeaway and want it to be eaten before 12 noon" through the microphone. The voice recognition unit receives the voice data "Order a takeaway and want it to be eaten before 12 noon" sent by the microphone, parses the voice data, and converts it into text information.

[0049] The memory center stores information such as takeaway stores around the user's location, the user's historical takeaway records, and the distances of each takeaway store from the user's location. The LLM unit analyzes the user's favorite food based on the text information and the user's information stored in the memory center, and then selects takeaway store A, takeaway store B, and takeaway store C that have the user's favorite food from the surrounding takeaway stores, and determines which of takeaway store A, takeaway store B, and takeaway store C can be found based on the distances of takeaway store A, takeaway store B, and takeaway store C from the user's location. The takeaway food will be delivered to the user's location before 12 noon, and the information analyzed by the LLM unit will be sent to the decision center. The decision center will make a specific decision: select takeaway store C, place an order using takeaway application D, and pay for the takeaway order using payment software E. The decision center will send the decision to the execution center, which will issue execution instructions to takeaway application D and payment software E respectively, so that the takeaway food ordered by the user can be placed through takeaway application D, and the takeaway order can be paid for using payment software E. The user's takeaway order request is now completed.

[0050] In the above example, the user only needs to input his or her voice data through the microphone without performing any other operations. The AIAgent architecture can complete the takeaway order based on the voice data input by the user.

[0051] In the above Figure 1 The AIAgent architecture of the electronic device shown has the following defects:

[0052] The microphone does not provide a high level of security protection, but because the microphone input voice data is a highly sensitive operation, the microphone output becomes a weak point in the AIAgent architecture. There is a possibility that the microphone output results can be tampered with, thereby executing actions that are not authorized by the owner.

[0053] The entire AIAgent architecture runs on the REE side, so any tampering in any link may lead to the execution of non-user-instructed behavior. At the same time, the memory center stores a large amount of data related to the user's personal behavior. If the data is leaked, it will cause great damage to the user's privacy.

[0054] Therefore, when the electronic device configured with the AIAgent architecture in the prior art calls the AIAgent service, there is a problem that data is easily leaked, causing great damage to the user's privacy. In order to solve the above problem, the embodiment of the present application provides an information processing method, device, electronic device and storage medium, which obtains the user's first identity information in response to the user's first input, and then can receive the user's first voice information only after determining that the user's first identity information is obtained, and then the user's first identity information is verified, ensuring that the execution instruction of the first voice information is the voice information sent by the user in the real physical world, ensuring the security of the voice information data. In addition, when it is determined that the first identity information is verified, the parameter information of the first input is encrypted to obtain a first signature. When it is determined that the parameter information in the first signature is verified, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain a second signature, and then the first signature and the second signature are verified respectively. When it is determined that both the first signature and the second signature are verified, the execution instruction is executed, so that the first identity information and the parameter information of the first voice information are multiple encrypted to prevent the encryption calculation result from being tampered with, and at the same time protect the user's personal privacy data.

[0055] The electronic device is provided with a first execution environment, a virtual execution environment and a second execution environment, and the electronic device includes: a target control and a microphone. The electronic device provided in the embodiment of the present application can receive the user's first voice information only after the user presses the target control, and then verify the user's first identity information, ensuring that the execution instruction of the first voice information in the second execution environment is the voice information sent by the user in the real physical world, ensuring the security of the voice information data, and the microphone in the embodiment of the present application is an AIAgent-specific microphone, avoiding the risk of the voice information received by the traditional microphone being easily tampered with. In addition, in addition to the traditional REE, a first execution environment and a virtual execution environment are constructed, and the encryption of the execution instructions corresponding to the first identity information and the first voice information is completed in the first execution environment and the virtual execution environment respectively. The traditional second execution environment only verifies the execution instructions corresponding to the encrypted first identity information and the first voice information, and executes the execution instructions when the execution instructions corresponding to the encrypted first identity information and the first voice information are verified. In this way, the encryption work is isolated from the second execution environment of the electronic device, avoiding the encryption calculation results from being tampered with, and protecting the user's personal privacy data.

[0056] The technical solution of the embodiments of the present application can be applied to scenarios where a user uses voice commands to instruct an electronic device to perform a series of operations, for example, it can be applied to scenarios such as ordering takeout, sending red envelopes, and taking a taxi.

[0057] Before introducing the information processing method of the embodiment of the present application, an electronic device for implementing the information processing method of the embodiment of the present application is first introduced.

[0058] Figure 2 It is a structural schematic diagram of an electronic device provided in an application embodiment. The electronic device may be, but is not limited to, a personal computer (PC), a smart phone, a tablet computer or a personal digital assistant (PDA).

[0059] like Figure 2 As shown, the electronic device is provided with a first execution environment 210 , a virtual execution environment 220 and a second execution environment 230 , and the electronic device may include: a target control 240 and a microphone 250 .

[0060] It should be noted that the first execution environment 210 here can be an execution environment different from the second execution environment 230, and the first execution environment 210 is more trusted than the second execution environment 230. For example, when the second execution environment 230 is a rich execution environment (REE), the first execution environment 210 can be a trusted execution environment (TEE).

[0061] The virtual execution environment 220 may be a virtual execution environment created in an electronic device, such as an artificial intelligence agent virtual memory (AI Agent VM).

[0062] In the following implementation of the present application, the first execution environment 210 is TEE, the second execution environment is REE, and the virtual execution environment is AIAgentVM as an example for explanation.

[0063] refer to Figure 2 and Figure 1 ,compared to Figure 1 The electronic equipment shown, Figure 2 The AIAgent architecture in has the following changes:

[0064] At the hardware level, a target control 240 and a microphone 250 are introduced. The target control 240 here can be a control for collecting the user's first identity information. For example, when the first identity information is fingerprint information, the target control 240 here can be a fingerprint button. When the first identity information is facial feature information, the target control 240 here can be an image acquisition device. When the first identity information is iris information, the target control 240 here can be an iris acquisition control. The specific form of the target control 240 can be determined according to the form of the first identity information, which is not limited in the embodiments of the present application.

[0065] In one example, reference Figure 3 , Figure 3 Schematic diagram of the structure of an electronic device. Taking the first identity information as fingerprint information as an example, the electronic device includes a target control 240 and a microphone 250. Figure 3 In the example, the target control 240 may be a fingerprint button.

[0066] At the framework level, the first execution environment 210 and the virtual execution environment 220 are introduced. In addition to the execution center being in the second execution environment 230, Figure 1 The other units in the middle framework layer are all in the virtual execution environment 220. The specific functions of the first execution environment 210 and the virtual execution environment 20 are described in detail in the following embodiments.

[0067] The following is a detailed introduction Figure 2 The functions of each functional module of AIAgent in the electronic device shown are:

[0068] The target control 240 is used to obtain the first identity information of the user in response to the first input of the user;

[0069] Microphone 250, used to receive the first voice information of the user when it is determined that the target control obtains the first identity information;

[0070] TEE 210, connected to target control 240, is used to encrypt the first input parameter information, generate a first signature, and send the first signature to virtual execution environment 220 when it is determined that the verification of the first identity information passes;

[0071] The virtual execution environment 220 is connected to the first execution environment 210 and the microphone 250, respectively, and is used to encrypt the parameter information and the execution instruction corresponding to the first voice information to obtain the second signature when it is determined that the parameter information in the first signature is verified, and send the parameter information, the execution instruction, the first signature and the second signature to the second execution environment 230;

[0072] The second execution environment 230 is connected to the virtual execution environment 220, and is used to verify the first signature, parameter information, execution instruction and second signature respectively, and execute the execution instruction when it is determined that the first signature, parameter information, execution instruction and second signature are all verified.

[0073] Among them, the first input is an input to the target control, and the above-mentioned first input is used to obtain the first identity information of the user, and the first input can be a first operation. Exemplarily, the above-mentioned first input includes but is not limited to: the user's touch input to the target control through a touch device such as a finger or a stylus, or a face image input by the user, or iris information input by the user, or other feasible input, which can be determined according to actual use requirements, and can be determined according to actual use requirements, and the embodiments of the present invention are not limited. For example, the above-mentioned first input can be: the user's long press input to the target control.

[0074] The first identity information may be information used to characterize the identity of the user, such as, but not limited to, the user's fingerprint, facial features, and iris information.

[0075] The first voice information may be voice information input by a user.

[0076] The parameter information of the first input may be a parameter related to the first input, such as the timestamp information of the first input, and a random number randomly generated when the user executes the first input.

[0077] The first signature may be a signature generated after encrypting the first input parameter information. The specific generation process of the first signature will be described in detail in the following embodiments.

[0078] The execution instruction corresponding to the first voice information may be an instruction to execute the first voice information. Taking the above example of ordering takeout, the execution instruction may be selecting a takeout store C, placing an order using a takeout application D, and paying for the takeout order using a payment software E.

[0079] The second signature may be a signature generated after encrypting the parameter information and the execution instruction corresponding to the first voice information. The specific generation process of the first signature will be described in detail in the following embodiments.

[0080] The electronic device provided in the embodiment of the present application can receive the user's first voice information with a microphone only after the user presses the target control, and then verify the user's first identity information, ensuring that the execution instruction of the first voice information of the REE is the voice information sent by the user in the real physical world, ensuring the security of the voice information data, and the microphone in the embodiment of the present application is an AIAgent-specific microphone, avoiding the risk of the voice information received by the traditional microphone being easily tampered with. In addition, in addition to the traditional REE, TEE and AIAgentVM are constructed, and the encryption of the execution instructions corresponding to the first identity information and the first voice information is completed in TEE and AIAgentVM respectively. The traditional REE only verifies the execution instructions corresponding to the encrypted first identity information and the first voice information, and executes the execution instructions when the execution instructions corresponding to the encrypted first identity information and the first voice information are verified. In this way, the encryption work is isolated from the REE of the electronic device, avoiding the tampering of the encryption calculation results, and protecting the user's personal privacy data.

[0081] Based on the above Figure 2 The present application also provides an information processing method, which is applied to the electronic device shown in the figure. Figure 2 Electronic equipment shown.

[0082] The information processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0083] Figure 4 is a flowchart of an information processing method provided by an embodiment of the present application, such as Figure 4 As shown, the information processing method provided in the embodiment of the present application may include steps 410 to 440.

[0084] Step 410: In response to a first input from a user, first identity information of the user is obtained, and when it is determined that the first identity information is obtained, first voice information of the user is received.

[0085] Step 420: When it is determined that the verification of the first identity information passes, encrypt the first input parameter information to generate a first signature.

[0086] Step 430: When it is determined that the parameter information in the first signature has been verified, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain a second signature.

[0087] Step 440: Verify the first signature and the second signature respectively. If it is determined that both the first signature and the second signature have been verified, execute the execution instruction.

[0088] In the embodiment of the present application, the first identity information of the user is obtained in response to the first input of the user, and then the first voice information of the user can be received only after the first identity information of the user is determined to be obtained, and then the first identity information of the user is verified, so as to ensure that the execution instruction of the first voice information is the voice information sent by the user in the real physical world, and ensure the security of the voice information data. In addition, when it is determined that the first identity information is verified, the parameter information of the first input is encrypted to obtain the first signature, and when it is determined that the parameter information in the first signature is verified, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain the second signature, and then the first signature and the second signature are verified respectively, and when it is determined that both the first signature and the second signature are verified, the execution instruction is executed, so that the parameter information of the first identity information and the first voice information is encrypted multiple times to prevent the encryption calculation result from being tampered with, and at the same time protect the user's personal privacy data.

[0089] Figure 5 is a flowchart of an information processing method provided by an embodiment of the present application, such as Figure 5 As shown, the information processing method provided in the embodiment of the present application may include steps 510 to 540.

[0090] Step 510: Acquire the first identity information of the user in response to the first input of the user through the target control, and receive the first voice information of the user based on the microphone when it is determined that the target control acquires the first identity information.

[0091] In some embodiments of the present application, the user's first identity information can be obtained by the target control in response to the user's first input, and then the microphone will be activated only when it is determined that the target control has obtained the first identity information, so that the user's first voice information can be received based on the microphone.

[0092] Step 520: When the first execution environment determines that the verification of the first identity information is passed, the first input parameter information is encrypting, a first signature is generated, and the first signature is sent to the virtual execution environment.

[0093] In some embodiments of the present application, after the target control obtains the user's first identity information, the first identity information can be sent to a first execution environment, such as TEE. TEE can verify the first identity information. When TEE determines that the first identity information is verified, TEE encrypts the first input parameter information, generates a first signature, and sends the first signature to a virtual execution environment, such as AIAgentVM.

[0094] Step 530: When the parameter information in the first signature is verified through the virtual execution environment, the parameter information and the execution instruction corresponding to the first voice information are encrypting to obtain a second signature, and the first signature and the second signature are sent to the second execution environment.

[0095] In some embodiments of the present application, after the parameter information is encrypted in step 520, if the user's first input is needed to ensure the security of the user's identity information, the parameter information needs to be decrypted, that is, the parameter information needs to be verified. When it is determined that the parameter information in the first signature has been verified, the first voice information needs to be encrypted, that is, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain a second signature, and then the first signature and the second signature can be sent to a second execution environment, such as REE.

[0096] Step 540: Verify the first signature and the second signature respectively through the second execution environment, and execute the execution instruction when it is determined that both the first signature and the second signature have been verified.

[0097] In some embodiments of the present application, the first signature and the second signature may be verified respectively through REE, and when it is determined that both the first signature and the second signature have been verified, the execution instruction may be executed.

[0098] In the embodiment of the present application, the target control responds to the user's first input to obtain the user's first identity information, and then after determining that the user's first identity information is obtained, the microphone can receive the user's first voice information, and then the user's first identity information is verified based on the first execution environment, ensuring that the execution instruction of the first voice information is the voice information sent by the user in the real physical world, ensuring the security of the voice information data. And the microphone in the embodiment of the present application is an AI Agent exclusive microphone, so the first voice information received by the microphone of the embodiment of the present application is more secure, avoiding the risk of easy tampering of the voice information received by the traditional microphone. In addition, the encryption of the execution instructions corresponding to the first identity information and the first voice information is completed in the first execution environment and the virtual execution environment respectively, and the traditional second execution environment only verifies the execution instructions corresponding to the encrypted first identity information and the first voice information, and executes the execution instructions when the execution instructions corresponding to the encrypted first identity information and the first voice information are verified, so that the encryption work is isolated from the second execution environment of the electronic device, avoiding the tampering of the encryption calculation results, and protecting the user's personal privacy data.

[0099] In some embodiments of the present application, in order to ensure the accuracy of instruction execution, before step 410 of the above embodiment, it is necessary to first set and save the user's identity information so as to verify the user's first identity information, that is, before step 410, the above method may further include:

[0100] In response to a second input from the user, obtaining second identity information of the user;

[0101] Before step 420, the above method may further include:

[0102] The first identity information is compared with the second identity information, and when it is determined that the first identity information is consistent with the second identity information, it is determined that the verification of the first identity information has passed.

[0103] Among them, the second input is an input to the target control, and the second input is used to obtain the second identity information of the user, and the second input can be a second operation. Exemplarily, the second input includes but is not limited to: the user's touch input to the target control through a touch device such as a finger or a stylus, or a face image input by the user, or iris information input by the user, or other feasible input, which can be determined according to actual use requirements, and can be determined according to actual use requirements, and the embodiment of the present invention does not limit it. For example, the second input can be: the user's long press input to the target control.

[0104] The second identity information may be information used to characterize the identity of the user, such as but not limited to the user's fingerprint, facial features, or iris information. Specifically, the second identity information is the same as the first identity information, that is, if the first identity information is fingerprint information, then the second identity information is also fingerprint information; if the first identity information is iris information, then the second identity information is also iris information.

[0105] In some embodiments of the present application, the user's second identity information can be obtained in advance through the target control in response to the user's second input, and then when the TEE can verify the first identity information, the first identity information can be compared with the second identity information through the TEE. When it is determined that the first identity information is consistent with the second identity information, it is determined that the verification of the first identity information has passed.

[0106] In an embodiment of the present application, the user's second identity information is obtained by responding to the user's second input in advance. When the first identity information is subsequently verified, the first identity information can be compared with the second identity information. When it is determined that the first identity information and the second identity information are consistent, it is determined that the verification of the first identity information has passed. In this way, before executing the execution instruction corresponding to the first voice information through the scheme of the embodiment of the present application, the user's identity information is first verified. The execution instruction corresponding to the first voice information can be executed only if the verification passes, thereby improving the accuracy of the execution of the execution instruction.

[0107] In some embodiments of the present application, in order to improve the security of user data, the first input parameter information is encrypted in step 420, and generating the first signature may specifically include:

[0108] Performing hash calculation on the timestamp information and the random number to obtain a first hash value;

[0109] The first hash value is encrypted using a first private key corresponding to the first identity information to generate a first signature.

[0110] The first hash value may be a hash value obtained by performing a hash calculation on the timestamp information and the random number.

[0111] The first private key may be a private key used to represent user identity information.

[0112] In some embodiments of the present application, the parameter information corresponding to the first input may include: timestamp information Time of the first input, and a random number Nonce generated by a random function when the user executes the first input.

[0113] In some embodiments of the present application, the timestamp information and the random number can be first encrypted using a hash algorithm to obtain a first hash value Hash(Time||Nonce), and then the first hash value Hash(Time||Nonce) can be encrypted using the first private key finger_pri corresponding to the first identity information to generate a first signature. When the first hash value Hash(Time||Nonce) is encrypted using the first private key finger_pri, the encryption algorithm used can be but is not limited to the Sign encryption algorithm, the RSA encryption algorithm, and the ECDSA encryption algorithm.

[0114] In an example, taking the encryption algorithm as Sign encryption algorithm as an example, the first hash value Hash(Time||Nonce) is encrypted using the first private key finger_pri corresponding to the first identity information to generate a first signature Sign_finger=Sign(pri_finger, Hash(Time||Nonce)).

[0115] It should be noted that the encryption algorithms used in the following encryption processes in the embodiments of the present application are all described using the Sign encryption algorithm as an example.

[0116] In an embodiment of the present application, a first hash value is obtained by performing a hash calculation on the timestamp information and the random number, and then the first hash value is encrypted using the first private key corresponding to the first identity information to generate a first signature. In this way, the parameter information corresponding to the user's first input can be encrypted to ensure the security of the first input, thereby protecting the user's identity information and improving the security of user data.

[0117] In some embodiments of the present application, in order to ensure the accuracy of subsequent execution of instructions, the parameter information may be decrypted in the following manner, that is, before step 430, the above method may further include:

[0118] Verifying the parameter information in the first signature using the first public key corresponding to the first identity information in the first certificate;

[0119] Step 450 may specifically include:

[0120] When it is determined that the parameter information verification passes, the first certificate, the first signature, and the second signature are verified respectively. When it is determined that the first certificate, the first signature, and the second signature are all verified, the execution instruction is executed.

[0121] The first certificate may be generated by TEE and sent to the AI ​​Agent VM before executing step 410. The specific generation process of the first certificate will be described in detail in subsequent embodiments.

[0122] The first public key may be a public key used to represent user identity information.

[0123] In some embodiments of the present application, when decrypting the parameter information, the first public key finger_pub corresponding to the first identity information in the first certificate Cert_voice may be used to verify the parameter information in the first signature to obtain the decrypted parameter information Hash(Time||Nonce)=Verify(finger_pub,Sign_finger). Here, Verify is the decryption algorithm corresponding to the encryption algorithm Sign.

[0124] It should be noted that verifying the parameter information in the first signature by using the first public key corresponding to the first identity information in the first certificate may be performed in the AIAgentVM.

[0125] Then, when AIAgentVM determines that the parameter information verification is passed, the first certificate, the first signature and the second signature are sent to REE, and the corresponding REE verifies the first certificate, the first signature and the second signature respectively, and executes the execution instruction when it is determined that the first certificate, the first signature and the second signature are all verified.

[0126] In an embodiment of the present application, the parameter information in the first signature is verified by using the first public key corresponding to the first identity information in the first certificate, and then when it is determined that the parameter information verification has passed, the first certificate, the first signature and the second signature are verified respectively. When it is determined that the first certificate, the first signature and the second signature have all passed the verification, the execution instruction is executed. In this way, the accuracy of the user's identity information can be verified, ensuring that the execution instructions subsequently executed are from the correct user, and ensuring the accuracy of the execution of the subsequent execution instructions.

[0127] In some embodiments of the present application, before encrypting the parameter information and the execution instruction corresponding to the first voice information, it is first necessary to determine the execution instruction corresponding to the first voice information. Therefore, before encrypting the parameter information and the execution instruction corresponding to the first voice information, the above method may also include:

[0128] Converting the first voice information into text to obtain text information corresponding to the first voice information;

[0129] Based on the text information and environmental perception information, execution instructions are obtained.

[0130] The environmental perception information may be pre-stored environmental information of the user's location, and specifically may be pre-stored environmental information of the user's location in the memory center of the AI ​​Agent VM.

[0131] In some embodiments of the present application, after obtaining the first voice information, it is necessary to use the AIAgent VM to convert the first voice information into text information, and then obtain the execution instruction according to the text information and the environmental perception information. The specific method of obtaining the execution instruction according to the text information and the environmental perception information can refer to the above Figure 1 The method of determining the execution instructions in the execution process of the AIAgent architecture will not be repeated here.

[0132] In an embodiment of the present application, by performing text conversion on the first voice information, text information corresponding to the first voice information is obtained, and then based on the text information and environmental perception information, an execution instruction is obtained, so that the execution instruction corresponding to the first voice information can be accurately obtained.

[0133] In some embodiments of the present application, before converting the first voice information into text, it is necessary to verify the first voice information of the user to determine whether the first voice information is sent by the user, so as to ensure that the execution instruction executed subsequently is what the user wants to execute. Therefore, before converting the first voice information into text, the above method may further include:

[0134] Extracting features from the first voice information to obtain feature information corresponding to the first voice information;

[0135] Comparing the characteristic information with the preset characteristic information;

[0136] The converting the first voice information into text may specifically include:

[0137] When it is determined that the characteristic information is consistent with the preset characteristic information, the first voice information is converted into text.

[0138] The feature information corresponding to the first voice information may be a voice feature of the user, such as the voiceprint information of the user.

[0139] The preset characteristic information may be pre-stored voice characteristic information of the user.

[0140] In some embodiments of the present application, after obtaining the first voice information, it is necessary to perform feature extraction on the first voice information to obtain feature information corresponding to the first voice information, and then compare the feature information with the pre-stored user's preset features. If the comparison is consistent, the first voice information is converted into text information. Specifically, the first voice information can be feature extracted through AIAgentVM to obtain feature information corresponding to the first voice information, and then compare the feature information with the pre-stored user's preset features. If the comparison is consistent, the first voice information is converted into text information.

[0141] It should be noted that the preset feature information may be pre-stored in TEE. When the AIAgentVM needs to compare the feature information corresponding to the first voice information with the preset feature information, the AIAgent VM may obtain the preset feature information from the TEE, and then compare the feature information corresponding to the first voice information with the preset feature information.

[0142] In an embodiment of the present application, feature extraction is performed on the first voice information to obtain feature information corresponding to the first voice information, and then the feature information is compared with the pre-stored preset features of the user. If the comparison is consistent, the first voice information is converted into text information. This ensures that the first voice information is issued by the user, and further ensures that the subsequent execution instructions are what the user wants to execute, thereby improving the accuracy of the execution of the execution instructions.

[0143] In some embodiments of the present application, before comparing the feature information corresponding to the first voice information with the preset feature information, it is first necessary to configure the user's voice feature information in the configuration stage. Therefore, before comparing the feature information with the preset feature information, the above method may also include:

[0144] receiving a second voice message from a user;

[0145] Feature extraction is performed on the second voice information to obtain preset feature information.

[0146] The second voice information may be voice information input by the user before the first voice information.

[0147] In some embodiments of the present application, the user's second voice information can be acquired in advance through a microphone, and then the second voice information is subjected to feature extraction through the AIAgentVM to obtain preset feature information, and then the preset feature information is stored in the AIAgentVM.

[0148] In some embodiments of the present application, after obtaining the preset feature information, the AIAgentVM may also store the preset feature information in the TTE. Whether the specific preset feature information is pre-stored in the AIAgent VM or in the TEE can be selected according to user needs and is not limited in the embodiments of the present application.

[0149] In an embodiment of the present application, the user's second voice information is received in advance, and then features are extracted from the second voice information to obtain preset feature information. This facilitates the subsequent verification of the user's first voice information based on the preset feature information, ensuring that the executed execution instruction is based on that issued by the user, thereby ensuring the accuracy of the execution of the execution instruction.

[0150] In some embodiments of the present application, during the setting stage, the first certificate may be generated by the first private key and the first public key corresponding to the second identity information of the user, and the public key and the private key corresponding to the electronic device. The generation process of the first certificate is described in detail below:

[0151] After obtaining the second identity information of the user, the above method may further include:

[0152] Based on the second identity information, generate a first private key and a first public key;

[0153] Encrypting the first public key based on a third private key of the electronic device to generate a third signature;

[0154] generating a third certificate based on the third signature and the second certificate;

[0155] The first private key signs the third public key to generate a fourth signature, and a first certificate is generated based on the fourth signature and the third certificate.

[0156] The third private key may be a device private key of the electronic device.

[0157] In some embodiments of the present application, when electronic equipment is produced, the electronic equipment manufacturer itself is required to have the ability to sign a certification authority (CA) certificate, that is, the electronic equipment manufacturer has a public key and private key pair {CA_pri, CA_pub} signed by the CA certificate, and the public key and private key pair {CA_pri, CA_pub} can be stored in the TEE.

[0158] When an electronic device leaves the factory, a public-private key pair {device_pri, device_pub} of the device needs to be generated on the TEE side of the electronic device, that is, the third private key mentioned above is device_pri.

[0159] The third signature may be a signature generated by encrypting the first public key based on a third private key of the electronic device.

[0160] The second certificate can be generated by TEE signing the fourth public key of the electronic device based on the fourth private key of the CA certificate. The above-mentioned fourth public key can be the device public key of the electronic device, that is, the fourth public key is device_pub. The fourth private key can be the private key of the CA certificate, that is, the fourth private key is CA_pri.

[0161] In some embodiments of the present application, the device public key device_pub is signed using the CA private key CA_pri to obtain the signature Sign_device=Sign(CA_pri, device_pub), and then the second certificate Cert_device can be generated according to the signature Sign_device.

[0162] The third certificate may be a certificate generated based on the third signature and the second certificate.

[0163] The third public key may be generated by the AIAgentVM based on preset feature information. In some embodiments of the present application, after the user inputs the second voice information, the AIAgentVM may randomly generate a public-private key pair {voice_pri, voice_pub} based on the feature information corresponding to the second voice information, and then store the public-private key pair {voice_pri, voice_pub} in the TEE for storage, where the third public key is voice_pub.

[0164] The fourth signature may be a signature generated by TEE by signing the third public key based on the first private key.

[0165] In some embodiments of the present application, after the user enters the second identity information, the TEE may generate a public-private key pair {finger_pri, finger_pub} that matches the user's identity information based on the second identity information, and then encrypt the first public key finger_pub based on the third private key device_pri of the electronic device through the TEE to generate a third signature Sign_finger=Sign(device_pri, finger_pub), and then generate a third certificate Cert_finger based on the third signature Sign_finger and the second certificate Cert_device through the TEE, and then the TEE signs the third public key voice_pub based on the first private key finger_pri to generate a fourth signature Sign_voice=Sign(finger_pri, voice_pub), and generates a first certificate Cert_voice based on the fourth signature Sign_voice=Sign(finger_pri, voice_pub) and the third certificate Cert_finger, and sends the first certificate Cert_voice to the AIAgentVM.

[0166] In an embodiment of the present application, a first private key and a first public key are generated based on the second identity information, the first public key is encrypted based on the third private key of the electronic device, a third signature is generated, a third certificate is generated based on the third signature and the second certificate, the third public key is signed based on the first private key, a fourth signature is generated, and the first certificate is generated based on the fourth signature and the third certificate, so that the first certificate can be accurately obtained.

[0167] In some embodiments of the present application, in order to ensure the security of the parameter information and the execution instruction, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain the second signature, which may specifically include:

[0168] Performing a hash calculation on the parameter information and the execution instruction corresponding to the first voice information to obtain a second hash value;

[0169] The second hash value is encrypted using a second private key corresponding to the first voice information to obtain a second signature.

[0170] The second hash value may be a hash value obtained by performing a hash calculation on the parameter information and the execution instruction corresponding to the first voice information.

[0171] The second private key may be the private key corresponding to the first voice information. Since the feature information of the user's first voice information and the second voice information is the same, the private keys are also the same. Therefore, the private key of the first voice information is the private key of the second voice information, that is, the second private key is voice_pri.

[0172] In some embodiments of the present application, a second hash value Hash(Time||Nonce||InstructionN) can be obtained by performing a hash calculation on the parameter information and the execution instruction corresponding to the first voice information, and then the second hash value Hash(Time||Nonce||InstructionN) is encrypted using a second private key corresponding to the first voice information to obtain a second signature Sign_exe=Sign(voice_pri, Hash(Time||Nonce||InstructionN)).

[0173] In an embodiment of the present application, a hash calculation is performed on the parameter information and the execution instruction corresponding to the first voice information to obtain a second hash value, and the second hash value is encrypted using a second private key corresponding to the first voice information to obtain a second signature. This ensures the security of the parameter information and the execution instruction and prevents the parameter information and the execution instruction from being tampered with.

[0174] In some embodiments of the present application, in order to ensure the security of the first voice information, before step 440, the above method may further include:

[0175] Determine the time difference between the current timestamp information and the timestamp information;

[0176] The verifying of the first signature and the second signature respectively may specifically include:

[0177] When it is determined that the time difference information is less than a preset time difference threshold, the first signature and the second signature are verified respectively.

[0178] The current timestamp information may be current time information.

[0179] The time difference information may be the difference between the current timestamp information and the timestamp information.

[0180] The preset time threshold may be a threshold of the preset time difference information. The value of the preset time threshold may be set according to user needs and is not limited in the embodiments of the present application.

[0181] In some embodiments of the present application, after REE obtains the second signature, REE is first used to determine the time difference information between the current timestamp information and the first input timestamp information. If the time difference information is less than a preset time threshold, that is, the time difference information is within a certain range, REE is used to verify the first signature, parameter information, execution instructions, and the second signature respectively. If the time difference information is less than the preset time threshold, the process is terminated. This is because after a user generally inputs voice information, it will not take a long time to process the voice information. If the voice information is processed after a long time, the voice information may be maliciously tampered with in the middle.

[0182] In an embodiment of the present application, the time difference information between the current timestamp information and the timestamp information is determined. When it is determined that the time difference information is less than a preset time difference threshold, the first signature and the second signature are verified respectively. In this way, the first signature and the second signature are verified respectively only when the time difference information between the current timestamp information and the timestamp information is within a certain time difference range. In this way, the first voice information is prevented from being maliciously tampered with during the processing process, thereby ensuring the security of the first voice information.

[0183] In some embodiments of the present application, in order to ensure the security of user information, step 440 may specifically include:

[0184] Verify the first certificate using the second public key of the CA certificate;

[0185] When it is determined that the first certificate is verified successfully, obtaining the first public key in the first certificate and the third public key corresponding to the first voice information;

[0186] Verifying the first signature using the first public key;

[0187] When it is determined that the first signature verification passes, verifying the second signature using the third public key;

[0188] If it is determined that the second signature verification passes, the execution instruction is executed.

[0189] The second public key may be the public key of the CA certificate, that is, CA_pub.

[0190] The third public key may be a public key corresponding to the first voice information. Since the first voice information and the second voice information are both voice information of the user, the third public key is the above-mentioned voice_pub.

[0191] In some embodiments of the present application, the first certificate is verified by REE using the second public key of the CA certificate. When it is determined that the first certificate verification succeeds, the first public key finger_pub in the first certificate and the third public key voice_pub corresponding to the first voice information are obtained, and then the first signature Sign_finger is verified using the first public key finger_pub Hash(Time||Nonce)=Verify(pub_finger, Sign_finger). When it is determined that the first signature verification succeeds, the second signature is verified using the third public key voice_pub. Specifically, the parameter information and execution instructions in the second signature are first hash-encrypted, and then the hash-encrypted parameter information and execution instructions are verified, that is, Verify(voice_pub, Hash(Time||Nonce||InstructionN)). When it is determined that the second signature verification succeeds, the execution instruction is executed.

[0192] In an embodiment of the present application, the first certificate is verified by using the second public key of the CA certificate. When it is determined that the first certificate verification is successful, the first public key in the first certificate and the third public key corresponding to the first voice information are obtained, and then the first signature is verified by using the first public key. When it is determined that the first signature verification is successful, the second signature is verified by using the third public key. When it is determined that the second signature verification is successful, the execution instruction is executed. In this way, it is ensured that the encrypted first signature and the second signature can be decrypted by their respective public keys, thereby ensuring the security of the first signature and the second signature, and then ensuring the security of user information.

[0193] It should be noted that the above information processing method is divided into a setting stage and an execution stage. In the setting stage, the user's identity information and voice information are set, and then in the execution stage, the user's identity information is verified. After the identity information verification is passed, the user's voice information is obtained, and then the voice information is matched with the voice information in the setting stage. If the match is successful, it means that the voice information in the execution stage belongs to the user himself, and then the AIAgent can be called to encrypt and verify the user's identity information and voice information to ensure the accuracy of the execution instructions obtained based on the user's voice information.

[0194] In order to facilitate understanding of the information processing method of the embodiment of the present application, refer to Figure 6 and Figure 7 , the following describes in detail the processing process of the setup phase and the execution phase for specific scenarios, among which, Figure 6 It is a schematic diagram of the specific execution flow of the setting stage in the information processing method. Figure 7 It is a schematic diagram of a specific execution flow of the execution phase in the information processing method.

[0195] 1. Setup phase:

[0196] 1. The target control obtains the second identity information.

[0197] 2. The target control sends the second identity information to TEE.

[0198] 3. TEE reads the second identity information and stores the second identity information.

[0199] 4. TEE generates a public and private key pair corresponding to the second identity information.

[0200] In step 4, the public-private key pair corresponding to the identity information is the first private key and the first public key in the above embodiment.

[0201] 5. TEE generates the third signature.

[0202] In step 5, the specific process of TEE generating the third signature can refer to the generation method of the third signature in the above embodiment, which will not be repeated here.

[0203] 6. Obtain the user's second voice information through the microphone.

[0204] 7. The microphone sends the second voice information to the AI ​​Service VM.

[0205] 8. The AI ​​Service VM extracts features from the second voice information to obtain preset feature information.

[0206] 9. The AI ​​Service VM generates a public-private key pair corresponding to the second voice information based on the preset feature information.

[0207] In step 9, the public-private key pair corresponding to the second voice information is the second private key and the third public key in the above embodiment.

[0208] 10. The AI ​​Service VM transmits the public key corresponding to the second voice information to TEE.

[0209] 11. TEE generates a first certificate based on the public key corresponding to the second voice information.

[0210] In step 11, the specific process of TEE generating the first certificate according to the public key corresponding to the second voice information can refer to the process of generating the first certificate according to the third public key in the above embodiment, which will not be repeated here.

[0211] 12. TEE sends the first certificate to the AI ​​Service VM.

[0212] 2. Implementation phase:

[0213] 1. Obtain the first identity information through the target control.

[0214] 2. The target control sends the first identity information to TEE.

[0215] 3. TEE verifies the first identity information.

[0216] In step 3, TEE verifies the first identity information, which is the process of comparing the first identity information with the second identity information in the above embodiment, and the details are not repeated here.

[0217] 4. TEE generates the first signature.

[0218] In step 4, the specific process of TEE generating the first signature can refer to the process of TEE generating the first signature in the above embodiment, which will not be repeated here.

[0219] 5. TEE sends the parameter information and the first signature to the AI ​​Service VM.

[0220] 6. The AI ​​Service VM verifies the parameter information in the first signature.

[0221] In step 6, the specific process of the AI ​​Service VM verifying the parameter information in the first signature can refer to the process of the AI ​​Service VM verifying the parameter information in the first signature in the above embodiment, which will not be repeated here.

[0222] 7. Obtain the user's first voice information through the microphone.

[0223] 8. The microphone sends the first voice message to the AI ​​Service VM.

[0224] 9. The AI ​​Service VM extracts features of the first voice information and verifies the first voice information.

[0225] In step 9, the first voice information is verified, which is the process of comparing the feature information corresponding to the first voice information with the preset feature information in the above embodiment, which will not be described in detail here.

[0226] 10. The AI ​​Service VM converts the first voice information to obtain text information of the first voice information.

[0227] 11. AI ServiceVM calculates and executes instructions.

[0228] In step 11, the specific process of AI ServiceVM calculating the execution instruction can refer to the method of determining the execution instruction in the above embodiment, which will not be repeated here.

[0229] 12. AI Service VM generates a second signature.

[0230] In step 12, the specific process of the AI ​​ServiceVM generating the second signature can refer to the method of generating the second signature in the above embodiment, which will not be repeated here.

[0231] 13. The AI ​​Service VM sends the first signature, the first certificate, and the second signature to REE.

[0232] 14. REE verifies the first signature, the first certificate, and the second signature.

[0233] In step 14, the specific process of REE verifying the first signature, the first certificate and the second signature can refer to the verification process of REE verifying the first signature, the first certificate and the second signature in the above embodiment, which will not be repeated here.

[0234] 15. REE executes the corresponding execution instruction.

[0235] In step 15, when it is determined that the REE has successfully verified the first signature, the first certificate, and the second signature, the execution instruction may be executed.

[0236] The information processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmentedreality, AR) / virtual reality (virtualreality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personalcomputer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personalcomputer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0237] The information processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0238] The information processing device provided in the embodiment of the present application can realize Figure 4 and / or Figure 5 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0239] Alternatively, if Figure 8 As shown, an embodiment of the present application also provides an electronic device 800, including a processor 801 and a memory 802, wherein the memory 802 stores programs or instructions that can be executed on the processor 801, and when the program or instructions are executed by the processor 801, the various steps of the above-mentioned information processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0240] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0241] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0242] The electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.

[0243] Those skilled in the art will appreciate that the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0244] Among them, the processor 910 is used to obtain the first identity information of the user in response to the user's first input, and receive the user's first voice information when it is determined that the first identity information is obtained; when it is determined that the verification of the first identity information is passed, the parameter information of the first input is encrypting to generate a first signature; when it is determined that the parameter information in the first signature is verified, the parameter information and the execution instruction corresponding to the first voice information are encrypting to obtain a second signature; the first signature and the second signature are verified respectively, and when it is determined that the first signature and the second signature are both verified, the execution instruction is executed.

[0245] In this way, by responding to the user's first input, the user's first identity information is obtained, and then the user's first voice information can be received only after the user's first identity information is determined to be obtained, and then the user's first identity information is verified, ensuring that the execution instruction of the first voice information is the voice information sent by the user in the real physical world, ensuring the security of the voice information data. In addition, when it is determined that the first identity information is verified, the parameter information of the first input is encrypted to obtain the first signature, and when it is determined that the parameter information in the first signature is verified, the parameter information and the execution instruction corresponding to the first voice information are encrypted to obtain the second signature, and then the first signature and the second signature are verified respectively. When it is determined that both the first signature and the second signature are verified, the execution instruction is executed. In this way, the first identity information and the parameter information of the first voice information are encrypted multiple times to prevent the encryption calculation result from being tampered with, while protecting the user's personal privacy data.

[0246] Optionally, the parameter information includes first timestamp information of the first input and a random number randomly generated based on the first input, and the processor 910 is further used to: perform hash calculation on the timestamp information and the random number to obtain a first hash value; encrypt the first hash value using a first private key corresponding to the first identity information to generate a first signature.

[0247] In this way, by performing hash calculation on the timestamp information and the random number, a first hash value is obtained, and then the first hash value is encrypted using the first private key corresponding to the first identity information to generate a first signature. In this way, the parameter information corresponding to the user's first input can be encrypted to ensure the security of the first input, thereby protecting the user's identity information and improving the security of user data.

[0248] Optionally, the processor 910 is further used to: before respectively verifying the first signature and the second signature, determine the time difference information between the current timestamp information and the first timestamp information; when it is determined that the time difference information is less than a preset time difference threshold, verify the first signature and the second signature respectively.

[0249] In this way, the time difference information between the current timestamp information and the timestamp information is determined. When it is determined that the time difference information is less than the preset time difference threshold, the first signature and the second signature are verified respectively. In this way, the first signature and the second signature are verified respectively only when the time difference information between the current timestamp information and the timestamp information is within a certain time difference range. In this way, the first voice information is prevented from being maliciously tampered with during the processing process, thereby ensuring the security of the first voice information.

[0250] Optionally, the processor 910 is further used to: when it is determined that the first signature is verified successfully, before encrypting the parameter information and the execution instruction corresponding to the first voice information, verify the parameter information in the first signature using the first public key corresponding to the first identity information in the first certificate; when it is determined that the parameter information is verified successfully, verify the first certificate, the first signature and the second signature respectively; when it is determined that the first certificate, the first signature and the second signature are all verified successfully, execute the execution instruction.

[0251] In this way, the parameter information in the first signature is verified by using the first public key corresponding to the first identity information in the first certificate, and then when it is determined that the parameter information verification has passed, the first certificate, the first signature and the second signature are verified respectively. When it is determined that the first certificate, the first signature and the second signature have all passed the verification, the execution instruction is executed. In this way, the accuracy of the user's identity information can be verified, ensuring that the execution instructions subsequently executed are from the correct user, and ensuring the accuracy of the execution of the subsequent execution instructions.

[0252] Optionally, the processor 910 is also used to: verify the first certificate using the second public key of the CA certificate; when it is determined that the first certificate verification is successful, obtain the first public key in the first certificate and the third public key corresponding to the first voice information; verify the first signature using the first public key; when it is determined that the first signature verification is successful, verify the second signature using the third public key; when it is determined that the second signature verification is successful, execute the execution instruction.

[0253] In this way, the first certificate is verified by using the second public key of the CA certificate. When it is determined that the first certificate verification is successful, the first public key in the first certificate and the third public key corresponding to the first voice information are obtained, and then the first signature is verified by using the first public key. When it is determined that the first signature verification is successful, the second signature is verified by using the third public key. When it is determined that the second signature verification is successful, the execution instruction is executed. In this way, it is ensured that the encrypted first signature and second signature can be decrypted by their respective public keys, thereby ensuring the security of the first signature and the second signature, and then ensuring the security of user information.

[0254] Optionally, the processor 910 is also used to: before encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain the second signature, convert the first voice information into text to obtain text information corresponding to the first voice information; and obtain the execution instruction based on the text information and environmental perception information.

[0255] In this way, by converting the first voice information into text, text information corresponding to the first voice information is obtained, and then based on the text information and the environmental perception information, an execution instruction is obtained, so that the execution instruction corresponding to the first voice information can be accurately obtained.

[0256] Optionally, the processor 910 is further used to: before converting the first voice information into text, extract features from the first voice information to obtain feature information corresponding to the first voice information; compare the feature information with preset feature information; and when it is determined that the feature information is consistent with the preset feature information, convert the first voice information into text.

[0257] In this way, by performing feature extraction on the first voice information, feature information corresponding to the first voice information is obtained, and then the feature information is compared with the pre-stored preset features of the user. If the comparison is consistent, the first voice information is converted into text information. This ensures that the first voice information is issued by the user, and then ensures that the subsequent execution instructions are what the user wants to execute, thereby improving the accuracy of the execution of the execution instructions.

[0258] Optionally, the processor 910 is further used to: perform hash calculation on the parameter information and the execution instruction corresponding to the first voice information to obtain a second hash value; and encrypt the second hash value using a second private key corresponding to the first voice information to obtain a second signature.

[0259] In this way, the parameter information and the execution instruction corresponding to the first voice information are hashed to obtain a second hash value, and the second hash value is encrypted using the second private key corresponding to the first voice information to obtain a second signature. This ensures the security of the parameter information and the execution instruction and prevents the parameter information and the execution instruction from being tampered with.

[0260] Optionally, the processor 910 is further used to: obtain the first identity information of the user in response to the user's first input, and obtain the second identity information of the user in response to the user's second input before receiving the user's first voice message when it is determined that the first identity information has been obtained; compare the first identity information with the second identity information, and determine that the verification of the first identity information has passed when it is determined that the first identity information and the second identity information are consistent.

[0261] In this way, by pre-receiving the user's second voice information and then performing feature extraction on the second voice information, preset feature information is obtained, so that the user's first voice information can be subsequently verified based on the preset feature information, ensuring that the executed execution instruction is based on that issued by the user, thereby ensuring the accuracy of the execution of the execution instruction.

[0262] Optionally, the processor 910 is also used to: after obtaining the second identity information and the first voice information of the user, generate a first private key and a first public key based on the second identity information; encrypt the first public key based on the third private key of the electronic device to generate a third signature; generate a third certificate based on the third signature and the second certificate, wherein the second certificate is generated by signing the fourth public key of the electronic device based on the fourth private key of the CA certificate; sign the third public key based on the first private key to generate a fourth signature, and generate a first certificate based on the fourth signature and the third certificate, wherein the third public key is generated based on the preset feature information.

[0263] In this way, based on the second identity information, the first private key and the first public key are generated, the first public key is encrypted based on the third private key of the electronic device to generate a third signature, a third certificate is generated based on the third signature and the second certificate, the third public key is signed based on the first private key to generate a fourth signature, and the first certificate is generated based on the fourth signature and the third certificate, so that the first certificate can be accurately obtained.

[0264] It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a color camera) in the video capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0265] The memory 909 can be used to store software programs and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 909 may include a volatile memory or a non-volatile memory, or the memory 909 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 909 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0266] The processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.

[0267] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0268] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0269] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0270] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0271] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned information processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0272] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0273] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0274] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An information processing method, characterized in that: The method comprises: In response to a first input from a user, acquiring first identity information of the user, and receiving first voice information of the user if it is determined that the first identity information is acquired; If it is determined that the verification of the first identity information passes, encrypting the first input parameter information to generate a first signature; When it is determined that the parameter information in the first signature is verified, encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature; The first signature and the second signature are verified respectively, and when it is determined that both the first signature and the second signature are verified successfully, the execution instruction is executed.

2. The method according to claim 1, characterized in that: The parameter information includes first timestamp information of the first input and a random number randomly generated based on the first input, and the encrypting the parameter information of the first input to generate a first signature includes: Performing a hash calculation on the timestamp information and the random number to obtain a first hash value; The first hash value is encrypted using a first private key corresponding to the first identity information to generate a first signature.

3. The method according to claim 2, characterized in that Before respectively verifying the first signature and the second signature, the method further includes: Determine time difference information between current timestamp information and the first timestamp information; The verifying the first signature and the second signature respectively includes: When it is determined that the time difference information is less than a preset time difference threshold, the first signature and the second signature are verified respectively.

4. The method according to claim 1, characterized in that: In the case where it is determined that the first signature verification is passed, before encrypting the parameter information and the execution instruction corresponding to the first voice information, the method further includes: Verifying the parameter information in the first signature using a first public key corresponding to the first identity information in the first certificate; The verifying the first signature and the second signature respectively, and executing the execution instruction when it is determined that the first signature and the second signature are both verified successfully, comprises: When it is determined that the parameter information verification passes, the first certificate, the first signature, and the second signature are verified respectively; when it is determined that the first certificate, the first signature, and the second signature are all verified, the execution instruction is executed.

5. The method according to claim 4, characterized in that The verifying the first certificate, the first signature, and the second signature respectively, and executing the execution instruction when it is determined that the first certificate, the first signature, and the second signature are all verified successfully, comprises: Verifying the first certificate using the second public key of the certification authority CA certificate; When it is determined that the first certificate is verified successfully, obtaining the first public key in the first certificate and a third public key corresponding to the first voice information; Verifying the first signature using the first public key; When it is determined that the first signature verification passes, verifying the second signature using the third public key; When it is determined that the second signature verification passes, the execution instruction is executed.

6. The method according to claim 1, characterized in that Before encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain the second signature, the method further includes: Converting the first voice information into text to obtain text information corresponding to the first voice information; The execution instruction is obtained based on the text information and the environmental perception information.

7. The method according to claim 6, characterized in that Before converting the first voice information into text, the method further includes: Extracting features from the first voice information to obtain feature information corresponding to the first voice information; Comparing the characteristic information with preset characteristic information; The converting the first voice information into text includes: When it is determined that the characteristic information is consistent with the preset characteristic information, the first voice information is converted into text.

8. The method according to claim 1, characterized in that The step of encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature includes: Performing a hash calculation on the parameter information and the execution instruction corresponding to the first voice information to obtain a second hash value; The second hash value is encrypted using a second private key corresponding to the first voice information to obtain a second signature.

9. The method according to claim 1, characterized in that: Before acquiring the first identity information of the user in response to the first input of the user, and receiving the first voice information of the user when it is determined that the first identity information is acquired, the method further includes: In response to a second input from the user, obtaining second identity information of the user; In the case where it is determined that the verification of the first identity information passes, before encrypting the first input parameter information and generating the first signature, the method further includes: The first identity information is compared with the second identity information, and when it is determined that the first identity information is consistent with the second identity information, it is determined that the verification of the first identity information has passed.

10. The method according to claim 9, characterized in that After acquiring the second identity information and the first voice information of the user, the method further includes: Based on the second identity information, generate a first private key and a first public key; Encrypting the first public key based on a third private key of the electronic device to generate a third signature; Generate a third certificate based on the third signature and the second certificate, wherein the second certificate is generated by signing the fourth public key of the electronic device based on the fourth private key of the CA certificate; The third public key is signed based on the first private key to generate a fourth signature, and a first certificate is generated based on the fourth signature and the third certificate, wherein the third public key is generated based on the preset characteristic information.

11. An information processing method, characterized in that: The method comprises: Responding to a first input of the user through a target control, acquiring first identity information of the user, and receiving first voice information of the user based on a voice acquisition device when it is determined that the first identity information is acquired; When determining that the verification of the first identity information passes, the first execution environment encrypts the first input parameter information to generate a first signature; Based on the virtual execution environment, when it is determined that the parameter information in the first signature is verified, encrypting the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature; The first signature and the second signature are respectively verified based on the second execution environment, and when it is determined that both the first signature and the second signature are verified successfully, the execution instruction is executed.

12. An information processing device, characterized in that: The device comprises: A first acquisition module, configured to acquire first identity information of the user in response to a first input of the user, and receive first voice information of the user if it is determined that the first identity information is acquired; A first determination module is used to encrypt the first input parameter information and generate a first signature when it is determined that the verification of the first identity information passes; A second determination module is used to encrypt the parameter information and the execution instruction corresponding to the first voice information to obtain a second signature when it is determined that the parameter information in the first signature is verified. An execution module is used to verify the first signature and the second signature respectively, and execute the execution instruction when it is determined that the first signature and the second signature are both verified.

13. An electronic device, characterized in that: It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, it implements the steps of the information processing method according to any one of claims 1 to 10, and / or the steps of the information processing method according to claim 11.

14. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the information processing method according to any one of claims 1 to 10 and / or the steps of the information processing method according to claim 11 are implemented.

Images