Keyboard input encryption processing method and device

Abstract

The application provides a keyboard input encryption processing method and device. The method comprises the following steps: after triggering the keyboard to start the anti-eavesdropping mode, acquiring an audio signal generated by the current keystroke on the keyboard, and extracting the audio feature of the audio signal; generating a noise signal matched with the audio feature of the audio signal based on the audio feature of the audio signal, and generating a high-frequency sound wave carrier signal satisfying a preset frequency range; modulating the noise signal to the high-frequency sound wave carrier signal to obtain a high-frequency sound wave interference signal, and outputting the high-frequency sound wave interference signal before the next keystroke on the keyboard. The keyboard input encryption processing method provided by the application can effectively improve the security of input information during the use of the keyboard, thereby reducing the risk of stealing sensitive information such as account password.

Description

Technical Field

[0001] This invention relates to the field of information encryption technology, specifically to a keyboard input encryption processing method and apparatus. It also relates to an electronic device and a processor-readable storage medium. Background Technology

[0002] With the rapid development of computer technology, information security has gradually gained attention. Servers are computer devices specifically designed for processing and storing various data, information, and services. Due to their high performance, high stability, and high reliability, they are widely used in data centers, cloud computing, enterprise storage, industrial control, and other fields. Along with the widespread use of servers, the security challenges they face are becoming increasingly severe. Server security challenges mainly include network attacks, malware, and data breaches. Addressing network attacks requires measures such as installing antivirus software, firewalls, and strengthening password policies. Addressing malware requires, in addition to antivirus software, restricting software installation permissions and avoiding the use of software from unknown sources. Preventing data breaches can be achieved through strengthening access control, regularly backing up data, and enhancing physical security. However, with the rapid development of technologies such as artificial intelligence, hackers are employing increasingly sophisticated methods to steal server data. Among these, using artificial intelligence to listen to the sound of users typing on keyboards to steal accounts, passwords, and other sensitive information has become possible. Current server deployments all use ordinary physical mechanical keyboards. Each key on this keyboard emits a unique sound, which, theoretically, can be recorded. Based on the audio characteristics, it's possible to deduce which key is being pressed. Artificial intelligence programs can then identify the pattern of each key's sound. By recording someone's typing sound and successfully deducing the typed content, it's clear that ordinary keyboards already pose a significant security vulnerability. Therefore, designing a more secure keyboard input encryption solution is a pressing issue that needs to be addressed. Summary of the Invention

[0003] To address this, the present invention provides a keyboard input encryption processing method and apparatus to solve the problem that existing keyboard input encryption processing schemes have high limitations, resulting in poor security of input information during keyboard use.

[0004] In a first aspect, the present invention provides a keyboard input encryption processing method, comprising:

[0005] After triggering the keyboard to start the anti-eavesdropping mode, the audio signal generated by the current key press is acquired, and the audio features of the audio signal are extracted.

[0006] Based on the audio characteristics of the audio signal, a noise signal matching the audio characteristics of the audio signal is generated, and a high-frequency acoustic carrier signal satisfying a preset frequency range is generated.

[0007] The noise signal is modulated onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and the high-frequency acoustic interference signal is output before the next keystroke.

[0008] Furthermore, the audio signal includes a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released;

[0009] The step of generating a noise signal that matches the audio features of the audio signal based on the audio features of the audio signal specifically includes:

[0010] The audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal are both taken as the audio features of the audio signal;

[0011] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to find several target audio waveform data that satisfy preset similarity conditions between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal; wherein, the waveform sample library stores preset audio waveform data of various types; the waveform amplitudes corresponding to the several target audio waveform data are averaged to obtain target waveform amplitudes; and a noise signal corresponding to the target waveform amplitude is generated based on the target waveform amplitudes.

[0012] Furthermore, the step of calculating the similarity between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes is performed to find several target audio waveform data that satisfy preset similarity conditions with both the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal. Specifically, this includes:

[0013] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to obtain corresponding similarity indices; wherein, the calculation formula for the similarity index is as follows:

[0014]

[0015] Where Ai represents the waveform amplitude corresponding to the audio characteristics of the audio signal; Bi represents the waveform amplitude corresponding to the sample audio waveform data; The mean value of the waveform amplitude corresponding to the audio characteristics of the audio signal; This represents the mean amplitude of the waveform corresponding to the sample audio waveform data; i represents different audio signals.

[0016] Based on the magnitude of the similarity index, several target audio waveform data are obtained from the waveform sample library and the sample library that pre-stores historical audio signals of previous keystrokes, where the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal both satisfy preset similarity conditions.

[0017] Furthermore, acquiring the audio signal generated by the current key press specifically includes:

[0018] Acquire the initial audio signal generated by the current key press on the keyboard;

[0019] The initial audio signal is filtered based on a preset amplitude threshold to obtain a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released; wherein, the audio signal includes the first audio signal and the second audio signal.

[0020] Furthermore, the step of acquiring the initial audio signal generated by the current key press specifically includes: acquiring the actual audio signal generated by the current key press;

[0021] The actual audio signal is converted into a corresponding voltage signal, and the voltage signal is filtered to obtain a filtered signal; the filtered signal is converted into a corresponding digital audio signal, and the digital audio signal is used as the initial audio signal.

[0022] Furthermore, the extraction of audio features from the audio signal specifically includes:

[0023] Feature extraction is performed on the audio waveforms corresponding to the first audio signal and the second audio signal respectively to obtain the audio waveform features corresponding to the first audio signal and the second audio signal. The audio waveform features corresponding to the first audio signal and the second audio signal are used as the audio features of the audio signal.

[0024] Furthermore, the step of modulating the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and outputting the high-frequency acoustic interference signal before the next keystroke, specifically includes: loading the noise signal onto the high-frequency acoustic carrier signal to obtain a corresponding high-frequency acoustic interference signal, sending the high-frequency acoustic interference signal to a preset speaker corresponding to the keyboard, and releasing the high-frequency acoustic interference signal through the speaker before the next keystroke.

[0025] Secondly, the present invention also provides a keyboard input encryption processing device, comprising:

[0026] The audio data processing module is used to acquire the audio signal generated by the current key press after the keyboard is activated to start the anti-eavesdropping mode, and to extract the audio features of the audio signal.

[0027] The noise generation module is used to generate a noise signal that matches the audio characteristics of the audio signal based on the audio characteristics of the audio signal, and to generate a high-frequency acoustic carrier signal that meets a preset frequency range.

[0028] The modulation module is used to modulate the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and to output the high-frequency acoustic interference signal before the next key press.

[0029] Furthermore, the audio signal includes a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released;

[0030] The noise generation module is specifically used for:

[0031] The audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal are both taken as the audio features of the audio signal;

[0032] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to find several target audio waveform data that satisfy preset similarity conditions between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal; wherein, the waveform sample library stores preset audio waveform data of various types; the waveform amplitudes corresponding to the several target audio waveform data are averaged to obtain target waveform amplitudes; and a noise signal corresponding to the target waveform amplitude is generated based on the target waveform amplitudes.

[0033] Furthermore, the step of calculating the similarity between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes is performed to find several target audio waveform data that satisfy preset similarity conditions with both the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal. Specifically, this includes:

[0034] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to obtain corresponding similarity indices; wherein, the calculation formula for the similarity index is as follows:

[0035]

[0036] Where Ai represents the waveform amplitude corresponding to the audio characteristics of the audio signal; Bi represents the waveform amplitude corresponding to the sample audio waveform data; The mean value of the waveform amplitude corresponding to the audio characteristics of the audio signal; This represents the mean amplitude of the waveform corresponding to the sample audio waveform data; i represents different audio signals.

[0037] Based on the magnitude of the similarity index, several target audio waveform data are obtained from the waveform sample library and the sample library that pre-stores historical audio signals of previous keystrokes, where the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal both satisfy preset similarity conditions.

[0038] Furthermore, the audio data processing module is specifically used for:

[0039] Acquire the initial audio signal generated by the current key press on the keyboard;

[0040] The initial audio signal is filtered based on a preset amplitude threshold to obtain a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released; wherein, the audio signal includes the first audio signal and the second audio signal.

[0041] Furthermore, the step of acquiring the initial audio signal generated by the current key press specifically includes: acquiring the actual audio signal generated by the current key press;

[0042] The actual audio signal is converted into a corresponding voltage signal, and the voltage signal is filtered to obtain a filtered signal; the filtered signal is converted into a corresponding digital audio signal, and the digital audio signal is used as the initial audio signal.

[0043] Furthermore, the audio data processing module is specifically used for:

[0044] Feature extraction is performed on the audio waveforms corresponding to the first audio signal and the second audio signal respectively to obtain the audio waveform features corresponding to the first audio signal and the second audio signal. The audio waveform features corresponding to the first audio signal and the second audio signal are used as the audio features of the audio signal.

[0045] Furthermore, the modulation module is specifically used to: load the noise signal onto the high-frequency acoustic carrier signal to obtain a corresponding high-frequency acoustic interference signal, send the high-frequency acoustic interference signal to a preset speaker corresponding to the keyboard, and release the high-frequency acoustic interference signal through the speaker before the next key press.

[0046] Thirdly, the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the keyboard input encryption processing method described in any of the above claims.

[0047] Fourthly, the present invention also provides a processor-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the keyboard input encryption processing method described in any of the above claims.

[0048] The keyboard input encryption method provided by this invention obtains the audio signal generated by the current key press after triggering the anti-eavesdropping mode of the keyboard, extracts the audio features of the audio signal, generates a noise signal that matches the audio features of the audio signal based on the audio features, and modulates the noise signal onto the high-frequency acoustic wave carrier signal to obtain a high-frequency acoustic wave interference signal. The high-frequency acoustic wave interference signal is output before the next key press, which can effectively improve the security of input information during keyboard use, thereby reducing the risk of sensitive information such as account passwords being stolen. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a flowchart illustrating the keyboard input encryption processing method provided in an embodiment of the present invention;

[0051] Figure 2 This is a schematic diagram of the waveform generated during the pressing and releasing of the letter G on the keyboard according to an embodiment of the present invention;

[0052] Figure 3 This is a schematic diagram of the keyboard anti-eavesdropping mode selection process provided in an embodiment of the present invention;

[0053] Figure 4 This is a flowchart illustrating the keyboard encryption principle provided in an embodiment of the present invention;

[0054] Figure 5 This is a schematic diagram of the keyboard input encryption processing device provided in an embodiment of the present invention;

[0055] Figure 6 This is a schematic diagram of the hardware environment for the keyboard input encryption processing method provided in an embodiment of the present invention;

[0056] Figure 7 This is a schematic diagram of the physical structure of the electronic device provided in an embodiment of the present invention. Detailed Implementation

[0057] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0058] The following is a detailed description of embodiments of the keyboard input encryption method described in this invention. Figure 1 The diagram shown is a flowchart of the keyboard input encryption processing method provided in an embodiment of the present invention. The specific implementation process includes the following steps:

[0059] Step 101: After triggering the keyboard to start the anti-eavesdropping mode, acquire the audio signal generated by the current key press on the keyboard, and extract the audio features of the audio signal.

[0060] Specifically, after triggering the keyboard's anti-eavesdropping mode, the actual audio signal generated by the current key press can be acquired and converted into a corresponding voltage signal. This voltage signal is then filtered to obtain a filtered signal, which is further converted into a corresponding digital audio signal. This digital audio signal is used as the initial audio signal. Based on a preset amplitude threshold, the initial audio signal is filtered to obtain a first audio signal generated by pressing the keyboard key and a second audio signal generated by releasing the keyboard key. Feature extraction is performed on the audio waveforms corresponding to the first and second audio signals to obtain the audio waveform features corresponding to the first and second audio signals, respectively. These two audio waveform features are then used as the audio features of the audio signal. The audio signal includes both the first audio signal generated by pressing the keyboard key and the second audio signal generated by releasing the keyboard key.

[0061] like Figure 2 The image shows the waveforms obtained when the G key is pressed and released on the keyboard. As you can see, pressing and releasing the keyboard will produce two audio signals with relatively large amplitudes (i.e., the first audio signal and the second audio signal). By setting an adaptive amplitude threshold, the waveform amplitudes of the two audio signals can be selected.

[0062] Step 102: Generate a noise signal that matches the audio characteristics of the audio signal based on the audio characteristics of the audio signal, and generate a high-frequency acoustic carrier signal that meets the preset frequency range.

[0063] Both the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal are used as the audio features of the audio signal. Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library that stores historical audio signals of previous keystrokes, respectively, to find several target audio waveform data that satisfy preset similarity conditions with the audio waveform features corresponding to the first audio signal and the second audio signal; wherein, the waveform sample library stores preset audio waveform data of various types; the waveform amplitudes corresponding to the several target audio waveform data are averaged to obtain the target waveform amplitude; and a noise signal corresponding to the target waveform amplitude is generated based on the target waveform amplitude.

[0064] The specific implementation process involves calculating the similarity between the audio waveform features corresponding to the first and second audio signals and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals from previous keystrokes. This aims to identify several target audio waveform data that satisfy preset similarity conditions with both the audio waveform features corresponding to the first and second audio signals.

[0065] The audio waveform features corresponding to the first audio signal and the second audio signal are matched with the waveform amplitudes in the local waveform sample library and the sample library containing previously stored historical audio signals of the keyboard being typed. The comparison is performed using a similarity index, and the similarity formula is as follows:

[0066]

[0067] Where Ai and Bi are the sample waveforms; Ai represents the waveform amplitude corresponding to the audio characteristics of the audio signal, Bi represents the waveform amplitude corresponding to the sample audio waveform data; and i represents different audio signals. The mean value of the waveform amplitude corresponding to the audio characteristics of the audio signal; This represents the mean amplitude of the waveform corresponding to the sample audio waveform data. The larger the similarity index C value, the higher the similarity.

[0068] Based on the aforementioned key detection principle, the keyboard of this invention uses an FPGA to implement the data processing process, employing the following algorithm: Assuming the time interval between pressing two keys consecutively is Ti, the amplitude of the key sound emitted after pressing the i-th key (i.e., the waveform amplitude of the first audio signal) is Xi, and the amplitude of the sound after releasing the key (i.e., the waveform amplitude of the second audio signal) is Yi. Before the (i+1)-th key is pressed, based on the FPGA (Field Programmable Gate Array), N audio waveform data with similar amplitudes but different from Xi and Yi can be found in the local waveform sample library and the previous i-1 waveforms (i.e., audio waveform data in the sample library that pre-stores the historical audio signals of the keyboard being pressed). After summing and averaging, a corresponding noise signal (i.e., noise sequence) is generated. After the i-th key is released, at the time point 0.5Ti, the aforementioned noise sequence is loaded onto a high-frequency sound wave (i.e., generating a high-frequency sound wave carrier signal that meets the preset frequency range), and released through the speaker, thus realizing the keyboard audio encryption function. The preset frequency range of the high-frequency acoustic carrier signal needs to be above 20kHz so that the noise cannot be heard by the human ear.

[0069] Step 103: Modulate the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and output the high-frequency acoustic interference signal before the next key press.

[0070] Specifically, the noise signal is loaded onto the high-frequency acoustic carrier signal to obtain a corresponding high-frequency acoustic interference signal, and the high-frequency acoustic interference signal is sent to the preset speaker corresponding to the keyboard. Before the next keystroke, the high-frequency acoustic interference signal is released through the speaker.

[0071] In this embodiment of the invention, an additional anti-eavesdropping button is added to the keyboard. When it is necessary to input account passwords and other critical data information, the anti-eavesdropping button can be pressed to trigger the keyboard to activate the anti-eavesdropping mode. The user can determine whether to activate the anti-eavesdropping mode based on whether the content to be input is confidential. If not, the anti-eavesdropping circuit is controlled to be in a low-power state by the FPGA data processing module; if so, the audio pickup module is controlled by the FPGA data processing module to collect the actual audio data of the keys (i.e., key sound data). The collected key sound data is filtered. The noise includes not only environmental noise but also high-frequency noise from the keyboard output. Since the FPGA data processing module is aware of the characteristics of its own high-frequency noise signal, it sets corresponding filters to remove the corresponding environmental noise and high-frequency noise. The waveform amplitude of the keyboard sound is obtained and compared with a set amplitude threshold to find the waveform amplitude when the keyboard is pressed and released. From the local waveform sample library and newly captured past waveforms (i.e., audio waveform data in a sample library pre-stored with historical audio signals from previous keystrokes), N target waveform amplitudes are identified. These waveforms must meet a preset similarity condition but be different from the latest captured waveform amplitude. The amplitudes are then summed and averaged. Based on the obtained target waveform amplitudes, a noise circuit is controlled to generate a noise signal, which is simultaneously modulated onto a high-frequency sound wave to obtain a high-frequency sound interference signal. This generated high-frequency sound interference signal is released before the next key is pressed. In this way, the sound emitted when the user types on the keyboard includes not only the actual keystroke sound but also noise that closely resembles the keyboard sound characteristics, thereby protecting the input content and increasing data security.

[0072] like Figure 3 As shown, to reduce keyboard power consumption, an additional anti-eavesdropping button is added to the keyboard. This button is connected to both an LED (light-emitting diode) indicator and the FPGA data processing module. When account passwords or other critical data need to be entered, pressing the anti-eavesdropping button triggers the keyboard to enter anti-eavesdropping mode (i.e., encryption protection mode). The FPGA data processing module controls the circuit to output interference noise, and the LED indicator lights up. When performing other normal operations, the user can switch the keyboard to normal mode using the anti-eavesdropping button. The FPGA data processing module then controls the corresponding modules to enter low-power mode and stop emitting noise, thereby reducing power consumption.

[0073] The keyboard input encryption processing method described in this embodiment of the invention, after triggering the keyboard to start the anti-eavesdropping mode, acquires the audio signal generated by the current key press, extracts the audio features of the audio signal, generates a noise signal that matches the audio features of the audio signal based on the audio features, and modulates the noise signal onto the high-frequency acoustic wave carrier signal to obtain a high-frequency acoustic wave interference signal. The high-frequency acoustic wave interference signal is output before the next key press, which can improve the security of input information during keyboard use, effectively reduce the possibility of hackers accurately reconstructing user input content based on the sound features of keyboard keys, reduce the leakage of high-value data or important content such as account passwords, and thus reduce the information leakage security risks, thereby reducing the risk of sensitive information such as account passwords being stolen.

[0074] Corresponding to the keyboard input encryption processing method provided above, this invention also provides a keyboard input encryption processing device. Since the embodiments of this device are similar to the method embodiments described above, the description is relatively simple. For relevant details, please refer to the description in the method embodiment section above. The embodiments of the keyboard input encryption processing device described below are merely illustrative. Please refer to... Figure 5 As shown, it is a schematic diagram of a keyboard input encryption processing device provided in an embodiment of the present invention.

[0075] The keyboard input encryption processing device of the present invention specifically includes the following parts:

[0076] The audio data processing module 501 is used to acquire the audio signal generated by the current key press after the keyboard is triggered to start the anti-eavesdropping mode, and to extract the audio features of the audio signal.

[0077] The noise generation module 502 is used to generate a noise signal that matches the audio characteristics of the audio signal based on the audio characteristics of the audio signal, and to generate a high-frequency acoustic carrier signal that meets a preset frequency range.

[0078] The modulation module 503 is used to modulate the noise signal onto the high-frequency acoustic wave carrier signal to obtain a high-frequency acoustic wave interference signal, and to output the high-frequency acoustic wave interference signal before the next key press.

[0079] Furthermore, the audio signal includes a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released;

[0080] The noise generation module is specifically used for:

[0081] The audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal are both taken as the audio features of the audio signal;

[0082] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to find several target audio waveform data that satisfy preset similarity conditions between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal; wherein, the waveform sample library stores preset audio waveform data of various types; the waveform amplitudes corresponding to the several target audio waveform data are averaged to obtain target waveform amplitudes; and a noise signal corresponding to the target waveform amplitude is generated based on the target waveform amplitudes.

[0083] Furthermore, the step of calculating the similarity between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes is performed to find several target audio waveform data that satisfy preset similarity conditions with both the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal. Specifically, this includes:

[0084] Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to obtain corresponding similarity indices; wherein, the calculation formula for the similarity index is as follows:

[0085]

[0086] Where Ai represents the waveform amplitude corresponding to the audio characteristics of the audio signal; Bi represents the waveform amplitude corresponding to the sample audio waveform data; The mean value of the waveform amplitude corresponding to the audio characteristics of the audio signal; This represents the mean amplitude of the waveform corresponding to the sample audio waveform data; i represents different audio signals.

[0087] Based on the magnitude of the similarity index, several target audio waveform data are obtained from the waveform sample library and the sample library that pre-stores historical audio signals of previous keystrokes, where the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal both satisfy preset similarity conditions.

[0088] Furthermore, the audio data processing module is specifically used for:

[0089] Acquire the initial audio signal generated by the current key press on the keyboard;

[0090] The initial audio signal is filtered based on a preset amplitude threshold to obtain a first audio signal generated when the keyboard key is pressed and a second audio signal generated when the keyboard key is released; wherein, the audio signal includes the first audio signal and the second audio signal.

[0091] Furthermore, the step of acquiring the initial audio signal generated by the current key press specifically includes: acquiring the actual audio signal generated by the current key press;

[0092] The actual audio signal is converted into a corresponding voltage signal, and the voltage signal is filtered to obtain a filtered signal; the filtered signal is converted into a corresponding digital audio signal, and the digital audio signal is used as the initial audio signal.

[0093] Furthermore, the audio data processing module is specifically used for:

[0094] Feature extraction is performed on the audio waveforms corresponding to the first audio signal and the second audio signal respectively to obtain the audio waveform features corresponding to the first audio signal and the second audio signal. The audio waveform features corresponding to the first audio signal and the second audio signal are used as the audio features of the audio signal.

[0095] Furthermore, the modulation module is specifically used to: load the noise signal onto the high-frequency acoustic carrier signal to obtain a corresponding high-frequency acoustic interference signal, send the high-frequency acoustic interference signal to a preset speaker corresponding to the keyboard, and release the high-frequency acoustic interference signal through the speaker before the next key press.

[0096] like Figure 4As shown, in a complete embodiment, the device can consist of seven modules: a sound pickup module, a filtering and noise reduction module, an ADC (Analog-Digital Converter) acquisition module, an FPGA data processing module (i.e., a data processing module), a modulation module, a noise generation module, and a speaker module. The sound pickup module records keyboard keystrokes in real time and converts the sound signal into a voltage signal. The voltage signal is filtered by the filtering module to remove environmental noise and high-frequency noise generated by the noise control module controlled by the FPGA data processing module. Then, it is converted into a digital signal by the ADC data acquisition module. The FPGA data processing module extracts the waveform characteristics of the keyboard sound, generates noise information matching the keyboard sound signal characteristics, and modulates the noise signal onto a preset high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal (the high-frequency acoustic wave frequency is above 20kHz, so that the human ear cannot hear the noise). This interference signal is then converted into a sound signal by the speaker module and emitted.

[0097] The keyboard input encryption processing device described in this embodiment of the invention, after triggering the keyboard to start the anti-eavesdropping mode, acquires the audio signal generated by the current key press, extracts the audio features of the audio signal, generates a noise signal that matches the audio features of the audio signal based on the audio features, and modulates the noise signal onto the high-frequency acoustic wave carrier signal to obtain a high-frequency acoustic wave interference signal. The high-frequency acoustic wave interference signal is output before the next key press, which can effectively improve the security of input information during keyboard use, thereby reducing the risk of sensitive information such as account passwords being stolen.

[0098] The methods and embodiments provided in this application can be executed on a computer terminal, device terminal, or similar computing device. Taking running on a computer terminal as an example, Figure 6 This is a schematic diagram of the hardware environment for a keyboard input encryption processing method according to an embodiment of this application. Figure 6 As shown, a computer terminal may include one or more ( Figure 6 Only one is shown in the diagram. A processor 602 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 604 for storing data are also shown. In one exemplary embodiment, the computer terminal may further include a transmission device 606 for communication functions and an input / output device 608. Those skilled in the art will understand that... Figure 6 The structure shown is for illustrative purposes only and does not limit the structure of the computer terminal described above. For example, the computer terminal may also include components that are more complex than those described above. Figure 6 The more or fewer components shown, or having the same Figure 6 Equivalent functions or ratios shown Figure 6The illustrated functionality includes various configurations. Memory 604 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the keyboard input encryption processing method in this embodiment. Processor 602 executes various functional applications and data processing by running the computer program stored in memory 604, thus implementing the aforementioned method. Memory 604 may include high-speed random access memory and non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, memory 604 may further include memory remotely located relative to processor 602, which can be connected to the computer terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Transmission device 606 is used to receive or send data via a network. Specific examples of such networks may include wireless networks provided by the computer terminal's communication provider. In one example, transmission device 606 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In one example, the transmission device 606 can be a radio frequency (RF) module, used for wireless communication with the Internet. This embodiment provides a keyboard input encryption method applied to the aforementioned computer terminal.

[0099] Alternatively, corresponding to the keyboard input encryption method provided above, the present invention also provides an electronic device. Since the embodiment of this electronic device is similar to the method embodiment described above, it is described simply. For relevant details, please refer to the description in the method embodiment section above. The electronic device described below is merely illustrative. Figure 7The diagram shows a physical structure of an electronic device disclosed in an embodiment of the present invention. The electronic device may include a processor 701, a memory 702, and a communication bus 703. The processor 701 and the memory 702 communicate with each other via the communication bus 703 and communicate with the outside world via a communication interface 704. The processor 701 can call logical instructions in the memory 702 to execute a keyboard input encryption processing method. This method includes: after triggering the keyboard to start an anti-eavesdropping mode, acquiring the audio signal generated by the current key press and extracting the audio features of the audio signal; generating a noise signal matching the audio features of the audio signal based on the audio features, and generating a high-frequency acoustic carrier signal that meets a preset frequency range; modulating the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and outputting the high-frequency acoustic interference signal before the next key press.

[0100] Furthermore, the logical instructions in the aforementioned memory 702 can be implemented as software functional modules and sold or used as independent products, and can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as memory chips, USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0101] On the other hand, embodiments of the present invention also provide a computer program product, the computer program product including a computer program stored on a processor-readable storage medium, the computer program including program instructions, and when the program instructions are executed by a computer, the computer is able to execute the keyboard input encryption processing method provided in the above-described method embodiments. The method includes: after triggering the keyboard to start an anti-eavesdropping mode, acquiring the audio signal generated by the current key press on the keyboard, and extracting the audio features of the audio signal; generating a noise signal matching the audio features of the audio signal based on the audio features of the audio signal, and generating a high-frequency acoustic carrier signal that satisfies a preset frequency range; modulating the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and outputting the high-frequency acoustic interference signal before the next key press.

[0102] In another aspect, embodiments of the present invention also provide a processor-readable storage medium storing a computer program, which, when executed by a processor, implements the keyboard input encryption processing method provided in the above embodiments. The method includes: after triggering the keyboard to activate an anti-eavesdropping mode, acquiring an audio signal generated by the current key press on the keyboard and extracting audio features of the audio signal; generating a noise signal matching the audio features of the audio signal based on the audio features, and generating a high-frequency acoustic carrier signal satisfying a preset frequency range; modulating the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and outputting the high-frequency acoustic interference signal before the next key press.

[0103] The processor-readable storage medium can be any available medium or data storage device that the processor can access, including but not limited to magnetic memory (e.g., floppy disk, hard disk, magnetic tape, magneto-optical disk (MO)), optical memory (e.g., CD, DVD, BD, HVD), and semiconductor memory (e.g., ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state drive (SSD)).

[0104] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0105] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0106] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A keyboard input encryption processing method, characterized in that, include: After triggering the keyboard to start the anti-eavesdropping mode, the audio signal generated by the current key press is acquired, and the audio features of the audio signal are extracted. Based on the audio characteristics of the audio signal, a noise signal matching the audio characteristics of the audio signal is generated, and a high-frequency acoustic carrier signal satisfying a preset frequency range is generated. The noise signal is modulated onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and the high-frequency acoustic interference signal is output before the next keystroke. The audio signal includes a first audio signal generated by pressing a keyboard key and a second audio signal generated by releasing the keyboard key. Generating a noise signal matching the audio features of the audio signal specifically includes: using the audio waveform features corresponding to both the first and second audio signals as audio features of the audio signal; calculating similarity between the audio waveform features corresponding to the first and second audio signals and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keyboard presses, to find several target audio waveform data that satisfy preset similarity conditions between the audio waveform features corresponding to the first and second audio signals; wherein the waveform sample library stores preset types of audio waveform data; averaging the waveform amplitudes corresponding to the several target audio waveform data to obtain target waveform amplitudes; and generating a noise signal corresponding to the target waveform amplitude based on the target waveform amplitude.

2. The keyboard input encryption processing method according to claim 1, characterized in that, The step involves calculating the similarity between the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal, and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, to find several target audio waveform data that satisfy preset similarity conditions with both the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal. Specifically, this includes: Based on the audio waveform features corresponding to the first audio signal and the second audio signal, similarity calculations are performed with sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keystrokes, respectively, to obtain corresponding similarity indices; wherein, the calculation formula for the similarity index is as follows: Among them, A i B represents the waveform amplitude corresponding to the audio characteristics of the audio signal; i This represents the waveform amplitude corresponding to the sample audio waveform data; The mean value of the waveform amplitude corresponding to the audio characteristics of the audio signal; This represents the mean amplitude of the waveform corresponding to the sample audio waveform data; i represents different audio signals. Based on the magnitude of the similarity index, several target audio waveform data are obtained from the waveform sample library and the sample library that pre-stores historical audio signals of previous keystrokes, where the audio waveform features corresponding to the first audio signal and the audio waveform features corresponding to the second audio signal both satisfy preset similarity conditions.

3. The keyboard input encryption processing method according to claim 1, characterized in that, The acquisition of the audio signal generated by the current key press specifically includes: Acquire the initial audio signal generated by the current key press on the keyboard; The initial audio signal is filtered based on a preset amplitude threshold to obtain a first audio signal generated by pressing the keyboard key and a second audio signal generated by releasing the keyboard key; wherein the audio signal includes the first audio signal and the second audio signal.

4. The keyboard input encryption processing method according to claim 3, characterized in that, The step of obtaining the initial audio signal generated by the current key press on the keyboard specifically includes: obtaining the actual audio signal generated by the current key press on the keyboard. The actual audio signal is converted into a corresponding voltage signal, and the voltage signal is filtered to obtain a filtered signal; the filtered signal is converted into a corresponding digital audio signal, and the digital audio signal is used as the initial audio signal.

5. The keyboard input encryption processing method according to claim 3, characterized in that, The extraction of audio features from the audio signal specifically includes: Feature extraction is performed on the audio waveforms corresponding to the first audio signal and the second audio signal respectively to obtain the audio waveform features corresponding to the first audio signal and the second audio signal. The audio waveform features corresponding to the first audio signal and the second audio signal are used as the audio features of the audio signal.

6. The keyboard input encryption processing method according to claim 1, characterized in that, The step of modulating the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and outputting the high-frequency acoustic interference signal before the next keystroke, specifically includes: loading the noise signal onto the high-frequency acoustic carrier signal to obtain a corresponding high-frequency acoustic interference signal, sending the high-frequency acoustic interference signal to a preset speaker corresponding to the keyboard, and releasing the high-frequency acoustic interference signal through the speaker before the next keystroke.

7. A keyboard input encryption processing device, characterized in that, include: The audio data processing module is used to acquire the audio signal generated by the current key press after the keyboard is activated to start the anti-eavesdropping mode, and to extract the audio features of the audio signal. The noise generation module is used to generate a noise signal that matches the audio characteristics of the audio signal based on the audio characteristics of the audio signal, and to generate a high-frequency acoustic carrier signal that meets a preset frequency range. A modulation module is used to modulate the noise signal onto the high-frequency acoustic carrier signal to obtain a high-frequency acoustic interference signal, and to output the high-frequency acoustic interference signal before the next key press. The audio signal includes a first audio signal generated by pressing a keyboard key and a second audio signal generated by releasing the keyboard key. Generating a noise signal matching the audio features of the audio signal specifically includes: using the audio waveform features corresponding to both the first and second audio signals as audio features of the audio signal; calculating similarity between the audio waveform features corresponding to the first and second audio signals and sample audio waveform data in a preset waveform sample library and a sample library pre-stored with historical audio signals of previous keyboard presses, to find several target audio waveform data that satisfy preset similarity conditions between the audio waveform features corresponding to the first and second audio signals; wherein the waveform sample library stores preset types of audio waveform data; averaging the waveform amplitudes corresponding to the several target audio waveform data to obtain target waveform amplitudes; and generating a noise signal corresponding to the target waveform amplitude based on the target waveform amplitude.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the keyboard input encryption processing method as described in any one of claims 1 to 6.

9. A processor-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the keyboard input encryption processing method as described in any one of claims 1 to 6.

Images