Covert communication method and system based on acoustic side channel leakage of liquid crystal display
Through the hidden communication method of the acoustic side channel leakage of the LCD display, the capacitive howling frequency and harmonic feature template matching algorithm are used to realize efficient hidden communication under the physical isolation network, and solve the insufficient signal quality and anti-interference ability in traditional technology. Problem, providing high data transmission rate and stability.
Patent Information
- Application Number
- CN202310028783.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-09
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2043-01-09
AI Technical Summary
The prior art is difficult to achieve hidden communication with high transmission rate, high signal quality and anti-interference ability under physical isolation networks, especially because electromagnetic signals are susceptible to shielding measures, optical, thermal radiation and mechanical vibration signals transmission rates are relatively low, which is difficult to Supports large amounts of data transmission.
The hidden communication method is adopted for leakage of the acoustic side channel of the LCD display. By encoding sensitive information into binary data frames, using black and white striped pixel height modulation capacitor howling frequency, receiving and demodulating signals using microphones, combining harmonic feature template matching algorithms for decoding and Error detection and correction to realize hidden communication.
It achieves a communication distance of up to 130cm and a maximum throughput of 170bps in a physical isolation environment. It has a high data transmission rate and signal quality. It can avoid electromagnetic shielding interference, improve communication stability and anti-interference ability. It is suitable for up to 55dB Reliable transmission under environmental noise.
Smart Images

Figure CN116016799B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of information security technology, and in particular relates to a covert communication method and system based on acoustic side channel leakage of a liquid crystal display. Background Art
[0002] In some highly confidential places such as government, military, and research institutes, physically isolated networks are usually used to prevent the leakage of sensitive information to ensure the security of internal confidential documents. The so-called physically isolated network is a computer system that does not use any network transmission media and conventional communication methods, which can largely prevent virus implantation and hacker intrusion. In this case, in order to be able to transmit sensitive information beyond the limitations of physical isolation, physical side channel communication has become a very important research direction. Physical side channel communication uses the energy radiation generated by electronic devices during operation to encode and transmit information, turning an electronic device without communication capabilities into a wireless signal transmitter. Since the characteristics of side channel leakage (amplitude, frequency, etc.) are strongly correlated with the operating status of the device, the relationship between the data processed by the device and the leakage characteristics is used to modulate the side channel leakage, which can implement covert communication that is difficult to detect, thereby breaking through the protection of physical isolation. Traditional side channel technology research can achieve passive monitoring, such as passively eavesdropping on user information, detecting user behavior status, and software activity status perception through side channel leakage; while side channel leakage that can be actively modulated can use energy radiation for active covert communication, etc.
[0003] Research in recent years has shown that electronic devices that can be used to modulate side channel leakage include monitors, USB cables, memory, CPUs, etc., among which monitors are widely used for side channel covert communications. The most common method of modulating side channel leakage to establish a covert channel is to use special software to deliberately stimulate different components of the computer to emit enhanced side channel leakage, including electromagnetic radiation, acoustic leakage, optical leakage, thermal radiation, magnetic radiation, and even mechanical vibration.
[0004] In order to carry out covert communication, electromagnetic side channel leakage often propagates the fastest and farthest, but electromagnetic signals are easily affected by metal casings or other shielding measures, making the information transmission capability unstable and prone to bit errors due to interference during transmission; optical leakage, thermal radiation, magnetic leakage and mechanical vibration signals are not easy to be shielded, but due to the low transmission rate, it is difficult to support the transmission of large amounts of data. Therefore, it is an urgent problem to design a new covert communication method that meets the requirements of high transmission rate, high signal quality, and not easily affected by external factors, and to carry out reliable covert transmission. Summary of the invention
[0005] The technical problem to be solved by the present invention is to provide a covert communication method and system based on acoustic side channel leakage of liquid crystal displays in view of the deficiencies in the above-mentioned prior art, so as to solve the technical problem of covert communication in a physically isolated network.
[0006] The present invention adopts the following technical solutions:
[0007] The covert communication method based on the acoustic side channel leakage of the liquid crystal display comprises the following steps:
[0008] S1. Encode the sensitive information of covert communication into binary according to a predetermined encoding method and encapsulate it into a data frame;
[0009] S2, grouping the data frame obtained by encoding in step S1 into bits, and mapping each group to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then using MATLAB to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding;
[0010] S3, playing the video modulated and generated in step S2 on the LCD display at the transmitting end in a covert manner, and sending out the sensitive information in the form of capacitor howling;
[0011] S4. Use a microphone to receive the audio signal emitted in step S3, obtain the original data of sensitive information through demodulation and decoding, monitor the received audio signal, and switch to decoding mode when the Preamble segment of the audio signal is detected. Use a template matching algorithm based on harmonic features to demodulate the received signal, decode and perform error detection and correction on the demodulated data, recover the original data of sensitive information, and complete the covert communication based on the acoustic side channel leakage of the liquid crystal display.
[0012] Specifically, in step S1, the sensitive information of the covert communication is encoded into binary as follows:
[0013] S101, encode the original data of sensitive information to be sent into binary using 8-bit ASCII code, and add CRC at the end as the Payload field;
[0014] S102, encode the encoded data bit length into binary using 8-bit ASCII code, and add CRC at the end as the Configuration field, which is placed before the Payload field;
[0015] S103, performing RS encoding and channel interleaving on the Payload field obtained in step S101 and the Configuration field obtained in step S102, respectively, to improve the anti-interference capability during the transmission process and enhance the error correction capability and robustness of the decoding stage;
[0016] S104. Add a Preamble field as a precursor before the Configuration field obtained in step S103 to obtain a complete data frame.
[0017] Specifically, in step S2, the data encoding is modulated as follows:
[0018] S201, specifying a mathematical relationship F between the pixel height of the black and white stripes and the fundamental frequency of the capacitor howling;
[0019] S202, calculating the fundamental frequencies corresponding to stripes of different heights according to the mathematical relationship F obtained in step S201, selecting several stripe heights with fundamental frequency differences greater than 130 Hz and more harmonics in the range of 4 to 20 kHz as modulation symbols, and establishing a corresponding mapping table;
[0020] S203, the data frame obtained after encoding in step S201 is grouped according to the modulation rate predetermined by the sender and the receiver, and the encoding of each group is mapped to the corresponding stripe height as a symbol with reference to the mapping table preset in step S202, and the binary data frame is modulated into a string of symbol sequences, and a frame of black and white stripe image is generated for each symbol using MATLAB;
[0021] S204, the black and white stripe images generated in step S203 are superimposed frame by frame to generate a video, and the video frame rate can be selected to be 10 to 50 FPS according to actual communication requirements, and a higher frame rate can obtain a faster data transmission rate.
[0022] Furthermore, in step S201, the mathematical relationship F is specifically:
[0023]
[0024] Among them, Y H is the vertical resolution of the LCD display, S H is the pixel height of black and white stripes, R A The actual refresh rate of the screen.
[0025] Further, in step S202, the mapping table is as follows;
[0026]
[0027]
[0028] Furthermore, in step S204, the video frame rate is 10 to 50 FPS.
[0029] Specifically, in step S3, the concealment method is as follows:
[0030] In covert communication, the black and white striped video generated in step S2 is played on the display as the transmitter, so that the display power supply unit generates capacitive howling of the corresponding frequency and sends the data out; the receiving end is within 130cm from the transmitting end, and the capacitive howling is received and recorded by a microphone.
[0031] Specifically, step S4 is as follows:
[0032] S401, designing the number to be 2 according to the modulation rate n selected when encoding the information n Harmonic feature templates are used to obtain a template set T;
[0033] S402, the receiving end works in the monitoring mode, and when the preamble is detected, it switches to the decoding mode, samples the audio signal received by the microphone at a sampling rate equal to the video frame rate, and converts it to the frequency domain using a fast Fourier transform;
[0034] S403, convert the signal S into the frequency domain in step S402 a Use the harmonic feature template set T for demodulation, that is, use each template T in the set T i With signal S a Calculate the correlation coefficient r i , the resulting mutual correlation coefficient r i The symbol and code corresponding to the largest template is S a The demodulation result of
[0035] S404: When decoding the demodulation result in step S403, first decode the Configuration field to obtain the data length, then decode the Payload field according to the data length, and perform error detection and correction on the decoding result to restore the original data of the sensitive information.
[0036] Furthermore, in step S403, the correlation coefficient r i Specifically:
[0037]
[0038] Where τ=0,1,…,N, τ represents the mutual correlation coefficient r i The τth position in the sequence, S a )t(is the frequency domain signal of the sampling signal, T i is the i-th template of the cross-correlation templates.
[0039] In a second aspect, an embodiment of the present invention provides a covert communication system based on acoustic side channel leakage of a liquid crystal display, comprising:
[0040] The encoding module is used to encode the sensitive information of the covert communication into binary according to a predetermined encoding method, and encapsulate it into a data frame;
[0041] The modulation module is used to group the data frames encoded by the encoding module into bits, and correspond each group to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then use MATLAB to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding;
[0042] The sending module is used to play the video modulated by the modulation module on the LCD display of the sending end in a covert manner, and send out the sensitive information in the form of capacitor howling;
[0043] The receiving module is used to use a microphone to receive the audio signal sent by the sending module, obtain the original data of sensitive information through demodulation and decoding, monitor the received audio signal, and switch to decoding mode when the Preamble segment of the audio signal is detected. The received signal is demodulated using a template matching algorithm based on harmonic features, and the demodulated data is decoded and error-checked and corrected to recover the original data of sensitive information, thereby completing covert communication based on the acoustic side channel leakage of the LCD display.
[0044] Compared with the prior art, the present invention has at least the following beneficial effects:
[0045] The covert communication method based on the acoustic side channel leakage of the liquid crystal display creatively uses the capacitive howling of the capacitor of the power unit of the liquid crystal display as a carrier of sensitive information, and performs covert communication by modulating this acoustic side channel leakage. The quantitative relationship between the color distribution of the liquid crystal display pixel display and the capacitive howling frequency is studied and revealed, and a modulation method using black and white striped images of different pixel heights as symbols is proposed. The present invention uses acoustic leakage for covert communication, which can avoid the interference of traditional electromagnetic shielding measures, and improves the stability and transmission performance of communication while taking into account the concealment of communication.
[0046] Furthermore, by encoding sensitive information that needs to be transmitted covertly into binary, sensitive information in any format (such as documents, pictures, videos, etc.) can be converted into a bit stream that is easy to transmit, which is conducive to the unification of the encoding format by the communicating parties and reduces unnecessary format conversion overhead caused by inconsistent encoding formats.
[0047] Furthermore, it is noted that capacitor howling has very rich harmonic characteristics, and the capacitor howling caused by black and white stripes of different pixel heights has different harmonic characteristics. Therefore, the stripe pixel heights corresponding to several fundamental waves with more harmonics in the frequency range of 4kHz to 20kHz are selected to modulate the code, and a cross-correlation template matching algorithm for harmonic characteristics is used at the receiving end to demodulate the received signal. Specifically, the harmonic feature template library corresponding to the stripe height selected during modulation is used to perform cross-correlation calculation with the received signal to determine the demodulation result. The present invention uses harmonic features to demodulate the signal, which can avoid the influence of environmental noise to a greater extent, and at the same time can improve the demodulation performance of the system, and can obtain relatively accurate demodulation results even in the case of low signal-to-noise ratio, so that the covert communication has stronger anti-interference ability and higher signal quality.
[0048] Furthermore, through the study of the working principle and side channel leakage characteristics of the display, the calculation formula for the fundamental frequency F of the acoustic side channel leakage of the display is obtained. The frequency of the leakage signal is predicted through the mathematical relationship of F, and the corresponding harmonic feature template library is designed to demodulate the signal.
[0049] Furthermore, modulation rates of 2bit, 3bit and 4bit were implemented in the system respectively. Specifically, black and white stripe images of different stripe heights were mapped to binary codes, and a coding mapping table was established. In the mapping table, different binary codes were corresponded to images of different stripe heights, and the stripe distances between the stripe heights were dispersed as much as possible. The advantage of this is that it reduces the possibility that the receiving end cannot correctly identify acoustic signals of different frequencies due to the fact that the acoustic leakage frequencies corresponding to images of similar stripe heights are too close.
[0050] Furthermore, in the actual communication process, the transmission rate of this system is equivalent to the frame rate of the video, and a video frame rate of 10 to 50 FPS is achieved in the system implementation. For users, the higher the video frame rate is set, the faster the rate of transmitting sensitive information is; the lower the video frame rate is, the higher the reliability of transmitting sensitive information is.
[0051] Furthermore, since the system uses the capacitive howling noise of the display as a medium for covert communication, and this acoustic signal is weak and cannot be detected by the human ear, but can be captured by devices such as microphones, it is possible to covertly transmit sensitive information in a physically isolated environment without being discovered by nearby staff.
[0052] Furthermore, the demodulation process described in step S4 identifies the leading segment Peamble, demodulates using the harmonic feature template set T, obtains the data length in the Configuration field, decodes the Payload field according to the data length, and performs error detection and correction on the decoding result. Finally, the system receiving end can effectively demodulate the received acoustic leakage signal to obtain the sensitive information it carries.
[0053] Furthermore, the correlation coefficient r i is the sampling signal S a Cross-correlation template T with different frequencies i The result of cross-correlation calculation reflects the relationship between the sampled signal and the T i The similarity of the two cross-correlation templates. i The larger the value, the closer the frequency of the sampling signal is to the Tth i The frequency corresponding to the cross-correlation template. Therefore, the receiving end of the system can identify the received acoustic signal frequency through the cross-correlation calculation process.
[0054] It can be understood that the beneficial effects of the second aspect mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.
[0055] In summary, the present invention has the characteristics of higher data transmission rate, higher signal quality, and is not easily affected by external factors. It fully considers the practicality and applicability of the system, and can perform reliable covert transmission under environmental noise of up to 55dB, achieving a communication distance of up to 130cm and a maximum throughput of 170bps.
[0056] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] Figure 1 Provides an overall flow chart of the covert communication method of the present invention;
[0058] Figure 2 Provides a module structure diagram of a covert communication system for the present invention;
[0059] Figure 3 A spectrum diagram of the capacitive howling acoustic side channel leakage corresponding to the black and white stripes at each pixel height provided in an embodiment of the present invention;
[0060] Figure 4 A diagram of a process of encoding and modulating sensitive information at a transmitting end provided in an embodiment of the present invention;
[0061] Figure 5 A diagram of a process of demodulating and decoding an audio signal at a receiving end provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0062] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0063] In the description of the present invention, it should be understood that the terms “include” and “comprises” indicate the presence of described features, wholes, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or collections thereof.
[0064] It should also be understood that the terms used in the present specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.
[0065] It should be further understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects are in an "or" relationship.
[0066] It should be understood that, although the terms first, second, third, etc. may be used to describe preset ranges, etc. in the embodiments of the present invention, these preset ranges should not be limited to these terms. These terms are only used to distinguish preset ranges from each other. For example, without departing from the scope of the embodiments of the present invention, the first preset range may also be referred to as the second preset range, and similarly, the second preset range may also be referred to as the first preset range.
[0067] The word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0068] Various structural schematic diagrams of the embodiments disclosed in the present invention are shown in the accompanying drawings. These figures are not drawn to scale, and some details are magnified and some details may be omitted for the purpose of clear expression. The shapes of various regions and layers shown in the figures and the relative sizes and positional relationships therebetween are only exemplary, and may deviate in practice due to manufacturing tolerances or technical limitations, and those skilled in the art may additionally design regions / layers with different shapes, sizes, and relative positions according to actual needs.
[0069] The present invention provides a covert communication method based on acoustic side channel leakage of a liquid crystal display, which utilizes a new acoustic side channel on a power supply unit of a liquid crystal display to modulate and enhance sensitive information, and establish a covert communication channel that is not interfered by electromagnetic shielding. When a liquid crystal display is used to display different images, the capacitor in its power supply unit leaks capacitor howling of different frequencies due to the piezoelectric effect (which is almost imperceptible to the human ear but can be captured by a microphone) to establish an acoustic side channel, thereby realizing the covert transmission of sensitive information; the principle that the frequency of capacitor howling is affected by the color displayed by the pixels of the liquid crystal display is used to make the pixels alternately display black and white to enhance the amplitude of capacitor howling, thereby improving the signal-to-noise ratio of the transmitted signal; the principle that the fundamental frequency of capacitor howling can be quantified and controlled by displaying black and white striped images of different pixel heights on the display is used to obtain the mathematical relationship between the fundamental frequency of capacitor howling and the displayed image, thereby selecting the pixel height of the stripes to modulate the encoded sensitive information; the capacitor howling acoustic leakage has rich harmonic characteristics, and due to the mapping relationship between the fundamental frequency and the stripe height, each pixel height corresponds to a unique harmonic feature. Considering that harmonics have higher frequencies and are not easily interfered by environmental noise, demodulating the received signal based on the harmonic characteristics can effectively improve the demodulation capability in the case of low signal-to-noise ratio. The method uses a cross-correlation template for the harmonic characteristics to perform cross-correlation calculation with the received signal to demodulate the received signal.
[0070] Compared with electromagnetic side channel leakage, the present invention can circumvent electromagnetic shielding, greatly improve the signal's anti-interference ability and communication concealment, and transmit sensitive information under an environmental noise of up to 55dB. Compared with optical leakage and thermal radiation, it has a higher information transmission rate, and can achieve a communication distance of up to 130cm and a maximum throughput of 170bps.
[0071] See also Figure 1 The present invention provides a covert communication method based on acoustic side channel leakage of a liquid crystal display, comprising the following steps:
[0072] S1. Encoding sensitive information
[0073] The sensitive information to be sent is encoded into a data frame, including a preamble segment Preamble, a configuration information segment Configuration and a data segment Poaload; the specific encoding technology uses RS (Reed-solomon) encoding and channel interleaving technology.
[0074] The specific steps to encode sensitive information are:
[0075] S101, encode the original data of sensitive information to be sent into binary using 8-bit ASCII code, and add CRC (cyclic checksum) at the end as the Payload field;
[0076] S102, encode the encoded data bit length into binary using 8-bit ASCII code, and add CRC at the end as the Configuration field, which is placed before the Payload field;
[0077] S103, performing RS encoding (Reed Solomon code) and channel interleaving on the two fields respectively, so as to improve the anti-interference capability during the transmission process and enhance the error correction capability and robustness of the decoding stage;
[0078] S104. Finally, add the Preamble field before the Configuration field as a precursor to obtain a complete data frame.
[0079] S2, Modulate special video
[0080] The encoded data frame is bit-grouped in n-bit binary format, and each group is modulated into a black and white stripe image of corresponding stripe height according to a predetermined mapping table, and then a corresponding black and white stripe image sequence is generated according to the data sequence to be sent, and a special video is generated at a predetermined video frame rate.
[0081] The specific steps of modulating and generating video are:
[0082] S201, specify the mathematical relationship between the black and white stripe pixel height and the fundamental frequency of capacitor howling. If the vertical resolution of the LCD display is Y H , the pixel height of black and white stripes is S H , the actual screen refresh rate is R A According to experimental measurements, the fundamental frequency F of capacitor howling is calculated as follows:
[0083]
[0084] For different models of LCD monitors from different manufacturers, the calculation method should be adjusted appropriately to ensure the accuracy of the calculation;
[0085] S202, according to the calculation method of the fundamental frequency F of the capacitor howling in step S201, calculate the fundamental frequencies corresponding to the stripes of different heights, select several stripe heights with large frequency differences and more harmonics in the range of 4 to 20 kHz as modulation symbols, and establish the corresponding mapping table as follows;
[0086]
[0087] S203, the data frame obtained after encoding in step S201 is grouped according to the modulation rate predetermined by the sender and the receiver, and the encoding of each group is mapped to the corresponding stripe height as a symbol with reference to the mapping table preset in step S202, so as to modulate the binary data frame into a string of symbol sequences, and use matlab to generate a frame of black and white stripe image for each symbol;
[0088] S204, the generated black and white stripe images are superimposed frame by frame to generate a video, and the video frame rate can be selected to be 10 to 50 FPS according to actual communication requirements, and a higher frame rate can obtain a faster data transmission rate.
[0089] S3, play video and send data
[0090] By playing the specially generated video in full screen on an LCD monitor, the monitor is controlled to emit modulated acoustic leakage, sending out sensitive information in the form of capacitive howling.
[0091] The specific characteristics of sending data when playing a video are as follows:
[0092] In covert communication, the black and white striped video generated in step S2 is played on the display as the transmitter, so that the display power supply unit generates capacitive howling of the corresponding frequency and sends the data out; the receiving end is within 130cm from the transmitting end, and the capacitive howling is received and recorded by a microphone.
[0093] S4. Demodulate the received signal based on the cross-correlation template matching of the harmonic characteristics, perform error detection, correction and decoding on the demodulated data, so as to recover the original data of the sensitive information.
[0094] After preprocessing the audio data received by the microphone, the frequency domain signal of the sampled signal is correlated with each template in the harmonic feature template library, and the signal demodulation result is determined based on the calculation result.
[0095] Template matching based on harmonic features demodulates the received signal. The specific steps are:
[0096] S401, designing the number to be 2 according to the modulation rate n selected when encoding the information nIf 2-bit encoding is used, 4 templates are designed. If 3-bit encoding is used, 8 templates are designed. And so on. A template set T is obtained. Then the i-th template T in the set T is i The design method is:
[0097]
[0098] Where F = {F i ,2F i ,3F i ,4F i} is the four equally spaced harmonic frequencies corresponding to the ith symbol, which can be obtained based on the fundamental frequency calculated in step 2. N is the number of frequency domain points of the received signal, which is also the template T i Length;
[0099] S402, the receiving module of the receiving end has been working in the monitoring mode. Once the receiving end detects the preamble, it switches to the decoding mode, samples the audio signal received by the microphone at a sampling rate equal to the video frame rate, and converts it to the frequency domain using a fast Fourier transform;
[0100] S403, convert the signal S into the frequency domain a Use the harmonic feature template set T for demodulation, that is, use each template T in the set T i With signal S a Calculate the correlation coefficient r i , then the mutual correlation coefficient r i The symbol and code corresponding to the largest template is S a The demodulation result of i The specific calculation method is:
[0101]
[0102] Where τ represents the mutual correlation coefficient r i The τth position in the sequence.
[0103] S404. Restore sensitive information.
[0104] The specific characteristics of sensitive information are:
[0105] When the demodulation result in step S403 is further decoded, the Configuration field is first decoded to obtain the data length, and then the Payload field is decoded according to the data length, and error detection and correction are performed on the decoding result to restore the original data of the sensitive information. However, if it is found that the bit error rate is too high to pass the CRC check, the data frame is discarded and the receiving module is switched back to the monitoring mode.
[0106] In still another embodiment of the present invention, a covert communication system based on acoustic side channel leakage of a liquid crystal display is provided. The system can be used to implement the above-mentioned covert communication method based on acoustic side channel leakage of a liquid crystal display. Specifically, the covert communication system based on acoustic side channel leakage of a liquid crystal display includes a coding module, a modulation module, a sending module and a receiving module.
[0107] The encoding module is used to encode the sensitive information of the covert communication into binary according to a predetermined encoding method and encapsulate it into a data frame;
[0108] The modulation module is used to group the data frames encoded by the encoding module into bits, and correspond each group to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then use MATLAB to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding;
[0109] The sending module is used to play the video modulated by the modulation module on the LCD display of the sending end in a covert manner, and send out the sensitive information in the form of capacitor howling;
[0110] The receiving module is used to use a microphone to receive the audio signal sent by the sending module, obtain the original data of sensitive information through demodulation and decoding, monitor the received audio signal, and switch to decoding mode when the Preamble segment of the audio signal is detected. The received signal is demodulated using a template matching algorithm based on harmonic features, and the demodulated data is decoded and error-checked and corrected to recover the original data of sensitive information, thereby completing covert communication based on the acoustic side channel leakage of the LCD display.
[0111] In another embodiment of the present invention, a terminal device is provided, the terminal device includes a processor and a memory, the memory is used to store a computer program, the computer program includes program instructions, and the processor is used to execute the program instructions stored in the computer storage medium. The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. It is the computing core and control core of the terminal, which is suitable for implementing one or more instructions, and is specifically suitable for loading and executing one or more instructions to implement the corresponding method flow or corresponding function; the processor described in the embodiment of the present invention can be used for the operation of the covert communication method based on the acoustic side channel leakage of the liquid crystal display, including:
[0112] The sensitive information of covert communication is encoded into binary according to a predetermined encoding method and encapsulated into a data frame; the encoded data frame is bit-grouped, and each group is mapped to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then MATLAB is used to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding; the modulated video is played on the LCD display at the transmitting end in a covert manner, and the sensitive information is sent out in the form of capacitive howling; a microphone is used to receive the emitted audio signal, and the original data of the sensitive information is obtained through demodulation and decoding, and the received audio signal is monitored. When the Preamble segment of the audio signal is detected, the decoding mode is switched to, and the received signal is demodulated using a template matching algorithm based on harmonic features, and the demodulated data is decoded and error-checked and corrected to restore the original data of the sensitive information, thereby completing the covert communication based on the acoustic side channel leakage of the LCD display.
[0113] In another embodiment of the present invention, the present invention further provides a storage medium, specifically a computer-readable storage medium (Memory), which is a memory device in a terminal device for storing programs and data. It can be understood that the computer-readable storage medium here can include both the built-in storage medium in the terminal device and the extended storage medium supported by the terminal device. The computer-readable storage medium provides a storage space, which stores the operating system of the terminal. In addition, one or more instructions suitable for being loaded and executed by the processor are also stored in the storage space, and these instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory (Non-Volatile Memory), such as at least one disk memory.
[0114] One or more instructions stored in a computer-readable storage medium may be loaded and executed by a processor to implement the corresponding steps of the covert communication method based on acoustic side channel leakage of a liquid crystal display in the above embodiment; one or more instructions in the computer-readable storage medium are loaded and executed by the processor in the following steps:
[0115] The sensitive information of covert communication is encoded into binary according to a predetermined encoding method and encapsulated into a data frame; the encoded data frame is bit-grouped, and each group is mapped to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then MATLAB is used to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding; the modulated video is played on the LCD display at the transmitting end in a covert manner, and the sensitive information is sent out in the form of capacitive howling; a microphone is used to receive the emitted audio signal, and the original data of the sensitive information is obtained through demodulation and decoding, and the received audio signal is monitored. When the Preamble segment of the audio signal is detected, the decoding mode is switched to, and the received signal is demodulated using a template matching algorithm based on harmonic features, and the demodulated data is decoded and error-checked and corrected to restore the original data of the sensitive information, thereby completing the covert communication based on the acoustic side channel leakage of the LCD display.
[0116] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. The components of the embodiments of the present invention described and shown in the drawings here can usually be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.
[0117] Example 1
[0118] The covert communication method and system based on acoustic side channel leakage of liquid crystal display proposed by the present invention mainly comprises the following steps at the transmitting end: after encoding sensitive information, modulating the data frame using black and white stripe images with different pixel heights; the specific steps are as follows:
[0119] (1) Encode the original sensitive information to be sent into binary using 8-bit ASCII code and add a CRC (cyclic checksum) at the end as the Payload field;
[0120] (2) Encode the encoded data bit length into binary using 8-bit ASCII code, and add CRC at the end as the Configuration field, which is placed before the Payload field;
[0121] (3) Both fields are subjected to RS encoding (Reed Solomon coding) and channel interleaving to improve the anti-interference capability during transmission and enhance the error correction capability and robustness of the decoding stage;
[0122] (4) Finally, add the Preamble field before the Configuration field as a precursor to obtain a complete data frame;
[0123] (5) The mathematical relationship between the pixel height of black and white stripes and the fundamental frequency of capacitor whistle is defined, such as Figure 3 As shown, the spectrum of the capacitor howling corresponding to the black and white stripes with a height of 4 pixels to 31 pixels. If the vertical resolution of the LCD display is Y H , the pixel height of black and white stripes is S H , the actual screen refresh rate is R A ,According to experimental measurements, for different models of LCD monitors from different manufacturers, in order to ensure the accuracy of the calculation, the calculation method should be adjusted appropriately;
[0124] (6) According to the calculation method of the fundamental frequency F of the capacitor howling in (5), the fundamental frequencies corresponding to the stripes of different heights are calculated, and several stripe heights with large frequency differences and more harmonics in the range of 4kHz to 20kHz are selected as modulation symbols, and the corresponding mapping table is established as follows;
[0125] (7) The data frame obtained after encoding in (4) is grouped into bits according to the modulation rate predetermined by the sender and the receiver, and the encoding of each group is mapped to the corresponding stripe height as a symbol with reference to the mapping table preset in (6), so as to modulate the binary data frame into a string of symbol sequences, and use mtalab to generate a corresponding black and white stripe image for each symbol;
[0126] (8) The generated black and white stripe images are superimposed frame by frame to generate a video. The video frame rate can be selected from 10FPS to 50FPS according to actual communication requirements. A higher frame rate can achieve a faster data transmission rate.
[0127] (9) The black and white striped video generated by (8) is played in a covert manner on a display as the transmitter, so that the display power supply unit generates a capacitive howling of the corresponding frequency and sends the data out. The receiving end receives and records the capacitive howling with a microphone within a range of 130 cm from the transmitting end, and thus receives sensitive information.
[0128] like Figure 4 As shown, this is a diagram of the process of encoding and modulating sensitive information at the transmitter.
[0129] Example 2
[0130] The covert communication method and system based on the acoustic side channel leakage of the liquid crystal display proposed by the present invention mainly demodulates the received capacitor howling audio signal using a template matching algorithm based on harmonic features at the receiving end. The specific steps are as follows:
[0131] (1) The number of designs is 2 according to the modulation rate n predetermined when encoding the information. n If 2-bit encoding is used, 4 templates are designed. If 3-bit encoding is used, 8 templates are designed. And so on, a template set T is obtained.
[0132] (2) The receiving module at the receiving end always works in the monitoring mode. Once the receiving end detects the preamble, it switches to the decoding mode, samples the audio signal received by the microphone at a sampling rate equal to the predetermined video frame rate, and converts it into the frequency domain using the fast Fourier transform;
[0133] (3) The signal S converted to the frequency domain aUse the harmonic feature template set T for demodulation, that is, use each template T in the set T i With signal S a Calculate the correlation coefficient r i , then the mutual correlation coefficient r i The symbol and code corresponding to the largest template is S a The demodulation result of
[0134] (4) Furthermore, when decoding the demodulation result in (3), the Configuration field is first decoded to obtain the data length, and then the Payload field is decoded based on the data length. Error detection and correction are performed on the decoding result to restore the original data of the sensitive information. However, if it is found that the bit error rate is too high to pass the CRC check, the data frame is discarded and the receiving module is switched back to the listening mode.
[0135] like Figure 5 As shown, it is a diagram of the process of demodulating and decoding the audio signal at the receiving end.
[0136] In summary, the present invention provides a covert communication method and system based on the acoustic side channel leakage of liquid crystal displays, and provides a new method for covert communication in a physically isolated network system. Compared with the existing technology, it has the characteristics of higher data transmission rate, higher signal quality, and is not easily interfered by external factors. It fully considers the practicality and applicability of the system, can perform reliable covert transmission under normal environmental noise, and ensures the transmission performance and stability of covert communication.
[0137] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0138] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0139] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0140] In the embodiments provided by the present invention, it should be understood that the disclosed devices / terminals and methods can be implemented in other ways. For example, the device / terminal embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0141] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0142] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0143] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.
[0144] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0145] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0146] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0147] The above contents are only for explaining the technical idea of the present invention and cannot be used to limit the protection scope of the present invention. Any changes made on the basis of the technical solution in accordance with the technical idea proposed by the present invention shall fall within the protection scope of the claims of the present invention.
Claims
1. A covert communication method based on acoustic side channel leakage of liquid crystal display, characterized in that: The following steps are involved: S1. Encode the sensitive information of covert communication into binary according to a predetermined encoding method and encapsulate it into a data frame; S2, the data frame obtained by encoding in step S1 is grouped into bits, and each group is mapped to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then matlab is used to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding. The modulation of the data encoding is specifically as follows: S201. Specify the mathematical relationship between the pixel height of black and white stripes and the fundamental frequency of capacitor howling , the mathematical relationship Specifically: in, is the vertical resolution of the LCD display, is the pixel height of black and white stripes, is the actual refresh rate of the screen; S202: The mathematical relationship obtained in step S201 Calculate the fundamental frequencies corresponding to stripes of different heights, select several stripe heights with fundamental frequency differences greater than 130Hz and more harmonics in the range of 4-20kHz as modulation symbols, and establish a corresponding mapping table; S203, the data frame obtained after encoding in step S201 is grouped according to the modulation rate predetermined by the sender and the receiver, and the encoding of each group is mapped to the corresponding stripe height as a symbol with reference to the mapping table preset in step S202, and the binary data frame is modulated into a string of symbol sequences, and a frame of black and white stripe image is generated for each symbol using MATLAB; S204, the black and white stripe images generated in step S203 are superimposed frame by frame to generate a video, and the video frame rate can be selected from 10 to 50 FPS according to actual communication requirements, and a higher frame rate can obtain a faster data transmission rate; S3, playing the black and white stripe video modulated and generated in step S2 on the LCD display at the transmitting end in a covert manner, and sending out the sensitive information in the form of capacitor howling; S4. Use a microphone to receive the audio signal emitted in step S3, obtain the original data of sensitive information through demodulation and decoding, monitor the received audio signal, and switch to decoding mode when the Preamble segment of the audio signal is detected. Use a template matching algorithm based on harmonic features to demodulate the received signal, decode and perform error detection and correction on the demodulated data, recover the original data of sensitive information, and complete the covert communication based on the acoustic side channel leakage of the liquid crystal display.
2. The covert communication method based on acoustic side channel leakage of liquid crystal display according to claim 1, characterized in that: In step S1, the sensitive information of covert communication is encoded into binary as follows: S101, encode the original data of sensitive information to be sent into binary using 8-bit ASCII code, and add CRC at the end as the Payload field; S102, encode the encoded data bit length into binary using 8-bit ASCII code, and add CRC at the end as the Configuration field, which is placed before the Payload field; S103, performing RS encoding and channel interleaving on the Payload field obtained in step S101 and the Configuration field obtained in step S102, respectively, to improve the anti-interference capability during the transmission process and enhance the error correction capability and robustness of the decoding stage; S104. Add a Preamble field as a precursor before the Configuration field obtained in step S103 to obtain a complete data frame.
3. The covert communication method based on acoustic side channel leakage of liquid crystal display according to claim 1, characterized in that: In step S204, the video frame rate is 10-50 FPS.
4. The covert communication method based on acoustic side channel leakage of a liquid crystal display according to claim 1, characterized in that: In step S3, the concealment method is specifically: Play the black and white stripe video generated in step S2 on the display as the transmitter in the covert communication, so that the display power supply unit generates a capacitor howling of a corresponding frequency and sends the data out; The receiving end is within 130cm of the transmitting end, and uses a microphone to receive and record the capacitor howling.
5. The covert communication method based on acoustic side channel leakage of liquid crystal display according to claim 1, characterized in that: Step S4 is specifically as follows: S401, designing the number to be 2 according to the modulation rate n selected when encoding the information n Harmonic feature templates are used to obtain a template set T; S402, the receiving end works in the monitoring mode, and when the preamble is detected, it switches to the decoding mode, samples the audio signal received by the microphone at a sampling rate equal to the video frame rate, and converts it to the frequency domain using a fast Fourier transform; S403: convert the signal in step S402 into the frequency domain Use the harmonic feature template set T for demodulation, that is, use each template in the set T With signal Calculate the correlation coefficient , the resulting mutual correlation coefficient The symbol and code corresponding to the largest template are The demodulation result of S404: When decoding the demodulation result in step S403, first decode the Configuration field to obtain the data length, then decode the Payload field according to the data length, and perform error detection and correction on the decoding result to restore the original data of the sensitive information.
6. The covert communication method based on acoustic side channel leakage of liquid crystal display according to claim 5, characterized in that: In step S403, the correlation coefficient Specifically: in, , Represents the mutual correlation coefficient The first Bit, is the frequency domain signal of the sampled signal, The first templates.
7. A covert communication system based on acoustic side channel leakage of liquid crystal display, characterized in that: include: The encoding module is used to encode the sensitive information of the covert communication into binary according to a predetermined encoding method, and encapsulate it into a data frame; The modulation module is used to group the data frames encoded by the encoding module into bits, and correspond each group to the corresponding black and white stripe pixel height according to a predetermined mapping table to obtain a symbol, and then use MATLAB to generate a black and white stripe video with a predetermined frame rate from the obtained symbol sequence to complete the modulation of the data encoding. The modulation of the data encoding is specifically as follows: The mathematical relationship between the pixel height of black and white stripes and the fundamental frequency of capacitor howling is specified , according to the obtained mathematical relationship Calculate the fundamental frequencies corresponding to stripes of different heights, select several stripe heights with a fundamental frequency difference of more than 130Hz and more harmonics in the range of 4-20kHz as modulation symbols, and establish a corresponding mapping table; group the encoded data frames according to the modulation rate predetermined by the sender and receiver, correspond the encoding of each group to the corresponding stripe height as a symbol with reference to the mapping table preset in step S202, modulate the binary data frame into a string of symbol sequences, and use matlab to generate a frame of black and white stripe image for each symbol; superimpose the generated black and white stripe images frame by frame to generate a video, and the video frame rate can be selected from 10 to 50FPS according to the actual communication requirements, and a higher frame rate can obtain a faster data transmission rate; Mathematical Relationship Specifically: in, is the vertical resolution of the LCD display, is the pixel height of black and white stripes, is the actual refresh rate of the screen; The sending module is used to play the black and white stripe video modulated by the modulation module on the LCD display at the sending end in a covert manner, and send out sensitive information in the form of capacitor howling; The receiving module is used to use a microphone to receive the audio signal sent by the sending module, obtain the original data of sensitive information through demodulation and decoding, monitor the received audio signal, and switch to decoding mode when the Preamble segment of the audio signal is detected. The received signal is demodulated using a template matching algorithm based on harmonic features, and the demodulated data is decoded and error-checked and corrected to recover the original data of sensitive information, thereby completing covert communication based on the acoustic side channel leakage of the LCD display.
8. The covert communication system based on liquid crystal display acoustic side channel leakage according to claim 7, characterized in that: In the encoding module, the sensitive information of covert communication is encoded into binary as follows: The original data of sensitive information to be sent is encoded into binary using 8-bit ASCII code, and CRC is added at the end as the Payload field; the encoded data bit length is encoded into binary using 8-bit ASCII code, and CRC is added at the end as the Configuration field, which is placed before the Payload field; the obtained Payload field and the obtained Configuration field are RS encoded and channel interleaved respectively to improve the anti-interference ability during the transmission process and enhance the error correction ability and robustness of the decoding stage; the Preamble field is added as a forerunner before the obtained Configuration field to obtain a complete data frame.
9. The covert communication system based on liquid crystal display acoustic side channel leakage according to claim 7, characterized in that: In the sending module, the concealment method is as follows: Play the black and white stripe video generated in step S2 on the display as the transmitter in the covert communication, so that the display power supply unit generates a capacitor howling of a corresponding frequency and sends the data out; The receiving end is within 130cm of the transmitting end, and uses a microphone to receive and record the capacitor howling.
10. The covert communication system based on liquid crystal display acoustic side channel leakage according to claim 7, characterized in that: The receiving module is as follows: The number of designs is 2 according to the modulation rate n selected when encoding the information. n The harmonic feature templates are used to obtain a set of templates T; the receiving end works in the monitoring mode, and when the preamble is detected, it switches to the decoding mode, samples the audio signal received by the microphone at a sampling rate equal to the video frame rate, and converts it to the frequency domain using the fast Fourier transform; the signal converted to the frequency domain Use the harmonic feature template set T for demodulation, that is, use each template in the set T With signal Calculate the correlation coefficient , the resulting mutual correlation coefficient The symbol and code corresponding to the largest template are When decoding the demodulation result, the Configuration field is first decoded to obtain the data length, and then the Payload field is decoded according to the data length. Error detection and correction are performed on the decoding result to restore the original data of the sensitive information. Mutual Correlation Coefficient Specifically: in, , Represents the mutual correlation coefficient The first Bit, is the frequency domain signal of the sampled signal, The first templates.
