Multi-channel synchronous transmission method of wireless audio and video transmission device

Abstract

The invention discloses a multi-channel synchronous transmission method of a wireless audio and video transmission device, and relates to the related technical field of audio and video transmission, and the method comprises the steps: carrying out the synchronous collection of audio and video data of a target site through a plurality of front-end cameras; carrying out data dynamic compression and staggered data encryption; transmitting the audio and video data set to a multi-channel dual-mode receiver in the form of a radio signal; demodulating to obtain a plurality of encrypted real-time audio and video data sets; and performing time delay analysis according to the plurality of acquisition timestamps, and synchronously transmitting the plurality of encrypted real-time audio and video data sets back to a remote platform by using a network according to an analysis result. The technical problems that in the prior art, multi-channel audio and video data are poor in synchronism, large in transmission delay and low in bandwidth utilization rate are solved, efficient synchronous transmission of the multi-channel audio and video data is achieved through low-frequency-band wireless communication with the high penetrating diffraction capacity, and the transmission efficiency is improved. The technical effects of improving the transmission efficiency of the multi-channel audio and video data, ensuring the data synchronism and reducing the time delay are achieved.

Description

Technical Field

[0001] The present application relates to the technical field related to audio and video transmission, and in particular to a multi-channel synchronous transmission method for a wireless audio and video transmission device. Background Art

[0002] With the continuous development of wireless communication technology, the transmission of audio and video data has become an indispensable part of modern communication. Especially in the application scenarios of multi-channel audio and video transmission, such as conference records, telemedicine, drone live broadcast, etc., it is necessary to transmit audio and video data from multiple signal sources at the same time, which usually faces technical difficulties such as signal synchronization, data transmission delay, and transmission efficiency. How to achieve efficient multi-channel synchronous audio and video data transmission has become an important research direction in the field of wireless audio and video transmission. However, traditional wireless audio and video transmission methods usually rely on single-path transmission or parallel data transmission through multiple channels. When facing large amounts of data transmission, there are often problems such as large delays, synchronization difficulties, and insufficient network bandwidth utilization. For example, the data collected by multiple cameras needs to ensure synchronization, but during the signal transmission process, there may be delay differences between different channels, resulting in the inability of the receiving end to achieve accurate synchronization.

[0003] At present, relevant technologies still have technical problems such as poor synchronization of multi-channel audio and video data, large transmission delay, and low bandwidth utilization. Summary of the invention

[0004] The present application solves the technical problems of poor synchronization of multi-channel audio and video data, large transmission delay and low bandwidth utilization existing in the prior art by providing a multi-channel synchronous transmission method for a wireless audio and video transmission device. The application realizes efficient synchronous transmission of multi-channel audio and video data by penetrating low-frequency wireless communications with strong diffraction capability, thereby achieving the technical effect of improving the efficiency of multi-channel audio and video data transmission, ensuring data synchronization and reducing delay.

[0005] The present application provides a multi-channel synchronous transmission method for a wireless audio and video transmission device, comprising: using a plurality of front-end cameras to synchronously collect audio and video data of a target scene to obtain a plurality of real-time audio and video data sets; traversing the plurality of real-time audio and video data sets to perform dynamic data compression and staggered data encryption to obtain a plurality of encrypted real-time audio and video data sets after preprocessing; the plurality of front-end cameras use low-frequency wireless communication to transmit the plurality of encrypted real-time audio and video data sets in the form of a plurality of radio signals to a multi-channel dual-mode receiver; the multi-channel dual-mode receiver simultaneously receives the plurality of radio signals and performs demodulation to obtain a plurality of encrypted real-time audio and video data sets; obtaining a plurality of acquisition timestamps of the plurality of encrypted real-time audio and video data sets, the multi-channel dual-mode receiver performs delay analysis according to the plurality of acquisition timestamps, and according to the analysis results, synchronously transmits the plurality of encrypted real-time audio and video data sets back to a remote platform using a network.

[0006] In a possible implementation, the several real-time audio and video data sets are traversed to perform dynamic data compression and staggered data encryption to obtain several encrypted real-time audio and video data sets after preprocessing, and the following processing is also performed: the first frame real-time audio and video data in the several real-time audio and video data sets are respectively used as several first key frame real-time audio and video data; the several first key frame real-time audio and video data are used as comparison objects, and the several real-time audio and video data sets are dynamically compressed to obtain several key frame real-time audio and video data sets; the several key frame real-time audio and video data sets are staggered data encryption to obtain several encrypted real-time audio and video data sets after preprocessing.

[0007] In a possible implementation, the several first key frame real-time audio and video data are taken as comparison objects, and the several real-time audio and video data sets are dynamically compressed to obtain several key frame real-time audio and video data sets. The following processing is also performed: the several first key frame real-time audio and video data are taken as comparison objects, and similarity recognition is performed on each frame of real-time audio and video data located after the several first key frame real-time audio and video data in the several real-time audio and video data sets to determine several inter-frame similarity sets; a preset similarity threshold is obtained, and the data corresponding to the first inter-frame similarity greater than or equal to the preset similarity threshold in the several inter-frame similarity sets is taken as several second key frame real-time audio and video data; the several second key frame real-time audio and video data are updated as comparison objects, and so on, until the several last frames of real-time audio and video data of the several real-time audio and video data sets, to obtain several key frame real-time audio and video data sets.

[0008] In a possible implementation, the several key frame real-time audio and video data sets are staggeredly encrypted to obtain several encrypted real-time audio and video data sets after preprocessing, and the following processing is also performed: the several key frame real-time audio and video data sets are encrypted separately using the AES encryption algorithm to obtain several encryption and decryption key pairs; several historical encryption and decryption key pair sets of the several front-end cameras in the historical time window are traversed; based on the several historical encryption and decryption key pair sets, the several encryption and decryption key pairs are authenticated for staggered data encryption; if the authentication fails, return to step one and regenerate several encryption and decryption key pairs; if the authentication passes, the several encryption and decryption key pairs are used to encrypt the data to obtain the several encrypted real-time audio and video data.

[0009] In a possible implementation, the data encryption authentication of the several encryption and decryption key pairs is performed in a staggered manner based on the several historical encryption and decryption key pair sets, and the following processing is also performed: the similarities of the several encryption and decryption key pairs and the several historical encryption and decryption key pair sets are respectively calculated to obtain several key similarity sets; it is determined whether the several key similarity sets have a key similarity greater than or equal to a preset key similarity threshold, and if so, the authentication fails.

[0010] In a possible implementation, the multi-channel dual-mode receiver simultaneously receives the multiple radio signals, and demodulates them to obtain multiple encrypted real-time audio and video data sets, and also performs the following processing: using the multi-channel dual-mode receiver to receive the multiple radio signals in parallel through multiple receiving channels; performing signal gain control and filtering on the multiple received radio signals to obtain multiple enhanced radio signals; and using a demodulation algorithm to demodulate the multiple enhanced radio signals to obtain the multiple encrypted real-time audio and video data sets.

[0011] In a possible implementation, the multi-channel synchronous transmission method of the wireless audio and video transmission device also performs the following processing: the remote platform decrypts and decodes the several encrypted real-time audio and video data sets to obtain several real-time audio and video data sets in a playable format.

[0012] In a possible implementation, the multi-channel synchronous transmission method of the wireless audio and video transmission device also performs the following processing: when there are multiple user battery life optimization targets, obtain a preset penalty coefficient for each user battery life optimization target, and the preset penalty coefficient is proportional to the influence of the battery life optimization target; according to the correspondence between the preset penalty coefficient and the user battery life optimization target, construct a penalty evaluation function, add the penalty evaluation function to the target evaluation function, and perform optimization target parameter control optimization.

[0013] The multi-channel synchronous transmission method of the wireless audio and video transmission device proposed in this application is intended to use several front-end cameras to synchronously collect audio and video data of the target scene; perform dynamic data compression and staggered data encryption; transmit the audio and video data set to a multi-channel dual-mode receiver by radio signal; perform demodulation to obtain several encrypted real-time audio and video data sets; perform delay analysis based on several acquisition timestamps, and use the network to synchronously transmit several encrypted real-time audio and video data sets back to the remote platform based on the analysis results. The technical problems of poor synchronization of multi-channel audio and video data, large transmission delay, and low bandwidth utilization in the prior art are solved, and the efficient synchronous transmission of multi-channel audio and video data is realized through low-frequency wireless communication with strong penetrating diffraction ability, achieving the technical effect of improving the transmission efficiency of multi-channel audio and video data, ensuring data synchronization, and reducing delay. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the accompanying drawings of the embodiment of the present invention will be briefly introduced below. A flow chart is used in the present application to illustrate the operations performed by the system according to the embodiment of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, various steps can be processed in reverse order or simultaneously as needed. At the same time, other operations can also be added to these processes, or one or more operations can be removed from these processes.

[0015] Figure 1 A schematic flow chart of a multi-channel synchronous transmission method for a wireless audio and video transmission device provided in an embodiment of the present application.

[0016] Figure 2 A schematic diagram of a process for obtaining an encrypted real-time audio and video data set in a multi-channel synchronous transmission method of a wireless audio and video transmission device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below.

[0018] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0019] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict, and the terms "first\second" involved are merely to distinguish similar objects and do not represent a specific ordering of objects. The terms "including" and "having" and any variations are intended to cover non-exclusive inclusions, for example, a process, method, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, including other steps or modules that are not clearly listed or inherent to these processes, methods, products, or devices. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by technicians in the technical field of this application. The terms used herein are for the purpose of describing the embodiments of the present application only.

[0020] The present application embodiment provides a multi-channel synchronous transmission method for a wireless audio and video transmission device, such as Figure 1 As shown, the method includes: Step S100, using a plurality of front-end cameras to synchronously collect audio and video data of a target scene to obtain a plurality of real-time audio and video data sets.

[0021] Preferably, multiple front-end cameras are used to synchronously record and capture audio and video of the same target scene at the same time point, and the audio and video data captured by each camera form a real-time audio and video data set, thereby obtaining several real-time audio and video data sets. Specifically, multiple front-end cameras start recording audio and video data at the same time, and each camera captures from a different angle or position. The captured real-time audio and video data may contain different perspectives of the same target, including audio and video signals of the target scene, such as images and sound information of sounds, people, objects or other targets at the scene.

[0022] Step S200, traverse the plurality of real-time audio and video data sets to perform dynamic data compression and staggered data encryption to obtain a plurality of encrypted real-time audio and video data sets after preprocessing.

[0023] Preferably, dynamic data compression and staggered data encryption are performed on several real-time audio and video data sets to ensure that the data can be transmitted efficiently and securely. Specifically, each real-time audio and video data set is preprocessed, including dynamic data compression and staggered data encryption. Dynamic data compression refers to the use of different compression algorithms and parameters to compress audio and video data according to different scenarios and data content to reduce the amount of data, reduce the consumption of transmission bandwidth, and improve transmission efficiency. In this process, the compression method may be dynamically adjusted according to different characteristics of the audio and video data (such as the frame rate of the video, the complexity of the image content, the frequency range of the audio, etc.). For example, a more efficient compression method can be used for static images, and a suitable compression algorithm can be selected for complex dynamic images to maintain good image and sound quality while reducing bandwidth requirements; staggered data Data encryption refers to the encryption processing of compressed audio and video data, and the encryption process may be staggered, that is, different encryption strategies or encryption times are used for different audio and video data sets to ensure that the data is encrypted at different times or in different sequences without affecting the synchronous transmission of data, thereby improving data security. For example, the encryption time can be staggered according to the characteristics of the data stream or security requirements to reduce the possible impact on synchronization, such as using different encryption algorithms (such as symmetric encryption or asymmetric encryption), and different keys may be used for different audio and video data during the encryption process to ensure that the data is not illegally accessed or tampered with during transmission; after data compression and encryption processing, a pre-processed encrypted real-time audio and video data set is obtained, thereby reducing the volume of audio and video data, improving transmission efficiency, and enhancing data security.

[0024] Further, such as Figure 2 As shown, step S200 also includes step S210, respectively taking the first frame real-time audio and video data in the several real-time audio and video data sets as several first key frame real-time audio and video data; step S220, taking the several first key frame real-time audio and video data as comparison objects, dynamically compressing the several real-time audio and video data sets to obtain several key frame real-time audio and video data sets; step S230, staggering data encryption of the several key frame real-time audio and video data sets to obtain several encrypted real-time audio and video data sets after preprocessing.

[0025] Preferably, the first frame of real-time audio and video data (i.e., the starting frame of audio and video) in each real-time audio and video data set is extracted as the first key frame real-time audio and video data of the data set. In video encoding, a key frame is usually a complete image frame that can be displayed separately and does not depend on the previous frame. The extracted first key frame real-time audio and video data is then used as a comparison object. Using the first key frame as a benchmark, other subsequent frames will be compared with it and compressed according to the comparison result. The real-time audio and video data set is dynamically compressed, that is, different compression methods are selected according to the characteristics of the data (such as the complexity of the image, the change of video content, etc.). Specifically, according to the difference between each frame and the first key frame, an appropriate compression algorithm is selected. For example, if the image content of some frames changes little from the first key frame, a more efficient compression method can be selected to reduce the amount of data. Subsequent frames usually do not need to be stored completely, but the difference (increment) with the previous frame can be stored. By comparing the data difference between the first key frame and other frames, compression is flexibly performed to obtain several key frame real-time audio and video data sets, thereby improving transmission efficiency and reducing the required bandwidth.

[0026] Preferably, after obtaining the compressed key frame real-time audio and video data set, these data sets may still contain sensitive information, so encryption processing is required to protect the security of the data. Specifically, staggered data encryption refers to the use of asynchronous encryption methods when encrypting these data, that is, encryption may be performed for different data streams or different time points to avoid the encryption operation and data transmission operation being completely synchronized, thereby reducing possible timing conflicts. The encryption operation can be key-based encryption (such as symmetric or asymmetric encryption algorithms such as AES and RSA) to ensure that the data will not be illegally obtained or tampered with by a third party during the transmission process. The staggered encryption method means that there is a time difference between the encryption operation and the actual transmission of the audio and video data stream, which may be to improve the security of the encryption processing or avoid the potential security risks brought about by the encryption mode that is completely synchronized with the transmission process. After dynamic data compression and staggered data encryption processing, the encrypted real-time audio and video data set after preprocessing is finally obtained, which reduces the size of the data and ensures that both efficient bandwidth utilization and effective protection of data privacy and security can be maintained during the audio and video data transmission process.

[0027] Furthermore, step S220 also includes step S221, taking the several first key frame real-time audio and video data as comparison objects, performing similarity identification on each frame of real-time audio and video data located after the several first key frame real-time audio and video data in the several real-time audio and video data sets, and determining several inter-frame similarity sets; step S222, obtaining a preset similarity threshold, and taking the data corresponding to the first inter-frame similarity greater than or equal to the preset similarity threshold in the several inter-frame similarity sets as several second key frame real-time audio and video data; step S223, updating the several second key frame real-time audio and video data as comparison objects, and so on, until the several last frames of real-time audio and video data of the several real-time audio and video data sets, and obtaining several key frame real-time audio and video data sets.

[0028] Preferably, the first key frame real-time audio and video data is used as a comparison object (i.e., an initial reference point) for comparison with subsequent frames, and similarity identification is performed on each frame of real-time audio and video data located after several first key frame real-time audio and video data in several real-time audio and video data sets, that is, each frame after the first key frame is compared with the current comparison object (initially the first key frame) one by one, and the similarity between the current frame and the first key frame is calculated. For example, the mean square error (MSE), structural similarity index (SSIM), cosine similarity, etc. are used to measure the difference between two frames of images. If the similarity between the two frames is high, it means that the change between them is small, and it can be considered that the difference between the subsequent frame and the current frame is not large, which may be a continuous image or video sequence. If the similarity is low, it means that the change between the two frames is large, and the scene may have changed significantly, and a new key frame is needed, thereby obtaining several inter-frame similarity sets, each of which contains the similarity value between each frame in the real-time audio data set and the first key frame, to help determine which frames in the video data stream have a small change (high similarity) and which frames have a large change (low similarity).

[0029] Preferably, the preset similarity threshold is a standard set for judging whether the change between the current frame and the previous frame is large enough, and then determining whether a new key frame needs to be selected. Then, the data corresponding to the first inter-frame similarity in the inter-frame similarity set that is greater than or equal to the preset similarity threshold is used as the second key frame real-time audio and video data. Specifically, if the inter-frame similarity is greater than or equal to the preset similarity threshold, it means that the current frame is relatively different and a new key frame needs to be selected. Otherwise, it means that the change of the current frame is small and the key frame does not need to be updated. Then, the second key frame real-time audio and video data is updated as the comparison object, and so on, until the last frame of real-time audio and video data, that is, the newly selected The real-time audio and video data corresponding to the second key frame is used as the new comparison object, and the similarity calculation and judgment of subsequent frames are continued. Through this recursive process (each time a key frame is found, the key frame is used as the benchmark to continue to compare the next frames until the last frame of the entire data set), each time a new key frame is found, the comparison object is updated until the entire real-time audio and video data set is traversed, and finally several key frame real-time audio and video data sets are obtained, including multiple key frame real-time audio data sets, which represent the audio and video data sets corresponding to each important change time point in the video stream, that is, there are large image changes or scene transitions.

[0030] Furthermore, step S230 also includes step S231, using the AES encryption algorithm to encrypt the several key frame real-time audio and video data sets respectively to obtain several encryption and decryption key pairs; step S232, traversing the several historical encryption and decryption key pair sets of the several front-end cameras in the historical time window; step S233, performing staggered data encryption authentication on the several encryption and decryption key pairs based on the several historical encryption and decryption key pair sets, if the authentication fails, returning to step one, and regenerating several encryption and decryption key pairs; step S234, if the authentication passes, using the several encryption and decryption key pairs to encrypt the data to obtain the several encrypted real-time audio and video data.

[0031] Preferably, the key frame real-time audio and video data sets are encrypted using the AES encryption algorithm, wherein the AES encryption algorithm (Advanced Encryption The Advanced Encryption Standard (AES) is a symmetric encryption algorithm that is widely used to protect data security. The AES algorithm is used to encrypt each key frame real-time audio and video data set. Specifically, when encrypting the data of each key frame, a pair of encryption and decryption keys (encryption and decryption key pair) will be generated. The encryption key is used to encrypt the data, and the decryption key is used to restore the original data. Since AES is a symmetric encryption algorithm, the same key is used for encryption and decryption. Therefore, each encrypted data set corresponds to a unique key pair. The audio and video data is protected by AES encryption, so that even if it is intercepted during transmission, it cannot be interpreted by unauthorized personnel; then the encryption and decryption key pairs used by each front-end camera within a certain time range (i.e., the historical time window) are traversed to ensure that there are no security vulnerabilities between the newly generated encryption and decryption key pairs and the historical key pairs, to prevent replay attacks or key leaks. Among them, each time the front-end camera encrypts, a new key pair will be generated, and these key pairs may be reused within a period of time. The historical encryption and decryption key pair set refers to the set of key pairs that have been generated and used before.

[0032] Preferably, data encryption authentication is performed on several encryption and decryption key pairs according to the historical encryption and decryption key pair set, that is, the validity of the newly generated encryption and decryption key pairs is verified through the authentication mechanism to ensure that there is no security conflict between them and the historical key pair set, including verifying the security of the new key pair, such as checking whether there are duplicate keys or other potential security vulnerabilities. Through the staggered authentication method, malicious users can be prevented from performing illegal operations by using outdated or leaked key pairs. If the authentication fails, a new encryption and decryption key pair is regenerated to ensure the security of the data encryption process. If the authentication process passes, it means that the current encryption and decryption key pair is safe and there is no conflict or risk. The encryption and decryption key pair is used to further encrypt the audio and video data to generate the final encrypted real-time audio and video data, ensuring that it will not be illegally accessed or tampered with during transmission or storage, thereby ensuring that the encrypted data can be securely transmitted or stored through wireless networks, the Internet, etc., and only the recipient holding the correct key can decrypt and restore the original audio and video data, thereby ensuring the confidentiality and integrity of the data.

[0033] Furthermore, step S233 also includes step S233a, respectively calculating the similarities of the several encryption and decryption key pairs and the several historical encryption and decryption key pair sets to obtain several key similarity sets; step S233b, determining whether there is a key similarity greater than or equal to a preset key similarity threshold in the several key similarity sets, and if so, the authentication fails.

[0034] Preferably, several encryption and decryption key pairs and several historical encryption and decryption key pair sets are compared respectively, that is, their similarities are calculated to determine whether the current encryption and decryption key is too similar to the historical key. Specifically, the similarity calculation method may include hash value comparison, hashing the key, comparing the similarity of the hash values, or calculating the difference between the two keys by some algorithm (such as Hamming distance, Jaccard similarity, etc.). The smaller the difference, the higher the similarity. Then, it is determined whether there is a key similarity greater than or equal to a preset key similarity threshold in the key similarity set. Among them, the key similarity threshold is a preset standard for judging whether a newly generated key is too similar to a historical key. It judges whether the values ​​in the calculated key similarity set have a similarity greater than or equal to the preset similarity threshold. If it is found that the similarity between a new key pair and a historical key pair is too high, it is considered that the key has a security risk and the authentication fails. For example, assuming the preset similarity threshold is 80%, if the similarity between a newly generated encryption and decryption key and a historical key is 85%, it is considered that the new key is too similar to the historical key and cannot pass the authentication.

[0035] In step S300, the plurality of front-end cameras transmit the plurality of encrypted real-time audio and video data sets to a multi-channel dual-mode receiver in the form of a plurality of radio signals by means of low-frequency wireless communication.

[0036] Preferably, through wireless communication technology, the encrypted real-time audio and video data collected and pre-processed by multiple front-end cameras are transmitted to the receiving end through low-frequency wireless signals, that is, transmitted to the multi-channel dual-mode receiver, wherein the multi-channel dual-mode receiver is a device that receives these wireless signals, has the ability to receive multiple signal channels, and supports 4-channel full HD 1080P video concurrent transmission. The radio signal (including the encrypted audio and video data set) sent by each front-end camera is received through different channels, allowing the receiver to process multiple signals at the same time. Specifically, low-frequency wireless communication refers to the use of low-frequency wireless signals (such as UHF band, VHF band or other similar bands) for data transmission. These bands can adapt to more complex environments. The visible transmission distance of a single-channel video reaches 700 meters, with strong wall-penetrating diffraction capability, good anti-interference and high reliability. It is suitable for those who need to be in a long-distance or multi-obstacle environment. The application of transmitting audio and video data in an environment is particularly important. It can better penetrate some obstacles, such as inside buildings or long-distance transmission. The advantage of low-frequency wireless signals is that they can be stably transmitted over a long distance and are usually not interfered by high-frequency signals. It can better solve the problem that the mobile network signal is poor and cannot transmit data in an unknown and complex environment; each front-end camera converts the processed audio and video data into a radio signal, and sends it through a low-frequency wireless communication method to the multi-channel dual-mode receiver at the receiving end. The multi-channel dual-mode receiver can support two communication modes. For example, it may support two different wireless communication standards (such as certain low-frequency and high-frequency communication protocols), or support different signal reception modes (such as simultaneous reception of analog signals and digital signals), ensuring that multi-channel audio and video data can be transmitted stably and securely over a certain transmission distance and in a complex environment.

[0037] Step S400: the multi-channel dual-mode receiver receives the plurality of radio signals simultaneously and performs demodulation to obtain a plurality of encrypted real-time audio and video data sets.

[0038] Preferably, the multi-channel dual-mode receiver receives several radio signals simultaneously, and demodulates and extracts several encrypted real-time audio and video data sets therefrom. Specifically, the multi-channel dual-mode receiver receives and processes several radio signals simultaneously, and performs demodulation processing, that is, restores the modulation information in the wireless signals. Since radio signals are usually modulated (such as frequency modulation, phase modulation, etc.), the receiver needs to demodulate these signals and convert them from radio signals into digital or analog signals that can be further processed. During the demodulation process, the receiver will extract the encoding information in the audio and video data, and restore the compressed and encrypted audio and video data sets, while ensuring synchronization between multiple signals and correctly restoring the content of each audio and video data, and finally restore multiple encrypted audio and video data sets, and the data content still remains encrypted to protect the security of the data during transmission.

[0039] Furthermore, step S400 also includes step S410, using a multi-channel dual-mode receiver to receive the multiple radio signals in parallel through multiple receiving channels; step S420, performing signal gain control and filtering on the multiple received radio signals to obtain multiple enhanced radio signals; step S430, using a demodulation algorithm to demodulate the multiple enhanced radio signals to obtain the multiple encrypted real-time audio and video data sets.

[0040] Preferably, a multi-channel dual-mode receiver refers to a device with multiple receiving channels, which can receive radio signals from different signal sources in parallel through several receiving channels. Parallel reception means that the receiver can process multiple signal streams at the same time, such as audio and video data from multiple front-end cameras, and then perform signal gain control and filtering on the received radio signals. Specifically, the received wireless signal is usually affected by noise, interference or signal attenuation. Especially in a wireless environment, the signal strength may change with factors such as distance and obstacles. Signal gain control refers to amplifying the signal to improve the signal quality and ensure that the received signal strength is high enough. During the propagation process, the wireless signal may be affected by various noises, such as environmental noise, electromagnetic interference, etc. Filtering refers to removing these unnecessary signal interferences so that the effective signal can be obtained. For better processing, filters can be used to remove high-frequency noise, reduce distortion, etc. Through gain control and filtering, the receiver improves the signal quality, making the signal clearer and more stable, which is convenient for the subsequent demodulation process, and obtains several enhanced radio signals, that is, high-quality signals after gain and filtering processing; then the demodulation algorithm is used to demodulate the several enhanced radio signals, that is, to restore the received modulated signal to the original data form, such as after modulation (such as frequency modulation, phase modulation, etc.) so as to propagate on the wireless frequency band, wherein the demodulation algorithm is used to demodulate the received modulated signal to restore the original digital or analog data. For audio and video data, the demodulation process is to extract the encrypted audio and video data set from the received radio signal, and finally obtain several encrypted real-time audio and video data sets, and ensure the security of the data during transmission.

[0041] Step S500, obtaining several acquisition timestamps of the several encrypted real-time audio and video data sets, the multi-channel dual-mode receiver performing delay analysis according to the several acquisition timestamps, and synchronously transmitting the several encrypted real-time audio and video data sets back to the remote platform via the network according to the analysis results.

[0042] Preferably, acquisition timestamps corresponding to several sets of encrypted real-time audio and video data are obtained, and the time information of audio and video data acquisition is used by a multi-channel dual-mode receiver to analyze and process the delay of different camera data, and ensure the synchronous return of the final audio and video data. The acquisition timestamp refers to the specific time point recorded by each front-end camera when collecting audio and video data, and the acquisition moment of the audio and video data is usually marked in a time format (such as UNIX timestamp, millisecond time stamp, etc.). In the scenario of synchronous acquisition by multiple cameras, each camera will record the time tag of the data it collects, that is, the exact time of each frame of video or audio collected by the camera.

[0043] Preferably, delay analysis refers to the multi-channel dual-mode receiver evaluating the transmission delay between different signal streams by comparing the acquisition timestamps of signals received from different cameras. The data of each camera will experience different transmission paths, channels and possible interference, resulting in different arrival times and delay differences. By analyzing these timestamps, the receiver can calculate the delays between the signal streams and evaluate the impact of these delays on data synchronization to ensure that the data of different signal streams can be processed at synchronized time points to avoid the phenomenon of audio and video being out of sync. The delay analysis results may include the reasons for the delay differences in audio and video signal streams, such as environmental factors of wireless transmission, signal interference, different transmission paths, etc. The multi-channel dual-mode receiver adjusts each data stream by buffering or timestamp alignment according to the analysis results. For example, time synchronization can be performed according to the delay difference, that is, the display of certain audio and video data can be postponed, or the processing of certain data can be accelerated to ensure that all audio and video streams are synchronized when finally presented, so that audio and video data from different sources can be displayed synchronously when finally transmitted back.

[0044] Preferably, these synchronized audio and video data are transmitted to a remote platform via network synchronous backhaul. The remote platform may be a data center, server or terminal device for further data processing, storage or playback. Network synchronous backhaul refers to the transmission of multiple synchronized data streams (audio and video data) to the remote platform via the network, including mobile communication cellular network (4G / 5G, etc.) backhaul or wired network backhaul. During the backhaul process, the audio and video data that have passed the delay analysis and adjustment will be transmitted in the synchronized time sequence, thereby ensuring that the data received by the remote platform is synchronized and has no delay difference, that is, it supports remote backhaul of audio and video via 4G / 5G to the remote background for real-time browsing, and supports local browsing of audio and video via wired connection. The two application modes are suitable for multi-scenario applications. For example, wireless audio and video transmission equipment supports local audio and video browsing connected to a computer via a wired network, and also supports playback on the PC / mobile phone.

[0045] Furthermore, step S500 also includes step S510, wherein the several receiving channels of the multi-channel dual-mode receiver generate corresponding receiving timestamps when receiving the several radio signals, and obtain several receiving timestamps, wherein each receiving timestamp corresponds to a radio signal; step S520, calculating the difference between the several receiving timestamps and the several acquisition timestamps, and obtaining several transmission times; step S530, based on the several transmission times, the multi-channel dual-mode receiver performs channel delay analysis on the several receiving channels, performs delay compensation on the several encrypted real-time audio and video data sets according to the analysis results, and synchronously transmits the several encrypted real-time audio and video data sets back to the remote platform using the network according to the compensation results.

[0046] Preferably, the multi-channel dual-mode receiver simultaneously receives data from different radio signal sources through its multiple receiving channels. Whenever a radio signal is received, the receiver generates a corresponding receiving timestamp, that is, recording the exact time when each signal is received, wherein each receiving timestamp is associated with the corresponding radio signal, that is, each signal stream (which may come from different front-end cameras) will have an independent receiving timestamp, and then the difference between the receiving timestamp and the acquisition timestamp is calculated to obtain the transmission time, which reflects the time delay from data acquisition to data reception. For each group of data streams, the difference between the receiving timestamp and the acquisition timestamp represents the delay from the data stream being collected by the camera to being received by the receiver. This delay is usually caused by factors such as signal transmission and network processing.

[0047] Preferably, channel delay analysis refers to analyzing the signal transmission delay differences of different receiving channels based on the transmission time. Due to the characteristics of different signal sources, different signal paths, and different receiving channels, the signal transmission delays may be different. The delay differences between each channel are analyzed and calculated. Through these differences, the receiver can determine which channels' signals will cause inconsistency or asynchrony of audio and video data when they arrive at the remote platform, and then perform delay compensation for several encrypted real-time audio and video data sets. Specifically, according to the results of the channel delay analysis, the signal is adjusted or corrected in time to ensure that the data of different channels are synchronized in time. For example, if the signal of a certain channel has a long delay, the receiver may delay the signals of other channels or adjust their playback order to make the timing of all data streams consistent. After the delay compensation is completed, all encrypted real-time audio and video data sets are synchronously transmitted back to the remote platform through the network, and processed, stored or played, thereby achieving high-quality multi-channel audio and video synchronous transmission.

[0048] Furthermore, step S530 also includes the remote platform decrypting and decoding the plurality of encrypted real-time audio and video data sets to obtain a plurality of real-time audio and video data sets in a playable format.

[0049] Preferably, the remote platform performs decryption processing on a plurality of encrypted real-time audio and video data sets, which means restoring the encrypted audio and video data to the original data, usually using the same key as that used for encryption (such as an AES key) to restore the data. Specifically, the audio and video data are decrypted using the received decryption key, and the decrypted data will be restored to the original audio and video content before encryption, but may still be in an encoded format (such as a compressed H.264 video stream and an AAC audio stream) rather than a directly playable format; and then performs decoding processing, that is, converting the compressed or encoded audio and video data into a playable format, specifically including converting the encoded The decoder converts the data (such as H.264 format for video, AAC format for audio, etc.) into raw audio and video streams (such as pixel matrices and audio waveforms) that the device can understand and display. For example, if the video data is H.264 encoded, the decoder will decompress it and convert it into image frames; if the audio is AAC encoded, the decoder will convert it into a playable audio waveform; and finally obtain several sets of real-time audio and video data in a playable format. For example, the video stream can be turned into a standard image frame, and the audio stream can be turned into audio data that can be played through a speaker, which can be played and viewed by the user through a player or other software that supports audio and video playback.

[0050] The above specific implementation manner does not constitute a limitation to the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application. In some cases, the actions or steps recorded in the present application can be performed in an order different from that in the embodiment and can still achieve the desired results. In addition, the process depicted in the accompanying drawings does not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Claims

1. A multi-channel synchronous transmission method for a wireless audio and video transmission device, characterized in that: The method comprises: Use several front-end cameras to synchronously collect audio and video data of the target scene to obtain several real-time audio and video data sets; Traversing the plurality of real-time audio and video data sets to perform dynamic data compression and staggered data encryption to obtain a plurality of encrypted real-time audio and video data sets after preprocessing; The plurality of front-end cameras transmit the plurality of encrypted real-time audio and video data sets to the multi-channel dual-mode receiver in the form of a plurality of radio signals by means of low-frequency wireless communication; The multi-channel dual-mode receiver simultaneously receives the plurality of radio signals and performs demodulation to obtain a plurality of encrypted real-time audio and video data sets; Acquire several acquisition timestamps of the several encrypted real-time audio and video data sets, the multi-channel dual-mode receiver performs delay analysis according to the several acquisition timestamps, and synchronously transmits the several encrypted real-time audio and video data sets back to the remote platform via the network according to the analysis results.

2. The multi-channel synchronous transmission method of the wireless audio and video transmission device according to claim 1, characterized in that: Traversing the plurality of real-time audio and video data sets to perform dynamic data compression and staggered data encryption, and obtaining a plurality of encrypted real-time audio and video data sets after preprocessing, including: respectively taking the first frame of real-time audio and video data in the plurality of real-time audio and video data sets as a plurality of first key frame real-time audio and video data; Taking the plurality of first key frame real-time audio and video data as comparison objects, dynamically compressing the plurality of real-time audio and video data sets to obtain a plurality of key frame real-time audio and video data sets; The plurality of key frame real-time audio and video data sets are staggeredly encrypted to obtain a plurality of encrypted real-time audio and video data sets after preprocessing.

3. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 2, characterized in that: The plurality of first key frame real-time audio and video data are used as comparison objects, and the plurality of real-time audio and video data sets are dynamically compressed to obtain a plurality of key frame real-time audio and video data sets, including: Taking the plurality of first key frame real-time audio and video data as comparison objects, performing similarity identification on each frame of real-time audio and video data located after the plurality of first key frame real-time audio and video data in the plurality of real-time audio and video data sets, and determining a plurality of inter-frame similarity sets; Obtaining a preset similarity threshold, and using data corresponding to a first inter-frame similarity greater than or equal to the preset similarity threshold in the plurality of inter-frame similarity sets as a plurality of second key frame real-time audio and video data; The plurality of second key frame real-time audio and video data are updated as comparison objects, and so on, until the plurality of last frames of real-time audio and video data of the plurality of real-time audio and video data sets, to obtain a plurality of key frame real-time audio and video data sets.

4. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 2, characterized in that: Performing staggered data encryption on the plurality of key frame real-time audio and video data sets to obtain a plurality of encrypted real-time audio and video data sets after preprocessing, including: Using the AES encryption algorithm to encrypt the plurality of key frame real-time audio and video data sets respectively, to obtain a plurality of encryption and decryption key pairs; Traversing a plurality of historical encryption and decryption key pair sets of the plurality of front-end cameras within a historical time window; Based on the several historical encryption and decryption key pair sets, the several encryption and decryption key pairs are subjected to staggered data encryption authentication. If the authentication fails, the process returns to step 1 to regenerate several encryption and decryption key pairs. If the authentication is successful, the data is encrypted using the several encryption and decryption key pairs to obtain the several encrypted real-time audio and video data.

5. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 4, characterized in that: include: Calculating similarities between the plurality of encryption and decryption key pairs and the plurality of historical encryption and decryption key pair sets respectively, to obtain a plurality of key similarity sets; It is determined whether there is a key similarity greater than or equal to a preset key similarity threshold among the plurality of key similarity sets. If so, the authentication fails.

6. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 1, characterized in that: The multi-channel dual-mode receiver simultaneously receives the plurality of radio signals and performs demodulation to obtain a plurality of encrypted real-time audio and video data sets, including: Using a multi-channel dual-mode receiver to receive the plurality of radio signals in parallel through a plurality of receiving channels; Performing signal gain control and filtering on a plurality of received radio signals to obtain a plurality of enhanced radio signals; The plurality of enhanced radio signals are demodulated using a demodulation algorithm to obtain the plurality of encrypted real-time audio and video data sets.

7. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 1, characterized in that: include: The plurality of receiving channels of the multi-channel dual-mode receiver generate corresponding receiving timestamps when receiving the plurality of radio signals, and obtain a plurality of receiving timestamps, wherein each receiving timestamp corresponds to a radio signal; Calculating the difference between the plurality of receiving timestamps and the plurality of collecting timestamps to obtain a plurality of transmission times; Based on the several transmission times, the multi-channel dual-mode receiver performs channel delay analysis on several receiving channels, performs delay compensation on the several encrypted real-time audio and video data sets according to the analysis results, and uses the network to synchronously transmit the several encrypted real-time audio and video data sets back to the remote platform according to the compensation results.

8. The multi-channel synchronous transmission method of the wireless audio and video transmission device as claimed in claim 1, characterized in that: The remote platform decrypts and decodes the plurality of encrypted real-time audio and video data sets to obtain a plurality of real-time audio and video data sets in a playable format.

Images