Multi-link aggregation transmission method and system for group full-duplex call system

Abstract

The present invention relates to a multi-link aggregation transmission method and system for a group full-duplex call system. The method comprises: a network protocol stack receives, by means of a public network, a network audio data packet of a server, performs decapsulation processing on the network audio data packet, and transmits network audio data obtained by means of the decapsulation processing to a data fusion module; a wireless protocol stack receives, by means of an ad hoc network, a wireless audio data packet of a neighbor node arranged in the ad hoc network, performs decapsulation processing on the wireless audio data packet, and transmits wireless audio data obtained by means of the decapsulation processing to the data fusion module; and the data fusion module performs adaptive dynamic combination processing on the network audio data and the wireless audio data on the basis of an operation mode to obtain combined data, and transmits the combined data to an audio decoding module. The present invention achieves full-duplex communication by means of multi-link transmission, allows for communication in an area without base station coverage, and achieves reliable communication under the condition of strong interference.

Description

Multi-link aggregation transmission method and system for group full-duplex call system Technical Field

[0001] The present invention relates to the technical field of group calls, and in particular to a multi-link aggregation transmission method and system for a group full-duplex call system. Background Art

[0002] There are two main implementation forms of existing group call systems. One is to implement it by radio, generally using VHF (frequency 136-174MHz) and UHF (frequency 400-470MHz) to achieve half-duplex wireless communication. The other is to use the operator's public network, which is divided into half-duplex and full-duplex modes. The half-duplex mode is represented by public network walkie-talkies, which require the use of the PTT button to seize the channel to make a sound. However, this traditional radio intercom method cannot achieve full-duplex calls. In an emergency, it cannot seize the channel in time to make a sound, and the communication is not real-time; when one party speaks, the other party can only listen. The full-duplex mode is mainly implemented by mobile phone software applications, such as online conference systems, but public network intercoms need to rely on the operator's network and cannot communicate in areas without base station coverage.

[0003] In recent years, with the development of short-range communication networking technologies such as Bluetooth and Zigbee, the use of short-range communication protocols to implement Adhoc (wireless Ad-Hoc Network) self-organizing networks for group calls has gradually emerged. This is a dynamic, multi-hop mobile peer-to-peer network consisting of several to dozens of nodes. However, the use of short-range communication networking to implement Adhoc self-organizing network group calls has a limited transmission distance. In scenarios with obstruction and strong interference, data is easily lost, and reliable communication cannot be achieved. Summary of the Invention

[0004] The main purpose of the present invention is to provide a multi-link aggregation transmission method and system for a group full-duplex call system, which simultaneously transmits voice data through two links, a local wireless ad hoc network and a public network, to achieve full-duplex communication, and can communicate in areas without base station coverage, transmit data through two links, and achieve reliable communication.

[0005] To achieve the above objectives, the present invention provides a multi-link aggregation transmission method for a group full-duplex call system, comprising:

[0006] receiving a network audio data packet from a server via a public network through a network protocol stack, decapsulating the network audio data packet, and transmitting the decapsulated network audio data to a data fusion module;

[0007] receiving wireless audio data packets from neighboring nodes in the ad hoc network through the wireless protocol stack according to the ad hoc network, decapsulating the wireless audio data packets, and transmitting the decapsulated wireless audio data to the data fusion module;

[0008] The data fusion module adaptively and dynamically merges the network audio data and the wireless audio data according to the operating mode of the processor to obtain merged data, and transmits the merged data to the audio decoding module.

[0009] Furthermore, before the step of receiving the network audio data packet from the server through the network protocol stack according to the public network, the method further includes:

[0010] The processor obtains the voice data packets sent by the voice encoder, and sends the voice data packets to the network protocol stack and the wireless protocol stack respectively;

[0011] Encrypting and encapsulating the received voice data packets according to preset encapsulation rules through the network protocol stack connected to the processor, and transmitting the encrypted and encapsulated network audio data packets to the server through the public network;

[0012] The wireless protocol stack connected to the processor encrypts and encapsulates the received voice data packet according to a preset encapsulation rule, and transmits the wireless audio data packet obtained by the encryption and encapsulation to the neighboring node through the protocol of the ad hoc network.

[0013] Furthermore, the voice encoder encodes the voice stream collected by the microphone according to a preset encoding standard, performs packet processing on the continuous frame data packets obtained by the encoding, and sends the voice data packets obtained by the packet processing to the processor.

[0014] Furthermore, the encoded continuous frame data packets are packetized and the voice data packets obtained by the packetization are sent to the processor, including:

[0015] Add header information including the length, encoding format, sampling rate and number of channels of the continuous frame data packet to the continuous frame data packet, extract feature data of the continuous frame data packet, encrypt the continuous frame data packet to obtain an encrypted data packet, set the feature data as a decryption instruction of the encrypted data packet, fill the feature data in 5 vertical columns and 5 horizontal columns respectively, and arrange them in sequence according to a preset fence arrangement rule to obtain 5 vertical fence data and 5 horizontal fence data, interleave the 5 vertical fence data and the 5 horizontal fence data to obtain a fence password that complies with the preset rules, package the encrypted data packet and the fence password to obtain the voice data packet, and send the voice data packet to the processor.

[0016] Furthermore, the receiving of a network audio data packet from a server via a public network through a network protocol stack includes:

[0017] The network protocol stack connected to the target node receives the network audio data packet through a receiving queue, reads the address information, serial number and timestamp of the network audio data packet, re-queues the network audio data packet received within a preset cache time in the receiving queue according to the serial number and timestamp, detects the uniqueness of the network audio data packet based on the address information, serial number and timestamp, and when multiple duplicate network audio data packets are detected, filters the network audio data packet to obtain a unique network audio data packet.

[0018] Furthermore, the decapsulating the network audio data packet and transmitting the read network audio data to the data fusion module includes:

[0019] The network protocol stack unpacks the network audio data packet according to a preset unpacking table; specifically, the process includes: judging whether the address information, the serial number, and the timestamp of the network audio data packet meet the requirements through the unpacking table; when the address information, the serial number, and the timestamp meet the requirements of the unpacking table, unpacking the network audio data packet according to the unpacking rules of the unpacking table to obtain the network audio data, and transmitting the network audio data to the data fusion module.

[0020] Furthermore, the receiving of wireless audio data packets from neighboring nodes in the ad hoc network through the wireless protocol stack according to the ad hoc network includes:

[0021] The wireless protocol stack connected to the target node receives the wireless audio data packet from the neighboring node through a self-organizing network, reads the address information, the serial number and the timestamp of the wireless audio data packet, detects the uniqueness of the wireless audio data packet based on the address information, the serial number and the timestamp, and when multiple repeated wireless audio data packets are detected, filters the wireless audio data packet to obtain a unique wireless audio data packet.

[0022] Furthermore, decapsulating the wireless audio data packet and transmitting the decapsulated wireless audio data to the data fusion module includes:

[0023] The wireless audio data packet is unsealed according to a preset unsealing table through the wireless protocol stack; specifically, the process includes: judging whether the address information, the serial number and the timestamp of the wireless audio data packet meet the requirements through the unsealing table; when the address information, the serial number and the timestamp meet the requirements of the unsealing table, unsealing the wireless audio data packet according to the unsealing rules of the unsealing table to obtain the wireless audio data, and transmitting the wireless audio data to the data fusion module.

[0024] Furthermore, the adaptive dynamic merging of the network audio data and the wireless audio data by the data fusion module according to the operation mode to obtain merged data, and transmitting the merged data to the audio decoding module includes:

[0025] detecting, by the data fusion module, whether the operating mode of the processor is a single-link transmission mode or a multi-link transmission mode;

[0026] When the operation mode is the single-link operation mode, the data fusion module receives the network audio data sent by the single-running network protocol stack or the wireless audio data sent by the single-running wireless protocol stack, queues and performs re-filtering on the received network audio data or the wireless audio data to obtain queued data, and transmits the queued data to the audio decoding module;

[0027] When the operating mode is a multi-link operating mode, when the data fusion module receives the first data sent by either the network protocol stack or the wireless protocol stack within a preset receiving time, it determines whether the integrity of the first data meets the requirements; when the first data meets the requirements, it marks the first data as valid data; when the data fusion module receives the second data sent by the other party within the preset receiving time, it determines whether the integrity of the second data meets the requirements; when the second data meets the requirements, the second data and the first data are converted according to a preset data conversion table, the converted first data and the second data are compared to obtain deviation data, and it is determined whether the deviation data meets the requirements of the preset deviation rule; when the deviation data meets the requirements, a common sequence number of the two data is obtained, the second data is cleared, the first data and the deviation data are merged to obtain the merged data of the network audio data and the wireless audio data, and the merged data is transmitted to the audio decoding module in sequence according to the common sequence number.

[0028] The present invention also provides a multi-link aggregation transmission system for a group full-duplex call system, comprising:

[0029] an acquisition module, the acquisition module being configured to receive a network audio data packet from a server according to a public network through a network protocol stack, decapsulate the network audio data packet, and transmit the decapsulated network audio data to a data fusion module;

[0030] an acquisition module configured to receive wireless audio data packets from neighboring nodes in the ad hoc network through a wireless protocol stack according to the ad hoc network, decapsulate the wireless audio data packets, and transmit the decapsulated wireless audio data to the data fusion module;

[0031] The processing module is used to merge the network audio data and the wireless audio data through the data fusion module to obtain merged data, and transmit the merged data to the audio decoding module.

[0032] The multi-link aggregation transmission method and system for a group full-duplex call system provided by the present invention have the following beneficial effects:

[0033] The present invention receives network audio data and wireless audio data respectively through the network protocol stack and the wireless protocol stack, realizes multi-link transmission, increases transmission bandwidth and stability, improves call quality and reliability, and can communicate in areas without base station coverage. The received network audio data packets and wireless audio data packets are unpacked and restored to the original audio data, ensuring that the transmitted audio data is complete and correct. The network audio data and wireless audio data are merged and processed by the data fusion module to obtain merged data. Through data fusion, the advantages of multi-link transmission can be fully utilized to improve call quality and capacity. Finally, the merged data is transmitted to the audio decoding module for decoding, and the merged data is restored to an audible audio signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] 1 is a flow chart of a multi-link aggregation transmission method for a group full-duplex call system provided by the present invention;

[0035] FIG2 is a flow chart of a multi-link aggregation transmission method for a group full-duplex call system provided by the present invention;

[0036] FIG3 is one of the data transmission structure diagrams of the network protocol stack and the wireless protocol stack of the multi-link aggregation transmission method of the group full-duplex call system provided by the present invention.

[0037] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0039] The present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0040] 1-3 , the present invention provides a multi-link aggregation transmission method for a group full-duplex call system, comprising:

[0041] Step 1: Receive the network audio data packet from the server through the public network through the network protocol stack, decapsulate the network audio data packet, and transmit the decapsulated network audio data to the data fusion module;

[0042] Step 2: Receive wireless audio data packets from neighboring nodes in the ad hoc network through the wireless protocol stack according to the ad hoc network, decapsulate the wireless audio data packets, and transmit the decapsulated wireless audio data to the data fusion module;

[0043] Step 3: Adaptively and dynamically merge the network audio data and the wireless audio data through the data fusion module according to the operating mode of the processor to obtain merged data, and transmit the merged data to the audio decoding module.

[0044] Among them, the neighbor nodes include the initial source node used to send initial data in the ad hoc network and the relay node used for forwarding and relaying purposes in the ad hoc network. The data fusion module can detect the adaptive operation mode of the system and determine whether the system works in multiple links or a single link. When the adaptive operation mode of the system is detected, the corresponding operation mode is used to process data. The system has the following adaptive operation modes:

[0045] 1. Multiple links work simultaneously, and all group members have multiple links.

[0046] 2. Use the network mode alone to work, and all group members use the separate network mode.

[0047] 3. Use wireless ad hoc network to work alone, and all group members use independent wireless ad hoc network mode.

[0048] 4. Mixed use: some members use the network mode, and some members use wireless ad hoc networks. At this time, the network can be adaptively divided into multiple small groups, and then the small groups form a large group. Each small group has at least one node with multiple links.

[0049] As described above, the specific steps include:

[0050] Step 1: Receive the network audio data packets from the server through the public network through the network protocol stack. The network protocol stack is responsible for handling network communications, including receiving and sending data packets, decapsulating the received network audio data packets, and transmitting the decapsulated network audio data to the data fusion module.

[0051] The unblocking process includes the following steps:

[0052] a. Decryption: Decrypt the received network audio data packet and restore it to unencrypted network audio data;

[0053] b. Data parsing: Unpacking, decompressing, converting and decoding unencrypted network audio data, and restoring it to the original audio data;

[0054] c. Error detection and correction: Perform error detection and correction on the original audio data to obtain network audio data.

[0055] Step 2: Receive wireless audio data packets sent by neighboring nodes in the ad hoc network through the wireless protocol stack. The wireless protocol stack is responsible for processing wireless communications, including receiving and sending data packets, and transmitting the wireless audio data obtained by decapsulation to the data fusion module.

[0056] The received wireless audio data packet is decapsulated, and the decapsulation process includes the following steps:

[0057] a. Decryption: Decrypt the received wireless audio data packet and restore it to unencrypted wireless audio data.

[0058] b. Data parsing: Unpack, decompress, convert and decode unencrypted network audio data, and restore it to the original audio data.

[0059] c. Error detection and correction: Perform error detection and correction on the original audio data to obtain wireless audio data.

[0060] Step 3: The data fusion module receives the network audio data and wireless audio data from steps 1 and 2. The data fusion module merges the network audio data and wireless audio data according to the processor's operating mode to obtain merged data. The merged data is then transmitted to the audio decoding module via an internal data transmission mechanism. The audio decoding module decodes the received merged data and converts it into the original audio signal. Further processing is performed on the decoded audio signal as needed, such as audio enhancement, noise reduction, and equalization. Finally, the audio decoding module outputs the original audio signal.

[0061] The data fusion module can select one of the following merging processing methods to merge the received network audio data and wireless audio data, and the merging processing methods include:

[0062] Simple mixing: Add network audio data and wireless audio data in a certain ratio to obtain combined data;

[0063] Time division multiplexing: Network audio data and wireless audio data are divided into time slices and transmitted alternately to obtain combined data;

[0064] Frequency division multiplexing: Network audio data and wireless audio data are divided according to frequency, transmitted separately, and then merged to obtain combined data.

[0065] The present invention provides a multi-link aggregation transmission method for a group full-duplex call system, which receives network audio data packets through a network protocol stack and wireless audio data packets through a wireless protocol stack, so that audio data can be received from a public network and a self-organizing network respectively, ensuring the stability and accuracy of the audio signal, and providing a reliable data source for subsequent data processing and transmission, and expanding the communication range and enhancing the flexibility of communication. Among them, multi-link transmission is achieved through the network protocol stack to increase the transmission bandwidth and stability, and communication can be carried out in areas without base station coverage through the wireless protocol stack, realizing a wider range of communication. The network audio data and the wireless audio data are merged and processed by the data fusion module, which can eliminate problems such as packet loss and jitter in network transmission, reduce the loss and deformation of audio data, and thus provide a clearer and more stable audio signal. Moreover, through the merged processing, when there is a problem or interruption in the network link or the wireless link, the audio data transmitted by the other link can still be obtained, avoiding the complete loss of data and ensuring the continuity and reliability of communication.

[0066] 3 , in one embodiment, before the step of receiving a network audio data packet from a server via a public network through a network protocol stack, the step further includes:

[0067] The processor obtains the voice data packet sent by the voice encoder, copies the voice data packet into two copies, and sends them to the network protocol stack and the wireless protocol stack respectively.

[0068] After the network protocol stack connected to the processor receives the voice data packet, the network protocol stack encrypts and encapsulates the voice data packet. According to the preset encapsulation rules, the network protocol stack adds metadata and control information contained in the additional transport layer and the encryption algorithm during the encapsulation process to obtain a network audio data packet, which is then transmitted to the server through the public network.

[0069] After the wireless protocol stack connected to the processor receives the voice data packet, the wireless protocol stack encrypts and encapsulates the received voice data packet. According to the preset encapsulation rules, the metadata and control information contained in the additional transport layer and the encryption algorithm are added during the encapsulation process to obtain a wireless audio data packet. The wireless audio data packet is then sent to the neighboring nodes in the self-organizing network through the self-organizing network protocol. When the self-organizing network detects that the target node where the audio decoding module is located and the starting sending node are within the radio frequency coverage range, it can be sent directly to the target node where the audio decoding module is located without passing through the relay node in the neighboring node and then forwarded to the target node where the audio decoding module is located.

[0070] This embodiment utilizes a combination of public and ad hoc networks, providing long-distance communication capabilities over the public network and local communication capabilities over the ad hoc network in areas or specific environments without public network coverage. This approach achieves wider communication coverage and increases communication flexibility. By replicating voice data packets and sending them separately to the network protocol stack and wireless protocol stack, even if a problem occurs on one communication link, data can still be transmitted over the other link, improving the system's fault tolerance while protecting data security and confidentiality.

[0071] In one embodiment, the voice encoder encodes the voice stream collected by the microphone according to a preset encoding standard, performs packet processing on the consecutive frame data packets obtained by the encoding, and sends the voice data packets obtained by the packet processing to the processor.

[0072] This embodiment uses a voice encoder to encode the voice stream captured by a microphone, converting the voice signal into digital data for transmission and processing in a digital communication system. This achieves efficient voice compression and transmission, saving bandwidth and storage space. By encapsulating the encoded continuous frame data packets, the continuous voice data is divided into smaller data packets for transmission during the communication process. This improves data transmission efficiency and real-time performance, and reduces transmission delays.

[0073] In one embodiment, packetizing the encoded continuous frame data packets and sending the voice data packets obtained by the packetization to a processor includes:

[0074] Header information is added to the continuous frame data packets, including information such as the length of the continuous frame, encoding format, sampling rate, and number of channels. This information helps the receiving end correctly parse and process the voice data. Feature data is extracted from the continuous frame data packets. This extracted feature data is used in subsequent encryption and decryption operations. The feature data can serve as key parameters or identifiers for identifying and processing the voice data. The continuous frame data packets are encrypted, using an encryption algorithm that can utilize symmetric or asymmetric encryption to ensure that only authorized receivers can decrypt and restore the voice data. The feature data is set as the decryption instructions for the encrypted data packets. The feature data is then filled into five vertical columns according to a preset fence arrangement rule, and the feature data is also filled into five horizontal columns according to a preset fence arrangement rule. The five vertical fence data and the five horizontal fence data are then interleaved and sorted to obtain a fence code that conforms to the preset rules. The encrypted data packet and the fence code are then packaged to obtain a final voice data packet, which is then sent to the processor.

[0075] Among them, the voice data packet contains an encrypted data packet and a fence password. By reverse cracking the fence password according to the corresponding decryption rules, the corresponding feature data can be restored, and then the encrypted data can be decrypted using the feature data to obtain a continuous frame data packet.

[0076] This embodiment enhances the security of voice data through encryption, ensuring that only the corresponding processor can decrypt and restore the voice data, thus protecting the confidentiality of the data. By adding header information and feature data, the receiving end can accurately parse and process the voice data, ensuring data integrity and correctness. Through fence cipher generation and interleaved sorting, the structure of the voice data packet is complex, enhancing the data's resistance to interference and reducing errors and losses during data transmission. Through packet processing, the structure of the voice data packet can be adjusted and expanded as needed to suit different application scenarios and requirements.

[0077] 2-3 , in one embodiment, receiving a network audio data packet from a server via a public network through a network protocol stack includes:

[0078] The network protocol stack connected to the target node receives network audio data packets sent from the server through the public network, and caches the network audio data packets received within a preset cache time (the preset range of the cache time is 100-2000ms) in a receiving queue.

[0079] The network protocol stack reads the address information, sequence number, and timestamp of the network audio data packet from the receive queue. Within a preset buffering time, the network protocol stack handles link latency and jitter, and dynamically adjusts the buffering time based on the link latency. Network audio data packets arriving within the buffering time are re-queued in the receive queue based on their sequence number and timestamp. The network protocol stack uses this information, sequence number, and timestamp to verify the uniqueness of the network audio data packet. If multiple duplicate network audio data packets are detected, the network protocol stack filters out the duplicates, retaining only the single, unique network audio data packet.

[0080] By caching audio packets in the receive queue for a certain period of time and dynamically adjusting the caching time based on link latency, this embodiment effectively handles link latency and jitter in the network protocol stack. Furthermore, using sequence numbers and timestamps, the network protocol stack ensures that audio packets are processed at the appropriate time and in the order in which they were sent. Furthermore, by detecting address information, sequence numbers, and timestamps, the network protocol stack can identify and filter out multiple duplicate audio packets, retaining only unique packets. This avoids repeated processing of identical audio data and the unnecessary burden this would place on the system, improving processing efficiency and ensuring the accuracy and consistency of audio data.

[0081] 2-3 , in one embodiment, decapsulating a network audio data packet and transmitting the read network audio data to a data fusion module includes:

[0082] By pre-setting a decapsulation table, the decapsulation table includes the requirements for address information, sequence number and timestamp as well as the corresponding decapsulation rules. The decapsulation table is used to determine whether the network audio data packet meets the requirements and to determine how to decapsulate the corresponding network audio data packet.

[0083] After the network protocol stack receives the network audio data packet, it first reads the address information, serial number and timestamp of the network audio data packet, and determines whether the address information, serial number and timestamp meet the requirements according to the requirements in the decapsulation table. When the address information, serial number and timestamp meet the requirements of the decapsulation table, the network audio data packet is decapsulated according to the decapsulation rules of the decapsulation table. The decapsulation operation includes decryption, decompression and data format conversion to obtain the original network audio data.

[0084] The unpacked network audio data is transmitted to the data fusion module of the processor for subsequent processing.

[0085] This embodiment decapsulates network audio data packets that meet the requirements according to the decapsulation rules of the decapsulation table and restores them to the original network audio data. Other data packets that do not meet the requirements are filtered out, thereby reducing the processing and transmission of invalid data, improving processing efficiency, and ensuring data integrity and correctness.

[0086] 2-3 , in one embodiment, receiving a wireless audio data packet from a neighboring node in an ad hoc network through a wireless protocol stack according to the ad hoc network includes:

[0087] The wireless protocol stack connected to the target node receives wireless audio data packets from multiple neighboring nodes through an ad hoc network, reads the address information, serial number and timestamp of the wireless audio data packets in sequence, detects the uniqueness of the wireless audio data packets based on the address information, serial number and timestamp, and when multiple repeated wireless audio data packets are detected, filters the wireless audio data packets to obtain a unique wireless audio data packet.

[0088] This embodiment uses an ad hoc network to receive wireless audio data packets from neighboring nodes within the ad hoc network, improving wireless network stability, extending wireless network coverage, and enhancing communication reliability and fault tolerance. Uniqueness detection removes duplicate wireless audio data packets, ensuring the uniqueness of each wireless audio data packet. Duplicate filtering and retention of unique data packets reduces the processing, transmission, and impact of duplicate data, ensuring data integrity and accuracy, and improving processing efficiency.

[0089] 2-3 , in one embodiment, decapsulating a wireless audio data packet and transmitting the decapsulated wireless audio data to a data fusion module includes:

[0090] By pre-setting a decapsulation table, the decapsulation table includes the requirements of address information, sequence number and timestamp as well as the corresponding decapsulation rules. The decapsulation table is used to determine whether the wireless audio data packet meets the requirements and to determine how to decapsulate the corresponding wireless audio data packet.

[0091] After receiving the wireless audio data packet, the wireless protocol stack first reads the address information, serial number and timestamp of the wireless audio data packet, and determines whether the address information, serial number and timestamp meet the requirements according to the requirements in the decapsulation table. When the address information, serial number and timestamp meet the requirements of the decapsulation table, the wireless audio data packet is decapsulated according to the decapsulation rules of the decapsulation table. The decapsulation operation includes decryption, decompression and data format conversion to obtain the original wireless audio data.

[0092] The unpacked wireless audio data is transmitted to the data fusion module of the processor for subsequent processing.

[0093] This embodiment decapsulates wireless audio data packets that meet the requirements according to the decapsulation rules of the decapsulation table and restores them to original wireless audio data. Other data packets that do not meet the requirements are filtered out, thereby reducing the processing and transmission of invalid data, improving processing efficiency, and ensuring data integrity and correctness.

[0094] 2-3 , in one embodiment, the data fusion module merges the network audio data and the wireless audio data to obtain merged data, and transmits the merged data to the audio decoding module, including:

[0095] Detecting, through the data fusion module, whether the processor's operating mode is a single-link transmission mode or a multi-link transmission mode;

[0096] When the operation mode is the single-link operation mode, the data fusion module receives network audio data sent by a single running network protocol stack or wireless audio data sent by a single running wireless protocol stack, queues and performs repetition filtering on the received network audio data or wireless audio data to obtain queued data, and transmits the queued data to the audio decoding module;

[0097] When the operation mode is multi-link operation mode, the data fusion module receives the first data sent by either the network protocol stack or the wireless protocol stack within the preset receiving time, and determines whether the integrity of the first data meets the requirements. If the first data meets the requirements, it is marked as valid data.

[0098] The data fusion module receives the second data from the other party within the preset reception time and determines whether the integrity of the second data meets the requirements. If the second data meets the requirements, it proceeds to the next step of processing. According to the preset data conversion table, the first and second data are converted and compared to obtain the deviation data.

[0099] Determine whether the deviation data meets the requirements of the preset deviation rules. If the deviation data meets the requirements, obtain the common sequence number of the first data and the second data, clear the second data, merge the first data with the deviation data to obtain the merged data of the network audio data and the wireless audio data. The merged data is transmitted in sequence according to the common sequence number to the audio decoding module of the processor for subsequent processing.

[0100] This embodiment determines the integrity of the first and second data, and only complete data will be marked as valid data for subsequent processing, thereby improving the reliability of the data and avoiding the processing of incomplete or damaged data. By converting and comparing the first and second data, deviation data is obtained, which helps to detect differences and deviations between the data and provides a basis for subsequent merging processing. By determining whether the deviation data meets the requirements of the preset deviation rules, the deviation data is screened, which helps to exclude deviation data that does not meet the requirements and retain data that meets the requirements, thereby improving the accuracy and reliability of the data. By obtaining the common serial number of the first and second data, the order of the merged data is ensured to be correct, which helps to maintain the temporal nature of the data and avoid data dislocation or confusion.

[0101] In another embodiment, the present invention further provides a multi-link aggregation transmission system for a group full-duplex call system, comprising:

[0102] An acquisition module is used to receive network audio data packets from a server based on a public network through a network protocol stack, decapsulate the network audio data packets, and transmit the decapsulated network audio data to a data fusion module;

[0103] The acquisition module is used to receive wireless audio data packets from neighboring nodes in the ad hoc network through the wireless protocol stack according to the ad hoc network, decapsulate the wireless audio data packets, and transmit the decapsulated wireless audio data to the data fusion module;

[0104] The processing module is used to merge the network audio data and the wireless audio data through the data fusion module to obtain merged data, and transmit the merged data to the audio decoding module.

[0105] The present invention provides a multi-link aggregation transmission system for a group full-duplex call system, which receives network audio data and wireless audio data respectively through a network protocol stack and a wireless protocol stack, thereby realizing multi-link transmission, increasing transmission bandwidth and stability, improving call quality and reliability, and being able to communicate in areas without base station coverage. The received network audio data packets and wireless audio data packets are decapsulated and restored to the original audio data, ensuring that the transmitted audio data is complete and correct. The network audio data and the wireless audio data are merged and processed by a data fusion module to obtain merged data. Through data fusion, the advantages of multi-link transmission can be fully utilized to improve call quality and capacity. Finally, the merged data is transmitted to the audio decoding module for decoding, and the merged data is restored to an audible audio signal.

[0106] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A multi-link aggregation transmission method for a group full-duplex call system, characterized in that: include: receiving a network audio data packet from a server via a public network through a network protocol stack, decapsulating the network audio data packet, and transmitting the decapsulated network audio data to a data fusion module; receiving wireless audio data packets from neighboring nodes in the ad hoc network through the wireless protocol stack according to the ad hoc network, decapsulating the wireless audio data packets, and transmitting the decapsulated wireless audio data to the data fusion module; The data fusion module adaptively and dynamically merges the network audio data and the wireless audio data according to the operating mode of the processor to obtain merged data, and transmits the merged data to the audio decoding module.

2. The multi-link aggregation transmission method for a group full-duplex call system according to claim 1, characterized in that: Before the step of receiving the network audio data packet of the server through the network protocol stack according to the public network, the step further includes: The processor obtains the voice data packets sent by the voice encoder, and sends the voice data packets to the network protocol stack and the wireless protocol stack respectively; Encrypting and encapsulating the received voice data packets according to preset encapsulation rules through the network protocol stack connected to the processor, and transmitting the encrypted and encapsulated network audio data packets to the server through the public network; The wireless protocol stack connected to the processor encrypts and encapsulates the received voice data packet according to a preset encapsulation rule, and transmits the wireless audio data packet obtained by the encryption and encapsulation to the neighboring node through the protocol of the ad hoc network.

3. The multi-link aggregation transmission method for a group full-duplex call system according to claim 2, characterized in that: The speech encoder encodes the speech stream collected by the microphone according to a preset encoding standard, performs packet processing on the continuous frame data packets obtained by the encoding, and sends the speech data packets obtained by the packet processing to the processor.

4. The multi-link aggregation transmission method for a group full-duplex call system according to claim 3, characterized in that: Packetizing the encoded continuous frame data packets and sending the voice data packets obtained by the packetization to the processor, including: Add header information including the length, encoding format, sampling rate and number of channels of the continuous frame data packet to the continuous frame data packet, extract feature data of the continuous frame data packet, encrypt the continuous frame data packet to obtain an encrypted data packet, set the feature data as a decryption instruction of the encrypted data packet, fill the feature data in 5 vertical columns and 5 horizontal columns respectively, and arrange them in sequence according to a preset fence arrangement rule to obtain 5 vertical fence data and 5 horizontal fence data, interleave the 5 vertical fence data and the 5 horizontal fence data to obtain a fence password that complies with the preset rules, package the encrypted data packet and the fence password to obtain the voice data packet, and send the voice data packet to the processor.

5. The multi-link aggregation transmission method for a group full-duplex call system according to claim 2, characterized in that: The method of receiving a network audio data packet from a server via a public network through a network protocol stack includes: The network protocol stack connected to the target node receives the network audio data packet through a receiving queue, reads the address information, serial number and timestamp of the network audio data packet, re-queues the network audio data packet received within a preset cache time in the receiving queue according to the serial number and timestamp, detects the uniqueness of the network audio data packet based on the address information, serial number and timestamp, and when multiple duplicate network audio data packets are detected, filters the network audio data packet to obtain a unique network audio data packet.

6. The multi-link aggregation transmission method for a group full-duplex call system according to claim 5, characterized in that: The decapsulating the network audio data packet and transmitting the read network audio data to the data fusion module includes: The network protocol stack unpacks the network audio data packet according to a preset unpacking table; specifically, the process includes: judging whether the address information, the serial number, and the timestamp of the network audio data packet meet the requirements through the unpacking table; when the address information, the serial number, and the timestamp meet the requirements of the unpacking table, unpacking the network audio data packet according to the unpacking rules of the unpacking table to obtain the network audio data, and transmitting the network audio data to the data fusion module.

7. The multi-link aggregation transmission method for a group full-duplex call system according to claim 2, characterized in that: The method of receiving a wireless audio data packet from a neighboring node in an ad hoc network through a wireless protocol stack according to the ad hoc network includes: The wireless protocol stack connected to the target node receives the wireless audio data packet from the neighboring node through a self-organizing network, reads the address information, the serial number and the timestamp of the wireless audio data packet, detects the uniqueness of the wireless audio data packet based on the address information, the serial number and the timestamp, and when multiple repeated wireless audio data packets are detected, filters the wireless audio data packet to obtain a unique wireless audio data packet.

8. The multi-link aggregation transmission method for a group full-duplex call system according to claim 7, characterized in that: Decapsulating the wireless audio data packet and transmitting the decapsulated wireless audio data to the data fusion module includes: The wireless audio data packet is unsealed according to a preset unsealing table through the wireless protocol stack; specifically, the process includes: judging whether the address information, the serial number and the timestamp of the wireless audio data packet meet the requirements through the unsealing table; when the address information, the serial number and the timestamp meet the requirements of the unsealing table, unsealing the wireless audio data packet according to the unsealing rules of the unsealing table to obtain the wireless audio data, and transmitting the wireless audio data to the data fusion module.

9. The multi-link aggregation transmission method for a group full-duplex call system according to claim 1, characterized in that: The adaptive dynamic merging of the network audio data and the wireless audio data by the data fusion module according to the operation mode to obtain merged data, and transmitting the merged data to the audio decoding module includes: detecting, by the data fusion module, whether the operating mode of the processor is a single-link transmission mode or a multi-link transmission mode; When the operation mode is the single-link operation mode, the data fusion module receives the network audio data sent by the single-running network protocol stack or the wireless audio data sent by the single-running wireless protocol stack, queues and performs re-filtering on the received network audio data or the wireless audio data to obtain queued data, and transmits the queued data to the audio decoding module; When the operating mode is a multi-link operating mode, when the data fusion module receives the first data sent by either the network protocol stack or the wireless protocol stack within a preset receiving time, it determines whether the integrity of the first data meets the requirements; when the first data meets the requirements, it marks the first data as valid data; when the data fusion module receives the second data sent by the other party within the preset receiving time, it determines whether the integrity of the second data meets the requirements; when the second data meets the requirements, the second data and the first data are converted according to a preset data conversion table, the converted first data and the second data are compared to obtain deviation data, and it is determined whether the deviation data meets the requirements of the preset deviation rule; when the deviation data meets the requirements, a common sequence number of the two data is obtained, the second data is cleared, the first data and the deviation data are merged to obtain the merged data of the network audio data and the wireless audio data, and the merged data is transmitted to the audio decoding module in sequence according to the common sequence number.

10. A multi-link aggregation transmission system for a group full-duplex call system, characterized in that: include: an acquisition module, the acquisition module being configured to receive a network audio data packet from a server according to a public network through a network protocol stack, decapsulate the network audio data packet, and transmit the decapsulated network audio data to a data fusion module; an acquisition module configured to receive wireless audio data packets from neighboring nodes in the ad hoc network through a wireless protocol stack according to the ad hoc network, decapsulate the wireless audio data packets, and transmit the decapsulated wireless audio data to the data fusion module; The processing module is used to merge the network audio data and the wireless audio data through the data fusion module to obtain merged data, and transmit the merged data to the audio decoding module.

Images