27 results about "Channel decoder" patented technology

The present invention relates to the technical field of cross-modal image signal reconstruction. Disclosed is a cross-modal joint source-channel coding and decoding method adaptable to changeable scenarios. The method comprises: first designing a Transformer encoder-based cross-modal channel coding and decoding optimization solution, so as to achieve the performance improvement and robustness of a channel encoder and a channel decoder; then designing a cross-modal source coding and decoding optimization solution for haptic-to-image generation based on a latent diffusion model, so that under an image signal loss scenario, haptic information is used to guide image generation; and finally, incorporating transfer learning technology, so as to reduce additional training costs caused by a system facing changeable cross-modal communication scenarios such as a changeable channel signal-to-noise ratio and different transmission tasks. Under cross-modal changeable communication scenarios, the joint source-channel coding and decoding method provided in the present invention can solve the problems of the inability of a receiving end to well complete image reconstruction, and additional model training costs caused by changeable channel environments and scenarios.

The invention provides a diffusion-driven channel adaptive point cloud semantic communication method, which belongs to the technical field of wireless communication, and comprises the following steps: obtaining a training point cloud data set, constructing a point cloud feature extraction network based on a hypergraph convolutional neural network as a semantic encoder, and constructing a channel adaptive enhancement module as a channel decoder, a channel adaptive recovery module is constructed at a receiving end as a channel decoder, a diffusion reconstruction network is constructed as a semantic decoder, end-to-end joint training is performed on the point cloud feature extraction network, the channel adaptive enhancement module, the channel adaptive recovery module and the diffusion reconstruction network, the diffusion reconstruction network predicts original point cloud distribution, and the point cloud feature extraction network and the channel adaptive enhancement module are subjected to end-to-end joint training. And a loss function is constructed based on the chamfering distance between the predicted point cloud distribution and the original point cloud. In the communication process, the reconstructed semantic features are input into the diffusion reconstruction network to reconstruct an original point cloud structure. The high-order semantic features of the point cloud can be effectively extracted so as to improve the adaptive capacity of the method to the incomplete point cloud.

The present disclosure provides a semantic communication method and device, electronic equipment and storage medium, relates to the technical field of communication, in particular to the technical field of semantic communication. The scheme is: obtaining high-speed mobile user data and low-speed mobile user data; using a first deep joint source channel encoder to encode the high-speed mobile user data to obtain first semantic symbols, and using a second deep joint source channel encoder to encode the low-speed mobile user data to obtain second semantic symbols; performing delay Doppler domain modulation on the first semantic symbols to generate a first signal, and performing time-frequency domain modulation on the second semantic symbols to generate a second signal; superimposing the first signal and the second signal, and sending the superimposed signal to a receiving end; and performing parallel decoding on the receiving end through a first deep joint source channel decoder and a second deep joint source channel decoder to recover the data. The present disclosure suppresses the cliff effect and improves transmission reliability.

A semantic communication system includes a base station including a semantic encoder configured to convert data to be transmitted into semantic information and a channel encoder configured to convert the converted semantic information into a channel signal and a plurality of user equipment devices (UEs) including a channel decoder configured to receive the channel signal and decode the channel signal into the semantic information and a semantic decoder configured to decode data included in the decoded semantic information based on the decoded semantic information.

This invention discloses a source-channel joint encoding and decoding method based on a cross-modal communication system, relating to the field of cross-modal image signal reconstruction technology. The method includes: First, designing a cross-modal source encoder, inputting tactile signals and image signals with category labels into the encoder to mine deep-level fusion feature information between modalities. Second, designing a channel encoder and channel decoder, directly mapping the extracted fusion features into a bitstream for channel transmission, improving the system's adaptability to channel changes. Finally, designing a corresponding source decoder at the receiving end to complete high-quality image signal reconstruction from deep-level feature information. The source-channel joint encoding and decoding method provided by this invention reduces power consumption in the network, uses a fitness function to measure the load balance between the cloud network and the server (host), transforming the load balancing problem into an optimization problem, thus making it suitable for resource optimization. Using the particle swarm optimization results as the initial population for the genetic algorithm, this invention achieves better results in terms of execution cost, load balancing, and completion time.

The application discloses a kind of semantic communication methods, devices and systems for image classification tasks, the method includes transmitter obtains the semantic feature of given image and is encoded into transmitted image semantic vector based on auto-encoder;Relay node extracts the text feature of given image, and it is multimodal feature fusion with the image feature recovered by image channel decoder, then it is obtained multimodal semantic vector by multimodal channel encoder and is forwarded to receiver;Receiver receives multimodal semantic vector and executes image classification task.The semantic communication method provided by the application introduces the structure of auto-encoder into semantic communication on the one hand, greatly reduces the information redundancy, reduces the occupied communication resources, on the other hand, introduces multimodal semantic relay module, it can supplement complementary text semantic features in relay node, to help receiver better complete image classification task.

This invention provides a resource allocation method for an image semantic communication system that balances computation and transmission. The image semantic communication system includes a channel encoder, a channel decoder, a semantic decoder, and a semantic encoder with selectable slices. Multiple slices in the encoder have different network depths and widths. The method includes: calculating the computational and transmission loads required by each terminal when selecting different slices; determining the corresponding objectives and constraints based on the communication scenario; modeling an optimization model based on the objectives and constraints; solving the optimization model based on the computational and transmission loads required by each terminal when selecting different slices to obtain a target slice combination and a target resource allocation scheme. The slice combination is the set of slices selected by all terminals, and the resource allocation scheme is the computational and transmission resources allocated to each terminal. This invention, by selecting different slices for encoding and transmission, can flexibly adapt to different communication scenarios and requirements.

A multi-channel decoder circuit associated with a multi-channel decoder system is disclosed. The multi-channel decoder circuit comprises a distributed decoder circuit comprising a set of unit decoder circuits, each unit decoder circuit configured to receive one or more codewords of a plurality of codewords associated with a plurality of input channels, and decode the one or more codewords. The multi-channel decoder circuit further comprises a distribution controller circuit configured to distribute each incoming codeword of the one or more codewords to the respective unit decoder circuit of the set of unit decoder circuits within the distributed decoder circuit, based on determining a currently available unit decoder circuit within the set of unit decoder circuits.

This invention discloses a speech enhancement method, an electronic device, and a storage medium. The speech enhancement method is used in a speech enhancement system, which includes an encoder module, a dual-channel module, a decoder module, and a merging module. The decoder module includes an excitation decoder, a channel decoder, and a complex spectrum decoder. The method includes: extracting preset features from the original noisy speech signal using the encoder module; modeling the preset features on the frequency axis using the dual-channel module to obtain frequency axis features; modeling the preset features on the time axis using the dual-channel module to obtain time axis features; processing the time axis features using the excitation decoder and channel decoder to obtain a first denoised speech signal; processing the frequency axis features using the complex spectrum decoder to obtain a second denoised speech signal; and merging the first denoised speech signal, the second denoised speech signal, and the original noisy speech signal using the merging module to obtain a final estimated speech signal.

The application discloses a kind of based on source channel joint coding haptic signal reconstruction method, it is related to haptic signal generation technical field, including: the haptic and image signal for training is passed through source encoder, based on classification task preliminary carries out the modal intra-feature extraction and inter-modal feature fusion of haptic and image.Based on the channel encoder of neural network modeling that fusion feature is input, it is used to produce the code stream suitable for channel transmission, after channel transmission, input channel decoder, through the joint training of channel encoder and decoder, the recovered fusion feature is input into haptic decoder, and haptic signal is reconstructed.The haptic signal reconstruction method based on source channel joint coding provided in the application realizes the semantic information fusion of different modal, greatly reduces data volume, improves the robustness of signal to channel change by separately designed channel encoder and channel decoder, and reduces the delay of signal through channel, so that the reconstruction quality of haptic signal is significantly improved.

The invention discloses a cross-modal pedestrian re-identification method based on intermediate modal and multi-attention fusion, and the method comprises the steps: firstly carrying out the modal preprocessing of a visible light image and an infrared image, and inputting the images into a nonlinear modal converter; the converter comprises a bimodal information encoder and a unified channel decoder, and is used for generating an intermediate modal image with modal alignment; then, jointly inputting the generated intermediate modal image and the original visible light and infrared image into a backbone network, and extracting part aggregation features through an intra-modal multi-attention fine-grained feature aggregation module; furthermore, the distribution consistency of the middle modal image is restrained through a loss function of unified modal alignment, the inter-modal alignment effect is optimized, and the cross-modal recognition performance is improved. According to the method, image-level nonlinear mapping and a multi-attention mechanism are utilized, the problems of modal difference and intra-modal heterogeneity between visible light and infrared images are effectively relieved, and the discrimination and robustness of pedestrian identity features are enhanced.

The invention discloses an image semantic communication method and device based on semantic entropy and CSI non-intrusive fusion. The method comprises the following steps: determining estimated CSI based on an original pilot signal and a received pilot signal; when the semantic information entropy of the image semantic information output by the channel decoder is greater than or equal to the dynamic entropy threshold of the channel, performing feature extraction on the estimated CSI to obtain the feature information of the estimated CSI; respectively calculating a value vector, a key vector and a query vector of the semantic information and the feature information of the image, and carrying out vector fusion to obtain enhanced feature representation; performing semantic decoding on the enhanced feature representation to obtain a reconstructed image; according to the method, for a 6G MIMO fading channel, image semantic information and estimated CSI are fused, a more robust semantic feature can be generated, and the feature intrusion problem in a traditional method is avoided.

The application relates to a Gold sequence spread spectrum underwater acoustic modulation and demodulation method against strong multipath interference, relating to underwater acoustic communication. The method comprises the design of a transmitting end modulation and a receiving end demodulation; on the basis of a traditional Gold sequence spread spectrum modulation and demodulation technology, a molecule set method is adopted to divide the traditional GSSS code set into multiple subsets, and different subsets are adopted in the modulation process of each symbol, so that weak correlation is ensured between each symbol. The demodulation process is based on the molecule set modulation method of the modulation process, energy detection is carried out according to the corresponding local GSSS code subset symbol by symbol, the number of bits carried by each symbol is calculated, each bit soft information is calculated, the soft information is input into an interleaver and a channel decoder, and the original information is correctly demodulated. The method overcomes the problem that the traditional GSSS modulation and demodulation technology cannot be correctly demodulated in a strong multipath environment, improves the robustness of the GSSS modulation and demodulation technology to the strong multipath underwater acoustic channel, and realizes stable and robust communication in the strong multipath environment.

The invention relates to a digital semantic communication method and system for voice reconstruction and classification, and the method comprises the steps: carrying out the preprocessing of voice data, and inputting the preprocessed data into a semantic encoder formed based on a double-attention residual mechanism network; after semantic features output by the semantic encoder are processed by the channel encoder, the semantic features are mapped into digital constellation symbols by a modulator adopting a soft quantization method; after transmission through the physical channel, the modulation symbols recover features by the soft decision demodulator, and signal distortion caused by the physical channel is eliminated through the channel decoder; and the demodulated semantic features are respectively input into a semantic decoder with a symmetric architecture to realize voice reconstruction, and input into a voice classifier consisting of a lightweight feature compression network and a classification head to realize voice classification. According to the method, the feature extraction integrity is improved through a double-attention architecture, the gradient fracture problem is solved through soft quantization and soft decision, and the channel robustness is enhanced in combination with progressive signal-to-noise ratio training.

The invention discloses a channel decoding method and device and a channel decoder. The method comprises the following steps: acquiring a received signal, an actual channel noise variance and a plurality of preset channel noise variances corresponding to a plurality of preset time steps; performing matching processing based on the actual channel noise variance and a plurality of preset channel noise variances corresponding to the plurality of preset time steps, and determining an initial time step; determining a de-noising time step sequence based on the initial time step and a preset time step; based on the received signal, the de-noising time step sequence and a preset time embedding converter model, performing de-noising processing to obtain a target original signal; and performing hard decision processing based on a preset threshold and the target original signal to obtain a target decoding value corresponding to the received signal. According to the method, the received signal can be initialized to a proper state of the diffusion time axis, and the received signal is gradually denoised based on the time step sequence by using the time embedding converter model, so that the physical consistency with a forward process is realized, and the decoding accuracy is improved.

A multi-channel decoder circuit associated with a multi-channel decoder system is disclosed. The multi-channel decoder circuit comprises a distributed decoder circuit comprising a set of unit decoder circuits, each unit decoder circuit configured to receive one or more codewords of a plurality of codewords associated with a plurality of input channels, and decode the one or more codewords. The multi-channel decoder circuit further comprises a distribution controller circuit configured to distribute each incoming codeword of the one or more codewords to the respective unit decoder circuit of the set of unit decoder circuits within the distributed decoder circuit, based on determining a currently available unit decoder circuit within the set of unit decoder circuits.

The application discloses a cross-modal source channel joint coding method for coping with variable scenes, relates to the technical field of cross-modal image signal reconstruction, and comprises the following steps: firstly, a cross-modal channel coding optimization scheme of a Transformer encoder is designed to improve the performance and robustness of a channel encoder and a channel decoder; secondly, a cross-modal source coding optimization scheme of haptic-image generation based on a hidden diffusion model is designed to guide image generation by using haptic information in the case of image signal loss; finally, a transfer learning technology is introduced to reduce the additional training cost of the system in the face of variable cross-modal communication scenes, such as variable channel signal-to-noise ratios and different transmission tasks. The source channel joint coding method provided by the application can solve the problems that the receiver cannot well complete image reconstruction and additional model training costs caused by variable channel environments and scenes in the variable scene of cross-modal communication.

The invention belongs to the technical field of SoC design in an integrated circuit. The Crossbar interconnection architecture based on the AMBA AXI protocol comprises a top-layer interface, an arbitration system and a data distribution system, the top-layer interface comprises a slave interface and a master interface, the arbitration system comprises a decoding module and an arbiter, the decoding module comprises a write transaction channel decoder, a read address channel decoder and a read data channel decoder, and the data distribution system comprises a read transaction channel decoder, a read address channel decoder and a read data channel decoder. The data distribution system comprises a write transaction channel occupancy table, a read transaction channel occupancy table and a multi-path data selection module, wherein the read transaction channel occupancy table comprises a read address channel occupancy table and a read data channel occupancy table. Allowing the plurality of master devices to access the slave devices in parallel; as different master devices send communication requests of the same access mode to the same slave device, communication arbitration can be completed in one period; communication mechanisms such as Outstanding, out-of-order, Interleaf and the like in the AXI protocol can be supported and realized.

The application discloses a simple receiving multiple access method based on symbol and bit stream joint distribution, first, a transmitter distributes symbol streams and bit streams of each user based on a hierarchical quadrature amplitude modulation constellation diagram; different interference management schemes are adopted for inter-user interference in different beams and inter-user interference in the same beam to inhibit the influence of inter-user interference on system performance; channel equalization processing is performed on signals received by each user receiver, each user calculates log likelihood ratios of each bit stream allocated to each user according to a bit stream distribution result, and the calculation result is sent into a channel decoder to obtain original bit data. The above method jointly optimizes symbol and bit stream distribution schemes of each user and constellation diagram design, and can realize efficient user access in a large-scale access scene while satisfying a constraint condition of signal processing complexity of the receiver.

The invention relates to a redundant remainder system (RRNS) channel encoder, an RRNS channel decoder, an RRNS channel encoding method, an RRNS channel decoding method, electronic equipment and a storage medium. A mode set corresponding to the RRNS channel encoder comprises k information modes and n-k redundant modes; the RRNS channel encoder comprises: an input module receiving a first k-element remainder vector comprising k information remainder components; the modular operation modules from the first level to the (k-1) th level determine k weights based on the k information remainder components and the k information moduli; the kth-level modular operation module determines n-k check remainder components based on the k information moduli, the k weights and the n-k redundancy moduli; the output module determines and sends a first n-element remainder vector to the target channel according to the k information remainder components and the n-k check remainder components. According to the embodiment of the invention, the implementation complexity of the digital circuit of the RRNS channel encoder can be reduced.

The disclosure relates to a 5G communication system or a 6G communication system for supporting higher data rates beyond a 4G communication system such as long term evolution (LTE). Disclosed herein is a method for decoding received signal that includes obtaining an input parameter from the received signal, obtaining a tree structure based on matrix factorization of the channel matrix, pre-processing of the received signal, obtaining an initial linear solution, determining a neighbour of the linear solution based on the modulation order for a layer and a pre-defined number of the neighbour in the layer, creating a search space by pruning the tree structure, applying a decoding technique on the search space, computing a decision metric, determining a likelihood-based metric based on the decision metric, and decoding the received signal by feeding the likelihood-based metric for the at least one bit to a channel decoder.

The present disclosure relates to a redundant residue number system (RRNS) channel encoder, a RRNS channel decoder, a RRNS channel encoding method, a RRNS channel decoding method, an electronic device, and a storage medium. The RRNS channel encoder corresponds to a modulus set including k information moduli and n-k redundancy moduli. The RRNS channel encoder includes an input module configured to receive a first k-residue vector including k information residue components; a first to (k-1)-th modulus operation module configured to determine k weights based on the k information residue components and the k information moduli; a k-th modulus operation module configured to determine n-k check residue components based on the k information moduli, the k weights, and the n-k redundancy moduli; and an output module configured to determine a first n-residue vector based on the k information residue components and the n-k check residue components, and send the first n-residue vector to a target channel. The embodiments of the present disclosure can reduce the complexity of digital circuit implementation of the RRNS channel encoder.

There is disclosed a channel decoder apparatus (40) for generating a vectorial feature representation as a vectorial feature representation (40a, 45) in a format specific of a source decoder (50), from a sequence of symbols (36), the vectorial feature representation (40a) representing a source signal (1, 5), the channel decoder apparatus being configured to apply at least one channel-decoder neural network, NN (40a, 42), to the sequence of symbols (36) or another representation (46a, 43a, 42a) of the sequence of symbols, thereby generating the vectorial feature representation in the format specific of the source decoder (50). There is disclosed a channel encoder apparatus (30) for encoding a source signal (1) received as a vectorial feature representation (20a, 21a) from a source encoder (20), the vectorial feature representation (20a, 21a) being in a vectorial format specific of the source encoder (20), the channel encoder apparatus (30) being configured to apply at least one channel-encoder neural network, NN (30a), to the vectorial feature representation (20a, 21a) in the vectorial format specific of the source encoder (20) or to another feature representation (22a, 23a, 24a, 25) of the vectorial feature representation (20a, 21a), to provide a sequence of symbols (35) from the vectorial feature representation (20a, 21a) or the other feature representation (22a, 23a, 24a, 25).

According to the rate matching puncturing method based on semantic importance, a sending end rate matcher is additionally arranged between a sending end semantic encoder and a channel encoder, more important symbol compression semantic rate in an output result of the semantic encoder is reserved, semantic loss is reduced to the maximum extent, and the rate matching puncturing efficiency is improved. And adding a receiving end rate matcher between a receiving end channel decoder and a semantic decoder to reconstruct punctured semantic slices. According to the technical scheme, the semantic slices containing more important semantic information can be effectively recognized and reserved, so that semantic loss caused in the rate matching process is reduced, meanwhile, the scheme does not need to re-train an original semantic communication system, and the semantic slices can be conveniently embedded into the existing semantic communication system.

This invention relates to the field of wireless communication channel decoding, specifically a channel decoding method and system based on dynamic channel environments. The method includes: acquiring a received signal; performing synchronization, channel estimation, and demodulation processing on the received signal to obtain an initial log-likelihood ratio vector and a channel-related feature matrix; concatenating and normalizing the initial log-likelihood ratio vector and the channel-related feature matrix to obtain a normalized feature matrix; constructing a log-likelihood ratio correction model; inputting the normalized feature matrix into the log-likelihood ratio correction model to obtain a corrected log-likelihood ratio vector; acquiring a pre-set initial value for a scaling factor; calibrating the corrected log-likelihood ratio vector to obtain a final log-likelihood ratio vector; and inputting the final log-likelihood ratio vector into a channel decoder for decoding. This method solves the problems of lack of adaptability and accuracy in existing channel decoding methods based on dynamic channel environments.

The application discloses a reversible robust watermark embedding and extraction model construction method against image attacks, which comprises a first Harr wavelet transformer, a channel encoding module, a channel decoding module, a reversible module, an embedding and separation module, a first image attack module and a second image attack module; the channel encoding module comprises a channel encoder, an upsampler, an expander and a second Harr wavelet transformer which are sequentially connected; the channel decoding module comprises a second separator, a first Harr wavelet inverse transformer, a third separator and a channel decoder which are sequentially connected; the reversible module comprises a plurality of feature aggregation layers, and the plurality of feature aggregation layers are sequentially connected and further connected with a convolutional neural network; the embedding and separation module comprises a first separator, a second Harr wavelet inverse transformer and a third Harr wavelet transformer; the first image attack module comprises a first attack layer, and the second image attack module comprises a second attack layer and a third attack layer. The application improves the robust performance of the model and the extraction accuracy of watermark information.

The invention discloses a physical layer security semantic communication method based on channel capacity constraint, and the method comprises the following steps: determining a semantic communication system architecture which comprises a transmitting end, a legal receiving end and an eavesdropping receiving end; carrying out vector embedding, semantic coding and channel coding on the source statement, generating a transmission signal, and transmitting the transmission signal through a channel; at a legal receiving end and an eavesdropping receiving end, source statement reconstruction is carried out by utilizing a channel decoder and a semantic decoder, meanwhile, channel state information of a legal channel and an eavesdropping channel is considered, and good channel capacity estimation of a legal user and an eavesdropper is realized by introducing a differentiable mutual information estimator; traversal safety capacity is regulated and controlled in an explicit mode by adopting safety threshold constraint, wiretap channel capacity increase is restrained while legal channel capacity is maximized, and finally a semantic communication system and a mutual information estimator are jointly trained. According to the method, the safety and reliability of the semantic communication system can be effectively improved.