271 results about "Signal encoding" patented technology

Techniques and solutions are described for encoding and decoding signals, such as audio data. Disclosed innovations can find particular use in speech coding applications, such as for real time communications. Using a neural network, contextual coding can be used to encode latent features for a current frame using a prediction from reconstructed latent features of past frames as a context. An extractor learns a residual-like feature based on such prediction and latent features of the current frame obtained using an encoder. The residual-like feature is then quantized. At a decoder portion of a coding framework, the quantized feature is dequantized and then combined with a prediction from prior reconstructed latent features to provide reconstructed features of a current frame, which can then be processed by a decoder to provide a reconstructed signal.

The invention provides a motor imagery-based rehabilitation evaluation method and system and a storage medium, and the method comprises the steps: obtaining electroencephalogram signal data collected by a subject during the execution of a motor imagery-based rehabilitation task, and extracting the frequency domain features of the electroencephalogram signal data; inputting the frequency domain characteristics of the electroencephalogram signal data into a pre-trained encoder for encoding, and outputting to obtain embedded representation of the electroencephalogram signal data; inputting the embedded representation of the electroencephalogram signal data into a natural language decoder, and outputting to obtain a rehabilitation evaluation result of the subject; wherein in the process of training the signal encoding module to obtain the encoder, the signal encoding module is updated through encoding loss, so that the embedding representation of the label text and the embedding representation of the corresponding electroencephalogram signal data realize cross-modal alignment. According to the method, the end-to-end generation from the original electroneurographic signal to the multi-modal evaluation information can be realized.

The invention belongs to the technical field of wireless communication and artificial intelligence, and discloses a multi-mode semantic communication method and device oriented to multiple tasks, which avoid low-layer signal coding transmission of original data through extraction and transmission of semantic features, realize end-to-end optimization and channel adaptive robust transmission of semantic level communication, and improve the communication efficiency. The bandwidth occupation is obviously reduced; and the anti-noise performance is improved. Semantic transmission and task execution of multi-source data such as images, texts and voices under a unified framework are achieved through a shared neural network encoder and a channel interface, the robustness of tasks is kept under the complex channel condition, and cross-domain semantic expression among modes such as vision, texts and voices is achieved through the framework. Radio frequency data are sent and received in a real hardware platform, physical combination of an algorithm and a radio frequency link is achieved, and implementation of deep semantic communication in an actual wireless link shows that the method has engineering deployability and expansibility.

The invention provides an equipment fault diagnosis method and device based on a large language model and electronic equipment, and the method comprises the steps: collecting a vibration signal of the equipment, and extracting the time-frequency characteristics of the vibration signal through a signal encoder; a description text corresponding to the time-frequency feature is retrieved from the description text data set; and editing the cue word template based on the description text and the time-frequency features, and inputting the cue word template into the large language model to obtain an equipment fault diagnosis result, an equipment fault diagnosis basis and an equipment fault maintenance scheme output by the large language model. By using a large language model and a retrieval enhancement generation technology, the problem of cross-working-condition fault diagnosis of equipment in a complex environment is solved, so that the accuracy of fault diagnosis is enhanced, and the generalization of diagnosis is improved.

A method for training a non-autoregressive TTS model includes receiving training data that includes a reference audio signal and a corresponding input text sequence. The method also includes encoding the reference audio signal into a variational embedding that disentangles the style / prosody information from the reference audio signal and encoding the input text sequence into an encoded text sequence. The method also includes predicting a phoneme duration for each phoneme in the input text sequence and determining a phoneme duration loss based on the predicted phoneme durations and a reference phoneme duration. The method also includes generating one or more predicted mel-frequency spectrogram sequences for the input text sequence and determining a final spectrogram loss based on the predicted mel-frequency spectrogram sequences and a reference mel-frequency spectrogram sequence. The method also includes training the TTS model based on the final spectrogram loss and the corresponding phoneme duration loss.

An audio communication method, an audio conversion method, a bitstream processing method, an apparatus, an electronic device, a computer-readable storage medium, and a computer program product. The audio communication method comprises: in response to a first communication request for an audio signal, acquiring, from a plurality of communication modes, a voice transformation mode for the audio signal (101); performing feature coding on the audio signal, so as to obtain a coded feature of the audio signal (102); acquiring a target timbre corresponding to the voice transformation mode, and determining a timbre feature of the target timbre (103); performing timbre conversion on the coded feature on the basis of the timbre feature, so as to obtain a target coded feature (104); and performing signal coding on the target coded feature, so as to obtain a target audio bitstream conforming to the target timbre, and transmitting the target audio bitstream to a decoding terminal (105).

An encoding method for a light signal, an electronic device, a non-transitory computer-readable storage medium, and a light signal detection circuit are provided. The encoding method for a light signal includes: detecting whether there is a change in a light intensity signal representing a light intensity, the light intensity signal being converted by a photosensitive unit from a received photon stream; encoding, in response to detecting a change in the light intensity signal, the changed light intensity signal to obtain an encoding result; and arranging the encoding result into an encoded sequence according to a time sequence relationship corresponding to changes in the light intensity, the encoded sequence representing time sequence code of the photon stream, and the time sequence relationship representing an order of the changes in the light intensity within a time period.

The application discloses a kind of haptic signal encoding processing method, decoding processing method and related equipment, belong to haptic codec field, the haptic signal encoding processing method of the embodiment of the application includes: obtaining at least one of the key frame sequence and first signal corresponding to each haptic signal in multiple haptic signals, the key frame sequence is obtained based on second signal, first signal is obtained based on target residual signal and third signal, target residual signal is obtained based on second signal and key frame sequence, second signal and third signal are obtained based on to haptic signal, and the frequency of second signal is less than the frequency of third signal;At least one of the following is performed: first masking processing is carried out to key frame sequence based on first masking model, and the signal after first masking processing is encoded to obtain first encoding sequence;Second masking processing is carried out to first signal based on second masking model, and the signal after second masking processing is encoded to obtain second encoding sequence.

The present disclosure relates generally to signal encoding for value documents. One aspect of the technology relates to authentication of value documents comprising line art patterns. In one example, authentication relies of detection of signals encoded within the line art, and expected frequency domain analysis of the line art. Other combinations are described as well. For example, authentication may rely on detection of signals encoded within encoded and then printed documents, expected frequency domain characteristics encoded signals, presence or absence of halftoning, a color check and / or trained classifier analysis. Other aspects, technology, claims and combinations are described as well.

The invention belongs to the field of communication, and relates to an audio signal transmission method and related equipment, and the method comprises the steps: collecting audio signals which comprise a public network audio signal and a private network audio signal; preprocessing the public network audio signal and the private network audio signal; mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal; encoding the mixed audio signal into a Bluetooth protocol format through an application program, and generating a Bluetooth audio signal; and transmitting the Bluetooth audio signal to a Bluetooth device. According to the application, protocol analysis and mixing processing are carried out on the private network data packet through a software level, seamless audio fusion of the public network and the private network and cooperative output of the Bluetooth are realized, the problem that audio fusion of the public network and the private network and intercommunication between the Bluetooth and the private network need additional hardware modules is solved, low-delay and high-compatibility transmission is realized, and the transmission efficiency is improved. And the user experience and the operation efficiency in a complex communication scene are improved.

The invention relates to the technical field of power system equipment detection, and discloses a mouse linkage wireless intelligent triggering system and method for a switch cabinet mechanical characteristic test, and the system comprises a motion collection module which is used for collecting the operation parameters of a mouse, building an operation behavior feature library, and transmitting the operation behavior feature data to a signal coding module in real time; the signal coding module is used for receiving the operation behavior characteristic data of the mouse, collecting an opening and closing instruction electric signal generated by a telecontrol background, extracting behavior characteristics and electric signal characteristics, and generating a unique opening characteristic code and / or a closing characteristic code; the tester intelligent receiving module is used for receiving the opening feature code and / or the closing feature code, and starting a dual mechanism of time window verification and feature code matching verification to verify the feature code; and the cloud collaborative management platform is used for receiving data uploaded by the action acquisition module, the signal coding module and the tester intelligent receiving module in real time. The efficiency of testing the mechanical characteristics of the switch cabinet is improved.

The invention discloses a multi-modal speech enhancement method and device based on a deep learning model, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining the head posture data, binaural audio signals and visual context information of a user in a virtual reality environment, coding the binaural audio signals into three-dimensional space acoustic features, and carrying out the coding of the three-dimensional space acoustic features; and extracting virtual sound source position features and lip motion features from the visual context information, inputting the features into an immersive fusion enhancement network, selectively enhancing or inhibiting acoustic features from different spatial directions, generating an enhanced audio stream, and outputting the enhanced audio stream through a binaural rendering engine. According to the method, the technical problems that in the prior art, due to the fact that multi-modal prior information cannot be effectively fused, voice enhancement lacks spatial selectivity, and an interference sound source irrelevant to vision is difficult to restrain are solved, and head posture dynamic attention and lip motion cross-modal constraint are fused; the technical effects of natural binding of auditory attention and a visual focus and effective suppression of an interference sound source are achieved.

The invention provides signal coding equipment, an imaging system and an imaging method. The signal coding equipment comprises an array waveguide grating, a coding optical fiber, a delay optical fiber and an optical splitter, the array waveguide grating is configured to convert an initial signal emitted by the light source into multiple paths of target signals; the optical splitter is configured to combine multiple paths of target signals and then emit the combined signals; a plurality of paths of coding optical fibers and a plurality of paths of delay optical fibers with different lengths are arranged behind the array waveguide grating, and each path of delay optical fiber is connected to the coding optical fiber of the corresponding coding sequence; the delay optical fiber is configured to delay a transmitted target signal, and the coding optical fiber is configured to perform pulse coding on the transmitted target signal. According to the invention, the original pulse signal is coded by using the sequence code with good orthogonality, so that the signal processing accuracy is improved. And the delay optical fibers are grouped, so that the corresponding channels in each group of channels can be simultaneously transmitted, the signal transmitting time is shortened, the signal processing efficiency is improved, and the point acquisition rate can be improved while the fuzzy distance is expanded.

A video decoding method includes the steps of: generating a merge candidate list for a first block; selecting one among merge candidates included in the merge candidate list; and performing motion compensation for the first block based on motion information of the selected merge candidate. At this point, an inter-region merge candidate included in an inter-region motion information list may be added to the merge candidate list based on the number of spatial merge candidates and temporal merge candidates included in the merge candidate list.

This invention relates to the field of control methods for public transportation equipment, specifically to a control method for LED wall washer lights for driver fatigue wake-up in long tunnels. The method includes: calibrating driver fatigue-sensitive sections in each spatial unit of the entire tunnel and completing alignment; updating the vehicle's spatial unit and collected parameters in real time to classify the driver's real-time fatigue state; generating a fatigue wake-up light signal encoding parameter set for the vehicle corresponding to the current driving tracking ID, the current fatigue state, and the current spatial unit; and driving the wall washer lights to generate optical flow signals according to the set parameters. This invention constructs an optical flow signal framework deeply bound to the driving state, simultaneously achieving both fatigue wake-up and directional navigation functions. It also binds the driver's real-time fatigue state classification to a stepped stimulation level, ensuring that the optical flow signal only acts on the surrounding visual area corresponding to the tunnel sidewall, without interfering with the driver's observation. This spatial distribution eliminates the interference of dynamic lighting on normal driving observation.

FIELD: video signal encoding and decoding.SUBSTANCE: residual coefficient of the residual block is extracted. The quantization parameter for the residual block is calculated. Inverse quantization on the residual coefficient using the calculated quantization parameter is performed. A residual sample of the residual block is formed by performing an inverse transform on the inversely quantized residual coefficient. The encoded residual coefficient for the partial region in the residual block is not transmitted from the encoding device. The residual sample of the partial region in the residual block is set to the default value preset in the decoder, which is 0. The default value is set based on at least one of the size or shape of the residual block. A partial region is a region excluding at least one of the N columns on the left side of the residual block or M rows on the top side of the residual block.EFFECT: increased efficiency of video signal coding.9 cl, 16 dwg

A multi-channel signal encoding method includes determining a downmixed signal of a first channel signal and a second channel signal in a multi-channel signal, and reverberation gain parameters corresponding to different subbands of the first channel signal and the second channel signal, where the obtained reverberation gain parameters belong to at least two reverberation gain parameter groups. The method further includes selecting, from the at least two reverberation gain parameter groups, a target reverberation gain parameter group. The method further includes generating parameter indication information, where the parameter indication information indicates the target reverberation gain parameter group. The method further includes encoding reverberation gain parameters corresponding to the target reverberation gain parameter group, the parameter indication information, and the downmixed signal to obtain a bitstream.

An image signal decoding method according to the present invention comprises the steps of: decoding information indicating whether a current block is encoded using a multi-mode intra prediction; when it is determined that the current block is encoded in the multi-mode intra prediction, dividing the current block into a plurality of partial blocks; and obtaining an intra prediction mode of each of the plurality of partial blocks.

Provided are an apparatus for encoding an audio signal and a method of an operation thereof. An audio signal encoding method includes obtaining quantized linear prediction (LP) coefficients by performing a linear predictive coding (LPC) analysis and quantization on an input audio signal, generating a reference signal by applying discrete Fourier transform (DFT) to the input audio signal, obtaining LP residual coefficients from the reference signal, scaling magnitudes of the LP residual coefficients using the quantized LP coefficients and the reference signal, and quantizing phases of the LP residual coefficients and the scaled magnitudes of the LP residual coefficients.

The application belongs to the field of communication and relates to an audio signal transmission method and related equipment, which comprises the following steps: collecting an audio signal, wherein the audio signal comprises a public network audio signal and a private network audio signal; preprocessing the public network audio signal and the private network audio signal; mixing the preprocessed public network audio signal and the preprocessed private network audio signal to obtain a mixed audio signal; encoding the mixed audio signal into a Bluetooth protocol format through an application program to generate a Bluetooth audio signal; and transmitting the Bluetooth audio signal to a Bluetooth device. The application performs protocol analysis and mixing processing on a private network data packet at a software level, realizes seamless fusion of public network and private network audio and Bluetooth collaborative output, solves the problem of the need for additional hardware modules for public and private network audio fusion and interworking between private networks, realizes low-delay and high-compatibility transmission, and improves user experience and operation efficiency in a complex communication scenario.

A fingerprint sensor, comprising fingerprint sensing circuitry configured to sense a fingerprint of a finger, and to provide a representation of the fingerprint; a sensor interface coupled to the fingerprint sensing circuitry, and comprising at least a first input pad for input to the fingerprint sensor of at least a first digital signal, and at least one output pad for output from the fingerprint sensor of a digital data signal encoding the representation of the fingerprint; and IO-voltage determining circuitry coupled to the first input pad and configured to sense a voltage level of the first digital signal, and to determine, based on the sensed voltage level of the first digital signal, a nominal voltage level to use for the digital data signal encoding the representation of the fingerprint.

The present disclosure provides an apparatus and method for encoding a video with ultra-low latency, the apparatus including: one or a plurality of video sources configured to provide a video signal; an encoder configured to encode the video signal provided through the video source and provided for each of the video sources; and a caster configured to transmit video data encoded by the encoder to the outside through a network communication network.Accordingly, the present disclosure can transmit a video with ultra-low latency, so a video service is possible in real time anytime anywhere as long as the internet is connected, whereby there is the advantage that the present disclosure can be applied to various fields of 4th industry such as autonomous driving, unmanned drone operation, driving of unmanned heavy equipment, robot control, a remote medical service, VR / AR, an intelligent CCTV, a smart city⋅factory, provision of traffic information, etc.

A multi-channel signal encoding method includes obtaining a multi-channel signal of a current frame; determining an initial multi-channel parameter of the current frame; determining a difference parameter based on the initial multi-channel parameter of the current frame and multi-channel parameters of previous K frames of the current frame, where the difference parameter represents a difference between the initial multi-channel parameter of the current frame and the multi-channel parameters of the previous K frames, and K is an integer greater than or equal to one; determining a multi-channel parameter of the current frame based on the difference parameter and a characteristic parameter of the current frame; and encoding the multi-channel signal based on the multi-channel parameter of the current frame.

Various problems in a wire rope, such as internal defects, fatigue damage, wear, and corrosion, are nondestructively analyzed by momentarily magnetizing a wire rope with a permanent magnet for detection and detecting, via sensors, magnetic flux leakage signals that are generated in the magnetized state, but issues arise: defect signals are not clearly delineated due to environmental noise and trends contained in raw magnetic flux leakage signals; and signal distortion caused by the dynamic state of a rope must be removed to detect defects more accurately. To address these issues, data preprocessing comprises: a channel trend removal step for removing low-frequency signals below a threshold after acquiring signal data from a plurality of Hall sensors; a channel noise removal step for identifying high-frequency signals above the threshold as noise and removing same from the signal data that has undergone the trend removal step; a change point detection step for removing the effect of the wire rope moving upward, downward, or being stationary, to distinguish states and calculating information for detecting defects; and a Hilbert transform step for making the signs of the signals to be the same on the basis of the threshold so that the defects of the wire rope can be detected.

This sound signal downmixing method comprises: a delayed crosstalk addition step for, with respect to each of two channels, acquiring, as a delayed crosstalk-added signal of the channel, a signal obtained by adding an input sound signal of the channel and a signal obtained by delaying an input sound signal of the other channel and multiplying the delayed input sound signal by a weight value that is a predetermined value with an absolute value less than 1; a left-right relation information acquisition step for acquiring preceding channel information that is information indicating which of the delayed crosstalk-added signals of the two channels precedes, and a left-right correlation value that is a value indicating the magnitude of a correlation between the delayed crosstalk-added signals of the two channels; and a downmixing step for acquiring a downmixed signal by performing weighted addition of the input sound signals of the two channels such that the input sound signal of the preceding channel out of the input sound signals of the two channels is included in a larger proportion as the left-right correlation value is larger, on the basis of the left-right correlation value and the proceeding channel information.

Embodiments of the present application disclose a kind of multi-channel signal encoding and decoding method and device.In the encoding method of multi-channel signal, the current frame of the multi-channel signal to be encoded includes first channel and second channel, obtain the first grouping information of the M blocks of first channel and the second grouping information of the M blocks of second channel, when the first grouping information and the second grouping information satisfy preset condition, obtain the first adjustment grouping information and the second adjustment grouping information according to the first grouping information and the second grouping information;Next, obtain the first to be encoded spectrum according to the first adjustment grouping information and the spectrum of the M blocks of first channel, and the same can obtain second to be encoded spectrum, finally, the first to be encoded spectrum and second to be encoded are encoded using encoding neural network, and the spectrum encoding result is obtained, and the spectrum encoding result can be carried by bitstream.It can realize grouping, adjustment and encoding for different transient identification blocks, improve the encoding quality of multi-channel signal.

A video encoding / decoding apparatus according to the present invention acquires motion vector refinement information, performs motion compensation on the basis of a motion vector of a current block, refines the motion vector of the current block using at least one or both of the motion vector refinement information and the output of the motion compensation, and performs motion compensation using the refined motion vector.

The video decoding method of the present invention comprises the steps of: generating a merge candidate list in a current block; specifying any one of a plurality of merge candidates included in the merge candidate list; deriving a first affine seed vector and a second affine seed vector of the current block based on the first affine seed vector and the second affine seed vector of the specified merge candidate; deriving an affine vector of a sub-block of the current block using the first affine seed vector and the second affine seed vector of the current block; and performing motion compensation prediction on the sub-block based on the affine vector.

The image decoding method according to the present invention includes the following steps: deriving merging candidates of the current block from neighboring blocks; adding the derived merging candidates to a merging candidate list; and when the number of merging candidates already added to the merging candidate list is less than a threshold, adding at least one predicted region merging candidate included in the predicted region motion information list to the merging candidate list; deriving motion information of the current block based on the merging candidate list; and performing motion compensation on the current block based on the derived motion information.

To provide a sensor system capable of improving detection accuracy of a conductor.SOLUTION: A sensor system (20) includes a signal generation unit (23) that generates a reference signal having a predetermined frequency, and an encoding unit (24) that encodes the reference signal by a first code and a second code different from each other. The sensor system also includes a capacitance type of first sensor (21) that detects a conductor in a first area according to the signal encoded by the first code, and a capacitance type of second sensor (22) that detects the conductor in a second area at least partially overlapped with the first area according to the signal encoded by the second code. The sensor system also includes a decoding unit (25) that decodes a first detection signal transmitted from the first sensor according to the first code, and decodes a second detection signal transmitted from the second sensor according to the second code, and a detection unit (26) that detects the presence or absence and a position of the conductor on the basis of the decoded signal.SELECTED DRAWING: Figure 3