27 results about "Error concealment" patented technology

The invention discloses a multidirectional frame audio stream transmission method, device, equipment and medium, and the method is realized through cooperation of a transmitting end and a receiving end: the transmitting end cuts an original audio stream into independent audio frames, gives priority identifiers to the independent audio frames, and determines redundant coding parameters and transmission paths for different priority frames in combination with a predefined static strategy; generating a data packet containing an original data block and a redundant data block, and sending the data packet through at least one network path; and a receiving end caches the multi-path data packet, recovers lost data by using redundant data blocks to recombine a complete audio frame, and executes error concealment processing on the frame which cannot be recombined to generate a replacement frame. According to the method, based on a multi-path parallel transmission, forward error correction (FEC) redundancy mechanism and a cost-aware static scheduling strategy, lossless forwarding and instantaneous recovery of audio streams are realized on the premise of not waiting for network feedback and avoiding inter-frame dependence, and high-quality real-time audio transmission service can still be provided in a complex network environment.

The invention provides a video coding and compression transmission method for intelligent equipment, which belongs to the technical field of video coding and compression transmission, realizes advanced channel quality estimation by establishing a channel prediction model enhanced by a spatial transformation network, configures layered coding parameters according to a prediction result and optimizes motion search in combination with inertial measurement unit data. An optimal coding mode is selected by an application rate distortion optimization algorithm, enhancement layer sending is adjusted according to real-time feedback by adopting a dynamic transmission scheduling strategy, and differential forward error correction protection and a time-space domain error concealment mechanism are matched; the technical problem that video transmission is unstable due to violent fluctuation of channel quality when intelligent equipment moves and works in complex electromagnetic environments such as a transformer substation is solved.

The invention discloses an anti-packet loss processing method and system for audio and video data. The method is applied to an articulated naturality web, the articulated naturality web comprises two groups of devices, and the two groups of devices are respectively a receiving end device and a transmitting end device. According to the anti-packet-loss processing method and system for the audio and video data, provided by the invention, through a series of steps of packet loss detection, recovery, error concealment and the like, the audio and video data can be recovered to the greatest extent under the condition of data packet loss, the problems of jamming, fuzzy pictures, discontinuous sound and the like are reduced, and the quality of the audio and video is remarkably improved; forward error correction, interpolation compensation and various error hiding methods are carried out by using redundant data, and lost data packets are processed from different angles, so that the definition and fluency of audios and videos and the fidelity of the audios are ensured; meanwhile, through secondary packet loss detection, the situation that the transmission integrity of the audio and video data packets is affected due to the fact that the packet loss phenomenon is not found in time can be effectively avoided.

An apparatus may include one or more processors and a receiver configured to receive first audio data having one or more gain spikes and retransmission of a first copy of the first audio data. The one or more processors may determine a first set of bit positions each having a sensitivity value higher than a threshold value, the sensitivity value indicating a degree of sensitivity of audio quality to bit errors at each bit position, determine that a second set of bit positions, at each of which the first audio data and the first copy have bit values different from each other, include at least one of the first set of bit positions, and modify the first audio data to eliminate a gain spike corresponding to the at least one of the first set of bit positions.

Image series transformation for optimal compressibility is performed with neural upsampling and error resilience. A novel correlation network composed of convolutional layers for feature extraction that extract multi-dimensional features from the image and a channel-wise transformer with attention to capture complex inter-channel dependencies. An angle optimizer enhances compressibility of an image and an error resilience subsystem improves robustness against transmission errors and data loss. The error resilience subsystem applies forward error correction coding, data partitioning based on importance, and embeds error concealment hints. This hybrid approach addresses both local and global features, mitigates compression artifacts, improves image quality, and enhances data integrity during transmission. The correlation network incorporates error correction and concealment techniques during decoding. The model's outputs enable effective image reconstruction, achieving advanced compression while preserving information for accurate analysis.

A method and a decoder for generating concealment audio frame of an audio signal. The method includes performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further includes estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method includes applying an inverse transform to time domain on an error concealment spectrum, that includes the peaks and the attenuated noise spectrum.

A method and a decoder for generating concealment audio frame of an audio signal. The method includes performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further includes estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method includes applying an inverse transform to time domain on an error concealment spectrum, that includes the peaks and the attenuated noise spectrum.

In various examples, systems and methods are disclosed relating to context-aware error concealment to improve inference accuracy are disclosed. A system can identify a frame of a video stream and determine that the frame comprises corrupted or lost data. The system can generate a corrected frame by applying an error concealment function selected based at least on a location of the corrupted or lost data in the frame and a region of interest in the frame.

Disclosed herein are embodiments of a hearing aid configured to receive a wireless signal including a succession of frames including a first frame including first encoded audio samples, and determine a first codec, perform an error check based on the first frame, and in accordance with a determination that the first frame fails to pass the error check, perform a test.

A method, at a hearing aid, including receiving a wireless signal including a succession of frames including a first frame including first encoded audio samples and determining a first codec, performing an error check based on the first frame, and in accordance with a determination that the first frame fails to pass the error check, performing a test.

The invention relates to context-aware error concealment for improved reasoning accuracy. In various examples, systems and methods related to context-aware error concealment are disclosed to improve reasoning accuracy. The system may identify a frame of the video stream and determine that the frame contains corrupted or lost data. The system may generate a corrected frame by applying an error concealment function selected based on a location of corrupted or lost data in the frame and a region of interest in the frame.

A method for speech-based health analysis, comprising: receiving via a digital transmission channel an input signal related to a recorded speech signal, the input signal comprising at least one feature related to health information; processing the input signal by adapting the input signal for at least partly cancelling at least one effect on a signal path, wherein the signal path comprises path from speech signal output of a person to a device recording the speech signal and / or the digital transmission channel, wherein the at least one effect on the signal path comprises distortions caused to the input signal by at least one of the following: background noise, acoustic environment, recording equipment characteristics, transmission errors and / or error concealments, network handovers, codec, speech enhancement; and providing the processed signal to a health analysis, e.g. to a health analysis system; and an arrangement and a system thereof.

This application discloses a method, apparatus, device, and medium for intra-frame error recovery of AVS3 keyframes, relating to the field of video encoding and decoding technology. The method includes: acquiring target keyframe data sent by the encoding end; performing integrity detection on the target keyframe data; if missing slices exist in the target keyframe, acquiring the luminance sketch in the image header of the target keyframe; performing error hiding on the target keyframe to obtain corresponding intermediate keyframes; upsampling the target sketch block in the luminance sketch to obtain corresponding upsampled sketch blocks; and fusing the upsampled sketch blocks and the target keyframe blocks in the intermediate keyframes to supplement missing data in the target keyframe, thereby achieving intra-frame error recovery. By fusing the luminance sketch with the intermediate keyframes, the problem of significant deviation between the overall brightness of the reconstructed result and the original content is solved.

A method, a computer readable medium, and an apparatus for audio error concealment are provided. The apparatus may receive a plurality of audio frames. The apparatus may receive a first audio frame after the receiving of the plurality of audio frames. The apparatus may detect a second audio frame being lost in transmission. The second audio frame is transmitted after the plurality of audio frames and before the first audio frame. The apparatus may identify an audio segment within the plurality of audio frames that best matches a reference audio pattern of the plurality of audio frames. The identified audio segment may be received before a last audio frame of the plurality of audio frames. The apparatus may reconstruct the second audio frame based on audio data received subsequent to the identified audio segment.

The application provides a method, system, terminal and medium for realizing video error concealment, wherein an original video is compressed by coding and decoding to form a test set and a training set; frame extraction processing is performed on the test set and the training set, a mask block operation is performed, and a network training set is obtained; a network model is constructed, the network model is trained, and a video error concealment model is obtained; the video frame test set is input into the video error concealment model, and a reconstructed frame is output; a generator of the model uses a Video Swin Transformer network to perform video frame multi-layer feature extraction on the input video frame test set, then different levels of features are fused for reconstruction of a video loss or damaged area, and the reconstructed frame is output. The application solves the problem that the loss or damaged area of a VVC standard compressed video cannot be effectively recovered, and overcomes the disadvantage that a traditional convolutional neural network cannot simultaneously consider parallel execution and long-range time dependency modeling capability.

A method of approximating a lost or corrupted multichannel audio frame of a multichannel audio signal in a decoding device is provided. The device may generate a down-mix error concealment frame and transform the frame into a frequency domain to generate a transformed down-mix error concealment frame. The device may decorrelate the transformed frame to generate a decorrelated concealment frame. The device may obtain a residual signal spectrum of a stored residual signal of a previously received multichannel audio signal frame and generate an energy adjusted decorrelated residual signal concealment frame using the residual signal spectrum. The device may obtain a set of multi-channel audio substitution parameters and provide the frames and substitution parameters to an audio synthesis component to generate a synthesized multichannel audio frame. The device performs an inverse frequency domain transformation of the audio frame to generate a substitution frame for the lost or corrupted audio frame.

Several examples disclose systems and methods for context-aware error concealment to improve inference accuracy. A system can identify a frame in a video stream and determine that the frame contains corrupted or lost data. The system can then generate a corrected frame by applying an error concealment function selected based on at least the position of the corrupted or lost data within the frame and a region of interest within the frame.

This application discloses a video frame error hiding method, apparatus, electronic device, and medium, belonging to the field of communication technology. The method includes: determining a damaged video frame in a video coded bitstream; if the damaged video frame is intra-coded, error hiding the damaged macroblock according to its macroblock type, including flat blocks, edge blocks, and texture blocks; if the damaged video frame is inter-coded, error hiding the damaged macroblock according to its macroblock state; the target macroblock includes any one of the following: macroblocks adjacent to the damaged macroblock in the damaged video frame; macroblocks adjacent to the damaged macroblock in the damaged video frame; and macroblocks in a reference frame of the damaged video frame.

A method and a decoder for generating concealment audio frame of an audio signal. The method comprises performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further comprises estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method comprises applying an inverse transform to time domain on an error concealment spectrum, which is comprised of the peaks and the attenuated noise spectrum.

In various examples, systems and methods are disclosed relating to context-aware error concealment to improve inference accuracy are disclosed. A system can identify a frame of a video stream and determine that the frame comprises corrupted or lost data. The system can generate a corrected frame by applying an error concealment function selected based at least on a location of the corrupted or lost data in the frame and a region of interest in the frame.

The application relates to an unsigned error compensation device and method. The device comprises a field programmable logic gate array, the field programmable logic gate array comprising a phase accumulation unit, a dither signal generation unit and an unsigned error shaping module; the phase accumulation unit is used for generating complete phase data according to a clock signal and sending the phase data to the unsigned error shaping module; the unsigned error shaping module is used for splitting the phase data into integer part data and truncated decimal part data, and is also used for performing unsigned error compensation calculation according to a dither signal output by the dither signal generation unit, the decimal part data and historical error data, outputting a compensation signal used for correcting the integer part data, and determining a compensated phase address according to the compensation signal. The device can simplify the hardware structure, effectively suppress output spectrum stray caused by phase truncation and improve the signal non-spur dynamic range.

In various examples, systems and methods are disclosed relating to error concealment by replacing a lost video frame region with a chronological predecessor. Network packets including data corresponding to an encoded bitstream of a frame of a video stream can be received. In response to determining that at least one packet of the video stream has been lost, a region of the video frame corresponding to the lost network packet can be replaced with the same region of a previous frame of the video stream.

The application relates to the technical field of video tampering detection, and discloses a monitoring video tampering detection method and system based on feature data feedback, and a monitoring video tampering detection method based on feature data feedback, which comprises the following steps: step S101, calculating a normalized brightness frame; step S102, generating a block boundary activation field; step S103, generating a multi-scale grid energy score; step S104, calculating a multi-scale spectral kurtosis; step S105, screening a hidden dominant candidate set; and step S106, judging the classification label of non-malicious error concealment and malicious frame deletion. The application firstly performs normalization processing on the brightness component of a video frame, reduces the interference of non-tampering factors such as exposure changes, then captures the structural traces of error concealment through a time derivative field and a block boundary activation field, strengthens feature differences through frequency domain transformation and multi-scale energy analysis, and finally completes classification in combination with a presentation timestamp to construct a decision index.

The application discloses an intra-frame error recovery method and device of an AVS3 key frame, equipment and a medium, relates to the technical field of video coding, and comprises the following steps: acquiring target key frame data sent by an encoding end; performing integrity detection on the target key frame data; if there is a missing slice in the target key frame, acquiring a luminance sketch in the image header of the target key frame; performing error concealment on the target key frame to acquire a corresponding intermediate key frame; performing up-sampling on a target sketch block in the luminance sketch to acquire a corresponding up-sampled sketch block; and fusing the up-sampled sketch block and a target key frame block in the intermediate key frame to supplement missing data of the target key frame, so that intra-frame error recovery is realized. By fusing the luminance sketch and the intermediate key frame, the problem that the overall luminance of the reconstruction result is greatly deviated from the original content is solved.

A decoder for decoding a frame to reconstruct a signal portion of a signal is provided. The signal portion is encoded within the frame, wherein the frame includes a bitstream payload and two or more redundancy bits, wherein the bitstream payload includes a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload. The decoder includes a channel decoding module, being configured to detect, depending on the two or more redundancy bits, whether the bitstream payload includes one or more corrupted bits being one or more of the payload bits that are distorted or that are likely to be distorted. Moreover, the decoder includes a source decoding module.

A network communicates an extended reality (XR) traffic with a user equipment (UE) with frame error concealment to limit a duration of temporal error propagation. The network also transmits a report of failure or a request for retransmission to the UE in an event of a network transmission failure.

The application discloses a kind of real-time fire smoke monitoring early warning method, equipment and medium based on monitoring video, it is related to video content analysis technical field, comprising: obtaining monitoring code stream and decoding to obtain video frame, video frame is parsed, obtains link feature parameter set;Link feature parameter set is fused to generate pseudo-texture risk map by coding block grid, generates error concealment event indication;Video frame and pseudo-texture risk map are composed into multi-channel input, are sent into target detection neural network including detection branch and artifact branch, and apply antagonistic constraint to detection branch, output smoke flame candidate frame and confidence;According to error concealment event indication and smoke flame candidate frame in pseudo-texture risk, confidence is corrected and false diffusion trigger data is screened out, and after cross-frame association, the candidate that meets persistence condition generates early warning event.The application is inputted into double-branch detection network by video frame and pseudo-texture risk map multi-channel, inhibits false diffusion trigger and stabilizes output early warning event.