15 results about "Error concealment" patented technology

The invention provides a video coding and compression transmission method for intelligent equipment, which belongs to the technical field of video coding and compression transmission, realizes advanced channel quality estimation by establishing a channel prediction model enhanced by a spatial transformation network, configures layered coding parameters according to a prediction result and optimizes motion search in combination with inertial measurement unit data. An optimal coding mode is selected by an application rate distortion optimization algorithm, enhancement layer sending is adjusted according to real-time feedback by adopting a dynamic transmission scheduling strategy, and differential forward error correction protection and a time-space domain error concealment mechanism are matched; the technical problem that video transmission is unstable due to violent fluctuation of channel quality when intelligent equipment moves and works in complex electromagnetic environments such as a transformer substation is solved.

The invention discloses an anti-packet loss processing method and system for audio and video data. The method is applied to an articulated naturality web, the articulated naturality web comprises two groups of devices, and the two groups of devices are respectively a receiving end device and a transmitting end device. According to the anti-packet-loss processing method and system for the audio and video data, provided by the invention, through a series of steps of packet loss detection, recovery, error concealment and the like, the audio and video data can be recovered to the greatest extent under the condition of data packet loss, the problems of jamming, fuzzy pictures, discontinuous sound and the like are reduced, and the quality of the audio and video is remarkably improved; forward error correction, interpolation compensation and various error hiding methods are carried out by using redundant data, and lost data packets are processed from different angles, so that the definition and fluency of audios and videos and the fidelity of the audios are ensured; meanwhile, through secondary packet loss detection, the situation that the transmission integrity of the audio and video data packets is affected due to the fact that the packet loss phenomenon is not found in time can be effectively avoided.

An apparatus may include one or more processors and a receiver configured to receive first audio data having one or more gain spikes and retransmission of a first copy of the first audio data. The one or more processors may determine a first set of bit positions each having a sensitivity value higher than a threshold value, the sensitivity value indicating a degree of sensitivity of audio quality to bit errors at each bit position, determine that a second set of bit positions, at each of which the first audio data and the first copy have bit values different from each other, include at least one of the first set of bit positions, and modify the first audio data to eliminate a gain spike corresponding to the at least one of the first set of bit positions.

A method and a decoder for generating concealment audio frame of an audio signal. The method includes performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further includes estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method includes applying an inverse transform to time domain on an error concealment spectrum, that includes the peaks and the attenuated noise spectrum.

A method and a decoder for generating concealment audio frame of an audio signal. The method includes performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further includes estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method includes applying an inverse transform to time domain on an error concealment spectrum, that includes the peaks and the attenuated noise spectrum.

In various examples, systems and methods are disclosed relating to context-aware error concealment to improve inference accuracy are disclosed. A system can identify a frame of a video stream and determine that the frame comprises corrupted or lost data. The system can generate a corrected frame by applying an error concealment function selected based at least on a location of the corrupted or lost data in the frame and a region of interest in the frame.

The invention relates to context-aware error concealment for improved reasoning accuracy. In various examples, systems and methods related to context-aware error concealment are disclosed to improve reasoning accuracy. The system may identify a frame of the video stream and determine that the frame contains corrupted or lost data. The system may generate a corrected frame by applying an error concealment function selected based on a location of corrupted or lost data in the frame and a region of interest in the frame.

This application discloses a method, apparatus, device, and medium for intra-frame error recovery of AVS3 keyframes, relating to the field of video encoding and decoding technology. The method includes: acquiring target keyframe data sent by the encoding end; performing integrity detection on the target keyframe data; if missing slices exist in the target keyframe, acquiring the luminance sketch in the image header of the target keyframe; performing error hiding on the target keyframe to obtain corresponding intermediate keyframes; upsampling the target sketch block in the luminance sketch to obtain corresponding upsampled sketch blocks; and fusing the upsampled sketch blocks and the target keyframe blocks in the intermediate keyframes to supplement missing data in the target keyframe, thereby achieving intra-frame error recovery. By fusing the luminance sketch with the intermediate keyframes, the problem of significant deviation between the overall brightness of the reconstructed result and the original content is solved.

The application provides a method, system, terminal and medium for realizing video error concealment, wherein an original video is compressed by coding and decoding to form a test set and a training set; frame extraction processing is performed on the test set and the training set, a mask block operation is performed, and a network training set is obtained; a network model is constructed, the network model is trained, and a video error concealment model is obtained; the video frame test set is input into the video error concealment model, and a reconstructed frame is output; a generator of the model uses a Video Swin Transformer network to perform video frame multi-layer feature extraction on the input video frame test set, then different levels of features are fused for reconstruction of a video loss or damaged area, and the reconstructed frame is output. The application solves the problem that the loss or damaged area of a VVC standard compressed video cannot be effectively recovered, and overcomes the disadvantage that a traditional convolutional neural network cannot simultaneously consider parallel execution and long-range time dependency modeling capability.

Several examples disclose systems and methods for context-aware error concealment to improve inference accuracy. A system can identify a frame in a video stream and determine that the frame contains corrupted or lost data. The system can then generate a corrected frame by applying an error concealment function selected based on at least the position of the corrupted or lost data within the frame and a region of interest within the frame.

A method and a decoder for generating concealment audio frame of an audio signal. The method comprises performing a frequency domain analysis of a sequence of previously decoded audio signal to obtain a frequency spectrum and identifying peaks in the spectrum. The method further comprises estimating a relative energy between the noise spectrum and the complete spectrum, determining an attenuation of the noise spectrum based on the relative energy, and applying the attenuation to the noise spectrum. The method comprises applying an inverse transform to time domain on an error concealment spectrum, which is comprised of the peaks and the attenuated noise spectrum.

In various examples, systems and methods are disclosed relating to context-aware error concealment to improve inference accuracy are disclosed. A system can identify a frame of a video stream and determine that the frame comprises corrupted or lost data. The system can generate a corrected frame by applying an error concealment function selected based at least on a location of the corrupted or lost data in the frame and a region of interest in the frame.

The application relates to the technical field of video tampering detection, and discloses a monitoring video tampering detection method and system based on feature data feedback, and a monitoring video tampering detection method based on feature data feedback, which comprises the following steps: step S101, calculating a normalized brightness frame; step S102, generating a block boundary activation field; step S103, generating a multi-scale grid energy score; step S104, calculating a multi-scale spectral kurtosis; step S105, screening a hidden dominant candidate set; and step S106, judging the classification label of non-malicious error concealment and malicious frame deletion. The application firstly performs normalization processing on the brightness component of a video frame, reduces the interference of non-tampering factors such as exposure changes, then captures the structural traces of error concealment through a time derivative field and a block boundary activation field, strengthens feature differences through frequency domain transformation and multi-scale energy analysis, and finally completes classification in combination with a presentation timestamp to construct a decision index.

The application discloses an intra-frame error recovery method and device of an AVS3 key frame, equipment and a medium, relates to the technical field of video coding, and comprises the following steps: acquiring target key frame data sent by an encoding end; performing integrity detection on the target key frame data; if there is a missing slice in the target key frame, acquiring a luminance sketch in the image header of the target key frame; performing error concealment on the target key frame to acquire a corresponding intermediate key frame; performing up-sampling on a target sketch block in the luminance sketch to acquire a corresponding up-sampled sketch block; and fusing the up-sampled sketch block and a target key frame block in the intermediate key frame to supplement missing data of the target key frame, so that intra-frame error recovery is realized. By fusing the luminance sketch and the intermediate key frame, the problem that the overall luminance of the reconstruction result is greatly deviated from the original content is solved.

The application discloses a kind of real-time fire smoke monitoring early warning method, equipment and medium based on monitoring video, it is related to video content analysis technical field, comprising: obtaining monitoring code stream and decoding to obtain video frame, video frame is parsed, obtains link feature parameter set;Link feature parameter set is fused to generate pseudo-texture risk map by coding block grid, generates error concealment event indication;Video frame and pseudo-texture risk map are composed into multi-channel input, are sent into target detection neural network including detection branch and artifact branch, and apply antagonistic constraint to detection branch, output smoke flame candidate frame and confidence;According to error concealment event indication and smoke flame candidate frame in pseudo-texture risk, confidence is corrected and false diffusion trigger data is screened out, and after cross-frame association, the candidate that meets persistence condition generates early warning event.The application is inputted into double-branch detection network by video frame and pseudo-texture risk map multi-channel, inhibits false diffusion trigger and stabilizes output early warning event.