87 results about "Temporal filter" patented technology

The invention relates to the technical field of camera motion compensation, and discloses an IMU-based camera motion compensation method and device and a storage medium, and the method comprises the steps: processing original data collected by a plurality of IMU sensors, and obtaining six-degree-of-freedom IMU fusion data; processing through a linear convolution aliasing model to obtain a high-dimensional motion feature vector; performing fusion to obtain a camera motion parameter prediction value; constructing an advanced network compensation model, carrying out jitter intensity evaluation, and dynamically adjusting a compensation model parameter matrix; performing geometric transformation to obtain an initial stable image sequence and a foreground mask; according to the method, IMU data and image information can be effectively fused, camera motion parameters can be accurately estimated, and a compensation strategy can be dynamically adjusted according to scene features to realize camera motion compensation.

In various examples, updates to a dynamic seam placement and / or fitted 3D bowl may be at least partially concealed using temporal masking. A future time in which a predicted change in dynamic seam placement and / or fitted 3D bowl exceeds some threshold may be determined. A predicted dynamic seam placement and / or fitted 3D bowl update may be temporally masked by triggering the update before arriving at the future time to compensate for the latency of the temporal filtering and / or by adjusting the temporal filter size (e.g., shortening a temporal window over which temporal filtering is applied) in anticipation of the predicted dynamic seam placement and / or fitted 3D bowl update, effectively maintaining some of the smoothing effects of temporal filtering, while reducing the latency.

In various examples, the present disclosure relates to using temporal filters for automated real-time classification. The technology described herein improves the performance of a multiclass classifier that may be used to classify a temporal sequence of input signals—such as input signals representative of video frames. A performance improvement may be achieved, at least in part, by applying a temporal filter to an output of the multiclass classifier. For example, the temporal filter may leverage classifications associated with preceding input signals to improve the final classification given to a subsequent signal. In some embodiments, the temporal filter may also use data from a confusion matrix to correct for the probable occurrence of certain types of classification errors. The temporal filter may be a linear filter, a nonlinear filter, an adaptive filter, and / or a statistical filter.

The invention provides an infrared image flicker processing method, system and device and a medium. The method comprises the steps of generating a blocking piece mean value based on blocking piece image data of continuous N frames obtained during single-point correction; processing the histograms of the two-time single-point correction gap images according to the separation blade mean value to generate a statistical histogram of the images; performing first filtering processing on the statistical histogram to generate a first filtering result of the histogram; after the first filtering result is calculated in an accumulated mode, a gray mapping table is calculated, second filtering processing is carried out, and a second filtering result of the gray mapping table is generated; and performing time domain filtering processing on the second filtering result to realize flicker processing of the infrared image. According to the infrared image flicker processing method, the flicker phenomenon of the infrared image can be effectively reduced, and the stability and the visual effect of the image are improved.

Systems and methods herein are for a video encoder to be associated with a temporal filter and a coding tree and that can perform a main pass for video encoding using individual video blocks towards prediction of at least one frame associated with the media stream, where the coding tree is associated with a lookahead pass, and where the temporal filter can enable denoising within the lookahead pass to reduce an effect of noise in one or more of motion estimation or mode selection of the video encoding.

A method for a multi-antenna receiver arrangement, the multi-antenna receiver arrangement being comprisable in a wireless device, WD, the method comprising: receiving a first plurality of analog radio signals; converting the first plurality of analog radio signals into a first plurality of digital signals; extracting reference signals from each of the first plurality of digital signals; determining characteristics for each of the first plurality of digital signals based on the extracted reference signals; processing the first plurality of digital signals with a second plurality of spatial-temporal filters to obtain a second plurality of combined signals, wherein the first plurality is larger than the second plurality. Corresponding computer program product, multi-antenna receiver arrangement, and wireless device are also disclosed.

In various embodiments, when reference picture resampling is applied to achieve better coding efficiency, methods and devices adapt temporal filtering of a noise-reduced input video prior to encoding according to a resolution ratio. According to one embodiment, temporal filtering strength values are fine-tuned at a pre-processing module according to the resolution ratio of the RPR mode. According to another embodiment, temporal filtering is deferred after rescaling when the RPR mode is enabled, and filtering strength values are fine-tuned according to the resolution ratio of the RPR mode. A third embodiment proposes to refine motion estimation in the encoder by setting the block size of motion estimation in temporal filtering according to the resolution ratio of the RPR mode.

A decoder includes circuitry configured to receive a bitstream, decode a plurality of video frames from the bitstream, determine that a long-term reference block update mode is enabled for a current block of a current frame, determine a long-term reference block update including pixel values and using the plurality of video frames, and update a portion of a long-term reference frame using the long-term reference block update. Related apparatus, systems, techniques, and articles are also described.

A height information reconstruction method suitable for a vehicle, includes: sensing multiple entities through a three-dimensional radar to generate a three-dimensional radar point cloud corresponding to the vehicle; sensing entities through an inertial measurement unit to generate inertial measurement data corresponding to the vehicle data; and executing through the processor: receiving the three-dimensional radar point cloud and the inertial measurement data, and calculating the radar displacement and radar velocity of the three-dimensional radar; calculating the radial velocity of each entity based on the radar speed; performing dynamic segmentation to extract a static entity in the entities based on the radar velocity and radial velocity; calculating the elevation angle of the static entity; performing temporal filtering to calculate the height value of the static entity based on the elevation angle and the radar displacement; and generating a height reconstruction radar point cloud based on the height value of the static entity.

Light time-of-flight camera for distance measurement with a time-of-flight sensor with at least one time-of-flight pixel, with a lighting system for emitting modulated light, the time-of-flight camera is designed for distance measurements according to a phase measurement principle and is designed in this way, that, a) for at least a part of the light-time-of-flight pixels, for determining a distance (d w ) of an object at least two measurements (A1, A2, ...) are carried out with different modulation frequencies (f1, f2, ...) and thus different uniqueness ranges (UR1, UR2, ...), whereby in each measurement (A i ) a residual distance (d i = mod(d, UR i )) is measured, b) starting from these residual distances (d i ) for each light travel time pixel, initially a sub-area index M of a total distance curve (UR) extd) is assigned, c) a field of the initially assigned sub-area indices M is processed using a "nearest neighbor filter" and / or a temporal filter, to generate a corrected, final sub-area index (M_final) for the respective light-time-of-flight pixel, and only then, d) the distance (d w ) by projecting the remaining distances (d i ) is determined on that sub-area of ​​the total distance curve which is defined by the corrected, final sub-area index (M_final).

A system and method for identifying container numbers on front-mounted cranes are disclosed, relating to the field of container number identification on front-mounted cranes. To address the shortcomings of existing methods, such as inability to adapt to rainy or snowy weather and low-light conditions, poor container number identification performance, and poor anti-interference capabilities, this invention acquires video or images of containers on front-mounted cranes; extracts continuous frames from the video at a fixed frequency and performs grayscale processing on each frame to reduce computational complexity; applies temporal filtering to the preprocessed video / image; applies spatial filtering to the filtered video / image to remove isolated noise points; reduces high-frequency noise and smooths the image through weighted averaging; enhances image contrast by adjusting the grayscale distribution of the image, making the container number area clearer; and performs container number area detection and character recognition on the processed image to achieve automatic container number identification. This invention is mainly used for identifying container numbers on front-mounted cranes.

The invention discloses a display device and a backlight control method thereof, the display device comprises a processor, a backlight module and a display module, the processor determines a first backlight value corresponding to a first backlight partition based on initial pixel values of a plurality of target pixel points; performing spatial filtering processing on the first backlight value to obtain a second backlight value; performing time filtering processing on the second backlight value based on the third backlight value and the filtering coefficient to obtain a target backlight value; the backlight module lights up a backlight source in the first backlight partition according to the target backlight value, and backlight is provided; the display module displays an image frame to be displayed. Through spatial filtering processing, the purpose of adjusting the luminance of the connecting position of every two adjacent backlight subareas is achieved, and the cross color phenomenon of a spatial domain is eliminated. The time filtering processing with different processing intensities is carried out, so that the lightening rates of the backlight sources in the backlight partitions are kept consistent, the cross color phenomenon of the time domain is eliminated, and the display effect of the display equipment is improved.

The present application discloses a method, device, storage medium and electronic device for identifying high-speed abnormal moving targets, which relates to the field of information technology. The method includes: acquiring the original event stream data collected by a dynamic vision sensor within a continuous time period; performing noise reduction processing on the original event stream data based on a preset spatio-temporal filtering kernel to obtain the event stream data after noise reduction processing; mapping each denoised event in the event stream data after noise reduction processing to the corresponding image channel according to the polarity of each denoised event to obtain the polarity channel image frame data; respectively inputting the polarity channel image frame data into a preset target detection model and a preset target segmentation model for processing to obtain a target detection result and a target segmentation result; and determining an abnormal moving target identification result according to the target detection result and the target segmentation result. The present application can solve the problems of high power consumption, large data volume and complex structure of the detection system.

The present application discloses a video compression method, apparatus, device and storage medium, relating to the technical field of video processing, including: determining a target video sequence to be compressed, and sequentially obtaining a plurality of pixel blocks in each frame image of the target video sequence; respectively calculating the sum of squared errors, vertical sum of squared errors and horizontal sum of squared errors of the plurality of pixel blocks in each frame image; calculating the error distribution of the corresponding pixel blocks based on the size, sum of squared errors, vertical sum of squared errors and horizontal sum of squared errors of each pixel block to obtain an error distribution value, and determining whether the error distribution value is less than a preset threshold; if it is less than the preset threshold, performing a temporal filtering operation on the corresponding pixel block to obtain filtered data, and performing encoding and compression on the filtered data to obtain a compression result; if it is not less than the preset threshold, directly performing encoding and compression on the corresponding pixel block to obtain a compression result. The present application can improve the compression performance of the encoder and at the same time improve the efficiency of video compression.

The present invention relates to a data filtering method based on space-time grid, terminal equipment and storage medium, the method comprising: S1: filtering data with a rule-based filter to remove abnormal data that does not conform to the rules; S2: performing space-time grid processing on the filtered data to encode the space-time grid and then storing it in a hash table structure; S3: filtering the data in the hash table that does not meet the space-time constraint conditions through the space-time filter. In addition to filtering common abnormal data, the present invention also refines the data by performing space-time grid processing on the data, reduces the storage of a large number of redundant basic collection logs, reduces the storage cost, and retains data with representative value, laying a good foundation for subsequent space-time association mining.

Techniques for generating a high resolution full color output image from lower resolution sparse color input images are disclosed. A camera generates images. The camera's sensor has a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and IMU data are fed into a motion model, which performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, a blue-only image, and a monochrome image. The color images are up-sampled to match the resolution of the monochrome image. A high resolution output color image is generated by combining the up-sampled images and the monochrome image.

An apparatus configured for sensor processing is configured to receive a current frame of raw data from an indirect ToF sensor, wherein the raw data comprises an in-phase component and a quadrature component for each pixel of the current frame. The apparatus may jointly apply a first spatial noise reduction filter to the in-phase components and the quadrature components of the current frame, jointly apply, after the first spatial noise reduction filter, a temporal filter to the in-phase components and the quadrature components of the current frame, and jointly apply, after the temporal filter, a second spatial noise reduction filter to the in-phase components and the quadrature components of the current frame to produce a filtered current frame. The apparatus may then output the filtered current frame and use the filtered current frame to determine depth value for other applications.

The invention relates to adaptive quantization based on a coding tree. Systems and methods herein are used to associate a video encoder with a temporal filter and a coding tree, and may perform a main channel of video coding using respective video blocks to predict at least one frame associated with a media stream, where the coding tree is associated with a look-ahead channel, and the temporal filter may denoise within the look-ahead channel, and where the coding tree is associated with the look-ahead channel. To reduce noise effects in one or more of motion estimation or mode selection for video coding.

The invention discloses a bare soil intelligent identification method and system of a high-resolution remote sensing image, and relates to the technical field of ecological environment remote sensing monitoring, high-resolution remote sensing image data of a to-be-identified area is acquired and preprocessed, and preprocessed high-resolution remote sensing image data is obtained; performing filtering optimization on the preprocessed high-resolution remote sensing image data by adopting a dynamic adaptive multi-temporal filtering optimization method to obtain an optimized high-resolution remote sensing image data image; cutting the optimized high-resolution remote sensing image data, extracting contour position coordinates of a mask image, and constructing a training set; and inputting the training set into a bare soil recognition model for training to obtain a trained bare soil recognition model, and recognizing the bare soil plaques of the to-be-recognized region based on the trained bare soil recognition model. The multi-scale bare soil plaques under a complex background are accurately and automatically identified under a relatively low computing resource demand, and the distinction degree between the bare soil and other ground features is enhanced.

This paper presents a method for fusing and reconstructing trajectory data from multiple sources in hybrid traffic flow, relating to the fields of multi-source sensor fusion localization and target tracking. The method acquires the 3D acceleration sequence and RGB video stream of the target object, extracting the geometric center coordinate sequence. Based on the frequency domain energy distribution of acceleration, the target's fundamental frequency parameters are obtained. Temporal filtering coefficients are constructed using the dynamic sampling rate of the video, and the geometric center coordinates are filtered to obtain a corrected center coordinate sequence, which is then mapped to a measurement vector. Kinematic state prediction is performed using acceleration to obtain prior inferred state variables, and then posterior updates are performed using the measurement vectors to obtain the optimal spatial position. The reconstructed trajectory sequence is generated by stitching the data together, and the sliding time window is updated based on feedback-optimized parameters. This method effectively eliminates spurious displacements caused by gait, fundamentally eliminating jagged oscillations in the trajectory, resulting in a smooth and stable fused trajectory.

A neural network-based medical image processing apparatus according to the present invention, which identifies a small intestine region from a medical image acquired by a capsule endoscope, comprises: a memory equipped with an organ identification algorithm for performing organ identification from the medical image; and a processor for applying the medical image to the organ identification algorithm such that the small intestine region is identified. The organ identification algorithm includes: a convolutional neural network algorithm for identifying an organ included in the medical image as the stomach, the small intestine, and the large intestine to identify the small intestine region therefrom; and a temporal filtering algorithm linked to the convolutional neural network algorithm to reduce images which may be misidentified by the convolutional neural network algorithm.

Embodiments described relate to adjusting one or more pixel values in a region corresponding to an image artifact based on one or more spatial characteristics and one or more temporal characteristics to reduce or eliminate the image artifact. An electronic device may employ spatio-temporal filtering circuitry that includes spatial adjustment circuitry, temporal adjustment circuitry, and / or fuse circuitry. The spatial adjustment circuitry may perform a spatial adjustment of image data in the region of the image frame. Moreover, the temporal adjustment circuitry may perform a temporal adjustment of the image data in the region of the image frame. The fuse circuitry may then merge the spatially adjusted image data and the temporally adjusted image data in the region of the image frame.

A radar sensor system comprises a receive antenna that receives a radar return and circuitry configured to perform certain acts. The acts comprise receiving analog-to-digital converted (ADC) samples of a received radar signal and identifying power magnitudes for the ADC samples. The acts also comprise calculating a mean power value for ADC samples in a given ramp of the received radar signal and calculating a mean power variance of the ADC samples in the given ramp. The acts further comprise identifying a sample having a power magnitude above a power threshold. Additionally, the acts comprise adjusting the power magnitude of the identified sample to mitigate the interference effect caused by the identified sample.

The application discloses a training method and a decoding method of a single-time spatial-temporal filter based on double-frequency intermodulation, and the training method comprises the following steps: displaying a plurality of training targets in a row-column distribution on a visual stimulation interface, wherein each training target is jointly coded by a first stimulation signal and a second stimulation signal; collecting single-time training data of a subject; pre-processing the single-time training data to obtain ; performing time-domain displacement processing on the pre-processed mean template of the training target to obtain a time-shifted template; integrating the pre-processed mean template and the time-shifted template of the plurality of training targets to obtain a training target matrix; obtaining a standard reference signal of the training target, wherein the standard reference signal comprises a double-frequency intermodulation component; obtaining a training target reference signal matrix according to the standard reference signal; and obtaining a first spatial-temporal filter according to the training target reference signal matrix. The application achieves the technical effect that a spatial-temporal filter with good performance is obtained by using single-time training data, and provides a new method for efficient encoding and decoding of a large-instruction-set visual evoked brain-computer interface.

A decoder includes circuitry configured to receive a bitstream, decode a plurality of video frames from the bitstream, determine that a long-term reference block update mode is enabled for a current block of a current frame, determine that a long-term reference block update including pixel values and using the plurality of video frames, and determine that a long-term reference block update using the plurality of video frames is enabled for a current block of the current frame. And updating a portion of a long-term reference frame with the long-term reference block update. Related apparatus, systems, techniques, and articles are also described.

A neural network-based medical image processing apparatus according to the present invention, which identifies a small intestine region from a medical image acquired by a capsule endoscope, comprises:

The present invention proposes a sparse image view synthesis method based on time-domain filtered neural radiation fields. This method innovatively introduces a time-domain filtered neural radiation field model to solve the problem that the neural radiation field represented by the multi-layer perceptron has high rendering overhead and cannot reduce the aliasing noise of the synthesized image by oversampling. By applying filtering technology in the time domain, the computational burden required for oversampling is effectively shared over consecutive frames, thereby significantly improving the quality of the synthesized image and effectively reducing noise and aliasing without increasing the number of additional network inferences. In addition, in order to improve the geometric extraction capability of the neural radiation field, the method introduces a deep prior network and designs an inter-frame geometric consistency loss to enhance the expression capability of the neural radiation field in multiple views and improve the generalization performance of the network.

The invention provides an image encoding method and an image encoding device. The image coding method comprises the steps that first quantization parameter information of a code rate control unit block in an image to be filtered is acquired, and the code rate control unit block represents a processing unit used for code rate distribution and image quality control; adjusting a filtering weight of a filtering block to be subjected to motion compensation time domain filtering in the bit rate control unit block based on the first quantization parameter information; performing motion compensation time domain filtering on the filtering block based on the adjusted filtering weight; and performing encoding based on the filtering result.

Provided is a method for encoding a video, an electronic device and a storage medium, relating to the field of video encoding. The method includes: obtaining a reference frame that is adjacent to a current frame and has established hierarchical division of an initial ROI; reusing a motion vector generated by the reference frame in a motion compensated temporal filter process to determine an ROI position prediction value of the current frame; extracting facial feature points from the current frame, and correcting the ROI position prediction value based on a spatial topological relationship of feature points in the initial ROI; configuring differentiated quantization parameters for a main face region, a secondary face region and a background region after correction respectively; dynamically allocating a three-region bitrate according to a real-time network bandwidth; and outputting an encoded frame of the current frame and associated ROI-level metadata.