269results about "Conversion involving interpolation processes" patented technology

The invention discloses a real-time video processing system based on an ampere-path FPGA. The real-time video processing system comprises an SD card, an ampere-path FPGA board card and an HDMI displayer. The SD card is used for storing original video data in a Bayer format; the A-path FPGA board card comprises an FPGA end and an ARM end, the FPGA end comprises an SD card reading control module, an image cache FIFO module, a Bayer-to-RGB module, a seven-in-one image processing module, an SDRAM read-write control module and an HDMI display control module, the first four modules are connected in sequence, and the SDRAM read-write control module is connected with the Bayer-to-RGB module, the seven-in-one image processing module and the HDMI display control module; wherein the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all peripheral interfaces, and all the modules are connected in sequence; the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all the peripheral interfaces; the ampere-path FPGA board card is used for completing all video processing functions; and the HDMI display outputs the processed video. The method is good in video processing effect, low in resource consumption, high in flexibility, high in stability and low in hardware cost, and the hardware is 100% localized.

A method and processor for real-time frame processing of a sequence of frames, focusing on motion vector determination, decision metric calculation, and selective triggering of modes for frame processing. It involves calculating motion vectors and their metrics based on pixel displacement and gradient magnitude between consecutive frames to decide on the most appropriate processing mode-copying, generating via neural networks, or rendering using GPUs. The method adapts over time by adjusting thresholds for motion vector metrics, employing decay functions to refine the decision-making process for subsequent frames. This adaptive approach aims to optimize frame generation and rendering quality in dynamic sequences, providing a sophisticated method for managing and enhancing visual media in real-time applications. The processor is configured to execute these steps, adjusting its operations as it processes more frames, ensuring efficient and high-quality visual outputs.

The invention discloses an optical flow positioning method of an unmanned aerial vehicle and the unmanned aerial vehicle, and relates to the technical field of unmanned aerial vehicle positioning, and the method comprises the steps: collecting a continuous image sequence in the flight process of the unmanned aerial vehicle in real time, and constructing a Gaussian pyramid for the collected images; and then illumination compensation is carried out between adjacent frames, speed information of the unmanned aerial vehicle is calculated, feedback compensation is carried out on the speed information of the unmanned aerial vehicle, and accurate positioning of the unmanned aerial vehicle is realized. By inserting the progressive frame between the adjacent frames with the overlarge gray difference value, gradual brightness transition can be realized between the adjacent frames with the overlarge gray difference value, the appearance change of a target can be smoothed, a tracker is helped to adapt to illumination change, visual and algorithm difficulties caused by sudden brightness change are reduced, and the tracking accuracy is improved. And meanwhile, the progressive frame is inserted between the adjacent frames with overlarge gray difference values to provide more references for feature point matching, so that the wrong matching rate of the feature points is reduced, and the accuracy and robustness of unmanned aerial vehicle positioning are improved.

The invention relates to the technical field of optical communication, in particular to an automobile headlamp communication system and method based on image frame interpolation, comprising a transmitting end and a receiving end, a vehicle-mounted central control system of the transmitting end is used for receiving input to-be-transmitted information, and an ambient light detection module evaluates an external illumination condition in response to the input of the to-be-transmitted information; an image gray value and frame insertion frequency are set based on the illumination intensity, the image coding module codes information to be transmitted based on the set image gray value to generate a projection image frame, and the projection module inserts the projection image frame into a normal illumination frame sequence of a vehicle lamp based on the frame insertion frequency and projects the projection image frame to an external environment; the image acquisition module of the receiving end is used for acquiring a projection image frame, the image decoding module preprocesses the projection image frame and then decodes the projection image frame, and the information to be transmitted is restored and sent to the vehicle-mounted central control system. According to the invention, vehicle lamp communication at a certain distance in a traffic environment can be realized on the premise of ensuring normal vehicle lamp illumination.

The invention discloses a remote state monitoring system for a portable video conference device, relates to the technical field of equipment monitoring, and solves the problems that the use monitoring data of conference equipment is acquired by using a set frequency in the prior art, and when the set frequency is relatively high, the abnormal condition of the conference equipment cannot be identified in time, so that the use safety of the conference equipment is influenced. And normal proceeding of the conference is influenced. The method comprises the following steps: acquiring real-time data of conference equipment through a data sensor, and preprocessing the real-time data to obtain operation data; analyzing the acquisition frequency of the real-time data according to the operation data; calling operation data in a set time period based on the acquisition frequency, and analyzing the operation state of the conference equipment according to the operation data in the set time period; adjusting parameters of the conference equipment according to the running state; testing the adjusted conference equipment to obtain a test result; the adjustment of the parameters is optimized according to a test result; abnormity of the conference equipment can be found in time, and normal operation of the conference equipment can be ensured.

An example device for upconverting video data includes a memory configured to store video data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: determine an amount of motion between a region of a first frame of the video data and a corresponding region of a second frame of the video data; determine a number of frames to interpolate between the first frame and the second frame according to the amount of motion; and interpolate the determined number of frames to upconvert the video data.

The invention relates to the technical field of image stabilization, in particular to a GMSL camera system design method supporting anti-shake, which comprises the following steps: acquiring a YUV image through image acquisition, extracting an edge through a Canny algorithm and generating trajectory data, tracking pixel displacement to calculate an angle and an amplitude, marking as a stable area if a threshold condition is met, generating a stable area coordinate, and calculating the image according to the stable area coordinate. The IMU collects acceleration and angular velocity data, synchronizes the acceleration and angular velocity data with an image frame, calculates acceleration change, detects an edge direction angle, calculates a vector included angle to generate cutting offset, adjusts the position of a cutting frame, performs bilinear interpolation reduction, and outputs a stable image frame. According to the invention, the jitter compensation precision is improved, the delay and loss are reduced, and the image stability in the vibration environment is enhanced by extracting the image edge track, tracking the pixel displacement path, matching the IMU with the image timestamp, calculating the acceleration and the edge direction offset, dynamically adjusting the position of the cutting frame and performing interpolation reduction.

The invention relates to an image processing method and device for virtual shooting. The method comprises the following steps: receiving a latest image generated by rendering a current virtual scene from a rendering module and associated information of the latest image; generating a target number of frame insertion images according to the latest image, the associated information of the latest image and the previous image; performing projection transformation on the newest image and each frame insertion image based on the corresponding camera data to obtain a transformed newest image and each transformed frame insertion image so as to correspond to a camera; and in response to the refresh rate of the screen, sequentially sending the transformed frame insertion images and the transformed latest image to the screen, so that the screen sequentially displays the transformed frame insertion images and the transformed latest image after the previous image is displayed. The real-time frame insertion is realized while the high resolution of the virtual scene picture is ensured, the screen display picture is free of pause and smoother, the frame rate of the screen image is improved, the virtual shooting effect is improved, and the shooting requirement is met.

A system for increasing a frame rate of a dynamic image includes an input for receiving a set of consecutive image frames of a first dynamic image having a first plurality of image frames and a first frame rate. The system further includes a deformation encoding neural network coupled to the input and configured to derive at least one parameter characterizing dynamics of the set of consecutive image frames and to generate an interpolated image frame based on the at least one parameter, and a post-processing module coupled to the deformation encoding neural network and configured to receive one or more interpolated image frames from the deformation encoding neural network, to create a second plurality of image frames comprising the one or more interpolated image frames and the first plurality of image frames, and to generate a second dynamic image using the second plurality of image frames, the second dynamic image having a second frame rate higher than the first frame rate.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

Systems and techniques are described herein for interpolating image data. For instance, a method for interpolating image data is provided. The method may include processing a first image frame and a second image frame using a motion estimator to generate first motion vectors, wherein the motion estimator comprises a machine-learning model trained to generate motion vectors based on image frames; projecting the first motion vectors to generate second motion vectors; and generating a third image frame based on the first image frame, the second image frame, and the second motion vectors.

The invention discloses a video signal de-interlacing method and device and electronic equipment, and the method comprises the steps: S100, obtaining a directional correlation interpolation result P directional interpolation of a to-be-interpolated pixel point in a current field, and obtaining a median filtering result P median filtering of the to-be-interpolated pixel point in the current field; and S200, acquiring a motion coefficient M of a to-be-interpolated pixel point in the current field, and selecting an interpolation mode and an interpolation result of the to-be-interpolated pixel point in the current field according to an interval in which the motion coefficient M is located. According to the method, interpolation results of direction correlation interpolation and median filtering are calculated respectively, then motion detection is carried out, a motion area of a pixel point to be interpolated is divided, and then a proper interpolation algorithm is selected according to the divided area, namely, an optimal mode to be interpolated is selected through motion detection. Therefore, the final interpolation suitable for various motion scenes is obtained, and the interpolation mode and the interpolation effect during de-interlacing are greatly optimized.

The present disclosure relates to a method and apparatus for generating a video, an electronic device, and a computer program product. The method includes obtaining a visual token for generating an image frame in the video. The method further includes obtaining a control token for constraining position information of an object in the image frame. In addition, the method also includes generating the image frame in the video based on the visual token and the control token, where the object in the image frame satisfies the position information.

The present disclosure relates to a method and apparatus for generating a video, an electronic device, and a computer program product. The method includes obtaining a visual token for generating an image frame in the video. The method further includes obtaining a control token for constraining position information of an object in the image frame. In addition, the method also includes generating the image frame in the video based on the visual token and the control token, where the object in the image frame satisfies the position information.

The embodiment of the invention discloses a video processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of video processing, and the method comprises the steps: judging whether a to-be-played video meets a preset image quality enhancement condition or not at a decoding stage of the to-be-played video; if the image quality enhancement condition is satisfied, carrying out resolution enhancement on the to-be-played video; performing local color monitoring on the enhanced to-be-played video to obtain a monitoring result; and performing local color enhancement or dynamic frame insertion processing on the video to be played according to the monitoring result. Therefore, the display effect of the low-resolution video can be remarkably improved in the decoding stage, improvement is carried out in the aspects of resolution, color, frame rate and the like, parameters such as resolution, color, frame rate and the like are dynamically adjusted, and the display effect of the low-resolution video is improved.

The invention relates to the technical field of three-dimensional reconstruction, in particular to an industrial CT image three-dimensional reconstruction-based implementation method and system, and the method comprises the following steps: CT image preprocessing, edge detection, image frame insertion, two-dimensional image coordinate three-dimensional processing, and mesh outer surface 3D visualization. The three-dimensional reconstruction implementation method and system based on the industrial CT image have the beneficial effects that a series of processing is carried out on the CT section scanning data of a plurality of objects, and the three-dimensional grid model of the objects is finally restored and generated and is used for subsequent application such as industrial detection and recognition. Compared with a traditional medical reconstruction method, the reconstruction efficiency is higher, and the resource demand of a machine is reduced by more than 50%; the middle process of the image is estimated through frame insertion based on motion estimation through deep learning, and compared with a traditional mathematical algorithm, the reconstruction precision of the three-dimensional model can be improved, so that the precision requirement of subsequent industrial detection is met.

The invention provides a video rendering method, which is applied to the field of video processing. The video rendering method comprises the following steps: a video rendering device obtains a first video, wherein the first video comprises an Nth frame image and an (N + 1) th frame image; the video rendering device obtains a first instruction, the first instruction indicates to operate a second video, and the second video is obtained after frame insertion of the first video; the video rendering device obtains a first frame insertion image based on the first instruction, the Nth frame image and the (N + 1) th frame image, the second video comprises the Nth frame image, the (N + 1) th frame image and the first frame insertion image, and the first frame insertion image is an image after the (N + 1) th frame image in the second video. In the technical scheme provided by the invention, the frame insertion image is generated in an extrapolation mode, so that the delay between the video rendering equipment and the terminal equipment can be reduced. Moreover, the frame insertion image is generated according to the instruction of the second video, so that the quality of the frame insertion image can be improved, and the user experience is improved.

The invention discloses an image processing method and device, electronic equipment and a readable storage medium, and belongs to the technical field of image processing. The image processing method comprises the steps that a binary image of a first image frame, a motion vector image of the first image frame relative to a second image frame and a depth image of the first image frame are acquired, the second image frame is a previous frame image of the first image frame, and pixel points of the motion vector image, the binary image and the depth image are in one-to-one correspondence; processing the motion vector image and the depth image according to the binary image to obtain an updated motion vector image and an updated depth image; and generating a frame insertion image between the first image frame and the second image frame according to the updated motion vector image, the updated depth image, the first image frame and the second image frame.

The invention discloses a video interpolation method and device, electronic equipment and a medium, and belongs to the field of video processing, and the method comprises the following steps: obtaining a to-be-interpolated video and a missing fragment thereof, and constructing an image data set by taking the to-be-interpolated video and the missing fragment thereof as a group of data; acquiring position information of a first frame of the missing fragment in the video to be interpolated, and positioning an interpolation range of the missing fragment; training an interpolation frame model by using the image data set, and interpolating the video to be interpolated based on the position information of the first frame of the missing fragment in the video to be interpolated and the interpolation range of the missing fragment in the model training process; the trained interpolation frame model is used for video interpolation. The method is suitable for interpolating missing frames in videos or repairing damaged video clips, and has important application value in the fields of old film repairing, monitoring video quality improvement, dynamic medical imaging and the like.

The invention relates to a method for acquiring frames using a plurality of detection channels (CH1, CH2), comprising the steps of: acquiring first frame data using a first detection channel (CH1) in a first acquisition mode, and acquiring second frame data using a second detection channel (CH2) in a second acquisition mode, wherein the first frame data and the second frame data are acquired in respective mutually alternating acquisition sequences (Smn) of the respective acquisition series (EF1, EF2). The invention is characterized in that the duration of the acquisition sequence (Smn) of the acquisition series (EF1, EF2) is selected differently for each detection channel (Ch1, Ch2), the duration of the acquisition sequence (Smn) in one acquisition mode differing from the duration of the acquisition sequence (Smn) of at least one further acquisition mode by at least a duration of a single frame acquisition. The invention also relates to an optical device for acquiring a frame using a plurality of detection channels (Ch1, CH2).

The invention provides a multi-phase pulse width modulation method and related equipment for reducing harmonic waves for a class-D power amplifier, and relates to the field of radio and television, and the method comprises the steps: sampling an original audio signal at a preset sampling rate, and obtaining a sine wave audio signal; generating a plurality of triangular wave signals corresponding to the sine wave audio signal according to a preset frequency multiple; performing amplitude comparison on the sampling signal and each triangular wave signal to obtain a pulse width modulation signal corresponding to each triangular wave signal; superposing the plurality of pulse width modulation signals to obtain a superposed signal; and inputting the superposed signal into a D-type power amplifier to obtain a power amplifier output signal after harmonic wave reduction. By implementing the method, the performance requirement on a post-stage low-pass filter can be reduced, so that the harmonic distortion of the output signal is suppressed on the premise of not increasing the cost and complexity of the filter.

To provide a dynamic image display device capable of further accurately comparing dynamic images of different frame rates.SOLUTION: A dynamic image display device (a diagnostic console 3) includes a dynamic image acquisition unit (a control unit 31) for acquiring a first dynamic image captured at a first frame rate and a second dynamic image captured at a second frame rate lower than the first frame rate, an interpolated image generation unit (the control unit 31) for generating an interpolated image between respective frame images of the second dynamic image and increasing a frame rate of the second dynamic image, and a display unit 34 for displaying the first dynamic image and the second dynamic image including the interpolated image in a comparable manner.SELECTED DRAWING: Figure 1

In various examples, systems and methods are disclosed that perform motion detection across image frames, such as optical flow determination, to synchronize an asynchronous frame with respect to a target time for the asynchronous frame. For example, image frames from a sensor can be processed by an optical flow accelerator to detect displacement across the image frames, and the displacement can be used to interpolate a modified frame at the target time. This can be used to perform data collection and combining operations such as stitching and / or reconstruction. The synchronization can be performed from sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

Disclosed is an electronic device including a display module and a processor. The processor is configured to obtain a first video frame and a bypass control value for the first video frame and determine whether to perform frame rate conversion (FRC) processing using the first video frame based on the bypass control value. Based on a determination that the bypass control value is set to a first value indicating bypass of the FRC processing, the processor is configured to display the first video frame. Based on a determination that the bypass control value is set to a second value indicating the FRC processing, the processor is configured to generate an interpolation frame using the first video frame and a second video frame after the first video frame, and display the first video frame, the interpolation frame, and the second video frame.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

A method of performing frame interpolation including creating first interpolated optical flow data based on an optical flow from a preceding 102 and / or following frame 104, the first interpolated opti

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a disparity map generation module, and the disparity map generation module is used for determining a reference window and a candidate window of the to-be-reconstructed low-resolution video, performing depth information extraction based on the reference window and the candidate window to generate a disparity map, and reconstructing the to-be-reconstructed low-resolution video according to the disparity map. Compared with the prior art that the depth information is not considered, the method can extract the depth information for reconstruction, thereby improving the reconstruction effect.

The present application relates to an image generation method and apparatus based on video frame interpolation, and a computer device. The method comprises: acquiring two video frame images, and on the basis of the displacement of pixel points in the two video frame images, determining first optical flow information between the two video frame images (202); on the basis of the two video frame images and the first optical flow information, predicting an intermediate frame image between the two video frame images to obtain a predicted intermediate frame image (204); for each of the two video frame images, on the basis of the video frame image and the displacement of pixel points in the predicted intermediate frame image, determining second optical flow information between the video frame image and the predicted intermediate frame image (206); for each first pixel point in the predicted intermediate frame image, acquiring, from the second optical flow information, a position offset corresponding to the first pixel point, and on the basis of the position offset, selecting an image block corresponding to the first pixel point from the video frame image (208); on the basis of an image block corresponding to each first pixel point in the predicted intermediate frame image, updating a pixel value at each first pixel point in the predicted intermediate frame image to obtain an updated intermediate frame image corresponding to the video frame image (210); and fusing the updated intermediate frame images corresponding to the two video frame images respectively to obtain a fused intermediate frame image (212).

A method for interpolating video frames, includes: obtaining at least two key frames of a video, for which a motion estimation is to be performed, detecting repetitive pattern regions on the at least one key frame of the at least two key frames, estimating motion between the at least one key frame of the at least two key frames and a point in time, for which an interpolated frame will be obtained by feeding the at least two key frames and the repetitive pattern regions to a trained motion estimation neural network.