215results about "Conversion involving interpolation processes" patented technology

The invention discloses a real-time video processing system based on an ampere-path FPGA. The real-time video processing system comprises an SD card, an ampere-path FPGA board card and an HDMI displayer. The SD card is used for storing original video data in a Bayer format; the A-path FPGA board card comprises an FPGA end and an ARM end, the FPGA end comprises an SD card reading control module, an image cache FIFO module, a Bayer-to-RGB module, a seven-in-one image processing module, an SDRAM read-write control module and an HDMI display control module, the first four modules are connected in sequence, and the SDRAM read-write control module is connected with the Bayer-to-RGB module, the seven-in-one image processing module and the HDMI display control module; wherein the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all peripheral interfaces, and all the modules are connected in sequence; the ARM end comprises a Cortex-M0 processor core, an AHBLiite-Interconnect data bus and all the peripheral interfaces; the ampere-path FPGA board card is used for completing all video processing functions; and the HDMI display outputs the processed video. The method is good in video processing effect, low in resource consumption, high in flexibility, high in stability and low in hardware cost, and the hardware is 100% localized.

A method and processor for real-time frame processing of a sequence of frames, focusing on motion vector determination, decision metric calculation, and selective triggering of modes for frame processing. It involves calculating motion vectors and their metrics based on pixel displacement and gradient magnitude between consecutive frames to decide on the most appropriate processing mode-copying, generating via neural networks, or rendering using GPUs. The method adapts over time by adjusting thresholds for motion vector metrics, employing decay functions to refine the decision-making process for subsequent frames. This adaptive approach aims to optimize frame generation and rendering quality in dynamic sequences, providing a sophisticated method for managing and enhancing visual media in real-time applications. The processor is configured to execute these steps, adjusting its operations as it processes more frames, ensuring efficient and high-quality visual outputs.

The invention relates to the technical field of optical communication, in particular to an automobile headlamp communication system and method based on image frame interpolation, comprising a transmitting end and a receiving end, a vehicle-mounted central control system of the transmitting end is used for receiving input to-be-transmitted information, and an ambient light detection module evaluates an external illumination condition in response to the input of the to-be-transmitted information; an image gray value and frame insertion frequency are set based on the illumination intensity, the image coding module codes information to be transmitted based on the set image gray value to generate a projection image frame, and the projection module inserts the projection image frame into a normal illumination frame sequence of a vehicle lamp based on the frame insertion frequency and projects the projection image frame to an external environment; the image acquisition module of the receiving end is used for acquiring a projection image frame, the image decoding module preprocesses the projection image frame and then decodes the projection image frame, and the information to be transmitted is restored and sent to the vehicle-mounted central control system. According to the invention, vehicle lamp communication at a certain distance in a traffic environment can be realized on the premise of ensuring normal vehicle lamp illumination.

The invention discloses a remote state monitoring system for a portable video conference device, relates to the technical field of equipment monitoring, and solves the problems that the use monitoring data of conference equipment is acquired by using a set frequency in the prior art, and when the set frequency is relatively high, the abnormal condition of the conference equipment cannot be identified in time, so that the use safety of the conference equipment is influenced. And normal proceeding of the conference is influenced. The method comprises the following steps: acquiring real-time data of conference equipment through a data sensor, and preprocessing the real-time data to obtain operation data; analyzing the acquisition frequency of the real-time data according to the operation data; calling operation data in a set time period based on the acquisition frequency, and analyzing the operation state of the conference equipment according to the operation data in the set time period; adjusting parameters of the conference equipment according to the running state; testing the adjusted conference equipment to obtain a test result; the adjustment of the parameters is optimized according to a test result; abnormity of the conference equipment can be found in time, and normal operation of the conference equipment can be ensured.

The invention relates to the technical field of image stabilization, in particular to a GMSL camera system design method supporting anti-shake, which comprises the following steps: acquiring a YUV image through image acquisition, extracting an edge through a Canny algorithm and generating trajectory data, tracking pixel displacement to calculate an angle and an amplitude, marking as a stable area if a threshold condition is met, generating a stable area coordinate, and calculating the image according to the stable area coordinate. The IMU collects acceleration and angular velocity data, synchronizes the acceleration and angular velocity data with an image frame, calculates acceleration change, detects an edge direction angle, calculates a vector included angle to generate cutting offset, adjusts the position of a cutting frame, performs bilinear interpolation reduction, and outputs a stable image frame. According to the invention, the jitter compensation precision is improved, the delay and loss are reduced, and the image stability in the vibration environment is enhanced by extracting the image edge track, tracking the pixel displacement path, matching the IMU with the image timestamp, calculating the acceleration and the edge direction offset, dynamically adjusting the position of the cutting frame and performing interpolation reduction.

The invention relates to an image processing method and device for virtual shooting. The method comprises the following steps: receiving a latest image generated by rendering a current virtual scene from a rendering module and associated information of the latest image; generating a target number of frame insertion images according to the latest image, the associated information of the latest image and the previous image; performing projection transformation on the newest image and each frame insertion image based on the corresponding camera data to obtain a transformed newest image and each transformed frame insertion image so as to correspond to a camera; and in response to the refresh rate of the screen, sequentially sending the transformed frame insertion images and the transformed latest image to the screen, so that the screen sequentially displays the transformed frame insertion images and the transformed latest image after the previous image is displayed. The real-time frame insertion is realized while the high resolution of the virtual scene picture is ensured, the screen display picture is free of pause and smoother, the frame rate of the screen image is improved, the virtual shooting effect is improved, and the shooting requirement is met.

A system for increasing a frame rate of a dynamic image includes an input for receiving a set of consecutive image frames of a first dynamic image having a first plurality of image frames and a first frame rate. The system further includes a deformation encoding neural network coupled to the input and configured to derive at least one parameter characterizing dynamics of the set of consecutive image frames and to generate an interpolated image frame based on the at least one parameter, and a post-processing module coupled to the deformation encoding neural network and configured to receive one or more interpolated image frames from the deformation encoding neural network, to create a second plurality of image frames comprising the one or more interpolated image frames and the first plurality of image frames, and to generate a second dynamic image using the second plurality of image frames, the second dynamic image having a second frame rate higher than the first frame rate.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

Systems and techniques are described herein for interpolating image data. For instance, a method for interpolating image data is provided. The method may include processing a first image frame and a second image frame using a motion estimator to generate first motion vectors, wherein the motion estimator comprises a machine-learning model trained to generate motion vectors based on image frames; projecting the first motion vectors to generate second motion vectors; and generating a third image frame based on the first image frame, the second image frame, and the second motion vectors.

The invention discloses a video signal de-interlacing method and device and electronic equipment, and the method comprises the steps: S100, obtaining a directional correlation interpolation result P directional interpolation of a to-be-interpolated pixel point in a current field, and obtaining a median filtering result P median filtering of the to-be-interpolated pixel point in the current field; and S200, acquiring a motion coefficient M of a to-be-interpolated pixel point in the current field, and selecting an interpolation mode and an interpolation result of the to-be-interpolated pixel point in the current field according to an interval in which the motion coefficient M is located. According to the method, interpolation results of direction correlation interpolation and median filtering are calculated respectively, then motion detection is carried out, a motion area of a pixel point to be interpolated is divided, and then a proper interpolation algorithm is selected according to the divided area, namely, an optimal mode to be interpolated is selected through motion detection. Therefore, the final interpolation suitable for various motion scenes is obtained, and the interpolation mode and the interpolation effect during de-interlacing are greatly optimized.

The present disclosure relates to a method and apparatus for generating a video, an electronic device, and a computer program product. The method includes obtaining a visual token for generating an image frame in the video. The method further includes obtaining a control token for constraining position information of an object in the image frame. In addition, the method also includes generating the image frame in the video based on the visual token and the control token, where the object in the image frame satisfies the position information.

The present disclosure relates to a method and apparatus for generating a video, an electronic device, and a computer program product. The method includes obtaining a visual token for generating an image frame in the video. The method further includes obtaining a control token for constraining position information of an object in the image frame. In addition, the method also includes generating the image frame in the video based on the visual token and the control token, where the object in the image frame satisfies the position information.

The embodiment of the invention discloses a video processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of video processing, and the method comprises the steps: judging whether a to-be-played video meets a preset image quality enhancement condition or not at a decoding stage of the to-be-played video; if the image quality enhancement condition is satisfied, carrying out resolution enhancement on the to-be-played video; performing local color monitoring on the enhanced to-be-played video to obtain a monitoring result; and performing local color enhancement or dynamic frame insertion processing on the video to be played according to the monitoring result. Therefore, the display effect of the low-resolution video can be remarkably improved in the decoding stage, improvement is carried out in the aspects of resolution, color, frame rate and the like, parameters such as resolution, color, frame rate and the like are dynamically adjusted, and the display effect of the low-resolution video is improved.

The invention relates to the technical field of three-dimensional reconstruction, in particular to an industrial CT image three-dimensional reconstruction-based implementation method and system, and the method comprises the following steps: CT image preprocessing, edge detection, image frame insertion, two-dimensional image coordinate three-dimensional processing, and mesh outer surface 3D visualization. The three-dimensional reconstruction implementation method and system based on the industrial CT image have the beneficial effects that a series of processing is carried out on the CT section scanning data of a plurality of objects, and the three-dimensional grid model of the objects is finally restored and generated and is used for subsequent application such as industrial detection and recognition. Compared with a traditional medical reconstruction method, the reconstruction efficiency is higher, and the resource demand of a machine is reduced by more than 50%; the middle process of the image is estimated through frame insertion based on motion estimation through deep learning, and compared with a traditional mathematical algorithm, the reconstruction precision of the three-dimensional model can be improved, so that the precision requirement of subsequent industrial detection is met.

The invention provides a video rendering method, which is applied to the field of video processing. The video rendering method comprises the following steps: a video rendering device obtains a first video, wherein the first video comprises an Nth frame image and an (N + 1) th frame image; the video rendering device obtains a first instruction, the first instruction indicates to operate a second video, and the second video is obtained after frame insertion of the first video; the video rendering device obtains a first frame insertion image based on the first instruction, the Nth frame image and the (N + 1) th frame image, the second video comprises the Nth frame image, the (N + 1) th frame image and the first frame insertion image, and the first frame insertion image is an image after the (N + 1) th frame image in the second video. In the technical scheme provided by the invention, the frame insertion image is generated in an extrapolation mode, so that the delay between the video rendering equipment and the terminal equipment can be reduced. Moreover, the frame insertion image is generated according to the instruction of the second video, so that the quality of the frame insertion image can be improved, and the user experience is improved.

The invention discloses a video interpolation method and device, electronic equipment and a medium, and belongs to the field of video processing, and the method comprises the following steps: obtaining a to-be-interpolated video and a missing fragment thereof, and constructing an image data set by taking the to-be-interpolated video and the missing fragment thereof as a group of data; acquiring position information of a first frame of the missing fragment in the video to be interpolated, and positioning an interpolation range of the missing fragment; training an interpolation frame model by using the image data set, and interpolating the video to be interpolated based on the position information of the first frame of the missing fragment in the video to be interpolated and the interpolation range of the missing fragment in the model training process; the trained interpolation frame model is used for video interpolation. The method is suitable for interpolating missing frames in videos or repairing damaged video clips, and has important application value in the fields of old film repairing, monitoring video quality improvement, dynamic medical imaging and the like.

The invention provides a multi-phase pulse width modulation method and related equipment for reducing harmonic waves for a class-D power amplifier, and relates to the field of radio and television, and the method comprises the steps: sampling an original audio signal at a preset sampling rate, and obtaining a sine wave audio signal; generating a plurality of triangular wave signals corresponding to the sine wave audio signal according to a preset frequency multiple; performing amplitude comparison on the sampling signal and each triangular wave signal to obtain a pulse width modulation signal corresponding to each triangular wave signal; superposing the plurality of pulse width modulation signals to obtain a superposed signal; and inputting the superposed signal into a D-type power amplifier to obtain a power amplifier output signal after harmonic wave reduction. By implementing the method, the performance requirement on a post-stage low-pass filter can be reduced, so that the harmonic distortion of the output signal is suppressed on the premise of not increasing the cost and complexity of the filter.

To provide a dynamic image display device capable of further accurately comparing dynamic images of different frame rates.SOLUTION: A dynamic image display device (a diagnostic console 3) includes a dynamic image acquisition unit (a control unit 31) for acquiring a first dynamic image captured at a first frame rate and a second dynamic image captured at a second frame rate lower than the first frame rate, an interpolated image generation unit (the control unit 31) for generating an interpolated image between respective frame images of the second dynamic image and increasing a frame rate of the second dynamic image, and a display unit 34 for displaying the first dynamic image and the second dynamic image including the interpolated image in a comparable manner.SELECTED DRAWING: Figure 1

In various examples, systems and methods are disclosed that perform motion detection across image frames, such as optical flow determination, to synchronize an asynchronous frame with respect to a target time for the asynchronous frame. For example, image frames from a sensor can be processed by an optical flow accelerator to detect displacement across the image frames, and the displacement can be used to interpolate a modified frame at the target time. This can be used to perform data collection and combining operations such as stitching and / or reconstruction. The synchronization can be performed from sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

A method of performing frame interpolation including creating first interpolated optical flow data based on an optical flow from a preceding 102 and / or following frame 104, the first interpolated opti

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a disparity map generation module, and the disparity map generation module is used for determining a reference window and a candidate window of the to-be-reconstructed low-resolution video, performing depth information extraction based on the reference window and the candidate window to generate a disparity map, and reconstructing the to-be-reconstructed low-resolution video according to the disparity map. Compared with the prior art that the depth information is not considered, the method can extract the depth information for reconstruction, thereby improving the reconstruction effect.

A method for interpolating video frames, includes: obtaining at least two key frames of a video, for which a motion estimation is to be performed, detecting repetitive pattern regions on the at least one key frame of the at least two key frames, estimating motion between the at least one key frame of the at least two key frames and a point in time, for which an interpolated frame will be obtained by feeding the at least two key frames and the repetitive pattern regions to a trained motion estimation neural network.

To provide an image processing apparatus that can improve definition of an image with high accuracy by using machine learning.SOLUTION: An image processing apparatus uses a first image group to improve definition of images in a second image group with a smaller number of high frequency components than images in the first image group, and the image processing apparatus calculates similarity between an image for which the definition is to be improved, the image selected from the second image group, and an image for which the definition is to be improved in a previous time, creates a learning model for improving the definition of the image for which the definition is to be improved by using training data selected on the basis of the image for which the definition is to be improved from among a plurality of pieces of training data each including an image included in the first image group as one of a pair of images, infers a high frequency component of the image for which the definition is to be improved by using the created learning model when the calculated similarity is equal to or less than a threshold, and by using a learning model used for improving the definition in the previous time as it is when the similarity is larger than the threshold, and creates an image with the improved definition on the basis of, the image for which the definition is to be improved and the inferred high frequency component.SELECTED DRAWING: Figure 20

The present disclosure provides a method, medium, product and computing device for dynamically adjusting interpolation calculation, relating to the field of image and video processing, especially to the field of real-time rendering, and the implementation scheme is as follows: obtaining a feature parameter related to interpolation calculation of a current rendering frame; inputting the feature parameter into a complexity prediction model to obtain a predicted time consumption of interpolation calculation of the current rendering frame before rendering of the current rendering frame starts; selecting an interpolation mode from a plurality of interpolation modes with different calculation accuracies based on the predicted time consumption and a budget time to perform interpolation calculation on the current rendering frame, and recording an actual time consumption of interpolation calculation of the current rendering frame; and updating the complexity prediction model based on a difference between the actual time consumption and the predicted time consumption.

The invention discloses a frame insertion method and system based on a 3D movie and computer equipment, and the method comprises the steps: obtaining a left 2D video signal and a right 2D video signal in the 3D movie, extracting an input frame signal in each 2D video signal, carrying out the optical flow estimation according to the input frame signals, and obtaining a left optical flow estimation result and a right optical flow estimation result; performing network fitting correction on the optical flow estimation results of the left path and the right path to obtain an optical flow signal with consistent space; according to the left and right paths of corrected optical flow signals, carrying out pixel capture to obtain frame insertion candidate frames; performing joint optimization on the frame insertion candidate frames according to 3D information to obtain an optimized frame insertion result; and fusing the optimized frame insertion result to generate an intermediate frame for frame insertion so as to obtain a high-frame-rate video sequence. According to the invention, the consistency, coherence and robustness of the 3D film frame insertion process can be effectively improved.

A method includes: obtaining a first main image from a first real image and obtaining a second main image from a second real image, where the first real image and the second real image are images obtained through rendering by the electronic device; performing motion vector calculation on the first main image and the second main image, to obtain a motion vector; warping an environment in a target main image and a moving object in the target main image based on the motion vector, to generate an environment in a predicted frame and a moving object in the predicted frame; and multiplexing image data of a shadow of the moving object in the target main image into the predicted frame, to generate a shadow of the moving object in the predicted frame.

Embodiments herein provide a method for user interaction management in a user interaction application in an electronic device. The method includes: generating and displaying artificial frames among a plurality of real frames of a user interaction application, and receiving user input on the artificial frames displayed among the plurality of real frames of the user interaction application; detecting an object in the artificial frame input by the user; determining a correlation between the user input, coordinates of the object in a real frame of the plurality of real frames, and coordinates of the object in the artificial frame based on the object detected in the artificial frame; and displaying an interaction of the object in the artificial frame based on the determined correlation.

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a channel attention mechanism module provided with a gating mechanism, the gating mechanism comprises target feature weights corresponding to the feature information, the target feature weights are determined through adaptive training, and the channel attention mechanism module is used for performing feature extraction on the low-resolution video to be reconstructed to obtain the feature information; and reconstructing the to-be-reconstructed low-resolution video according to the corresponding target feature weight based on each piece of feature information to obtain a target high-resolution video. When the method is used, reconstruction can be carried out through a gating mechanism according to the target feature weights corresponding to the feature information, so that interference can be reduced, and the reconstruction effect is improved.

The present invention discloses a method for motion estimation and motion compensation and a video processor thereof. The method is used in a video processor and includes the following steps: detecting an input frame rate of a series of input frames; calculating a frame count value, the frame count value representing the number of output frame periods between a current input frame and a previous input frame in the series of input frames; calculating a phase step value based on the frame count value, the phase step value being used to generate a phase coefficient, the phase coefficient being used to generate an interpolated frame as an output frame for each output frame period; and generating the interpolated frame using the phase coefficient based on the current input frame and the previous input frame. The steps of calculating the frame count value, calculating the phase step value, and generating the interpolated frame are performed continuously until the input frame rate is successfully detected.