133results about "Conversion involving interpolation processes" patented technology

The invention relates to the technical field of optical communication, in particular to an automobile headlamp communication system and method based on image frame interpolation, comprising a transmitting end and a receiving end, a vehicle-mounted central control system of the transmitting end is used for receiving input to-be-transmitted information, and an ambient light detection module evaluates an external illumination condition in response to the input of the to-be-transmitted information; an image gray value and frame insertion frequency are set based on the illumination intensity, the image coding module codes information to be transmitted based on the set image gray value to generate a projection image frame, and the projection module inserts the projection image frame into a normal illumination frame sequence of a vehicle lamp based on the frame insertion frequency and projects the projection image frame to an external environment; the image acquisition module of the receiving end is used for acquiring a projection image frame, the image decoding module preprocesses the projection image frame and then decodes the projection image frame, and the information to be transmitted is restored and sent to the vehicle-mounted central control system. According to the invention, vehicle lamp communication at a certain distance in a traffic environment can be realized on the premise of ensuring normal vehicle lamp illumination.

The invention relates to the technical field of image stabilization, in particular to a GMSL camera system design method supporting anti-shake, which comprises the following steps: acquiring a YUV image through image acquisition, extracting an edge through a Canny algorithm and generating trajectory data, tracking pixel displacement to calculate an angle and an amplitude, marking as a stable area if a threshold condition is met, generating a stable area coordinate, and calculating the image according to the stable area coordinate. The IMU collects acceleration and angular velocity data, synchronizes the acceleration and angular velocity data with an image frame, calculates acceleration change, detects an edge direction angle, calculates a vector included angle to generate cutting offset, adjusts the position of a cutting frame, performs bilinear interpolation reduction, and outputs a stable image frame. According to the invention, the jitter compensation precision is improved, the delay and loss are reduced, and the image stability in the vibration environment is enhanced by extracting the image edge track, tracking the pixel displacement path, matching the IMU with the image timestamp, calculating the acceleration and the edge direction offset, dynamically adjusting the position of the cutting frame and performing interpolation reduction.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

Systems and techniques are described herein for interpolating image data. For instance, a method for interpolating image data is provided. The method may include processing a first image frame and a second image frame using a motion estimator to generate first motion vectors, wherein the motion estimator comprises a machine-learning model trained to generate motion vectors based on image frames; projecting the first motion vectors to generate second motion vectors; and generating a third image frame based on the first image frame, the second image frame, and the second motion vectors.

The invention provides a video rendering method, which is applied to the field of video processing. The video rendering method comprises the following steps: a video rendering device obtains a first video, wherein the first video comprises an Nth frame image and an (N + 1) th frame image; the video rendering device obtains a first instruction, the first instruction indicates to operate a second video, and the second video is obtained after frame insertion of the first video; the video rendering device obtains a first frame insertion image based on the first instruction, the Nth frame image and the (N + 1) th frame image, the second video comprises the Nth frame image, the (N + 1) th frame image and the first frame insertion image, and the first frame insertion image is an image after the (N + 1) th frame image in the second video. In the technical scheme provided by the invention, the frame insertion image is generated in an extrapolation mode, so that the delay between the video rendering equipment and the terminal equipment can be reduced. Moreover, the frame insertion image is generated according to the instruction of the second video, so that the quality of the frame insertion image can be improved, and the user experience is improved.

The invention provides a multi-phase pulse width modulation method and related equipment for reducing harmonic waves for a class-D power amplifier, and relates to the field of radio and television, and the method comprises the steps: sampling an original audio signal at a preset sampling rate, and obtaining a sine wave audio signal; generating a plurality of triangular wave signals corresponding to the sine wave audio signal according to a preset frequency multiple; performing amplitude comparison on the sampling signal and each triangular wave signal to obtain a pulse width modulation signal corresponding to each triangular wave signal; superposing the plurality of pulse width modulation signals to obtain a superposed signal; and inputting the superposed signal into a D-type power amplifier to obtain a power amplifier output signal after harmonic wave reduction. By implementing the method, the performance requirement on a post-stage low-pass filter can be reduced, so that the harmonic distortion of the output signal is suppressed on the premise of not increasing the cost and complexity of the filter.

In various examples, systems and methods are disclosed that perform motion detection across image frames, such as optical flow determination, to synchronize an asynchronous frame with respect to a target time for the asynchronous frame. For example, image frames from a sensor can be processed by an optical flow accelerator to detect displacement across the image frames, and the displacement can be used to interpolate a modified frame at the target time. This can be used to perform data collection and combining operations such as stitching and / or reconstruction. The synchronization can be performed from sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

A method of performing frame interpolation including creating first interpolated optical flow data based on an optical flow from a preceding 102 and / or following frame 104, the first interpolated opti

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a disparity map generation module, and the disparity map generation module is used for determining a reference window and a candidate window of the to-be-reconstructed low-resolution video, performing depth information extraction based on the reference window and the candidate window to generate a disparity map, and reconstructing the to-be-reconstructed low-resolution video according to the disparity map. Compared with the prior art that the depth information is not considered, the method can extract the depth information for reconstruction, thereby improving the reconstruction effect.

A method for interpolating video frames, includes: obtaining at least two key frames of a video, for which a motion estimation is to be performed, detecting repetitive pattern regions on the at least one key frame of the at least two key frames, estimating motion between the at least one key frame of the at least two key frames and a point in time, for which an interpolated frame will be obtained by feeding the at least two key frames and the repetitive pattern regions to a trained motion estimation neural network.

To provide an image processing apparatus that can improve definition of an image with high accuracy by using machine learning.SOLUTION: An image processing apparatus uses a first image group to improve definition of images in a second image group with a smaller number of high frequency components than images in the first image group, and the image processing apparatus calculates similarity between an image for which the definition is to be improved, the image selected from the second image group, and an image for which the definition is to be improved in a previous time, creates a learning model for improving the definition of the image for which the definition is to be improved by using training data selected on the basis of the image for which the definition is to be improved from among a plurality of pieces of training data each including an image included in the first image group as one of a pair of images, infers a high frequency component of the image for which the definition is to be improved by using the created learning model when the calculated similarity is equal to or less than a threshold, and by using a learning model used for improving the definition in the previous time as it is when the similarity is larger than the threshold, and creates an image with the improved definition on the basis of, the image for which the definition is to be improved and the inferred high frequency component.SELECTED DRAWING: Figure 20

The present disclosure provides a method, medium, product and computing device for dynamically adjusting interpolation calculation, relating to the field of image and video processing, especially to the field of real-time rendering, and the implementation scheme is as follows: obtaining a feature parameter related to interpolation calculation of a current rendering frame; inputting the feature parameter into a complexity prediction model to obtain a predicted time consumption of interpolation calculation of the current rendering frame before rendering of the current rendering frame starts; selecting an interpolation mode from a plurality of interpolation modes with different calculation accuracies based on the predicted time consumption and a budget time to perform interpolation calculation on the current rendering frame, and recording an actual time consumption of interpolation calculation of the current rendering frame; and updating the complexity prediction model based on a difference between the actual time consumption and the predicted time consumption.

The invention discloses a frame insertion method and system based on a 3D movie and computer equipment, and the method comprises the steps: obtaining a left 2D video signal and a right 2D video signal in the 3D movie, extracting an input frame signal in each 2D video signal, carrying out the optical flow estimation according to the input frame signals, and obtaining a left optical flow estimation result and a right optical flow estimation result; performing network fitting correction on the optical flow estimation results of the left path and the right path to obtain an optical flow signal with consistent space; according to the left and right paths of corrected optical flow signals, carrying out pixel capture to obtain frame insertion candidate frames; performing joint optimization on the frame insertion candidate frames according to 3D information to obtain an optimized frame insertion result; and fusing the optimized frame insertion result to generate an intermediate frame for frame insertion so as to obtain a high-frame-rate video sequence. According to the invention, the consistency, coherence and robustness of the 3D film frame insertion process can be effectively improved.

A method includes: obtaining a first main image from a first real image and obtaining a second main image from a second real image, where the first real image and the second real image are images obtained through rendering by the electronic device; performing motion vector calculation on the first main image and the second main image, to obtain a motion vector; warping an environment in a target main image and a moving object in the target main image based on the motion vector, to generate an environment in a predicted frame and a moving object in the predicted frame; and multiplexing image data of a shadow of the moving object in the target main image into the predicted frame, to generate a shadow of the moving object in the predicted frame.

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a channel attention mechanism module provided with a gating mechanism, the gating mechanism comprises target feature weights corresponding to the feature information, the target feature weights are determined through adaptive training, and the channel attention mechanism module is used for performing feature extraction on the low-resolution video to be reconstructed to obtain the feature information; and reconstructing the to-be-reconstructed low-resolution video according to the corresponding target feature weight based on each piece of feature information to obtain a target high-resolution video. When the method is used, reconstruction can be carried out through a gating mechanism according to the target feature weights corresponding to the feature information, so that interference can be reduced, and the reconstruction effect is improved.

The present invention discloses a method for motion estimation and motion compensation and a video processor thereof. The method is used in a video processor and includes the following steps: detecting an input frame rate of a series of input frames; calculating a frame count value, the frame count value representing the number of output frame periods between a current input frame and a previous input frame in the series of input frames; calculating a phase step value based on the frame count value, the phase step value being used to generate a phase coefficient, the phase coefficient being used to generate an interpolated frame as an output frame for each output frame period; and generating the interpolated frame using the phase coefficient based on the current input frame and the previous input frame. The steps of calculating the frame count value, calculating the phase step value, and generating the interpolated frame are performed continuously until the input frame rate is successfully detected.

The present disclosure relates to the technical field of image processing. Provided in the embodiments of the present disclosure are a video super-resolution method and apparatus. The method comprises: separately decomposing into N image blocks the t-th image frame of a video to be subjected to super-resolution and a neighborhood image frame of the t-th image frame; generating N image block sequences, the images block in each image block sequence being respectively located at the same position of different image frames; computing motion parameters of each image block sequence, the motion parameters of the image block sequence comprising motion parameters between the image blocks of the adjacent image frames in the image block sequence; according to the motion parameters of each image block sequence, determining a super-resolution network model corresponding to each image block sequence; using the corresponding super-resolution network model to perform super-resolution on the image block of the t-th image frame in each image block sequence, so as to obtain super-resolution image blocks of the t-th image frame; and according to the super-resolution image blocks of the t-th image frame, generating a super-resolution image frame of the t-th image frame.

The invention relates to the technical field of video processing, and discloses a video super-resolution reconstruction method and device and wearable equipment, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution video; reconstructing the to-be-reconstructed low-resolution video through a preset reconstruction model to obtain a target high-resolution video; wherein the preset reconstruction model at least comprises a dense module and a non-local attention module, the dense module is used for performing feature extraction on the to-be-reconstructed low-resolution video and reconstructing the to-be-reconstructed low-resolution video according to the first extraction result to obtain an initial high-resolution video, and the non-local attention module is used for performing non-local attention on the initial high-resolution video; and the non-local attention module is used for determining the relevance of the initial high-resolution video by adopting a self-attention mechanism, and adjusting the initial high-resolution video based on the relevance to obtain a target high-resolution video. According to the method and the device, the relevance of different positions can be considered in the obtained target high-resolution video, so that the reconstruction effect is improved.

Various examples, systems, and methods are disclosed relating to feature cache-based generative video editing for dynamic frame generation. A system can apply a first frame as input to a machine learning model to retrieve, from the machine learning model, a first embedding of the first frame. The system can store the first embedding in a cache, wherein the cache includes a second embedding of a second frame. The system can generate a third frame using the machine learning model based at least on the cache, wherein the third frame is associated with the first frame. The system can output the third frame to a video stream comprising a fourth frame.

Embodiments herein provide a method for user interaction management in a user-interactive application in an electronic device. The method includes: generating and displaying artificial frame in-between a plurality of real frames of the user-interactive application and receiving a user input on the artificial frame displayed in-between the plurality of real frames of the user-interactive application; detecting an object in the artificial frame on which the user input is received; determining a correlation between the user input, coordinates of object in real frame of the plurality of real frames, and coordinates of the object in the artificial frame based on the detected object in the artificial frame; and displaying an interaction of the object in the artificial frame based on the determined correlation.

The invention discloses frame interpolation based on optical flow to synchronize between sensors. In various examples, systems and methods are disclosed that perform motion detection, such as optical flow determination, across image frames to synchronize asynchronous frames with respect to a target time of the asynchronous frames. For example, an image frame from a sensor may be processed by an optical flow accelerator to detect a displacement across the image frame, and the displacement may be used to interpolate a modified frame at a target time. This may be used to perform data collection and combination operations, such as splicing and / or reconstruction. Synchronization may be performed according to sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

The application provides a multi-phase pulse width modulation method for reducing harmonics of a class-D power amplifier and related equipment, and relates to the field of broadcast television.The method comprises the following steps: sampling an original audio signal at a preset sampling rate to obtain a sinusoidal audio signal; generating a plurality of triangular wave signals corresponding to the sinusoidal audio signal at a preset frequency multiple; performing amplitude comparison between the sampling signal and each triangular wave signal to obtain a pulse width modulation signal corresponding to each triangular wave signal; superimposing the plurality of pulse width modulation signals to obtain a superimposed signal; and inputting the superimposed signal into the class-D power amplifier to obtain a power amplifier output signal with reduced harmonics. By implementing the method, the performance requirement of a low-pass filter in the latter stage can be reduced, so that the suppression of harmonic distortion of the output signal is realized without increasing the cost and complexity of the filter.

A dynamic image display device includes a hardware processor and a display. The hardware processor acquires a first dynamic image captured at a first frame rate and a second dynamic image captured at a second frame rate lower than the first frame rate, and generates an interpolation image between each frame image of the second dynamic image and increases a frame rate of the second dynamic image. The display that displays the first dynamic image and the second dynamic image that includes the interpolation image in a comparable manner.

A processor unit configured to identify blocks of a frame of a video sequence to be excluded from a motion-compensated operation, includes a frame processor configured to process pixel values of a first frame to characterise blocks of one or more pixels of the first frame as representing at least a portion of a graphic object; a frame-difference processor configured to determine difference values between blocks of the first frame and corresponding blocks of a second frame, and to process said difference values to characterise blocks of the first frame as representing an image component that is static between the first and second frames; a block identifier configured to identify blocks of the first frame as protected blocks in dependence on blocks characterised as: (i) representing at least a portion of a graphic object; and (ii) representing an image component that is static between the first and second frames, wherein the identified protected blocks are to be excluded from the motion compensated operation.

In one implementation, a method of frame rate extrapolation is performed by a device including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes displaying, on the display, the image of the scene at a first time. The method includes generating an extrapolated image by transforming, using the one or more processors, the image of the scene based on movement of the device, wherein the extrapolated image includes a first area including a first plurality of pixels having respective first pixel values based on a single depth and a second area including a second plurality of pixels having respective second pixel values based on a plurality of depths. The method includes displaying, on the display, the extrapolated image at a second time after the first time.

An image processing method for a video processor includes receiving a first input frame at a first time instant, receiving a second input frame at a second time instant, and creating an interpolated frame. When no input frame is received at a third time instant, the interpolated frame is generated using extrapolation according to the first and second input frames. When a third input frame is received at the third time instant, the interpolated frame is generated using interpolation according to the second and third input frames. The video playback smoothness can be improved by dynamically switching between extrapolation and interpolation.

An electronic apparatus including memory storing one or more instructions and at least one processor that is connected with the memory and controls the electronic apparatus, wherein the at least one processor is configured to, by executing the one or more instructions, identify an area where a motion is maintained in an input image, identify motion information of the identified area and representative motion information of the identified area, identify a motion correction value based on the identified motion information and the identified representative motion information, perform motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area, obtain an interpolation frame by applying the identified motion correction value to the identified area, and obtain an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.

A display device includes: an image input unit configured to receive an image signal; a frame skip detector configured to detect a frame skip in the image signal; a frame skip compensation adjuster configured to determine information indicating whether to perform frame interpolation, interpolation input frame information, and an interpolation time, based on the frame skip detected by the frame skip detector; a frame interpolator configured to generate an interpolation frame, based on the information indicating whether to perform frame interpolation, the interpolation input frame information, and the interpolation time; and an image output unit configured to output an image signal including the interpolation frame corresponding to the interpolation time.