142results about "Conversion by changing video signal frequency" patented technology

The invention relates to the technical field of digital twinning, particularly provides a digital twinning scene adaptive optimization method based on point cloud data, and solves the problems that smoothness and detail presentation cannot be balanced during network fluctuation, and a scene prediction optimization mechanism based on space-time semantic analysis is not established. The method comprises the following steps: data preprocessing and hierarchical construction: carrying out preprocessing of abnormal point elimination, missing value complementation and density adjustment on original point cloud data, dividing key and common regions according to scene requirements, and constructing a multi-scale and multi-resolution hierarchical point cloud data system; the method can deeply analyze the spatio-temporal dynamic characteristics of the point cloud data through the technologies of spatio-temporal dynamic semantic segmentation, dynamic change monitoring, prediction optimization and the like, processes the continuous time sequence point cloud data after adaptive transmission, models a time dependency relationship and extracts local and global characteristics in time and space dimensions respectively, and improves the accuracy of point cloud data processing. Accurate identification of object types, positions and dynamic change information is realized.

The invention belongs to the technical field of image processing, and particularly relates to a binocular camera low-delay synchronization method, which comprises the following steps of: respectively establishing data queues for a main view acquisition stream and an auxiliary view acquisition stream, and acquiring an acquisition frame with an acquisition time identifier from the data queues; taking an acquisition moment identifier of a certain acquisition frame in the main view acquisition stream as unified target time; on the basis of at least two acquisition frames in a unified target time neighborhood in the auxiliary view acquisition stream, a re-projection auxiliary view frame in the unified target time is generated by executing a cross-view stream time re-projection algorithm; and taking an acquisition frame in the main view acquisition stream as a reference acquisition frame, forming a time synchronization frame pair together with the re-projection auxiliary view frame, and outputting the time synchronization frame pair. According to the method, the synchronization precision and stability are improved under the low-delay condition, the hardware dependence and the storage overhead are reduced, and the method has the advantages of being high in real-time performance, high in adaptability, easy to implement and good in expandability.

Aspects presented herein relate to methods and devices for display processing including an apparatus, e.g., a GPU or a CPU. The apparatus may obtain a first frame and a second frame of a plurality of frames in a scene. The apparatus may also calculate a set of first motion vectors in the first frame and a set of second motion vectors in the second frame, where the set of first motion vectors and the set of second motion vectors are calculated based on a block matching procedure. Further, the apparatus may estimate at least one third frame in the plurality of frames based on the set of first motion vectors in the first frame and the set of second motion vectors in the second frame, where the at least one third frame is subsequent to the second frame in the plurality of frames.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

Systems and techniques are described herein for interpolating image data. For instance, a method for interpolating image data is provided. The method may include processing a first image frame and a second image frame using a motion estimator to generate first motion vectors, wherein the motion estimator comprises a machine-learning model trained to generate motion vectors based on image frames; projecting the first motion vectors to generate second motion vectors; and generating a third image frame based on the first image frame, the second image frame, and the second motion vectors.

In various examples, systems and methods are disclosed that perform motion detection across image frames, such as optical flow determination, to synchronize an asynchronous frame with respect to a target time for the asynchronous frame. For example, image frames from a sensor can be processed by an optical flow accelerator to detect displacement across the image frames, and the displacement can be used to interpolate a modified frame at the target time. This can be used to perform data collection and combining operations such as stitching and / or reconstruction. The synchronization can be performed from sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

The invention provides a low earth orbit satellite network video code rate determination method and device and electronic equipment. The method comprises the following steps: acquiring link state information of a low earth orbit satellite network link; predicting whether a link reconstruction event occurs at the next moment based on the link state information; and under the condition of predicting that a link reconstruction event occurs in the low earth orbit satellite network link at the next moment, dividing a time domain into independent control intervals, and independently determining the video block code rate at the next moment based on the network state of the independent control interval in each independent control interval. According to the method, the satellite network reconstruction event is predicted, and the video code rate is independently determined in the interval mode in the reconstruction event period, so that the video live broadcast experience quality in the low-orbit satellite network environment is improved.

Disclosed herein is zero-latency switching between two resolution and frame rate modes. The system includes receiving a trigger to switch a video data stream of frames between a first resolution and frame rate mode and a second resolution and frame rate mode. The system also includes switching, in response to the trigger, the video data stream between the first resolution and frame rate mode and the second resolution and frame rate mode, wherein a total horizontal pixel width of each frame of the video data stream in the first resolution and frame rate mode and of each frame of the video data stream in the second resolution and frame rate mode are the same, wherein a pixel clock rate of the video data stream in the first resolution and frame rate mode and the video data stream in the second resolution and frame rate mode are the same.

The invention discloses a self-adaptive video transmission control method based on unmanned aerial vehicle bandwidth perception. The method comprises the steps that S1, an unmanned aerial vehicle video system sends a bandwidth perception data frame to a ground receiving end; s2, the ground end returns a bandwidth state data frame, wherein the bandwidth state data frame comprises a received signal strength indication (RSSI) and a frame loss rate (FLR) index; s3, the unmanned aerial vehicle video system analyzes the bandwidth state data frame and evaluates the channel quality grade; s4, the unmanned aerial vehicle video system calculates a buffer proportion factor of the annular buffer area; s5, the unmanned aerial vehicle video system calls a pre-constructed adaptive transmission control model, transmission parameters are updated according to the channel quality grade and the buffer proportion factor, and the transmission parameters comprise transmission video quality and coding parameters; s6, transmitting video data according to the updated transmission parameters of the unmanned aerial vehicle video system; and S7, the ground end receives the video data and decodes and plays the video data. According to the invention, the problem of poor adaptability in different network environments when the unmanned aerial vehicle sends the video data with the fixed channel parameters is solved, and the video transmission quality is improved.

A method for interpolating video frames, includes: obtaining at least two key frames of a video, for which a motion estimation is to be performed, detecting repetitive pattern regions on the at least one key frame of the at least two key frames, estimating motion between the at least one key frame of the at least two key frames and a point in time, for which an interpolated frame will be obtained by feeding the at least two key frames and the repetitive pattern regions to a trained motion estimation neural network.

The invention provides a video frame extraction method and device, a storage medium and computer equipment. The method comprises the following steps: reading packet structures of a plurality of video frames of a plurality of main code stream video data; obtaining a type identifier of each video frame according to the packet structure; and determining the video frames of which the type identifiers are I frame identifiers as key frames, and extracting the key frames of the plurality of main code stream video data to a video decoder for decoding, so that the video decoding equipment only needs to decode the I frames, the workload of the video decoder is reduced, and the video decoding efficiency is improved on the premise of completely keeping the image quality of the main code stream unchanged. The decoding pressure of a video decoder is greatly reduced, and the shooting parameter configuration of the camera corresponding to each main code stream video data is not influenced at all.

A curation system may be used by a number of collaborative users in order to capture and manage audio and video content. Content is captured by a capture device and streamed in near real-time to a storage and management server. The management server is configured to provide interfaces to remote collaborative users via computers and other devices to allow content to be viewed as it is captured, or after it is captured. Collaborative users may also modify content by submitting metadata to be associated with content in order to add comments, keywords, clips, notes, and other organizational and classifying information to sections of the content. The server is also configured to transcribe audio and video content, and associate transcription metadata with the content to allow it to be further captioned, searched, and organized. Shared interfaces allow users to collaboratively edit and publish content while minimizing wasted effort.

The invention relates to the technical field of computer vision and video image processing, and discloses a video picture intelligent frame supplementing method and system based on deep learning, and the method comprises the steps: carrying out the feature coding and semantic segmentation of front and rear frames of a video sequence, and dividing an image into a rigid body instance region and a non-rigid body region; constructing a parameterized rigid body reference flow field by predicting geometric transformation parameters of the rigid body instance; calculating a space gradient and a semantic edge weight of the reference flow field; a motion field gradient consistency constraint is introduced when a residual optical flow is predicted, and a semantic edge weight is used for forcibly synthesizing a space gradient of an optical flow field to keep consistent with a reference flow field at the edge; and determining a pseudo depth sequence according to the semantic category, and executing hierarchical forward transformation and hole filling by using the synthetic optical flow to generate a target intermediate frame. According to the method, parameterized modeling and a gradient constraint mechanism are combined, the problems of structural deformation and obscured shielding edges in a rigid body large-displacement scene are solved, and the definition and structural integrity of a complementary frame picture are improved.

The present disclosure relates to the technical field of image processing. Provided in the embodiments of the present disclosure are a video super-resolution method and apparatus. The method comprises: separately decomposing into N image blocks the t-th image frame of a video to be subjected to super-resolution and a neighborhood image frame of the t-th image frame; generating N image block sequences, the images block in each image block sequence being respectively located at the same position of different image frames; computing motion parameters of each image block sequence, the motion parameters of the image block sequence comprising motion parameters between the image blocks of the adjacent image frames in the image block sequence; according to the motion parameters of each image block sequence, determining a super-resolution network model corresponding to each image block sequence; using the corresponding super-resolution network model to perform super-resolution on the image block of the t-th image frame in each image block sequence, so as to obtain super-resolution image blocks of the t-th image frame; and according to the super-resolution image blocks of the t-th image frame, generating a super-resolution image frame of the t-th image frame.

The invention relates to a non-standard JPEG (Joint Photographic Experts Group) coding processing method for dynamic code rate control. The method comprises the following steps: presetting a multi-frame joint image processing scene, obtaining an original reference image, and carrying out combined processing of boundary expansion and random bias addition to obtain a preprocessed reference image; dividing macro blocks for the preprocessed reference image, and distributing an independent coding parameter configuration space after verification and compliance; frequency domain conversion is executed according to a division result, an initial quantization parameter is calculated through an index model, and a dynamic quantization table is dynamically adjusted; executing non-standard entropy coding to obtain an indexed macro block coding code stream; combining the indexed code stream and a macro block division result to construct an index table containing a macro block serial number, an initial address and a code stream length; analyzing the code stream to obtain quantized data, and performing inverse quantization by using a dynamic quantization table to obtain spatial domain data; enabling the format of the reconstructed image to be consistent with that of the preprocessed reference image through reverse preprocessing, and performing real-time processing on the linkage input image to obtain a reconstructed reference image; and non-standard JPEG coding processing of dynamic code rate control is realized.

The invention discloses a video transmission and display control method and device, electronic equipment and a storage medium, the method is executed by a decoder, and the method comprises the following steps: determining system time matched with a video frame image according to the received video frame image, the system time being added when a shooting device encodes the video frame image; according to the matched system time of two adjacent video frame images, determining the frame interval time of the video frame images; and transmitting and displaying the video according to the frame interval time and the output frame rate of the decoder. According to the invention, the adaptability to shooting equipment with different frame rates can be improved, the fluency of video playing is ensured, and video playing lagging is avoided.

The application provides an arbitrary resolution HDMI prototype verification device and method, wherein a frame analysis unit analyzes received data packets and stores analyzed image data into a storage unit at a limited clock frequency, a frame extraction unit sequentially extracts each frame image data from the storage unit at a clock frequency corresponding to a corresponding resolution, when the frame extraction unit sequentially extracts previous frame image data, it is judged whether next frame image data is stored in the storage unit; if the next frame image data has been stored, the frame extraction unit extracts the next frame image data; if the next frame image data has not been stored, the frame extraction unit repeatedly extracts the previous frame image data until the next frame image data is stored; the frame extraction unit outputs the extracted image data and performs image display; through the above method, the clock frequency required by any resolution is matched with the limited clock frequency, and corresponding verification is completed.

The application discloses a chip and a display device. The chip comprises an image receiving module, an image display module and a frame rate synchronization module. The image receiving module is used for sending an input image to a frame buffer under the triggering of a vertical synchronization signal to store the input image in the frame buffer. The image display module is used for reading the input image stored in the frame buffer to obtain an output image for a display screen to display the output image. The frame rate synchronization module is used for determining a tearing position range corresponding to frame rates of the input image and the output image and determining a first reading position. The speed of the image display module reading the input image stored in the frame buffer is adjusted according to the first reading position and the tearing position range. Thus, the speed of the image display module reading the input image stored in the frame buffer is adjusted according to the first reading position and the tearing position range by the frame rate synchronization module, so that each frame of output image is continuous and the input image is synchronized with the output image under the premise of a single frame buffer.

An electronic device includes a display, and at least one processor. The at least one processor is configured to obtain an image; identify whether or not the luminance of the display equals to or is higher than a predetermined luminance; when the luminance of the display equals to or is higher than the predetermined luminance, identify the FPS of the image and the motion information of a scene of the image to be displayed by means of the display, and determine a refresh rate of the display based on the FPS of the image and the motion information of the scene; and, when the luminance of the display is lower than the predetermined luminance, determine a refresh rate corresponding to the FPS of the image as the refresh rate of the display, and display the scene of the image by means of the display based on the determined refresh rate.

A method for reading and writing frame images with multiple buffer blocks and a system are provided. In the system, when an input-fast mode is switched to an input-low mode, a read end decides whether to read a next buffer block according to a writing progress. If a write end does not change the buffer block to be written, the read end keeps reading the buffer block, and otherwise the read end selects a next buffer block to be read. In an instance that the read end is required to read the same frame image repeatedly, when the input-slow mode is switched to the input-fast mode, the write end decides whether to write a next buffer block according to a reading progress. The write end selects a next buffer block to be written with a next frame image if the read end already reads last buffer block.

The invention discloses frame interpolation based on optical flow to synchronize between sensors. In various examples, systems and methods are disclosed that perform motion detection, such as optical flow determination, across image frames to synchronize asynchronous frames with respect to a target time of the asynchronous frames. For example, an image frame from a sensor may be processed by an optical flow accelerator to detect a displacement across the image frame, and the displacement may be used to interpolate a modified frame at a target time. This may be used to perform data collection and combination operations, such as splicing and / or reconstruction. Synchronization may be performed according to sensor data from sensors such as cameras, LIDAR sensors, and / or RADAR sensors.

This application provides an image processing method and apparatus, and an electronic device, and belongs to the field of smart terminal technologies. The method includes: creating at least one second mesh layer if a real frame image includes a reconstructed region satisfying a first preset condition and / or a second preset condition, and drawing pixels of the reconstructed region at a first mesh layer and the at least one second mesh layer respectively based on a reconstruction attribute of the reconstructed region. In this way, regardless of how complex a geometric edge of a discontinuous image region is, pixels having different attributes in the discontinuous image region can be respectively drawn at different mesh layers in a mesh reconstruction manner, to ensure that a pixel region in each mesh is a continuous pixel region.

A dynamic image display device includes a hardware processor and a display. The hardware processor acquires a first dynamic image captured at a first frame rate and a second dynamic image captured at a second frame rate lower than the first frame rate, and generates an interpolation image between each frame image of the second dynamic image and increases a frame rate of the second dynamic image. The display that displays the first dynamic image and the second dynamic image that includes the interpolation image in a comparable manner.

An image processing method for a video processor includes receiving a first input frame at a first time instant, receiving a second input frame at a second time instant, and creating an interpolated frame. When no input frame is received at a third time instant, the interpolated frame is generated using extrapolation according to the first and second input frames. When a third input frame is received at the third time instant, the interpolated frame is generated using interpolation according to the second and third input frames. The video playback smoothness can be improved by dynamically switching between extrapolation and interpolation.

The invention provides a remote sensing time sequence frame completion method based on a joint embedded prediction architecture and a diffusion model, and the method comprises the steps: collecting a first time sequence remote sensing data set, and carrying out the data preprocessing, the first time sequence remote sensing data set being a training data set; carrying out representation learning on the preprocessed time sequence remote sensing data set based on the joint embedded prediction architecture model so as to extract target features; inputting the target features into the constructed diffusion model to train the diffusion model, and obtaining a double-component model comprising a joint embedded prediction architecture and the diffusion model; and collecting a second time sequence remote sensing data set, and inputting the second time sequence remote sensing data set into the double-component model to obtain a target intermediate frame so as to complete the remote sensing time sequence frame of the second time sequence remote sensing data set. The invention further provides a remote sensing time sequence frame complementing device and equipment based on the joint embedded prediction architecture and the diffusion model.

A CMS includes a camera mounted to a commercial vehicle. The camera is configured to provide a video feed of an external environment of the commercial vehicle. The CMS includes an electronic control unit (ECU) that includes processing circuitry operatively connected to memory. The processing circuitry is configured to receive the video feed from the camera over a wired interface, and the video feed is serialized. The processing circuitry is configured to deserialize the video feed according to a first low-voltage differential signaling (LVDS) standard based on the video feed being serialized according to the first LVDS standard, and deserialize the video feed according to a second LVDS standard based on the video feed being serialized according to the second LVDS standard. A method for a camera monitor system (CMS) is also disclosed.

The invention discloses a movie frame insertion method, system and device, a medium and a product, and relates to the field of movie frame insertion, and the method comprises the steps: taking a high-frame-rate video in an RGB color space as training data, training a video frame insertion model, determining the trained video frame insertion model, estimating the motion of an input low-frame-rate video frame, and determining the motion of the input low-frame-rate video frame; determining a frame insertion result; inputting the low-frame-rate video frame and the frame insertion result into a color correction module, correcting the frame insertion result in a color space random disturbance mode, and determining a final frame insertion result; and the color correction module is used as a post-processing module of frame insertion and is used for enhancing a video frame insertion algorithm under the condition that parameters of the trained video frame insertion model are kept unchanged, and randomly converting RGB data into different color spaces during training, so that the RGB data can correct frame insertion negative effects of the different color spaces, and the frame insertion negative effects of the different color spaces can be corrected. And negative effects such as color shift caused by a color space during final playing can be avoided.

The application belongs to the technical field of image processing, and particularly relates to a binocular camera low-delay synchronization method, which comprises the following steps: establishing data queues for a main-view acquisition stream and an auxiliary-view acquisition stream respectively, and acquiring acquisition frames with acquisition time identifiers from the data queues; taking the acquisition time identifier of an acquisition frame in the main-view acquisition stream as a unified target time; and based on at least two acquisition frames in the auxiliary-view acquisition stream within the neighborhood of the unified target time, generating a re-projected auxiliary-view frame at the unified target time by executing a cross-view stream time re-projection algorithm; taking the acquisition frame in the main-view acquisition stream as a reference acquisition frame, and outputting the reference acquisition frame and the re-projected auxiliary-view frame together to form a pair of time frame pairs. The application not only improves the synchronization accuracy and stability under low-delay conditions, but also reduces hardware dependence and storage overhead, and has the advantages of strong real-time performance, high adaptability, simple implementation and good scalability.