156 results about "Macroblock" patented technology

The invention relates to the technical field of computer video processing, and discloses a low-delay video stream real-time processing method and device, and the method comprises the steps: obtaining original video stream data, and processing the original video stream data through employing a lightweight motion prediction method; processing the macro block data set and the predicted coding configuration parameter by adopting multi-thread assembly line coding to obtain a coded data block; establishing a data transmission mechanism to perform data flow control on the unified memory access interface; a heterogeneous task scheduling strategy is adopted to distribute task division results; a lightweight neural network is adopted to carry out parameter adaptive adjustment, and an optimized video stream processing result is obtained; according to the method, a zero-copy data transmission technology is adopted, and optimal configuration and efficient utilization of computing resources are achieved.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention relates to the technical field of industrial visual intelligence, in particular to an intelligent image selection and switching system fusing visual features and quality scores, which comprises the following steps: receiving multiple paths of video coding streams, inter-frame motion vectors and camera parameters; generating a macro block activeness distribution map based on the video coding stream and the inter-frame motion vector, and performing local window positioning and feature reconstruction on the video coding stream to generate an enhanced video vector; calculating a confidence coefficient mean value and a consistency score of the video coding stream according to the enhanced video vector, and fusing the confidence coefficient mean value and the consistency score with a channel transmission signal-to-noise ratio and a quantization noise increment to generate a video quality score; constructing a multi-criterion optimization model, and setting a feature representation vector for the multi-criterion optimization model; mapping the viewpoint weight based on the inner product of the feature representation vector, and calculating with the video quality score to generate a video switching score; and performing priority ranking based on the video switching score, and triggering a mapping switching instruction. And realizing video image scheduling by fusing the visual features and the quality score.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

A signed video bitstream obtained by prediction coding of a video sequence includes data units and associated signature units, wherein each data unit represents at most one macroblock in a video frame of the video sequence, and each signature unit includes a digital signature of a bitstring derived from fingerprints of exactly one associated data unit each. The bitstream is edited by: receiving a request to substitute a region; determining a first set of macroblocks, in which said region is contained, and a second set of macroblocks referring to macroblocks in the first set; adding an archive object that includes fingerprints of a first and a second set of data units, which represent the first and second set of macroblocks; editing the first set of data units in accordance with the request to substitute; and re-encoding the second set of data units.

A method for performing Tile to Raster (T2R) conversion includes: receiving tile input data including a stream of a plurality of tiles each having a tile height, a tile input width, a macroblock width (MBW), and data bits; segmenting the tile input data based on a total number of virtual square tiles; segmenting a Tile Buffer (TB) into one or more of the virtual square tiles based on the received tile input data; and performing a raster-scanning operation on each of the segmented tile input data and the segmented TB based on the total number of virtual square tiles to generate raster data.

The application relates to the technical field of digital video processing, and discloses a video stream block time evidence watermarking method based on time authentication, which comprises the following steps: receiving a continuous video code stream and dividing the video code stream into multiple continuous video blocks, extracting video coding layer data of the first video block, performing a hash operation to generate a reference hash value; sending the reference hash value to a time watermarking device, performing a digital signature operation on the reference hash value in combination with an absolute timestamp and a signature key to generate a digital signature; intercepting a bit segment from the digital signature as a characteristic sequence to form cascade digest data; and modulating preset macro block syntax elements of the first frame of the next video block by using the cascade digest data, and outputting reconstructed video coding layer data. The method effectively reduces processor occupation and memory consumption of the system, enables video content to meet real-time transmission requirements in a monitoring scene while guaranteeing time sequence and data anti-fake capability.

The invention relates to a 3D Gaussian rendering acceleration method and device, and belongs to the technical field of three-dimensional image rendering, a rendering assembly line with an ellipse as the center is constructed, and the method comprises four stages of projection, hierarchical sorting, self-adaptive blocking and ellipse center rasterization; in the projection stage, a contracted axis alignment bounding box is calculated for each projected Gaussian ellipse, and the coverage area of the bounding box is adaptively adjusted by combining the opacity of Gaussian; in the hierarchical sorting stage, a hierarchical sorting strategy similar to GScore is adopted on larger macro block granularity; in the self-adaptive blocking stage, an elliptical bounding box is used as a boundary to dynamically divide the bounding box; in the rasterization stage, all pixels intersecting with the Gaussian ellipse are processed elliptically one by one, once one ellipse is loaded to an on-chip buffer area, all pixels covered by the ellipse are processed, and it is ensured that data of each Gaussian ellipse only needs to be loaded once from an off-chip memory.

The embodiment of the application discloses a kind of based on wavefront parallel processing to the method, device, storage medium and computer equipment of image H.264 encoding, it is related to image processing field.The application is processed adjacent macroblock line by double encoder parallelly, and respectively first buffer and second buffer are written to encoding bit stream.In macroblock line encoding completion, first buffer remaining bit stream and entropy encoding remaining bit stream are merged in real time, if the length after merging is less than 8 integer multiples, then appropriate bit stream is dynamically taken from the head of second buffer and spliced, complete code stream in line with H.264 standard is generated and outputed.After encoding is completed, the minimum splicing length is used as the offset of second buffer, continue to output byte stream, and the encoding of next macroblock line is started.The application only needs double macroblock line buffer, significantly improves the encoding speed, reduces memory occupation, and does not need to modify decoder, and compatibility is strong.

The present application relates to the technical field of image processing, and more particularly to a video decoding and Unreal Engine rendering method based on GPU full-link zero-copy, which comprises the following steps: step one, hardware decoding of an input video code stream on a GPU, and construction of a motion vector description buffer for storing compressed domain motion vector information in macroblock order; step two, reading of the motion vector description buffer by a calculation shader on the GPU to generate a dynamic special effect control buffer corresponding to each macroblock; and step three, in the post-processing material of the Unreal Engine rendering module, taking a shared video texture resource as an input texture and outputting a video picture. The present application realizes unified management of pixel data and motion data without relying on a host processor and without excessively occupying video memory bandwidth, significantly reduces delay, and improves special effect stability and direction consistency.

The invention relates to a non-standard JPEG (Joint Photographic Experts Group) coding processing method for dynamic code rate control. The method comprises the following steps: presetting a multi-frame joint image processing scene, obtaining an original reference image, and carrying out combined processing of boundary expansion and random bias addition to obtain a preprocessed reference image; dividing macro blocks for the preprocessed reference image, and distributing an independent coding parameter configuration space after verification and compliance; frequency domain conversion is executed according to a division result, an initial quantization parameter is calculated through an index model, and a dynamic quantization table is dynamically adjusted; executing non-standard entropy coding to obtain an indexed macro block coding code stream; combining the indexed code stream and a macro block division result to construct an index table containing a macro block serial number, an initial address and a code stream length; analyzing the code stream to obtain quantized data, and performing inverse quantization by using a dynamic quantization table to obtain spatial domain data; enabling the format of the reconstructed image to be consistent with that of the preprocessed reference image through reverse preprocessing, and performing real-time processing on the linkage input image to obtain a reconstructed reference image; and non-standard JPEG coding processing of dynamic code rate control is realized.

Embodiments of the present application provide a video processing method, device and electronic equipment, relating to the field of artificial intelligence, the video processing method is applied to a pre-trained video processing model, comprising: extracting a spatio-temporal feature of a video frame; the video frame comprises a current frame to be processed and a reference frame adjacent to the current frame; the spatio-temporal feature comprises a dynamic foreground feature, a noise level feature and a coding mode feature; the coding mode feature is used to represent the coding mode of each macroblock of the corresponding video frame; fusing the spatio-temporal feature of the current frame and the spatio-temporal feature of the reference frame to obtain a target spatio-temporal feature of the current frame; determining a filtering mode corresponding to the current frame according to the target spatio-temporal feature, and filtering the current frame based on the filtering mode. The present application can protect and retain the key information in the video, which is beneficial to more accurately and completely remove the noise and spatio-temporal redundancy in the video.

This application discloses a method, apparatus, device, and medium for scene switching detection using an x264 encoder for vertical short-form video, relating to the field of video coding technology. The method includes: dividing the vertical screen of a target video frame into target gradient regions using a preset gradient weighting strategy, and assigning weight coefficients to macroblocks in each target gradient region; downsampling the target video frame and calculating the SATD value of each macroblock based on the processed frame data; the SATD value includes the luminance component and chrominance component SATD values; determining the weighted cost value of each macroblock according to a preset weighted cost calculation formula and using the SATD value and weight coefficients to determine the full-frame cost of the target video frame; including a first full-frame cost when the target video frame is a P-frame and a second full-frame cost when it is an I-frame; determining the scene switching score of the target video frame through the full-frame cost, and determining whether the target video frame meets the preset scene switching conditions based on the scene switching score.

The invention relates to the technical field of image processing, in particular to a dynamic scene adaptive exposure regulation and control method for a visible light imaging product, which comprises the following steps: acquiring a motion vector of each macro block in a current frame image from a previous frame image to the current frame image; predicting a prediction position of each macro block in the next frame of image based on the motion vector; calculating the predicted brightness increment of each macro block according to the current brightness value of each macro block in the current frame image and the reference brightness value of each macro block at the predicted position in the next frame image; dividing the current frame image into a plurality of exposure regulation and control regions, and aggregating the predicted brightness increment of the macro block covered by each exposure regulation and control region to obtain the regional brightness increment of the exposure regulation and control region; when the regional brightness increment of any exposure regulation and control region exceeds a preset threshold value, executing an exposure moment determination process for any exposure regulation and control region; and in the exposure period of the next frame of image, performing line-level exposure termination based on the independent exposure termination time of each related pixel line through the time schedule controller.

The application discloses a kind of interframe macroblock motion vector determination method and device based on neural network, it is related to video processing technical field, wherein, the method includes: using improved U2net neural network to carry out semantic segmentation to video frame, determine the foreground area and background area in video frame, based on reference object in foreground area or background area, using depth local feature search network analysis video key feature sequence before and after frame, and based on key feature sequence determines target search area, depth local feature search network has fused time series neural network based on bidirectional long short-term memory network, carries out encoder interframe macroblock motion vector analysis strategy in target search area, determines the macroblock motion vector in target search area.The present application solves the technical problem that in the related art, in the video frame encoding process, using local feature to carry out MV prediction easily leads to improper search range selection, which affects the prediction accuracy.

The invention provides an image coding method and related equipment, and relates to the field of image processing, and the method comprises the steps: determining whether a target object in a current frame starts to move regularly or not; if yes, closing global motion vector detection, and predicting the position and the motion vector of the matched macro block in the next frame by using the long-term motion speed; wherein the long-term motion speed is obtained from the historical value of the long-term motion speed and the short-term motion speed, and the short-term motion speed is used for representing the motion vector of the matched macro block in the previous frame. According to the scheme, the coding efficiency can be improved in a screen content coding scene, and the coding computing power overhead is reduced.

The invention discloses a concurrent implementation method of motion vector search, which relates to the technical field of H264 video compression implementation, and comprises the following steps of: judging whether a current macro block meets a condition of becoming a PSKIP macro block according to PSKIP macro block type information of a block adjacent to the current macro block, if the current macro block is judged to be in a PSKIP macro block type, ending search, and otherwise, entering the next step; under the assumption that the partitioning mode is a P16 * 16 partitioning mode, taking a pskipmv variable value obtained by predicting an adjacent block of the current macro block as a prediction vector value of the current macro block, and calculating and judging whether the type of the current macro block is a PSKIP macro block type or not; and when the judgment result does not meet the condition of the PSKIP macro block, carrying out parallel search processing, and carrying out concurrent motion vector search in different blocking modes. Under the condition that a small number of code rates are increased, the compression speed is greatly increased, and the method is more suitable for the use scene of real-time video compression.

A method for performing content-based video compression using reinforcement learning (RL) is provided. The method includes obtaining frame information associated with a frame from a video. The frame information comprises quantization parameter (QP) information associated with the frame, and the QP information indicates an initial compression level for encoding aspects of the frame. The frame information and additional information are processed by an RL agent to generate a generated QP map indicating a plurality of updated values associated with a plurality of macro-blocks (MBs) of the frame. A bitstream is generated comprising a plurality of bits for the frame based on the generated QP map. Specifically, the plurality of updated values from the generated QP map indicates an amount of allocated bits from the bitstream to allocate for each of the plurality of MBs. The bitstream is provided to a downstream model.

The invention discloses a three-dimensional chip thermal perception optimization method based on tensor data flow, and relates to the field of integrated circuits, and the method comprises the steps: firstly, starting from the angle of tensor data flow, providing a collaborative thermal optimization process combining a network, an architecture, physics and packaging; then, based on a quantitative modeling tensor data flow energy optimization method, automatically identifying the most energy-saving tensor data flow under given three-dimensional chip constraints by using a heuristic optimization method; and finally, providing a thermal sensing three-dimensional architecture spatial layout method, simplifying the spatial layout problem of the SRAM macro block into an affine mapping optimization problem, and optimizing an affine mapping relationship through a heuristic optimization method to obtain the spatial layout with optimal thermal performance. According to the method, the tensor calculation characteristics are optimized in a targeted manner, so that the three-dimensional stacked SRAM chip meets the thermal reliability requirement in a high-density integration scene.

The embodiment of the invention discloses a coding and decoding method, a code stream, a coder, a decoder and a storage medium, and the method comprises the steps: decoding the code stream, and determining a value of first syntax element information and a value of at least one piece of second syntax element information; wherein the first syntax element information is used for indicating the number of bits occupied by the point value of the current macro block, the ith second syntax element information is used for indicating the ith bit corresponding to the point value of the current macro block, and i is an integer greater than or equal to 0 and less than the value of the first syntax element information; and determining a point value of the current macro block according to the value of the first syntax element information and the value of the at least one piece of second syntax element information. Therefore, the coding and decoding efficiency can be improved.

Example systems, apparatus, articles of manufacture, and methods to implement hardware-accelerated intra frame encoding are disclosed. Example hardware-accelerated intra frame video encoders disclosed herein are VC3 compliant. Some example video encoders disclosed herein quantize alternating current (AC) coefficients of a macroblock of an input image frame using a small set of anchor quantization scale factors (QSFs), and interpolate between the resulting bit counts for the first anchor QSFs to determine an estimated QSF meets a target bit budget. Some example video encoders disclosed herein perform bit coding with a round-robin packing strategy that distributes the packing of encoded symbols among macroblocks and discards excess symbols to avoid exceeding the specified frame size. Some example video encoders disclosed herein are configurable via control circuitry and / or a driver that selects target bit budgets, anchor QSFs, encoding modes, etc., thereby enabling single or multi pass operation and adjustable performance versus quality trade-offs.

The present invention includes obtaining block type identification information on a partition of the current macroblock when the current macroblock is intra-mixed, specifying a bock type of the current macroblock based on the block type identification information, obtaining an intra prediction mode of the current macroblock according to the block type of the partition of the current macroblock, and predicting the current macroblock using the intra prediction mode and a pixel value of a neighboring block.

The present invention discloses a video processing method, apparatus, and device. The method comprises: obtaining a macroblock weighting factor for adjusting the brightness of each frame in a frame sequence of a video stream in a current scene; the frame comprises multiple macroblocks; and adjusting the brightness of each frame in the frame sequence based on the macroblock weighting factor. By doing so, the present invention can reduce flickering or jittering caused by the pre-processing of video content transcoding.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

The application discloses a hardware-implemented H264 macroblock-level code rate control method, which comprises the following steps: using a five-stage pipeline to implement H264 hardware coding, specifically, IME module, FME module, IPTQ module, DBK module, EE module and WBK module are used; and the hardware-implemented macroblock-level code rate control method mainly comprises the following steps: when calculating a macroblock quantization parameter QP, the calculation is divided into two stages, coarse quantization parameter coarse_qp is calculated through texture information of the macroblock, and the value is only used for the IME module and the FME module; after the macroblock type of the macroblock is determined, the mad value of the macroblock can be obtained, and the macroblock quantization parameter mb_qp is recalculated according to the mad value of the macroblock, and the value is used for operation and processing of the IPTQ module, the DBK module and the EE module. The method avoids complex macroblock quantization parameter QP calculation in the JVT-G012 algorithm, and the algorithm is simple and easy to implement in hardware.

The present invention relates to the field of video processing technology, and provides a video encoding method, device, electronic device, and storage medium. The method comprises: first determining the target area where the target object is located in the video frame to be processed, and determining the positional relationship between all its macroblocks and the target area; then obtaining the two-dimensional heat information of the previous video frame of the video frame to be processed from the three-dimensional heat information to obtain reference two-dimensional heat information; then obtaining the two-dimensional heat information of the video frame to be processed based on the positional relationship and the reference two-dimensional heat information, and updating it to the three-dimensional heat information; finally, determining the quantization parameter value of each macroblock in the video frame to be processed based on the positional relationship and the two-dimensional heat information of the video frame to be processed, and encoding the video frame to be processed according to the quantization parameter value of each macroblock in the video frame to be processed. This achieves the rational allocation of encoding resources and improves the adaptability of video encoding to dynamically changing scenes.

The invention relates to a high-compression-ratio low-cost image compression method, which comprises the following steps of: segmenting an input image into macro blocks with the height of 2 and the width of 128 or 256, and converting RGB (Red, Green, Blue) to YUV (Yttrium, Ultraviolet) to reduce component correlation; the macro block is pre-coded, and a pre-coding bit number is obtained through up-sampling, vertical Haar wavelet transformation, horizontal transformation, quantization and entropy coding; calculating an optimal quantization parameter based on the precoding bit number to realize code rate control; and formally coding according to the optimal parameter, updating the buffer and outputting a code stream. According to the method, through multi-stage transformation and dynamic quantization control, the high compression ratio is achieved, vision is lossless, the algorithm is simple, the hardware implementation cost is low, the method is suitable for multiple platforms, and the scene requirements of ultra-high-definition videos and the like are met.

The application relates to the technical field of video compression, in particular to a monitoring video efficient compression method and system for intelligent monitoring, which comprises the following steps: performing visual identification on a first monitoring video to obtain a region for identifying a preset monitoring target in a video frame, analyzing visual identification information to obtain a target change probability of each pixel point in each video frame; and adjusting the size of a plurality of initial macroblocks corresponding to each video frame respectively according to the target change probability, to obtain a plurality of adjusted macroblocks corresponding to each video frame, and then performing video compression on the plurality of video frames according to the adjusted macroblocks to obtain a second monitoring video; the target change probability and the size of the adjusted macroblock covering the corresponding pixel point are in a negative correlation relationship. Through the adjustment of the macroblocks, the definition of the region corresponding to the preset monitoring target can be improved.

The invention belongs to the technical field of data processing, and particularly relates to a security and protection monitoring data compression and transmission method and system based on edge end intelligent analysis, so as to solve the technical problems that a linear adjustment mechanism has response lag and is easy to lose packets and image quality oscillation is caused by QP value jump in a security and protection emergency scene. The method comprises the following steps: collecting the number of bytes occupied by a current network sending buffer area of edge computing equipment, and macro block motion vectors of a current frame and a previous frame at the front end of a video encoder; calculating a scene data potential energy index representing data explosion pressure in a future short time; constructing a nonlinear response gain by using an exponential function, wherein the nonlinear response gain is in nonlinear change along with the scene data potential energy index; and calculating and updating a quantization parameter of the current frame, and performing video data compression transmission based on the updated quantization parameter. According to the invention, the transmission quality of security and protection monitoring data and the system stability are ensured.

The present invention discloses a motion vector domain video steganalysis method based on skipped macroblocks, comprising: extracting first-category features of the skipped macroblocks by employing a recompression calibration method to obtain predicted motion vector recovery features of the skipped macroblocks; extracting second-category features of the skipped macroblocks by employing a recompression calibration method to obtain state transition probability features of the skipped macroblocks; and merging features by merging the predicted motion vector recovery features and state transition probability features of the skipped macroblocks to obtain comprehensive video steganalysis features of the skipped macroblocks. The motion vector domain video steganalysis method based on skipped macroblocks of the present invention extracts and merges predicted motion vector recovery features and state transition probability features of the skipped macroblocks through recompression calibration to improve the correct detection rate of steganalysis.