98 results about "Macroblock" patented technology

The invention relates to the technical field of computer video processing, and discloses a low-delay video stream real-time processing method and device, and the method comprises the steps: obtaining original video stream data, and processing the original video stream data through employing a lightweight motion prediction method; processing the macro block data set and the predicted coding configuration parameter by adopting multi-thread assembly line coding to obtain a coded data block; establishing a data transmission mechanism to perform data flow control on the unified memory access interface; a heterogeneous task scheduling strategy is adopted to distribute task division results; a lightweight neural network is adopted to carry out parameter adaptive adjustment, and an optimized video stream processing result is obtained; according to the method, a zero-copy data transmission technology is adopted, and optimal configuration and efficient utilization of computing resources are achieved.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention relates to the technical field of industrial visual intelligence, in particular to an intelligent image selection and switching system fusing visual features and quality scores, which comprises the following steps: receiving multiple paths of video coding streams, inter-frame motion vectors and camera parameters; generating a macro block activeness distribution map based on the video coding stream and the inter-frame motion vector, and performing local window positioning and feature reconstruction on the video coding stream to generate an enhanced video vector; calculating a confidence coefficient mean value and a consistency score of the video coding stream according to the enhanced video vector, and fusing the confidence coefficient mean value and the consistency score with a channel transmission signal-to-noise ratio and a quantization noise increment to generate a video quality score; constructing a multi-criterion optimization model, and setting a feature representation vector for the multi-criterion optimization model; mapping the viewpoint weight based on the inner product of the feature representation vector, and calculating with the video quality score to generate a video switching score; and performing priority ranking based on the video switching score, and triggering a mapping switching instruction. And realizing video image scheduling by fusing the visual features and the quality score.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

A method for performing Tile to Raster (T2R) conversion includes: receiving tile input data including a stream of a plurality of tiles each having a tile height, a tile input width, a macroblock width (MBW), and data bits; segmenting the tile input data based on a total number of virtual square tiles; segmenting a Tile Buffer (TB) into one or more of the virtual square tiles based on the received tile input data; and performing a raster-scanning operation on each of the segmented tile input data and the segmented TB based on the total number of virtual square tiles to generate raster data.

The application relates to the technical field of digital video processing, and discloses a video stream block time evidence watermarking method based on time authentication, which comprises the following steps: receiving a continuous video code stream and dividing the video code stream into multiple continuous video blocks, extracting video coding layer data of the first video block, performing a hash operation to generate a reference hash value; sending the reference hash value to a time watermarking device, performing a digital signature operation on the reference hash value in combination with an absolute timestamp and a signature key to generate a digital signature; intercepting a bit segment from the digital signature as a characteristic sequence to form cascade digest data; and modulating preset macro block syntax elements of the first frame of the next video block by using the cascade digest data, and outputting reconstructed video coding layer data. The method effectively reduces processor occupation and memory consumption of the system, enables video content to meet real-time transmission requirements in a monitoring scene while guaranteeing time sequence and data anti-fake capability.

The invention relates to a 3D Gaussian rendering acceleration method and device, and belongs to the technical field of three-dimensional image rendering, a rendering assembly line with an ellipse as the center is constructed, and the method comprises four stages of projection, hierarchical sorting, self-adaptive blocking and ellipse center rasterization; in the projection stage, a contracted axis alignment bounding box is calculated for each projected Gaussian ellipse, and the coverage area of the bounding box is adaptively adjusted by combining the opacity of Gaussian; in the hierarchical sorting stage, a hierarchical sorting strategy similar to GScore is adopted on larger macro block granularity; in the self-adaptive blocking stage, an elliptical bounding box is used as a boundary to dynamically divide the bounding box; in the rasterization stage, all pixels intersecting with the Gaussian ellipse are processed elliptically one by one, once one ellipse is loaded to an on-chip buffer area, all pixels covered by the ellipse are processed, and it is ensured that data of each Gaussian ellipse only needs to be loaded once from an off-chip memory.

The embodiment of the application discloses a kind of based on wavefront parallel processing to the method, device, storage medium and computer equipment of image H.264 encoding, it is related to image processing field.The application is processed adjacent macroblock line by double encoder parallelly, and respectively first buffer and second buffer are written to encoding bit stream.In macroblock line encoding completion, first buffer remaining bit stream and entropy encoding remaining bit stream are merged in real time, if the length after merging is less than 8 integer multiples, then appropriate bit stream is dynamically taken from the head of second buffer and spliced, complete code stream in line with H.264 standard is generated and outputed.After encoding is completed, the minimum splicing length is used as the offset of second buffer, continue to output byte stream, and the encoding of next macroblock line is started.The application only needs double macroblock line buffer, significantly improves the encoding speed, reduces memory occupation, and does not need to modify decoder, and compatibility is strong.

The present application relates to the technical field of image processing, and more particularly to a video decoding and Unreal Engine rendering method based on GPU full-link zero-copy, which comprises the following steps: step one, hardware decoding of an input video code stream on a GPU, and construction of a motion vector description buffer for storing compressed domain motion vector information in macroblock order; step two, reading of the motion vector description buffer by a calculation shader on the GPU to generate a dynamic special effect control buffer corresponding to each macroblock; and step three, in the post-processing material of the Unreal Engine rendering module, taking a shared video texture resource as an input texture and outputting a video picture. The present application realizes unified management of pixel data and motion data without relying on a host processor and without excessively occupying video memory bandwidth, significantly reduces delay, and improves special effect stability and direction consistency.

The invention relates to a non-standard JPEG (Joint Photographic Experts Group) coding processing method for dynamic code rate control. The method comprises the following steps: presetting a multi-frame joint image processing scene, obtaining an original reference image, and carrying out combined processing of boundary expansion and random bias addition to obtain a preprocessed reference image; dividing macro blocks for the preprocessed reference image, and distributing an independent coding parameter configuration space after verification and compliance; frequency domain conversion is executed according to a division result, an initial quantization parameter is calculated through an index model, and a dynamic quantization table is dynamically adjusted; executing non-standard entropy coding to obtain an indexed macro block coding code stream; combining the indexed code stream and a macro block division result to construct an index table containing a macro block serial number, an initial address and a code stream length; analyzing the code stream to obtain quantized data, and performing inverse quantization by using a dynamic quantization table to obtain spatial domain data; enabling the format of the reconstructed image to be consistent with that of the preprocessed reference image through reverse preprocessing, and performing real-time processing on the linkage input image to obtain a reconstructed reference image; and non-standard JPEG coding processing of dynamic code rate control is realized.

Embodiments of the present application provide a video processing method, device and electronic equipment, relating to the field of artificial intelligence, the video processing method is applied to a pre-trained video processing model, comprising: extracting a spatio-temporal feature of a video frame; the video frame comprises a current frame to be processed and a reference frame adjacent to the current frame; the spatio-temporal feature comprises a dynamic foreground feature, a noise level feature and a coding mode feature; the coding mode feature is used to represent the coding mode of each macroblock of the corresponding video frame; fusing the spatio-temporal feature of the current frame and the spatio-temporal feature of the reference frame to obtain a target spatio-temporal feature of the current frame; determining a filtering mode corresponding to the current frame according to the target spatio-temporal feature, and filtering the current frame based on the filtering mode. The present application can protect and retain the key information in the video, which is beneficial to more accurately and completely remove the noise and spatio-temporal redundancy in the video.

This application discloses a method, apparatus, device, and medium for scene switching detection using an x264 encoder for vertical short-form video, relating to the field of video coding technology. The method includes: dividing the vertical screen of a target video frame into target gradient regions using a preset gradient weighting strategy, and assigning weight coefficients to macroblocks in each target gradient region; downsampling the target video frame and calculating the SATD value of each macroblock based on the processed frame data; the SATD value includes the luminance component and chrominance component SATD values; determining the weighted cost value of each macroblock according to a preset weighted cost calculation formula and using the SATD value and weight coefficients to determine the full-frame cost of the target video frame; including a first full-frame cost when the target video frame is a P-frame and a second full-frame cost when it is an I-frame; determining the scene switching score of the target video frame through the full-frame cost, and determining whether the target video frame meets the preset scene switching conditions based on the scene switching score.

The invention relates to the technical field of image processing, in particular to a dynamic scene adaptive exposure regulation and control method for a visible light imaging product, which comprises the following steps: acquiring a motion vector of each macro block in a current frame image from a previous frame image to the current frame image; predicting a prediction position of each macro block in the next frame of image based on the motion vector; calculating the predicted brightness increment of each macro block according to the current brightness value of each macro block in the current frame image and the reference brightness value of each macro block at the predicted position in the next frame image; dividing the current frame image into a plurality of exposure regulation and control regions, and aggregating the predicted brightness increment of the macro block covered by each exposure regulation and control region to obtain the regional brightness increment of the exposure regulation and control region; when the regional brightness increment of any exposure regulation and control region exceeds a preset threshold value, executing an exposure moment determination process for any exposure regulation and control region; and in the exposure period of the next frame of image, performing line-level exposure termination based on the independent exposure termination time of each related pixel line through the time schedule controller.

The application discloses a kind of interframe macroblock motion vector determination method and device based on neural network, it is related to video processing technical field, wherein, the method includes: using improved U2net neural network to carry out semantic segmentation to video frame, determine the foreground area and background area in video frame, based on reference object in foreground area or background area, using depth local feature search network analysis video key feature sequence before and after frame, and based on key feature sequence determines target search area, depth local feature search network has fused time series neural network based on bidirectional long short-term memory network, carries out encoder interframe macroblock motion vector analysis strategy in target search area, determines the macroblock motion vector in target search area.The present application solves the technical problem that in the related art, in the video frame encoding process, using local feature to carry out MV prediction easily leads to improper search range selection, which affects the prediction accuracy.

The invention provides an image coding method and related equipment, and relates to the field of image processing, and the method comprises the steps: determining whether a target object in a current frame starts to move regularly or not; if yes, closing global motion vector detection, and predicting the position and the motion vector of the matched macro block in the next frame by using the long-term motion speed; wherein the long-term motion speed is obtained from the historical value of the long-term motion speed and the short-term motion speed, and the short-term motion speed is used for representing the motion vector of the matched macro block in the previous frame. According to the scheme, the coding efficiency can be improved in a screen content coding scene, and the coding computing power overhead is reduced.

The invention discloses a concurrent implementation method of motion vector search, which relates to the technical field of H264 video compression implementation, and comprises the following steps of: judging whether a current macro block meets a condition of becoming a PSKIP macro block according to PSKIP macro block type information of a block adjacent to the current macro block, if the current macro block is judged to be in a PSKIP macro block type, ending search, and otherwise, entering the next step; under the assumption that the partitioning mode is a P16 * 16 partitioning mode, taking a pskipmv variable value obtained by predicting an adjacent block of the current macro block as a prediction vector value of the current macro block, and calculating and judging whether the type of the current macro block is a PSKIP macro block type or not; and when the judgment result does not meet the condition of the PSKIP macro block, carrying out parallel search processing, and carrying out concurrent motion vector search in different blocking modes. Under the condition that a small number of code rates are increased, the compression speed is greatly increased, and the method is more suitable for the use scene of real-time video compression.

A method for performing content-based video compression using reinforcement learning (RL) is provided. The method includes obtaining frame information associated with a frame from a video. The frame information comprises quantization parameter (QP) information associated with the frame, and the QP information indicates an initial compression level for encoding aspects of the frame. The frame information and additional information are processed by an RL agent to generate a generated QP map indicating a plurality of updated values associated with a plurality of macro-blocks (MBs) of the frame. A bitstream is generated comprising a plurality of bits for the frame based on the generated QP map. Specifically, the plurality of updated values from the generated QP map indicates an amount of allocated bits from the bitstream to allocate for each of the plurality of MBs. The bitstream is provided to a downstream model.

The invention discloses a three-dimensional chip thermal perception optimization method based on tensor data flow, and relates to the field of integrated circuits, and the method comprises the steps: firstly, starting from the angle of tensor data flow, providing a collaborative thermal optimization process combining a network, an architecture, physics and packaging; then, based on a quantitative modeling tensor data flow energy optimization method, automatically identifying the most energy-saving tensor data flow under given three-dimensional chip constraints by using a heuristic optimization method; and finally, providing a thermal sensing three-dimensional architecture spatial layout method, simplifying the spatial layout problem of the SRAM macro block into an affine mapping optimization problem, and optimizing an affine mapping relationship through a heuristic optimization method to obtain the spatial layout with optimal thermal performance. According to the method, the tensor calculation characteristics are optimized in a targeted manner, so that the three-dimensional stacked SRAM chip meets the thermal reliability requirement in a high-density integration scene.

The embodiment of the invention discloses a coding and decoding method, a code stream, a coder, a decoder and a storage medium, and the method comprises the steps: decoding the code stream, and determining a value of first syntax element information and a value of at least one piece of second syntax element information; wherein the first syntax element information is used for indicating the number of bits occupied by the point value of the current macro block, the ith second syntax element information is used for indicating the ith bit corresponding to the point value of the current macro block, and i is an integer greater than or equal to 0 and less than the value of the first syntax element information; and determining a point value of the current macro block according to the value of the first syntax element information and the value of the at least one piece of second syntax element information. Therefore, the coding and decoding efficiency can be improved.

Example systems, apparatus, articles of manufacture, and methods to implement hardware-accelerated intra frame encoding are disclosed. Example hardware-accelerated intra frame video encoders disclosed herein are VC3 compliant. Some example video encoders disclosed herein quantize alternating current (AC) coefficients of a macroblock of an input image frame using a small set of anchor quantization scale factors (QSFs), and interpolate between the resulting bit counts for the first anchor QSFs to determine an estimated QSF meets a target bit budget. Some example video encoders disclosed herein perform bit coding with a round-robin packing strategy that distributes the packing of encoded symbols among macroblocks and discards excess symbols to avoid exceeding the specified frame size. Some example video encoders disclosed herein are configurable via control circuitry and / or a driver that selects target bit budgets, anchor QSFs, encoding modes, etc., thereby enabling single or multi pass operation and adjustable performance versus quality trade-offs.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

The application discloses a hardware-implemented H264 macroblock-level code rate control method, which comprises the following steps: using a five-stage pipeline to implement H264 hardware coding, specifically, IME module, FME module, IPTQ module, DBK module, EE module and WBK module are used; and the hardware-implemented macroblock-level code rate control method mainly comprises the following steps: when calculating a macroblock quantization parameter QP, the calculation is divided into two stages, coarse quantization parameter coarse_qp is calculated through texture information of the macroblock, and the value is only used for the IME module and the FME module; after the macroblock type of the macroblock is determined, the mad value of the macroblock can be obtained, and the macroblock quantization parameter mb_qp is recalculated according to the mad value of the macroblock, and the value is used for operation and processing of the IPTQ module, the DBK module and the EE module. The method avoids complex macroblock quantization parameter QP calculation in the JVT-G012 algorithm, and the algorithm is simple and easy to implement in hardware.

The invention belongs to the technical field of data processing, and particularly relates to a security and protection monitoring data compression and transmission method and system based on edge end intelligent analysis, so as to solve the technical problems that a linear adjustment mechanism has response lag and is easy to lose packets and image quality oscillation is caused by QP value jump in a security and protection emergency scene. The method comprises the following steps: collecting the number of bytes occupied by a current network sending buffer area of edge computing equipment, and macro block motion vectors of a current frame and a previous frame at the front end of a video encoder; calculating a scene data potential energy index representing data explosion pressure in a future short time; constructing a nonlinear response gain by using an exponential function, wherein the nonlinear response gain is in nonlinear change along with the scene data potential energy index; and calculating and updating a quantization parameter of the current frame, and performing video data compression transmission based on the updated quantization parameter. According to the invention, the transmission quality of security and protection monitoring data and the system stability are ensured.

The embodiment of the present application provides a kind of video encoding method and device, parallel computing unit and electronic equipment.Therein, video encoding method includes: the data loading of all to-be-encoded macroblocks in the to-be-encoded area in to-be-encoded video frame is carried out;The prediction of all to-be-encoded macroblocks after loading is carried out, and corresponding prediction result is obtained;According to corresponding prediction result, the transform and quantization of residual data of all to-be-encoded macroblocks are carried out, and corresponding quantization result is obtained;The entropy coding and code stream writing of corresponding quantization result of all to-be-encoded macroblocks are carried out, and corresponding encoding code stream is obtained;Wherein, the operation of at least one step in the above four steps is executed in parallel for all to-be-encoded macroblocks.The method can significantly improve the video encoding efficiency, so that the method can be applied to some scenes with higher real-time requirements.

The invention relates to the technical field of video image compression, and provides a distributed courseware video resource transmission optimization method and system, and the method comprises the steps: uploading a courseware video, carrying out the fragmentation of the courseware video, and extracting courseware image frames in the fragmentation; dividing a macro block, and determining the knowledge point saliency of the macro block according to the position of the macro block in the courseware image frame, the gradient direction of pixel points in the macro block and the texture of the macro block; determining the ink change degree of the macro block according to the difference between the gradient amplitude and the gradient direction of the pixel points in the macro block and the clutter degree of the motion direction of the pixel points; and according to a weighted summation result of the knowledge point saliency and the ink change degree of the macro blocks, allocating code rates to all the macro blocks, obtaining fragments of the compressed courseware video, and performing distributed transmission on the fragments of the compressed courseware video. The definition of the image quality of the important content position in the courseware video can be ensured.

Systems, apparatus, articles of manufacture, and methods to perform parallel macroblock scan line decoding with error handling are disclosed. An example apparatus disclosed herein includes a first decoder circuit to decode a first macroblock scan line of an encoded video frame, the first decoder circuit to fetch the first macroblock scan line from memory based on a load balancing algorithm. The disclosed example apparatus also includes a second decoder circuit to decode a second macroblock scan line of the encoded video frame, the second macroblock scan line different from the first macroblock scan line, the second decoder circuit to fetch the second macroblock scan line from the memory based on the load balancing algorithm. In the disclosed example apparatus, the first decoder circuit is to decode the first macroblock scan line and the second decoder circuit is to decode the second macroblock scan line in parallel.

The invention relates to a self-adaptive robust video watermarking method based on H.264AVC video coding. The self-adaptive robust video watermarking method comprises the steps of preprocessing, watermark embedding and extracting. The method comprises the following steps: preprocessing: graying an image, carrying out integer discrete cosine transform and quantization processing on a gray value, then carrying out Z-shaped coefficient scanning, then carrying out data formula transformation and 4-bit unsigned binary coding conversion, and finally introducing an error correction coding link for improving the watermark data recovery capability. When a watermark is embedded, deterministic mapping from a macro block group to a bit is established in a key frame, and the same information is embedded in a distributed manner at different time points. During watermark extraction, a judgment method based on bit-level majority statistics is introduced so as to perform fusion processing on extraction results of the same watermark line in a plurality of key frames. According to the method, the overall performance of the watermarking system in the aspects of synchronism, robustness and invisibility can be improved.

The application discloses an image recognition method and device, electronic equipment and readable storage medium, and belongs to the technical field of image processing. The method comprises the following steps: acquiring encoding data of a target image, wherein the encoding data of the target image comprises encoding data of a plurality of macroblocks in the target image, the consumed information amount of any macroblock in the plurality of macroblocks during encoding processing is proportional to the texture complexity of the any macroblock, and the texture complexity of the any macroblock is related to the pixel value of each pixel point in the any macroblock; acquiring a contour image corresponding to the target image based on the encoding data of each macroblock, wherein the contour image is used for reflecting the contour of an object in the target image; and performing image recognition processing on the contour image to obtain an image recognition result. Since the encoding data of the target image does not need to be decoded to obtain the target image, a large amount of computing resources can be saved, and the image recognition efficiency is improved.

The present application relates to the technical field of image processing, and particularly relates to an image processing method, an electronic device and a readable storage medium, the image processing method comprises the following steps: fusing and blocking a current frame and a reference frame to obtain a plurality of to-be-encoded spatial image blocks, and combining the to-be-encoded spatial image blocks into a plurality of macroblocks, and configuring a corresponding encoding quantization table and a decoding quantization table for each macroblock; performing discrete cosine transform by using a first integer DCT transform kernel; performing quantization by using the encoding quantization table; performing entropy encoding and storing into an off-chip memory; reading a compressed code stream from the off-chip memory, performing entropy decoding, and performing inverse quantization by using the decoding quantization table; performing inverse discrete cosine transform by using a second integer DCT transform kernel; performing block recombination to obtain a reconstructed reference frame, and taking the reconstructed reference frame as a new reference frame, taking a next frame input as a new current frame, and recycling. The present application can effectively solve the technical problem of distortion accumulation in the multi-round iteration encoding and decoding process based on JPEG.

The embodiment of the invention provides a video coding method and a cloud desktop image coding method and device, and the video coding method comprises the steps: dividing a to-be-coded video frame into a plurality of macro blocks, and determining the macro block time domain complexity of each macro block according to the macro block inter-frame change degree of each macro block in the to-be-coded video frame; determining the frame time domain complexity of the video frame to be coded according to the macro block time domain complexity of each macro block, and calculating the quantization adjustment coefficient of the target macro block according to the frame time domain complexity and the target macro block time domain complexity of the target macro block; according to the quantization adjustment coefficient of the target macro block, updating the basic quantization parameter of the target macro block to obtain an updated quantization parameter; and coding the target macro block according to the updated quantization parameter. The basic quantization parameters are controlled and updated based on the macro block time domain complexity, so that the macro blocks with different change degrees can be coded by adopting different quantization parameters, the coding image quality of the macro blocks with different change degrees is controlled in a targeted manner, and the video coding effect is ensured.