222 results about "Macroblock" patented technology

The invention discloses a security and protection monitoring video real-time transmission method based on the Internet of Things, and relates to the technical field of security and protection monitoring video transmission, and the method specifically comprises the following steps: when a texture repetition region exists in an image frame, determining all macro blocks forming the texture repetition region in the image frame, and marking the macro blocks as texture repetition blocks; performing comprehensive analysis on each texture repetition block, and evaluating a candidate motion vector direction dispersion degree when an image frame in the security and protection monitoring video has a texture repetition area; based on the evaluation result, determining whether to classify each texture repetition block and whether to respectively match a corresponding motion vector selection strategy; and according to the matched motion vector selection strategy, respectively executing corresponding dynamic regulation and control operations. According to the method, the problem that the direction of the motion vector is discrete and uncontrollable in a texture repetition area is solved, dynamic regulation and control of a coding strategy and synchronous optimization of a decoding end are realized, and the image reconstruction precision and the intelligent analysis stability are improved.

The invention relates to the technical field of computer video processing, and discloses a low-delay video stream real-time processing method and device, and the method comprises the steps: obtaining original video stream data, and processing the original video stream data through employing a lightweight motion prediction method; processing the macro block data set and the predicted coding configuration parameter by adopting multi-thread assembly line coding to obtain a coded data block; establishing a data transmission mechanism to perform data flow control on the unified memory access interface; a heterogeneous task scheduling strategy is adopted to distribute task division results; a lightweight neural network is adopted to carry out parameter adaptive adjustment, and an optimized video stream processing result is obtained; according to the method, a zero-copy data transmission technology is adopted, and optimal configuration and efficient utilization of computing resources are achieved.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention relates to the technical field of image communication, in particular to a traffic engineering construction site video monitoring method and system, and the method comprises the steps: obtaining a monitoring frame image of each monitor at each moment in a traffic construction site, screening out the comparison monitor of each monitor at each moment, determining the risk coefficient of each macro block in the monitoring frame image, and determining the risk coefficient of each macro block in the monitoring frame image; a final comprehensive risk coefficient is determined, a plurality of key frame images of each monitor are screened out in combination with pixel point gray value differences between monitoring frame images of the same monitor at adjacent moments, each macro block in the key frame images is equally divided into a plurality of updated macro blocks, and the updated macro blocks are updated. And the compression coding module is used for compressing and coding all the monitored key frame images and transmitting all the monitored compressed data to the database. According to the invention, by introducing a risk assessment mechanism, the risk coefficients of different areas in the construction site monitoring picture are quantified, so that the compression effect of the video is monitored, and the bandwidth consumption is reduced.

The invention relates to the technical field of industrial visual intelligence, in particular to an intelligent image selection and switching system fusing visual features and quality scores, which comprises the following steps: receiving multiple paths of video coding streams, inter-frame motion vectors and camera parameters; generating a macro block activeness distribution map based on the video coding stream and the inter-frame motion vector, and performing local window positioning and feature reconstruction on the video coding stream to generate an enhanced video vector; calculating a confidence coefficient mean value and a consistency score of the video coding stream according to the enhanced video vector, and fusing the confidence coefficient mean value and the consistency score with a channel transmission signal-to-noise ratio and a quantization noise increment to generate a video quality score; constructing a multi-criterion optimization model, and setting a feature representation vector for the multi-criterion optimization model; mapping the viewpoint weight based on the inner product of the feature representation vector, and calculating with the video quality score to generate a video switching score; and performing priority ranking based on the video switching score, and triggering a mapping switching instruction. And realizing video image scheduling by fusing the visual features and the quality score.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

The invention discloses a method for preprocessing a video and a related product, and generally relates to the technical field of video coding. The method comprises the following steps: partitioning a filtering frame to obtain a first filtering frame macro block with a first size; partitioning the at least one first filtering frame macro block to obtain a second filtering frame macro block with a second size; determining a matching block matched with the macro block of the second filtered frame based on a reference frame associated with the filtered frame; and updating the second filtering frame macro block according to the matching block. According to the method, motion estimation is carried out between a filtering frame and a reference frame based on variable-size blocks, the time domain filtering effect is improved, and the video coding quality is further improved.

A signed video bitstream obtained by prediction coding of a video sequence includes data units and associated signature units, wherein each data unit represents at most one macroblock in a video frame of the video sequence, and each signature unit includes a digital signature of a bitstring derived from fingerprints of exactly one associated data unit each. The bitstream is edited by: receiving a request to substitute a region; determining a first set of macroblocks, in which said region is contained, and a second set of macroblocks referring to macroblocks in the first set; adding an archive object that includes fingerprints of a first and a second set of data units, which represent the first and second set of macroblocks; editing the first set of data units in accordance with the request to substitute; and re-encoding the second set of data units.

The present application relates to the technical field of image processing, discloses a grayscale image compression method in a weak network environment, and aims to solve the problem of suboptimal image compression sizes caused by compression methods focusing only on individual images without considering contextual correlations of the images within actual scenes. Key points of the technical solution are: S1: performing correlation extraction; S2: implementing the process of the grayscale image compression method in a weak network environment: first obtaining a data source, and then performing division of macro blocks according to requirements; S3: performing information conversion: converting two-dimensional pixel information into one-dimension pixel information, and finally obtaining one-dimensional discrete curve sequences lcur and lpre corresponding to mcur and mpre; S4: calculating a Fréchet distance FreDis; and S5: determining a transmission state on the basis of the value of FreDis: calculating the Fréchet distance FreDis after micro blocks having the same pixel are converted into one-dimensional discrete curves, and determining whether to perform transmission. The effects of reducing transmission delay and improving experience of users in weak network environments are achieved.

The embodiment of the invention discloses an image decoding method, an image coding method, electronic equipment and a readable storage medium. The decoding method comprises the following steps: during image decoding, performing first decoding sub-stage processing on a to-be-decoded image code stream to obtain pixel residual information; wherein the first decoding sub-stage comprises the steps of code stream acquisition and entropy decoding of an image to be decoded; caching the pixel residual error information to a shared macro block information buffer; when an image is decoded, acquiring residual information of pixels to be processed in the macro block information buffer by adopting an asynchronous independent clock; performing second decoding sub-stage processing on the to-be-processed pixel residual information to obtain image decoding information; wherein the second decoding sub-stage comprises inverse quantization, inverse discrete cosine transform and pixel code stream write-back. By decoupling the decoding process, asynchronous parallel processing of the decoding process can be realized, the image decoding efficiency is improved, and the memory utilization rate of equipment is improved.

The invention provides a region-based picture enhancement method and device, and the method comprises the steps: dividing a to-be-enhanced video picture by taking macro blocks as basic units, and carrying out the importance prediction of each divided macro block; based on the importance prediction result of each macro block, obtaining a plurality of to-be-enhanced areas of the to-be-enhanced video picture; the plurality of areas to be enhanced are spliced; and inputting the splicing result into the enhancement model for enhancement processing. According to the method, important regions can be quickly and accurately identified, and sparsely distributed regions are spliced into dense tensors and are efficiently enhanced.

A method for performing Tile to Raster (T2R) conversion includes: receiving tile input data including a stream of a plurality of tiles each having a tile height, a tile input width, a macroblock width (MBW), and data bits; segmenting the tile input data based on a total number of virtual square tiles; segmenting a Tile Buffer (TB) into one or more of the virtual square tiles based on the received tile input data; and performing a raster-scanning operation on each of the segmented tile input data and the segmented TB based on the total number of virtual square tiles to generate raster data.

The application relates to the technical field of digital video processing, and discloses a video stream block time evidence watermarking method based on time authentication, which comprises the following steps: receiving a continuous video code stream and dividing the video code stream into multiple continuous video blocks, extracting video coding layer data of the first video block, performing a hash operation to generate a reference hash value; sending the reference hash value to a time watermarking device, performing a digital signature operation on the reference hash value in combination with an absolute timestamp and a signature key to generate a digital signature; intercepting a bit segment from the digital signature as a characteristic sequence to form cascade digest data; and modulating preset macro block syntax elements of the first frame of the next video block by using the cascade digest data, and outputting reconstructed video coding layer data. The method effectively reduces processor occupation and memory consumption of the system, enables video content to meet real-time transmission requirements in a monitoring scene while guaranteeing time sequence and data anti-fake capability.

The present invention provides an encoding method, apparatus, device, and storage medium. The method includes: determining the pixel gradient values, genetic costs, intra-prediction costs, and quantization parameters of a target frame image corresponding to multiple macroblocks respectively; determining the quantization parameter offset values corresponding to the multiple macroblocks respectively according to the pixel gradient values, genetic costs, and intra-prediction costs corresponding to the multiple macroblocks respectively; determining the quantization parameters of the multiple macroblocks according to the quantization parameter offset values corresponding to the multiple macroblocks respectively and the quantization parameters of the target frame image; and encoding the target frame image according to the quantization parameters of the multiple macroblocks. When encoding a certain frame image in a video, during the process of calculating the quantization parameter offset values of each macroblock in this frame image, considering the pixel gradient information of each macroblock, the calculation result of the quantization parameter offset value of the macroblock can more accurately reflect the influence degree of the macroblock on future frames, making the encoding effect of the video better.

The invention relates to a 3D Gaussian rendering acceleration method and device, and belongs to the technical field of three-dimensional image rendering, a rendering assembly line with an ellipse as the center is constructed, and the method comprises four stages of projection, hierarchical sorting, self-adaptive blocking and ellipse center rasterization; in the projection stage, a contracted axis alignment bounding box is calculated for each projected Gaussian ellipse, and the coverage area of the bounding box is adaptively adjusted by combining the opacity of Gaussian; in the hierarchical sorting stage, a hierarchical sorting strategy similar to GScore is adopted on larger macro block granularity; in the self-adaptive blocking stage, an elliptical bounding box is used as a boundary to dynamically divide the bounding box; in the rasterization stage, all pixels intersecting with the Gaussian ellipse are processed elliptically one by one, once one ellipse is loaded to an on-chip buffer area, all pixels covered by the ellipse are processed, and it is ensured that data of each Gaussian ellipse only needs to be loaded once from an off-chip memory.

The embodiment of the application discloses a kind of based on wavefront parallel processing to the method, device, storage medium and computer equipment of image H.264 encoding, it is related to image processing field.The application is processed adjacent macroblock line by double encoder parallelly, and respectively first buffer and second buffer are written to encoding bit stream.In macroblock line encoding completion, first buffer remaining bit stream and entropy encoding remaining bit stream are merged in real time, if the length after merging is less than 8 integer multiples, then appropriate bit stream is dynamically taken from the head of second buffer and spliced, complete code stream in line with H.264 standard is generated and outputed.After encoding is completed, the minimum splicing length is used as the offset of second buffer, continue to output byte stream, and the encoding of next macroblock line is started.The application only needs double macroblock line buffer, significantly improves the encoding speed, reduces memory occupation, and does not need to modify decoder, and compatibility is strong.

A P-SKIP macro block judgment method, a coding method and related devices, the P-SKIP macro block judgment method judges whether a macro block to be judged is a P-SKIP macro block based on the total motion sum of micro-range motion, the total motion sum of local-range motion and the total motion sum of large-range motion of the macro block to be judged, and can improve the accuracy of P-SKIP macro block judgment.

The present application relates to the technical field of image processing, and more particularly to a video decoding and Unreal Engine rendering method based on GPU full-link zero-copy, which comprises the following steps: step one, hardware decoding of an input video code stream on a GPU, and construction of a motion vector description buffer for storing compressed domain motion vector information in macroblock order; step two, reading of the motion vector description buffer by a calculation shader on the GPU to generate a dynamic special effect control buffer corresponding to each macroblock; and step three, in the post-processing material of the Unreal Engine rendering module, taking a shared video texture resource as an input texture and outputting a video picture. The present application realizes unified management of pixel data and motion data without relying on a host processor and without excessively occupying video memory bandwidth, significantly reduces delay, and improves special effect stability and direction consistency.

The invention provides an image coding method, and relates to the field of image processing, and the method comprises the steps: determining a real-time code rate at a current moment; determining a code stream expected value of a next frame according to the real-time code rate and a target code rate; and for the intra-frame refresh frame, based on the code stream expected value, determining the column number of the contained intra-frame refresh macro block columns, and performing intra-frame refresh. According to the scheme, the smoothness of the code rate peak value can be realized by providing a dynamic coding method in the image coding process.

The present invention discloses a moving target detection method, device and terminal equipment, including: obtaining an image to be detected, detecting a moving foreground area of ​​the image to be detected by a motion detection method; performing macroblock division processing according to the image to be detected and the moving foreground area to obtain a macroblock foreground image; calculating the mutual information between adjacent macroblocks according to the macroblock foreground image to obtain a mutual information correlation image; performing region growth processing on the macroblock foreground image according to the mutual information correlation image to obtain a processed macroblock foreground image; obtaining the historical time sequence information of each macroblock in the processed macroblock foreground image, combining with a Bayesian filter, judging whether each macroblock in the processed macroblock foreground image is a foreground; and obtaining a moving target area according to all macroblocks judged to be foregrounds. The technical solution of the present invention can have good robustness to noise, enhance anti-interference performance, and thus improve the accuracy of moving target detection.

The invention relates to a non-standard JPEG (Joint Photographic Experts Group) coding processing method for dynamic code rate control. The method comprises the following steps: presetting a multi-frame joint image processing scene, obtaining an original reference image, and carrying out combined processing of boundary expansion and random bias addition to obtain a preprocessed reference image; dividing macro blocks for the preprocessed reference image, and distributing an independent coding parameter configuration space after verification and compliance; frequency domain conversion is executed according to a division result, an initial quantization parameter is calculated through an index model, and a dynamic quantization table is dynamically adjusted; executing non-standard entropy coding to obtain an indexed macro block coding code stream; combining the indexed code stream and a macro block division result to construct an index table containing a macro block serial number, an initial address and a code stream length; analyzing the code stream to obtain quantized data, and performing inverse quantization by using a dynamic quantization table to obtain spatial domain data; enabling the format of the reconstructed image to be consistent with that of the preprocessed reference image through reverse preprocessing, and performing real-time processing on the linkage input image to obtain a reconstructed reference image; and non-standard JPEG coding processing of dynamic code rate control is realized.

Embodiments of the present application provide a video processing method, device and electronic equipment, relating to the field of artificial intelligence, the video processing method is applied to a pre-trained video processing model, comprising: extracting a spatio-temporal feature of a video frame; the video frame comprises a current frame to be processed and a reference frame adjacent to the current frame; the spatio-temporal feature comprises a dynamic foreground feature, a noise level feature and a coding mode feature; the coding mode feature is used to represent the coding mode of each macroblock of the corresponding video frame; fusing the spatio-temporal feature of the current frame and the spatio-temporal feature of the reference frame to obtain a target spatio-temporal feature of the current frame; determining a filtering mode corresponding to the current frame according to the target spatio-temporal feature, and filtering the current frame based on the filtering mode. The present application can protect and retain the key information in the video, which is beneficial to more accurately and completely remove the noise and spatio-temporal redundancy in the video.

This application discloses a method, apparatus, device, and medium for scene switching detection using an x264 encoder for vertical short-form video, relating to the field of video coding technology. The method includes: dividing the vertical screen of a target video frame into target gradient regions using a preset gradient weighting strategy, and assigning weight coefficients to macroblocks in each target gradient region; downsampling the target video frame and calculating the SATD value of each macroblock based on the processed frame data; the SATD value includes the luminance component and chrominance component SATD values; determining the weighted cost value of each macroblock according to a preset weighted cost calculation formula and using the SATD value and weight coefficients to determine the full-frame cost of the target video frame; including a first full-frame cost when the target video frame is a P-frame and a second full-frame cost when it is an I-frame; determining the scene switching score of the target video frame through the full-frame cost, and determining whether the target video frame meets the preset scene switching conditions based on the scene switching score.

The invention relates to the technical field of image processing, in particular to a dynamic scene adaptive exposure regulation and control method for a visible light imaging product, which comprises the following steps: acquiring a motion vector of each macro block in a current frame image from a previous frame image to the current frame image; predicting a prediction position of each macro block in the next frame of image based on the motion vector; calculating the predicted brightness increment of each macro block according to the current brightness value of each macro block in the current frame image and the reference brightness value of each macro block at the predicted position in the next frame image; dividing the current frame image into a plurality of exposure regulation and control regions, and aggregating the predicted brightness increment of the macro block covered by each exposure regulation and control region to obtain the regional brightness increment of the exposure regulation and control region; when the regional brightness increment of any exposure regulation and control region exceeds a preset threshold value, executing an exposure moment determination process for any exposure regulation and control region; and in the exposure period of the next frame of image, performing line-level exposure termination based on the independent exposure termination time of each related pixel line through the time schedule controller.

The application discloses a kind of interframe macroblock motion vector determination method and device based on neural network, it is related to video processing technical field, wherein, the method includes: using improved U2net neural network to carry out semantic segmentation to video frame, determine the foreground area and background area in video frame, based on reference object in foreground area or background area, using depth local feature search network analysis video key feature sequence before and after frame, and based on key feature sequence determines target search area, depth local feature search network has fused time series neural network based on bidirectional long short-term memory network, carries out encoder interframe macroblock motion vector analysis strategy in target search area, determines the macroblock motion vector in target search area.The present application solves the technical problem that in the related art, in the video frame encoding process, using local feature to carry out MV prediction easily leads to improper search range selection, which affects the prediction accuracy.

The invention provides an image coding method and related equipment, and relates to the field of image processing, and the method comprises the steps: determining whether a target object in a current frame starts to move regularly or not; if yes, closing global motion vector detection, and predicting the position and the motion vector of the matched macro block in the next frame by using the long-term motion speed; wherein the long-term motion speed is obtained from the historical value of the long-term motion speed and the short-term motion speed, and the short-term motion speed is used for representing the motion vector of the matched macro block in the previous frame. According to the scheme, the coding efficiency can be improved in a screen content coding scene, and the coding computing power overhead is reduced.

The invention discloses a concurrent implementation method of motion vector search, which relates to the technical field of H264 video compression implementation, and comprises the following steps of: judging whether a current macro block meets a condition of becoming a PSKIP macro block according to PSKIP macro block type information of a block adjacent to the current macro block, if the current macro block is judged to be in a PSKIP macro block type, ending search, and otherwise, entering the next step; under the assumption that the partitioning mode is a P16 * 16 partitioning mode, taking a pskipmv variable value obtained by predicting an adjacent block of the current macro block as a prediction vector value of the current macro block, and calculating and judging whether the type of the current macro block is a PSKIP macro block type or not; and when the judgment result does not meet the condition of the PSKIP macro block, carrying out parallel search processing, and carrying out concurrent motion vector search in different blocking modes. Under the condition that a small number of code rates are increased, the compression speed is greatly increased, and the method is more suitable for the use scene of real-time video compression.

A method for performing content-based video compression using reinforcement learning (RL) is provided. The method includes obtaining frame information associated with a frame from a video. The frame information comprises quantization parameter (QP) information associated with the frame, and the QP information indicates an initial compression level for encoding aspects of the frame. The frame information and additional information are processed by an RL agent to generate a generated QP map indicating a plurality of updated values associated with a plurality of macro-blocks (MBs) of the frame. A bitstream is generated comprising a plurality of bits for the frame based on the generated QP map. Specifically, the plurality of updated values from the generated QP map indicates an amount of allocated bits from the bitstream to allocate for each of the plurality of MBs. The bitstream is provided to a downstream model.

The invention discloses a three-dimensional chip thermal perception optimization method based on tensor data flow, and relates to the field of integrated circuits, and the method comprises the steps: firstly, starting from the angle of tensor data flow, providing a collaborative thermal optimization process combining a network, an architecture, physics and packaging; then, based on a quantitative modeling tensor data flow energy optimization method, automatically identifying the most energy-saving tensor data flow under given three-dimensional chip constraints by using a heuristic optimization method; and finally, providing a thermal sensing three-dimensional architecture spatial layout method, simplifying the spatial layout problem of the SRAM macro block into an affine mapping optimization problem, and optimizing an affine mapping relationship through a heuristic optimization method to obtain the spatial layout with optimal thermal performance. According to the method, the tensor calculation characteristics are optimized in a targeted manner, so that the three-dimensional stacked SRAM chip meets the thermal reliability requirement in a high-density integration scene.

The embodiment of the invention discloses a coding and decoding method, a code stream, a coder, a decoder and a storage medium, and the method comprises the steps: decoding the code stream, and determining a value of first syntax element information and a value of at least one piece of second syntax element information; wherein the first syntax element information is used for indicating the number of bits occupied by the point value of the current macro block, the ith second syntax element information is used for indicating the ith bit corresponding to the point value of the current macro block, and i is an integer greater than or equal to 0 and less than the value of the first syntax element information; and determining a point value of the current macro block according to the value of the first syntax element information and the value of the at least one piece of second syntax element information. Therefore, the coding and decoding efficiency can be improved.