289 results about "Macroblock" patented technology

The invention discloses a security and protection monitoring video real-time transmission method based on the Internet of Things, and relates to the technical field of security and protection monitoring video transmission, and the method specifically comprises the following steps: when a texture repetition region exists in an image frame, determining all macro blocks forming the texture repetition region in the image frame, and marking the macro blocks as texture repetition blocks; performing comprehensive analysis on each texture repetition block, and evaluating a candidate motion vector direction dispersion degree when an image frame in the security and protection monitoring video has a texture repetition area; based on the evaluation result, determining whether to classify each texture repetition block and whether to respectively match a corresponding motion vector selection strategy; and according to the matched motion vector selection strategy, respectively executing corresponding dynamic regulation and control operations. According to the method, the problem that the direction of the motion vector is discrete and uncontrollable in a texture repetition area is solved, dynamic regulation and control of a coding strategy and synchronous optimization of a decoding end are realized, and the image reconstruction precision and the intelligent analysis stability are improved.

The invention relates to the technical field of computer video processing, and discloses a low-delay video stream real-time processing method and device, and the method comprises the steps: obtaining original video stream data, and processing the original video stream data through employing a lightweight motion prediction method; processing the macro block data set and the predicted coding configuration parameter by adopting multi-thread assembly line coding to obtain a coded data block; establishing a data transmission mechanism to perform data flow control on the unified memory access interface; a heterogeneous task scheduling strategy is adopted to distribute task division results; a lightweight neural network is adopted to carry out parameter adaptive adjustment, and an optimized video stream processing result is obtained; according to the method, a zero-copy data transmission technology is adopted, and optimal configuration and efficient utilization of computing resources are achieved.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

The invention relates to the technical field of image communication, in particular to a traffic engineering construction site video monitoring method and system, and the method comprises the steps: obtaining a monitoring frame image of each monitor at each moment in a traffic construction site, screening out the comparison monitor of each monitor at each moment, determining the risk coefficient of each macro block in the monitoring frame image, and determining the risk coefficient of each macro block in the monitoring frame image; a final comprehensive risk coefficient is determined, a plurality of key frame images of each monitor are screened out in combination with pixel point gray value differences between monitoring frame images of the same monitor at adjacent moments, each macro block in the key frame images is equally divided into a plurality of updated macro blocks, and the updated macro blocks are updated. And the compression coding module is used for compressing and coding all the monitored key frame images and transmitting all the monitored compressed data to the database. According to the invention, by introducing a risk assessment mechanism, the risk coefficients of different areas in the construction site monitoring picture are quantified, so that the compression effect of the video is monitored, and the bandwidth consumption is reduced.

Overlapped block disparity estimation and compensation is described. Compensating for images with overlapped block disparity compensation (OBDC) involves determining if OBDC is enabled in a video bit stream, and determining if OBDC is enabled for one or more macroblocks that neighbor a first macroblock within the video bit stream. The neighboring macroblocks may be transform coded. If OBDC is enabled in the video bit stream and for the one or more neighboring macroblocks, predictions may be made for a region of the first macroblock that has an edge adjacent with the neighboring macroblocks. OBDC can be causally applied. Disparity compensation parameters or modes may be shared amongst views or layers. A variety of predictions may be used with causally-applied OBDC.

The invention relates to the technical field of industrial visual intelligence, in particular to an intelligent image selection and switching system fusing visual features and quality scores, which comprises the following steps: receiving multiple paths of video coding streams, inter-frame motion vectors and camera parameters; generating a macro block activeness distribution map based on the video coding stream and the inter-frame motion vector, and performing local window positioning and feature reconstruction on the video coding stream to generate an enhanced video vector; calculating a confidence coefficient mean value and a consistency score of the video coding stream according to the enhanced video vector, and fusing the confidence coefficient mean value and the consistency score with a channel transmission signal-to-noise ratio and a quantization noise increment to generate a video quality score; constructing a multi-criterion optimization model, and setting a feature representation vector for the multi-criterion optimization model; mapping the viewpoint weight based on the inner product of the feature representation vector, and calculating with the video quality score to generate a video switching score; and performing priority ranking based on the video switching score, and triggering a mapping switching instruction. And realizing video image scheduling by fusing the visual features and the quality score.

The present invention relates to a method for decoding a video signal, comprising the steps of: acquiring a transform size flag of the current macroblock from a video signal; checking the number of non-zero transform coefficients at each pixel position in a first transform block which corresponds to the transform size flag; changing a scan order of the first transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients in the first transform block; determining the number of the non-zero transform coefficients at each pixel position in a second transform block, and setting the changed scan order of the first transform block as an initialized scan order of the second transform block; adding the number of the non-zero transform coefficients at each pixel position in the first transform block and the number of the non-zero transform coefficients at each pixel position in the second transform block, and changing the scan order of the second transform block by prioritizing the position of the pixel having the greatest number of the nonzero transform coefficients; and decoding the transform coefficients arranged in the scan order changed in the previous step, wherein the first transform block and the second transform block have sizes corresponding to the transform size flag, and are contained in the current macroblock.

The invention discloses a method for preprocessing a video and a related product, and generally relates to the technical field of video coding. The method comprises the following steps: partitioning a filtering frame to obtain a first filtering frame macro block with a first size; partitioning the at least one first filtering frame macro block to obtain a second filtering frame macro block with a second size; determining a matching block matched with the macro block of the second filtered frame based on a reference frame associated with the filtered frame; and updating the second filtering frame macro block according to the matching block. According to the method, motion estimation is carried out between a filtering frame and a reference frame based on variable-size blocks, the time domain filtering effect is improved, and the video coding quality is further improved.

A signed video bitstream obtained by prediction coding of a video sequence includes data units and associated signature units, wherein each data unit represents at most one macroblock in a video frame of the video sequence, and each signature unit includes a digital signature of a bitstring derived from fingerprints of exactly one associated data unit each. The bitstream is edited by: receiving a request to substitute a region; determining a first set of macroblocks, in which said region is contained, and a second set of macroblocks referring to macroblocks in the first set; adding an archive object that includes fingerprints of a first and a second set of data units, which represent the first and second set of macroblocks; editing the first set of data units in accordance with the request to substitute; and re-encoding the second set of data units.

The present invention relates to an image encoding and decoding technique, and more particularly, to an image encoder and decoder using unidirectional prediction. The image encoder includes a dividing unit to divide a macro block into a plurality of sub-blocks, a unidirectional application determining unit to determine whether an identical prediction mode is applied to each of the plurality of sub-blocks, and a prediction mode determining unit to determine a prediction mode with respect to each of the plurality of sub-blocks based on a determined result of the unidirectional application determining unit.

The invention belongs to the technical field of artificial intelligence and research and development, and relates to a video compression method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a target video frame in a to-be-compressed video stream, and generating a thermodynamic diagram according to the target video frame; dividing the thermodynamic diagram into a plurality of thermodynamic diagram macro blocks, and calculating a thermodynamic value of each thermodynamic diagram macro block; correspondingly determining a compression strategy of each thermodynamic diagram macro block according to the thermodynamic value of each thermodynamic diagram macro block; and compressing the target video frame according to the compression strategy of each thermodynamic diagram macro block. In addition, the invention also relates to a block chain technology, and data such as a target video frame and a thermodynamic diagram can be stored in a block chain. According to the invention, the problem of quality reduction of video key content in a dynamic video processing process can be solved.

The present application relates to the technical field of image processing, discloses a grayscale image compression method in a weak network environment, and aims to solve the problem of suboptimal image compression sizes caused by compression methods focusing only on individual images without considering contextual correlations of the images within actual scenes. Key points of the technical solution are: S1: performing correlation extraction; S2: implementing the process of the grayscale image compression method in a weak network environment: first obtaining a data source, and then performing division of macro blocks according to requirements; S3: performing information conversion: converting two-dimensional pixel information into one-dimension pixel information, and finally obtaining one-dimensional discrete curve sequences lcur and lpre corresponding to mcur and mpre; S4: calculating a Fréchet distance FreDis; and S5: determining a transmission state on the basis of the value of FreDis: calculating the Fréchet distance FreDis after micro blocks having the same pixel are converted into one-dimensional discrete curves, and determining whether to perform transmission. The effects of reducing transmission delay and improving experience of users in weak network environments are achieved.

The invention provides a data encoding method, a data decoding method, terminal equipment and a server, relates to the technical field of electronic information, and can solve the problem of low image encoding processing efficiency. According to the specific technical scheme, the coding parameter of each macro block is dynamically adjusted according to the visual sensitive value of the image content, so that the characteristics of a human visual system can be more effectively utilized, the visual quality is maintained or improved, the coding time length and the code stream size are reduced, and the transmission speed is improved.

The embodiment of the invention discloses an image decoding method, an image coding method, electronic equipment and a readable storage medium. The decoding method comprises the following steps: during image decoding, performing first decoding sub-stage processing on a to-be-decoded image code stream to obtain pixel residual information; wherein the first decoding sub-stage comprises the steps of code stream acquisition and entropy decoding of an image to be decoded; caching the pixel residual error information to a shared macro block information buffer; when an image is decoded, acquiring residual information of pixels to be processed in the macro block information buffer by adopting an asynchronous independent clock; performing second decoding sub-stage processing on the to-be-processed pixel residual information to obtain image decoding information; wherein the second decoding sub-stage comprises inverse quantization, inverse discrete cosine transform and pixel code stream write-back. By decoupling the decoding process, asynchronous parallel processing of the decoding process can be realized, the image decoding efficiency is improved, and the memory utilization rate of equipment is improved.

The invention provides a region-based picture enhancement method and device, and the method comprises the steps: dividing a to-be-enhanced video picture by taking macro blocks as basic units, and carrying out the importance prediction of each divided macro block; based on the importance prediction result of each macro block, obtaining a plurality of to-be-enhanced areas of the to-be-enhanced video picture; the plurality of areas to be enhanced are spliced; and inputting the splicing result into the enhancement model for enhancement processing. According to the method, important regions can be quickly and accurately identified, and sparsely distributed regions are spliced into dense tensors and are efficiently enhanced.

The invention provides a video code stream quality evaluation method, which comprises the following steps of: for each frame image in a video code stream, performing macro block decoding on the frame image to obtain a plurality of macro blocks; in the macro block decoding process, determining the type of an error macro block aiming at the error macro block generated by the macro block decoding information error; determining the number of center error macro blocks of the frame image, and evaluating the quality of the frame image at least according to the number of the center error macro blocks of the frame image and the total number of the macro blocks; according to the embodiment of the invention, by evaluating the quality of the video code stream at the macro block level, the unit of quality control can be reduced from the current coding fragment to the macro block level, so that the decoding process can be controlled more finely, and the decoding and display effects can be improved; and the quality of the frame image can be quickly and effectively evaluated based on the central error macro block at the central position of the frame image. The invention further provides computer equipment and a readable medium.

A method for performing Tile to Raster (T2R) conversion includes: receiving tile input data including a stream of a plurality of tiles each having a tile height, a tile input width, a macroblock width (MBW), and data bits; segmenting the tile input data based on a total number of virtual square tiles; segmenting a Tile Buffer (TB) into one or more of the virtual square tiles based on the received tile input data; and performing a raster-scanning operation on each of the segmented tile input data and the segmented TB based on the total number of virtual square tiles to generate raster data.

The application relates to the technical field of digital video processing, and discloses a video stream block time evidence watermarking method based on time authentication, which comprises the following steps: receiving a continuous video code stream and dividing the video code stream into multiple continuous video blocks, extracting video coding layer data of the first video block, performing a hash operation to generate a reference hash value; sending the reference hash value to a time watermarking device, performing a digital signature operation on the reference hash value in combination with an absolute timestamp and a signature key to generate a digital signature; intercepting a bit segment from the digital signature as a characteristic sequence to form cascade digest data; and modulating preset macro block syntax elements of the first frame of the next video block by using the cascade digest data, and outputting reconstructed video coding layer data. The method effectively reduces processor occupation and memory consumption of the system, enables video content to meet real-time transmission requirements in a monitoring scene while guaranteeing time sequence and data anti-fake capability.

The present invention provides an encoding method, apparatus, device, and storage medium. The method includes: determining the pixel gradient values, genetic costs, intra-prediction costs, and quantization parameters of a target frame image corresponding to multiple macroblocks respectively; determining the quantization parameter offset values corresponding to the multiple macroblocks respectively according to the pixel gradient values, genetic costs, and intra-prediction costs corresponding to the multiple macroblocks respectively; determining the quantization parameters of the multiple macroblocks according to the quantization parameter offset values corresponding to the multiple macroblocks respectively and the quantization parameters of the target frame image; and encoding the target frame image according to the quantization parameters of the multiple macroblocks. When encoding a certain frame image in a video, during the process of calculating the quantization parameter offset values of each macroblock in this frame image, considering the pixel gradient information of each macroblock, the calculation result of the quantization parameter offset value of the macroblock can more accurately reflect the influence degree of the macroblock on future frames, making the encoding effect of the video better.

The invention relates to a 3D Gaussian rendering acceleration method and device, and belongs to the technical field of three-dimensional image rendering, a rendering assembly line with an ellipse as the center is constructed, and the method comprises four stages of projection, hierarchical sorting, self-adaptive blocking and ellipse center rasterization; in the projection stage, a contracted axis alignment bounding box is calculated for each projected Gaussian ellipse, and the coverage area of the bounding box is adaptively adjusted by combining the opacity of Gaussian; in the hierarchical sorting stage, a hierarchical sorting strategy similar to GScore is adopted on larger macro block granularity; in the self-adaptive blocking stage, an elliptical bounding box is used as a boundary to dynamically divide the bounding box; in the rasterization stage, all pixels intersecting with the Gaussian ellipse are processed elliptically one by one, once one ellipse is loaded to an on-chip buffer area, all pixels covered by the ellipse are processed, and it is ensured that data of each Gaussian ellipse only needs to be loaded once from an off-chip memory.

The embodiment of the application discloses a kind of based on wavefront parallel processing to the method, device, storage medium and computer equipment of image H.264 encoding, it is related to image processing field.The application is processed adjacent macroblock line by double encoder parallelly, and respectively first buffer and second buffer are written to encoding bit stream.In macroblock line encoding completion, first buffer remaining bit stream and entropy encoding remaining bit stream are merged in real time, if the length after merging is less than 8 integer multiples, then appropriate bit stream is dynamically taken from the head of second buffer and spliced, complete code stream in line with H.264 standard is generated and outputed.After encoding is completed, the minimum splicing length is used as the offset of second buffer, continue to output byte stream, and the encoding of next macroblock line is started.The application only needs double macroblock line buffer, significantly improves the encoding speed, reduces memory occupation, and does not need to modify decoder, and compatibility is strong.

A P-SKIP macro block judgment method, a coding method and related devices, the P-SKIP macro block judgment method judges whether a macro block to be judged is a P-SKIP macro block based on the total motion sum of micro-range motion, the total motion sum of local-range motion and the total motion sum of large-range motion of the macro block to be judged, and can improve the accuracy of P-SKIP macro block judgment.

The present application relates to the technical field of image processing, and more particularly to a video decoding and Unreal Engine rendering method based on GPU full-link zero-copy, which comprises the following steps: step one, hardware decoding of an input video code stream on a GPU, and construction of a motion vector description buffer for storing compressed domain motion vector information in macroblock order; step two, reading of the motion vector description buffer by a calculation shader on the GPU to generate a dynamic special effect control buffer corresponding to each macroblock; and step three, in the post-processing material of the Unreal Engine rendering module, taking a shared video texture resource as an input texture and outputting a video picture. The present application realizes unified management of pixel data and motion data without relying on a host processor and without excessively occupying video memory bandwidth, significantly reduces delay, and improves special effect stability and direction consistency.

The invention provides an image coding method, and relates to the field of image processing, and the method comprises the steps: determining a real-time code rate at a current moment; determining a code stream expected value of a next frame according to the real-time code rate and a target code rate; and for the intra-frame refresh frame, based on the code stream expected value, determining the column number of the contained intra-frame refresh macro block columns, and performing intra-frame refresh. According to the scheme, the smoothness of the code rate peak value can be realized by providing a dynamic coding method in the image coding process.

The present invention discloses a moving target detection method, device and terminal equipment, including: obtaining an image to be detected, detecting a moving foreground area of ​​the image to be detected by a motion detection method; performing macroblock division processing according to the image to be detected and the moving foreground area to obtain a macroblock foreground image; calculating the mutual information between adjacent macroblocks according to the macroblock foreground image to obtain a mutual information correlation image; performing region growth processing on the macroblock foreground image according to the mutual information correlation image to obtain a processed macroblock foreground image; obtaining the historical time sequence information of each macroblock in the processed macroblock foreground image, combining with a Bayesian filter, judging whether each macroblock in the processed macroblock foreground image is a foreground; and obtaining a moving target area according to all macroblocks judged to be foregrounds. The technical solution of the present invention can have good robustness to noise, enhance anti-interference performance, and thus improve the accuracy of moving target detection.

The invention relates to a non-standard JPEG (Joint Photographic Experts Group) coding processing method for dynamic code rate control. The method comprises the following steps: presetting a multi-frame joint image processing scene, obtaining an original reference image, and carrying out combined processing of boundary expansion and random bias addition to obtain a preprocessed reference image; dividing macro blocks for the preprocessed reference image, and distributing an independent coding parameter configuration space after verification and compliance; frequency domain conversion is executed according to a division result, an initial quantization parameter is calculated through an index model, and a dynamic quantization table is dynamically adjusted; executing non-standard entropy coding to obtain an indexed macro block coding code stream; combining the indexed code stream and a macro block division result to construct an index table containing a macro block serial number, an initial address and a code stream length; analyzing the code stream to obtain quantized data, and performing inverse quantization by using a dynamic quantization table to obtain spatial domain data; enabling the format of the reconstructed image to be consistent with that of the preprocessed reference image through reverse preprocessing, and performing real-time processing on the linkage input image to obtain a reconstructed reference image; and non-standard JPEG coding processing of dynamic code rate control is realized.

The embodiment of the invention provides a video coding method and a coding method for LED display data, and relates to the technical field of video coding. The video coding method comprises the following steps: determining each target input interface and a coding scheduling strategy, writing a received image block into a cache region corresponding to a first coding channel, reading a macro block to be coded from the cache region corresponding to each coding channel in sequence according to a first strategy, and writing the read macro block into a plurality of sub-regions of the shared region, determining a coding channel which needs to be polled when data input is performed on the coding module according to a first strategy as a to-be-processed channel, reading the current to-be-processed macro block from the sub-region corresponding to the to-be-processed channel, and sending the to-be-processed macro block to the to-be-processed channel. And inputting the read macro block into the coding module so as to carry out coding processing based on each processing unit. Therefore, the scheme can improve the resource utilization rate of the encoder.

Embodiments of the present application provide a video processing method, device and electronic equipment, relating to the field of artificial intelligence, the video processing method is applied to a pre-trained video processing model, comprising: extracting a spatio-temporal feature of a video frame; the video frame comprises a current frame to be processed and a reference frame adjacent to the current frame; the spatio-temporal feature comprises a dynamic foreground feature, a noise level feature and a coding mode feature; the coding mode feature is used to represent the coding mode of each macroblock of the corresponding video frame; fusing the spatio-temporal feature of the current frame and the spatio-temporal feature of the reference frame to obtain a target spatio-temporal feature of the current frame; determining a filtering mode corresponding to the current frame according to the target spatio-temporal feature, and filtering the current frame based on the filtering mode. The present application can protect and retain the key information in the video, which is beneficial to more accurately and completely remove the noise and spatio-temporal redundancy in the video.

This application discloses a method, apparatus, device, and medium for scene switching detection using an x264 encoder for vertical short-form video, relating to the field of video coding technology. The method includes: dividing the vertical screen of a target video frame into target gradient regions using a preset gradient weighting strategy, and assigning weight coefficients to macroblocks in each target gradient region; downsampling the target video frame and calculating the SATD value of each macroblock based on the processed frame data; the SATD value includes the luminance component and chrominance component SATD values; determining the weighted cost value of each macroblock according to a preset weighted cost calculation formula and using the SATD value and weight coefficients to determine the full-frame cost of the target video frame; including a first full-frame cost when the target video frame is a P-frame and a second full-frame cost when it is an I-frame; determining the scene switching score of the target video frame through the full-frame cost, and determining whether the target video frame meets the preset scene switching conditions based on the scene switching score.

A video encoder including a first buffer containing a plurality of data values defining a macroblock of pixels of a video frame. The video encoder also includes a second buffer and an entropy encoder coupled to the first and second buffers and configured to encode a macroblock based on another macroblock. The entropy encoder identifies a subset of the data values from the first buffer defining a given macroblock and copies the identified subset to the second buffer, the subset of data values being just those data values used by the entropy encoder when subsequently encoding another macroblock.