Supercharge Your Innovation With Domain-Expert AI Agents!

A Hevc-Based Saliency Detection Method in Compressed Domain

A detection method and compressed domain technology, applied in the field of video technology processing, can solve problems such as low experimental detection accuracy, unobvious salient areas, and uncommon driving tasks, achieve accurate saliency values, reduce computational complexity, and benefit Effects of Perceptual Video Encoding

Active Publication Date: 2021-07-13
NORTHWESTERN POLYTECHNICAL UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although a new research direction is proposed, the marked area is not obvious, and the accuracy of experimental detection is not high
[0004] The top-down selective attention mechanism of biological vision is an unresolved problem in cognitive psychology. In the field of machine vision, the top-down visual saliency detection model is also a research difficulty. The general idea of ​​the existing models is First learn the prior knowledge related to the target and task, and then use the learned prior knowledge to guide the saliency detection. Xu et al. established a data set for human eye tracking, and used the feature component CU in HEVC to divide the depth and bit allocation. And the motion vector, respectively solve the characteristic information of space and time, and then use the nonlinear part of the support vector machine to classify, and finally use the training results to classify each pixel. This algorithm is more complicated to calculate and takes a long time.
Most top-down saliency detection models need to learn from huge image databases, the amount of calculation is huge, and they are not universal because the driving tasks are not universal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Hevc-Based Saliency Detection Method in Compressed Domain
  • A Hevc-Based Saliency Detection Method in Compressed Domain
  • A Hevc-Based Saliency Detection Method in Compressed Domain

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0052] The compressed feature information is extracted in the HEVC test program HM13.0, and the saliency detection is performed, and then compared with other saliency detection algorithms. Select 10 sets of sequences as test sequences, including 4 sets of CIF video sequences, and 6 sets of sequences with sizes of 480P, 720P and 1080P. The video content includes sports, news, live broadcast, entertainment and other types. 50 frames in each YUV sequence are selected for encoding, and the saliency map is calculated. Using the encoder_lowdelay_main.cfg configuration file, the CTU size is set to 64×64, and the maximum CTU division depth is 3, which can provide all possible CTU division structures for saliency detection. The size of each image group is 4, and all of them are B-frame type video frames, and other video encoding parameters are set as convention...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a HEVC-based compressed domain saliency detection method, which relates to the field of video technology processing. By extracting chroma, brightness and texture static feature maps, a model for filtering the background of the static feature maps is established to calculate the final static saliency map. and a dynamic saliency map to get the final saliency map. Compared with other saliency models, the accuracy of the present invention is improved to a certain extent, and the detection algorithm is relatively stable, and at the same time, the complexity of the algorithm is correspondingly reduced. Gaussian distribution is used to filter out the background of the static feature map, and the static feature information is fully extracted, so that the calculation accuracy is improved. ; The motion feature, texture feature and statistical properties of the image are included in the calculation of the dynamic saliency map, which reduces the complexity of the algorithm, because the saliency of the compressed domain reflects the saliency of the reconstructed video, so it is more conducive to perceptual video coding; An adaptive fusion algorithm is adopted to make the saliency value more accurate.

Description

technical field [0001] The invention relates to the field of video technology processing, in particular to a method for detecting the significance of a video sequence. Background technique [0002] Perceptual video coding takes the video quality perceived by human eyes as the standard of video coding, and is considered to be a new coding form that can solve the bottleneck of existing video coding. Visual saliency models can be applied to perceptual video coding. So far, many saliency detection models have been studied, and the models are divided into bottom-up and top-down mechanisms. The former refers to a fast processing method based on low-level visual features and data-driven, while the latter refers to a slow processing method based on task-driven and conscious domination. [0003] The original bottom-up saliency detection models are inspired by biological vision. The study found that there is a working mechanism in the retina and primary visual cortex: visual neuron...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/186H04N19/625H04N19/70G06T7/90
CPCG06T2207/10016G06T7/90H04N19/186H04N19/625H04N19/70
Inventor 周巍白瑞魏恒璐张冠文
Owner NORTHWESTERN POLYTECHNICAL UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More