A 3D Video Saliency Detection Method

A detection method and saliency technology, applied in image data processing, instrumentation, calculation, etc., can solve the problem of not being able to correctly reflect the saliency area of ​​real images, and achieve the effect of improving accuracy and accuracy

Inactive Publication Date: 2018-01-09
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional saliency detection methods for 2D video images only focus on color information, and the detecti

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D Video Saliency Detection Method
  • A 3D Video Saliency Detection Method
  • A 3D Video Saliency Detection Method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0044] Example 1

[0045] Such as figure 1 As shown, the operation steps in this example are as follows:

[0046] 1. Input the 3D video sequence to be processed, which specifically includes a color sequence and a depth sequence. This method uses frame-by-frame processing. If you want to process a frame of image, you need to obtain the input color image Color1 and depth image Depth1 of the current frame to be processed, and the color image Color2 of the next frame of the current frame. .

[0047] 2. Perform super pixel segmentation and feature extraction on the input 3D video frame.

[0048] Combine its color image Color1 and depth image Depth1 to perform super pixel segmentation on the current frame to obtain N super pixel segmentation regions, denoted as R = {R 1 ,R 2 ,...,R i ,...,R N }. According to the superpixel segmentation results, the features of each superpixel segmentation area are extracted. The features include color, motion, depth, and position, denoted as among them,...

Example Embodiment

[0084] Example 2

[0085] The method of this example is the same as that of Example 1. Figure 7 Is the grayscale image of the color image in this example, Figure 8 Is the depth image of this example. The saliency optimization result of the current frame obtained by the above method is as follows Picture 9 As shown, it can be seen that the boundary of the saliency region is clear and the contour of the region is complete, and the result can clearly and accurately reflect the saliency region.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A 3D video saliency detection method belongs to the technical field of video image processing to overcome the disadvantage that the prior art cannot accurately reflect the saliency region of the 3D video. Including: obtaining the color image and depth image of the current frame in the 3D video, and the color image of the next frame; combining the color image and the depth image to perform superpixel segmentation on the current frame to form a superpixel segmentation area, and extracting The features of each superpixel segmentation region; use the global contrast method to calculate the initial feature saliency according to the global contrast of different features, and then fuse the initial feature saliency to obtain the initial saliency of the current frame; establish superpixels according to the superpixel segmentation results The graph theory model calculates the probability of saliency state transition between adjacent superpixels based on the feature similarity of adjacent superpixels, iteratively updates the initial saliency according to the saliency transition probability, and obtains the saliency optimization result of the current frame; applicable for processing video.

Description

technical field [0001] The invention belongs to the technical field of video image processing, and relates to a video image saliency detection method, in particular to a 3D video saliency detection method that effectively combines 3D video color information and depth information. Background technique [0002] Saliency detection technology is an important research content in the field of computer vision. Its purpose is to detect more important or more informative regions on the image for subsequent processing. At present, saliency detection technology has been researched and applied in the fields of video compression coding, visual quality assessment, image retrieval, object detection, and image segmentation. The important areas in visual information can be obtained through saliency detection technology, which simplifies the usual needs. In the process of processing the entire visual area, the complex calculation process is concentrated in these important areas, which greatly...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06T7/11G06T7/246
CPCG06T7/0002G06T2207/10021
Inventor 张萍浦洋南立园汪阳彭真明
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products