Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D Video Saliency Detection Method

A detection method and saliency technology, applied in image data processing, instrumentation, calculation, etc., can solve the problem of not being able to correctly reflect the saliency area of ​​real images, and achieve the effect of improving accuracy and accuracy

Inactive Publication Date: 2018-01-09
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional saliency detection methods for 2D video images only focus on color information, and the detection results cannot correctly reflect the salient regions of real images when they are directly applied to 3D video images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D Video Saliency Detection Method
  • A 3D Video Saliency Detection Method
  • A 3D Video Saliency Detection Method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] like figure 1 As shown, the operation steps in this example are as follows:

[0046] 1. Input the 3D video sequence to be processed, which specifically includes a color sequence and a depth sequence. This method uses a frame-by-frame processing method. If you want to process a certain frame of image, you need to obtain the input color image Color1 and depth image Depth1 of the current frame to be processed, as well as the color image Color2 of the next frame of the current frame. .

[0047] 2. Perform superpixel segmentation and feature extraction on the input 3D video frame.

[0048] Combining its color image Color1 and depth image Depth1 to perform superpixel segmentation on the current frame to obtain N superpixel segmentation regions, denoted as R={R 1 , R 2 ,...,R i ,...,R N}. According to the superpixel segmentation results, the features of each superpixel segmentation region are extracted, the features include color, motion, depth and position, denoted as ...

Embodiment 2

[0085] The method of this example is the same as that of Example 1. Figure 7 is the grayscale image of the color image in this example, Figure 8 is the depth image in this example, the current frame saliency optimization result obtained by the above method is as follows Figure 9 As shown, it can be seen that the boundary of the salient region is clear, and the outline of the region is complete. This result can clearly and accurately reflect the salient region.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A 3D video saliency detection method belongs to the technical field of video image processing to overcome the disadvantage that the prior art cannot accurately reflect the saliency region of the 3D video. Including: obtaining the color image and depth image of the current frame in the 3D video, and the color image of the next frame; combining the color image and the depth image to perform superpixel segmentation on the current frame to form a superpixel segmentation area, and extracting The features of each superpixel segmentation region; use the global contrast method to calculate the initial feature saliency according to the global contrast of different features, and then fuse the initial feature saliency to obtain the initial saliency of the current frame; establish superpixels according to the superpixel segmentation results The graph theory model calculates the probability of saliency state transition between adjacent superpixels based on the feature similarity of adjacent superpixels, iteratively updates the initial saliency according to the saliency transition probability, and obtains the saliency optimization result of the current frame; applicable for processing video.

Description

technical field [0001] The invention belongs to the technical field of video image processing, and relates to a video image saliency detection method, in particular to a 3D video saliency detection method that effectively combines 3D video color information and depth information. Background technique [0002] Saliency detection technology is an important research content in the field of computer vision. Its purpose is to detect more important or more informative regions on the image for subsequent processing. At present, saliency detection technology has been researched and applied in the fields of video compression coding, visual quality assessment, image retrieval, object detection, and image segmentation. The important areas in visual information can be obtained through saliency detection technology, which simplifies the usual needs. In the process of processing the entire visual area, the complex calculation process is concentrated in these important areas, which greatly...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/00G06T7/11G06T7/246
CPCG06T7/0002G06T2207/10021
Inventor 张萍浦洋南立园汪阳彭真明
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com