Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video copy detection method based on time-domain visual attention

A technology for video copy detection and visual attention, which is applied in the fields of instrumentation, computing, and electrical digital data processing.

Inactive Publication Date: 2013-02-13
SHANDONG UNIV
View PDF1 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These forms are all based on experiments and have no systematic theoretical support.
Moreover, this type of method does not highlight the content changes in the time domain of the video, and cannot effectively extract the information that highlights the video content, and lacks robustness to attacks in the time domain.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video copy detection method based on time-domain visual attention
  • Video copy detection method based on time-domain visual attention
  • Video copy detection method based on time-domain visual attention

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Videos including documentaries, news, sports, animation, etc. were used in the experiment, and video attacks including histogram equalization, Gaussian noise, contrast change, random frame swapping, frame dropping, random frame plus Gaussian noise, etc. were used.

[0039] figure 1 Provided the frame diagram of the inventive method, according to shown flow process, comprise following concrete steps:

[0040] (1) Build a visual attention model for videos.

[0041] a. For the establishment of a static attention model for video frames, we first perform multi-scale transformation on video frames, and then extract local contrast features such as color, brightness, and texture. The corresponding feature maps are generated according to the local control maps at different scales, and then the global normalized feature maps are linearly combined to form the final saliency map, namely S_sm.

[0042] b. Use the block-based LK optical flow algorithm to obtain the optical flow LK ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video copy detection method based on time-domain visual attention. The method comprises the following steps of: acquiring visual attention changes between different video frames according to a visual attention mechanism, and acquiring representation of time-domain attention degree; calculating a time-domain attention weight of a video frame in a video clip according to the time-domain attention degree to form a visual attention transfer image of the video clip; and finally, extracting video hash on the generated visual attention transfer image provided with time domain and space domain information. By the method, the time domain information of the video is fully considered, a video frame which makes the video content prominent is weighted, the time domain and space domain information is integrated through the extracted characteristics, and the video copy detection method has high robustness on time domain attacks.

Description

technical field [0001] The invention relates to a video copy detection method based on time-domain visual attention, and belongs to the technical field of content-based video retrieval. Background technique [0002] With the development of multimedia technology, thousands of digital videos are generated and released every day. Using digital processing tools, videos can be converted into various versions. Therefore, how to quickly and effectively find the copy of digital video from a large number of videos has become an urgent problem to be solved. In addition to copyright protection, copy detection can also be applied to de-redundancy of video search results, filtering of harmful content videos, etc., which has huge market application demand and broad application prospects. Content-based video copy detection technology is produced under such circumstances, and has become a research hotspot in recent years. At present, many copy detection technologies detect the spatial fe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06K9/00
Inventor 孙建德柳晓翠张丽坤
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products