Video behavior timeline detection method

A detection method and time axis technology, applied in the field of video analysis, can solve problems such as insufficient use of candidate frames and efficiency to be improved

CN108830212AActive Publication Date: 2018-11-16PEKING UNIV SHENZHEN GRADUATE SCHOOL
5 Cites 20 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2018-11-16

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a video behavior timeline detection method. The method comprises the following steps: performing modeling based on a deep learning and time structure, detecting a video behavior timeline in combination with coarse granularity detection and fine granularity detection, and extracting temporal and spatial characteristics of a video by using a dual-flow model on the basis of anexisting model SSN; modeling a time structure of a behavior, and dividing a single behavior into three stages; then providing a new characteristic pyramid capable of effectively extracting time boundary information of a video behavior; and finally, combining the coarse granularity detection and the fine granularity detection to make a detection result more precise. The video behavior timeline detection method is high in detection precision, and the detection precision is higher than the detection precision of all of the current existing disclosed methods; the video behavior timeline detectionmethod is wide in application range, is applicable to detection of video clips in which people are interested in an intelligent monitoring system or a human-machine supervision system, is favorable for subsequent analysis and processing, and has an important application value.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the technical field of video analysis, in particular to a video behavior timeline detection method, which is based on deep learning and combined with video context information to detect the timeline of human behavior in a video. Background technique

[0002] Videos containing human behavior can be divided into two categories: one is artificially cropped video containing only human behavior without any extraneous background video; the other is uncropped video after shooting, in which not only Includes human behavior and contains extraneous background segments such as credits, audience, etc. Video behavior timeline detection refers to locating the start time and end time of human behavior in a video that has not been manually cropped, and identifying the category of human behavior. The existing video behavior timeline detection methods mainly follow a two-step strategy: first, extract a large number of video behavior tim...

Examples

Embodiment Construction

[0029] Below in conjunction with accompanying drawing, further describe the present invention through embodiment, but do not limit the scope of the present invention in any way.

[0030] Video behavior timeline detection is a subproblem of video behavior detection, which mainly focuses on locating the beginning and end of time when behaviors occur within a video. It plays a key technical support role in the fields of intelligent monitoring system, human-computer interaction and video search. Since the video contains a lot of information, most of which are useless noise, it is very important to automatically locate the video segments of human interest on the time axis for subsequent processing before processing. In practical applications, quite high requirements are placed on the accuracy of video behavior positioning. In order to accurately locate the start time and end time of a video action, it is very important to extract the time boundary information of the action. This ...