3D SIFT (3D Scale-invariant feature transform) framework-based detection method and device of spatio-temporal interest points (STIPs)

A spatio-temporal interest point and framework technology, applied in the detection field of spatio-temporal interest points, can solve the problems of reducing the repeatability and robustness of spatio-temporal interest points, and underutilizing video temporal motion change information.

Inactive Publication Date: 2017-11-28
SHENZHEN UNIV
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a method and device for detecting spatio-temporal interest points based on 3D SIFT framework, aiming to solve the problem of insufficient use of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D SIFT (3D Scale-invariant feature transform) framework-based detection method and device of spatio-temporal interest points (STIPs)
  • 3D SIFT (3D Scale-invariant feature transform) framework-based detection method and device of spatio-temporal interest points (STIPs)
  • 3D SIFT (3D Scale-invariant feature transform) framework-based detection method and device of spatio-temporal interest points (STIPs)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0028] Due to the lack of full use of the motion change information in the time domain of the video in the prior art, performance technical problems such as repeatability and robustness of the temporal and spatial interest points of the video are reduced.

[0029] In order to solve the above technical problems, the present invention proposes ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a 3D SIFT (3D Scale-invariant feature transform) framework-based detection method and device of spatio-temporal interest points (STIPs). The method and device combine gray information and motion change information. Compared with the prior art, the method constructs a GMCM (Gray and Motion Change Information Matrix) which is under a geometric algebra framework and contains the gray information and the motion change information, and constructs and obtains scale space through the GMCM; because the GMCM contains the gray information of pixels of a video in three-dimensional geometric algebraic space, and also contains the motion change information, the constructed and obtained scale space is related to the motion change information; and the scale space and a pyramid model constructed and obtained by utilizing the GMCM realize detection of the spatio-temporal interest points, the motion change information of the video on a time domain is fully utilized, and the repeatability, the robustness and other performance of the spatio-temporal interest points are enhanced.

Description

technical field [0001] The present invention relates to the field of video image processing, in particular to a method for detecting spatiotemporal interest points based on a 3D scale-invariant feature transform (3DScale-invariant feature transform, 3D SITF) framework. Background technique [0002] Behavior recognition in video is a hot research topic at present. Although the behavior recognition method based on deep learning has made breakthroughs in behavior recognition on large video data sets, it is difficult to apply it to small sample data sets. For example, the video data of traffic accidents, because the data of traffic accidents is difficult to collect and simulate, and the amount of data is very limited, it is difficult to apply deep learning methods to the identification of traffic accidents in videos. However, the traditional behavior recognition algorithms based on video spatio-temporal interest points (Spatio-Temporal Interest Point, STIP for short) and support...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/46G06K9/00
CPCG06V20/46G06V10/462
Inventor 李岩山李庆腾李泓毅谢维信
Owner SHENZHEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap