Unlock instant, AI-driven research and patent intelligence for your innovation.

Video Semantic Block Segmentation Method Based on Optical Flow Clustering

A semantic block and clustering technology, which is applied in the fields of digital video signal modification, electrical components, image communication, etc., can solve the problem that there is no way to grasp the global characteristics of the scene.

Active Publication Date: 2017-02-01
SHANGHAI JIAOTONG UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method mainly uses the correlation of foreground motion to find semantic blocks. The main problem is that it mainly considers the correlation of motion patterns of adjacent frames and adjacent pixels, and there is no way to grasp the global characteristics of the scene.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video Semantic Block Segmentation Method Based on Optical Flow Clustering
  • Video Semantic Block Segmentation Method Based on Optical Flow Clustering
  • Video Semantic Block Segmentation Method Based on Optical Flow Clustering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0028] This embodiment is carried out on the premise of the technical solution of the present invention, and the detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

[0029] This embodiment includes the following steps:

[0030] Step 1: Obtain the optical flow field of the input video (a total of T frames, each frame has M×N pixels, M and N are the length and width of each frame image) (a t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video semantic block partition method based on light stream clustering. The detection result of consistent motion areas under the same motion mode and the light stream information are combined, a relevant matrix is built, spectral clustering is carried out, labels obtained after clustering are used as feature vectors, and secondary clustering is carried out on different motion modes. According to the method, the detection result of the consistent motion areas can be well applied, and the relevant information of the scene motion under the same motion mode and the global information of the scene motion under the different motion modes can be effectively mastered. The information of the scene motion is mastered accurately, and the method plays an important role in improving the accuracy rate of relevant applications like mode recognition.

Description

technical field [0001] The present invention relates to a video semantic block segmentation technology, in particular to a video semantic block segmentation technology based on optical flow clustering, that is, scene segmentation is performed through optical flow clustering of videos, and then the segmentation results are used to continue to obtain motion Chunking of patterns for more expressiveness. Background technique [0002] Semantic blocks in videos refer to regions with consistent motion patterns. Video semantic block segmentation is very important in the field of image processing, and it has a wide range of applications in traffic supervision, dense crowd monitoring, etc. [0003] Consistent motion area detection technology is a very important technology in the field of video and image processing. There are many methods for consistent motion area detection. It is found through literature retrieval of existing technologies, such as, S.Ali et al. in 2007 in " The pap...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/70H04N19/17H04N19/543H04N19/137
Inventor 林巍峣王薇月
Owner SHANGHAI JIAOTONG UNIV