Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image summarization method based on hidden structure learning

A technology of image summarization and summarization, which is applied in the direction of editing/combining graphics or text, special data processing applications, instruments, etc., can solve the problems of not comprehensively considering complementary information and redundant information, information differences, theme differences, etc., to achieve high The effect of information coverage, low information redundancy, and good effect

Active Publication Date: 2017-01-11
ZHEJIANG UNIV
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Third, the differences in topics, that is, the information contained and preferred by different topic-related image sets are different
Because many traditional summarization methods often consider each picture in the summation independently, and do not comprehensively consider the complementary information and redundant information contained in each picture in the summarization picture set, so they cannot comprehensively analyze the original picture set and get a good result. summary of
In addition, although some summary generation methods proposed in the past consider the collection of summary pictures as a whole structure, they do not take into account the differences of related topics, so they cannot well adapt to user needs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image summarization method based on hidden structure learning
  • Image summarization method based on hidden structure learning
  • Image summarization method based on hidden structure learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0070] 19 picture collections are selected from the database, and different picture collections are associated with different themes, for example, plane crash, briefcase, sea, factory workers, etc. The picture collection of each topic contains 30 to 70 pictures, and 6 pictures are manually selected as the abstract picture collection. First, the color histogram, visual word and direction gradient histogram features are extracted from these pictures, and then the three features are normalized and fused, so that each picture is projected into a 2450-dimensional feature space. In the process of normalization, the normalization method of normalizing to 0.1 to 0.9 is used. For example, in the color histogram features of all pictures, the maximum value is max and the minimum value is min, then for a value x of a certain dimension, the normalized feature value will become 0.1+(x-min)(max- min) × (0.9-0.1). In this way, the minimum value of the color histogram feature is converted to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image summary generation method based on hidden structure learning. It includes the following steps: 1) extract HSV color histogram features, visual word features and direction histogram features from the picture; 2) perform normalized preprocessing on the three features extracted in the previous step and normalize the three features 3) Construct a structural support vector machine with hidden variables, select the training set from the database multiple times, and use the picture sets related to different topics in the training set to learn the weight coefficient; 4) Use the above The weight coefficient obtained by one-step learning, selects different topic-related image sets from the database, predicts their implicit feature selection preferences, and generates a corresponding abstract image set. The present invention has higher information coverage and lower redundancy, and can implicitly learn different preferences in feature selection of image collections related to different topics, and achieves better results than traditional methods.

Description

technical field [0001] The invention relates to image summary generation, in particular to an image summary generation method based on hidden structure learning. Background technique [0002] At present, with the development of storage technology and network technology, a large number of image files are uploaded on the Internet every day. On the one hand, users can access more and more image data, on the other hand, the increasingly complex structure and redundancy of the data itself also bring great difficulties to users to obtain useful information. For example, users can use search engines to search a large number of pictures through keywords, but these pictures contain a large number of heavily similar pictures, which hinders the overall presentation of information, and a summary that takes into account information coverage and redundancy becomes more reasonable. Another example is that there are a large number of personal photo albums on the photo sharing website Flick...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/66G06F17/30G06T11/60
Inventor 汤斯亮邵健方晗吟吴飞庄越挺
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products