Hidden structure learning-based image digest generation method

A technology of image summarization and abstract, applied in the direction of editing/combining graphics or text, special data processing applications, instruments, etc., can solve the problems of information differences, failure to comprehensively consider complementary information and redundant information, subject differences, etc., and achieve good results. effect, high information coverage, low information redundancy effect

Active Publication Date: 2014-01-22
ZHEJIANG UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Third, the differences in topics, that is, the information contained and preferred by different topic-related image sets are different
Because many traditional summarization methods often consider each picture in the summation independently, and do not comprehensively consider the complementary information and redundant information contained in each picture in the summarization picture set, so they cannot comprehensively analyze the original picture set and get a good result. summary of
In addition, although some summary generation methods proposed in the past consider the collection of summary pictures as a whole structure, they do not take into account the differences of related topics, so they cannot well adapt to user needs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hidden structure learning-based image digest generation method
  • Hidden structure learning-based image digest generation method
  • Hidden structure learning-based image digest generation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0071] 19 picture collections are selected from the database, and different picture collections are associated with different themes, for example, plane crash, briefcase, sea, factory workers, etc. The picture collection of each topic contains 30 to 70 pictures, and 6 pictures are manually selected as the abstract picture collection. First, the color histogram, visual word and direction gradient histogram features are extracted from these pictures, and then the three features are normalized and fused, so that each picture is projected into a 2450-dimensional feature space. In the process of normalization, the normalization method of normalizing to 0.1 to 0.9 is used. For example, in the color histogram features of all pictures, the maximum value is max and the minimum value is min, then for a value x of a certain dimension, the normalized feature value will become 0.1+(x-min)(max- min) × (0.9-0.1). In this way, the minimum value of the color histogram feature is converted to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hidden structure learning-based image digest generation method. The method comprises the following steps: (1) extracting the HSV (Hue, Saturation and Value) color histogram characteristic, visual word characteristic and orientation histogram characteristic of a picture; (2) performing normalization preprocessing on the three characteristics extracted in the previous step and combining the three characteristics into a characteristic vector after normalization; (3) constructing a structural support vector machine with a hidden variable, selecting training sets from a database for many times, and performing weight coefficient learning on picture sets related to different subjects in a training set; (4) selecting picture sets related to different subjects from the database by using the weight coefficient obtained by the learning in the previous step, predicting hidden characteristic selection preferences of the picture sets and generating a digest picture set corresponding to the hidden characteristic selection preferences. The method has higher information coverage and lower redundancy, can implicitly learn the different preferences of the picture sets related to the different subjects in characteristic selection and has a better effect compared with the conventional method.

Description

technical field [0001] The invention relates to image summary generation, in particular to an image summary generation method based on hidden structure learning. Background technique [0002] At present, with the development of storage technology and network technology, a large number of image files are uploaded on the Internet every day. On the one hand, users can access more and more image data, on the other hand, the increasingly complex structure and redundancy of the data itself also bring great difficulties to users to obtain useful information. For example, users can use search engines to search a large number of pictures through keywords, but these pictures contain a large number of heavily similar pictures, which hinders the overall presentation of information, and a summary that takes into account information coverage and redundancy becomes more reasonable. Another example is that there are a large number of personal photo albums on the photo sharing website Flick...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/66G06F17/30G06T11/60
Inventor 汤斯亮邵健方晗吟吴飞庄越挺
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products