Method and system for inserting and transforming advertisement sign based on visual attention module

A technology of visual attention and advertising signs, which is applied in the field of automatic insertion and transformation of advertising signs and systems, can solve the problems of not being able to guarantee users and repeatedly attracting the audience's attention, and achieve good advertising effects

Inactive Publication Date: 2010-01-06
PEKING UNIV
View PDF2 Cites 64 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 2) There is no guarantee that the ad will repeatedly capture the viewer's attention

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for inserting and transforming advertisement sign based on visual attention module
  • Method and system for inserting and transforming advertisement sign based on visual attention module
  • Method and system for inserting and transforming advertisement sign based on visual attention module

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] The method flowchart of embodiment 1 invention is as figure 2 As shown, in general, there are three main problems to be solved to automatically insert an advertisement logo into video content. That is, (1) determine the time point of advertisement insertion; (2) detect the position suitable for advertisement insertion; (3) find a suitable advertisement logo conversion method. In order to determine the insertion time point, it is necessary to predict the degree of attention of the user to each frame of the video, the purpose of which is to reduce the impact of the inserted advertisement logo on the user's viewing, that is, insert the advertisement only in the frames that the user is not interested in or relatively low in attention sign. To this end, a visual attention model needs to be built first to predict the degree of user attention to each frame and the location of the region of interest.

Embodiment 2

[0048] Example 2 image 3 It is a flow chart of user attention prediction according to the present invention. From the results of psychological research and intuitive experience, the user's attention changes are mainly affected by two aspects: short-term attention and long-term attention, in which short-term attention is mainly affected by changes in single-frame or short-term features , such as color contrast, color variation, etc. The present invention first uses image segmentation algorithm to divide each frame into multiple regions, and according to the results of psychological research and intuitive experience, the following attention extraction rules are defined for each object to calculate short-term attention:

[0049] 1) In the same situation, users tend to notice larger objects (regions);

[0050] 2) Under the same circumstances, users tend to notice objects (regions) with complex content;

[0051] 3) In the same situation, users tend to notice objects (regions) w...

Embodiment 3

[0080] Embodiment 3 The above-mentioned short-term salience can generally be equivalent to the prediction of the user's short-term attention. In addition, the user's attention distribution is not only affected by short-term attention, but also affected by long-term attention. For example in figure 1 In (a), the short-term saliency such as the color salience of the advertising logo is relatively large, but in fact users often ignore these advertising logos; this is because the advertising logo appears for a long time, and during this long period of time The color pattern and motion pattern of the advertising logo remain unchanged, and when users are familiar with the color pattern and motion pattern, they will ignore these advertising logos. In order to illustrate the impact of this long-term attention, the present invention describes the user's long-term attention by the degree of familiarity with motion patterns and color patterns. In long-term attention, the movement patte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for inserting and transforming an advertisement sign based on a visual attention module. The method comprises the following steps: firstly, predicting interest areas in various areas of each frame of video and the attention degree on each frame of a user on the basis of the constructed visual attention model; secondly, determining a time point for inserting an advertisement according to a curve of the attention degree on each frame of the user, evaluating the fitness degree of inserting the advertisement in the various areas on the basis of predicted attention distribution, further acquiring a sequence of candidate areas for inserting the advertisement, and inserting the advertisement in an area with little influence on video content; and finally, inserting the advertisement sign into proper time point and position according to the predicted attention distribution, and performing multiple feature transformation on the advertisement sign to make the advertisement sign attract the attention of users or audience repeatedly. The method and the system can effectively perform automatic insertion and transformation of the advertisement sign, and make the inserted advertisement sign attract the attention of people repeatedly in the condition of not influencing normal watching.

Description

technical field [0001] The invention relates to an image and video processing method, in particular to a method and system for automatically inserting and transforming advertising signs based on a visual attention model. Background technique [0002] With the rapid development of video broadcast technology, video broadcast and video files have experienced explosive growth; at the same time, the method of inserting corresponding advertising signs in video broadcast and video files for advertising has also been widely used. For example, when browsing video broadcasts on common video broadcasting websites (such as "Youku", "Tudou", etc.), generally a corresponding advertising website logo will be added in the lower right corner or upper right corner of the video program. It is also common to see logos of relevant program sponsors superimposed on television video programming while watching television programming. However, as attached figure 1 As shown in (a), this kind of logo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N5/272H04N5/445
Inventor 田永鸿李甲黄铁军高文
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products