A panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics

A panoramic image and visual characteristic technology, which is applied in image data processing, instruments, character and pattern recognition, etc., can solve the problems of different viewing methods of panoramic images and the inability to obtain saliency maps, etc., and achieve the effect of improving the display effect
CN109166178AActive Publication Date: 2019-01-08INST OF INFORMATION ENG CHINESE ACAD OF SCI
7 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN Ā· China
Patent Type
Applications(China)
Current Assignee / Owner
INST OF INFORMATION ENG CHINESE ACAD OF SCI
Publication Date
2019-01-08

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a panoramic image salience image generation method and system for fusion of visual characteristics and behavioral characteristics. The method comprises the following steps: 1)converting a panoramic image from an equal rectangular domain to a spherical domain, and then converting the panoramic image from the spherical domain to a view angle domain to obtain a view angle plane image corresponding to the panoramic image; 2) using the Gaussian difference filter to process the plane image of the view angle to obtain DoG values of each pixel in the image in the visual space;3) using the Euclidean distance value between the DoG value corresponding to each pixel and the average DoG value to represent the visual feature saliency of the corresponding pixel on the whole panoramic image, and obtaining the visual feature saliency map SV corresponding to the panoramic image; 4) obtaining the behavior characteristic salience map Sb of the user viewing the panoramic image according to the actual head movement data of the user; 5) fusing the visual characteristic salience map SV and the behavior characteristic salience map Sb to obtain the final panoramic image salience map S. The method greatly improves the display effect of the panoramic image.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The technical field of computer software of the present invention relates to a method and system for generating a saliency map of a panoramic image in which visual characteristics and behavioral characteristics are fused. Background technique

[0002] In recent years, panoramic images have attracted attention because they can capture a wide view of surrounding scenes. By using a head-mounted display (HMD), panoramic images can give viewers an immersive visual experience. Based on this feature, panoramic images have been widely used in many virtual reality (VR) applications.

[0003] The spatial size of panoramic images is much larger than that of traditional images. It is very difficult to store and transmit panoramic images under existing conditions. However, the human visual attention mechanism (Visual Attention Mechanism) is a kind of selective attention. Users usually only Focus on a small portion of the entire panoramic image. Distinguish salie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More