A Method and System for Extracting Regions of Interest in Images Based on Two-step Clustering of Eye Track Data

A technology of region of interest and extraction method, applied in the field of eye movement data analysis, can solve the problem that the task of extracting region of interest cannot be efficiently completed, and it consumes a lot of time and manpower.

Active Publication Date: 2020-07-10
WUHAN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the target contains content of different shapes and randomly distributed, such as natural scene images, the manual labeling method cannot efficiently complete the task of extracting the region of interest, especially when the number of images is large, the manual labeling method needs to consume a lot of time. time and manpower

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method and System for Extracting Regions of Interest in Images Based on Two-step Clustering of Eye Track Data
  • A Method and System for Extracting Regions of Interest in Images Based on Two-step Clustering of Eye Track Data
  • A Method and System for Extracting Regions of Interest in Images Based on Two-step Clustering of Eye Track Data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0102] The present invention first clusters the eye movement track data of every two observers in turn, obtains the clustering results of the data of every two observers, and detects and eliminates noise points for each class at the point level and the class level respectively, Obtain effective eye track points that belong to the gaze process; secondly, the pre-clustering results after removing noise are merged into a group and then clustered again to obtain the final clustering results, in which each class represents an interesting point in the image Regional location.

[0103] The technical scheme of the invention can adopt computer software to support the automatic operation process. The technical solution of the present invention will be described in detail below in conjunction with the drawings and embodiments.

[0104] An embodiment comprises a pre-clustering phase and a clustering phase,

[0105] 1. The pre-clustering stage carries out the removal of eye movement data...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method for extracting image regions of interest based on two-step clustering of eye movement data, including a pre-clustering stage and a clustering stage; wherein the pre-clustering stage aims to eliminate noise points in the eye movement data, and input test pictures Based on the eye movement trajectory point data of multiple people on the Internet, the trajectory point data of each two people are combined for clustering, and the noise points are eliminated based on the recognition standards at the point level and the class level, and the eye movement trajectory points belonging to the effective fixation process are retained. The clustering stage aims to extract the region of interest from the effective eye movement trajectory points, and takes all the eye movement trajectory points belonging to the effective fixation process as input, and first clusters the points, where each class represents a region of interest, and the center represents The location of the region of interest, and the number of points in the class represents how much the region attracts attention. The present invention analyzes the trajectory points of multiple people through two-step clustering, and the extracted result of the region of interest is more in line with the human visual attention mode, and has better stability and anti-noise interference ability.

Description

technical field [0001] The invention relates to the field of eye movement data analysis, in particular to a method and system for extracting regions of interest based on two-step clustering of eye movement data. Background technique [0002] The eye tracker can be used to record the eye movement characteristics of the human eye when processing visual information, including eyeball position, fixation duration and fixation position and other related information. With the intelligent development of eye tracker hardware and related software, eye movement data is widely used in psychological Academic research fields such as science and medicine, and commercial fields such as advertising and web page optimization. Among them, one of the application hotspots of the eye tracker is to find the user's interest area for a certain visual target through the distribution characteristics of the user's eye movement data. Correspondingly, extracting image regions of interest based on eye mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/62
CPCG06V40/18G06V10/25G06F18/23G06F18/22
Inventor 陈震中张滢雪
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products