A visually disabled person-oriented automatic picture description method for web content barrier-free access

A technology for the visually impaired and web page content, applied in the field of automatic picture description, can solve problems such as difficulties, narrow bandwidth of screen reading software, lack of visual information assistance, etc., and achieve the effect of improving understanding

Inactive Publication Date: 2012-09-12
ZHEJIANG UNIV
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1) Screen reading software has narrow bandwidth and can only support sequential information access;
[0005] 2) Lack of visual information assistance, it is difficult to understand the content of the picture itself only from the picture instead of text description;
[0006] 3) Many webpage images lack alternative text, and the existing alternative text descriptions often lack useful information
[000

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A visually disabled person-oriented automatic picture description method for web content barrier-free access
  • A visually disabled person-oriented automatic picture description method for web content barrier-free access

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0033] The present invention will be further described below in conjunction with the drawings and embodiments.

[0034] 1. Grab tagged pictures on the Internet as a sample library of tagged pictures: Grab pictures and their corresponding tags from many current picture sharing websites. Commonly used picture sharing sources include: (1) Flickr, currently the most widely used picture sharing website, and provides a complete download API; you can use the Flickr API to grab a large number of pictures and corresponding tags. (2) LabelMe, this picture source provides a large number of high-quality label pictures.

[0035] 2. Sort the image tags in the annotated image sample library to achieve tag denoising:

[0036] 2.1) Use image color, texture, and shape features to measure the similarity between images, and use neighbor voting to sort image tags as the initial result of the sorting;

[0037] 2.2) Construct the jump probability matrix in the graph sorting algorithm according to the relat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a visually disabled person-oriented automatic picture description method for web content barrier-free access. The method comprises the steps of: grabbing tagged pictures from the network to form a sample library of annotated pictures; sorting the picture tags of the annotated picture sample library to realize tag denoising; generating tag recommendation words for illustrations of the webpages by using similar pictures of the sample library; and extracting sentences from contexts of the positions where the pictures are located on the WebPages in combination with tag words and using the sentences as descriptions of the pictures. The method comprehensively uses the tag ordering, tag recommending, and webpage document abstracting technology to generate brief descriptions for the pictures, and thus improves the webpage content barrier-free access for vision disabilities, thereby improving their web experience.

Description

technical field [0001] The invention relates to the field of automatic picture description, in particular to an automatic picture description method for visually disabled web page content barrier-free access. Background technique [0002] According to the second national sample survey of disabled people in April 2006, there are 16.91 million visually disabled people in China, including 12.33 million with single visually disabled people and 4.58 million with multiple disabled people with visually disabled people. Dr. Thylefore, Director of the Prevention of Blindness and Deafness Program of the World Health Organization in Geneva, pointed out that China is the country with the largest number of blind people in the world, accounting for 18% of the blind people in the world. About 450,000 people go blind in China every year, almost one case of blindness occurs every minute. If current trends are assumed to continue, the number of blind people in China is expected to increase f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 王灿卜佳俊汪兆鹏陈纯陈争光
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products