A visually disabled person-oriented automatic picture description method for web content barrier-free access

Abstract

The invention discloses a visually disabled person-oriented automatic picture description method for web content barrier-free access. The method comprises the steps of: grabbing tagged pictures from the network to form a sample library of annotated pictures; sorting the picture tags of the annotated picture sample library to realize tag denoising; generating tag recommendation words for illustrations of the webpages by using similar pictures of the sample library; and extracting sentences from contexts of the positions where the pictures are located on the WebPages in combination with tag words and using the sentences as descriptions of the pictures. The method comprehensively uses the tag ordering, tag recommending, and webpage document abstracting technology to generate brief descriptions for the pictures, and thus improves the webpage content barrier-free access for vision disabilities, thereby improving their web experience.

Description

technical field [0001] The invention relates to the field of automatic picture description, in particular to an automatic picture description method for visually disabled web page content barrier-free access. Background technique [0002] According to the second national sample survey of disabled people in April 2006, there are 16.91 million visually disabled people in China, including 12.33 million with single visually disabled people and 4.58 million with multiple disabled people with visually disabled people. Dr. Thylefore, Director of the Prevention of Blindness and Deafness Program of the World Health Organization in Geneva, pointed out that China is the country with the largest number of blind people in the world, accounting for 18% of the blind people in the world. About 450,000 people go blind in China every year, almost one case of blindness occurs every minute. If current trends are assumed to continue, the number of blind people in China is expected to increase f...

AI Technical Summary

Problems solved by technology

[0004] 1) Screen reading software has narrow bandwidth and can only support sequential information access;

[0005] 2) Lack of visual information assistance, it is difficult to understand the content of the picture itself only from the picture instead of text description;

[0006] 3) Many webpage images lack alternative text, and the existing alternative text descriptions often lack useful information

[0007] The existing automatic image tagging technology aims to generate several related tag words for pictures. These tag words can effectively assist image classification and retrieval, but their role in helping blind people understand the content of pictures is limited.

Existing image annotation technologies cannot automatically extract high-level semantic information directly from general image content

Images