Very-large-scale automatic categorizer for Web content

Abstract

A method and apparatus for efficiently classifying and categorizing data objects such as electronic text, graphics, and audio based documents within very-large-scale hierarchical classification trees is provided. In accordance with one embodiment of the invention, a first node of a plurality of nodes of a subject hierarchy is selected. Previously classified data objects corresponding to a selected first node of a subject hierarchy as well as any associated sub-nodes of the selected node are aggregated to form a content class of data objects. Similarly, data objects corresponding to sibling nodes of the selected node and any associated sub-nodes of the sibling nodes are then aggregated to form an anti-content class of data objects. Features are then extracted from each of the content class of data objects and the anti-content class of data objects to facilitate characterization of said previously classified data objects.

Description

RELATED APPLICATIONS [0001] This application is a non-provisional application of the earlier filed provisional application No. 60 / 289,418, filed on May 7, 2001, and claims priority to the earlier filed '418s provisional application, whose specification is hereby fully incorporated by reference.BACKGROUND OF THE INVENTION [0002] 1. Field of the Invention [0003] The invention relates to the field of data processing. More specifically, the invention relates to the automatic analysis of the content of electronic data objects and the categorization of the electronic data objects into one or more discrete categories. [0004] 2. Background Information [0005] The Internet consists of billions of discrete pages, which can be accessed from any browser-equipped computer or appliance connected to the World Wide Web (hereinafter “Web”). The availability of so many pages simultaneously represents both a boon and a bane to the user. Information, opinion, and news are available about a vast array of...

AI Technical Summary

Problems solved by technology

Information, opinion, and news are available about a vast array of topics, but the challenge is to find those pages of the Web which are most relevant to the particular needs or desires of the user at any given moment.

This method has several problems, including the cost of finding experts to perform the classification, and the necessary backlog between the time a site is placed on the Web and the time (if ever) it enters the classification hierarchy, moreover a grader expert in one subject area may misclassify a page of another subject, which can make the page more difficult to find for the casual browser.

Although this is an active area of research, existing systems typically work with only a limited number of subject fields and often display poor performance.

Images