Method and system for reducing lexical ambiguity
Inactive Publication Date: 2004-08-26
DUAN LEI +2
View PDF38 Cites 103 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, linguistic behavior cannot be completely accounted for without also taking into account another aspect of what makes humans intelligent--their general world knowledge and their reasoning abilities.
The complexity of the natural language process is increased due to lexical ambiguity of input sentences.
In character-based languages, e.g. in the Japanese language, extracting information from an input sentence creates a serious problem because Japanese sentences do not have spaces between words.
As a result, the parsing program is time consuming and requires a large amount of space for its operation.
If a long or complicated sentence is involved, such a parser may not be able to perform the parsing at all.
However, the segmentation selected based upon the lowest costs may not correspond to the correct meaning of the input sentence.
Since the syntactic parser is better equipped to recognize the correct meaning of the input sentence, making a selection before the parsing operation may result in loss of pertinent information.
Consequently, this approach may lead to inaccurate results in producing a response to an input sentence; especially in producing a response to a longer or more complicated sentence.
However, multiple POS tags of a word present the same problem for English sentences as they do for Japanese sentences.
In this approach, the parsing program is very time consuming and requires a large amount of space for its operation.
In addition, this approach may not be able to handle long and complicated sentences.
However, some probabilities may be hard to estimate.
No matter how much text is analyzed for the estimation, there will always be a large volume of words that appear only a few times. Thus, relying strictly on probabilities may not result in an accurate interpretation, especially in dealing with a long or complex sentence in which a word's meaning is dependent upon the context of the word within the sentence.
As explained earlier, since the syntactic parser is better equipped to recognize the correct meaning of the input sentence, making a selection before the parsing operation may result in loss of pertinent information.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0028] A method and system for reducing lexical ambiguity in an input stream are described. In one embodiment, the input stream is broken into tokens. The tokens are used to create a connection graph comprising a number of paths. Each of the paths is assigned a cost. At least one best path is defined based upon a corresponding cost to generate an output graph. The generated output graph is provided to reduce lexical ambiguity.
[0029] In the following detailed description of the present invention, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without these specific details. In some instances, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring the present invention.
[0030] Some portions of the detailed descriptions that follow are presented in terms of algorit...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A method and system for reducing lexical ambiguity in an input stream are described. In one embodiment, the input stream is broken into tokens. The tokens are used to create a connection graph comprising a number of paths. Each of the paths is assigned a cost. At least one best path is defined based upon a corresponding cost to generate an output graph. The generated output graph is provided to reduce lexical ambiguity.
Description
[0001] 1. Field of the Invention[0002] The present invention relates to language translation systems. More particularly, the present invention relates to a method for reducing lexical ambiguity.[0003] 2. Background Information[0004] With the continuing growth of multinational business dealings where the global economy brings together business people of all nationalities and with the ease and frequency of today's travel between countries, the demand for a machine-aided interpersonal communication system that provides accurate near real-time language translation, whether in spoken or written form, is a compelling need. This system would relieve users of the need to possess specialized linguistic or translational knowledge.[0005] A typical language translation system functions by using natural language process. Natural language processing is generally concerned with the attempt to recognize a large pattern or sentence by decomposing it into small subpatterns according to linguistic rul...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F17/27G06F17/28
CPCG06F17/2818G06F17/277G06F40/284G06F40/44
InventorDUAN, LEIFRANZ, ALEXANDERHORIGUCHI, KEIKO
OwnerDUAN LEI