Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

12 results about "Bigram" patented technology

A bigram or digram is a sequence of two adjacent elements from a string of tokens, which are typically letters, syllables, or words. A bigram is an n-gram for n=2. The frequency distribution of every bigram in a string is commonly used for simple statistical analysis of text in many applications, including in computational linguistics, cryptography, speech recognition, and so on. Gappy bigrams or skipping bigrams are word pairs which allow gaps (perhaps avoiding connecting words, or allowing some simulation of dependencies, as in a dependency grammar).

Hard tag text countermeasure attack sample generation method

The invention discloses a hard tag text adversarial attack sample generation method, which belongs to the technical field of text adversarial sample generation, and comprises the following steps: determining a text adversarial sample target; binary phrases are constructed for the original samples, and initial confrontation samples are generated by preferentially replacing the binary phrases; replacing unnecessary synonyms with original words; searching synonym iteration replacement optimization confrontation samples by determining transition replacement words; according to the hard tag text adversarial attack sample generation method, in an adversarial sample initialization stage, firstly, a high-frequency binary phrase is replaced to improve the quality of a generated initial adversarial sample; in the confrontation sample optimization stage, a relatively simple and effective mode is adopted to carry out iterative optimization, a generative method is not adopted any more, consumption of too much query times is avoided, the quality and efficiency of generating the confrontation sample are improved, the quality of the confrontation sample is remarkably improved in an attack scene closer to reality, and meanwhile, the query cost is reduced. And the query cost is reduced while the generation quality of the adversarial sample is improved.
Owner:LIYANG RES INST OF SOUTHEAST UNIV +2

Evaluating the quality of document changes

A method, computer program product, and computer system are provided for evaluating quality of changes to a collaborative document. Data corresponding to text, metadata, and comments associated with a document is received based on detecting a change to the document. The received data is analyzed based on term frequency, collocations including bigrams and trigrams, and colligates associated with the document. The analyzed data is compared to a corpus of documents from a domain associated with the document. A list of frequencies and collocates associated with the data is generated based on the comparison. An agreement score corresponding to agreement between comments, metadata, and document text is calculated based on the list of frequencies and collocates. The change to the document is caused to be displayed to a user based on the calculated agreement score.
Owner:INTERNATIONAL BUSINESS MACHINE CORPORATION

Discovery, extraction, and recommendation of talent-screening questions

Methods, systems, and computer programs are presented for automatically generating phrase-based talent-screening questions. One method includes analyzing job descriptions to generate ngrams. Each ngram comprises one or more words. Further, the method includes identifying, from the ngrams, an ngram set comprising a predetermined number of bigrams and trigrams according to frequency of appearance in the job descriptions. The method further includes removing, from the ngram set, bigrams and trigrams comprising one or more of stop words, negation words, or requirement words, to obtain first seed phrases. The first seed phrases are filtered based on a frequency of appearance of the seed phrase in the job descriptions to obtain second seed phrases. Further, the second seed phrases are added to the first seed phrases to obtain third seed phrases. Each seed phrase is a sequence of one or more words that is associated with a category of talent-screening questions.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

A bad review classification method, device and equipment based on a bert model and a medium

The present application relates to big data technology, and discloses a bad review classification method based on a BERT model, which comprises the following steps: data integration and data cleaning are performed on evaluation information to obtain effective evaluation data, and manual sentiment labeling is performed on the effective evaluation data to obtain labeled data; the labeled data is used to perform parameter tuning on a pre-trained BERT model, the trained BERT sentiment classification model is used to classify the evaluation data, positive sentiment data is removed, and data with an emotional category that is not equal to a star level in the evaluation is extracted, screened and labeled; the labeled data and the effective evaluation data are used to retrain the BERT model; negative sentiment data is subjected to word segmentation, a BTM (Bigram Topic Model) is used to extract a bad review theme of the negative word segmentation, and the evaluation information is classified according to the bad review theme. The present application also provides a bad review classification device, equipment and medium based on the BERT model. The present application can improve the accuracy of customer bad review information extraction.
Owner:CHINA PETROLEUM & CHEMICAL CORP +1

Identifying personally identifiable information within an unstructured data store

Methods and systems for identifying personally identifiable information (PII) are disclosed. In some aspects, frequency maps of fields storing known PII information are generated. The frequency maps may count occurrences of unique bigrams in the PII fields. A field of interest may then be analyzed to generate a second frequency map. Correlations between the first frequency maps and the second frequency map may be generated. If one of the correlations meets certain criterion, the disclosed embodiments may determine that the field of interest does or does not include PII. Access control for the field of interest may then be based on whether the field includes PII. In some aspects, a storage location of data included in the field of interest may be based on whether the field includes PII.
Owner:SNAP INC

Detecting fraud by calculating email address prefix mean keyboard distances using machine learning optimization

This disclosure relates to systems and methods for identifying fraudulent email addresses associated with an electronic payment service. In some implementations, a computing device receives an email with a prefix having a number of characters and characterized by a prefix length indicative of the number of characters in the prefix. The computing device identifies each of a number of bigrams is identified within the prefix, and determines a row and column distance for each bigram between two consecutive characters of the bigram as positioned on a keyboard. The computing device calculates a Euclidean distance between the two consecutive characters of the bigram based on the row and column distances, and determines a normalized distance based on the prefix length and an average of the Euclidean distances calculated for the number of bigrams in the prefix. The normalized distance is compared with a value to classify the email as suspicious or as not suspicious.
Owner:INTUIT INC

Character grouping method based on binary character frequencies and security character library construction method

The present invention particularly relates to a character grouping method based on bigram frequencies and a method for constructing a secure character library. The character grouping method includes the following steps: traversing a corpus to statistically obtain a bigram frequency matrix of the occurrences of any two characters among N characters to be grouped; traversing the characters one by one in descending order of character frequency, and calculating the weight of the character c to be assigned to the k-th group according to a formula; adding the character c to be assigned to the group with the largest weight, and so on until all characters are grouped. The bigram frequency matrix reflects the frequency of two characters appearing together. Through the weight calculation formula, the weight increases when two characters that often appear together are in different groups. In this way, we can make the characters that appear together be in different groups as much as possible by selecting the group with the largest weight, thereby realizing reasonable grouping of characters. This grouping method does not limit the number of characters in each group, making it more reasonable.
Owner:HEFEI HIGH DIMENSIONAL DATA TECH CO LTD

Natural language short text-oriented topic clustering processing method and device

The invention provides a natural language short text-oriented topic clustering processing method and device, relates to the technical field of natural language processing, and aims to solve the technical problems that an existing topic clustering method is low in timeliness and accuracy and difficult to meet actual requirements. The method comprises the steps of obtaining a natural language text to be processed, and performing word segmentation processing on the natural language text; on the basis of the natural language text subjected to word segmentation processing, stop words are removed, and the stop words represent words which do not contribute to semantics of the natural language text; based on the natural language text after the stop words are removed, introducing associated words from a pre-constructed knowledge graph to perform semantic enhancement on the natural language text; based on the natural language text after semantic enhancement, any two keywords are extracted for disordered combination, and binary phrases are generated; and inputting the binary phrases into a pre-trained topic clustering model for topic clustering to obtain topic distribution of the natural language text.
Owner:齐鲁空天信息研究院

AI service window background display method and system

The invention relates to the technical field of screening display, and particularly discloses an AI service window background display method and system, and the method comprises the steps: obtaining dialogue information, and converting the dialogue information into a bigram sequence; counting all bigram sequences in a preset time period, determining a TF-IDF value of each bigram in each bigram sequence based on the counted bigram sequences, and converting each bigram sequence into a vector; on the basis of the vectors, clustering is carried out on all the bigram sequences, and for each type of bigram sequences, an identification sequence is selected from the type of bigram sequences; dialogue information corresponding to the identification sequence is read, the difference rate between the identification sequence and the related sequence is obtained, and the dialogue information and the difference rate are counted to serve as display content and sent to the background; according to the method, multiple pieces of dialogue information are simplified into a limited number of texts and the difference rate through a feature extraction scheme and a clustering scheme, the background display content is greatly simplified, and the work pressure of background workers is reduced.
Owner:国网山西省电力有限公司阳泉供电分公司 +1

Text processing method and device based on Node2Vec, storage medium and electronic equipment

The application relates to the field of natural language processing, and discloses a text processing method and device based on Node2Vec, a storage medium and electronic equipment. The application obtains a word set and a character set by respectively performing word segmentation processing and single-character segmentation processing on target text; calculates TF-IDF values of the words and the characters; respectively performs sliding window operation on the words and the characters to obtain bigram words and bigram characters; constructs tri-gram words and tri-gram characters according to the bigram words and the bigram characters, and takes the TF-IDF values as weights; inputs the tri-gram words and the tri-gram characters into a Node2Vec model for training, and the Node2Vec model outputs word node vectors and character node vectors; and constructs a text vectorization representation according to the word node vectors and the character node vectors. The application reduces the influence of word segmentation on the result, improves the accuracy of text vector representation, and more comprehensively obtains a text semantic representation.
Owner:SHENZHEN LONGGUANGYUNZHONG INTELLIGENT TECH CO LTD

Increasing Misspelling, Typographical, and Partial Search Tolerance for Search Terms

Concepts and technologies disclosed herein are directed to increasing misspelling, typographical, and partial search tolerance for search terms. A system can obtain media content metadata associated with media content. The system can identify a plurality of names within the media content metadata and remove a plurality of stop words from the media content metadata. The system can determine a plurality of unigrams and a plurality of bigrams from the media content metadata. The system can determine a plurality of misspellings of the media content metadata. The system can compile the plurality of names, the plurality of stop words, the plurality of unigrams, the plurality of bigrams, and the plurality of misspellings as results. The system can determine a plurality of incorrect search strings based upon the results and can create a dictionary including the plurality of incorrect search strings mapped to a plurality of correct search strings.
Owner:AT&T INTELLECTUAL PROPERTY I L P

A method for Chinese speech enhancement recognition and text correction correction

The application belongs to the field of speech and text processing, and particularly relates to a Chinese speech enhancement recognition and text error correction method, which comprises the following steps: preprocessing the audio to be recognized, extracting features through a voiceprint model, and establishing an initial coarse dialect identification model; establishing an initial network model to train the initial coarse dialect identification model to obtain a dialect identification model; determining an error correction candidate word segmentation set based on an N-gram language model; and outputting the text after error correction and correction through a Bigram 2-gram language model and the N-gram language model. The application preprocesses the audio to be recognized, reduces speech recognition interference factors, improves the recognition performance by adopting a GMM-SVM model, has a faster and better training fitting effect by adopting a combination model of a GMM-UBM model and an LSTM model to establish an initial network model, effectively reduces the error rate by processing the text through an N-gram language model and a Bigram 2-gram language model, and optimizes the result of converting the audio to be recognized into text information.
Owner:NANTONG UNIV