Pinyin Semantic Recognition via Vector Embedding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech recognition and Pinyin input methods face challenges in accuracy due to words with similar pronunciations but different meanings, leading to incorrect semantic understanding in human-machine interactions, and current solutions require cumbersome manual annotation and high costs.

Innovation Solution

A method and apparatus for semantic recognition that converts Pinyin sequences into sentence vectors using a word embedding model and neural network, determining semantically similar reference sentences to improve accuracy and handle misspelled words efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If speech recognition converts speech signals into text information using conventional methods, then the process is simple and fast, but accuracy deteriorates due to words with similar pronunciations but different meanings

Engineering Contradiction:
Improvespeech recognition accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces Pinyin sequences as an intermediary representation between speech signals and text information. Instead of directly converting speech to text, the system first converts speech to Pinyin sequences, then uses word embedding models to map these sequences to vector spaces where semantically similar words are distinguished. This intermediary step resolves the ambiguity of homophones while maintaining system feasibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the representation parameters of speech recognition from direct text mapping to Pinyin-based vector space mapping. By changing the parameter space from discrete text labels to continuous vector representations with semantic differentiation, the system can distinguish between words with similar pronunciations but different meanings, thereby improving recognition accuracy.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If manual annotation is used to distinguish words with similar pronunciations, then semantic accuracy is improved, but cost and time consumption increase significantly

Engineering Contradiction:
Improvesemantic recognition accuracyVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements a self-service mechanism where the word embedding model automatically learns and distinguishes semantic differences between Pinyin sequences without requiring manual annotation. The model trains on unlabeled data and autonomously develops the capability to differentiate homophones based on contextual patterns, eliminating the need for expensive and time-consuming manual semantic labeling.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent uses word embedding to create vector space copies of Pinyin sequences, where each Pinyin sequence is represented as a vector that captures its semantic meaning. This copying approach allows the system to work with semantic representations rather than raw text, enabling automatic differentiation of homophones through vector similarity calculations without manual intervention.

Inventive Principle:
Principle #26Copying

3Ease of manufacture

If conventional speech recognition is used, then the system is simple to implement, but semantic understanding becomes incorrect due to homophone confusion

Engineering Contradiction:
Improveimplementation simplicityVSAvoidsemantic understanding reliability
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent segments the speech recognition process into distinct stages: speech-to-Pinyin conversion, Pinyin-to-vector mapping using word embedding, and vector-based semantic analysis. This segmentation allows each component to be optimized independently while maintaining overall system simplicity. The Pinyin segmentation approach preserves phonetic information while enabling semantic differentiation in the vector space.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20210264903A9Pinyin-based method and apparatus for semantic recognition, and system for human-machine dialog
Publication Date: 2021.08.26 BOE TECHNOLOGY GROUP CO LTD
  • US20210264903A9 patent drawing
  • US20210264903A9 patent drawing
  • US20210264903A9 patent drawing

AI summary

The present disclosure provides a method and an apparatus for semantic recognition, and a system for human-machine dialog. In the method, a Pinyin sequence of a sentence to be recognized is obtained. The Pinyin sequence includes a plurality of Pinyin segments. Then, word vectors of the plurality of Pinyin segments are obtained. Next, the word vectors of the plurality of Pinyin segments are combined into a sentence vector of the sentence to be recognized. Based on the sentence vector of the sentence to be recognized, an output vector of the sentence to be recognized is obtained by using a neural network. Based on the output vector of the sentence to be recognized, a reference sentence semantically similar to the sentence to be recognized is determined. Then, a semantic meaning of the sentence to be recognized is recognized as a semantic meaning of the reference sentence.