Word Embedding Model for Public Sentiment Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current social networking systems lack effective methods to analyze public insights and sentiments from user-generated content, failing to provide accurate and timely reflections of contemporary public opinions.

Innovation Solution

A social networking system utilizes a word embedding model trained on a large corpus of text from user-generated content to represent n-grams as vectors in a d-dimensional embedding space, enabling the calculation of similarity metrics and generation of insights that reflect public sentiments through keyword identification, concept intersection, and visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional text analysis methods are used, then the system is simple to implement, but the accuracy of public sentiment analysis is insufficient

Engineering Contradiction:
Improveaccuracy of public sentiment analysisVSAvoidcomplexity of analysis system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical text analysis methods with a neural network-based word embedding system. The neural network automatically learns semantic representations of words and n-grams, enabling accurate sentiment analysis without manual feature engineering. This substitution of mechanical analysis with intelligent learning systems resolves the contradiction by achieving high accuracy while managing complexity through automated processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces word embeddings as an intermediary layer between raw text data and sentiment analysis. The embedding layer transforms discrete text tokens into continuous vector representations that capture semantic meaning, serving as a bridge that enables accurate analysis. This intermediary mechanism allows the system to achieve high measurement precision by translating text into a form that reveals underlying semantic structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If word embedding models are used, then the accuracy of sentiment analysis is improved, but the computational resources and time required increase

Engineering Contradiction:
Improveaccuracy of public sentiment analysisVSAvoidtime for training and processing
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-training the word embedding model on a large corpus of text data before deploying it for sentiment analysis. This pre-training phase creates reusable word vector representations that can be quickly applied to new text data without retraining. By performing the computationally intensive learning process in advance, the system achieves high accuracy while reducing processing time for actual sentiment analysis tasks.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses word embeddings to create vector copies of text data that preserve semantic meaning. Instead of processing raw text repeatedly, the system works with compressed vector representations that capture the essential semantic information. This copying mechanism reduces computational overhead and processing time while maintaining analysis accuracy, as the vector representations can be efficiently manipulated and compared.

Inventive Principle:
Principle #26Copying

3Loss of information

If word vectors are calculated for all n-grams, then complete semantic coverage is achieved, but the computational complexity and processing time increase

Engineering Contradiction:
Improvesemantic coverage of analysisVSAvoidcomputational complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the most relevant n-grams and their word vectors for sentiment analysis rather than calculating vectors for all possible n-grams. The system identifies and extracts key semantic units from the text that are most informative for sentiment determination. This selective extraction approach maintains complete semantic coverage for relevant concepts while reducing computational complexity by focusing resources on the most important elements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by using different levels of n-gram granularity in different contexts. The system dynamically selects between unigrams, bigrams, and longer n-grams based on the specific analysis needs and local text characteristics. This localized approach to n-gram selection ensures semantic coverage where needed while reducing overall computational complexity by avoiding uniform processing of all possible n-gram lengths across the entire text corpus.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10509863B1Consumer insights analysis using word embeddings
Publication Date: 2019.12.17 META PLATFORMS INC
  • US10509863B1 patent drawing
  • US10509863B1 patent drawing
  • US10509863B1 patent drawing

AI summary

In one embodiment, a method includes receiving a request to generate a two-dimensional visualization of public sentiments regarding a particular subject, where the request includes an input n-gram representing the particular subject, constructing a first corpus of text by collecting text containing the input n-gram from a plurality of user-created content objects in the online social network, identifying a list of unique n-grams appearing in the first corpus of text, generating a table comprising unique n-grams in the list and their corresponding word vectors using a word embedding model, condensing the d-dimensional word vectors in the table into a two-dimensional word vectors; and sending, as a response to the request, instructions to display n-grams in the table on a two-dimensional display space, where each n-gram is placed at a location of the corresponding condensed word vector.