Natural Language Generation with Pinned Text and Personality Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current natural language generation models struggle to produce coherent, longer-form text that captures topic, pacing, and emotional affect, often resulting in text that lacks a motivating principle, making it distinguishable from high-quality human-generated text.

Innovation Solution

A system that generates plausible and provocative texts by creating a personality and sentiment model for a target individual, using a feedback loop to refine text generation, and incorporating a discriminator network to ensure grammatical acceptability and emotional impact, with specific words or phrases required in the output to enhance coherence and human-like quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing generative models are used to produce natural language text, then text generation speed and basic grammatical structure are achieved, but the text lacks coherent story, emotional affect, and motivating principle making it easily distinguishable from human-generated text

Engineering Contradiction:
Improvetext coherence and human-likenessVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments text generation into multiple specialized components: a generator network creates candidate text, a discriminator network evaluates authenticity, a personality model infers emotional state, and a sentiment model analyzes emotional affect. Each component handles a specific aspect of text quality, allowing the system to produce coherent human-like text through coordinated specialization rather than a single complex model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements nested models where the personality model and sentiment model are embedded within the broader generator-discriminator architecture. The personality model processes input text to infer emotional state, which then influences the generator's text production. The sentiment model similarly analyzes emotional affect and feeds back to the generator. This nesting allows multiple layers of analysis and generation to operate hierarchically, improving text coherence without requiring a completely redesign of the base architecture.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Reliability

If the generator attempts to create more realistic text with emotional affect and coherent story, then text quality and human-likeness improve, but the discriminator becomes harder to train and more computationally intensive

Engineering Contradiction:
Improvetext emotional affect and coherenceVSAvoidtraining time and computational resources
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis through the personality model and sentiment model before the generator produces text. The personality model pre-infers emotional state from input text, and the sentiment model pre-analyzes emotional affect requirements. This preliminary action allows the generator to focus computational resources on producing text with the correct emotional characteristics rather than learning all aspects of text quality from scratch, reducing overall training time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The discriminator provides feedback to the generator about text authenticity, while the personality and sentiment models provide feedback about emotional coherence. This multi-loop feedback system allows the generator to iteratively improve text quality by adjusting based on specific guidance about what makes text human-like, rather than requiring the discriminator alone to convey all quality signals, which accelerates convergence.

Inventive Principle:
Principle #23Feedback

3Reliability

If multiple models (generator, discriminator, personality, sentiment) are integrated to improve text quality, then text coherence and emotional resonance improve, but system complexity and computational overhead increase

Engineering Contradiction:
Improvetext quality and emotional resonanceVSAvoidnumber of models and processing steps
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The generator network serves multiple functions: it produces candidate text based on input text and inferred personality, generates text that attempts to match sentiment characteristics, and provides the output that the discriminator evaluates. This multi-functionality allows a single model to handle multiple aspects of text generation rather than requiring separate specialized models for each function, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the personality inference and sentiment analysis functions into the text generation process itself. Rather than treating these as completely separate preprocessing and postprocessing steps, the models are integrated so that personality inference directly influences generator input, and sentiment analysis informs generation parameters. This merging reduces the number of independent processing pipelines and simplifies the overall system architecture.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240028834A1Natural language generation using pinned text and multiple discriminators
Publication Date: 2024.01.25 JUNGLE DISK LLC
  • US20240028834A1 patent drawing
  • US20240028834A1 patent drawing
  • US20240028834A1 patent drawing

AI summary

A personality model is created for a population and used as an input to a text generation system. Alternative texts are created based upon the emotional effect of the generated text. Certain words or phrases are “pinned” in the output, reducing the variability of the generated text so as to preserve required information content, and a number of tests provide input to a discriminator network so that proposed outputs both match an outside objective regarding the information content, emotional affect, and grammatical acceptability. A feedback loop provides new “ground truth” data points for refining the personality model and associated generated text.