Controllable Style-Based Text Transformation via Neural Network

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional text transformation techniques fail to produce stylistic variations of input text that conform to multiple tunable style specifications, often resulting in degraded fluency and adequacy due to random sampling from multiple text generators, without guaranteeing adherence to style-specific controls.

Innovation Solution

A computer-implemented method using an unsupervised neural network with gated recurrent units (GRUs) for controllable style-based text transformation, where style specifications include target writing style domains and linguistic aspects, allowing users to select and weight these specifications for generating style-transformed output texts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If random sampling from multiple text generators is used, then stylistic variations are produced, but fluency and adequacy are degraded

Engineering Contradiction:
Improvestylistic variationsVSAvoidfluency and adequacy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system segments the style transformation task into multiple independent style specifications (e.g., formality, tone, register) that can be controlled separately. Each style dimension is handled by dedicated neural network components, allowing precise control over stylistic variations without compromising overall text quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes parameters by introducing continuous style control vectors that adjust the degree and type of stylistic transformation. By modifying style parameter values rather than randomly sampling, the system maintains fluency and adequacy while producing controlled stylistic variations

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple text generators are used, then style specifications are attempted, but adherence to style-specific controls is not guaranteed

Engineering Contradiction:
Improvestyle specificationsVSAvoidadherence to style-specific controls
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system implements feedback mechanisms where the neural network continuously monitors and adjusts style parameters during generation. Style control vectors are refined based on feedback from style embeddings, ensuring that the generated text adheres to the specified style requirements

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system uses a universal encoder-decoder architecture that can handle multiple style specifications simultaneously. The same neural network framework processes different style dimensions (formality, tone, register) through a unified style control mechanism, ensuring consistent adherence across all style requirements

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If conventional text transformation techniques are used, then processing is simpler, but stylistic control and fluency are compromised

Engineering Contradiction:
Improveprocessing simplicityVSAvoidstylistic control and fluency
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system introduces style embeddings as intermediary representations that bridge the input text and the style-transformed output. These embeddings encode style information from unlabeled corpora and serve as mediators that guide the transformation process, maintaining both simplicity and stylistic control

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary action by pre-training the neural network on unlabeled corpora to learn style distributions before actual transformation. Style embeddings are pre-computed from training data, allowing the system to maintain simplicity during operation while ensuring high-quality stylistic control

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11734509B2Controllable style-based text transformation
Publication Date: 2023.08.22 ANTHROPIC PBC
  • US11734509B2 patent drawing
  • US11734509B2 patent drawing
  • US11734509B2 patent drawing

AI summary

Methods, systems and computer program products for multi-style text transformation are provided herein. A computer-implemented method includes selecting at least one set of style specifications for transforming at least a portion of input text. The at least one set of style specifications include one or more target writing style domains selected from a plurality of writing style domains, weights for each of the target writing style domains representing relative impact of the target writing style domains for transformation of at least a portion of the input text, and weights for each of a set of linguistic aspects for transformation of at least a portion of the input text. The computer-implemented method also includes generating one or more style-transformed output texts based at least in part on the at least one set of style specifications utilizing at least one unsupervised neural network.