Content generation using target content derived modeling and unsupervised language modeling

Abstract

Content generation leverages an unsupervised, generative pre-trained language model (e.g., a generative-AI). In this approach, a model derived by applying to given content relevant competitive content and one or more optimization targets is received. Based on optimization criteria encoded as embedding signals in the model, a determination is made regarding whether a template suitable for use as an input to the generative-AI exists in a set of templates. If so, the model embedding signals are merged into the template, or the template itself is transformed using the embedding signals, in either case creating a modified template. If, however, no template suitable as the input exists, the model and other information are input to a natural language processor to generate a generative-AI input. Either the modified template or the generative-AI input, as the case may be, is then applied through the generative-AI to generate an output competitively-optimized with respect to the optimization targets.

Description

BACKGROUNDTechnical Field[0001]This application relates generally to AI-assisted techniques for content generation.Brief Description of the Related Art[0002]It is known in the prior art to provide network-accessible (e.g., web-based) editing applications that automatically detect grammar, spelling, punctuation, word choice, and style errors in writing text being composed by a user in an online text editor. One commercial solution of this type works using a browser-based extension that identifies and enables a user to correct writing errors as the user enters text, e.g., on Google® Gmail, Facebook®, Twitter®, etc., in a web page or form. While these techniques and technologies provide advantages, they suffer from various deficiencies.[0003]State-of-the-art Artificial Intelligence (AI) techniques have recently begun to leverage unsupervised, generative pre-trained language models. The most well-known of this type is Generative Pre-trained Transformer 3 (GPT-3), which is an autoregress...

AI Technical Summary

Benefits of technology

[0006]The foregoing has outlined some of the more pertinent features of the subject matter. These features should be construed to be merely illustrative. Many

Problems solved by technology

While these techniques and technologies provide a

Images