Conversational Image Generation via GAN Privacy Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods fail to effectively summarize conversational content into image representations that convey locality, emotion, and tone, often exposing private information and being cumbersome to comprehend.

Innovation Solution

A computer-implemented method using a generative adversarial network to generate conversational image representations, incorporating user privacy parameters, sentiment, avatar, topic, and location, and displaying them in a comic style to summarize conversations visually.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional image generation methods are used to represent conversations, then the visual representation can be created, but the representation fails to convey emotions, tone, and locality effectively

Engineering Contradiction:
Improveconversational context informationVSAvoidimage generation system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the conversational input into distinct components including sentiment analysis, topic identification, location extraction, and avatar selection. Each component is processed separately through dedicated modules before being integrated into the final image generation process, ensuring comprehensive information retention while maintaining manageable system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer between the conversational input and the image generation. This layer includes sentiment analysis modules, topic modeling components, and context extraction mechanisms that transform raw conversation data into structured parameters suitable for image synthesis, thereby preserving conversational nuances without overwhelming the generation system

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If detailed conversational information is included in image representations, then comprehension and engagement improve, but user privacy is compromised

Engineering Contradiction:
Improvecommunication effectivenessVSAvoidprivacy exposure
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and separates personally identifiable information (PII) from the conversational data through dedicated extraction modules. Sensitive information such as names, addresses, and contact details are identified and removed or generalized before being used in image generation, allowing the system to retain communicative effectiveness while eliminating privacy risks

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms sensitive parameters into anonymized versions. For example, specific locations are converted to general area descriptions, and personal identifiers are replaced with generic avatars or pseudonyms. This parameter transformation maintains the contextual meaning necessary for effective communication while removing identifiable information

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If textual conversation summaries are provided, then the conversation content is preserved, but the representation becomes cumbersome and reduces reader retention

Engineering Contradiction:
Improveconversation contentVSAvoidreader comprehension
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent transforms one-dimensional textual conversation summaries into two-dimensional visual representations. By converting text into images that incorporate visual elements representing sentiment, topic, location, and participant avatars, the system maintains complete conversation information while dramatically improving readability and reader engagement through visual processing

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11756567B2Autocreation of conversational image representation
Publication Date: 2023.09.12 BLUE HERON DEVELOPMENT LLC
  • US11756567B2 patent drawing
  • US11756567B2 patent drawing
  • US11756567B2 patent drawing

AI summary

In an approach to generating conversational image representations, one or more computer processors detect one or more utterances by a user, wherein utterances are either textual or acoustic. The one or more computer processors generate one or more image representations of the one or more detected utterances utilizing a generative adversarial network restricted by one or more user privacy parameters, wherein the generative adversarial network is fed with an extracted sentiment, a generated avatar, an identified topic, an extracted location, and one or more user preferences. The one or more computer processors display the generated one or more image representations on one or more devices associated with respective one or more recipients of the one or more utterances.