Deep Generative Model Watermarking via Hyperparameter Embedding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing generative models, particularly deep generative models, face challenges in protecting intellectual property as they are often outsourced and resource-intensive, requiring mechanisms to verify and watermark models without modifying the training dataset or retraining the model.

Innovation Solution

A system and method for watermarking generative models using hyperparameters to embed a watermark within the model, allowing for verification of the model's authenticity and ownership without altering the training dataset or retraining, utilizing a processor and memory to procure a model, obtain hyperparameters, and deliver a watermarked model with a verification mechanism.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If watermarking is implemented in deep generative models, then intellectual property protection is improved, but model complexity and computational resource requirements increase

Engineering Contradiction:
Improveintellectual property protectionVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by modifying hyperparameters of the deep generative model to embed watermarks. Specifically, the watermark is embedded by adjusting parameters such as learning rates, weight decay, or other optimization hyperparameters during the training process. This allows the watermark to be incorporated into the model's operational characteristics without fundamentally changing the model architecture, thereby protecting intellectual property while managing complexity through parameter-level modifications rather than structural changes.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If watermarking is implemented in deep generative models, then intellectual property protection is improved, but computational resources and training time increase

Engineering Contradiction:
Improveintellectual property protectionVSAvoidcomputational resources
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by embedding the watermark during the model training process rather than adding it afterward. The watermarking is performed as part of the training routine, where the watermark signal is incorporated into the training data or training process itself. This preliminary integration ensures that the watermark is established before the model is deployed, avoiding the need for additional computational resources during inference and reducing overall computational burden.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If watermarking is implemented without modifying training dataset, then model utility is preserved, but watermark embedding complexity increases

Engineering Contradiction:
Improvemodel utilityVSAvoidwatermark embedding complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies the intermediary principle by introducing a watermark embedding mechanism that acts as a mediator between the training process and the final model. This intermediary component allows the watermark to be embedded through modifications to the training process itself (such as adjusting hyperparameters or incorporating watermark signals during training) rather than directly modifying the training dataset. The intermediary approach preserves model utility by maintaining the original training data integrity while achieving watermark embedding through the training process modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20230394298A1Watermarking deep generative models
Publication Date: 2023.12.07 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20230394298A1 patent drawing
  • US20230394298A1 patent drawing
  • US20230394298A1 patent drawing

AI summary

A system may include a memory and a processor in communication with the memory. The processor may be configured to perform operations. The operations may include procuring a model and obtaining hyperparameters for watermarking the model. The operations may include embedding a watermark in the model using the hyperparameters to achieve a watermarked model and delivering the watermarked model and a watermark verification mechanism to a user.