Visual Lens System for Automated Digital Tool Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital artists face challenges in replicating digital artwork techniques due to the lack of information on tools and processes used to create final products, leading to inefficient experimentation with various digital tools and excessive computational resource consumption.

Innovation Solution

A visual lens system that automatically identifies digital tool parameters by processing raster image data using a tool region detection network and a tool parameter estimation network, generating an interactive image that provides descriptive information on the tools and their configurations used to achieve specific visual appearances.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If digital artists manually experiment with different digital tools to replicate desired artwork results, then they can achieve creative flexibility and explore various techniques, but it results in inefficient consumption of computational resources and excessive time expenditure

Engineering Contradiction:
Improveease of replicating artwork techniquesVSAvoidcomputational resource efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system enables self-service by automatically analyzing rasterized artwork and identifying the digital tools and parameters used to create it. The tool region detection network and tool parameter estimation network work together to autonomously extract tool information without requiring human experimentation, thereby improving computational efficiency while maintaining ease of technique replication

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual tool experimentation with an automated computational system. Instead of artists manually trying different tools and iterating through multiple attempts, the system uses machine learning models to automatically identify tool regions and parameters from the final artwork, substituting human computational effort with automated algorithms

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If conventional systems lack the ability to analyze digital artwork and connect parts back to tools, then the system remains simple and fast, but it forces artists to manually experiment with tools resulting in time-consuming processes

Engineering Contradiction:
Improvespeed of artwork replicationVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the analysis process into distinct functional components: a tool region detection network that identifies which digital tools were used and where, and a tool parameter estimation network that determines the specific parameters of those tools. This segmentation allows each component to specialize in specific tasks, improving overall speed while managing complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary components including the tool region detection network and tool parameter estimation network that mediate between the input rasterized artwork and the output tool information. These intermediary models process the artwork data and transform it into actionable tool parameter data, enabling fast automated analysis without requiring direct complex connections between all system components

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If the system automatically identifies digital tool parameters from raster image data, then computational resource consumption is optimized and manual experimentation is reduced, but it requires complex machine learning models including tool region detection network and tool parameter estimation network

Engineering Contradiction:
Improveefficiency of tool parameter identificationVSAvoidmodel architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The complex task of automatic tool parameter identification is segmented into two specialized networks: a tool region detection network that first identifies which tools were used and their spatial locations, and a tool parameter estimation network that then determines the specific parameters. This segmentation divides the complex problem into manageable sub-tasks, improving efficiency while organizing complexity into distinct functional modules

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The tool region detection network performs preliminary action by first identifying and segmenting the regions of interest before the tool parameter estimation network processes them. This preliminary classification of tool regions prepares the data in advance, allowing the parameter estimation network to focus solely on extracting parameter values from pre-identified regions, thereby optimizing overall efficiency

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240095982A1Automated Digital Tool Identification from a Rasterized Image
Publication Date: 2024.03.21 ADOBE INC
  • US20240095982A1 patent drawing
  • US20240095982A1 patent drawing
  • US20240095982A1 patent drawing

AI summary

A visual lens system is described that identifies, automatically and without user intervention, digital tool parameters for achieving a visual appearance of an image region in raster image data. To do so, the visual lens system processes raster image data using a tool region detection network trained to output a mask indicating whether the digital tool is useable to achieve a visual appearance of each pixel in the raster image data. The mask is then processed by a tool parameter estimation network trained to generate a probability distribution indicating an estimation of discrete parameter configurations applicable to the digital tool to achieve the visual appearance. The visual lens system generates an image tool description for the parameter configuration and incorporates the image tool description into an interactive image for the raster image data. The image tool description enables transfer of the digital tool parameter configuration to different image data.