Automated Image Coloring Using Learned Reference Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for automatically coloring images using reference information are inefficient, as they require manual intervention and cannot handle large volumes of image data quickly, particularly in applications like animation and cartoon production where consistency across characters is needed.

Innovation Solution

An information processing apparatus and method that includes a target image data acquisition unit, area designation unit, reference information selection unit, and coloring processing unit, utilizing a learned model to automatically select and apply reference information for designated areas within image data, enabling efficient and consistent coloring across images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual coloring process is performed for each character while confirming reference information, then coloring consistency can be maintained, but the number of sheets that can be handled in a limited time is reduced

Engineering Contradiction:
Improvecoloring consistencyVSAvoidnumber of sheets handled per time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces the manual mechanical coloring process with an automated image processing system that uses reference information to automatically determine coloring parameters. The system extracts features from reference images and applies them to target images through automated algorithms, eliminating the need for manual confirmation while maintaining consistent coloring results across multiple sheets.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses reference information (reference images) as templates to copy coloring patterns and parameters to target images. By extracting coloring features from reference images and applying them automatically to multiple target sheets, the system achieves consistent reproduction of coloring styles without manual intervention for each sheet.

Inventive Principle:
Principle #26Copying

2Productivity

If automated coloring process is implemented without reference information selection, then processing speed is improved, but coloring consistency and quality deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidcoloring consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary selection and extraction of reference information before the actual coloring process. The system identifies and extracts relevant coloring parameters from reference images in advance, preparing them for automated application. This preliminary action ensures that the subsequent automated coloring process maintains high consistency while achieving fast processing speeds.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces reference information as an intermediary between the automated processing system and the target images. The reference images serve as mediators that provide coloring guidelines and parameters, enabling the automated system to produce consistent results without manual intervention. The reference information bridges the gap between automated speed and quality consistency.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11288845B2Information processing apparatus for coloring an image, an information processing program for coloring an image, and an information processing method for coloring an image
Publication Date: 2022.03.29 PREFERRED NETWORKS INC
  • US11288845B2 patent drawing
  • US11288845B2 patent drawing
  • US11288845B2 patent drawing

AI summary

An information processing apparatus includes a memory and processing circuitry coupled to the memory. The processing circuitry is configured to acquire target image data to be subjected to coloring, designate an area to be subjected to coloring by using reference information in the target image data, determine reference information to be used for the designated area, and perform a coloring process on the designated area by using the determined reference information, based on a learned model for coloring which has been previously learned in the coloring process using the reference information.