AR Color Tone Adjustment Using Virtual Marker Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Printed matters often exhibit different color tones than intended due to varying installation environments, requiring repeated adjustments and printings to match the desired color tone, which is time-consuming and inefficient.

Innovation Solution

A print system that includes an image forming apparatus and a display using augmented reality, where a marker is printed and detected in the real environment, allowing for the calculation of differential color information to adjust the color tone of a virtual object displayed on the display, and subsequently adjusting the print adjustment value for the image forming apparatus to match the desired color tone.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If color tone adjustment is performed by repeatedly printing and confirming in the installation place, then the color tone matching the environment can be achieved, but the time required to obtain the desired printed matter increases

Engineering Contradiction:
Improvecolor tone accuracyVSAvoidadjustment time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent uses a camera to capture an image of the marker in the installation environment and creates a virtual copy of the printed matter displayed on a display device. This virtual copy allows users to simulate and evaluate color tone appearance without physically printing multiple test samples, thereby reducing time while maintaining color tone accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary color tone simulation in a virtual environment before actual printing. By calculating differential color information between the captured marker image and reference data, and applying corrections to the virtual display, the system prepares the optimal color tone settings in advance, avoiding repeated trial printings

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If the printed matter is output after adjusting the color tone, then the color tone can be optimized, but the printed matter may still not be seen in the intended way requiring further repetition

Engineering Contradiction:
Improvecolor tone accuracyVSAvoidadjustment efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system captures images of the marker in the actual installation environment using a camera, calculates differential color information between the captured image and reference data, and uses this feedback to automatically adjust and correct the color tone of the virtual displayed object. This closed-loop feedback mechanism ensures accurate color tone reproduction without repeated manual adjustments

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the mechanical process of repeatedly printing physical test samples with an electronic/virtual system. The display device shows a virtual object that simulates how the printed matter will appear, allowing visual evaluation and adjustment without physical manipulation of printed materials

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10440203B2Adjusting color tone for printing using display of virtual object together with marker arranged in real environment
Publication Date: 2019.10.08 KONICA MINOLTA INC
  • US10440203B2 patent drawing
  • US10440203B2 patent drawing
  • US10440203B2 patent drawing

AI summary

A display includes a display unit, an image sensor that takes an image of a predetermined area and outputs the taken image, and a hardware processor that detects the marker in the taken image, generates differential color information between color data of the marker in the taken image and color data of the marker in the print image data, displays a virtual object which reproduces the print image data in the display unit, sets an object adjustment value for adjusting a color tone of the virtual object displayed on the display unit based on the differential color information, and calculates a print adjustment value for adjusting a color tone reproduced by the image forming apparatus based on the object adjustment value.