Handwriting Support Device Using Non-Display Image Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handwriting support devices using augmented reality (AR) techniques cause discomfort due to conflicting depth perception cues, as the virtual image is superimposed on the user's hand, leading to a shift in visual information that affects the writing experience.

Innovation Solution

A handwriting support device employing a half mirror and image display surface configuration where a non-display processed image is projected onto the writing surface, with the image display control unit processing regions corresponding to the vertically projected area of real objects, such as hands, to prevent overlap and reduce depth perception discomfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual image is superimposed on the writing surface using a half mirror, then handwriting guidance is provided, but the virtual image overlaps with the user's hand causing depth perception discomfort

Engineering Contradiction:
Improvehandwriting guidanceVSAvoiddepth perception discomfort
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent extracts the virtual image display from the hand region by detecting the hand's position and removing or masking the virtual image content that would overlap with the hand. This separation eliminates the conflicting depth cues while preserving the handwriting guidance function in non-hand regions.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different display qualities to different regions: the virtual image is displayed normally in regions where the hand is not present, but is suppressed or modified in regions where the hand is detected. This local differentiation resolves the depth perception conflict while maintaining overall guidance effectiveness.

Inventive Principle:
Principle #3Local quality

2Loss of information

If binocular parallax is used to determine AR object position behind the hand, then depth information is provided, but monocular shielding effect determines the AR object is in front of the hand, causing information conflict

Engineering Contradiction:
Improvedepth information consistencyVSAvoidvisual information conflict
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent removes the conflicting virtual image information from the hand region, eliminating the source of the binocular-monocular depth conflict. By extracting the problematic overlay, the system prevents the information conflict while preserving depth information in regions where no conflict occurs.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively reduces user discomfort by ensuring the virtual image is not overlaid on the hand, thereby improving the handwriting support function and enhancing the writing experience by maintaining accurate positional information.

Implementation Method 1

a half mirror 20; an image display surface 32 positioned to face at a side of a mirror surface of the half mirror 20

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS10852767B2Handwriting support device
Publication Date: 2020.12.01 FUJIFILM CORP
  • US10852767B2 patent drawing
  • US10852767B2 patent drawing
  • US10852767B2 patent drawing

AI summary

A handwriting support device includes a half mirror; an image display surface; a writing surface, a virtual image of an image displayed on the image display surface being projected on the writing surface. In a case where a real object is inserted onto the writing surface, the image display control unit causes a non-display processed image to be displayed on the image display surface, the non-display processed image being obtained by at least a partial region, of a region of the first image corresponding to a vertically projected region of the real object on the writing surface, being subjected to non-display processing. In the handwriting support device, an image, which is a virtual image of the non-display processed image in which at least a part of an inside of the vertically projected region of the real object is non-displayed, is projected onto the writing surface.