Operation Input System with Virtual Key Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing security information input systems, such as those using passwords, are vulnerable to leakage when another person secretly observes the operation panel or monitors the user's hand movements, as the arrangement of input keys cannot effectively prevent guessing of the input contents.

Innovation Solution

An operation input system comprising a display unit and an operation detecting unit that sets input keys in a predetermined arrangement on a screen, displaying a virtual image of the keys combined with the operator's actions via a camera, ensuring the keys are not visually recognizable, and optionally instructing dummy inputs to obscure the actual input operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the arrangement of input keys is changed randomly to prevent guessing, then security against guessing attacks is improved, but usability and ease of operation deteriorate because users cannot visually recognize the key positions

Engineering Contradiction:
ImprovesecurityVSAvoidease of operation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

A camera is introduced as an intermediary device to capture the operation window, and a portable terminal displays the captured image to the user. This intermediary system allows the keys to remain visually hidden on the operation panel while providing visual feedback to the user through the portable terminal, thus maintaining both security and usability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The solution moves the visual display function from the two-dimensional operation panel to a separate portable terminal device. By transferring the display to another dimension (a different physical device), the system can hide keys on the operation panel while displaying them on the portable terminal, resolving the contradiction between security and usability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If dummy input operations are instructed to obscure actual input, then security against observation attacks is improved, but operation time and complexity increase

Engineering Contradiction:
ImprovesecurityVSAvoidoperation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system converts the potentially harmful observation of operation movements into a beneficial security feature by instructing users to perform dummy input operations. These dummy operations, which look identical to real input operations, confuse observers who cannot distinguish between actual key presses and dummy movements, thus turning the observation vulnerability into a security advantage.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS8957862B2Operation input system and operation input method
Publication Date: 2015.02.17 KONICA MINOLTA BUSINESS TECH INC
  • US8957862B2 patent drawing
  • US8957862B2 patent drawing
  • US8957862B2 patent drawing

AI summary

Disclosed is an operation input system including: an operation display device; and a display device, wherein in case that the operation display device receives input of security information, the operation display device sets input keys in the key arrangement on a screen of the display unit and displays the operation window in which the input keys or at least contents of the input keys cannot be visually recognized, and the operation detecting unit receives the operation for the set input keys, and the display device controls display contents of the second display unit so as to display a state in which a virtual image of the input keys is combined with a situation in which an operator operates the display unit in accordance with an image shot by the camera so as to match a position of the virtual image with the set input keys.