Camera Scanner Gesture Control via Projected Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera scanners have limited user interface operability, making it difficult to improve user interaction, especially when dealing with objects other than documents, and user interface systems struggle to dynamically adjust operations based on object features.

Innovation Solution

An image processing apparatus equipped with a pickup image obtaining unit, distance image obtaining unit, detecting unit, projecting unit, recognizing unit, and reading unit that detects object placement, projects operation instructions, recognizes user gestures, and adjusts image acquisition based on recognized gestures and object features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a camera scanner uses a limited user interface unit, then the device complexity is reduced, but the ease of operation deteriorates

Engineering Contradiction:
Improveuser operabilityVSAvoiduser interface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The stage surface is transformed into a multi-functional interface that can display operation instructions, receive gesture inputs, and provide visual feedback simultaneously. This universal interface consolidates multiple functions (display, input, feedback) into a single component, improving ease of operation without proportionally increasing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The projector acts as an intermediary between the camera scanner system and the user. It translates system states into visual instructions projected on the stage, and translates user gestures into system commands, thereby improving operability while keeping the core scanner complexity low

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the user interface system is simplified, then the device complexity is reduced, but the adaptability deteriorates

Engineering Contradiction:
Improvedynamic control capabilityVSAvoidinterface system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The operation instructions projected on the stage are dynamically adjusted based on the detected object type and user gestures. The system transitions from a static interface to a dynamic one that adapts its displayed instructions and control options according to the scanning context, enhancing adaptability without requiring a completely complex interface system

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback by detecting user gestures on the projected instructions and responding by adjusting the reading operations. This feedback loop enables dynamic control where the system adapts to user intentions in real-time, improving versatility while maintaining a relatively simple interface structure

Inventive Principle:
Principle #23Feedback

3Ease of operation

If gesture recognition is added to enable dynamic control, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:
Improvegesture control capabilityVSAvoidrecognition system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The gesture recognition functionality is merged with the existing imaging units (camera and distance sensor) already present in the camera scanner. By reusing these existing components for dual purposes (document imaging and gesture detection), the system gains gesture control capability without proportionally increasing device complexity

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging units serve multiple functions: capturing document images during scanning and detecting user gestures for control. This multi-functionality allows the system to implement intuitive gesture-based operation while avoiding the need for separate dedicated gesture sensing hardware, thereby limiting the increase in device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user operability by allowing dynamic control and improved interaction with various objects, including solid shapes, through intuitive gesture recognition and projection-based instructions.

Implementation Method 1

a pickup image obtaining unit configured to obtain a pickup image on a stage through an imaging unit

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a solid measuring unit configured to obtain a distance image on the stage... a measurement pattern which is projected from the light projecting unit is photographed by the camera, and a solid shape is measured by a principle of triangular surveying

Methodology Applied
Scientific EffectTriangular surveying: Parallax

Data Source

PatentUS9924066B2Image processing apparatus, information processing method, and program
Publication Date: 2018.03.20 CANON KK
  • US9924066B2 patent drawing
  • US9924066B2 patent drawing
  • US9924066B2 patent drawing

AI summary

An operability of a user in an image processing apparatus such as a camera scanner is improved. For this purpose, the image processing apparatus has: a pickup image obtaining unit for obtaining a pickup image on a stage through an imaging unit; a distance image obtaining unit for obtaining a distance image on the stage through a solid measuring unit; a detecting unit for detecting the putting of an object on the stage based on the obtained pickup image; a projecting unit for projecting an operation display regarding the reading of the object onto the stage through a projector when the putting of the object is detected; a recognizing unit for recognizing a gesture of the user on the stage based on the obtained distance image; and a reading unit for obtaining a read image of the object in accordance with the gesture to the projected operation display.