Camera-Based Document Interaction Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices face difficulties in performing functions based on user interactions with real books, such as detecting touches or changes in printed areas, due to limitations in sensing and interpreting physical inputs from real-world documents.

Innovation Solution

An electronic device method involving image acquisition through a camera to detect changes in printed areas, determining user interactions by analyzing changes in the images, and performing corresponding functions based on these determinations, using a processor to execute program code that handles user interactions with real documents.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If an electronic device uses a camera to capture images of a real document, then it can detect user interactions with the document, but it cannot directly sense physical touches or changes in printed areas without additional sensing mechanisms

Engineering Contradiction:
Improvecapability to detect user interactionsVSAvoidsensing mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses a camera to capture an optical copy (image) of the real document instead of requiring direct physical sensing. By comparing sequential images, the system detects changes in the document state (such as finger touches obscuring printed areas) to infer user interactions. This copying approach enables interaction detection without complex physical sensing mechanisms.

Inventive Principle:
Principle #26Copying

2Measurement precision

If the electronic device analyzes image changes to detect user interactions, then it can interpret physical inputs from real documents, but it requires processing and comparing multiple images to determine interactions

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system captures a first image of the document before the user interaction occurs, establishing a baseline state. When a user interaction happens, the system captures a second image and compares it with the pre-captured first image to detect changes. This preliminary action of capturing the initial state enables efficient and accurate detection of interactions without requiring continuous complex processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11989978B2Method of detecting user interaction and electronic device supporting the same
Publication Date: 2024.05.21 WOONGJIN THINKBIG
  • US11989978B2 patent drawing
  • US11989978B2 patent drawing
  • US11989978B2 patent drawing

AI summary

A method of detecting a user interaction by an electronic device according to various embodiments may include acquiring, through a camera, a first image of a real document in which at least one first area is printed, determining whether at least one first part corresponding to the at least one first area and included in the first image is changed, and performing a function of the electronic device corresponding to the at least one first part, based on determining that the at least one first part is changed.