Camera-Based Touch Detection for Interactive Real Book Reading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multimedia books fail to actively engage users in reading by only providing passive or one-dimensional information, and existing technologies struggle to detect user inputs such as touch and drag on real books without increasing product costs.
Innovation Solution
A reading support apparatus using one camera to capture and process images of a real book, setting touch recognition references based on a user's finger or nail, and detecting touch and drag inputs by comparing the captured images to predefined references, allowing for interactive engagement without additional hardware costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras or additional sensors are used to detect user inputs on real books, then the detection accuracy and reliability improve, but the product cost and device complexity increase
Solution Approach 1:
The single camera is designed to perform multiple functions: capturing book images for display and detecting user inputs (touch, drag, swipe) by analyzing finger/nail appearances. This multi-functional design eliminates the need for separate touch sensors while maintaining detection capability, directly resolving the contradiction between detection accuracy and device complexity
Solution Approach 2:
The system creates a visual copy of the book surface through camera imaging and displays it on a screen. User inputs are detected by analyzing changes in this visual copy (appearance of fingers/nails), rather than requiring physical touch sensors. This copying approach enables accurate input detection using only a single camera
2Ease of operation
If conventional multimedia books provide passive information delivery, then the implementation simplicity is maintained, but the user engagement and reading effectiveness deteriorate
Solution Approach 1:
The system implements real-time feedback by detecting user inputs (touch, drag, swipe) through camera analysis and immediately responding with relevant book content or interactions. This feedback loop transforms passive information delivery into an engaging, interactive reading experience while maintaining implementation simplicity through software-based detection
Solution Approach 2:
The reading system transitions from static, passive information display to dynamic, interactive content delivery. The camera continuously captures images, the system dynamically analyzes them for user inputs, and adjusts content delivery in real-time based on detected gestures, creating an adaptive reading experience without complex hardware
Data Source
AI summary
Disclosed are a reading support apparatus which can detect a user input (touch and/or drag) conducted on a real book by using one camera, and a user input detection method using the same. The reading support apparatus sets a finger and/or nail on a target surface image captured through one camera to touch recognition reference, detects, as a user input, a user's touch or drag conducted on the surface of the real book by comparing the finger and/or nail included in the target surface image to the touch recognition reference, and provides an action corresponding to the user input.