Augmented Reality E-Book Interaction via Sensor Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality e-books lack technology for user participation and immersion, as they cannot reflect users' behaviors and environmental changes effectively, requiring manual operations like touch gestures.
Innovation Solution
A method and mobile terminal configuration that generates augmented reality content by loading user motion and sensor data onto a preview image, allowing for dynamic interaction with e-book content by detecting events and retrieving pre-mapped reaction data to enhance user participation and immersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If augmented reality content is generated using only default data from e-book parsing, then device complexity is reduced, but user participation and immersion levels deteriorate
Solution Approach 1:
The system captures user motion through the camera and sensor data, processes this feedback information, and dynamically adjusts the augmented reality content display accordingly. This closed-loop feedback mechanism enables the system to adapt to user behaviors while maintaining manageable complexity through automated processing.
Solution Approach 2:
The system automatically captures sensor data and user motion information without requiring manual input operations. The device serves itself by autonomously gathering necessary data from its sensors and environment, eliminating the need for complex manual gesture recognition systems while enhancing user participation.
2Ease of operation
If manual operations like touch gestures are required for interaction, then ease of operation is maintained, but user immersion and participation levels worsen
Solution Approach 1:
The system replaces manual touch gestures with automatic sensor-based detection and camera-based motion recognition. This substitution eliminates the need for deliberate manual operations while enhancing immersion, as the system naturally captures user behavior through sensors and processes it to adjust content display.
3Adaptability or versatility
If user motion and sensor data are integrated into AR content, then user immersion and participation improve, but device complexity increases
Solution Approach 1:
The system pre-processes and stores sensor data and user motion information captured during e-book reading. By performing preliminary data collection and processing, the system reduces the computational complexity required during actual AR content generation, as the raw data is already organized and ready for integration.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for generating augmented reality content includes receiving an augmented reality mode execution request for generating augmented reality content based on electronic book content, activating a camera in response to the request to provide a preview image, loading book data of the electronic book on the preview image, detecting an event occurring in the augmented reality mode, retrieving reaction data pre-mapped to the event, and loading the reaction data on the preview image.