Graphic Recognition Interactive Method for Picture Books
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interactive methods for picture books, such as automatic audio playback, lack interactivity and fail to maintain children's attention, as they do not provide a engaging experience beyond playback.
Innovation Solution
A graphic recognition-based interactive method that analyzes images, plays narration and question audio files, and uses feature graphic detection to determine if the user's response is correct, enhancing interactivity by providing feedback through correct or wrong audio files.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If automatic audio playback is used after recognizing the picture book, then the basic function is achieved, but there is no interaction process and user experience is not good
Solution Approach 1:
The system provides feedback by playing question audio files after narration, detecting user responses through image recognition, and providing correct/wrong audio feedback. This creates an interactive loop that improves user experience while maintaining automation through automated detection and response mechanisms.
2Duration of action of moving object
If automatic audio playback is used, then the picture book can be read, but children's attention is not maintained due to lack of engagement
Solution Approach 1:
The system maintains children's attention by providing continuous feedback through question audio files and correct/wrong responses. This interactive feedback loop keeps children engaged and focused on the picture book content throughout the reading process.
Solution Approach 2:
The system uses periodic action by alternating between narration audio playback and question audio playback in a rhythmic sequence. This periodic interaction pattern maintains children's attention by preventing monotony and creating an engaging reading experience.
3Extent of automation
If feature graphic detection is added to determine user response correctness, then interactivity is enhanced, but device complexity increases
Solution Approach 1:
The system enhances interactivity by implementing feature graphic detection to determine user response correctness and providing appropriate feedback. This adds automated interaction capability while the complexity is managed through integration with existing image recognition frameworks.
Data Source
AI summary
A graphic recognition-based interactive method and electronic device. The interactive method comprises: acquiring a first image to be analyzed (101); recognizing the first image to be analyzed to obtain a recognition result (102); playing a narration audio file associated with the recognition result (103); playing a question audio file associated with the interactive content of the first image to be analyzed based on the recognition result after the narration audio file is played (104); acquiring a second image to be analyzed (105); determining whether a feature graphic exists in the second image to be analyzed (106); if the feature graphic exists in the second image to be analyzed, determining whether the feature graphic overlaps with an interactive region, wherein the interactive region is an area corresponding to an answer to the question in the question audio file (108); playing a correct audio file if the feature graphic and the interactive region are overlapped (109); and playing a wrong audio file if the feature graphic and the interactive region are not overlapped (110). The said method provides increased interactivity.