Deformable Surface AR Tracking for Tactile Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional electronic media struggles to replicate the tactile and interactive experiences of tangible media, such as art and children's coloring books, limiting the translation of creative activities into immersive electronic experiences.
Innovation Solution
Deformable-surface tracking based augmented reality image generation systems and methods that allow users to interact with augmented reality representations of modified tangible images in real-time, using hardware processors and cameras to capture and process image data, identify image templates, and generate three-dimensional augmented reality images from two-dimensional deformable surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If traditional electronic media is used to replace tangible media, then the visual richness and immersiveness are improved, but the tactile interaction experience is lost
Solution Approach 1:
The patent combines tangible media (physical coloring book pages) with electronic media (AR devices and software) to create an integrated system. The AR system overlays digital content onto physical surfaces, allowing users to maintain tactile interaction with paper while experiencing enhanced visual richness through augmented reality elements, thereby merging the advantages of both media types.
Solution Approach 2:
The AR device acts as an intermediary between the tangible coloring book and the user's sensory experience. It captures images of the physical page, processes them through image recognition algorithms, and overlays augmented visual elements, thereby mediating between the tactile physical medium and the enhanced visual output without eliminating the tactile interaction.
2Ease of operation
If tangible media is used for creative activities, then tactile interaction is maintained, but visual richness and immersiveness are limited
Solution Approach 1:
The system merges traditional tangible media with modern AR technology to simultaneously preserve tactile interaction and enhance visual richness. The physical coloring book maintains its tactile properties while AR overlays add dynamic visual elements, animations, and interactive components that would be impossible with traditional media alone.
Solution Approach 2:
The system changes the visual parameters of the tangible media by overlaying AR content that can dynamically adjust brightness, color, animation speed, and other visual parameters based on user interaction, thereby enhancing the visual richness of the static physical medium without altering its tactile properties.
3Speed
If AR systems process complex image data in real-time, then interaction responsiveness is improved, but computational complexity increases
Solution Approach 1:
The system performs preliminary actions by pre-processing and pre-registering 3D models and textures before they are needed during interaction. Image templates and corresponding AR content are prepared in advance and stored for quick retrieval, allowing the system to respond rapidly to user interactions without performing complex processing in real-time.
Solution Approach 2:
The system segments the computational task by dividing image processing into distinct stages: initial image capture, template matching, feature point detection, and AR content rendering. Each stage processes only the necessary data for that specific step, reducing the computational burden at any given moment and enabling real-time responsiveness.
Data Source
AI summary
There are provided systems and methods for performing deformable-surface tracking based augmented reality image generation. In one implementation, such a system includes a hardware processor and a system memory storing an augmented reality three-dimensional image generator. The hardware processor is configured to execute the augmented reality three-dimensional image generator to receive image data corresponding to a two-dimensional surface, and to identify an image template corresponding to the two-dimensional surface based on the image data. In addition, the hardware processor is configured to execute the augmented reality three-dimensional image generator to determine a surface deformation of the two-dimensional surface. The hardware processor is further configured to execute the augmented reality three-dimensional image generator to generate an augmented reality three-dimensional image including at least one feature of the two-dimensional surface, based on the image template and the surface deformation of the two-dimensional surface.