AR Video Overlay on Print Media via 3D Texture Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems and traditional video playback methods on mobile terminals lack the ability to provide an engaging and interactive experience, with limited application scope and outdated video playback methods.
Innovation Solution
A method and system that uses augmented reality technology to convert picture information from print media into video, synchronizing audio and video playback by capturing scene images, registering them with reference images, calculating homography matrices, and rendering 3D models to overlay video frames on real scenes, providing a new audio-visual experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional video player software is used on mobile terminals, then video playback function is provided, but the playback manner is outdated and lacks attraction
Solution Approach 1:
The patent merges augmented reality technology with video playback functionality, combining the virtual 3D model rendering with real-world scene capture to create an immersive playback experience that transcends traditional video players
Solution Approach 2:
The patent transitions from traditional 2D video playback to 3D augmented reality playback by rendering virtual 3D models that overlay on real-world scenes, adding a spatial dimension to video consumption
2Adaptability or versatility
If virtual three-dimensional model is directly superposed on real scene, then augmented reality effect is achieved, but the application scope is limited
Solution Approach 1:
The patent creates a multi-functional system that can handle both traditional video playback and augmented reality experiences, making the device adaptable to various application scenarios from simple video viewing to complex AR interactions
Solution Approach 2:
The patent segments the video playback system into modular components including scene capture module, model rendering module, and composite display module, allowing flexible configuration for different application needs
3Productivity
If picture information from print media is converted into video information, then new audio-visual experience is provided, but real-time processing capability is required
Solution Approach 1:
The patent performs preliminary actions by pre-processing and storing video data in advance, allowing rapid retrieval and real-time rendering when needed, thus reducing actual processing time during user interaction
Data Source
AI summary
Disclosed is a video playing method based on augmented reality technology. In combination with augmented reality technology, a rectangular plane 3D model which completely covers a target picture in a current scene image is drawn, and at the same time, after a video file related to the target picture is separated into an audio stream and a video stream, a video image frame in the video stream is taken as a texture and is mapped to the 3D model frame by frame, and graphic rendering is performed; and finally, a scene image captured by a video camera and the rendered 3D model are fused and output, and the audio stream data is output synchronously. Correspondingly, also disclosed are a video playing system based on augmented reality technology and mobile terminal. The picture information in newspapers and periodicals, magazines and other print media can be easily converted into video information, and the video completely fits the picture in the spatial position, so that a user obtains a new audio-visual experience of combining emotion with scenery; and newspapers and periodicals, magazines and other paper media can also realize diversified propagation of information by virtue of the technology of the present invention, and provide a precise fast video push service.