AR Image Processing Bypassing 3D Model Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality, displaying virtual objects requires reconstructing three-dimensional virtual models, which consumes significant computing resources and time, leading to lower display efficiency and user experience.
Innovation Solution
An image processing method that uses image recognition technology to directly determine the target object and display associated objects in a live-action image, eliminating the need for virtual model reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If three-dimensional virtual models are reconstructed for displaying virtual objects in augmented reality, then the visual realism and immersion are improved, but computing resource consumption increases and display efficiency decreases
Solution Approach 1:
The patent uses image recognition to identify target objects in live-action images and superimposes corresponding displaying objects (such as text, icons, or simplified graphics) at determined positions. This copying approach replaces the need to reconstruct three-dimensional virtual models, achieving visual presentation while significantly reducing computing resource consumption and improving display efficiency.
Solution Approach 2:
The patent extracts the essential function of object identification and positioning from complex three-dimensional reconstruction processes. By using image recognition to determine target object positions and extracting only the necessary display information, the system achieves augmented reality effects without the computational burden of full 3D model reconstruction.
2Ease of operation
If three-dimensional virtual models are reconstructed for augmented reality display, then the immersion and interaction quality are improved, but computing resource consumption and processing time increase
Solution Approach 1:
The patent creates simplified representations (copying) of target objects as displaying objects for augmented reality interaction. Instead of reconstructing complex three-dimensional models, the system uses image recognition to identify objects and displays simplified versions at determined positions, maintaining interaction quality while reducing computing resource consumption.
Solution Approach 2:
The patent applies partial action by only processing and displaying the essential information needed for augmented reality interaction. Rather than performing complete three-dimensional reconstruction, the system extracts and displays only the necessary object identification and positioning data, reducing computational effort while maintaining sufficient user interaction quality.
3Productivity
If image recognition is used to directly display associated objects in live-action images, then computing resources are saved and display efficiency is improved, but the complexity of image processing and object association determination increases
Solution Approach 1:
The patent employs preliminary action by pre-establishing association relationships between target objects and displaying objects before the actual display process. This allows the system to quickly retrieve and display appropriate objects once target objects are identified through image recognition, reducing real-time processing complexity while maintaining high display efficiency.
Data Source
AI summary
Embodiments of the present disclosure provide an image processing method and apparatus, an electronic device, and a program product. The method includes: obtaining a live-action shooting image; determining a target object image in the live-action shooting image, where the target object image is an image containing a target object; acquiring a displaying object associated with the target object; determining, according to the target object image, a target displaying position of the displaying object in the live-action shooting image; and displaying the displaying object at the target displaying position in the live-action shooting image. According to the technical solution provided by the embodiments, an augmented reality display technology is used for directly displaying the displaying object associated with the target object; and reconstruction of a virtual model is no longer required, thereby saving computing resources, improving display efficiency, and enabling a user to obtain better interaction experience and visual experience.