AR Virtual Object Rendering via Pose-Based Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies require manual adjustment of virtual object size and placement, increasing user operations and reducing interactive experience.
Innovation Solution
An image processing method and apparatus that determine a reference surface for virtual object placement, acquire pose information of the image collection device relative to this surface, and automatically adjust the display size of the virtual object based on the pose information, rendering it onto the image without manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual adjustment of virtual object size and placement is used, then user control over object placement is improved, but user operations increase and interactive experience deteriorates
Solution Approach 1:
The system automatically determines the display size of the virtual object based on pose information without requiring user input. The processor acquires pose information of the image collection device relative to the reference surface, and automatically calculates the appropriate display size, making the system self-adjusting and eliminating manual intervention.
Solution Approach 2:
The display size of the virtual object is dynamically adjusted based on changes in pose parameters. As the pose information (position and orientation) of the image collection device changes relative to the reference surface, the display size parameter of the virtual object is automatically modified to maintain appropriate scaling and perspective.
2Extent of automation
If automatic size adjustment based on pose information is implemented, then interactive experience is improved, but device complexity increases
Solution Approach 1:
The processor performs multiple functions: it acquires pose information, determines the reference surface, calculates display size, and renders the virtual object. By consolidating these functions into a single processing unit, the system avoids the need for separate dedicated components for each function, thereby managing complexity while achieving automation.
Solution Approach 2:
Pose information serves as an intermediary data structure that connects the physical device state to the virtual object rendering. Instead of directly mapping complex device states to rendering parameters, the system uses pose information as an intermediate representation that simplifies the calculation of display size and other rendering parameters.
Data Source
AI summary
An image processing method and apparatus, and a computer readable medium are provided. The method includes that includes: a first reference surface on which a virtual object is placed is determined based on an image collected by an image collection device; a to-be-placed virtual object and pose information of the image collection device relative to the first reference surface are acquired; a display size of the to-be-placed virtual object is determined based on the pose information; and the to-be-placed virtual object is rendered on the image according to the display size.