AR Virtual Object Surface Texture Customization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems lack the ability to realistically integrate virtual objects into real-world environments captured in camera feeds, as they fail to consider and replicate the depth and texture of real-world objects.
Innovation Solution
The system allows users to modify the surface textures of virtual objects to match the underlying real-world environment, making the objects appear as if they exist within that environment, and enables the use of additional camera feeds to incorporate more environmental elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual objects are displayed in camera feed without surface texture modification, then system complexity is low, but realism and integration with real-world environment is poor
Solution Approach 1:
The patent applies the copying principle by capturing surface textures from the real-world environment through the camera feed and applying them to virtual objects. The system copies visual characteristics (colors, patterns, lighting) from background elements and transfers them to virtual objects, making them appear as if they are part of the real environment. This resolves the contradiction by achieving high realism through texture copying while keeping the system relatively simple compared to full 3D scanning and reconstruction approaches.
2Loss of information
If multiple camera feeds are used to capture more environmental elements, then completeness of environmental representation is improved, but device complexity and processing requirements increase
Solution Approach 1:
The patent applies the universality principle by designing a system where a single camera feed serves multiple functions: it captures both the real-world environment for texture sampling and provides the base layer for virtual object composition. The same camera input is used for both environmental understanding and virtual object rendering, eliminating the need for separate specialized sensors and reducing overall system complexity while maintaining complete environmental representation.
3Reliability
If surface textures are modified to match real-world environment, then visual integration is improved, but processing time and computational resources increase
Solution Approach 1:
The patent applies the partial action principle by selectively modifying only the surface textures of virtual objects rather than performing complete 3D rendering transformations. The system applies texture mapping and color adjustment to make virtual objects blend with the environment, which is sufficient for achieving visual integration without the excessive computational cost of full photorealistic rendering. This partial modification approach achieves adequate visual integration while significantly reducing processing time.
Data Source
AI summary
Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.