AR Object Reflective Surface Realism via Dual Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices fail to provide a realistic augmented reality experience when displaying virtual objects with reflective surfaces, as they do not accurately reflect the environment on the opposite side, lacking a high sense of reality.
Innovation Solution
An electronic device equipped with a touchscreen, two cameras, and a processor that captures and displays images, identifies the angle of reflective surfaces, and performs perspective transformation on the second image to apply it to the virtual object's reflective surfaces, enhancing the realism by overlaying the real environment's image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual objects with reflective surfaces are displayed on captured images, then augmented reality functionality is provided, but the sense of reality is not high because the reflective surfaces do not accurately reflect the real environment
Solution Approach 1:
The patent captures the real environment using a second camera and applies this captured image to the reflective surface of the virtual object. This copying approach replicates the actual reflected scene, ensuring that the virtual sunglasses display the same environment that would be visible in the real-world reflective surface, thereby restoring the sense of reality.
Solution Approach 2:
The patent introduces a second camera as an intermediary device to capture the environment that should be reflected. This intermediary captures the scene from the appropriate angle and position, then transfers this information to the virtual object's reflective surface, solving the problem of how to obtain accurate reflected environment data.
2Reliability
If the environment is reflected on virtual objects with reflective surfaces, then the sense of reality is increased, but the device complexity increases due to requiring additional cameras and processing
Solution Approach 1:
The second camera serves multiple functions: it captures the environment for reflective surfaces, and this same captured image can be used for various virtual objects with reflective properties. The processing system also handles multiple tasks including identifying reflective surfaces, determining angles, performing perspective transformations, and applying the captured images, thereby reducing overall system complexity through multi-functionality.
Solution Approach 2:
The patent transforms the captured environment image through perspective transformation based on the identified angle of the reflective surface. By changing the parameters of the captured image (applying geometric transformations), the system adapts the environment photo to match the specific orientation and geometry of each reflective surface, achieving realism without requiring complex physical setups.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution increases the sense of reality by accurately reflecting the environment on virtual objects with reflective surfaces, such as sunglasses, by applying the transformed image from the second camera to the virtual object's reflective surfaces, providing a more immersive augmented reality experience.
Implementation Method 1
an object (e.g., sunglasses) having a reflective material is displayed, an environment of the opposite side may be reflected thereon
Data Source
AI summary
Various embodiments of the present disclosure relate to an electronic device and a method of providing an augmented reality object thereof. The electronic device includes: a touchscreen; a first camera capturing a first image; a second camera capturing a second image; a processor operatively coupled with the touchscreen, the first camera, and the second camera; and a memory operatively coupled with the processor, wherein the memory stores instructions, when executed, causing the processor to: display the first image captured via the first camera on the touchscreen; receive a user input for adding at least one augmented reality object having at least one reflective surface on the first image; acquire the second image via the second camera in response to the user input; identify an angle of the reflective surface; and perform perspective transformation on the second image on the basis of the identified angle, and apply at least part of the perspective-transformed second image to each reflective surface of the augmented reality object. Other various embodiments are possible.