Synthetic AR Try-On Views Without Camera Repositioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual try-on experiences in augmented reality (AR) systems require users to awkwardly maneuver their devices to view fashion items from different perspectives, leading to distorted images and loss of facial tracking, which detracts from the overall experience.
Innovation Solution
The system intelligently generates synthetic views of fashion items by detecting items in a real-time camera feed and synthesizing images from different angles, allowing seamless access to multiple perspectives without manual device manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users manually maneuver devices to view fashion items from different perspectives, then they can see multiple angles, but the images become distorted and facial tracking is lost
Solution Approach 1:
The system creates synthetic copies of the real-world image from different camera perspectives using generative AI models. Instead of physically changing the camera angle, the system generates virtual images that replicate what would be seen from different angles, maintaining image quality and facial tracking while providing multiple viewing perspectives.
Solution Approach 2:
The patent replaces the mechanical action of physically moving the camera device with an AI-based image synthesis system. The generative model substitutes for manual device manipulation, automatically generating multiple perspective views without requiring users to physically reposition their device, thereby avoiding distortion and tracking loss.
2Adaptability or versatility
If users manually maneuver devices to view fashion items from different perspectives, then they can see multiple angles, but time and resources are consumed
Solution Approach 1:
The system performs preliminary image synthesis to generate multiple perspective views in advance. By pre-computing the synthetic images using generative AI models, the system eliminates the need for users to manually adjust their device multiple times, significantly reducing the time required to view fashion items from different angles.
Solution Approach 2:
Instead of requiring repeated physical captures from different angles, the system creates digital copies of the fashion item from multiple perspectives using AI generation. This allows users to access all viewing angles instantly without the time cost of manual device maneuvering and recapturing images.
3Adaptability or versatility
If users manually maneuver devices to view fashion items from different perspectives, then they can see multiple angles, but the AR item integration is compromised
Solution Approach 1:
The system generates synthetic copies of the real-world scene from different perspectives while maintaining consistent AR item placement. The generative AI model creates virtual images that preserve the spatial relationship between the fashion item and AR overlays, ensuring that AR integration remains reliable and coherent across all viewing angles.
Solution Approach 2:
Instead of capturing images from multiple physical angles and then trying to integrate AR items consistently, the system inverts the process by generating all perspectives synthetically from a single view and then applying AR integration uniformly across all generated images. This ensures consistent AR integration while providing multiple viewing perspectives.
Data Source
AI summary
Aspects of the present disclosure involve a system for synthetically generating a view of an object to present one or more AR fashion items in an image. The system accesses a first image depicting a first portion of a body of a person from a first camera view. The system detects a fashion item in the first image that is being worn by the person in the first image, the fashion item being depicted in the first image from the first camera view. The system generates an augmented reality (AR) item that visually resembles the fashion item from the second camera view and modifies the second image with the AR item to present a synthetic view of the second portion of the body of the person wearing the AR item corresponding to the fashion item.