Adaptive Zoom Try-On for Clear Item View and Face Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging applications struggle with efficiently providing a clear and intuitive virtual try-on experience for fashion items, as users often need to awkwardly maneuver their devices to zoom in on small items, leading to distorted images and loss of facial tracking.
Innovation Solution
An adaptive zoom system that automatically detects and crops fashion items in a real-time camera feed, presenting a focused image within a window alongside the feed, using intent inference from user movements or gestures to adjust the zoom level.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users manually zoom in on small fashion items by maneuvering devices, then the view of the item is enlarged, but the image becomes distorted and facial tracking is lost
Solution Approach 1:
The patent introduces an intermediary processing layer between the camera feed and the user view. A focus region is extracted from the camera feed to create a zoomed view of the fashion item, while the system maintains separate facial tracking data. This intermediary approach allows zooming without directly manipulating the camera, thus preserving facial tracking reliability while improving item visibility.
2Measurement precision
If users manually zoom in on small fashion items, then the item view is enlarged, but the operation becomes awkward and time-consuming
Solution Approach 1:
The system performs automatic detection and zooming without requiring manual user intervention. The focus detection module automatically identifies fashion items in the camera feed, and the system autonomously extracts and displays the focus region. This self-service approach eliminates the need for users to manually maneuver the device, making the operation simple and intuitive while achieving high item visibility.
3Measurement precision
If the camera is brought closer to capture small fashion items, then the item view is enlarged, but the perspective changes and the entire face is no longer visible
Solution Approach 1:
The patent segments the camera feed into multiple independent views: the main camera feed showing the entire face and body, and a separate focus region showing the zoomed fashion item. This segmentation allows both the full face visibility and detailed item view to coexist simultaneously, eliminating the need to choose between them.
4Measurement precision
If manual zooming is used to view small fashion items, then the item view is enlarged, but the time and effort required increases
Solution Approach 1:
The system performs preliminary detection and extraction of the focus region containing the fashion item before the user requests to view it. The focus detection module continuously monitors the camera feed and pre-processes potential focus regions, so when the user wants to view an item, the zoomed view is already prepared and can be displayed immediately, eliminating the time required for manual zooming operations.
Data Source
AI summary
Aspects of the present disclosure involve a system for automatically zooming in on objects in an image. The system accesses a video comprising a frame depicting a person and detects a fashion item being worn by the person in the frame of the video. The system, in response to detecting the fashion item being worn by the person, extracts, from the frame, a portion comprising a depiction of the fashion item being worn by the person. The system generates a focus image of the fashion item using the portion extracted from the frame and presents the focus image of the fashion item together with the video comprising the frame depicting the person.