Augmented Reality Component Portrait Image Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic messaging systems lack the capability to seamlessly integrate augmented reality (AR) components that can modify content based on previously captured and stored images of users, particularly within the camera view user interface.
Innovation Solution
The messaging system incorporates an AR component that allows users to access and modify content by overlaying images or animations onto captured frames, using a portrait image of the user to create a face object that can be integrated into target media content objects within the camera view interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR components are integrated into the messaging system to modify content using portrait images, then the user experience and interactivity are enhanced, but the device complexity and processing requirements increase
Solution Approach 1:
The AR processing functionality is segmented into a separate server system that handles computationally intensive tasks such as face object extraction, animation modification, and augmented content generation. The client device only needs to capture images and display results, dividing the complex processing workload between server and client to reduce device complexity while maintaining AR capabilities
Solution Approach 2:
A server system acts as an intermediary between the client device and the AR content generation process. The server receives captured images, processes them to extract face objects, modifies target media content objects, and returns the augmented content to the client for display, mediating the complex processing operations externally
2Ease of operation
If real-time AR modification is implemented using captured images, then the interactivity and engagement are improved, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing and storing portrait images of users in the messaging system. When AR modification is requested, the system can quickly retrieve the pre-stored face objects and apply them to target media content objects without needing to extract faces from scratch, significantly reducing processing time while maintaining real-time interactivity
Solution Approach 2:
The patent replaces traditional real-time computer vision processing on the client device with server-based image processing. The mechanical/computational burden of face detection, extraction, and animation modification is substituted with server-side processing that leverages distributed computing resources, reducing client device processing time and enabling faster AR content generation
Data Source
AI summary
The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.