Dual Camera AR Texture Mapping for Messaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) experiences on messaging applications face delays and resource inefficiencies due to the need to toggle between front and rear-facing cameras, leading to lag, missed opportunities for capturing content, and poor quality videos, as they typically operate with a single camera at a time.
Innovation Solution
The system enables simultaneous activation and utilization of multiple cameras (front and rear-facing) to capture and process images or videos, allowing for seamless switching and improved resource management by detecting real-world objects in one image and applying textures or AR elements to another, enhancing the user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system toggles between front and rear-facing cameras to capture content, then the user can access both camera views, but delays and lag occur due to sequential camera switching
Solution Approach 1:
The patent merges the functionality of front and rear-facing cameras by simultaneously activating both cameras and processing their feeds together in a single AR experience. This allows the system to eliminate sequential switching delays by having both cameras operate in parallel, with the processor managing both video streams concurrently to provide seamless camera view transitions.
2Use of energy by moving object
If the system uses a single camera at a time, then resource consumption is reduced, but video quality and AR experience are degraded
Solution Approach 1:
The patent implements dynamic resource management where the system activates multiple cameras simultaneously but dynamically adjusts their usage based on processing capacity and user needs. The processor can selectively process feeds from one or both cameras depending on current system state, allowing flexible optimization between resource consumption and video quality without being locked into a fixed single-camera or multi-camera mode.
3Productivity
If the system switches cameras sequentially, then camera resources are managed efficiently, but content capture opportunities are missed
Solution Approach 1:
The patent applies preliminary action by pre-processing and buffering video feeds from multiple cameras before they are needed for AR composition. The system prepares camera feeds in advance, maintaining ready-to-use buffers of both front and rear camera streams, so that when AR elements need to be composited, the data is already available without requiring real-time camera switching or risking missed capture moments.
Data Source
AI summary
Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems perform operations including: detecting a real-world object depicted in a first image captured by a first camera of a client device, the client device comprising a second camera; extracting one or more textures from the real-world object depicted in the first image; selecting a target object depicted in a second image captured by the second camera, the second image being captured by the second camera simultaneously with the first image captured by the first camera; generating an augmented reality (AR) element comprising the target object modified based on the one or more textures extracted from the real-world object depicted in the first image; and causing display of the AR element within the second image.