AR Image Processing SDK for Third-Party App Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Third-party developers of apps on portable computing devices lack the resources and expertise to provide sophisticated augmented reality (AR) effects, and existing systems do not efficiently support the creation, sharing, and integration of AR content generators within apps.
Innovation Solution
A software development kit (SDK) is provided that includes an application programming interface (API) and annotation system to enable third-party developers to integrate AR content generators, allowing image processing operations on camera feeds, with support from a server-hosted SDK provider for image processing instructions and parameters, and enabling AR content generation and sharing across networks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If third-party developers build their own AR effects capabilities, then they can provide sophisticated AR effects in their apps, but they lack the resources and expertise to do so effectively
Solution Approach 1:
The patent introduces an intermediary system consisting of a content generator platform and SDK that mediates between AR effect creators and third-party app developers. This platform pre-processes and packages AR effects into standardized content generators that can be easily integrated into apps, eliminating the need for developers to build AR capabilities from scratch while maintaining high quality standards.
Solution Approach 2:
The patent segments the AR development process into distinct components: content generation, packaging, distribution, and integration. By dividing the complex AR development task into manageable segments handled by different system components, the solution reduces overall complexity for third-party developers while preserving sophisticated AR effect capabilities.
2Adaptability or versatility
If AR content generators are distributed across networks, then sharing and management of AR content is facilitated, but efficient integration and processing require sophisticated systems
Solution Approach 1:
The patent creates a universal content generator format that can be used across multiple platforms and applications. This standardized interface allows AR content to be shared and integrated efficiently across different apps and devices, reducing integration complexity while enhancing content sharing capabilities through a single, multi-functional format.
3Reliability
If image processing operations are performed on camera feeds in real-time, then sophisticated AR effects can be applied, but computational resources are heavily consumed
Solution Approach 1:
The patent performs preliminary processing of AR effects during the content generation and packaging phase, preparing optimization instructions and pre-processed data that reduce the computational burden during real-time execution. This advance preparation allows high-quality AR effects to be applied with lower energy consumption during actual camera feed processing.
Data Source
AI summary
A modular image processing SDK comprises an API to receive API calls from third party software running on a portable device including a camera. SDK logic receives and processes commands and parameters received from the API that are based on the API calls received from the third party software. An annotation system performs image processing operations on a feed from the camera based on image processing instructions and parameters received by the annotation system from the SDK logic. The image processing is based at least in part on augmented reality content generator data (or AR content generators), user input and sensor data.