Modular Image Processing SDK for Third-Party AR Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing devices face challenges in performing image processing operations on digital images captured under varying conditions, and third-party app developers lack the resources to provide enhanced visual effects due to lack of knowledge and budget, necessitating a solution to enable image enhancement capabilities in their apps.
Innovation Solution
A software development kit (SDK) is provided that includes an application programming interface (API) to receive API calls from third-party applications, performs image processing operations using AR content generators, and integrates with a messaging application to enhance image processing capabilities without launching it, allowing developers to create, store, and load external effects and asset data for augmented reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If third-party app developers want to provide enhanced visual effects, then the functionality and user experience of their apps is improved, but they lack the knowledge and budget to implement such effects
Solution Approach 1:
The patent introduces a messaging application as an intermediary service that provides image processing and augmented reality effects. Third-party developers can integrate these effects into their apps without needing to build the complex image processing capabilities themselves, thus resolving the contradiction between providing enhanced functionality and lacking developer resources
Solution Approach 2:
The messaging application serves as a universal platform that provides multiple image processing functions (filters, effects, augmented reality) that can be integrated into various third-party apps. This multi-functional service allows different developers to access the same powerful toolset without each needing to develop it independently
2Manufacturing precision
If image processing operations are performed on digital images, then the visual quality and enhancement is improved, but the computational intensity and processing time increases
Solution Approach 1:
The system pre-processes and prepares image data and effects templates in advance. By having processing frameworks, effect libraries, and image data prepared beforehand, the actual image processing operations can be executed more efficiently with reduced computational intensity during runtime
Solution Approach 2:
The image processing task is divided into separate modules including effect application, image filtering, and rendering components. This segmentation allows the system to process images in stages using appropriate computational resources for each stage, optimizing both quality and computational efficiency
3Adaptability or versatility
If AR content generators are integrated into third-party apps, then the augmented reality functionality is improved, but the system complexity and integration difficulty increases
Solution Approach 1:
The messaging application acts as an intermediary that provides standardized AR content generators and effect templates. Third-party developers can integrate augmented reality functionality by simply calling predefined APIs rather than building complex AR systems from scratch, thus reducing integration difficulty while maintaining functionality
Solution Approach 2:
Instead of requiring developers to create original AR effects from scratch, the system provides pre-generated AR content templates and effect copies that can be directly integrated into apps. This allows developers to leverage existing sophisticated AR implementations without reproducing the complex underlying technology
Data Source
AI summary
A modular image processing SDK comprises an API to receive API calls from third party software running on a portable device including a camera. SDK logic receives and processes commands and parameters received from the API that are based on the API calls received from the third party software. An annotation system performs image processing operations on a feed from the camera based on image processing instructions and parameters received by the annotation system from the SDK logic. The image processing is based at least in part on augmented reality content generator data (or AR content generators), user input and sensor data.