Image Processing SDK Carousel for Modular, Resource-Efficient AR Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing devices face challenges in performing computationally intensive image processing operations, especially in capturing and enhancing digital images under varying conditions, and third-party app developers lack the resources to provide sophisticated visual effects.
Innovation Solution
A modular software development kit (SDK) is provided that enables third-party developers to integrate augmented reality content generators, allowing image modification features and augmented reality experiences, including real-time and stored content transformations, with support for object detection, tracking, and transformation using 3D mesh models and neural network analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If third-party developers create apps with image processing features, then app functionality and user engagement improve, but computational resources and processing capability deteriorate
Solution Approach 1:
The patent introduces an intermediary SDK layer between the app developer and the image processing engine. The SDK provides pre-built image processing capabilities that developers can integrate into their apps without having to build the computational infrastructure themselves. This mediator handles the computationally intensive tasks while allowing developers to create feature-rich applications.
Solution Approach 2:
The SDK provides a universal image processing platform that can be used across multiple different apps and use cases. By creating a multi-functional SDK that handles various image processing tasks (filtering, enhancement, transformation), the system allows third-party developers to access sophisticated capabilities without each developer needing to implement their own processing engine.
2Manufacturing precision
If sophisticated image processing capabilities are provided, then visual effect quality improves, but device complexity and resource requirements worsen
Solution Approach 1:
The patent segments the image processing system into distinct modular components including filtering modules, enhancement modules, transformation modules, and object detection modules. Each module handles a specific aspect of image processing, allowing the system to provide sophisticated capabilities while keeping individual components manageable and resource-efficient.
Solution Approach 2:
The SDK performs preliminary preparation of image processing algorithms and models before they are needed by the application. By pre-configuring and optimizing processing pipelines in advance, the system reduces the computational burden during actual image processing operations, thereby maintaining high visual effect quality while reducing real-time resource requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A user interface method is provided by an SDK embedded in a third party resource running on a portable device including a camera and a display. The method includes receiving an API call to display an image processing user interface and in response, displaying a first user interface comprising a list of selectable graphical items corresponding to a group of available image modification features. If user selection of a desired graphical item from the list of selectable graphical items is received, image modification features corresponding to the desired graphical item are applied to an image received from the camera, generating a modified image. A second user interface including the modified image is then displayed on the display.