Depth-Based Selective Stylized Image Painting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image editing technologies on computing devices lack the ability to efficiently apply artistic styles to selected regions of an image, providing limited creative freedom and immersive experience.
Innovation Solution
A photo filter system utilizing a depth-capturing camera, such as eyewear devices with visible light cameras and depth sensors, applies artistic styles to selected image regions, generating a stylized painting effect with a light field appearance of spatial movement or rotation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If artistic styles are applied to selected regions of images using existing image editing technologies, then creative freedom is improved, but the ability to generate immersive 3D-like effects deteriorates
Solution Approach 1:
The patent segments the image into multiple depth layers or planes, allowing different artistic styles to be applied to different regions at different depths. This segmentation enables selective stylization while preserving 3D spatial relationships, resolving the contradiction between creative freedom and immersive 3D effects.
Solution Approach 2:
The patent introduces a depth dimension to traditional 2D image editing by applying styles across multiple depth planes. This dimensional extension allows users to selectively stylize objects at different distances from the camera, maintaining 3D immersion while enabling creative freedom through region-specific artistic effects.
2Adaptability or versatility
If selective region styling is implemented, then creative freedom is improved, but computational complexity increases
Solution Approach 1:
The patent applies different artistic styles and processing qualities to different local regions of the image based on their depth and spatial location. By localizing the computational processing to only the regions that require stylization rather than processing the entire image uniformly, the system reduces overall computational complexity while maintaining selective region styling capabilities.
Solution Approach 2:
Instead of applying artistic styles to all regions of the image, the patent selectively applies styling only to specific depth planes or regions identified by the user or algorithm. This partial action approach reduces computational burden while preserving the creative freedom to stylize particular areas of interest.
3Ease of operation
If depth-capturing cameras with multiple cameras are used, then 3D-like effects are improved, but device complexity increases
Solution Approach 1:
The patent designs the image processing system to handle multiple camera inputs and depth information through a unified processing architecture. By creating a universal processing pipeline that can accommodate various camera configurations and depth-capturing methods, the system reduces the apparent complexity of using multiple cameras while maintaining high-quality 3D-like effects.
Data Source
AI summary
A photo filter (e.g., artistic/stylized painting) light field effect system includes an eyewear device having a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the stylized image painting effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The stylized image painting effect system generates a photo filter stylized painting effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.