Depth-Camera Stylized Painting for Light-Field Image Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image editing technologies on computing devices lack the ability to efficiently apply artistic styles to selected regions of an image, providing limited creative freedom and immersive experiences.
Innovation Solution
A photo filter system using a depth-capturing camera, such as eyewear devices with visible light cameras and depth sensors, applies artistic styles to selected image regions, generating a stylized painting effect with a light field appearance by interpolating between captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If artistic styles are applied to selected regions of images using existing image editing technologies, then creative freedom is enhanced, but the computational complexity and processing time increase significantly
Solution Approach 1:
The patent segments the image processing task by first identifying selected regions of interest (ROIs) within the image, then applying artistic style transfer independently to each region. This segmentation allows the system to handle complex style application by breaking it down into manageable portions, reducing overall computational complexity while maintaining creative flexibility.
Solution Approach 2:
The patent implements local quality enhancement by applying different artistic styles to different regions of the image based on user selections. Each selected region receives customized style treatment tailored to its specific content and location, enabling creative freedom without requiring the entire image to be processed at the same computational intensity.
2Adaptability or versatility
If depth-capturing cameras with multiple sensors are used to generate stylized painting effects, then immersive experience is improved, but device complexity increases
Solution Approach 1:
The patent employs a multi-functional camera system that integrates visible light cameras, infrared cameras, and depth sensors into a unified device. These multiple sensors work together to capture both color and depth information, enabling the generation of stylized painting effects with spatial movement while managing device complexity through coordinated operation of the sensors.
Solution Approach 2:
The patent implements a nested processing architecture where the depth-capturing camera system is integrated within the imaging device, with the infrared camera and depth sensor working in conjunction with the visible light camera. This nested structure allows the system to generate immersive stylized painting effects by layering multiple functional components together.
3Adaptability or versatility
If style transfer algorithms are applied to entire images, then artistic effects are enhanced, but processing time increases
Solution Approach 1:
The patent applies partial action by selectively applying style transfer algorithms only to the selected regions of interest rather than the entire image. This approach maintains the artistic effects in the areas that matter most to the user while significantly reducing processing time by avoiding unnecessary computation in unselected regions.
Solution Approach 2:
The patent implements preliminary action by first identifying and selecting the regions of interest before applying the style transfer algorithm. This preliminary selection step allows the system to prepare and process only the necessary portions of the image, optimizing both the artistic effect quality and processing efficiency.
Data Source
AI summary
A photo filter (e.g., artistic/stylized painting) light field effect system includes an eyewear device having a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the stylized image painting effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The stylized image painting effect system generates a photo filter stylized painting effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.