Height Map Shadow Generation for Digital Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image shadowing systems are inflexible, inaccurate, and inefficient, often relying on three-dimensional models for shadow generation, which limits their ability to produce realistic shadows under varying lighting conditions and requires significant computing resources and user interaction.
Innovation Solution
A height-based shadowing system that generates shadows using height maps for digital objects, allowing flexible control over shadow characteristics and eliminating the need for three-dimensional models by utilizing neural networks to predict pixel heights and determine shadow projections based on lighting conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If three-dimensional models and physics-based shadow rendering algorithms are used, then shadow generation accuracy is improved, but computing resources and device complexity increase significantly
Solution Approach 1:
The patent uses a two-dimensional height map as a simplified copy or representation of the three-dimensional object geometry, rather than requiring the full three-dimensional model. This height map captures only the essential vertical profile information needed for shadow generation, dramatically reducing computational complexity while maintaining shadow accuracy.
Solution Approach 2:
The patent extracts only the necessary geometric information (height profile) from the complex three-dimensional model to create a simplified height map. This extraction process removes unnecessary computational overhead while preserving the critical data needed for accurate shadow rendering.
2Measurement precision
If three-dimensional models are used for shadow generation, then shadow accuracy is improved, but user interaction time and operation difficulty increase
Solution Approach 1:
The system automatically generates the height map from the input image using neural network processing, eliminating the need for users to manually create or adjust three-dimensional models. The automated pipeline handles model generation, shadow calculation, and rendering without requiring user intervention, thereby improving ease of operation while maintaining shadow accuracy.
3Adaptability or versatility
If neural-network-based image synthesis is used, then flexibility is improved, but shadow control capability deteriorates
Solution Approach 1:
The patent introduces a height map as an intermediary data structure between the input image and the shadow rendering process. This height map serves as a controllable intermediate representation that maintains flexibility in handling various objects while providing explicit geometric information that enables precise shadow control through simple parameter adjustments.
Data Source
AI summary
The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate a height map for a digital object portrayed in a digital image and further utilizes the height map to generate a shadow for the digital object. Indeed, in one or more embodiments, the disclosed systems generate (e.g., utilizing a neural network) a height map that indicates the pixels heights for pixels of a digital object portrayed in a digital image. The disclosed systems utilize the pixel heights, along with lighting information for the digital image, to determine how the pixels of the digital image project to create a shadow for the digital object. Further, in some implementations, the disclosed systems utilize the determined shadow projections to generate (e.g., utilizing another neural network) a soft shadow for the digital object. Accordingly, in some cases, the disclosed systems modify the digital image to include the shadow.