3D Apparel Rendering with Illumination Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional on-model-product photography for apparel is time-consuming and expensive, and computer-aided solutions have not fully replaced traditional photo sessions due to limitations in capturing consistent environmental conditions and realistic integration of virtual apparel models with human models.
Innovation Solution
A method and apparatus that generate an artificial picture of a person wearing selectable apparel by combining a 3D person model with illumination condition data and a rendered 3D apparel model, using techniques such as 3D scanning, depth sensors, and photogrammetry to create a photorealistic image without the need for complex 3D scene rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional on-model-product photography is used, then realistic images of apparel on models are obtained, but the process is time-consuming and expensive
Solution Approach 1:
The patent uses a 3D digital copy of the model (created from photogrammetry or 3D scanning) to replace the physical model in photo shoots. This digital twin can be reused indefinitely without additional time or cost, while maintaining realistic appearance through high-quality rendering that replicates skin texture, lighting, and environmental interactions.
Solution Approach 2:
The patent replaces the mechanical/physical photo shooting process (models, photographers, lighting technicians, studios) with a computational system. Instead of physically capturing images with cameras and lighting equipment, the system uses computer graphics rendering to generate photorealistic images digitally, eliminating the need for physical photo sessions.
2Productivity
If multiple photos are taken during a photo shooting session, then more apparel items can be photographed, but the cost and time increase proportionally
Solution Approach 1:
The patent performs preliminary action by creating a complete 3D digital model of the model before the photo session. This pre-created digital twin can then be used to generate unlimited variations of apparel images without requiring additional photo shooting time. The heavy computational work of creating the realistic 3D model is done once, enabling rapid generation of multiple apparel presentations.
Solution Approach 2:
The 3D digital model serves multiple functions: it can display different apparel items, pose in various positions, respond to different lighting conditions, and be used across multiple projects. This single digital asset replaces the need for multiple physical photo sessions, allowing unlimited productivity from a single model creation effort.
3Adaptability or versatility
If photo shooting continues over several days, then more apparel can be photographed, but environmental conditions vary making consistency difficult
Solution Approach 1:
The patent captures the environmental conditions (lighting, background, atmosphere) as digital data during an initial reference photo session, then recreates these conditions exactly in the 3D rendering environment. This digital copy of the environment ensures that all subsequently generated images, regardless of when they are created, maintain identical environmental consistency without being affected by real-world variations.
Solution Approach 2:
The patent performs preliminary measurement and recording of all environmental parameters (lighting angles, intensity, color temperature, background characteristics) before generating the apparel images. This pre-captured environmental data is then used as the basis for all rendering, ensuring that environmental conditions remain stable and consistent across all generated images, independent of when the rendering occurs.
4Loss of time
If computer-aided solutions are used to replace photo sessions, then time and cost are reduced, but realistic integration of virtual apparel models with human models is difficult
Solution Approach 1:
The patent creates a photogrammetric 3D model that copies the actual model's geometry, texture, and appearance with high fidelity. This digital copy includes accurate skin textures, body proportions, and surface characteristics, allowing the virtual model to be indistinguishable from a real photo when rendered with appropriate lighting and environmental conditions.
Solution Approach 2:
The patent applies different levels of detail and quality to different parts of the model: high-resolution photogrammetric textures for skin areas that need realism, accurate 3D geometry for body contours, and appropriate material properties for clothing. This localized quality approach ensures that critical areas (like skin and fabric interfaces) have the highest realism while maintaining overall efficiency.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The present invention relates to a method for generating an artificial picture of a person wearing a selectable piece of apparel, the method comprising the steps of providing a 3D person model of at least a part of the person, providing a photo of the person corresponding to the 3D person model, providing illumination condition data relating to the photo, selecting the piece of apparel, and generating the artificial picture as a combination of the photo and a rendered 3D apparel model of the selected piece of apparel, wherein rendering the 3D apparel model considers the illumination condition data and the 3D person model, wherein considering the illumination condition data comprises applying the illumination condition data to the 3D apparel model and/or to the 3D person model.