Layered Image Processing for Realistic Skin Subsurface Scattering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image rendering technologies struggle to accurately depict the transparency and texture of human skin, lacking realism in the representation of subsurface scattering effects.

Innovation Solution

An image processing apparatus that generates image information by combining surface layer and inner layer data using first and second map data, employing ray tracing methods to simulate light reflection and subsurface scattering, thereby enhancing the realism of rendered images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional rendering methods are used, then the rendering process is simple and fast, but the realism of skin texture and transparency is insufficient

Engineering Contradiction:
Improverealism of skin textureVSAvoidcomplexity of rendering process
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The skin is segmented into multiple layers (epidermis, dermis, subcutaneous tissue) with distinct optical properties. Each layer is modeled separately with specific absorption and scattering characteristics, allowing realistic simulation of light interaction while maintaining manageable computational complexity through structured layering.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the skin are assigned locally specific optical properties including varying absorption coefficients, scattering coefficients, and anisotropy factors. This allows heterogeneous skin characteristics (e.g., different pigmentation, thickness variations) to be represented accurately in different areas without requiring uniform complex modeling everywhere.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If subsurface scattering is simulated accurately, then the transparency effect is realistic, but the computational cost increases significantly

Engineering Contradiction:
Improveaccuracy of transparency effectVSAvoidcomputational energy
Core Design Contradiction:
Manufacturing precisionVSUse of energy by stationary object

Solution Approach 1:

The rendering system uses parameter maps that store pre-computed optical properties (absorption coefficient, scattering coefficient, anisotropy) for different skin layers and regions. By changing and adjusting these parameters based on input data, the system can simulate various skin types and lighting conditions without re-computing the entire subsurface scattering model from scratch, reducing computational energy while maintaining accuracy.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If multiple map data layers are combined, then the image information is more comprehensive, but the processing complexity increases

Engineering Contradiction:
Improvecompleteness of image informationVSAvoidcomplexity of data processing
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Multiple map data layers containing different types of information (optical properties, geometric data, texture information) are merged into a unified data structure. This consolidation allows comprehensive skin representation while simplifying the processing pipeline by providing all necessary information in an integrated format that can be accessed systematically during rendering.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The apparatus achieves realistic texture representation by accurately modeling light interactions within the skin layers, resulting in more lifelike images.

Implementation Method 1

a first generation process of using the first map data to generate surface layer image information based on light reflected from the surface layer of the object

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a second generation process of using the second map data to generate inner layer image information based on light passing through the surface layer of the object and scattered in the inner layer

Methodology Applied
Scientific EffectLight scattering: Scattering

Data Source

PatentEP4629178A1Image processing device, image processing method, and program
Publication Date: 2025.10.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP4629178A1 patent drawingFigure 1~2
  • EP4629178A1 patent drawingFigure 3
  • EP4629178A1 patent drawingFigure 4(a)~4(b)

AI summary

There is provided an image processing apparatus 1 including a processor. The processor receives first map data and second map data, the first map data corresponding to a surface layer of an object, the second map data corresponding to at least one inner layer of the object, uses the first map data to generate surface layer image information based on light reflected from the surface layer of the object, uses the second map data to generate inner layer image information based on light passing through the surface layer of the object and scattered in the inner layer, and generates image information regarding the object by combining the surface layer image information and the inner layer image information thus generated.