Method and system for colour determination in facial images

The method generates a three-dimensional virtual representation of facial images to accurately determine skin color, addressing the limitations of existing methods by integrating eye-related colors and compensating for lighting conditions, thus providing precise skin color analysis and recommendations without external references.

WO2024236113A1PCT designated stage expired Publication Date: 2024-11-21FRÖHNER KAI
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/063528
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2024-05-16
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing methods for determining skin color in facial images using mobile devices fail to accurately account for direct illumination and three-dimensional lighting conditions, requiring external reference objects and not considering primary information beyond color analysis, which is inadequate for valid skin analysis and product recommendations.

Method used

A method that generates a three-dimensional virtual representation of a facial image using a common coordinate system integrating the person, eyes, and light sources, allowing for precise color determination by using eye-related colors as references, compensating for ambient lighting inequalities, and determining light source positions and intensities based on shadow formation, enabling valid skin color analysis without external reference objects.

Benefits of technology

Enables precise color determination in facial images taken with mobile devices, accounting for direct lighting and three-dimensional illumination, ensuring accurate skin color analysis and product recommendations, and improving user experience by eliminating the need for external reference objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024063528_21112024_PF_FP_ABST
    Figure EP2024063528_21112024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention relates to a method (100) for colour determination in facial images, said method comprising the steps of: recording (110) a two-dimensional facial image (GB) of a person by a camera module (12) of a mobile terminal device (10); generating (120) a three-dimensional virtual representation (VD) of the two-dimensional facial image (GB) based on a common coordinate system, in particular a coordinate system integrating the person, of a visual system (300) of the person and of the mobile terminal device (10); and performing (130) the colour determination in the three-dimensional virtual representation (VD) of the two-dimensional facial image (GB) using at least one reference colour present in the three-dimensional virtual representation (VD) of the two-dimensional facial image (GB), wherein at least one eye-related colour serves as a reference colour and the at least one eye-related colour comprises a colour value of a sclera as a first reference colour; wherein age-related and / or gender-related variances of the colour value of the sclera are in particular taken into account for the colour determination, in particular wherein an age and / or gender of the recorded person are extracted from the facial image (GB); and in particular the at least one eye-related colour comprises a colour value of a pupil as a second reference colour.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Method for determining the spatial relationship of a person's eye with respect to a camera device

    DE102006002001B4

  • Systems and methods for generating calibrated skin tone profiles

    EP3579139A1

  • Hierarchical differential image filters for skin analysis

    US10325146B2

  • Method and system for skin color estimation from an image

    US20070058860A1

  • Information processing device, method, and program

    US20110249863A1