Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Light supplementing method and system for human face in image, medium and electronic equipment

A technology for filling light in images, applied in the field of image processing, can solve problems affecting user experience and poor light filling effect, achieve excellent light filling effect, improve user experience, and avoid the risk of background overexposure

Active Publication Date: 2020-08-28
SPREADTRUM COMM (SHANGHAI) CO LTD
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to overcome the problem that in the prior art, the light supplement effect is poor due to the overall light supplement for the image containing the face, or the separation of the target portrait from the image for supplement light and then fusion with the original image. poor, affecting user experience, providing a method, system, medium, and electronic device for supplementing light for faces in images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Light supplementing method and system for human face in image, medium and electronic equipment
  • Light supplementing method and system for human face in image, medium and electronic equipment
  • Light supplementing method and system for human face in image, medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] This embodiment provides a method for supplementing light on a human face in an image. The image may be a static picture or a dynamic video including a background and a portrait. This embodiment does not limit the specific form of the image.

[0079] The supplementary light refers to adding light effects such as highlights, shadows, and spot lighting to the human face, so as to realize the human face photography effect of simulating artificial lighting in a studio, and improve the beauty of the human face.

[0080] Such as figure 1 As shown, the supplementary light method may include the following steps:

[0081] Step S10: identifying the human face in the image;

[0082] Step S11: Obtain the 3D dense key points of the face;

[0083] In this embodiment, automatic face recognition and three-dimensional face dense key point alignment technology can be used to accurately locate the position of the face in real time, and fit the pose, expression and shape of the face.

...

Embodiment 2

[0106] This embodiment provides a method for supplementing light for a human face in an image, and the method for supplementing light is a further improvement on the basis of Embodiment 1.

[0107] Further, see figure 2 , before the step S11 may also include:

[0108] Step S20: Acquiring the number of faces in the image;

[0109] Step S21: judging whether the number of faces is 1;

[0110] If the number is 1, then perform step S22: calculate the distance between the real face and the imaging device during imaging;

[0111] Step S23: judging whether the distance does not exceed a preset distance threshold;

[0112] If the preset distance threshold is not exceeded, step S11 is executed.

[0113] In this embodiment, considering that the multi-face scene is relatively complex and cross-occlusion of human faces may occur, if the number of human faces in the detected image is more than 2, no supplementary lighting is performed on the human faces in the image. Similarly, if the...

Embodiment 3

[0128] This embodiment provides a light supplement method for a human face in an image, which is a further improvement on the basis of Embodiment 1.

[0129] Further, as image 3 As shown, before the step S14, it may also include;

[0130] Step S30: performing spatial triangulation on the three-dimensional dense key points to obtain an array of triangles, each of which includes three three-dimensional dense key points;

[0131] In the process of building triangles, multiple triangles can share vertices (ie, key points), but the plane of each triangle does not intersect with the plane of any other triangle.

[0132] Preferably, a C program (a programming language) can be used to implement the steps in this algorithm.

[0133] For example: dense key points can be expressed as Verts[cout][3] in a programmatic statement, and spatial triangulation is performed on three-dimensional dense key points to obtain a triangle array Triangles[num][3].

[0134] Among them, cout is the num...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a light supplementing method and system for a human face in an image, a medium and electronic equipment. The light supplementing method comprises the steps: identifying the human face in the image; obtaining three-dimensional dense key points of the face; detecting the average brightness of the human face by utilizing the three-dimensional dense key points; determining light supplementing intensity according to the average brightness; determining the distance and the angle of a light supplementing light source relative to the front surface of the human face according tothe light supplementing intensity and a preset light effect type; rendering the three-dimensional dense key points by using the light supplementing light source to obtain a light supplementing shadowmap; and fusing the light supplementing shadow map with the human face so as to realize light supplementing of the human face. According to the technical scheme, a complex image matting algorithm isprevented from being used; the over-segmentation or under-segmentation problem does not exist; the face background brightness does not need to be changed in the light supplementing mode; the background overexposure risk does not exist; the light supplementing effect is excellent; and the user experience is improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, and in particular to a method, system, medium and electronic equipment for supplementing light of a human face in an image. Background technique [0002] With the popularization of portable mobile devices (such as smart phones), face cameras anytime and anywhere make selfies and photo shows a fashion in life. Although many smartphones integrate a variety of face beautification functions, such as: face beautification, background blur, etc., it is difficult to achieve photographic fill light when taking photos of faces on smartphones due to the limitations of the set and fill light of the shooting scene. Photo effects, such as three-dimensional highlights on the face, adding shadows, or increasing the layering of the face. [0003] In order to improve the fill light effect of the image, on the one hand, in the prior art, image editing software can be used to evenly fill the entire...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T15/50
CPCG06T15/50G06V40/172G06V40/168Y02B20/40
Inventor 谢富名
Owner SPREADTRUM COMM (SHANGHAI) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com