Face image generation method and device, computer device, and storage medium
By obtaining kinship images of the target individuals and utilizing genetic feature analysis and facial image generation models, realistic facial images of young individuals were generated, solving the problem of lacking offspring photos and providing crucial evidence for case handling.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-25
- Publication Date
- 2026-06-26
Smart Images

Figure CN121482848B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of genetic technology, and more specifically, to a method, apparatus, computer device, and storage medium for generating human face images. Background Technology
[0002] In today's society, the rapid development of technology has brought tremendous changes to various fields. Among them, image recognition and processing technology plays a crucial role in many scenarios, and has had a profound impact on the acquisition and utilization of facial images in many aspects.
[0003] However, handling cases involving missing or maliciously transferred young children presents unique challenges. In these cases, accurate photographs of the children play a crucial role in quickly locating them and confirming their identities. However, in reality, parents often fail to provide clear and accurate photographs of their children for various reasons. Some families may have very few photos of their children due to limited living conditions. Therefore, obtaining images that accurately reflect the child's appearance under these circumstances becomes a critical issue that urgently needs to be addressed in handling such cases. Summary of the Invention
[0004] This application provides a method, apparatus, device, and storage medium for generating facial images. The method can generate a facial image of a target based on a target kinship image of a blood relative. The generated facial image can highly realistically reflect the current facial features of a missing or maliciously transferred young person, providing crucial and powerful evidence for handling such cases.
[0005] A first aspect of this application provides a method for generating a face image, the method comprising:
[0006] Obtain the target kinship image of objects that are related to the target object by blood;
[0007] Based on the target kinship image, determine the target kinship features corresponding to each structural unit;
[0008] Using a preset genetic feature analysis strategy, the target kinship features corresponding to each structural unit are analyzed to determine the target genetic features, including: for each structural unit, obtaining a discrete feature set corresponding to each structural unit from a facial genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship features to obtain the similarity corresponding to each discrete feature; determining the discrete features with similarity greater than a preset threshold as reference discrete features corresponding to the structural unit; and determining the target genetic features based on the reference discrete features corresponding to each structural unit.
[0009] A pre-trained face image generation model is invoked to process the target genetic features and generate a face image of the target object.
[0010] Optionally, when there are multiple generations of objects related to the target object, determining the target genetic feature based on the reference discrete feature corresponding to each structural unit includes:
[0011] For each structural unit, a target genetic index corresponding to the reference discrete feature is obtained, wherein the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, the target discrete feature corresponding to the structural unit is selected from the reference discrete features;
[0012] The target genetic features are determined based on the target discrete features corresponding to each structural unit.
[0013] Optionally, determining the target genetic feature based on the target discrete feature corresponding to each structural unit includes:
[0014] For each target kinship feature corresponding to a structure, all combinations of genetic features and the conditional probability corresponding to each combination of genetic features under the target kinship feature are obtained. Among all combinations of genetic features, the combination of genetic features with the highest conditional probability is obtained and determined as the first combination of genetic features. When the target kinship feature and the first combination of genetic features meet a first preset condition, the first combination of genetic features is determined as the second combination of genetic features corresponding to the target kinship feature. When the target kinship feature and the first combination of genetic features do not meet the first preset condition, the third combination of genetic features with the highest correlation to the first combination of genetic features is obtained and determined as the second combination of genetic features corresponding to the target kinship feature. Based on the genetic features in the second combination of genetic features corresponding to each target kinship feature, the target genetic feature is obtained. The first preset condition is that the target kinship feature belongs to a strong feature set and the conditional probability corresponding to the first combination of genetic features is greater than the dominant inheritance threshold.
[0015] Optionally, obtaining the target genetic feature based on the genetic features in the second genetic feature combination corresponding to each target kinship feature includes:
[0016] Based on the genetic characteristics in the combination of second genetic characteristics corresponding to each target kinship trait, a reference genetic characteristic is determined;
[0017] Based on the reference genetic characteristics, the target genetic characteristics are determined.
[0018] Optionally, when multiple facial images of the target object exist, the method further includes:
[0019] For each face image, a pre-trained evaluation model is invoked to process the target kinship image and the face image to obtain the credibility of the face image;
[0020] The face images are updated based on the confidence level of each face image.
[0021] Optionally, when the target kinship image includes kinship images of multiple generations of kinship, determining the target kinship feature corresponding to each structural unit based on the target kinship image includes:
[0022] The target kinship image is divided into sub-images corresponding to each structural unit;
[0023] For each structural unit, the feature extraction model corresponding to the structural unit is used to extract features from the sub-image corresponding to the structural unit to obtain the target kinship features corresponding to the structural unit.
[0024] Optionally, the method further includes:
[0025] For each structural unit, image information corresponding to each category of the structural unit is obtained, and the image information is input into the feature extraction model to obtain discrete features corresponding to each category.
[0026] The discrete features corresponding to each category are combined to obtain the discrete feature set corresponding to the structural unit.
[0027] In a second aspect, this application provides a face image generation apparatus, comprising:
[0028] The acquisition unit is used to acquire target kinship images of objects that are related to the target object by blood.
[0029] The first determining unit is used to determine the target kinship features corresponding to each structural unit based on the target kinship image;
[0030] The second determining unit is used to analyze the target kinship features corresponding to each structural unit using a preset genetic feature analysis strategy to determine the target genetic features, including: for each structural unit, obtaining a discrete feature set corresponding to each structural unit from a face genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship feature to obtain the similarity corresponding to each discrete feature; determining the discrete features with similarity greater than a preset threshold as reference discrete features corresponding to the structural unit; and determining the target genetic features based on the reference discrete features corresponding to each structural unit.
[0031] The processing unit is used to call a pre-trained face image generation model to process the target genetic features and generate a face image of the target object.
[0032] Optionally, the second determining unit is used for:
[0033] For each structural unit, obtain the discrete feature set corresponding to the structural unit from the face genetic feature library;
[0034] Determine the similarity between each discrete feature in the discrete feature set and the target kinship feature to obtain the similarity corresponding to each discrete feature;
[0035] Based on the discrete features whose similarity satisfies the preset conditions, the reference discrete features corresponding to the structural unit are determined;
[0036] The target genetic feature is determined based on the reference discrete features corresponding to each structural unit.
[0037] Optionally, when there are multiple generations of objects related to the target object, the second determining unit includes:
[0038] For each structural unit, a target genetic index corresponding to the reference discrete feature is obtained, wherein the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, the target discrete feature corresponding to the structural unit is selected from the reference discrete features;
[0039] The target genetic features are determined based on the target discrete features corresponding to each structural unit.
[0040] Optionally, when multiple facial images of the target object exist, the device further includes an updating unit, the updating unit being used to:
[0041] For each face image, a pre-trained evaluation model is invoked to process the target kinship image and the face image to obtain the credibility of the face image;
[0042] The face images are updated based on the confidence level of each face image.
[0043] Optionally, when the target kinship image includes kinship images spanning multiple generations, the first determining unit is configured to:
[0044] The target kinship image is divided into sub-images corresponding to each structural unit;
[0045] For each structural unit, the feature extraction model corresponding to the structural unit is used to extract features from the sub-image corresponding to the structural unit to obtain the target kinship features corresponding to the structural unit.
[0046] Optionally, the device further includes an assembly unit, the assembly unit being used for:
[0047] For each structural unit, image information corresponding to each category of the structural unit is obtained, and the image information is input into the feature extraction model to obtain discrete features corresponding to each category.
[0048] The discrete features corresponding to each category are combined to obtain the discrete feature set corresponding to the structural unit.
[0049] A third aspect of this application provides a computer device, including: a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of any of the above methods.
[0050] A fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, characterized in that the computer program, when executed by a processor, implements the steps of the method as described in any of the above.
[0051] In this embodiment, target kinship images of individuals related to the target object by blood are obtained. Based on these target kinship images, target kinship features corresponding to each structural unit are determined. A pre-defined genetic feature analysis strategy is used to analyze the target kinship features corresponding to each structural unit, determining the target genetic features. A pre-trained face image generation model is invoked to process the target genetic features and generate a face image of the target object. This application can generate face images of the target object based on target kinship images of individuals related to the target object by blood. The generated face images can highly realistically reflect the facial features of missing or maliciously transferred young individuals, providing crucial and powerful evidence for handling such cases. Attached Figure Description
[0052] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:
[0053] Figure 1 A flowchart illustrating a face image generation method provided in one embodiment of this application;
[0054] Figure 2 A flowchart illustrating a method for targeting genetic characteristics provided in one embodiment of this application;
[0055] Figure 3A flowchart illustrating an image verification method provided in one embodiment of this application;
[0056] Figure 4 A bar chart showing the number of cases involving the malicious transfer of young victims solved in the middle of the period for the method of determining the target genetic characteristics of this application;
[0057] Figure 5 The number of times the ranking of a 2 million-repository library improved under different original library ranking intervals in the method for determining the target genetic characteristics of this application;
[0058] Figure 6 This is a schematic diagram of a face image generation device provided in one embodiment of this application;
[0059] Figure 7 This is a schematic diagram of a computer device structure provided in one embodiment of this application. Detailed Implementation
[0060] In today's society, the rapid development of technology has brought about tremendous changes in various fields. Among them, image recognition and processing technology plays a crucial role in many scenarios, and its acquisition and utilization of facial images has had a profound impact on many aspects. However, in handling cases involving missing or maliciously transferred young children, unique challenges arise. In these cases, accurate photographs of the children are crucial for quickly locating them and confirming their identities. However, in reality, parents may be unable to provide clear and accurate photographs of their children for various reasons. Some families may have very few photos of their children due to limited living conditions. Therefore, how to obtain images of children that truly reflect their appearance under the predicament of lacking accurate photographs has become a critical issue that urgently needs to be addressed in the handling of such cases.
[0061] To address the aforementioned issues, this application provides a method for generating facial images, which involves acquiring target kinship images of individuals related to the target subject by blood. Based on the target kinship images, the target kinship features corresponding to each structural unit are determined. A preset genetic feature analysis strategy is used to analyze the target kinship features corresponding to each structural unit to determine the target genetic features. A pre-trained facial image generation model is invoked to process the target genetic features and generate a facial image of the target subject. This application can generate facial images of the target subject based on target kinship images of individuals related to the target subject by blood. The generated facial images can highly realistically reflect the facial features of missing or maliciously transferred young subjects, providing crucial and powerful evidence for handling such cases.
[0062] The solutions in this application embodiment can be implemented using various computer languages, such as the object-oriented programming language Java and the interpreted scripting language JavaScript.
[0063] To make the technical solutions and advantages of the embodiments of this application clearer, the exemplary embodiments of this application will be described in further detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not an exhaustive list of all embodiments. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of this application can be combined with each other.
[0064] Please see Figure 1 The following embodiments use a face generation system as the execution subject, applying the method provided in the embodiments of this application to the aforementioned face generation system. The face image generation method provided in the embodiments of this application includes the following steps 101-104:
[0065] Step 101: Obtain the target kinship image of the object that is related to the target object by blood.
[0066] Among them, the target kinship images are facial images of people who are related to the target subject by blood, which can cover the target subject's immediate family members, such as parents, children, and siblings. These images can be obtained through various means, such as using professional image acquisition equipment to photograph people who are related to the target subject; or by selecting suitable images from an existing family photo library.
[0067] Meanwhile, to ensure the effectiveness of subsequent analysis, the collected images of the target relatives should have a certain quantity and diversity. Sufficient quantity can provide rich data support for the analysis, while diversity is reflected in the fact that the images include different age groups, different expressions, and different shooting angles, which helps to comprehensively capture the expression of genetic characteristics under different conditions.
[0068] Step 102: Based on the target kinship image, determine the target kinship features corresponding to each structural unit.
[0069] Among them, the target kinship features include facial feature information of objects that are related to the target object by blood, such as facial contour features, facial features, etc., which describe the characteristics of the object's face from various aspects.
[0070] In this step, the human face can typically be divided into multiple structural units, such as eyes, nose, mouth, and cheeks, each carrying unique genetic information. Therefore, based on the principles of facial anatomy and visual structure division, the entire face can be divided into sub-images corresponding to multiple structural units. Examples include hair, forehead, left eye, right eye, left ear, right ear, nose, left cheek, right cheek, mouth, and chin. Then, for each structural unit, its corresponding feature extraction model and sub-image are obtained. The feature extraction unit processes the sub-image corresponding to that structural unit to obtain the target kinship features. For example, for the eye structural unit, its corresponding feature extraction unit can use edge detection algorithms to determine the eye contour, and then extract geometric features such as palpebral fissure length, interocular distance, and eyelid folds; simultaneously, it uses color analysis algorithms to obtain color and morphological features such as iris color and pupil size. For the nose structural unit, its corresponding feature extraction unit uses 3D reconstruction technology to obtain three-dimensional features such as nasal bridge height, nasal tip angle, and nasal wing width; and uses texture analysis algorithms to extract the texture details of the nasal surface.
[0071] Alternatively, a first deep neural network is used to process the face image to obtain a feature map corresponding to the face image. Simultaneously, the face image is segmented to obtain a set of face region masks, which includes the face region mask corresponding to each structural unit. Then, the face region masks in the face region mask set are scaled to the same size as the aforementioned feature map, and the scaled masks are binarized to obtain binarized features, which in turn create a binarized feature set. For each binary feature corresponding to a structural unit in the binarized feature set, this binarized feature is multiplied by the aforementioned feature map to obtain a multiplication result. This multiplication result is then input into a second deep neural network to obtain the feature corresponding to that structural unit.
[0072] It should be noted that the neural network described above is trained on a large amount of data. It can be trained together with the models discussed later, or it can be trained using other methods. This is not a limitation here.
[0073] Based on the above, when there is only one target kinship image, the target kinship features corresponding to each structural unit can be obtained. When there are multiple target kinship images, one object may correspond to multiple images. Therefore, these target kinship images are divided into multiple image sets, each containing images of the same object. Then, for each image set, the features corresponding to each image in the set are obtained using the feature extraction method described above. These features are then comprehensively analyzed to obtain the final features corresponding to the set. Finally, each final feature is combined with the corresponding final features to obtain the target kinship features corresponding to each structural unit.
[0074] Step 103: Using a preset genetic feature analysis strategy, analyze the target kinship features corresponding to each structural unit to determine the target genetic features.
[0075] The process involves using a pre-defined genetic feature analysis strategy to analyze the target kinship features corresponding to each structural unit and determine the target genetic features. This includes: for each structural unit, obtaining a set of discrete features corresponding to each structural unit from a facial genetic feature database; determining the similarity between each discrete feature in the set and the target kinship feature, obtaining the similarity for each discrete feature; identifying discrete features with similarity greater than a pre-defined threshold as reference discrete features for the structural unit; and determining the target genetic features based on the reference discrete features for each structural unit. The target genetic features include facial feature information of the target object, such as facial contour features and facial features, which characterize the features of the target object's face from various aspects. The pre-defined genetic feature analysis strategy is constructed based on extensive genetic research results, actual case data, and the knowledge and experience of experts in related fields. It comprehensively considers the expression, inheritance patterns, and mutual influence relationships of different genetic features in each structural unit. In practice, the genetic feature analysis strategy includes a series of specific analysis rules and methods. For example, corresponding feature extraction and analysis methods are formulated for different structural units. For example, for facial contour structural units, related genetic traits might be analyzed by measuring multiple indicators such as facial length, width, and cheekbone height. Simultaneously, the strategy would also consider the correlation of genetic traits between different structural units, such as the potential co-inheritance relationship between eye shape and eyebrow shape.
[0076] In this step, each structural unit's characteristics are analyzed one by one according to a pre-defined genetic trait analysis strategy. For example, for the trait of nasal bridge height, if the strategy indicates that this trait exhibits a dominant inheritance pattern within the family, and a large proportion of known target relatives possess this trait, then the analysis will tend to consider a high nasal bridge as one of the possible target genetic traits. After analyzing the target kinship traits of each structural unit, the analysis results for all structural units are obtained. For example, the eye structural unit might identify double eyelids and large eyes as possible target genetic traits, while the facial contour structural unit might identify an oval face. Finally, by comprehensively analyzing the interactions between the genetic traits of each structural unit, the target genetic trait is obtained.
[0077] Specifically, the target genetic trait is obtained through the following genetic characteristic analysis strategy: 1) Statistically analyze the frequency distribution of different parental trait combinations in offspring, and identify the trait with the highest frequency as the genetic trait; 2) Determine the genetic transition matrix between morphological categories in each region, and adjust the identified traits based on this matrix; 3) Determine if there is a strong dominant inheritance pattern for certain structures (e.g., if both parents have narrow noses, the probability of their offspring having narrow noses is 90%), and identify the traits corresponding to the strong dominant inheritance pattern as the genetic trait. Through the above genetic characteristic analysis strategy, the parental traits are combined, processed, and adjusted to obtain the final genetic trait, i.e., the target genetic trait.
[0078] Furthermore, for each structural unit, in the genetic feature library, the conditional probabilities of all genetic feature combinations under the target kinship feature corresponding to that structural unit are obtained, and the conditional probability corresponding to each genetic feature combination is obtained. Then, the genetic feature combination with the highest conditional probability is determined as the first genetic feature combination. Based on the conditional probability corresponding to the first genetic feature combination and the target kinship feature, it is determined whether the first genetic feature combination and the target kinship feature meet the first preset condition, and then it is determined whether the feature in the second genetic feature combination is a strong genetic feature. When the feature in the first genetic feature combination is a strong genetic feature, the first genetic feature combination is determined as the second genetic feature combination. When the feature in the first genetic feature combination is not a strong genetic feature, based on the genetic feature matrix, the third genetic feature combination with the highest correlation with the first genetic feature combination is found, and the third genetic feature combination is determined as the second genetic feature combination.
[0079] The genetic feature matrix includes the correlation between combinations of genetic features, which are determined using genetic statistics methods. The genetic feature database stores all features, all combinations of genetic features, and the conditional probability of each combination of genetic features for each feature. A combination of genetic features is a combination of multiple genetic features.
[0080] The specific steps for determining whether the first genetic feature combination and the target kinship feature meet the first preset condition are as follows: detect whether the target kinship feature is in the preset strong feature set, and whether the conditional probability corresponding to the first genetic feature combination is greater than the dominant inheritance threshold. When both conditions are met, the feature in the first genetic feature combination is determined to be a strong genetic feature; otherwise, the feature in the second genetic feature combination is not a strong genetic feature.
[0081] For example, target kinship characteristics
[0082] in, Let represent the kinship feature corresponding to the i-th structural unit (hereinafter referred to as the i-th kinship feature), and n is the total number of structural units.
[0083] For the kinship characteristics corresponding to the i-th structural unit, the corresponding first genetic characteristic combination ,in It is a set containing all combinations of features. For the j-th combination of genetic traits, Obtain the conditional probability corresponding to the j-th genetic feature combination under the i-th target kinship feature.
[0084] Next, it is determined whether the i-th target kinship feature belongs to the strong feature set D, and the first genetic feature combination is detected. If the corresponding conditional probability is greater than the dominant inheritance threshold, then the first genetic trait combination is selected. The characteristics identified in the text are strong heritable traits. Otherwise, the third genetic trait combination with the strongest association with the first genetic trait combination will be selected, and the genetic trait in this third genetic trait combination will be identified as a strong genetic trait. The specific formula is as follows:
[0085]
[0086] in, The combination of genetic characteristics in the genetic transition matrix Combination of genetic traits The strength of the association between two genetic traits is the probability / correlation of a combination of genetic traits transforming into, retaining, or co-occurring with another combination of genetic traits during the genetic process (such as reproduction, iteration, natural selection / algorithmic evolution). It can be obtained through statistical analysis of a large amount of genetic data, or through other methods, which will not be elaborated here.
[0087] Finally, the target genetic trait is determined based on the strong heritability trait, that is, all the traits in the second genetic trait combination are strong heritability traits.
[0088] In the embodiments of this application, a feature analysis model can also be used to analyze the target kinship characteristics corresponding to each structural unit and determine the target genetic characteristics.
[0089] When the feature analysis model is a machine learning model, the specific steps for processing target kinship features and determining the target genetic characteristics of the target object are as follows: During the analysis of target kinship features, the pre-trained feature analysis model performs a comprehensive analysis of the target kinship features. Through this comprehensive and in-depth analysis, the model ultimately determines the target genetic characteristics that represent the genetic traits of the target object.
[0090] The pre-trained feature analysis model is built upon a large amount of facial genetic data and machine learning algorithms. This model aims to extract deep genetic information from the target kinship features corresponding to each structural unit, thereby determining the target genetic characteristics.
[0091] To extract target genetic features more accurately, this application can set different feature analysis models for different combinations of kinship relationships. This allows for the initial determination of the kinship relationship between each individual and the target individual, followed by the determination of the feature analysis model to be used based on the combination of these kinship relationships. For example, one feature analysis model corresponds to the father and mother, and another to the father and his siblings.
[0092] For example, when the father and mother each correspond to a feature analysis model, the method for obtaining the pre-trained feature analysis model is as follows: Assume the father's face region encoding feature is F_r, the mother's face region encoding feature is M_r, and the offspring's face region encoding feature to be predicted is S_r. Select several parent-child pairing data to construct a training dataset with the parents' encoding features as input and the offspring's encoding features as labels. Concatenate the father's face region encoding feature F_r and the mother's face region encoding feature M_r to obtain a fused feature P_r. Input the fused feature into the feature analysis model, and the output is the probability vector V_r for each region of the offspring. Perform One-Hot encoding on the offspring's face region encoding feature S_r to obtain labels. Train the feature analysis model by calculating the cross-entropy loss between the probability vector V_r and the One-Hot encoded labels. Finally, the pre-trained feature analysis model is obtained.
[0093] To train the aforementioned feature analysis model so that it can accurately extract genetic features from kinship images, the embodiments of this application employ the following training steps:
[0094] Step 1: Collect a large number of publicly available family photos or image data containing clear kinship relationships to construct a large-scale family kinship feature database, resulting in a sample dataset including family kinship relationships. Each sample in the sample dataset is a "family unit" containing at least one face image of the target object (children) and several face images of related relatives (such as father, mother, siblings, etc.).
[0095] Step 2: Using a pre-built feature extraction network (e.g., a deep convolutional neural network pre-trained on a large-scale face dataset or a publicly available face recognition model), process each image in each sample of the sample dataset. The feature extraction network acts as a feature encoder, mapping the input raw face image into a high-dimensional feature vector. This yields the baseline genetic feature vector corresponding to the target object in the sample, and the sample kinship feature vector corresponding to related objects.
[0096] Step 3: Construct a feature analysis model using the Transformer architecture. The model's input layer receives the sample kinship feature vectors corresponding to the aforementioned kinship objects. Utilizing the self-attention mechanism in the Transformer architecture, the model can capture the long-distance dependencies and association strengths between different sample kinship feature vectors, as well as between sample kinship feature vectors and potential genetic patterns.
[0097] Step 4: The feature analysis model also includes a weight predictor. The weight predictor connects to the Transformer module and, based on the contextual features output by the Transformer, predicts the contribution of each sample's kinship feature vector to the baseline genetic feature vector, outputting the corresponding feature weights. Subsequently, based on these feature weights, all sample kinship feature vectors are weighted and fused (e.g., weighted summation) to obtain the predicted genetic feature vector.
[0098] Step 5: During training, calculate the cosine similarity between the predicted genetic feature vector and the corresponding baseline genetic feature vector. Use the cosine similarity as the primary or sole metric of the loss function (e.g., loss = 1 - cosine similarity). Minimize this loss value using the backpropagation algorithm, continuously updating the parameters of the feature analysis model (including the Transformer module and weight predictor) until the model converges.
[0099] Through the above training method, the feature analysis model can learn how to accurately point to or approximate the true genetic characteristics of the target offspring in the vector space based on the combination of facial features of kinship objects, and finally obtain the trained feature analysis model.
[0100] In the above process, if the target description text can still be obtained, which may include facial description information of the target object, then it is detected whether the target description feature is extracted from the target description text. This target description feature is the facial description feature of the target object. If the target description feature is not extracted from the target description text, the feature analysis model is called to process the target kinship feature to obtain the target genetic feature of the target object. If the target description feature is extracted from the target description text, it is detected whether the target description feature includes both genetic description feature and facial description feature. The feature in the detection result is obtained, and the genetic feature analysis module is called to process the target kinship feature and the feature in the detection result to obtain the facial image of the target object.
[0101] Among them, genetic descriptive features are heritable facial characteristics within the target individual's family, such as common family features like a high nose bridge, deep-set eyes, and specific ear shapes. It also includes descriptions of physiological characteristics with heritable predispositions, such as skin color, hair color, and eye color. Facial descriptive features are unique facial details of the target individual, such as the location and shape of moles, birthmarks, and dimples, as well as facial expression habits, such as the upward curve of the corners of the mouth when smiling and the lines formed when frowning.
[0102] When the detection result indicates that the target descriptive features include both genetic descriptive features and facial descriptive features, the feature analysis module can further include a generation module and a modification model. The specific steps of calling the feature analysis module to process the target kinship features and the features in the detection result to obtain the facial image of the target object are as follows: The generation module can obtain the weights corresponding to the target kinship features and the genetic descriptive features, and based on these two weights, fuse the target kinship features and the genetic descriptive features to obtain a first fused feature. The first fused feature is then processed to obtain a reference genetic feature. The image modification model obtains the weights corresponding to the facial descriptive features and the reference genetic feature, and based on these two weights, fuses the facial descriptive features and the reference genetic feature to obtain a second fused feature. The second fused feature is then processed to obtain the target genetic feature.
[0103] The fusion process described above can involve multiplying the features and their corresponding weights, and then adding the results to obtain the fused features. Other fusion methods can also be used, and this is not limited here.
[0104] In the above process, when there are multiple target kinship features, the kinship relationship between the target kinship feature and the target object can be obtained, the weight corresponding to each kinship object can be determined, and the target kinship feature and the corresponding weight can be input into the feature analysis model so that the genetic feature analysis model can analyze and process the input data to obtain the target genetic feature.
[0105] The aforementioned feature analysis model is built upon a large amount of facial genetic data and machine learning algorithms. This model aims to extract deep-seated genetic information from the target kinship features corresponding to each structural unit, thereby determining the target genetic characteristics.
[0106] When the kinship relationship between the kinship object and the target object is the first kinship relationship, the weight corresponding to the kinship object is set as the first weight; when the kinship relationship between the kinship object and the target object is the second kinship relationship, the weight corresponding to the kinship object is set as the second weight; when the kinship relationship between the kinship object and the target object is the third kinship relationship, the remaining total weight is determined according to the first and second weights; the ratio of the remaining total weight to the number is determined as the third weight, and the weight corresponding to the kinship object is set as the third weight.
[0107] The first kinship relationship is the relationship between the mother and the target. The second kinship relationship is the relationship between the father and the target. The third kinship relationship is the relationship between the siblings and the target.
[0108] In this step, for each related object, when the kinship between the related object and the target object is the first kinship, the weight corresponding to the related object is set as the first weight. When the kinship between the related object and the target object is the second kinship, the weight corresponding to the related object is set as the second weight. When the kinship between the related object and the target object is the third kinship, the remaining total weight is determined based on the first and second weights. Subsequently, the ratio of the remaining total weight to the corresponding number is calculated to determine the third weight, and the weight corresponding to the related object is set as the third weight. The specific steps for determining the remaining total weight based on the first and second weights are as follows: since the sum of all weights is 1, 1 is subtracted from the first weight and the second weight, and the difference is determined as the remaining total weight.
[0109] For example, if the weight corresponding to the first kinship is 0.3, the weight corresponding to the second kinship is 0.3, the weight corresponding to the third kinship is 0.35, and the number of kinship objects corresponding to the third kinship is 5, then the ratio of the third weight of 0.35 to 5 is 0.7.
[0110] Step 104: Call the pre-trained face image generation model to process the target genetic features and generate the face image of the target object.
[0111] Among them, the pre-trained face image generation model is a tool specifically designed to generate realistic face images based on given genetic features. During training, this model learns a large number of mapping relationships between face images and their corresponding genetic features, enabling it to transform target genetic features into visualized face images.
[0112] In this step, the target genetic features are input into a pre-trained face image generation model to generate a face image of the target object.
[0113] In this embodiment, target kinship images of individuals related to the target object by blood are obtained. Based on these target kinship images, the target kinship features corresponding to each structural unit are determined. Using a pre-defined genetic feature analysis strategy, the target kinship features corresponding to each structural unit are analyzed to determine the target genetic features. A pre-trained face image generation model is invoked to process the target genetic features and generate a face image of the target object. This application can generate a face image of the target object based on target kinship images of individuals related to the target object by blood. The generated face image can highly realistically reflect the current facial features of missing or maliciously transferred young individuals, providing crucial and powerful evidence for handling such cases.
[0114] In this embodiment, some combinations of second genetic traits may overlap. To avoid this, after obtaining the genetic traits from all combinations of second genetic traits, duplicate traits are removed, and the remaining traits are designated as reference traits. Then, the target genetic trait can be determined based on the reference traits; for example, the reference traits can be directly designated as the target genetic trait. Specific steps include: determining the reference genetic trait based on the genetic traits in the second genetic trait combination corresponding to each target kinship trait; and determining the target genetic trait based on the reference genetic trait.
[0115] In this embodiment of the application, discrete features corresponding to each reference genetic feature can be determined, and these discrete features can be identified as target genetic features. The specific steps include: determining the reference structural unit corresponding to the reference genetic feature; for each reference structural unit, obtaining the set of discrete features corresponding to the reference structural unit from the face genetic feature database; determining the similarity between each discrete feature in the set of discrete features and the reference genetic feature, and obtaining the similarity corresponding to each discrete feature; and identifying the discrete features whose similarity satisfies a second preset condition as the target genetic feature corresponding to the reference structural unit.
[0116] The second preset condition is discrete features with a similarity greater than a similarity threshold.
[0117] In the above process, a similarity calculation algorithm can be used to calculate the similarity between discrete features and the reference genetic features. The similarity calculation algorithm can be a cosine similarity calculation algorithm, etc.
[0118] In this embodiment, the face generation system has a publicly available face database. For each face image in the database, the following operations are performed to obtain the features corresponding to all structural units on each face. The specific steps include: processing the face image using a first deep neural network to obtain a feature map corresponding to the face image; simultaneously dividing the face image to obtain a set of face region masks, which includes the face region mask corresponding to each structural unit. Then, scaling the face region masks in the face region mask set to the same size as the feature map, and binarizing the scaled masks to obtain binarized features, and then binarizing the feature set. Multiplying the binarized features in the binarized feature set with the feature map to obtain a multiplication result, and inputting this multiplication result into a second deep neural network to obtain its corresponding features. That is, obtaining the features corresponding to each structural unit on the face image. Then, for multiple face images, combining the features of the same structural unit to obtain a feature set corresponding to each structural unit. For each feature set corresponding to a structural unit, using a clustering method to divide the features in the feature set to obtain multiple clustering results. Each clustering result essentially corresponds to a category. Therefore, the central feature in the clustering result is determined as the discrete feature corresponding to that category. All discrete features corresponding to this structural unit are combined to obtain its corresponding discrete feature set.
[0119] Alternatively, for each structural unit, a sub-image corresponding to each category can be obtained, and then the sub-image can be input into a feature extraction model to obtain the discrete features corresponding to each category. Then, the discrete features corresponding to all categories can be combined to obtain the discrete feature set corresponding to the structural unit.
[0120] Finally, the discrete feature set corresponding to each structural unit is used to form a facial genetic feature library.
[0121] By obtaining a discrete feature set from a facial genetic feature database and performing similarity calculations and screening, existing genetic feature data can be fully utilized to accurately determine the target genetic feature. This method considers the multiple genetic feature possibilities of different structural units and improves the accuracy and reliability of the determination results through quantitative analysis and screening under preset conditions. Therefore, this application provides a method for determining a target genetic feature. The specific steps of this method include: for each structural unit, obtaining a discrete feature set corresponding to the structural unit from the facial genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship feature, obtaining the similarity corresponding to each discrete feature; determining the reference discrete feature corresponding to the structural unit based on the discrete features whose similarity meets preset conditions; and determining the target genetic feature based on the reference discrete feature corresponding to each structural unit.
[0122] The facial genetic feature database is a vast and meticulously organized collection of genetic feature information related to different facial structural units. These features are categorized and stored in a discrete form, covering a wide range of possible facial genetic feature types. For example, in the eye structural unit, it may include discrete features such as different shapes (round, almond-shaped, phoenix-shaped, etc.), eyelid types (single eyelid, double eyelid, inner double eyelid, etc.), and different iris colors. The preset conditions are based on genetic theory, practical research experience, and specific application needs. For example, preset conditions might be set to a similarity greater than a certain threshold (e.g., 0.7), or a high similarity ranking for certain discrete features.
[0123] In traditional deep learning-based face generation or style transfer techniques, facial features are typically mapped to a continuous high-dimensional vector space. When the model attempts to predict offspring features, it often employs weighted interpolation or regression of the parental feature vectors. However, this continuous space regression operation is prone to 'feature averaging' when dealing with highly nonlinear genetic features. For example, when the parents have 'high nose bridge' and 'flat nose bridge' respectively, the continuous vector model tends to generate a 'fuzzy intermediate state' feature between the two. This not only loses high-frequency texture details of the face, resulting in a distorted and overly smoothed facial image due to texture loss, but also fails to accurately reflect the discontinuous selection process of 'dominant / recessive' traits in genetics.
[0124] In contrast, the discretization encoding mechanism introduced in this application forces the predicted intermediate features to be mapped to a pre-constructed 'discrete feature set' consisting of clear and independent typical features. This is equivalent to introducing a 'quantization correction' process in the feature space: regardless of the intermediate results predicted by the model, the final determined target genetic feature must be a 'prototype feature' of a certain class that truly exists in the feature library and has clear texture. This mechanism effectively blocks the propagation of feature ambiguity, ensuring that each structural unit (such as eyes and nose) of the generated offspring face has highly realistic texture details and a clear morphological structure, thereby significantly improving the realism of face generation and the interpretability of genetic prediction.
[0125] In this application embodiment, when multiple generations of objects are related to the target object, by introducing a target genetic index and selecting target discrete features based on it, the quantitative information of genetic laws can be fully utilized to more accurately determine the target genetic features. Therefore, this application embodiment provides a method for determining target genetic features, such as... Figure 2 As shown, the specific steps include:
[0126] Step 201: For each structural unit, obtain the target genetic index corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, select the target discrete feature corresponding to the structural unit from the reference discrete features.
[0127] Among them, the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature, which can be an index such as genetic probability and / or genetic stability.
[0128] In this step, the reference discrete features of each structural unit are screened according to the established selection strategy to obtain the target discrete features corresponding to each structural unit. For example, for the eye structural unit, its reference discrete features are "double eyelid (target genetic index 0.8)", "single eyelid (target genetic index 0.2)" and "inner double eyelid (target genetic index 0.5)". If the strategy of selecting the highest target genetic index is adopted, then "double eyelid" will be selected as the target discrete feature corresponding to this structural unit.
[0129] Step 202: Determine the target genetic features based on the target discrete features corresponding to each structural unit.
[0130] In this step, the target discrete features selected from each structural unit are combined to obtain the target genetic features.
[0131] Optionally, determining the target genetic feature based on the target discrete feature corresponding to each structural unit includes: for each target kinship feature corresponding to a structure, obtaining all combinations of genetic features and the conditional probability corresponding to each combination of genetic features under the target kinship feature; among all combinations of genetic features, obtaining the combination of genetic features with the highest conditional probability and determining the combination of genetic features as the first combination of genetic features; when the target kinship feature and the first combination of genetic features satisfy a first preset condition, determining the first combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; when the target kinship feature and the first combination of genetic features do not satisfy the first preset condition, obtaining the third combination of genetic features with the highest correlation to the first combination of genetic features and determining the third combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; obtaining the target genetic feature based on the genetic features in the second combination of genetic features corresponding to each target kinship feature, wherein the first preset condition is that the target kinship feature belongs to a strong feature set and the conditional probability corresponding to the first combination of genetic features is greater than the dominant inheritance threshold.
[0132] The step of obtaining the target genetic feature based on the genetic features in the second genetic feature combination corresponding to each target kinship feature includes: determining a reference genetic feature based on the genetic features in the second genetic feature combination corresponding to each target kinship feature; and determining the target genetic feature based on the reference genetic feature.
[0133] In this embodiment, when multiple facial images of the target object exist, to ensure that the generated facial image meets the requirements, a pre-trained evaluation model can be used to process the facial image and the target kinship image to obtain the credibility of the facial image, and the facial image can be updated based on this credibility. Therefore, this embodiment provides an image verification method, which is as follows: Figure 3 As shown, it specifically includes:
[0134] Step 301: For each face image, call the pre-trained evaluation model to process the target kinship image and the face image to obtain the credibility of the face image.
[0135] The pre-trained evaluation model extracts multi-dimensional features from the face image and the target related image, then compares the extracted features to obtain a confidence score. The extracted features include, but are not limited to, facial contours, facial proportions, texture details, and unique genetic markers. Confidence score represents the degree of genetic similarity between the face image and the target related image. For example, the confidence score range is set between 0 and 1, where 0 indicates almost no genetic similarity and 1 indicates high similarity.
[0136] In this step, for each face image, feature vectors can be extracted from the face image and the target kinship image respectively, and these two feature vectors are input into a pre-trained evaluation model to obtain the credibility of the face image.
[0137] Step 302: Update the face images according to the confidence level of each face image.
[0138] In this step, the most reliable facial image is selected from the generated facial images and designated as the final facial image. This image has extremely high application value. For example, it can be used to conduct object search, helping relevant personnel to accurately locate target objects; or it can be used as a basis for public display, allowing the public to more intuitively understand the facial features of target objects, providing clear visual evidence for various possible assistance or supervision.
[0139] In this embodiment, a refined analysis of facial features is achieved by dividing the target kinship image and extracting the target kinship features corresponding to each structural unit. This approach allows the understanding of facial features to extend beyond the overall picture to delve into each specific structural unit. Furthermore, in practical applications, the extraction of target kinship features helps improve the accuracy and reliability of face recognition, as the target kinship features of different structural units can provide richer recognition information. Therefore, this embodiment provides a method for determining target kinship features. The specific steps of this method include: dividing the target kinship image to obtain sub-images corresponding to each structural unit; and for each structural unit, using the feature extraction model corresponding to the structural unit, extracting features from the sub-images corresponding to the structural unit to obtain the target kinship features corresponding to the structural unit.
[0140] In this step, a specialized image segmentation algorithm is used to divide the target kinship image. For example, a deep learning-based semantic segmentation algorithm can learn the feature patterns of different structural units (such as eyes, nose, mouth, cheeks, etc.) in a facial image, thereby accurately segmenting the target kinship image into sub-images corresponding to each structural unit. For each structural unit, the feature extraction module corresponding to that structural unit is called, and the sub-image corresponding to that structural unit is processed using that feature extraction module to obtain the target kinship features corresponding to that structural unit.
[0141] Furthermore, to ensure more accurate feature extraction, target kinship features corresponding to each structural unit can be obtained based on the feature maps of the sub-images of each structural unit and the face image. A face segmentation algorithm model based on a deep neural network is then used to segment the target kinship images, generating mask images for each structural unit. The feature maps of the face image and the mask images of each structural unit are then input into a feature extraction model to extract the target kinship features for each structural unit. Specifically, the first step is to extract the feature map of the face image using a deep neural network; the second step is to scale the face region mask to the same size as the feature map and perform binarization; the third step is to multiply each mask image with the feature map to obtain a region feature map; and the fourth step is to feed the region feature map into the feature extraction model to obtain the target kinship features for each structural unit.
[0142] In this embodiment of the application, in order to accurately generate a face image, the application can also obtain the age and gender information of the target object. Then, the target genetic features, age information, and gender information are input into a pre-trained face image generation model to generate a face image of the target object. Specific steps include: obtaining the attribute information of the target object; calling the pre-trained face image generation model to process the target genetic features and attribute information to generate a face image of the target object.
[0143] The attribute information includes age, gender, and other information.
[0144] In this step, a pre-trained face image generation model is invoked. During its training phase, this model utilized a massive amount of rich face image data, comprehensively covering face samples from different age groups, genders, and various combinations of genetic features. Through continuous optimization using deep learning algorithms, the model deeply learns and masters the complex mapping relationship between target genetic features, attribute information, and face images. In the usage phase, the acquired target genetic features and attribute information are input into the model, and the model gradually generates face images of the target object based on the learned mapping relationship.
[0145] In this embodiment of the application, after obtaining the face image of the target object, the target object is searched in the public face database based on the face image. The specific steps are as follows: using a similarity calculation algorithm, the similarity between each face in the public face database and the newly generated adult face image is calculated, and a preset number of faces with the highest similarity are taken as faces similar to the newly generated adult face image, and the object corresponding to the face image is determined as the target object.
[0146] In this embodiment, the target object can also be verified to determine if it is more likely to be the object being searched. Specific steps include: obtaining a preset verification strategy; and using the preset verification strategy to verify the target object.
[0147] In this step, a preset verification strategy can generate a verification notification for the system and send it to the relevant department in the target's household registration office, enabling the department to verify the target's information. For example, the verification notification could involve collecting DNA samples from the target and their current family members to determine if a blood relationship exists between them.
[0148] Based on the above embodiments, after obtaining a facial image, since the facial image excludes objective attribute differences such as gender and age, searching for targets based on this facial image can more accurately and efficiently locate individuals matching the facial features, reducing interference from non-core facial feature differences such as gender and age, improving the accuracy and targeting of the search, and finding the target object faster. Specific solutions include:
[0149] Case 1: During the initial facial comparison of suspected individual A (out of 800 people), over 100 individuals with "similar appearances" were manually selected. However, due to A's young age at the time of disappearance and significant changes in appearance as an adult (age interference), even though A was on the candidate list, he was deemed "low probability" and shelved. Subsequently, the team used cross-age kinship comparison technology to eliminate age interference and re-identified suspected individual A. Ultimately, after two DNA verifications, it was confirmed that the man was indeed suspected individual A, who had been missing for 22 years.
[0150] Case 2: Suspect B was transferred to Region 1 at the age of 3. After reaching adulthood, he returned to Region 2 with his adoptive parents, while his biological parents remained in Region 2. Due to "differences in appearance between childhood and adulthood (age interference)," the two groups repeatedly missed each other without being identified. In 2023, the authorities, using facial recognition technology that excludes age- and gender-irrelevant features, successfully matched the adult face of suspect B with the face of the child who went missing, ultimately leading to their reunion on September 26.
[0151] Case 3: From 1993 to 1996, suspect G and his accomplice H traveled to various locations, renting houses and familiarizing themselves with the local environment to target suitable underage individuals for malicious relocation. They repeatedly used these methods to maliciously relocate 11 underage individuals, including suspected individuals C and D, to region 3. Furthermore, of the 13 individuals suspected of being maliciously relocated by suspect G, 10 have been reunited with their families of origin, 2 have been located by the suspected perpetrators, and 1 remains missing.
[0152] Case 4: Suspect F was maliciously moved 100 days after birth, and his parents searched for him for 25 years without success. In 2022, after apprehending suspect I, the authorities only learned that suspect F had been maliciously moved to a location near region 4. However, due to the large time span and the fact that suspect F's appearance had completely changed beyond infancy (age interference), the search reached a stalemate. In November 2023, the authorities used cross-age kinship comparison technology (using the core facial features of suspect F's parents as anchor points to eliminate interference from suspect F's age and gender) to quickly locate suspect F. His identity was then confirmed by DNA testing, and the family reunion was achieved on December 1st.
[0153] Beyond specific case studies, various data and charts also visually demonstrate the powerful effectiveness of the technology. Table 1 presents the number of matches using only early childhood characteristics and combined with same-kinship characteristics for different ranges of "topk" candidate numbers, clearly showing that same-kinship comparison can effectively improve the match rate, specifically:
[0154] Table 1
[0155]
[0156] Figure 4 The bar chart shows a significant increase in the number of cases involving the malicious transfer of assets from underage individuals solved annually, indirectly confirming the significant assistance that related technologies provide in solving these cases. Figure 5 The bar chart shows the number of times the ranking of the 2 million databases improved under different original database ranking ranges, reflecting the effect of technology on improving the ranking of search objects.
[0157] Meanwhile, looking at historical cases: 1. Mr. Chen: Using traditional methods, it took 2 years without results; using the same kinship method, the algorithm results were analyzed in less than 1 hour; 2. Xiao C: Less than 1 hour; 3. Xiao Xie: Less than 1 hour; and some even got results in 0.5 hours.
[0158] It should be understood that although the steps in the flowchart are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order constraint on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the diagram may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.
[0159] Please see Figure 6 One embodiment of this application provides a face image generation apparatus 600, comprising:
[0160] Acquisition unit 601 is used to acquire target kinship images of objects that are related to the target object by blood;
[0161] The first determining unit 602 is used to determine the target kinship features corresponding to each structural unit based on the target kinship image;
[0162] The second determining unit 603 is used to analyze the target kinship features corresponding to each structural unit using a preset genetic feature analysis strategy to determine the target genetic features, including: for each structural unit, obtaining a discrete feature set corresponding to each structural unit from a face genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship feature to obtain the similarity corresponding to each discrete feature; determining the discrete features with similarity greater than a preset threshold as reference discrete features corresponding to the structural unit; and determining the target genetic features based on the reference discrete features corresponding to each structural unit.
[0163] The processing unit 604 is used to call a pre-trained face image generation model to process the target genetic features and generate a face image of the target object.
[0164] Optionally, the second determining unit 603 is used for:
[0165] For each structural unit, obtain the discrete feature set corresponding to the structural unit from the face genetic feature database;
[0166] Determine the similarity between each discrete feature in the discrete feature set and the target kinship feature to obtain the similarity corresponding to each discrete feature;
[0167] Based on the discrete features whose similarity satisfies the preset conditions, the reference discrete features corresponding to the structural unit are determined;
[0168] The target genetic feature is determined based on the reference discrete features corresponding to each structural unit.
[0169] Optionally, when there are multiple generations of objects related to the target object by blood, the second determining unit 603 includes:
[0170] For each structural unit, a target genetic index corresponding to the reference discrete feature is obtained, wherein the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, the target discrete feature corresponding to the structural unit is selected from the reference discrete features;
[0171] The target genetic features are determined based on the target discrete features corresponding to each structural unit.
[0172] Optionally, when multiple facial images of the target object exist, the device further includes an updating unit 605, which is used to:
[0173] For each face image, a pre-trained evaluation model is invoked to process the target kinship image and the face image to obtain the credibility of the face image;
[0174] The face images are updated based on the confidence level of each face image.
[0175] Optionally, when the target kinship image includes kinship images of multiple generations of kinship, the first determining unit 602 is used to:
[0176] The target kinship image is divided into sub-images corresponding to each structural unit;
[0177] For each structural unit, the feature extraction model corresponding to the structural unit is used to extract features from the sub-image corresponding to the structural unit to obtain the target kinship features corresponding to the structural unit.
[0178] Optionally, the device further includes a combination unit 606, which is used for:
[0179] For each structural unit, image information corresponding to each category of the structural unit is obtained, and the image information is input into the feature extraction model to obtain discrete features corresponding to each category.
[0180] The discrete features corresponding to each category are combined to obtain the discrete feature set corresponding to the structural unit.
[0181] For specific limitations regarding the aforementioned face image generation device, please refer to the limitations on the face image generation method described above, which will not be repeated here. Each unit in the aforementioned face image generation device can be implemented entirely or partially through software, hardware, or a combination thereof. Each of these units can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.
[0182] In one embodiment, a computer device is provided, the internal structure of which can be as follows: Figure 7 As shown. The computer device includes a processor, memory, network interface, and database connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database stores data. The network interface communicates with external terminals via a network connection. The computer program, executed by the processor, can implement the above-described face image generation method. It includes: memory and a processor; the memory stores a computer program; and the processor executes the computer program to implement any step of the above-described face image generation method.
[0183] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, can perform any of the steps in the face image generation method described above.
[0184] Those skilled in the art will understand that embodiments of this application can be provided as a face image generation method, system, or computer program product. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0185] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0186] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0187] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0188] Although preferred embodiments of this application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this application.
[0189] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A method for generating a human face image, characterized in that, include: Obtain the target kinship image of objects that are related to the target object by blood; Based on the target kinship image, the target kinship features corresponding to each structural unit are determined; the structural unit includes eyes, nose, mouth, and cheeks; Using a preset genetic feature analysis strategy, the target kinship features corresponding to each structural unit are analyzed to determine the target genetic features, including: for each structural unit, obtaining a discrete feature set corresponding to each structural unit from a facial genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship features to obtain the similarity corresponding to each discrete feature; determining the discrete features with similarity greater than a preset threshold as reference discrete features corresponding to the structural unit; and determining the target genetic features based on the reference discrete features corresponding to each structural unit. A pre-trained face image generation model is invoked to process the target genetic features and generate a face image of the target object; wherein, when there are multiple generations of objects related to the target object, determining the target genetic features based on the reference discrete features corresponding to each structural unit includes: For each structural unit, a target genetic index corresponding to the reference discrete feature is obtained, wherein the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, the target discrete feature corresponding to the structural unit is selected from the reference discrete features; Determining the target genetic feature based on the target discrete feature corresponding to each structural unit includes: for the target kinship feature corresponding to each structural unit, obtaining all combinations of genetic features and the conditional probability corresponding to each combination of genetic features under the target kinship feature; among all combinations of genetic features, obtaining the combination of genetic features with the highest conditional probability and determining the combination of genetic features as the first combination of genetic features; when the target kinship feature and the first combination of genetic features meet a first preset condition, determining the first combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; when the target kinship feature and the first combination of genetic features do not meet the first preset condition, obtaining the third combination of genetic features with the highest correlation to the first combination of genetic features and determining the third combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; obtaining the target genetic feature based on the genetic features in the second combination of genetic features corresponding to each target kinship feature, wherein the first preset condition is that the target kinship feature belongs to a strong feature set and the conditional probability corresponding to the first combination of genetic features is greater than the dominant inheritance threshold.
2. The method according to claim 1, characterized in that, The process of obtaining the target genetic feature based on the genetic features in the combination of second genetic features corresponding to each target kinship feature includes: Based on the genetic characteristics in the combination of second genetic characteristics corresponding to each target kinship trait, a reference genetic characteristic is determined; The target genetic characteristic is determined based on the reference genetic characteristic.
3. The method according to claim 1, characterized in that, When there are multiple facial images of the target object, the method further includes: For each face image, a pre-trained evaluation model is invoked to process the target kinship image and the face image to obtain the credibility of the face image; The face images are updated based on the confidence level of each face image.
4. The method according to claim 1, characterized in that, When the target kinship image includes kinship images from multiple generations, determining the target kinship feature corresponding to each structural unit based on the target kinship image includes: The target kinship image is divided into sub-images corresponding to each structural unit; For each structural unit, the feature extraction model corresponding to the structural unit is used to extract features from the sub-image corresponding to the structural unit to obtain the target kinship features corresponding to the structural unit.
5. The method according to claim 1, characterized in that, The method further includes: For each structural unit, image information corresponding to each category of the structural unit is obtained, and the image information is input into the feature extraction model to obtain discrete features corresponding to each category. The discrete features corresponding to each category are combined to obtain the discrete feature set corresponding to the structural unit.
6. A face image generation device, characterized in that, The device includes: The acquisition unit is used to acquire target kinship images of objects that are related to the target object by blood. The first determining unit is used to determine the target kinship features corresponding to each structural unit based on the target kinship image; the structural unit includes eyes, nose, mouth and cheeks; The second determining unit is used to analyze the target kinship features corresponding to each structural unit using a preset genetic feature analysis strategy to determine the target genetic features, including: for each structural unit, obtaining a discrete feature set corresponding to each structural unit from a face genetic feature database; determining the similarity between each discrete feature in the discrete feature set and the target kinship feature to obtain the similarity corresponding to each discrete feature; determining the discrete features with similarity greater than a preset threshold as reference discrete features corresponding to the structural unit; and determining the target genetic features based on the reference discrete features corresponding to each structural unit. A processing unit is configured to invoke a pre-trained face image generation model to process the target genetic features and generate a face image of the target object; wherein, when there are multiple generations of objects related to the target object, determining the target genetic features based on the reference discrete features corresponding to each structural unit includes: For each structural unit, a target genetic index corresponding to the reference discrete feature is obtained, wherein the target genetic index indicates the probability of inheritance of the category corresponding to the reference discrete feature; based on the target genetic index corresponding to the reference discrete feature, the target discrete feature corresponding to the structural unit is selected from the reference discrete features; Determining the target genetic feature based on the target discrete feature corresponding to each structural unit includes: for the target kinship feature corresponding to each structural unit, obtaining all combinations of genetic features and the conditional probability corresponding to each combination of genetic features under the target kinship feature; among all combinations of genetic features, obtaining the combination of genetic features with the highest conditional probability and determining the combination of genetic features as the first combination of genetic features; when the target kinship feature and the first combination of genetic features meet a first preset condition, determining the first combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; when the target kinship feature and the first combination of genetic features do not meet the first preset condition, obtaining the third combination of genetic features with the highest correlation to the first combination of genetic features and determining the third combination of genetic features as the second combination of genetic features corresponding to the target kinship feature; obtaining the target genetic feature based on the genetic features in the second combination of genetic features corresponding to each target kinship feature, wherein the first preset condition is that the target kinship feature belongs to a strong feature set and the conditional probability corresponding to the first combination of genetic features is greater than the dominant inheritance threshold.
7. A computer device, comprising: A memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method according to any one of claims 1 to 5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Missing face recognition method and device, computer equipment and storage medium
CN110378230A
Face recognition method and system based on family gene template
CN114708644A