Face recognition-based head portrait generation method, system and device, and storage medium

Abstract

The invention provides a face recognition-based head portrait generation method, system and device, and a storage medium. The method comprises the steps of collecting head portrait data of a user; generating at least one expression package based on the head portrait data of the user, the expression package including a plurality of expression head portraits representing the emotion of the user, and taking the selected expression head portrait as a default head portrait of the user; identifying current head portrait data of the user when the user logs in, performing expression identification, and taking an expression head portrait corresponding to the current expression of the user as a current head portrait of the user; and displaying the current head portrait to at least one user permitted by the user. According to the method, a series of expression packages representing different emotions can be generated based on the head portrait data of the user, the personalized customized expressions can enrich the interaction means of the user, the functionality of the head portrait of the user can be improved, and the interaction experience between the users is enhanced.

Description

Technical Field

[0001] The present invention relates to the field of social platforms, and in particular to a method, system, device and storage medium for generating an avatar based on face recognition. Background Art

[0002] In current system software or platforms, users cannot be forced to upload avatars based on user considerations. If the user has uploaded an avatar, the avatar seen in the address book of the system software or platform will be displayed as the user's uploaded avatar; if the user has not uploaded an avatar, the system's default built-in avatar will be displayed, or no avatar will be displayed. Due to the lack of effective rules, the avatar list is displayed in a chaotic manner, making it difficult to quickly identify contacts from the avatar, affecting the user experience.

[0003] Furthermore, unlike offline interactions, when a user is online, others cannot know their current mood. Therefore, even if a user is happy or sad, their friends cannot contact them to share their happiness or alleviate their sadness unless they proactively chat with them. This makes online social interaction impossible to achieve the offline communication model based on observing each other's expressions as the starting point.

[0004] In view of this, the present invention provides a method, system, device and storage medium for generating an avatar based on face recognition. Summary of the Invention

[0005] In response to the problems in the prior art, the purpose of the present invention is to provide a face recognition-based avatar generation method, system, device and storage medium, which overcomes the difficulties of the prior art and can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized customized emoticons can not only enrich the user's means of interaction, but also improve the functionality of the user's avatar and enhance the interactive experience between users.

[0006] An embodiment of the present invention provides a method for generating an avatar based on face recognition, comprising the following steps:

[0007] S110, collecting user's profile picture data;

[0008] S120, generating at least one emoticon package based on the user's avatar data, wherein the emoticon package includes several emoticon avatars representing the user's emotions, and selecting one of the emoticon avatars as the user's default avatar;

[0009] S130, identifying the user's current avatar data when the user logs in, performing expression recognition, and using the expression avatar corresponding to the user's current expression as the user's current avatar; and

[0010] S140: Display the current avatar to at least one user authorized by the user.

[0011] Preferably, the step S110 includes:

[0012] S111. Collecting three-dimensional point cloud information of the user's head;

[0013] S112: Perform facial detection and feature extraction based on the three-dimensional point cloud information to obtain the portrait data.

[0014] Preferably, the step S110 includes:

[0015] S113, collecting three-dimensional point cloud information of the user's head under different expressions;

[0016] S114, performing facial detection and feature extraction based on the three-dimensional point cloud information to identify the facial expression state;

[0017] S115: Create corresponding avatar data according to each expression state of the user.

[0018] Preferably, the step S120 includes:

[0019] S121, generating at least one emoticon package based on the user's avatar data, wherein the emoticon package includes several avatars representing the user's emotions;

[0020] S122: Selecting an expression avatar from the expression package as the user's default avatar.

[0021] Preferably, step S121 further includes: selecting a deep learning model for image style transfer, and training the model so that it can convert the input user portrait into a portrait with different artistic styles or expressions.

[0022] Preferably, the step S130 includes:

[0023] S131, performing facial recognition for authentication when the user logs in, the facial recognition including comparing facial features and providing a number of prompt expressions to the user, and collecting the user's facial features under different expressions and identifying the relationship between facial feature movements during the transition between each expression;

[0024] S132. After the user completes login, identify the user's current profile picture data and perform expression recognition;

[0025] S133: Use the expression avatar corresponding to the user's current expression as the user's current avatar.

[0026] Preferably, the step S140 includes:

[0027] S141. Displaying the current avatar to at least one user authorized by the user;

[0028] S142: When the current avatar is in a preset emergency expression state, notify the user's preset emergency contact;

[0029] S143: Display the default avatar to other users who are not authorized by the user.

[0030] Preferably, the step S140 further includes:

[0031] In the interactive interface of displayed users, the current avatar of each user is compared with the default avatar, and users whose current avatar is different from the default avatar are prioritized at the top.

[0032] An embodiment of the present invention further provides a face recognition-based avatar generation system for implementing the above-mentioned face recognition-based avatar generation method. The face recognition-based avatar generation system includes:

[0033] Data collection module, collecting user's avatar data;

[0034] An expression generation module generates at least one expression package based on the user's avatar data, wherein the expression package includes a plurality of expression avatars representing the user's emotions, and selects one of the expression avatars as the user's default avatar;

[0035] An expression recognition module that identifies the user's current avatar data when the user logs in, performs expression recognition, and uses the expression avatar corresponding to the user's current expression as the user's current avatar; and

[0036] The avatar display module displays the current avatar to at least one user authorized by the user.

[0037] An embodiment of the present invention further provides a head portrait generation device based on face recognition, comprising:

[0038] processor;

[0039] a memory storing executable instructions for the processor;

[0040] The processor is configured to execute the steps of the above-mentioned face recognition-based avatar generation method by executing the executable instructions.

[0041] An embodiment of the present invention further provides a computer-readable storage medium for storing a program, which, when executed, implements the steps of the above-mentioned face recognition-based avatar generation method.

[0042] The purpose of the present invention is to provide a face recognition-based avatar generation method, system, device and storage medium, which can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized customized emoticons can not only enrich the user's interaction means, but also improve the functionality of the user's avatar and enhance the interactive experience between users. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Other features, objects and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings.

[0044] Figure 1 It is a flow chart of the face recognition-based avatar generation method of the present invention.

[0045] Figures 2 to 4 It is a schematic diagram of the process of implementing the face recognition-based avatar generation method of the present invention.

[0046] Figure 5 It is a structural diagram of the face recognition-based avatar generation system of the present invention.

[0047] Figure 6 It is a structural schematic diagram of the head portrait generation device based on face recognition of the present invention.

[0048] Figure 7 It is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. DETAILED DESCRIPTION

[0049] The following describes the embodiments of the present application through specific examples. Those skilled in the art can easily understand the other advantages and effects of the present application from the content disclosed in the present application. The present application can also be implemented or applied through different specific embodiments. The details in the present application can also be modified or changed according to different viewpoints and application systems without departing from the spirit of the present application. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other unless they conflict.

[0050] The following is a detailed description of the embodiments of the present application with reference to the accompanying drawings so that those skilled in the art can easily implement the present application. The present application can be embodied in many different forms and is not limited to the embodiments described herein.

[0051] In the description of this application, reference to the terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of this application. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art may combine and integrate different embodiments or examples described in this application, as well as features of different embodiments or examples, unless otherwise contradictory.

[0052] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature identified as "first" or "second" may explicitly or implicitly include at least one such feature. In the context of this application, "plurality" means two or more, unless otherwise specifically defined.

[0053] In order to clearly describe the present application, components not related to the description are omitted, and the same or similar components throughout the specification are given the same reference numerals.

[0054] Throughout this specification, when a device is said to be "connected" to another device, this includes not only "direct connection" but also "indirect connection" with other elements interposed therebetween. Furthermore, when a device is said to "include" a certain component, unless otherwise stated, this does not exclude the inclusion of other components but rather implies that the device may include other components.

[0055] When a device is said to be "on" another device, it may be directly on the other device, but there may also be other devices between it. In contrast, when a device is said to be "directly on" another device, there are no other devices between it.

[0056] Although the terms first, second, etc. are used in some instances herein to represent various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first interface and the second interface, etc. are represented. Furthermore, as used in this article, the singular forms "one," "an," and "the" are intended to also include the plural forms, unless there is a contrary indication in the context. It should be further understood that the terms "comprise," "include," and "include" indicate the presence of features, steps, operations, elements, components, items, types, and / or groups, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, types, and / or groups. The terms "or" and "and / or" used herein are interpreted as inclusive, or mean any one or any combination. Therefore, "A, B, or C" or "A, B, and / or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B, and C." Exceptions to this definition only occur when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0057] The technical terms used herein are intended only to refer to specific embodiments and are not intended to limit this application. The singular form used herein also includes the plural form unless the statement explicitly indicates otherwise. The term "comprising" as used in this specification is intended to specify specific features, regions, integers, steps, operations, elements, and / or components and does not exclude the presence or addition of other features, regions, integers, steps, operations, elements, and / or components.

[0058] Although not defined differently, all terms used herein, including technical and scientific terms, have the same meanings as those generally understood by those skilled in the art to which this application belongs. Terms defined in commonly used dictionaries are to be interpreted as having meanings consistent with the relevant technical literature and current teachings, and unless otherwise defined, they should not be overly interpreted as ideal or highly formalized meanings.

[0059] Figure 1 This is a flow chart of the face recognition-based avatar generation method of the present invention. Figure 1 As shown, the face recognition-based avatar generation method of the present invention includes:

[0060] S110: Collect user's profile picture data.

[0061] S120: Generate at least one emoticon package based on the user's avatar data, where the emoticon package includes several emoticon avatars representing the user's emotions, and use a selected emoticon avatar as the user's default avatar.

[0062] S130, when the user logs in, identifying the user's current avatar data, performing expression recognition, and using the expression avatar corresponding to the user's current expression as the user's current avatar.

[0063] S140: Display the current avatar to at least one user authorized by the user.

[0064] In a preferred embodiment, step S110 includes:

[0065] S111. Collect three-dimensional point cloud information of the user's head.

[0066] S112. Perform facial detection and feature extraction based on the three-dimensional point cloud information to obtain portrait data, but the present invention is not limited thereto.

[0067] In a preferred embodiment, step S110 includes:

[0068] S113. Collect three-dimensional point cloud information of the user's head under different expressions.

[0069] S114: Perform facial detection and feature extraction based on the three-dimensional point cloud information to identify the facial expression state.

[0070] S115. Create corresponding avatar data according to each expression state of the user, but the present invention is not limited thereto.

[0071] In a preferred embodiment, step S120 includes:

[0072] S121. Generate at least one emoticon package based on the user's avatar data, where the emoticon package includes several avatars representing the user's emotions.

[0073] S122. An expression avatar is selected from the expression package as the user's default avatar, but this is not limited to the above. The present invention can collect a large amount of user avatar data, expressions, and facial features, input them into the style transfer learning model, and continuously train the model to transform the avatar into avatars with different styles and expressions. The model also monitors user feedback to continuously improve the generation quality and user experience. The user can select the generation style and expression in the interface.

[0074] The financial industry, in particular, is increasingly focused on providing personalized products and services. Users use emojis within financial applications to express diverse emotions, thereby enhancing interactivity and user engagement. Advances in computer vision and deep learning can accomplish tasks such as facial detection, feature extraction, image generation, and style transfer, making it possible to automatically generate emojis in a variety of styles.

[0075] In a preferred embodiment, step S121 further includes: selecting a deep learning model for image style transfer, and training the model so that it can convert the input user portrait into a portrait with different artistic styles or expressions, but is not limited thereto.

[0076] In a preferred embodiment, step S130 includes:

[0077] S131. Perform facial recognition for authentication when the user logs in. Facial recognition includes comparing facial features and providing a number of prompt expressions to the user, and collecting the user's facial features in different expressions and identifying the relationship between facial feature movements during the conversion of each expression.

[0078] S132: After the user completes login, identify the user's current avatar data and perform expression recognition.

[0079] S133: Using the expression avatar corresponding to the user's current expression as the user's current avatar, but not limited to this.

[0080] In a preferred embodiment, step S140 includes:

[0081] S141: Display the current avatar to at least one user authorized by the user.

[0082] S142: When the current avatar is in a preset emergency expression state, notify the user's preset emergency contact.

[0083] S143. Displaying the default avatar to other users who are not authorized by the user, but not limited to this.

[0084] In a preferred embodiment, the step S140 further includes:

[0085] In the interactive interface of displayed users, the current avatar of each user is compared with the default avatar, and users whose current avatar is different from the default avatar are prioritized at the top, but the present invention is not limited thereto.

[0086] The specific implementation of the present invention is as follows:

[0087] Figures 2 to 4It is a schematic diagram of the process of implementing the face recognition-based avatar generation method of the present invention. First, the three-dimensional point cloud information of the head of each user under different expressions is collected. Facial detection and feature extraction are performed based on the three-dimensional point cloud information to identify the expression state. Corresponding avatar data are established according to each expression state of the user. For example: in an APP of a financial platform, a large number of avatar data of different financial users can be collected, including users of different genders, ages and races. The data is labeled to specify the facial features and expression labels of each avatar (for example, happy, angry, surprised, etc.), and a facial detection algorithm is used to locate the facial area in the avatar. Facial feature points, such as the position of the eyes, mouth and nose, and the characteristics of facial expressions are extracted.

[0088] Then, at least one emoticon package is generated based on the user's avatar data. The emoticon package includes several emoticon avatars that represent the user's emotions. One emoticon avatar in the emoticon package will be selected as the user's default avatar. Alternatively, a deep learning model for image style transfer can be selected and trained to enable it to transform the input financial user avatar into avatars of different artistic styles or expressions using an existing portrait generation model or avatar stylization model. Figure 2 As shown, the address book in the interactive app on user Y's phone 1 shows other names, such as user X1's default avatar 11, user X2's default avatar 12, user X3's default avatar 13, user X4's default avatar 14, user X5's default avatar 15, and user X6's default avatar 16. A deep learning model for image style transfer can be selected and trained to transform the input financial user's profile picture into avatars with different artistic styles or expressions. User feedback can be regularly monitored and the generation quality and user experience continuously improved based on this feedback. The model can be updated to support new artistic styles and expressions. Alternatively, a user-friendly interface can be created where users can upload their own profile pictures. Users can select different styles or expressions, and the model will then convert their profile pictures into the selected styles or expressions. Multi-style emoji packs can be downloaded and generated by the user. In the interface, users can take a photo and enter their profile picture data, select the style and expression they want to generate, and the algorithm will extract facial features. The model will then convert the facial features into customized expressions and styles, which can then be downloaded and used.

[0089] See also Figure 3As shown, facial recognition is performed for authentication when each user logs in. Facial recognition involves comparing facial features, providing the user with several prompt expressions, and collecting information about the user's facial features during different expressions and the relationship between facial feature movements during each expression transition. After the user completes login, the user's current profile picture data is identified and expression recognition is performed. For example, if user X2's current expression is identified as joy, an avatar representing X2's joyful expression will be used as X2's current profile picture. If user X5's current expression is identified as sadness, an avatar representing X5's sadness will be used as X5's current profile picture.

[0090] See also Figure 4 As shown, since user Y is a user who is permitted to view the current avatar by user X1, user X2, user X3, user X4, user X5, and user X6, user Y can see the current avatar of user X2 and the current avatar of user X5 in the address book. User Y can then take the initiative to care about user X2 and initiate a chat request. In addition, when the current avatar is in a preset emergency expression state (for example, crying, etc.), the user's preset emergency contact (for example, the user's guardian, parent, or spouse) is notified. Moreover, the default avatar is displayed to other users who are not permitted by the user. Other users who are not permitted cannot see the current avatar, thereby protecting the user's personal privacy.

[0091] In one variation, in the interactive interface of displayed users, each user's current avatar is compared with the default avatar, and users whose current avatars are different from the default avatar are prioritized at the top. This is equivalent to each user opening their own interactive interface (for example, a chat interface, where users are naturally arranged according to the order in which they communicate), and being able to preferentially see the users whose avatars have obvious changes (showing relatively large emotional fluctuations) at the top of the interactive interface, thereby triggering the willingness of users to actively chat with each other. This is especially true in financial apps, where users often experience gains and losses every day. Using the present invention, users are more likely to prioritize communicating with users who have mutual benefits or losses, thereby enhancing emotions and enhancing the user experience in the interactive scenarios of financial apps.

[0092] This invention deploys models to cloud servers or local servers for immediate user access. It ensures model performance, speed, and stability to handle high concurrent requests. It also ensures that user-uploaded avatar data is protected from misuse or leakage. This invention provides personalized, entertaining, and interactive financial services, meeting user needs, enhancing brand appeal, and generating greater user retention and growth opportunities for financial institutions.

[0093] Figure 5Schematic diagram of the structure of the face recognition-based avatar generation system of the present invention. Figure 5 As shown, an embodiment of the present invention further provides a face recognition-based avatar generation system for implementing the above-mentioned face recognition-based avatar generation method. The face recognition-based avatar generation system 5 includes:

[0094] The data collection module 51 collects the user's head portrait data.

[0095] The expression generation module 52 generates at least one expression package based on the user's avatar data. The expression package includes several expression avatars representing the user's emotions, and selects a selected expression avatar as the user's default avatar.

[0096] The expression recognition module 53 identifies the user's current avatar data when the user logs in, performs expression recognition, and uses the expression avatar corresponding to the user's current expression as the user's current avatar.

[0097] The avatar display module 54 displays the current avatar to at least one user authorized by the user.

[0098] In a preferred embodiment, the data acquisition module 51 is configured to collect three-dimensional point cloud information of the user's head, perform facial detection and feature extraction based on the three-dimensional point cloud information to obtain portrait data, but is not limited thereto.

[0099] In a preferred embodiment, the data acquisition module 51 is configured to collect three-dimensional point cloud information of the user's head under different expressions, perform facial detection and feature extraction based on the three-dimensional point cloud information, identify the expression state, and establish corresponding avatar data according to each expression state of the user, but not limited to this.

[0100] In a preferred embodiment, the expression generation module 52 is configured to generate at least one expression package based on the user's avatar data, the expression package including several expression avatars representing the user's emotions. An expression avatar in the expression package is selected as the user's default avatar, but is not limited thereto.

[0101] In a preferred embodiment, the expression generation module 52 is further configured to select a deep learning model for image style transfer and train the model so that it can convert the input financial user portrait into a portrait with different artistic styles or expressions, but is not limited thereto.

[0102] In a preferred embodiment, the expression recognition module 53 is configured to perform facial recognition for authentication when a user logs in. This facial recognition includes comparing facial features, providing the user with a number of prompt expressions, and collecting information about the user's facial features during different expressions and the dynamic relationships between facial features during each expression transition. After the user completes login, the user's current avatar data is identified and expression recognition is performed. The avatar corresponding to the user's current expression is used as the user's current avatar, but this is not a limitation.

[0103] In a preferred embodiment, the avatar display module 54 is configured to display the current avatar to at least one user authorized by the user. When the current avatar is in a preset emergency expression state, the user's preset emergency contact is notified. The default avatar is displayed to other users not authorized by the user, but the configuration is not limited thereto.

[0104] In a preferred embodiment, the avatar display module 54 is also configured to compare the current avatar of each user with the default avatar in the interactive interface of the displayed users, and prioritize users whose current avatars are different from the default avatars, but not limited to this.

[0105] The face recognition-based avatar generation system of the present invention can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized customized emoticons can not only enrich the user's interaction methods, but also improve the functionality of the user's avatar and enhance the interactive experience between users.

[0106] An embodiment of the present invention further provides a device for generating an avatar based on face recognition, comprising a processor and a memory storing executable instructions for the processor. The processor is configured to execute the executable instructions to perform the steps of the method for generating an avatar based on face recognition.

[0107] As shown above, the face recognition-based avatar generation device of this embodiment of the present invention can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized customized emoticons can not only enrich the user's means of interaction, but also improve the functionality of the user's avatar and enhance the interactive experience between users.

[0108] Those skilled in the art will appreciate that various aspects of the present invention may be implemented as systems, methods, or program products. Accordingly, various aspects of the present invention may be implemented in the following forms: entirely in hardware, entirely in software (including firmware, microcode, etc.), or in a combination of hardware and software, collectively referred to herein as "circuits," "modules," or "platforms."

[0109] Figure 6 This is a schematic diagram of the structure of the head portrait generation device based on face recognition of the present invention. Figure 6 An electronic device 600 according to this embodiment of the present invention will be described. Figure 6 The electronic device 600 shown is merely an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0110] like Figure 6 As shown, electronic device 600 is implemented as a general-purpose computing device. Components of electronic device 600 may include, but are not limited to, at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different platform components (including storage unit 620 and processing unit 610), and a display unit 640.

[0111] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above method section of this specification. For example, the processing unit 610 can perform the following steps: Figure 1 Follow the steps shown in .

[0112] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0113] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0114] Bus 630 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0115] The electronic device 600 can also communicate with one or more external devices 700 (e.g., a keyboard, a pointing device, a Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 600, and / or any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., a router, a modem, etc.). Such communication can occur via an input / output (I / O) interface 650. Furthermore, the electronic device 600 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 660. The network adapter 660 can communicate with other modules of the electronic device 600 via the bus 630. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with the electronic device 600, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms.

[0116] An embodiment of the present invention further provides a computer-readable storage medium for storing a program that, when executed, implements the steps of the face recognition-based avatar generation method. In some possible implementations, various aspects of the present invention may also be implemented in the form of a program product, which includes program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the method section above.

[0117] As shown above, the face recognition-based avatar generation system of this embodiment of the present invention can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized emoticons can not only enrich the user's means of interaction, but also improve the functionality of the user's avatar and enhance the interactive experience between users.

[0118] Figure 7 Schematic diagram of the structure of the computer readable storage medium of the present invention. Figure 7 , a program product 800 for implementing the above method according to an embodiment of the present invention is described. The program product 800 may be a portable compact disc read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0119] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0120] Computer-readable storage media may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.

[0121] The program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and the like, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0122] In summary, the purpose of the present invention is to provide a face recognition-based avatar generation method, system, device and storage medium, which can generate a series of emoticon packages representing different emotions based on the user's avatar data. The personalized emoticons can not only enrich the user's means of interaction, but also improve the functionality of the user's avatar and enhance the interactive experience between users.

[0123] The above is a further detailed description of the present invention in conjunction with specific preferred embodiments, and the specific implementation of the present invention should not be considered to be limited to these descriptions. For those skilled in the art of the present invention, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should be considered to fall within the scope of protection of the present invention.

Claims

1. A method for generating an avatar based on face recognition, characterized in that: The following steps are involved: S110, collecting user's profile picture data; S120, generating at least one emoticon package based on the user's avatar data, wherein the emoticon package includes several emoticon avatars representing the user's emotions, and selecting one of the emoticon avatars as the user's default avatar; S130, identifying the user's current avatar data when the user logs in, performing expression recognition, and using the expression avatar corresponding to the user's current expression as the user's current avatar; as well as S140: Display the current avatar to at least one user authorized by the user.

2. The face recognition-based avatar generation method according to claim 1, wherein: The step S110 includes: S111. Collecting three-dimensional point cloud information of the user's head; S112: Perform facial detection and feature extraction based on the three-dimensional point cloud information to obtain the portrait data.

3. The face recognition-based avatar generation method according to claim 1, wherein: The step S110 includes: S113, collecting three-dimensional point cloud information of the user's head under different expressions; S114, performing facial detection and feature extraction based on the three-dimensional point cloud information to identify the facial expression state; S115: Create corresponding avatar data according to each expression state of the user.

4. The face recognition-based avatar generation method according to claim 3, wherein: The step S120 includes: S121. Generate at least one emoticon package based on the user's avatar data, the emoticon package including several avatars with expressions representing the user's emotions, select a deep learning model for image style transfer, and train the model to enable it to convert the input user avatar into avatars with different artistic styles or expressions; S122: Selecting an expression avatar from the expression package as the user's default avatar.

5. The face recognition-based avatar generation method according to claim 4, wherein: The step S130 includes: S131, performing facial recognition for authentication when the user logs in, the facial recognition including comparing facial features and providing a number of prompt expressions to the user, and collecting the user's facial features under different expressions and identifying the relationship between facial feature movements during the transition between each expression; S132. After the user completes login, identify the user's current profile picture data and perform expression recognition; S133: Use the expression avatar corresponding to the user's current expression as the user's current avatar.

6. The face recognition-based avatar generation method according to claim 4, wherein: The step S140 includes: S141. Displaying the current avatar to at least one user authorized by the user; S142: When the current avatar is in a preset emergency expression state, notify the user's preset emergency contact; S143: Display the default avatar to other users who are not authorized by the user.

7. The face recognition-based avatar generation method according to claim 1, wherein: The step S140 further includes: In the interactive interface of displayed users, the current avatar of each user is compared with the default avatar, and users whose current avatar is different from the default avatar are prioritized at the top.

8. A face recognition-based avatar generation system, used to implement the face recognition-based avatar generation method according to claim 1, characterized in that: include: Data collection module, collecting user's avatar data; An expression generation module generates at least one expression package based on the user's avatar data, wherein the expression package includes a plurality of expression avatars representing the user's emotions, and selects one of the expression avatars as the user's default avatar; The expression recognition module identifies the user's current avatar data when the user logs in, performs expression recognition, and uses the expression avatar corresponding to the user's current expression as the user's current avatar; as well as The avatar display module displays the current avatar to at least one user authorized by the user.

9. A head portrait generation device based on face recognition, characterized in that: include: processor; a memory storing executable instructions for the processor; The processor is configured to execute the steps of the face recognition-based avatar generation method according to any one of claims 1 to 7 by executing the executable instructions.

10. A computer-readable storage medium for storing a program, characterized in that: When the program is executed by a processor, the steps of the face recognition-based avatar generation method according to any one of claims 1 to 7 are implemented.

Images