Method and device for constructing digital person business card

Abstract

The invention discloses a method and device for constructing a digital human image film, and relates to the technical field of computer vision. The specific implementation mode comprises the following steps: receiving a request message for constructing a digital person business card sent by a user; voice information in the request information is sent to an emotion recognition model to be processed, and emotion parameters are obtained; determining a target digital human template selected by a user in the request message; driving a digital human in the target digital human template to act according to the emotion parameters; and generating a digital human video by using the digital human action, so that the digital human video is used for constructing a digital human name card. In the process of constructing the digital person business card by the user, the action of the digital person is driven through the voice information, so that the display effect of the digital person business card is greatly improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, specifically to the field of computer vision technology, and in particular to a method, device, electronic device and storage medium for constructing a digital human business card. Background Art

[0002] Digital human is a digital character image close to human image created by digital technology. In a narrow sense, digital human is the product of the integration of information science and life science. It uses information science methods to virtually simulate the human body's form and function at different levels.

[0003] A digital business card is a digitized personal or corporate business card that uses advanced technology to display personal information, business scope, product features, etc. on an electronic card. Summary of the invention

[0004] Aiming at the problem of action driving in digital human business cards, a method, device, electronic device and storage medium for constructing digital human business cards are provided.

[0005] According to a first aspect, a method for constructing a digital human business card is provided, comprising: receiving a request message for constructing a digital human business card sent by a user; sending voice information in the request message to an emotion recognition model for processing to obtain emotion parameters; determining a target digital human template selected by the user in the request message; driving digital human actions in the target digital human template according to the emotion parameters; and generating a digital human video using the digital human actions, so as to use the digital human video to construct a digital human business card.

[0006] In combination with the first aspect, in some examples, the digital human actions include body movements and gesture movements, and driving the digital human actions in the target digital human template according to the emotional parameters includes: determining the body movements according to the emotional parameters; determining the gesture movements according to the semantics in the voice information; and using the body movements and the gesture movements to drive the digital human actions in the target digital human template.

[0007] In combination with the first aspect, in some examples, determining a gesture action based on the semantics in the voice information includes: identifying whether the voice information contains preset keywords, the preset keywords include at least numbers; and matching corresponding gesture actions based on the preset keywords.

[0008] In combination with the first aspect, in some examples, using the limb movements and the gesture movements to drive the movements of the digital human in the target digital human template includes: smoothing two adjacent limb movements among the multiple limb movements; and using the smoothed limb movements and the gesture movements to drive the movements of the digital human.

[0009] In combination with the first aspect, in some examples, two adjacent limb movements among the multiple limb movements are smoothed, including: determining the default positions of the two adjacent limb movements; connecting the multiple preset movements according to the default positions to obtain a movement coefficient.

[0010] In combination with the first aspect, in some examples, two adjacent limb movements among the multiple limb movements are smoothed, including: determining the skeleton information corresponding to each limb movement, the skeleton information including the spatial position and distance relationship; and fusing the two adjacent limb movements using alignment and spherical linear interpolation for smoothing.

[0011] In combination with the first aspect, in some examples, the training method of the emotion recognition model includes: determining a common sense task template; generating common sense training data based on the common sense task template through a large language model under the constraints of a preset data set; determining an emotion task template; generating emotion training data based on the common sense task template through a large language model under the constraints of a preset data set; and training an initial model based on the common sense training data and the emotion training data respectively to obtain the emotion recognition model.

[0012] According to the second aspect, a device for constructing a digital human business card is provided, comprising: a first unit, for receiving a request message for constructing a digital human business card sent by a user; a second unit, for sending the voice information in the request information to an emotion recognition model for processing to obtain emotion parameters; a third unit, for determining a target digital human template selected by the user in the request message; a fourth unit, for driving the digital human action in the target digital human template according to the emotion parameters; and a fifth unit, for generating a digital human video using the digital human action, so as to use the digital human video to construct a digital human business card.

[0013] According to a third aspect, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a method as in any embodiment of a method for constructing a digital personal business card.

[0014] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method of any embodiment of the method for constructing a digital personal business card is implemented.

[0015] According to the solution of the present application, in the process of building a digital human business card by the user, the digital human is driven by voice information, which greatly improves the display effect of the digital human business card. The embodiment of the present application combines the process of selecting a digital human template in the process of building a digital human business card, and only needs to identify the emotional parameters in the voice information, and then the digital human can be driven by action, without the need to generate the digital human action in real time, which greatly reduces the computing pressure and improves the efficiency of generating digital human business cards. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0017] Figure 1 is an exemplary system architecture diagram to which some embodiments of the present application may be applied;

[0018] Figure 2 is a flow chart of an embodiment of a method for constructing a digital person business card according to the present application;

[0019] Figure 3 is a schematic diagram of an application scenario of the method for constructing a digital human business card according to the present application;

[0020] Figure 4 is a flow chart of another embodiment of a method for constructing a digital person business card according to the present application;

[0021] Figure 5 It is a structural schematic diagram of an embodiment of a device for constructing a digital human business card according to the present application;

[0022] Figure 6 It is a block diagram of an electronic device used to implement the method of constructing a digital human business card in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0024] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0025] Figure 1An exemplary system architecture 100 is shown to which an embodiment of the method for building a digital person business card or an apparatus for building a digital person business card of the present application can be applied.

[0026] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0027] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as video applications, live broadcast applications, instant messaging tools, email clients, social platform software, etc.

[0028] The terminal devices 101, 102, 103 here can be hardware or software. When the terminal devices 101, 102, 103 are hardware, they can be various electronic devices with display screens, including but not limited to smart phones, tablet computers, e-book readers, laptop portable computers and desktop computers, etc. When the terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, multiple software or software modules for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0029] The server 105 may be a server that provides various services, such as a background server that provides support for the terminal devices 101, 102, and 103. The background server may analyze and process the received voice information and other data, and feed back the processing results (such as emotional parameters or digital human actions) to the terminal device.

[0030] It should be noted that the method for constructing a digital person business card provided in the embodiment of the present application can be executed by the server 105 or the terminal devices 101, 102, 103, and accordingly, the device for constructing a digital person business card can be set in the server 105 or the terminal devices 101, 102, 103.

[0031] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0032] Continue to refer Figure 2, shows a process 200 of an embodiment of a method for constructing a digital person business card according to the present application. The method for constructing a digital person business card includes the following steps:

[0033] Step 201: receiving a request message for building a digital human business card sent by a user.

[0034] In this embodiment, the method for constructing a digital person business card runs on an execution subject (eg Figure 1 The server or terminal device shown in the figure can directly receive the request message sent by the user, or can receive the request message after the request message has undergone relevant network security verification.

[0035] In this embodiment, the request message for constructing a digital human business card includes, but is not limited to, image information such as the user's face image, text information such as labels and self-introduction, and voice information of the user as the speaker.

[0036] Step 202: Send the voice information in the request information to an emotion recognition model for processing to obtain emotion parameters.

[0037] In this embodiment, the above-mentioned execution entity pre-trains the emotion recognition model. In some embodiments, the training can be directly performed through a data set with emotion labels. In other embodiments, the emotion recognition model can be separately subjected to emotion training and common sense training, so that the emotion recognition model can improve the accuracy of emotion recognition through common sense understanding in the absence of context.

[0038] In some examples, the preset data sets are collected from domestic and foreign TV series. Taking "Friends" as an example, it includes 97 episodes, 897 scenes and 12,606 utterances. There are 7 emotional labels in the data set: neutral, happy, peaceful, powerful, scared, crazy and sad.

[0039] In some optional examples, the specific steps of performing emotion training and common sense training on the emotion recognition model include: determining a common sense task template; under the constraints of a preset data set, generating common sense task training data by giving the common sense task template a large language model; determining an emotion task template; under the constraints of a preset data set, generating emotion training data based on the common sense task template by a large language model; and training the initial model based on the common sense training data and the emotion training data respectively to obtain the emotion recognition model.

[0040] Specifically, in order to deeply mine the implicit information of the speaker, the embodiment of the present application trains the model through common sense tasks and emotional tasks, which can understand the speaker's intention, the speaker's psychological state and the speaker's effect. The speaker common sense task template is as follows.

[0041] {“input”:Now you are an expert at using common sense to make inferences. The following recorded conversation between “######” involves several speakers. ###U{u1,u2...u i-1}###Based on the above historical discourse, please use common sense to infer u i The potential audience response should be no more than ten words: "Target": "t i ”}.

[0042] Here U represents the historical dialogue of the current utterance, including utterance i-1. i represents the current discourse. i It represents u i Common sense of the speaker.

[0043] The common sense recognition loss function is as follows:

[0044]

[0045] Among them, input i Hint indicating the speaker's common sense recognition. i is u i The common sense of the speaker labels in . n represents the number of utterances in the conversation.

[0046] Based on the same idea, the prompt template for emotion recognition is as follows:

[0047] {"input": Now you are an expert in sentiment and emotion analysis. The following recorded conversation between "######" involves multiple speakers. ###U{u1,u2...u i-1}###Please select from <happy, sad, neutral i Emotional tags: angry, excited, frustrated> ","target": "e i ”}.

[0048] Here U represents the historical dialogue of the current utterance, including utterance i-1. i Represents the current discourse. i Represents u i The speaker's emotion label.

[0049] The loss function for emotion recognition is as follows:

[0050]

[0051] Here input i Represents the prompt for emotion recognition in the conversation. i is the sentiment label of the current utterance. n represents the number of utterances in the conversation.

[0052] Step 203: determine the target digital human template selected by the user in the request message.

[0053] In this embodiment, when the user chooses to build a digital human business card, the digital human building system will push a variety of digital human templates of different styles to the user, such as business, entertainment, and education. In other preferred embodiments, the styles of digital human business cards are multi-level, the first level includes cartoon style, realistic style, and hyper-realistic style, and each first level style includes business, entertainment, and education.

[0054] Step 204: driving the action of the digital human in the target digital human template according to the emotion parameter.

[0055] In this embodiment, the face of the user is matched with the preset digital human template to exchange the face, and the torso is generally not adjusted, or a preset fine adjustment is performed. In this case, for each style type of digital human business card, an action database with emotional tags is pre-established. When the user determines the digital human template of the target style type in the process of building the digital human business card, the above-mentioned execution subject calls the corresponding action database to match the emotional parameters and determine the digital human action in the digital human template of the target style type, so that the torso of the digital human can cooperate when the digital human plays the voice information.

[0056] Step 205: Generate a digital human video using the digital human action, so as to use the digital human video to construct a digital human business card.

[0057] In this embodiment, when constructing a digital human business card, the above-mentioned execution subject uses the digital human to interpret sounds, expressions and movements and generate videos, thereby improving the display effect of the digital human in the digital human business card.

[0058] Therefore, the method provided in the above embodiment of the present application, in the process of the user building a digital human business card, drives the digital human to act through voice information, which greatly improves the display effect of the digital human business card. The embodiment of the present application combines the process of selecting a digital human template in the process of building a digital human business card, and only needs to identify the emotional parameters in the voice information, and then the digital human can be driven by matching the actions in the action database, without the need to generate the digital human actions in real time, which greatly reduces the computing pressure and improves the efficiency of generating digital human business cards.

[0059] Continue to see Figure 3 , Figure 3 FIG. 1 is a schematic diagram of an application scenario of the method for constructing a digital human business card according to this embodiment. Figure 3In the application scenario of , after receiving the request message sent by the user, the execution subject 301 identifies the voice information 303 in the request message 302 and the target digital human template selected by the user, and sends the voice information 303 to the emotion recognition model 304 for processing to obtain the emotion parameter 305. Then, the body of the digital human in the target digital human template is driven to move according to the emotion parameter 305. Finally, the digital human action and other driving factors of the digital human (such as expression, lip synchronization parameters and voice information, etc.) are jointly driven to generate a digital human video, and the digital human business card is used to construct a digital human business card.

[0060] Further references Figure 4 , which shows a process 400 of another embodiment of a method for constructing a digital person business card. The process 400 includes the following steps:

[0061] Step 401, determining the body movement according to the emotion parameter;

[0062] In this embodiment, the method for constructing a digital person business card runs on an execution subject (eg Figure 1 The server or terminal device shown in the figure can match the preset action database according to the emotion parameters. The action database is further divided into a body action database and a gesture action database. When determining the body action database, matching is performed through the emotion parameters.

[0063] Step 402: determine the gesture action according to the semantics in the voice information.

[0064] In some preferred embodiments, the execution subject determines the gesture action according to the semantics in the voice information, including: identifying whether the voice information contains preset keywords, the preset keywords at least include some network social hot words or numbers, such as "heart", "666" and "like", etc. For example, when the execution subject recognizes that the voice information contains "666", the digital human will make a gesture of the number 6 accordingly.

[0065] Step 403: Use the body movements and the hand gestures to drive the movements of the digital human in the target digital human template.

[0066] Specifically, the execution subject drives the digital human movement in the target digital human template by using the body movements and the gesture movements, including: smoothing two adjacent movements among the plurality of body movements; and driving the digital human movement by using the smoothed body movements and the gesture movements.

[0067] In some examples, the execution subject may perform smoothing by: determining a default position of two adjacent limb movements; connecting a plurality of preset movements according to the default position to obtain an action coefficient, and smoothing the two adjacent limb movements through the action coefficient.

[0068] In other examples, the above-mentioned execution entity smoothes two adjacent limb movements among the multiple limb movements, including: determining the skeleton information corresponding to each limb movement, the skeleton information including the spatial position and distance relationship; fusing the two adjacent limb movements using alignment and spherical linear interpolation for smoothing.

[0069] Further references Figure 5 As an implementation of the methods shown in the above figures, the present application provides an embodiment of a device for constructing a digital person business card. Figure 2 Corresponding to the method embodiment shown in FIG. 1 , in addition to the features described below, the device embodiment may also include Figure 2 The device can be applied to various electronic devices.

[0070] like Figure 5 As shown, the device 500 for constructing a digital human business card in this embodiment includes: a first unit 501, a second unit 502, a third unit 503, a fourth unit 504 and a fifth unit 505. The first unit 501 is used to receive a request message for constructing a digital human business card sent by a user; the second unit 502 is used to send the voice information in the request information to the emotion recognition model for processing to obtain emotion parameters; the third unit 503 is used to determine the target digital human template selected by the user in the request message; the fourth unit 504 is used to drive the digital human action in the target digital human template according to the emotion parameters; the fifth unit 505 is used to generate a digital human video using the digital human action, so as to use the digital human video to construct a digital human business card.

[0071] In this embodiment, the specific processing of the first unit 501, the second unit 502, the third unit 503, the fourth unit 504 and the fifth unit 505 of the device 500 for constructing a digital person business card and the technical effects thereof can be referred to in Figure 2 The relevant descriptions of step 201, step 202, step 203, step 204 and step 205 in the corresponding embodiment are not repeated here.

[0072] In some optional implementations of this embodiment, the digital human action includes body movements and gesture movements, and the fourth unit 504 is further used to determine the body movements according to the emotional parameters; determine the gesture movements according to the semantics in the voice information; and use the body movements and the gesture movements to drive the digital human actions in the target digital human template.

[0073] In some optional implementations of this embodiment, the fourth unit 504 is further used to identify whether the voice information contains preset keywords, where the preset keywords at least include numbers; and match corresponding gesture actions according to the preset keywords.

[0074] In some optional implementations of this embodiment, the fourth unit 504 is further used to smooth two adjacent limb movements among the multiple limb movements; and use the smoothed limb movements and the gesture movements to drive the digital human movements.

[0075] In some optional implementations of this embodiment, the fourth unit 504 is further used to determine a default position of two adjacent limb movements; and connect a plurality of the preset movements according to the default position to obtain a movement coefficient.

[0076] In some optional implementations of this embodiment, the fourth unit 504 is further used to determine the skeleton information corresponding to each limb movement, and the skeleton information includes the spatial position and distance relationship; two adjacent limb movements are fused using alignment and spherical linear interpolation for smoothing.

[0077] In some optional implementations of the present embodiment, the second unit 502 is also used to train the emotion recognition model, and the training method includes: determining a common sense task template; generating common sense training data based on the common sense task template through a large language model under the constraints of a preset data set; determining an emotion task template; generating emotion training data based on the common sense task template through a large language model under the constraints of a preset data set; and training the initial model based on the common sense training data and the emotion training data, respectively, to obtain the emotion recognition model.

[0078] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0079] like Figure 6, is a block diagram of an electronic device for constructing a method for a digital business card according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0080] like Figure 6 As shown, the electronic device includes: one or more processors 601, a memory 602, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 6 A processor 601 is taken as an example.

[0081] The memory 602 is a non-transient computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable at least one processor to execute the method for constructing a digital person business card provided in the present application. The non-transient computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to execute the method for constructing a digital person business card provided in the present application.

[0082] The memory 602 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as the program instructions / modules corresponding to the method for constructing a digital person business card in the embodiment of the present application (for example, the attached Figure 5 The processor 601 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 602, that is, the method of building a digital human business card in the above method embodiment is realized.

[0083] The memory 602 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created according to the use of the electronic device for constructing a digital person business card, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 602 may optionally include a memory remotely arranged relative to the processor 601, and these remote memories may be connected to the electronic device for constructing a digital person business card via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0084] The electronic device of the method for constructing a digital business card may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected via a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0085] The input device 603 can receive input digital or character information, and generate key signal input related to user settings and function control of the electronic device for constructing the digital business card, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator rod, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 604 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0086] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0087] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0088] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0089] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0090] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0091] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0092] The units involved in the embodiments described in the present application may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes a first unit, a second unit, a third unit, a fourth unit, and a fifth unit. The names of these units do not constitute a limitation on the units themselves in some cases. For example, the first unit may also be described as a "unit for receiving a request message sent by a user to build a digital person business card."

[0093] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the device, the device: receives a request message sent by a user to build a digital human business card; sends the voice information in the request information to the emotion recognition model for processing to obtain emotion parameters; determines the target digital human template selected by the user in the request message; drives the digital human action in the target digital human template according to the emotion parameters; generates a digital human video using the digital human action, so as to use the digital human video to build a digital human business card.

[0094] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A method for constructing a digital person business card, characterized in that: The method comprises: Receiving a request message for building a digital human business card sent by a user; Sending the voice information in the request information to the emotion recognition model for processing to obtain emotion parameters; Determine the target digital human template selected by the user in the request message; Driving the action of the digital human in the target digital human template according to the emotion parameter; The digital human action is used to generate a digital human video, so as to use the digital human video to construct a digital human business card.

2. The method according to claim 1, characterized in that The digital human actions include body movements and gestures, and driving the digital human actions in the target digital human template according to the emotional parameters includes: determining the body movement according to the emotion parameter; Determine a gesture action according to the semantics in the voice information; The body movements and the hand gestures are used to drive the digital human movements in the target digital human template.

3. The method according to claim 2, characterized in that Determining a gesture action according to the semantics in the voice information includes: Identify whether the voice information contains preset keywords, where the preset keywords at least include numbers; The corresponding gesture action is matched according to the preset keyword.

4. The method according to claim 2, characterized in that: Using the body movements and the gesture movements to drive the digital human movements in the target digital human template includes: performing smoothing processing on two adjacent limb movements among the plurality of limb movements; The smoothed body movements and the hand gestures are used to drive the movements of the digital human.

5. The method according to claim 4, characterized in that Smoothing two adjacent limb movements among the plurality of limb movements includes: Determine the default position of two adjacent limb movements; A plurality of the preset actions are connected according to the default position to obtain an action coefficient.

6. The method according to claim 4, characterized in that Smoothing two adjacent limb movements among the plurality of limb movements includes: Determine the skeleton information corresponding to each limb movement, wherein the skeleton information includes a spatial position and a distance relationship; The adjacent limb movements are blended using alignment and spherical linear interpolation for smoothing.

7. The method according to claim 1, characterized in that The training method of the emotion recognition model includes: Determine the common sense task template; Under the constraints of the preset data set, common sense training data is generated based on common sense task templates through a large language model; Determine the emotional task template; Under the constraints of the preset data set, the emotion training data is generated based on the common sense task template through the large language model; The initial model is trained based on the common sense training data and the emotion training data respectively to obtain the emotion recognition model.

8. A device for constructing a digital person business card, characterized in that: include: The first unit is used to receive a request message for building a digital human business card sent by a user; The second unit is used to send the voice information in the request information to the emotion recognition model for processing to obtain emotion parameters; The third unit is used to determine the target digital human template selected by the user in the request message; A fourth unit is used to drive the action of the digital human in the target digital human template according to the emotion parameter; The fifth unit is used to generate a digital human video using the digital human action, so as to use the digital human video to construct a digital human business card.

9. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images