Method and device for generating virtual image
Patent Information
- Application Number
- CN202380089835.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-28
- Publication Date
- 2025-08-08
AI Technical Summary
When setting up avatars, users need to choose among a variety of unrelated style parameters, resulting in high learning costs, low setting efficiency and poor user experience.
By obtaining the user's text content and historical information records, the user's personality characteristic information is determined, and an avatar is generated based on this information, reducing the user's need for style parameter selection.
It reduces the user's learning cost when setting up the virtual image, improves the setting efficiency and user experience, and makes the generated virtual image more in line with the user's expectations.
Smart Images

Figure CN120457459A_ABST
Abstract
Description
Method and device for generating virtual image Technical Field
[0001] The embodiments of the present application relate to the field of human-computer interaction, and more specifically, to a method and apparatus for generating a virtual image. Background Art
[0002] Avatars are becoming increasingly popular due to their diverse user styles and intelligent interactive services. Currently, when setting up an avatar, terminal devices offer users a variety of style parameters for customization. However, due to the numerous and often unrelated style parameters, users need to have a solid foundation in avatar configuration to achieve the desired avatar. This increases user learning curve and impacts setup efficiency and user experience.
[0003] Summary of the Invention
[0004] The present application provides a method and device for generating a virtual image, which helps to reduce the learning cost of users when setting up a virtual image, improves the efficiency of setting up the virtual image, and also helps to improve the user experience.
[0005] The method provided in this application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), and vehicles. The embodiments of this application do not impose any restrictions on the specific types of terminal devices. For example, the vehicle is a vehicle in a broad sense, which can be a means of transportation (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiments of this application do not specifically limit the type of vehicle.
[0006] In a first aspect, a method for generating a virtual image is provided, the method comprising: obtaining first text content; determining first personality characteristic information based on the first text content and a user's historical information record; and generating a virtual image corresponding to the first text content based on the first personality characteristic information.
[0007] Based on the above technical solution, a terminal device can generate an avatar based on the text content entered by the user and the user's historical information records. This allows the user's historical information records to be combined to generate an avatar that better meets the user's expectations, making it easier for the user to resonate with the avatar. Furthermore, by eliminating the need for the user to select from a large number of unrelated style parameters, the user's learning curve when setting up the avatar is reduced, the efficiency of avatar setup is improved, and the user experience is enhanced.
[0008] In some possible implementations, the first text content includes a person's name or nickname.
[0009] In some possible implementations, the user's historical information records include one or more of the following: records of the user searching for news in news applications, records of using efficiency applications (for example, work plan applications, voice-to-text applications, etc.), records of searching for movies or TV series in video applications, records of launching game applications, records of reading novels or jokes, records of searching in browsers, and records of listening to songs in music applications within the past period of time (for example, one month).
[0010] In some possible implementations, the user's history information also includes the duration and frequency of use of different applications. For example, a user who frequently uses news applications may prefer formal text formats; a user who frequently uses video applications may prefer novel text formats; and a user who frequently uses productivity applications may prefer concise and brief text formats.
[0011] In some possible implementations, a correspondence between personality characteristic information and a virtual image is stored in a terminal device, and generating a virtual image corresponding to the first text content based on the first personality characteristic information includes: generating the virtual image based on the first personality characteristic and the correspondence.
[0012] In combination with the first aspect, in certain implementations of the first aspect, determining the first personality characteristic information based on the first text content and the user's historical information record includes: when the first text content is included in the historical information record, determining, based on the first text content, text co-occurrence words corresponding to the first text content; and determining the first personality characteristic information based on the text co-occurrence words.
[0013] Based on the above technical solution, when the user's historical information record includes the first text content, the first personality trait information can be determined based on the text co-occurring words corresponding to the first text content. In this way, by extracting the text co-occurring words in the context of the first text content to determine the first personality trait information, the personality trait information of the virtual avatar can be made more consistent with the user's expectations, and the resulting virtual avatar can also be made more consistent with the user's expectations, thereby improving the user experience.
[0014] In some possible implementations, determining the first personality characteristic information based on the co-occurring words in the text includes: determining the first personality characteristic information corresponding to the first text content based on text similarities between the co-occurring words in the text and words related to different personality dimensions.
[0015] In combination with the first aspect, in certain implementations of the first aspect, determining the first personality characteristic information based on the first text content and the user's historical information record includes: when the first text content is not included in the historical information record, determining the similarity between the first text content and each of one or more names in the historical information record; and determining the first personality characteristic information based on the similarity of each name and the personality characteristic information corresponding to each name.
[0016] Based on the above technical solution, even if the first text content is not included in the historical information record, the personality characteristic information corresponding to the first text content can be obtained by calculating the similarity with each name in the historical information record. In this way, by combining the names of people in the historical information record that are similar to the first text content, the personality characteristic information of the virtual avatar can be made more consistent with the user's expectations, and the resulting virtual avatar can also be more consistent with the user's expectations, which helps to improve the user experience.
[0017] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when detecting that the user issues a voice instruction or a text input instruction, controlling the virtual image to make a voice reply or a text reply through a second text content, and the second text content is determined by the historical information record.
[0018] Based on the above technical solution, during the process of dialogue or text interaction with the virtual image, by controlling the virtual image to use the content in the historical information record to replace the conventional response method, the user can be given a more appropriate virtual image experience.
[0019] In combination with the first aspect, in certain implementations of the first aspect, generating a virtual image corresponding to the first text content based on the first personality characteristic information includes: prompting a user with multiple personality characteristic information based on the first text content and the historical information record; and determining the first personality characteristic information from the multiple personality characteristic information based on user input of the multiple personality characteristic information.
[0020] Based on the above technical solution, by prompting users with multiple personality feature information, users can participate in the generation process of the virtual image, and the virtual image can be more in line with the user's expectations, which helps to improve the user experience.
[0021] In combination with the first aspect, in certain implementations of the first aspect, generating a virtual image corresponding to the first text content based on the first personality characteristic information includes: determining first style characteristic information based on the first personality characteristic information; and generating the virtual image based on the first style characteristic information.
[0022] In some possible implementations, a correspondence between personality feature information and style feature information is stored in a terminal device, and determining the first style feature information based on the first personality feature information includes: determining the first style feature information based on the first personality feature information and the correspondence.
[0023] Based on the above technical solution, by storing the correspondence between personality and style information in the terminal device, after determining the personality information, the style information required for generating an avatar can be quickly obtained and the corresponding avatar can be generated. This eliminates the need for users to select from a large number of unrelated style parameters, helping to reduce the learning cost of setting up an avatar, improve the efficiency of avatar setup, and enhance the user experience.
[0024] In combination with the first aspect, in certain implementations of the first aspect, determining the first style feature information based on the first personality feature information includes: inputting the first personality feature information into a prediction model to obtain the first style feature information; wherein the prediction model is trained by sample training data, the sample training data includes a sample name, sample personality feature information, and sample style feature information, and the sample style feature information includes at least one of an avatar, body shape, timbre, speaking speed, intonation, and expression corresponding to the sample name.
[0025] Based on the above technical solution, the prediction model is trained using sample names, sample personality feature information, and sample style feature information corresponding to the sample names. This allows the prediction model to include different style feature dimensions with names as alignment labels, which helps ensure the personality consistency of multiple style parameters of the virtual image. It also allows the final virtual image to be more in line with user expectations, helping to improve the user experience.
[0026] In combination with the first aspect, in certain implementations of the first aspect, a virtual image corresponding to the first text content is generated based on the first style feature information, including: prompting the user with style feature information of one or more dimensions; and generating the virtual image based on the user's input of the style feature information of the one or more dimensions.
[0027] Based on the above technical solution, by prompting users with style feature information of one or more dimensions, users can participate in the generation process of the virtual image, and the virtual image can be more in line with the user's expectations, which helps to improve the user experience.
[0028] In some possible implementations, determining the first style feature information according to the first personality feature information includes: determining the style feature information of the one or more dimensions according to the first personality feature information.
[0029] In some possible implementations, the style feature information of one or more dimensions may be a style parameter list of one or more dimensions.
[0030] In combination with the first aspect, in some implementations of the first aspect, the one or more dimensions of style feature information include at least one of avatar information, body shape information, timbre information, speaking speed information, intonation information, and expression information.
[0031] For example, the avatar information may be an avatar list consisting of multiple avatars, the body information may be a body list consisting of multiple bodies, the timbre information may be a timbre list consisting of multiple timbres, the speaking speed information may be a speaking speed list consisting of multiple speaking speeds, the tone information may be a tone list consisting of multiple tones, and the expression information may be an expression list consisting of multiple expressions.
[0032] In combination with the first aspect, in certain implementations of the first aspect, generating a virtual image corresponding to the first text content based on the first personality characteristic information includes: prompting a user with multiple virtual images based on the first personality characteristic information; and determining a virtual image corresponding to the first text content from the multiple virtual images based on user input into the multiple virtual images.
[0033] Based on the above technical solution, by prompting users to choose from multiple virtual images, users can participate in the virtual image generation process, and the virtual image can be more in line with user expectations, which helps to improve the user experience.
[0034] In a second aspect, a device for generating a virtual image is provided, the device comprising: an acquisition unit for acquiring first text content; a determination unit for determining first personality characteristic information based on the first text content and a user's historical information record; and a virtual image generation unit for generating a virtual image corresponding to the first text content based on the first personality characteristic information.
[0035] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is used to: when the first text content is included in the historical information record, determine, based on the first text content, text co-occurrence words corresponding to the first text content; and determine the first personality characteristic information based on the text co-occurrence words.
[0036] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is used to: when the first text content is not included in the historical information record, determine the similarity between the first text content and each of the one or more names in the historical information record; and determine the first personality characteristic information based on the similarity of each name and the personality characteristic information corresponding to each name.
[0037] In combination with the second aspect, in certain implementations of the second aspect, the device further includes a detection unit and a control unit, the detection unit being used to detect whether the user issues a voice command or a text input command; the control unit being used to control the virtual image to make a voice reply or a text reply through a second text content, and the second text content is determined by the historical information record.
[0038] In combination with the second aspect, in certain implementations of the second aspect, the device further includes: a first prompting unit, configured to prompt a user with multiple personality characteristic information based on the first text content and the historical information record; and a determining unit, configured to determine the first personality characteristic information from the multiple personality characteristic information based on user input of the multiple personality characteristic information.
[0039] In combination with the second aspect, in some implementations of the second aspect, the determination unit is further used to determine first style feature information based on the first personality feature information; and the virtual image generation unit is used to generate the virtual image based on the first style feature information.
[0040] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is used to: input the first personality characteristic information into a prediction model to obtain the first style characteristic information; wherein the prediction model is trained by sample training data, the sample training data includes a sample name, sample personality characteristic information, and sample style characteristic information, and the sample style characteristic information includes at least one of the head image, body shape, timbre, speaking speed, tone, and expression corresponding to the sample name.
[0041] In combination with the second aspect, in some implementations of the second aspect, the device also includes: a second prompt unit, used to prompt the user with style feature information of one or more dimensions; and the virtual image generation unit, used to generate the virtual image based on the user's input of the style feature information of the one or more dimensions.
[0042] In combination with the second aspect, in some implementations of the second aspect, the one or more dimensions of style feature information include at least one of avatar information, body shape information, timbre information, speaking speed information, intonation information, and expression information.
[0043] In combination with the second aspect, in certain implementations of the second aspect, the device further includes: a third prompting unit, configured to prompt a user with multiple virtual images based on the first personality characteristic information; and a virtual image generating unit, configured to determine, from the multiple virtual images, a virtual image corresponding to the first text content based on the user's input to the multiple virtual images.
[0044] In a third aspect, the present application provides a device for generating a virtual image, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to perform any possible method in the first aspect.
[0045] In a fourth aspect, the present application provides a terminal device, which includes any possible device in the second aspect, or includes the device described in the third aspect.
[0046] In combination with the fourth aspect, in some implementations of the fourth aspect, the terminal device is a vehicle, a computer, or a mobile phone.
[0047] In a fifth aspect, the present application provides a computer program product, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any possible method in the first aspect.
[0048] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or separately packaged with the processor, and the embodiments of the present application do not specifically limit this.
[0049] In a sixth aspect, the present application provides a computer-readable medium storing a program code, which enables the computer to execute any possible method in the first aspect when the computer program code is run on the computer.
[0050] In a seventh aspect, the present application provides a chip comprising a circuit for executing any possible method in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] FIG1 is a functional block diagram of a terminal device provided in an embodiment of the present application.
[0052] FIG2 is a schematic diagram of the distribution of display screens in a vehicle cabin according to an embodiment of the present application.
[0053] FIG3 is a schematic flowchart of a method for generating a virtual image provided in an embodiment of the present application.
[0054] FIG4 is a graphic user interface GUI provided in an embodiment of the present application.
[0055] FIG5 is another set of GUIs provided in an embodiment of the present application.
[0056] FIG6 is a schematic flow chart of a method for generating a personality-style database provided in an embodiment of the present application.
[0057] FIG7 is a schematic diagram of using names of people as alignment labels for different stylistic feature dimensions provided in an embodiment of the present application.
[0058] FIG8 is another set of GUIs provided in an embodiment of the present application.
[0059] FIG9 is another set of GUIs provided in an embodiment of the present application.
[0060] FIG10 is another GUI provided by an embodiment of the present application.
[0061] FIG11 is another schematic flowchart of the method for generating a virtual image provided in an embodiment of the present application.
[0062] FIG12 is a schematic flowchart of an apparatus for generating a virtual image provided in an embodiment of the present application. DETAILED DESCRIPTION
[0063] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a way to describe the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. "At least one" means one or more. For example, "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, at least one of A and B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0064] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.
[0065] As mentioned above, avatars are increasingly popular due to their diverse styles and intelligent interactive services. Currently, when setting up an avatar, terminal devices offer users a variety of style parameters for customization. As avatars become more sophisticated, the number of style parameters increases dramatically. Due to the numerous and often unrelated style parameters, users need a solid foundation of knowledge to create an avatar that meets their expectations. This increases the learning curve and impacts both setup efficiency and user experience.
[0066] Currently, it's also possible to set up an avatar by generating an image from text. However, due to different perceptions, users may have different understandings of the same name. For example, for 10-year-old elementary school students, Name A may more likely refer to a game character; while for 50-year-olds, Name A may more likely refer to a literary or dramatic character. If a 50-year-old user enters the avatar nickname "Name A" on a terminal device, the terminal device may generate an avatar similar to "Name A" in the game, which would deviate significantly from the user's expectations and affect the user experience.
[0067] The present invention provides a method and apparatus for generating an avatar. By integrating historical user information, the method generates an avatar that better meets the user's expectations, making it easier for the user to resonate with the avatar. Furthermore, the method eliminates the need for the user to choose from a multitude of unrelated style parameters, thereby reducing the learning curve for users when setting up an avatar, improving the efficiency of avatar setup, and enhancing the user experience.
[0068] Figure 1 is a functional block diagram of a terminal device 100 provided in an embodiment of the present application. Terminal device 100 may include a text input unit 110, a display device 120, and a computing platform 130. Text input unit 110 is used to obtain text content input by a user. In an embodiment of the present application, text input unit 110 may be used to obtain a nickname (or name) for an avatar input by the user.
[0069] The computing platform 130 may include one or more processors, such as processors 131 to 13n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor may be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 130 can also include a memory for storing instructions, and some or all of the processors 131 to 13n can call the instructions in the memory and execute the instructions to implement the corresponding functions. In an embodiment of the present application, the computing platform 130 can obtain the nickname (or name) of the virtual image sent by the text input unit 110, and generate a virtual image based on the nickname (or name) of the virtual image and the user's historical information record.
[0070] Taking the terminal device 100 as an example, which is a vehicle, the display device 120 in the vehicle cabin is mainly divided into two categories. The first category is the vehicle-mounted display screen; the second category is a projection display screen, such as a head-up display (HUD). The vehicle-mounted display screen is a physical display screen and an important part of the vehicle infotainment system. There can be multiple display screens in the cabin, such as a digital instrument display screen, a central control screen, a display screen in front of the passenger on the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger. Even the windows can be used as display screens for display. Head-up display, also known as head-up display system. It is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as a windshield). This reduces the driver's line of sight diversion time, avoids pupil changes caused by the driver's line of sight diversion, and improves driving safety and comfort. HUDs include, for example, a combiner-HUD (C-HUD) system, a windshield-HUD (W-HUD) system, and an augmented reality HUD (AR-HUD) system. It should be understood that other types of HUDs may emerge as technology evolves, and this application does not limit this. In the embodiment of this application, when the computing platform 130 generates a virtual image, it may display the virtual image to the user via the display device 120.
[0071] The above display device 130 is described by taking a vehicle-mounted display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device 130 can also be a light display screen or a projection screen.
[0072] Figure 2 shows a schematic diagram of an exemplary display screen layout within a vehicle cabin, as provided in an embodiment of the present application. As shown in Figure 2 , the vehicle cabin may include display screen 201 (or, alternatively, a central control screen), display screen 202 (or, alternatively, a passenger entertainment screen), display screen 203 (or, alternatively, a second-row left entertainment screen), display screen 204 (or, alternatively, a second-row right entertainment screen), and an instrument panel.
[0073] FIG3 shows a schematic flow chart of a method 300 for generating a virtual image according to an embodiment of the present application. The method 300 may be executed by the terminal device 100, or by the computing platform 130, or by a system on a chip (SoC) in the computing platform 130, or by a processor in the computing platform 130. The following description will be based on an example of the method 300 being executed by a terminal device. As shown in FIG3 , the method 300 includes:
[0074] S310: Obtain first text content.
[0075] For example, the first text content may be the name, given name, or nickname of the virtual image. For example, the first text content may be the aforementioned "Name A".
[0076] Taking the terminal device as a vehicle as an example, Figure 4 illustrates a graphical user interface (GUI) provided by an embodiment of the present application. The GUI is an avatar generation interface displayed on display screen 201. The avatar generation interface includes a text input box 401, a create avatar control 402, and a cancel control 403. Upon detecting that a user enters "Name A" in text input box 401 and clicks on create avatar control 402, the terminal device can retrieve the first text content, "Name A."
[0077] FIG4 illustrates an example of a GUI displayed on a display screen 201 in a vehicle, but the present invention is not limited thereto. For example, the GUI may also be a display interface for generating a game character displayed on a mobile phone or computer, or a display interface of an interactive robot.
[0078] S320: Determine first personality characteristic information based on the first text content and the user's historical information record.
[0079] In one embodiment, the historical information record of the user includes a record of the user using the terminal device in the past period of time.
[0080] Exemplarily, the user's historical information records may include one or more of the following: records of the user searching for news in news applications, records of using efficiency applications (for example, applications for specifying work plans, voice-to-text applications, etc.), records of searching for movies or TV series in video applications, records of launching game applications, records of reading novels or jokes, records of searching in browsers, and records of listening to songs in music applications within the past period of time (for example, one month).
[0081] For example, the user's historical information record may include the usage duration and frequency of different applications. For example, a user who frequently uses news applications may prefer formal text formats; a user who frequently uses video applications may prefer novel text formats; and a user who frequently uses productivity applications may prefer concise and brief text formats.
[0082] In one embodiment, the user's historical information record can be stored locally on the terminal device, or it can also be stored on another device (e.g., a cloud server). If the user's historical information record is stored on the cloud server, upon obtaining the first text content, the terminal device can request the user's historical information record from the cloud server. The terminal device can then determine the first personality trait information based on the first text content and the historical information record.
[0083] For example, the first text content is "Name A", and the user's historical information records include a record of launching a game application and using a game character named "Name A" in the game application. The terminal device can determine the personality characteristic information of the game character named "Name A" as the first personality characteristic information corresponding to the first text content.
[0084] Optionally, determining the first personality characteristic information based on the first text content and the user's historical information record includes: when the first text content is included in the historical information record, determining text co-occurrence words corresponding to the first text content based on the first text content; and determining the first personality characteristic information based on the text co-occurrence words.
[0085] For example, taking the first text content as "Hua Mulan" as an example, upon obtaining the first text content, the terminal device may search the user's historical information records. For example, the terminal device may determine that the user has searched for "Mulan" twice through the browser in the past period of time and clicked on search results related to literary characters in the search history. For example, the information in the search results is as follows:
[0086] "Mulan is both a remarkable woman and an ordinary person, a national hero and a common girl, a nimble warrior and a beautiful daughter. She is hardworking, kind, resolute and brave, honest and simple, smart and lively, loves her family and serves her motherland, does not covet high positions and generous salaries but loves a peaceful life."
[0087] Through the named entity analysis method or the term analysis method, the relevant adjectives that co-occur with the name "Mulan" such as "strange", "ordinary", "agile", "beautiful", "hardworking and kind", "resolute and brave", "mellow and simple" and "alert and lively" can be extracted. These words can be used as text co-occurrence words corresponding to the name "Mulan".
[0088] Optionally, determining the first personality characteristic information based on the text co-occurring words includes: determining the first personality characteristic information corresponding to the first text content based on text similarities between the text co-occurring words and words related to different personality dimensions.
[0089] For example, we can use the embedding layer of the bidirectional encoder representation from transformers (BERT) model to extract word vectors for different words, or we can use the word2Vec bag-of-words model to extract word vectors. The following uses the embedding layer to extract word vectors as an example.
[0090] If the text co-occurrence words of name A include word A and the word vector of word A is V A =(a1,a2…,a i ,…,a N ), V A Represents word A in word vector V A Mathematical representation in space; the words related to different personality dimensions include the calibration word B and the word vector of the calibration word B is V B =(b1,b2…,b i ,…,b N ), V B Represents word B in word vector V B Mathematical representation in space. The more similar the meanings of word A and word B are, the closer the vector directions in the word vector space are. For example, the similarity between word A and the calibration word B can be calculated as shown in formula (1):
[0091] Among them, Similarity AB is the similarity between word A and the labeled word B.
[0092] Similarly, the similarity between word A and each word in other personality dimension related words can be calculated, as well as the similarity between other text co-occurring words other than word A and words related to different personality dimensions. The calculation method of the personality characteristic parameters of the name A can be shown in formula (2):
[0093] Among them, n is the number of similarities calculated between the co-occurring words and the labeled words, V 人名A is the personality characteristic parameter of the person named A, or V 人名A It can be used as characteristic information of the name A in this personality dimension.
[0094] For example, the above-mentioned words related to different personality dimensions can be taken from the Big Five personality dimension table. Table 1 shows a Big Five personality dimension table.
[0095] Table 1 Big Five personality dimensions
[0096] For example, the related calibrated words for different personality dimensions may include "extrovert", "talkative", "quiet", "shy", "introvert", "confident", "dominant", etc.
[0097] Optionally, determining the first personality characteristic information based on the first text content and the user's historical information record includes: when the first text content is not included in the historical information record, determining the similarity between the first text content and each of one or more names in the historical information record; and determining the first personality characteristic information based on the similarity of each name and the personality characteristic information corresponding to each name.
[0098] When the historical information record does not include the first text content, the terminal device cannot extract the text co-occurrence related to the first text content. In this case, the terminal device can determine the first personality characteristic information by combining the names of people similar to the first text content in the historical information record.
[0099] In one embodiment, when the historical information record does not include the first text content, the first personality characteristic information corresponding to the first text content can be determined by the following formula (3):
[0100] Among them, V 第一文本内容 is the first personality characteristic information, Similarity i is the similarity between the first text content and each person’s name in the historical information record, V i is the personality characteristic parameter of each name, and N is the number of names in the historical information record.
[0101] For example, the first text content is "Hua Tielan", and "Hua Tielan" does not appear in the historical information record. Instead, it includes names similar to "Hua Tielan", such as "Hua Mulan", "Hua Rong", "Hua Wuque" and "Temujin". The terminal device can calculate the similarity between "Hua Tielan" and the names that appeared in the historical information record. The similarity of the names can be calculated using the Embedding word vector to calculate the cosine similarity, and the similarity is used as the weight. For example, Table 2 shows the calculated similarity between "Hua Tielan" and the names that appeared in the historical information record.
[0102] Table 2
[0103] For example, the personality characteristic parameter of “Tillandia” can be calculated by the following formula (4): V 花铁兰 =Similarity1*V 花木兰 +Similarity2*V 花荣 +Similarity3*V 花无缺+Similarity4*V 铁木真 (4)
[0104] Among them, V 花铁兰 is the personality characteristic parameter of “Tillandia” (V 花铁兰 can be the personality characteristic information corresponding to "flower iron orchid"), V 花木兰 is the personality characteristic parameter of "Mulan", V 花荣 is the personality characteristic parameter of "Hua Rong", V 花无缺 is the personality characteristic parameter of "Hua Wu Que", V 铁木真 are the personality characteristic parameters of "Temujin", Similarity1 is the similarity between "Hua Tielan" and "Hua Mulan" (for example, 0.4), Similarity2 is the similarity between "Hua Tielan" and "Hua Rong" (for example, 0.2), Similarity3 is the similarity between "Hua Tielan" and "Hua Wuque" (for example, 0.2), and Similarity4 is the similarity between "Hua Tielan" and "Temujin" (for example, 0.2).
[0105] Above V 花木兰 、V 花荣 、V 花无缺 、V 铁木真 The calculation process of can refer to the calculation process of the personality characteristic parameters of name A in the above formula (2), which will not be repeated here.
[0106] The above personality trait parameters can be a specific representation of the above personality trait information, and the embodiments of the present application are not limited thereto. For example, the personality trait information can also be text content describing personality traits (for example, "extrovert", "talkative", "introvert", etc.).
[0107] S330: Generate a virtual image corresponding to the first text content based on the first personality characteristic information.
[0108] In one embodiment, the terminal device may store a correspondence between personality characteristic information and a virtual image, and generate a virtual image corresponding to the first text content according to the first personality characteristic information, including: generating the virtual image according to the personality characteristic information and the correspondence.
[0109] For example, Table 3 shows a correspondence between personality characteristic information and a virtual image.
[0110] Table 3
[0111] For example, the first text content is "Name A". Based on "Name A" and the user's historical information records, it is determined that the personality characteristics corresponding to Name A are extroversion and confidence. Based on the corresponding relationship shown in Table 3 above, a virtual image 1 corresponding to "Name A" can be generated.
[0112] Optionally, determining the first personality characteristic information based on the first text content and the user's historical information records includes: prompting the user with multiple personality characteristic information based on the first text content and the historical information records; and determining the first personality characteristic information from the multiple personality characteristic information based on user input of the multiple personality characteristic information.
[0113] FIG5 shows another GUI provided by an embodiment of the present application.
[0114] As shown in (a) of FIG5 , when the vehicle detects a user clicking control 402, it can determine the personality trait information corresponding to "Person A" based on "Person A" and the user's historical information records, where the historical information records indicate that the user has launched Game 1 and used the character corresponding to "Person A," launched a browser and browsed search records related to "Person A," and searched for songs related to "Person A" through a music application within the past week. Based on the above historical information records, the vehicle can display multiple personality trait information corresponding to "Person A" (e.g., personality trait information 501-503) and the controls corresponding to each personality trait information through the GUI. For example, personality trait information 501 corresponding to "Person A" in Game 1 is "extroverted, talkative, and assertive," personality trait information 502 corresponding to "Person A" in the browser's search records is "modest, courteous, and magnanimous," and personality trait information 503 corresponding to "Person A" in the music application is "rude and suspicious."
[0115] As shown in (b) of Figure 5, when it is detected that the user clicks the control 504 corresponding to the personality feature information 501 and clicks the confirmation control 505, the vehicle can control the display screen to display the generated virtual image and control the virtual image to send a voice signal "Hello, I am your virtual image Xiao A".
[0116] The above description uses the example of a user inputting multiple personality traits by clicking on a control on a display screen, but the present embodiments are not limited to this. For example, after viewing personality traits 501-503, the user can also issue a voice command "extrovert, talkative, and assertive." After receiving this voice command, the vehicle can determine that the personality traits selected by the user are "extrovert, talkative, and assertive" based on the user's voice command and generate a corresponding avatar based on this personality trait.
[0117] Optionally, generating a virtual image corresponding to the first text content according to the first personality characteristic information includes: determining first style characteristic information according to the first personality characteristic information; and generating the virtual image according to the first style characteristic information.
[0118] Optionally, the terminal device stores a correspondence between personality feature information and style feature information, and determining the first style feature information according to the first personality feature information includes: determining the first style feature information according to the first personality feature information and the correspondence.
[0119] For example, style feature information can be divided into different categories. Table 4 shows a classification method of style feature information.
[0120] Table 4
[0121] For example, Table 5 shows a correspondence between personality feature information and style feature information.
[0122] Table 5
[0123] For example, when the first personality characteristic information is determined to be extroverted and confident based on the first text content and the user's historical information records, the style characteristic information of the virtual image can be determined to be facial features 1, body shape 1, clothing 1, timbre 1, speaking speed 1, intonation 1, rhythm 1, response content 1, expression 1, gesture 1 and posture 1 based on the correspondence shown in Table 5 above, so that a corresponding virtual image can be generated based on the style characteristic information.
[0124] Optionally, determining the first style characteristic information based on the first personality characteristic information includes: inputting the first personality characteristic information into a prediction model to obtain the first style characteristic information; wherein the prediction model is trained by sample training data, the sample training data includes a sample name, sample personality characteristic information, and sample style characteristic information, and the sample style characteristic information includes at least one of the head image, body shape, timbre, speaking speed, tone, and expression corresponding to the sample name.
[0125] The above embodiment introduces the process of obtaining the personality characteristic parameters of a person's name through the text co-occurrence words of the name. Similarly, the style characteristics of other dimensions associated with the name can be used to label the personality characteristics of the name. For example, the word vector of "Name A" and the personality characteristic parameters corresponding to the name are concatenated as input, and the physical and sound characteristics of "Name A" in "Movie 1" are used as labels to train the prediction model. Ultimately, data of multiple style characteristic dimensions with personality characteristic parameters as labels can be obtained. This type of data of multiple style characteristic dimensions can be used to obtain different style templates based on the style transfer method and stored in the prediction model.
[0126] The above prediction model can also be understood as a personality-style database.
[0127] FIG6 shows a schematic flow chart of a method 600 for generating a personality-style database according to an embodiment of the present application. The method 600 may be executed by a device (e.g., a cloud server) including a model training device. The method 600 includes:
[0128] S610: Determine personality characteristic parameters of person A.
[0129] For example, when "Name A" appears in a user's historical information records, the personality characteristic parameters of "Name A" can be calculated according to the above formula (2). The personality characteristic parameters of "Name A" appearing in different categories of historical information records may be different. For example, Table 6 shows the correspondence between the text co-occurrence words and personality characteristic parameters of "Name A" appearing in different categories of historical information records.
[0130] Table 6
[0131] S620 , using the name A as an alignment label for different style feature dimensions, generating different parameter templates through style transfer, and filling them into the personality-style database.
[0132] For example, FIG7 shows a schematic diagram of an embodiment of the present application using names as alignment labels for different style feature dimensions. As shown in FIG7 , the avatar features of person A in "Movie 1" include avatar 1 and avatar 2, and the avatar features in "Game 1" include avatar 3 and avatar 4. The voice features of person A in "Movie 1" include voice feature 1, and the voice features in "Game 1" are voice feature 2. An association relationship can be established between person A, personality feature parameter 1, avatar 1, avatar 2, and voice feature 1, and an association relationship can be established between person A, personality feature parameter 2, avatar 3, avatar 4, and voice feature 2.
[0133] Optionally, generating a virtual image corresponding to the first text content based on the first style feature information includes: prompting the user with style feature information of one or more dimensions; and generating the virtual image based on the user's input of the style feature information of the one or more dimensions.
[0134] 8 , description will be given below by taking as an example the case where the style feature information of one or more dimensions is a style parameter list of one or more dimensions.
[0135] FIG8 shows another set of GUIs provided by an embodiment of the present application.
[0136] As shown in (a) of FIG8 , upon detecting a user click on control 402, the vehicle can determine the personality profile information corresponding to "Person A" based on "Person A" and the user's historical information records, where the user's historical information records indicate that the user frequently opened Game 1 and used the character corresponding to "Person A" within the past week. Based on the personality profile information corresponding to "Person A," the vehicle can determine a list of one or more style parameters corresponding to "Person A." The list of one or more parameters includes an avatar list, a timbre list, and a voice tone list. The avatar list includes avatars 3 and 4. The voice tone list includes voice 1 and voice 2, where the timbre of voice 1 corresponds to one timbre of the game character "Person A," and the timbre of voice 2 corresponds to another timbre of the game character "Person A." The voice tone list includes voice 3 and voice 4, where the tone of voice 3 corresponds to one timbre of the game character "Person A," and the tone of voice 4 corresponds to another timbre of the game character "Person A." Users can select their favorite style features from a list of style parameters in different dimensions.
[0137] As shown in (b) in Figure 8, when it is detected that the user has selected avatar 3, voice 1 and voice 3 and clicked the control 801, the vehicle can generate a virtual image 1 based on the avatar 3, the timbre corresponding to voice 1 and the tone corresponding to voice 3 and display the virtual image 1 through the display screen. The avatar of the virtual image 1 is avatar 3 and the timbre and tone of the voice signal "Hello, I am your virtual image Xiao A" emitted by the virtual image 1 match the timbre in the above-mentioned voice 1 and the tone in voice 3 respectively.
[0138] FIG8 illustrates the example of allowing the user to manually select style parameters of different dimensions, but the embodiments of the present application are not limited thereto. For example, the terminal device can automatically select the style parameter with the highest recommendation from a list of style parameters of different dimensions as the style characteristic parameter of the avatar, thereby automatically generating the corresponding avatar. For another example, the terminal device can automatically randomly select a style parameter from a list of style parameters of different dimensions as the style characteristic parameter of the avatar, thereby automatically generating the corresponding avatar. This avoids the process of requiring the user to select the style parameters of the avatar, which helps to improve the user experience.
[0139] Optionally, the method 300 further includes: when it is detected that the user issues a voice instruction or a text input instruction, controlling the virtual image to make a voice reply or a text reply through a second text content, where the second text content is determined by the historical information record.
[0140] FIG9 shows another set of GUIs provided by an embodiment of the present application.
[0141] As shown in FIG9 (a), taking the terminal device as a vehicle as an example, after generating the virtual image 1, the user can perform voice interaction with the virtual image 1. For example, the vehicle can detect the user's voice command "open the window".
[0142] As shown in Figure 9(b), upon detecting a user's voice command, the vehicle can control avatar 1 to respond to the user using dialogue from "Game 1." For example, the dialogue for character "Name A" in "Game 1" includes "Let me show you advanced maneuvers." The vehicle can then control the avatar to issue the voice signal "Let me show you advanced maneuvers" in response to the user's voice command. This approach, using dialogue instead of conventional responses during a conversation, provides the user with a more engaging avatar experience.
[0143] Optionally, generating a virtual image corresponding to the first text content based on the first personality characteristic information includes: prompting a plurality of virtual images to the user based on the first personality characteristic information; and determining a virtual image corresponding to the first text content from the plurality of virtual images based on user input of the plurality of virtual images.
[0144] Optionally, prompting the user with multiple virtual images based on the first personality characteristic information includes: determining first style characteristic information based on the first personality characteristic information; and prompting the user with multiple virtual images based on the first style characteristic information.
[0145] Figure 10 shows another GUI provided by an embodiment of the present application. Based on the personality characteristics of "Person A," the vehicle can control the central control screen to display avatar 1001 and avatar 1002 corresponding to "Person A." Alternatively, based on the personality characteristics of "Person A," the vehicle can determine style characteristics corresponding to "Person A" and control the central control screen to display avatar 1001 and avatar 1002 corresponding to "Person A" based on this style characteristics. Upon detecting a user selecting an operation corresponding to avatar 1001, avatar 1001 can be determined as the avatar the user wishes to generate.
[0146] The above description uses the example of determining the virtual image corresponding to the first text from among the multiple virtual images after detecting that the user has clicked on one of the multiple virtual images. Embodiments of the present application are not limited to this. For example, the user may also issue a voice command to "select the leftmost virtual image." Upon detecting the user's voice command, the vehicle may determine, based on the voice command, that the virtual image corresponding to "Name A" that the user wishes to generate is virtual image 1001.
[0147] FIG11 shows a schematic flow chart of a method 1100 for generating a virtual image according to an embodiment of the present application. The method 1100 may be executed by the terminal device 100, or by the computing platform 130, or by a SoC in the computing platform 130, or by a processor in the computing platform 130. The following description will be based on an example of the method 1100 being executed by a terminal device. As shown in FIG11 , the method 1100 includes:
[0148] S1110, obtaining the name input by the user.
[0149] For example, as shown in FIG4 , when detecting that the user inputs “Name A” in the text input box 401 and clicks on the operation of generating a virtual image control 402 , the terminal device can obtain the information of “Name A”.
[0150] S1120: Determine personality characteristic parameters corresponding to the name based on the name and the user's historical information record.
[0151] Optionally, determining the personality characteristic parameters corresponding to the name based on the name and the user's historical information record includes: when the name is included in the user's historical information record, determining the personality characteristic parameters corresponding to the name based on text co-occurrence words of the name.
[0152] For example, the personality characteristic parameter can be calculated by the above formula (2). The personality characteristic parameter can be represented in the form of a vector.
[0153] Optionally, determining the personality characteristic parameters corresponding to the name based on the name and the user's historical information record includes: when the name is not included in the user's historical information record, determining the similarity between the name and each of one or more names in the historical information record; and determining the personality characteristic parameters of the name based on the similarity of each name and the personality characteristic parameters corresponding to each name.
[0154] It should be understood that the implementation process of S1120 can refer to the implementation process of S320 mentioned above, and will not be repeated here.
[0155] S1130: Determine style characteristic parameters corresponding to the name based on the personality characteristic parameters.
[0156] Exemplarily, the personality characteristic parameters may be input into the above-mentioned prediction model (or personality-style database) to obtain the style characteristic parameters corresponding to the name.
[0157] For the description of the prediction model, reference may be made to the description of the above embodiment, which will not be repeated here.
[0158] S1140: Generate a virtual image corresponding to the name based on the style feature parameters.
[0159] In the embodiment of the present application, the terminal device can generate a virtual image based on the name entered by the user and the user's historical information record. In this way, the user's historical information record can be used to generate a virtual image that better meets the user's expectations, and the user can resonate with the virtual image, which helps to improve the user's experience.
[0160] Figure 12 shows a schematic block diagram of an apparatus 1200 for generating a virtual avatar according to an embodiment of the present application. As shown in Figure 12, apparatus 1200 includes: an acquisition unit 1210 for acquiring first text content; a determination unit 1220 for determining first personality characteristics based on the first text content and a user's historical information records; and a virtual avatar generation unit 1230 for generating a virtual avatar corresponding to the first text content based on the first personality characteristics.
[0161] Optionally, the determining unit 1220 is configured to: when the historical information record includes the first text content, determine text co-occurrence words corresponding to the first text content based on the first text content; and determine the first personality characteristic information based on the text co-occurrence words.
[0162] Optionally, the determination unit 1220 is used to: when the first text content is not included in the historical information record, determine the similarity between the first text content and each of the one or more names in the historical information record; and determine the first personality characteristic information based on the similarity of each name and the personality characteristic information corresponding to each name.
[0163] Optionally, the device 1200 further includes a detection unit and a control unit, the detection unit being used to detect that the user issues a voice command or a text input command; the control unit being used to control the virtual image to make a voice reply or a text reply through a second text content, the second text content being determined by the historical information record.
[0164] Optionally, the device 1200 further includes: a first prompting unit, configured to prompt the user with multiple personality characteristic information based on the first text content and the historical information record; and the determining unit 1220, configured to determine the first personality characteristic information from the multiple personality characteristic information based on the user's input of the multiple personality characteristic information.
[0165] Optionally, the determining unit 1220 is further configured to determine first style characteristic information based on the first personality characteristic information; and the virtual image generating unit is configured to generate the virtual image based on the first style characteristic information.
[0166] Optionally, the determination unit 1220 is used to: input the first personality characteristic information into a prediction model to obtain the first style characteristic information; wherein the prediction model is trained by sample training data, the sample training data includes a sample name, sample personality characteristic information and sample style characteristic information, and the sample style characteristic information includes at least one of the head image, body shape, timbre, speaking speed, tone and expression corresponding to the sample name.
[0167] Optionally, the device 1200 further includes: a second prompting unit, configured to prompt the user with the style feature information of the one or more dimensions; and a virtual image generating unit 1230, configured to generate the virtual image based on the user's input of the style feature information of the one or more dimensions.
[0168] Optionally, the one or more dimensions of style feature information include at least one of avatar information, body shape information, timbre information, speaking speed information, intonation information, and expression information.
[0169] Optionally, the device 1200 further includes: a third prompting unit, configured to prompt a plurality of virtual images to the user based on the first personality characteristic information; and the virtual image generating unit 1230, configured to determine a virtual image corresponding to the first text content from the plurality of virtual images based on the user's input to the plurality of virtual images.
[0170] For example, the acquisition unit 1210 may be the computing platform or a processing circuit, processor, or controller in the computing platform in Figure 1. For example, if the acquisition unit 1210 is the processor 131 in the computing platform, the processor 131 may acquire the first text content input by the user.
[0171] For another example, determination unit 1220 is the computing platform in FIG1 or a processing circuit, processor, or controller in the computing platform. For example, if determination unit 1220 is processor 132 in the computing platform, processor 132 can determine the first personality trait information based on the first text content obtained by processor 131 and the user's historical information record.
[0172] For another example, avatar generation unit 1230 may be the computing platform in FIG1 or a processing circuit, processor, or controller in the computing platform. For example, avatar generation unit 1230 may be processor 133 in the computing platform. Processor 133 may generate an avatar corresponding to the first text content based on the first personality characteristic information determined by processor 132.
[0173] The functions implemented by the above-mentioned acquisition unit 1210, the functions implemented by the determination unit 1220 and the functions implemented by the virtual image generation unit 1230 can be implemented by different processors, or they can be implemented by the same processor, or some functions can be implemented by the same processor. The embodiments of the present application do not limit this.
[0174] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.
[0175] Each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
[0176] In addition, the various units in the above apparatus may be fully or partially integrated together, or may be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the apparatus. The at least one processor may be of different types, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.
[0177] An embodiment of the present application also provides a device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the device executes the method or steps performed by the above embodiment.
[0178] Optionally, if the apparatus is located in a terminal device, the processing unit may be the processor 131 - 13n shown in FIG1 .
[0179] An embodiment of the present application further provides a system, which includes a computing platform and a display device, wherein the computing platform may include the above-mentioned device 1200.
[0180] Illustratively, the display device may be a display screen, such as the display screens 201 - 204 described above.
[0181] An embodiment of the present application further provides a terminal device, which may include the above-mentioned apparatus 1200 or the above-mentioned system.
[0182] Exemplarily, the terminal device may be a mobile phone, a computer or a vehicle.
[0183] An embodiment of the present application further provides a computer program product, which includes: computer program code, which enables the computer to execute the method in the above embodiment when the computer program code is run on a computer.
[0184] An embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code runs on a computer, the computer executes the method in the above embodiment.
[0185] An embodiment of the present application further provides a chip, which includes a circuit, and the circuit is used to execute the method in the above embodiment.
[0186] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
[0187] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.
[0188] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0189] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0190] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0191] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0192] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0193] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0194] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0195] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be covered and fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.
Claims
1. A method for generating a virtual image, characterized in that: include: Get the first text content; Determining first personality characteristic information according to the first text content and the user's historical information record; Generate a virtual image corresponding to the first text content according to the first personality characteristic information.
2. The method according to claim 1, characterized in that The determining the first personality characteristic information according to the first text content and the historical information record of the user includes: When the first text content is included in the historical information record, determining text co-occurrence words corresponding to the first text content according to the first text content; The first personality characteristic information is determined according to the text co-occurring words.
3. The method according to claim 1, characterized in that The determining the first personality characteristic information according to the first text content and the historical information record of the user includes: When the first text content is not included in the historical information record, determining the similarity between the first text content and each of the one or more names in the historical information record; The first personality characteristic information is determined according to the similarity of each name and the personality characteristic information corresponding to each name.
4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: When it is detected that the user issues a voice command or a text input command, the virtual image is controlled to make a voice reply or a text reply through a second text content, and the second text content is determined by the historical information record.
5. The method according to any one of claims 1 to 4, characterized in that The determining the first personality characteristic information according to the first text content and the historical information record of the user includes: Prompting a user with multiple personality characteristic information based on the first text content and the historical information record; The first personality characteristic information is determined from the plurality of personality characteristic information according to the user's input of the plurality of personality characteristic information.
6. The method according to any one of claims 1 to 5, characterized in that Generating a virtual image corresponding to the first text content according to the first personality characteristic information includes: Determining first style feature information according to the first personality feature information; The virtual image is generated according to the first style feature information.
7. The method according to claim 6, characterized in that The determining the first style feature information according to the first personality feature information includes: Inputting the first personality characteristic information into a prediction model to obtain the first style characteristic information; The prediction model is trained by sample training data, and the sample training data includes sample names, sample personality feature information and sample style feature information. The sample style feature information includes at least one of the head image, body shape, timbre, speaking speed, intonation and expression corresponding to the sample name.
8. The method according to claim 6 or 7, characterized in that The step of generating the virtual image according to the first style feature information includes: Prompt the user with style feature information in one or more dimensions; The virtual image is generated according to the user's input of the style feature information of the one or more dimensions.
9. The method according to claim 8, characterized in that The one or more dimensions of style feature information include at least one of avatar information, shape information, timbre information, speaking speed information, intonation information, and expression information.
10. The method according to any one of claims 1 to 9, characterized in that Generating a virtual image corresponding to the first text content according to the first personality characteristic information includes: Prompting a plurality of virtual images to the user based on the first personality characteristic information; According to the user's input to the multiple virtual images, a virtual image corresponding to the first text content is determined from the multiple virtual images.
11. A device for generating a virtual image, characterized in that: include: An acquisition unit, used for acquiring first text content; A determination unit, configured to determine first personality characteristic information according to the first text content and the user's historical information record; A virtual image generating unit is used to generate a virtual image corresponding to the first text content according to the first personality characteristic information.
12. The device according to claim 11, characterized in that The determining unit is used for: When the first text content is included in the historical information record, determining text co-occurrence words corresponding to the first text content according to the first text content; The first personality characteristic information is determined according to the text co-occurring words.
13. The device according to claim 11, characterized in that The determining unit is used for: When the first text content is not included in the historical information record, determining the similarity between the first text content and each of the one or more names in the historical information record; The first personality characteristic information is determined according to the similarity of each name and the personality characteristic information corresponding to each name.
14. The device according to any one of claims 11 to 13, characterized in that The device also includes a detection unit and a control unit, The detection unit is used to detect that a user issues a voice command or a text input command; The control unit is used to control the virtual image to make a voice reply or a text reply through a second text content, and the second text content is determined by the historical information record.
15. The device according to any one of claims 11 to 14, characterized in that The device also includes: A first prompting unit, configured to prompt a user with a plurality of personality characteristic information according to the first text content and the historical information record; The determining unit is used to determine the first personality characteristic information from the multiple personality characteristic information according to the user's input of the multiple personality characteristic information.
16. The device according to any one of claims 11 to 15, characterized in that The determining unit is further configured to determine first style feature information according to the first personality feature information; The virtual image generating unit is used to generate the virtual image according to the first style feature information.
17. The device according to claim 16, characterized in that The determining unit is used for: Inputting the first personality characteristic information into a prediction model to obtain the first style characteristic information; The prediction model is trained by sample training data, and the sample training data includes sample names, sample The personality characteristic information and sample style characteristic information of the person, wherein the sample style characteristic information includes at least one of the head image, body shape, timbre, speaking speed, intonation, and expression corresponding to the sample person name.
18. The device according to claim 16 or 17, characterized in that The device also includes: A second prompting unit, used to prompt the user with style feature information of one or more dimensions; The virtual image generation unit is used to generate the virtual image according to the user's input of the style feature information of the one or more dimensions.
19. The device according to claim 18, characterized in that The one or more dimensions of style feature information include at least one of avatar information, shape information, timbre information, speaking speed information, intonation information, and expression information.
20. The device according to any one of claims 11 to 19, characterized in that The device also includes: a third prompting unit, configured to prompt a plurality of virtual images to the user according to the first personality characteristic information; The virtual image generating unit is used to determine the virtual image corresponding to the first text content from the multiple virtual images according to the user's input to the multiple virtual images.
21. A device for generating a virtual image, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 10.
22. A terminal device, characterized in that: Comprising a device as claimed in any one of claims 11 to 21.
23. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a computer, the method according to any one of claims 1 to 10 is implemented.
24. A chip, characterized in that: The chip comprises a circuit for executing the method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Virtual image-based interaction method and device and computer storage medium
CN110812843A
Information interaction method and device and computer readable storage medium
CN111309886A
Information interaction method, device and equipment and storage medium
CN111339938A
Virtual image generation method and device, equipment and storage medium
CN113536007A
Method and device for generating virtual image, electronic equipment and computer readable medium
CN115222857A