Display device and role template generation method

Abstract

The invention relates to a display device and a role template generation method. In the role template generation method, a content generation application in a display is configured with a role editing entry, and in response to a trigger operation for the role editing entry displayed by the display in the content generation application, role description prompt information is determined according to a target role under the condition that the target role is determined; and outputting role description prompt information, so that a user can input the role description information according to the role description prompt information, and then a target role template corresponding to the target role can be generated according to the role description information corresponding to the received role description prompt information; the target role template is used for generating the role image of the target role in the multimedia content, so that the target role template is self-defined, the role image of the target role in the multimedia content is enriched, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for generating a character template. Background Art

[0002] Currently, with the continuous development of technology, the functions of display devices are becoming more and more diversified. For example, today's display devices have the function of creating multimedia content such as multimedia content.

[0003] In the traditional technology, in the process of creating multimedia content, the characters in the multimedia content are usually selected from pre-set character templates.

[0004] Since the pre-set character templates are fixed and limited, the character images available for selection are relatively simple, so that the generated multimedia content is relatively limited. Summary of the invention

[0005] The present application provides a display device and a method for generating a character template, which can support users to customize character templates, thereby enriching the character images in multimedia content and improving the user experience.

[0006] In a first aspect, some embodiments provide a display device, including:

[0007] A controller, configured to receive a control signal from a control device, and control a display in the display device to display according to the control signal;

[0008] The display is configured to display a character editing entry in the content generation application;

[0009] The controller is further configured to:

[0010] In response to a trigger operation on the role editing entry, when a target role is determined, role description prompt information is determined according to the target role;

[0011] Controlling the display to present the role description prompt information;

[0012] Receiving role description information corresponding to the role description prompt information;

[0013] A target role template corresponding to the target role is generated according to the role description information; wherein the target role template is used to generate a role image of the target role in multimedia content.

[0014] In the above embodiment, the display device includes a controller and a display, wherein the controller is configured to receive a control signal of the control device and control the display in the display device to display according to the control signal; the display is configured to display a role editing entry in the content generation application; the controller is also configured to respond to a trigger operation for the role editing entry, determine the role description prompt information according to the target role in the case of determining the target role, and output the role description prompt information, and after receiving the role description information corresponding to the role description prompt information, generate a target role template that can be used to generate the role image of the target role in the multimedia content according to the role description information. On the one hand, the display device of the present application has a role editing entry, so that the display device has a custom role template function, that is, the use function of the display device is increased; further, the display device of the present application has a custom role template function, which can facilitate users to flexibly use the custom role template function to create role templates, thereby enriching the role image in the multimedia content. On the other hand, the present application determines the role description prompt information based on the role, which can make the output role description prompt information more reasonable, and then make the received role description information more accurate, so that the role image generated based on the generated target role template in the multimedia content meets the actual needs of the user, thereby improving the user experience.

[0015] In some embodiments, before the controller generates a target role template corresponding to the target role according to the role description information, it is further configured to:

[0016] Controlling the display to present at least one template card of a preset role template in the content generation application;

[0017] In response to a selection operation of a template card of a preset role template corresponding to the target role among the template cards, determining a role template to be adjusted;

[0018] When the controller generates the target role template corresponding to the target role according to the role description information, the controller is further configured to update the role template to be adjusted according to the role description information to obtain the target role template corresponding to the target role.

[0019] In the above embodiment, a method is provided for modifying an existing role template based on the existing role template to generate a new role template, thereby achieving the purpose of customizing the role template, and further enriching the role image of the target role in the generated multimedia content, thereby improving the user experience.

[0020] In some embodiments, each template card is associated with a role editing entry, and the role description prompt information includes at least one target role description item;

[0021] When the controller responds to a trigger operation on the role editing entry, the controller is further configured to:

[0022] In response to a triggering operation on a role editing entry associated with a template card of the role template to be adjusted;

[0023] When the controller determines the role description prompt information according to the target role, the controller is further configured to:

[0024] Controlling the display to present the role template to be adjusted corresponding to the target role;

[0025] In response to the region selection operation on the to-be-adjusted role template, determining a to-be-adjusted role description item of the to-be-adjusted role template;

[0026] Determining at least one target role description item according to the role description item to be adjusted;

[0027] The role description prompt information is generated according to at least one target role description item.

[0028] In the above embodiment, the role description prompt information can be determined based on the role template to be adjusted by interacting with the user, that is, a process of determining the role description prompt information through human-computer interaction is provided, so that the input of the role description prompt information is more targeted, and the adjustment of the existing role template meets the actual needs of the user, thereby improving the user experience.

[0029] In some embodiments, when the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to:

[0030] Controlling the display to present a role guide card; wherein the role guide card is used to instruct to send a basic image for the target role to the display device through a user terminal;

[0031] After receiving the basic image sent by the user terminal, a target role template corresponding to the target role is generated according to the basic image and the role description information.

[0032] In the above embodiment, an interactive process between the display device and the mobile terminal is introduced to obtain a basic image, and the basic image is modified based on the character description information to generate a target character template, thereby achieving the purpose of customizing the character template and enriching the character image of the target character in the generated multimedia content, thereby improving the user experience.

[0033] In some embodiments, when the controller controls the display to present the role description prompt information, the controller is further configured to:

[0034] Controlling the display to present a target role creation template; wherein the target role creation template includes role description prompt information;

[0035] When the controller receives the role description information corresponding to the role description prompt information, the controller is further configured to:

[0036] In response to an input operation on the role description prompt information, role description information corresponding to the role description prompt information is received.

[0037] In the above embodiment, a feasible method for acquiring role description information is provided, which facilitates the subsequent generation of a target role template based on the role description information.

[0038] In some embodiments, after generating a target role template corresponding to the target role according to the role description information, the controller is further configured to:

[0039] Obtaining a template card corresponding to the target role template;

[0040] Controlling the display is also configured to present a template card corresponding to the target role template in the content generation application;

[0041] When the template card corresponding to the target role template is in a selected state, if a content generation event is detected, a content generation instruction indicating the target role template is sent to the server; wherein the content generation instruction is used to instruct the server to generate the multimedia content according to the target role template;

[0042] The display is controlled to present a playback entry for the multimedia content in the content generation application.

[0043] In the above embodiment, a feasible method for generating multimedia content according to a target role template is provided, and the role image of the target role in the multimedia content can be selected according to one's own needs, thereby improving the user experience.

[0044] In some embodiments, before executing sending a content generation instruction indicating the target role template to the server, the controller is further configured to:

[0045] Controlling the display to present a theme editing entrance in the content generation application;

[0046] In response to an operation on the theme editing entry, receiving a target theme of the multimedia content to be generated;

[0047] Correspondingly, when the controller sends a content generation instruction instructing the target role template to the server, it is also configured to:

[0048] Sending a content generation instruction carrying the target subject and the target role and indicating the target role template to the server;

[0049] The content generation instruction is used to instruct the server to generate text description information of the multimedia content according to the target theme and the target role, and to generate the multimedia content according to the text description information and the target role template.

[0050] In the above embodiment, an achievable method for generating multimedia content is provided, which can automatically generate text description information according to the target theme and target role of the multimedia content, so that the generated multimedia content is more story-like; and the multimedia content is generated according to the text description information and the target role template, so that the generated multimedia content has a more appropriate combination of text and pictures, thereby improving the readability of the multimedia content.

[0051] In some embodiments, when the controller determines the role description prompt information according to the target role, it is further configured to:

[0052] Selecting at least one reference role creation template that matches the target role from each candidate role creation template; wherein different reference role creation templates contain different role description prompt information;

[0053] A target character creation template is selected from each reference character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template use information of each reference character creation template.

[0054] In the above embodiment, the controller can determine the role description prompt information based on the version information of the content generation application, the version information of the display and at least one of the template usage information of each reference role creation template, so that the determined role description prompt information is more in line with actual usage needs, and thus the determined role template is more in line with actual usage needs.

[0055] In some embodiments, before selecting a target character creation template from each reference character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference character creation template, the controller is further configured to:

[0056] Controlling the display to present a theme editing entrance in the content generation application;

[0057] In response to a trigger operation on the theme editing entry, receiving a target theme of the multimedia content to be generated;

[0058] The controller is further configured to select a target role creation template from each reference role creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference role creation template:

[0059] Selecting at least one candidate role creation template matching the target theme from each reference role creation template;

[0060] A target character creation template is selected from each candidate character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each candidate character creation template.

[0061] In the above embodiment, when determining the target character creation template, on the one hand, the target theme of the multimedia content is taken into consideration so that the determined target character creation template is more in line with the multimedia content; on the other hand, the target character creation template can be selected from the candidate character creation templates based on at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference character creation template, so that the target character creation template provided to the user is more in line with the actual character creation needs.

[0062] In some embodiments, when the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to:

[0063] A first role generation instruction carrying the role description information is sent to a server; wherein the first role generation instruction is used to instruct the server to call a target text graph model, and generate a target role template corresponding to the target role according to the role description information; wherein the target text graph model includes a text encoder, a denoising network, and an image generator.

[0064] In the above embodiment, the target role template is generated based on the role description information through the target text graph model, which can improve the efficiency of generating the target role template on the one hand, and improve the accuracy of generating the target role template on the other hand.

[0065] In some embodiments, the text encoder is used to extract features from the role description information to obtain a text embedding vector; the denoising network is used to denoise the initial noisy image based on the text embedding vector to obtain a denoised image; the image generator is used to perform an image generation operation based on the denoised image to obtain a target role template corresponding to the target role.

[0066] In the above embodiment, a specific implementation method for generating a target role template based on role description information through a target text graph model is provided, which can improve the efficiency of generating the target role template on the one hand, and improve the accuracy of generating the target role template on the other hand.

[0067] In some embodiments, the target text graph model is trained in the following manner:

[0068] Get a sample person image;

[0069] Extracting sample description information corresponding to the sample person image;

[0070] According to the sample description information corresponding to the sample character image, a denoising network in the initial text image model is trained to obtain a predicted character image;

[0071] Using a face recognition model, determining an image difference between the sample person image and the predicted person image;

[0072] The model parameters of the denoising network in the initial text graph model are adjusted according to the image difference to obtain the target text graph model.

[0073] In the above embodiment, a feasible method for obtaining a target text graph model is provided, which facilitates the use of the target text graph model to generate a target role template, thereby improving the efficiency of generating the target role template.

[0074] In some embodiments, when the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to:

[0075] A second role generation instruction carrying the role description information is sent to the server; wherein the second role generation instruction is used to instruct the server to select a target role image with the highest matching degree with the role description information from the candidate role images, and use the target role image as a target role template corresponding to the target role.

[0076] In the above embodiment, by adopting the text similarity matching method, a target role template is generated according to the role description information, thereby enriching the role image of the target role in the generated multimedia content, thereby improving the user experience.

[0077] In a second aspect, some embodiments further provide a method for generating a character template, the method being applied to a controller in a display device, the controller being used to receive a control signal of a control device, and controlling a display in the display device to display according to the control signal; the method comprising:

[0078] In response to a trigger operation on a character editing entry displayed on the display in the content generation application, when a target character is determined, determining character description prompt information according to the target character;

[0079] Controlling the display to present the role description prompt information;

[0080] Receiving role description information corresponding to the role description prompt information;

[0081] A target role template corresponding to the target role is generated according to the role description information; wherein the target role template is used to generate a role image of the target role in multimedia content.

[0082] As can be seen from the above technical solutions, some embodiments of the present application provide a display device and a method for generating a role template, wherein in the method for generating a role template, a role editing entry is configured in the content generation application in the display, and in response to a trigger operation on the role editing entry displayed by the display in the content generation application, when the target role is determined, the role description prompt information is determined according to the target role, and the role description prompt information is output, so that the user can input the role description information according to the role description prompt information, and then the target role template that can be used to generate the role image of the target role in the multimedia content can be generated according to the role description information corresponding to the received role description prompt information. On the one hand, the display device of the present application has a role editing entry, so that the display device has a custom role template function, that is, the use function of the display device is increased; further, the display device of the present application has a custom role template function, which can facilitate users to flexibly use the custom role template function to create role templates, thereby enriching the role image in the multimedia content. On the other hand, the present application determines the role description prompt information based on the role, which can make the output role description prompt information more reasonable, and then make the received role description information more accurate, so that the role image generated based on the generated target role template in the multimedia content meets the actual needs of the user, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0084] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0085] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0086] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0087] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0088] Figure 5 A schematic diagram of a character image selection interface provided in some embodiments of the present application;

[0089] Figure 6 A schematic diagram of the steps of a method for generating a role template provided in some embodiments of the present application;

[0090] Fig. 7A A schematic diagram of an operation interface of a content generation application provided in some embodiments of the present application;

[0091] Figure 7B A schematic diagram of an interface for inputting multimedia content themes provided in some embodiments of the present application;

[0092] Figure 7C A schematic diagram of an interface for inputting multimedia content roles provided in some embodiments of the present application;

[0093] Fig.7D A schematic diagram of a character image creation interface provided in some embodiments of the present application;

[0094] Figure 8 A schematic diagram of presenting role description prompt information provided in some embodiments of the present application;

[0095] Fig. 9A A schematic diagram of a generated target role template provided in some embodiments of the present application;

[0096] Fig. 9B A schematic diagram of turning pages of multimedia content provided in some embodiments of the present application;

[0097] Fig. 9C A schematic diagram of a regenerated target role template provided in some embodiments of the present application;

[0098] Fig.9D A schematic diagram of a multimedia content cover provided by some embodiments of the present application;

[0099] Fig.9E A schematic diagram of multimedia content preview provided in some embodiments of the present application;

[0100] Fig.9FA schematic diagram of multimedia content sharing provided in some embodiments of the present application;

[0101] Fig. 10A A schematic diagram of a template for creating a target role provided in some embodiments of the present application;

[0102] Fig. 10B Schematic diagram of role description information provided for some embodiments of the present application;

[0103] Fig.11A A schematic diagram of a preset role template editing entry provided in some embodiments of the present application;

[0104] Fig. 11B A schematic diagram of selected multimedia content provided by some embodiments of the present application;

[0105] Fig. 11C A schematic diagram of deleting multimedia content provided in some embodiments of the present application;

[0106] Fig.11D A schematic diagram of confirming deletion of multimedia content provided in some embodiments of the present application;

[0107] Fig.11E A schematic diagram of multimedia content after deletion provided in some embodiments of the present application;

[0108] Fig.12 A schematic diagram of the target text graph model structure provided for some embodiments of the present application;

[0109] Fig.13 A timing diagram for generating a target role template provided in some embodiments of the present application. DETAILED DESCRIPTION

[0110] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0111] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0112] The terms "first", "second", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0113] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0114] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0115] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0116] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0117] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0118] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN) and other networks.

[0119] The display device 200 can provide a broadcast receiving television function and a multimedia content creation function; wherein the multimedia content can be multimedia content, and can also provide an intelligent network TV function that provides computer support functions, including but not limited to network TV, smart TV, Internet Protocol Television (IPTV), etc.

[0120] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0121] In some embodiments, the display device 200 may include at least one of a tuner 210 , a communication device 220 , a detector 230 , a device interface 240 , a controller 250 , a display 260 , an audio output device 270 , a memory, a power supply, and a user input interface 280 .

[0122] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0123] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0124] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0125] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0126] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0127] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0128] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the GUI.

[0129] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0130] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0131] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0132] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0133] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0134] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0135] The controller 110 includes a processor 112, a random access memory (RAM) 113, a read-only memory (ROM) 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0136] The communication interface 130 implements the communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and a near field communication technology (NFC) module 133.

[0137] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0138] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0139] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0140] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0141] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0142] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0143] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications layer) (referred to as "application layer"), the application framework layer (Application Framework layer) (referred to as "framework layer"), the system library layer and the kernel layer.

[0144] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0145] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0146] like Figure 4 As shown, in the embodiment of the present application, the application layer includes various applications, for example, various applications include content generation applications to support users to generate multimedia content in the content generation applications. The content generation application includes preset multimedia content, and the pictures and audio contained in the multimedia content are related to the content text. When playing the multimedia content, the playing time of the pictures and content text corresponds to the broadcasting time of the audio content corresponding to the picture.

[0147] In the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0148] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0149] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0150] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, High-Definition Multimedia Interface (HDMI) driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0151] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0152] The above embodiments illustrate the hardware / software architecture and functional implementation of a display device 200. In some embodiments, the display device 200 is configured with a content generation application, and the display in the display device 200 can display the content generation application; the controller in the display device can receive the control signal of the control device 100, and control the display in the display device to display the content generation application according to the control signal; the user can control the display device 200 through the control device 100 to generate multimedia content in the content generation application; the user can also receive the user's voice through the sound collector in the detector 230, interact with the user, and generate multimedia content in the content generation application.

[0153] See also Figure 5 When generating multimedia content, users need to input the theme and role of the multimedia content, and then select the role image. The existing technology only supports users to select from the role templates pre-set in the content generation application, and the role template selection is relatively limited. For example, the pre-set role templates include "My dad", "My mom" and "My family", and users can only select from these pre-set role templates, thereby reducing the user experience.

[0154] Based on this, in some embodiments, the present application provides a display device, including a display and a controller. The controller is configured to receive a control signal from a control device, and control the display in the display device to display according to the control signal; the display is configured to display a role editing entry in a content generation application; the controller is also configured to execute a role template generation method, which can respond to a trigger operation on the role editing entry, interact with the user according to the role description prompt information corresponding to the target role, and obtain the role description information provided by the user, and then generate a target role template corresponding to the target role, thereby realizing a custom role template, enriching the role image of the role in the generated multimedia content, and improving the user experience.

[0155] Optional, reference Figure 6 , the role template generation method comprises the following steps:

[0156] Step 602, in response to a triggering operation on a role editing entry displayed on a display in a content generation application, when a target role is determined, role description prompt information is determined according to the target role.

[0157] For example, when generating multimedia content, the user can manipulate the control device 100 to interact with the display device 200. For example, the user can manipulate the control device 100 to open a content generation application in the display device 200, wherein the operation interface of the content generation application is as shown in FIG. Fig. 7A Then the user manipulates the control device 100 to trigger the multimedia content creation button "Create now" in the operation interface to enter the Figure 7B The user can also manipulate the control device 100 to Figure 7B Enter the theme of the multimedia content in the Topic column and the role of the multimedia content in the Role column to trigger "Next" and enter Figure 7C interface.

[0158] In some embodiments, the user can also directly control the opening of the content generation application through the voice interaction function. For example, the user can first wake up the voice assistant in the display device, and then use voice input "open content generation application" to enter Fig. 7A The interface shown in the figure; the user can enter the voice content "create multimedia content" and then enter Figure 7B Further, the user can also voice input the theme of the multimedia content, for example, the theme can be "family", enter Figure 7C Then voice input the target role of the multimedia content, for example, the target role can be "my dad", and then enter Fig.7D In the interface shown, select the character image.

[0159] Optionally, users can Fig.7D In the interface shown, a pre-set role template is selected. For example, the pre-set role templates may include "My dad", "My mom" and "My family"; wherein, there may be one or more templates for the same role, and the user may select one of the role templates according to one or more role templates corresponding to the target role, to generate the role image of the target role in the multimedia content. In some embodiments, when there are multiple templates for the same role, the multiple templates may be displayed in a superimposed manner, and the order of superposition may be determined according to information such as the frequency of use of each template.

[0160] In some embodiments, the content generation application also integrates a role editing entry. The so-called role editing entry is an entry to enter the role template customization function, which can be presented in the form of a button or a link, etc., and the embodiments of the present application do not limit this.

[0161] Optionally, the user can also trigger the role editing entrance to customize the corresponding role template. For example, the user can input "create a role" by voice, or manipulate the control device 100 to trigger the role editing entrance, for example, it can be Fig.7D Click the "plus sign" in the toolbar to enter the role template customization function to customize the corresponding role template.

[0162] For example, the controller needs to determine the target role before executing the specific role template customization. In the embodiment of the present application, the specific time for determining the target role is not limited. For example, the user can input the target role corresponding to the multimedia content before triggering the role editing entrance, that is, Figure 7C Alternatively, the controller can also determine the target role when the user creates a role template, that is, after the role editing entrance is triggered, the user first inputs the target role, and the controller can determine the target role at this time.

[0163] In some embodiments, when the target role is determined, the controller can determine the role description prompt information according to the target role. The so-called role description prompt information is used to prompt the user to enter the specific content of the corresponding role description item. Optionally, the role description prompt information in the embodiment of the present application can be one, in which case the role description prompt information can include multiple role description items; or, the role description prompt information can also be multiple, in which case one role description prompt information can include one role description item.

[0164] Optionally, the so-called role description item is a characteristic dimension for role description. Different roles correspond to different role description items. Furthermore, after determining the target role, multiple role description items associated with the target role can be obtained based on the correspondence between the role and the role description item, and part or all of the multiple role description items associated with the target role are used as the target role description item. At this time, corresponding role description prompt information can be generated based on the target role description item.

[0165] For example, the pre-set multiple role description items may include "hair style", "clothing", "cheeks", "body type", "size", "shape", "age", "personality", "skin color", "hobbies", "emotions", "name", "fur color", "behavior habits", etc. At this time, multiple role description items associated with the target role may be obtained based on the corresponding relationship between the role and the role description items.

[0166] Step 604, controlling the display to present role description prompt information.

[0167] Optionally, the display may be controlled to present the role description prompt information; or, the role description prompt information may be presented through voice playback and display on the display.

[0168] In some embodiments, after determining the role description prompt information corresponding to the target role, the display may be controlled to present the role description prompt information. Figure 8 , Figure 8 A schematic diagram of a display presenting role description prompt information is shown, wherein the role description prompt information can be displayed in one interface or in multiple interfaces. Figure 8 The role description prompt information is displayed in one interface. Figure 8 The character description prompt displayed in the game is "Hey kiddo, what does your dad look like? Can you tell me about his hair, skin color, height, and if he's big or small?" It should be noted that Figure 8 The role description prompt information is only an example and is not intended to limit the role description prompt information.

[0169] Step 606: Receive role description information corresponding to the role description prompt information.

[0170] Exemplarily, after the role description prompt information is presented, the user can input the role description information corresponding to the role description prompt information through the control device 100 based on the role description prompt information, or input the role description information corresponding to the role description prompt information through voice interaction. For example, if the role description prompt information is "what is the hairstyle like", the role description information that the user can input is "black shawl hair". After the user inputs the role description information, the controller can receive the role description information corresponding to the role description prompt information.

[0171] Step 608: Generate a target role template corresponding to the target role according to the role description information.

[0172] Exemplarily, the controller can generate a target role template corresponding to the target role based on the role description information, a preset algorithm or a preset model. The target role template is used to generate the role image of the target role in the multimedia content. For example, if the target role is "my dad", and the role description information is "yellow hair, glasses, very cute, likes reading", the generated target role template is as follows: Fig. 9A shown.

[0173] Furthermore, if the user is satisfied with the generated target role template, he or she can click Fig. 9A Press button 901 in the menu, or input “Continue or Next” by voice to enter Fig. 9B Interface. Fig. 9BBy clicking button 902 or 903, or by voice inputting "next page or previous page", the page can be turned up or down; the purpose is to apply the generated target role template to each frame image containing the target role in the multimedia content. If the user is not satisfied with the generated target role template, he can click Fig. 9A , or by voice inputting "regenerate", the target role template to be regenerated is as follows: Fig. 9C As shown; click Fig. 9C Press button 905 in the menu, or input “Continue or Next” by voice to enter Fig. 9B When you turn to the last page of multimedia content, click the next step, or voice input "Continue or Next" to enter Fig.9D The interface shown, Fig.9D The interface shown shows the generated multimedia content cover to the user.

[0174] Furthermore, the user can click the save button 906 or voice input "save" to save the generated multimedia content and jump to Fig.9E The interface shown, that is, the newly generated multimedia content is displayed on the homepage of the content generation application in the order of generation.

[0175] For example, the user can also click Fig.9D The share button 907 in the interface shown, or voice input "share", enter Fig.9F The interface shown; Fig.9F A shared QR code is shown. The user can scan the QR code through a terminal device to download multimedia content. The downloaded multimedia content can be in a picture format or a video format. The format of the downloaded multimedia content can be selected as needed.

[0176] In the above-mentioned character template generation method, a character editing entry is configured in the content generation application in the display, and in response to a trigger operation on the character editing entry displayed by the display in the content generation application, when the target character is determined, the controller determines the character description prompt information according to the target character, and outputs the character description prompt information, so that the user can input the character description information according to the character description prompt information, and then the controller can generate a target character template that can be used to generate the character image of the target character in the multimedia content according to the character description information corresponding to the received character description prompt information. On the one hand, the display device of the present application has a character editing entry, so that the display device has a custom character template function, that is, the use function of the display device is increased; further, the display device of the present application has a custom character template function, which can facilitate users to flexibly use the custom character template function to create character templates, thereby enriching the character image in the multimedia content. On the other hand, the present application determines the character description prompt information based on the role, which can make the output character description prompt information more reasonable, and then make the received character description information more accurate, so that the character image generated based on the generated target character template in the multimedia content meets the actual needs of the user, thereby improving the user experience.

[0177] In some exemplary embodiments, step 604 outputs the role description prompt information and receives the role description information corresponding to the role description prompt information, which may specifically include the following steps:

[0178] 1. Control the display to present the target character creation template.

[0179] Exemplarily, the target role creation template includes role description prompt information, that is, the target role creation template can be multiple role description prompt information. Fig. 10A , Fig. 10A A schematic diagram of a target role creation template is shown, wherein: Fig. 10A For example, “Hey kiddo, what does your dad look like? Can you tell meabout his hair, skin color, height, and if he's big or small?” can create a template for the target character.

[0180] 2. In response to an input operation on the role description prompt information, receiving role description information corresponding to the role description prompt information.

[0181] Further, the user can input the role description information corresponding to the role description prompt information by operating the control device 100 or by voice input, see Fig. 10B , Fig. 10B"He has golden hair, very cute, he wears glasses and he loves to read." is the role description information. So as to generate the target role template according to the role description information.

[0182] In the above embodiment, a feasible method for acquiring role description information is provided, which facilitates the subsequent generation of a target role template based on the role description information.

[0183] In some exemplary embodiments, step 602 determines role description prompt information according to the target role, which may specifically include the following steps:

[0184] 1. From each candidate role creation template, select at least one reference role creation template that matches the target role.

[0185] Exemplarily, the candidate character creation templates may be pre-set templates corresponding to different characters, wherein different candidate character creation templates include different character description prompt information. For example, the character description prompt information corresponding to a person may be prompt information for hairstyle, height, weight, age, occupation, etc.; the character description prompt information corresponding to an animal may be prompt information for body shape, color, personality, etc.

[0186] Optionally, even if the roles belong to the same type, roles with different identities can correspond to different role description prompts. For example, a father and a child belong to the same persona, but the role description prompts of the father can include the work dimension, while the role description prompts of the child do not involve the work dimension. This can make the generated role template more unique and more in line with the needs of users.

[0187] It should be noted that the reference role creation template is a role creation template that matches the target role among the candidate role creation templates, wherein the reference role creation template may be one or more, and different reference role creation templates may contain different role description prompt information. A correspondence between the candidate role creation templates and the role may be established in advance, and then at least one reference role creation template that matches the target role may be screened out from the candidate role creation templates according to the target role.

[0188] 2. Select a target character creation template from each reference character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference character creation template.

[0189] It should be noted that the fine-grained dimensions of the character images that can be displayed by different content generation application version information and different display version information are different. For example, higher content generation application version information and higher display version information can display more fine-grained character images, such as hairstyles that can display hair strands, skin that can display pores and wrinkles, and clothing that can display textures.

[0190] The template usage information of each reference role creation template may include the usage frequency of the reference role creation template. A higher usage frequency means that the reference role creation template is more popular and can be used preferentially.

[0191] Based on this, the controller can select a target role creation template from each reference role creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference role creation template. The target role creation template includes role description prompt information for prompting the user to input role description information.

[0192] In the above embodiment, the controller can determine the role description prompt information based on the version information of the content generation application, the version information of the display and at least one of the template usage information of each reference role creation template, so that the determined role description prompt information is more in line with actual usage needs, and thus the determined role template is more in line with actual usage needs.

[0193] In some exemplary embodiments, before executing the selection of the target character creation template from each reference character creation template based on the version information of the content generation application, the version information of the display and at least one of the template usage information of each reference character creation template, the controller can control the display to present a theme editing entrance in the content generation application to support the user to input the theme of the multimedia content; the controller receives the target theme of the multimedia content to be generated in response to the trigger operation on the theme editing entrance; exemplarily, the user can manipulate the control device 100 to input the target theme of the multimedia content, and can also input the target theme of the multimedia content by voice.

[0194] Based on this, the embodiment of the present application provides another achievable method for selecting a target role creation template from various reference role creation templates, which is different from the above embodiment in that the target role creation template can be selected according to the theme of the multimedia content. Specifically, the following steps are included:

[0195] 1. From each reference role creation template, select at least one candidate role creation template that matches the target theme.

[0196] Exemplarily, a correspondence between each candidate role creation template and the theme can be established in advance. After multiple reference role creation templates are screened out according to the target role in the candidate role creation templates, the controller can screen out at least one candidate role creation template that matches the target theme in the reference role creation templates based on the correspondence between each reference role creation template and the theme.

[0197] Alternatively, keywords may be extracted from the target theme, and at least one candidate role creation template corresponding to the keywords may be determined from each reference role creation template based on the extracted keywords.

[0198] 2. Select a target character creation template from each candidate character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each candidate character creation template.

[0199] Furthermore, after determining at least one candidate character creation template, the controller may continue to select a target character creation template from each candidate character creation template. Specifically, the controller may select a target character creation template from each candidate character creation template based on at least one of the version information of the content generation application, the version information of the display, and the template usage information of each candidate character creation template. In this way, in the process of determining the target character creation template, not only the fine-grained dimensions of the character image that can actually be displayed by the content generation application and the display can be considered; the frequency of use of each candidate character creation template can also be considered, thereby making the determined target character creation template more in line with the actual character creation needs.

[0200] In the above embodiment, when determining the target character creation template, on the one hand, the target theme of the multimedia content is taken into consideration so that the determined target character creation template is more in line with the multimedia content; on the other hand, the target character creation template can be selected from the candidate character creation templates based on at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference character creation template, so that the target character creation template provided to the user is more in line with the actual character creation needs.

[0201] It should be noted that generating a target role template can be a process of creating one from scratch, that is, the above embodiment provides a content generation application with a role editing entry (eg Fig.7D As an example given in ), a new role template can be created based on the role editing entry, thus realizing a customized target role template. Generating a target role template can also be a process of generating a new template based on an existing role template.

[0202] In some exemplary embodiments, before the controller generates the target role template corresponding to the target role according to the role description information, it can also control the display to present at least one template card of a preset role template in the content generation application; the controller determines the role template to be adjusted in response to the selection operation of the template card of the preset role template corresponding to the target role in each template card. The preset role template is a pre-set role template, and the template card can be understood as an image corresponding to the role template.

[0203] For example, in the above embodiment, Fig.7D The template card of each preset role template in the display interface supports editing operations. The user can select a template card of a preset role template, and the preset role template corresponding to the selected template card is regarded as the role template to be adjusted.

[0204] Further, after selecting the role template to be adjusted, the controller updates the role template to be adjusted according to the role description information input by the user, and obtains the target role template corresponding to the target role. For example, the role template to be adjusted selected by the user is the role template corresponding to "My dad". The controller updates the role template to be adjusted according to the role description information input by the user based on a preset algorithm or a preset model, and the target role template corresponding to the target role obtained can be Fig. 9A The role template shown.

[0205] In the above embodiment, a method is provided for modifying an existing role template based on the existing role template to generate a new role template, thereby achieving the purpose of customizing the role template, and further enriching the role image of the target role in the generated multimedia content, thereby improving the user experience.

[0206] In some exemplary embodiments, each template card is associated with a role editing entry, and the role description prompt information includes at least one target role description item.

[0207] Among them, the role editing entrance can be understood as Fig.11A The “plus sign” corresponding to each role template in the target role description items may include hairstyle, clothing, height, weight, age, job, hobbies, personality, etc. The role description prompt information is used to prompt the user to enter content related to the target role description items. For example, the role description prompt information may be what color the hairstyle is, what clothes are worn, how tall, how heavy, how old, etc.

[0208] Exemplarily, the user may trigger the character editing entrance by operating the control device 100, or select a template card and voice input "adjust character template" to trigger the character editing entrance.

[0209] At this time, the controller may determine the role description prompt information according to the target role in response to the trigger operation of the role editing entry associated with the template card of the role template to be adjusted. Alternatively, the controller may control the display to present the role template to be adjusted corresponding to the target role in response to the trigger operation of the role editing entry associated with the template card of the role template to be adjusted.

[0210] In some embodiments, the display device only displays the template card of the role template, that is, the display device does not store the role template itself. Therefore, after the controller responds to the trigger operation of the role editing entry associated with the template card of the role template to be adjusted, it can obtain the role template to be adjusted from the server; then, the controller can control the display to enlarge and display the role template to be adjusted. In some embodiments, the magnification can be determined according to the resolution of the display, the resolution of the role template to be adjusted, etc.

[0211] After the controller displays the character template to be adjusted through the display, the user can select the area to be adjusted in the character template to be adjusted, such as hair, clothes, eyes, nose, etc. Accordingly, the controller can determine the character description items to be adjusted of the character template to be adjusted in response to the area selection operation of the character template to be adjusted; for example, if the area to be adjusted selected by the user is hair and clothes, the controller determines the character description items to be adjusted of the character template to be adjusted as hairstyle and clothing.

[0212] After determining the role description item to be adjusted, the controller may determine at least one target role description item according to the role description item to be adjusted, and generate role description prompt information according to the at least one target role description item. For example, the role description item to be adjusted selected by the user may be used as the target role description item, and information may be encapsulated based on the target role description item to obtain the role description prompt information.

[0213] In the above embodiment, the role description prompt information can be determined based on the role template to be adjusted by interacting with the user, that is, a process of determining the role description prompt information through human-computer interaction is provided, so that the input of the role description prompt information is more targeted, and the adjustment of the existing role template meets the actual needs of the user, thereby improving the user experience.

[0214] In some exemplary embodiments, the present application provides another achievable method for generating a target role template, which specifically includes the following steps:

[0215] 1. Control the display to present the role guide card.

[0216] Exemplarily, the role guide card is used to instruct to send a basic image for the target role to the display device through the mobile terminal. For example, the role guide card can be a QR code. Exemplarily, if the role template that the user wants to generate is "my dad", the role guide card can be scanned by the mobile terminal to send the basic image to the display device.

[0217] 2. After receiving the basic image sent by the mobile terminal, a target role template corresponding to the target role is generated according to the basic image and role description information.

[0218] Furthermore, after receiving the basic image sent by the mobile terminal, the controller may update the basic image according to the role description information to obtain a target role template corresponding to the target role.

[0219] For example, after receiving the basic image sent by the mobile terminal, the controller can call a preset algorithm to update the basic image based on the role description information to obtain a target role template corresponding to the target role. It can also call a preset model to update the basic image based on the role description information to obtain a target role template corresponding to the target role.

[0220] In the above embodiment, an interactive process between the display device and the mobile terminal is introduced to obtain a basic image, and the basic image is modified based on the character description information to generate a target character template, thereby achieving the purpose of customizing the character template and enriching the character image of the target character in the generated multimedia content, thereby improving the user experience.

[0221] In some exemplary embodiments, the embodiments of the present application provide an implementable method for generating multimedia content, wherein the controller is further configured to obtain a template card corresponding to the target role template; and control the display to present the template card corresponding to the target role template in the content generation application; the specific implementation process is as follows:

[0222] When the template card corresponding to the target role template is in the selected state, if a content generation event is detected, a content generation instruction indicating the target role template is sent to the server; wherein the content generation instruction is used to instruct the server to generate multimedia content according to the target role template.

[0223] For example, when the template card corresponding to the target role template is in the selected state, a content generation event can be triggered. For example, the user can voice input "generate multimedia content" to trigger the content generation event; the user can also manipulate the control device 100 to trigger the role selection interface displayed by the display device (such as Fig.7D ) Fig.7D Not shown) to trigger a content generation event.

[0224] For example, the content generation instruction is used to instruct the server to generate multimedia content according to the target role template.

[0225] Further, the controller controls the display to present a playback entry of the multimedia content in the content generation application. Fig.9E In the interface shown, the playback entrance of the multimedia content can be the cover of the multimedia content. The user can play the multimedia content by operating the control device to select the cover of the multimedia content, or by voice input to play the multimedia content.

[0226] It should be noted that the content generation application has multiple multimedia contents preset, and supports users to create new multimedia contents. Each multimedia content includes multiple multimedia content pictures, and the character images in the multiple multimedia content pictures are unified; each multimedia content picture is generated based on a section of the story text in the multimedia content story, and each multimedia content picture corresponds to a broadcast audio, which is obtained based on the story text corresponding to the multimedia content picture.

[0227] In the content generation application, select multimedia content and confirm to play. The selected multimedia content can be played in video mode.

[0228] During the playback of the multimedia content video, the multimedia content picture can be displayed statically or with sliding effects. The story text corresponding to the page picture is also displayed on the multimedia content picture, and the display duration of each multimedia content picture corresponds to the broadcast audio duration of the multimedia content picture.

[0229] As an example, the switching display of two adjacent multimedia content pictures may be continuous, but the broadcasting audio of the two adjacent multimedia content pictures is played at an interval of 1 second.

[0230] There may be background music during the multimedia content playback, and the background music matches the story content of the multimedia content.

[0231] In the above embodiment, a feasible method for generating multimedia content according to a target role template is provided, and the role image of the target role in the multimedia content can be selected according to one's own needs, thereby improving the user experience.

[0232] In some exemplary embodiments, the embodiments of the present application provide an implementable method for automatically generating text description information of multimedia content according to the theme and target role of the multimedia content. The specific implementation process is as follows:

[0233] Before executing the content generation instruction indicating the target role template to be sent to the server, the controller controls the display to present a theme editing portal in the content generation application, so that the user can input the theme of the multimedia content in the theme editing portal. In response to the operation on the theme editing portal, the controller receives the target theme of the multimedia content to be generated; wherein the user can input the target theme of the multimedia content by manipulating the control device 100 or by voice input.

[0234] The controller then sends a content generation instruction to the server that carries the target theme and target role and indicates the target role template; wherein the content generation instruction is used to instruct the server to generate text description information of the multimedia content according to the target theme and target role, and to generate the multimedia content according to the text description information and the target role template.

[0235] It is understandable that the server can generate text description information of multimedia content according to the target theme and target role based on the text generation model, wherein the text generation model can be pre-trained with sample themes and sample roles as input data and sample text description information as label data to obtain the text generation model.

[0236] Furthermore, the server may generate multimedia content according to the text description information and the target role template, for example, by making the text description information correspond to each frame of the multimedia content, thereby generating the multimedia content.

[0237] In the above embodiment, an achievable method for generating multimedia content is provided, which can automatically generate text description information according to the target theme and target role of the multimedia content, so that the generated multimedia content is more story-like; and the multimedia content is generated according to the text description information and the target role template, so that the generated multimedia content has a more appropriate combination of text and pictures, thereby improving the readability of the multimedia content.

[0238] In some exemplary embodiments, if the user wants to delete the generated multimedia content, the user may first select the multimedia content, such as Fig. 11B As shown, trigger the "ok" button in the control device 100 to enter Fig. 11C The interface shown triggers the deletion event and enters Fig.11D In the interface shown, trigger the delete button "Remove", confirm the deletion, and jump to Fig.11E interface, the multimedia content has been deleted.

[0239] In some exemplary embodiments, the embodiments of the present application provide an implementable method for generating a target role template corresponding to a target role according to role description information, and the specific implementation process is as follows:

[0240] A first role generation instruction carrying role description information is sent to the server; wherein the first role generation instruction is used to instruct the server to call a target text graph model, and generate a target role template corresponding to the target role according to the role description information; wherein the target text graph model includes a text encoder, a denoising network and an image generator.

[0241] Exemplarily, the target text graph model is obtained by training the initial text graph model with the sample role description information as input and the sample role template as label data. Based on this, the server inputs the first role generation instruction carrying the role description information into the target text graph model, and outputs the target role template corresponding to the target role.

[0242] In the above embodiment, the target role template is generated based on the role description information through the target text graph model, which can improve the efficiency of generating the target role template on the one hand, and improve the accuracy of generating the target role template on the other hand.

[0243] In some exemplary embodiments, see Fig.12 , Fig.12 A structural diagram of a target text-generated graph model is provided, wherein the target text-generated graph model includes a text encoder, a denoising network, and an image generator; Z T is the initial noise image, Z T-1 is the first denoised image, and Z0 is the Tth denoised image.

[0244] The embodiment of the present application provides an implementable method for a server to generate a target role template corresponding to a target role based on a target text graph model and according to role description information. The specific implementation process is as follows:

[0245] Exemplarily, the server may input the role description information into a text editor, and the text encoder is used to extract features from the role description information to obtain a text embedding vector.

[0246] Then the server inputs the text embedding vector into the denoising network, and the denoising network is used to denoise the initial noise image according to the text embedding vector to obtain a denoised image. The initial noise image can be understood as a preset noise image, which can be a randomly generated noise image or a fixed input noise image, and is used to perform denoising according to the text embedding vector to obtain a denoised image for generating a target character template.

[0247] Furthermore, the server inputs the denoising network into an image generator, and the image generator is used to perform an image generation operation according to the denoised image to obtain a target role template corresponding to the target role.

[0248] In the above embodiment, a specific implementation method for generating a target role template based on role description information through a target text graph model is provided, which can improve the efficiency of generating the target role template on the one hand, and improve the accuracy of generating the target role template on the other hand.

[0249] In some exemplary embodiments, the embodiments of the present application provide an implementable method for a server to train a target document graph model, specifically comprising the following steps:

[0250] 1. Get sample person images.

[0251] For example, the server may first obtain sample character images, for example, sample character images from film and television resources, online public resources, third-party data and other resources, and the sample character images include Chinese and Western faces, taking into account the age distribution and the ratio of men to women. These images are annotated, and the annotation dimensions include (hair style, face shape, body shape, clothing, makeup, accessories, posture) and other information.

[0252] 2. Extract the sample description information corresponding to the sample person image.

[0253] Furthermore, the server extracts sample description information corresponding to the sample character image, for example, extracts information on dimensions such as hairstyle, face shape, body shape, clothing, makeup, accessories, and posture corresponding to the sample character image.

[0254] 3. According to the sample description information corresponding to the sample character image, the denoising network in the initial text image model is trained to obtain the predicted character image.

[0255] Furthermore, the server uses the sample description information as input data, and the sample character image corresponding to the sample description information as label data, and obtains a predicted character image by training the denoising network in the initial text graph model.

[0256] 4. Use the face recognition model to determine the image difference between the sample person image and the predicted person image.

[0257] Exemplarily, the server may use a face recognition model to determine the image difference between the sample person image and the predicted person image.

[0258] 5. According to the image differences, the model parameters of the denoising network in the initial text image model are adjusted to obtain the target text image model.

[0259] Furthermore, the server uses the image difference as a loss to adjust the model parameters of the denoising network in the initial text image model until the number of training times reaches a preset number of times or the image difference is less than a preset difference, thereby obtaining the target text image model.

[0260] In the above embodiment, a feasible method for obtaining a target text graph model is provided, which facilitates the use of the target text graph model to generate a target role template, thereby improving the efficiency of generating the target role template.

[0261] In some exemplary embodiments, the present application provides another achievable method for generating a target role template, and the specific implementation process is as follows:

[0262] A second role generation instruction carrying role description information is sent to the server; wherein the second role generation instruction is used to instruct the server to select a target role image with the highest matching degree with the role description information from the candidate role images, and use the target role image as a target role template corresponding to the target role.

[0263] Exemplarily, the candidate character images may be a plurality of pre-stored character images; the server may employ text image similarity matching technology to score each candidate image according to the character description information, and use the candidate character image with a score greater than a set score threshold, or the candidate character image with the highest score, as the target character image, and use the target character image as the target character template corresponding to the target character.

[0264] In the above embodiment, by adopting the text similarity matching method, a target role template is generated according to the role description information, thereby enriching the role image of the target role in the generated multimedia content, thereby improving the user experience.

[0265] It should be noted that the above voice input content is only an exemplary description and is not intended to limit the voice input content of each step. The voice input content corresponding to each specific operation step can be preset or customized by the user.

[0266] In some exemplary embodiments, see Fig.13 ,13 provides a timing diagram of a role template generation method, and the specific ,implementation process is as follows:

[0267] 1. The user manipulates the control device 100 to trigger an instruction to open the content generating application, or triggers an instruction to open the content generating application by voice inputting “open the content generating application”.

[0268] 2. The content generation application responds to the opening content generation instruction by synchronizing the instruction to enter the content generation application to the controller.

[0269] 3. Based on the instruction to enter the content generation application, the controller controls the display to display the operation interface of the content generation application.

[0270] 4. The display presents the operation page of the content generation application.

[0271] 5. The content generation application responds to the instruction to generate multimedia content and synchronizes the instruction to generate multimedia content to the controller.

[0272] 6. Based on the instruction to generate multimedia content, the controller controls the display to display an operation page for inputting multimedia themes and roles.

[0273] 7. The display sequentially presents operation pages for inputting multimedia themes and roles.

[0274] 8. The content generation application responds to the input target theme and target role of the multimedia content and synchronizes instructions for generating the target theme and target role of the multimedia content to the controller.

[0275] 9. The controller controls the display to display the target theme and the target role based on the instruction to generate the target theme and the target role of the multimedia content.

[0276] 10. The display presents the target subject and target role.

[0277] 11. The content generation application responds to the operation that triggers the role editing portal and synchronizes the instruction to generate the target role template to the controller.

[0278] 12. The controller determines the role description prompt information corresponding to the target role template based on the instruction for generating the target role template, and controls the display to display the role description prompt information.

[0279] 13. The display shows the role description prompt information.

[0280] 14. The content generation application responds to the operation of inputting the role description information and synchronizes the role description information to the controller.

[0281] 15. The controller controls the server to generate a target role template based on the role description information, and controls the display to display the target role template.

[0282] 16. The display presents the target role template.

[0283] 17. The controller controls the server to generate multimedia content based on the target role template.

[0284] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0285] Based on the same inventive concept, the embodiment of the present application also provides a role template generation device for implementing the role template generation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method. The specific limitations can be found in the above limitations on role template generation, which will not be repeated here.

[0286] In one embodiment, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above-mentioned method for generating a role template are implemented.

[0287] In one embodiment, the present application further provides a computer program product, including a computer program, which implements the steps of the above-mentioned role template generation method when executed by a processor.

[0288] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0289] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0290] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A display device, characterized in that: include: A controller, configured to receive a control signal from a control device, and control a display in the display device to display according to the control signal; The display is configured to display a character editing entry in the content generation application; The controller is further configured to: In response to a trigger operation on the role editing entry, when a target role is determined, role description prompt information is determined according to the target role; Controlling the display to present the role description prompt information; Receiving role description information corresponding to the role description prompt information; A target role template corresponding to the target role is generated according to the role description information; wherein the target role template is used to generate a role image of the target role in multimedia content.

2. The display device according to claim 1, characterized in that Before the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to: Controlling the display to present at least one template card of a preset role template in the content generation application; In response to a selection operation of a template card of a preset role template corresponding to the target role among the template cards, determining a role template to be adjusted; When the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to: The role template to be adjusted is updated according to the role description information to obtain a target role template corresponding to the target role.

3. The display device according to claim 2, characterized in that Each template card is associated with a role editing entry, and the role description prompt information includes at least one target role description item; When the controller responds to a trigger operation on the role editing entry, the controller is further configured to: In response to a triggering operation on a role editing entry associated with a template card of the role template to be adjusted; When the controller determines the role description prompt information according to the target role, the controller is further configured to: Controlling the display to present the role template to be adjusted corresponding to the target role; In response to the region selection operation on the to-be-adjusted role template, determining a to-be-adjusted role description item of the to-be-adjusted role template; Determining at least one target role description item according to the role description item to be adjusted; The role description prompt information is generated according to at least one target role description item.

4. The display device according to claim 1, characterized in that When the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to: Controlling the display to present a role guide card; wherein the role guide card is used to instruct to send a basic image for the target role to the display device via a mobile terminal; After receiving the basic image sent by the mobile terminal, a target role template corresponding to the target role is generated according to the basic image and the role description information.

5. The display device according to claim 1, characterized in that When the controller controls the display to present the role description prompt information, the controller is further configured to: Controlling the display to present a target role creation template; wherein the target role creation template includes role description prompt information; When the controller receives the role description information corresponding to the role description prompt information, the controller is further configured to: In response to an input operation on the role description prompt information, role description information corresponding to the role description prompt information is received.

6. The display device according to claim 1, characterized in that After executing the step of generating a target role template corresponding to the target role according to the role description information, the controller is further configured to: Obtaining a template card corresponding to the target role template; Controlling a display to present a template card corresponding to the target role template in the content generation application; When the template card corresponding to the target role template is in a selected state, if a content generation event is detected, a content generation instruction indicating the target role template is sent to the server; wherein the content generation instruction is used to instruct the server to generate the multimedia content according to the target role template; The display is controlled to present a playback entry for the multimedia content in the content generation application.

7. The display device according to claim 6, characterized in that Before executing sending a content generation instruction indicating the target role template to the server, the controller is further configured to: A controller display presents a theme editing entry in the content generation application; In response to an operation on the theme editing entry, receiving a target theme of the multimedia content to be generated; Correspondingly, when the controller sends a content generation instruction instructing the target role template to the server, it is also configured to: Sending a content generation instruction carrying the target subject and the target role and indicating the target role template to the server; The content generation instruction is used to instruct the server to generate text description information of the multimedia content according to the target theme and the target role, and to generate the multimedia content according to the text description information and the target role template.

8. The display device according to claim 1, characterized in that When the controller determines the role description prompt information according to the target role, the controller is further configured to: Selecting at least one reference role creation template that matches the target role from each candidate role creation template; wherein different reference role creation templates contain different role description prompt information; A target character creation template is selected from each reference character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template use information of each reference character creation template.

9. The display device according to claim 8, characterized in that Before executing the step of selecting a target character creation template from each reference character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference character creation template, the controller is further configured to: Controlling the display to present a theme editing entrance in the content generation application; In response to a trigger operation on the theme editing entry, receiving a target theme of the multimedia content to be generated; The controller is further configured to select a target role creation template from each reference role creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each reference role creation template: Selecting at least one candidate role creation template matching the target theme from each reference role creation template; A target character creation template is selected from each candidate character creation template according to at least one of the version information of the content generation application, the version information of the display, and the template usage information of each candidate character creation template.

10. The display device according to claim 1, characterized in that When the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to: A first role generation instruction carrying the role description information is sent to a server; wherein the first role generation instruction is used to instruct the server to call a target text graph model, and generate a target role template corresponding to the target role according to the role description information; wherein the target text graph model includes a text encoder, a denoising network, and an image generator.

11. The display device according to claim 10, characterized in that The text encoder is used to extract features from the role description information to obtain a text embedding vector; the denoising network is used to denoise the initial noisy image based on the text embedding vector to obtain a denoised image; the image generator is used to perform an image generation operation based on the denoised image to obtain a target role template corresponding to the target role.

12. The display device according to claim 10, characterized in that The target text graph model is trained by the following method: Get a sample person image; Extracting sample description information corresponding to the sample person image; According to the sample description information corresponding to the sample character image, a denoising network in the initial text image model is trained to obtain a predicted character image; Using a face recognition model, determining an image difference between the sample person image and the predicted person image; The model parameters of the denoising network in the initial text graph model are adjusted according to the image difference to obtain the target text graph model.

13. The display device according to claim 1, characterized in that When the controller generates a target role template corresponding to the target role according to the role description information, the controller is further configured to: A second role generation instruction carrying the role description information is sent to the server; wherein the second role generation instruction is used to instruct the server to select a target role image with the highest matching degree with the role description information from the candidate role images, and use the target role image as a target role template corresponding to the target role.

14. A method for generating a role template, characterized in that: The method is applied to a controller in a display device, the controller is used to receive a control signal of a control device, and control a display in the display device to display according to the control signal, and the method includes: In response to a trigger operation on a character editing entry displayed on the display in the content generation application, when a target character is determined, determining character description prompt information according to the target character; Controlling the display to present the role description prompt information; Receiving role description information corresponding to the role description prompt information; A target role template corresponding to the target role is generated according to the role description information; wherein the target role template is used to generate a role image of the target role in multimedia content.

Images