A multimedia interactive method, device, electronic device and storage medium

By displaying preset text and dynamic virtual characters in multimedia shooting, the problem of limited expression in existing technologies is solved, and richer content generation and interactive experience are achieved.

CN119967276BActive Publication Date: 2026-03-06BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-24
Publication Date
2026-03-06

AI Technical Summary

Technical Problem

Existing multimedia shooting methods are relatively fixed and monotonous in terms of expression and presentation, with poor interactive experience and a lack of personalization and richness.

Method used

During the shooting process, fixed text and virtual characters corresponding to preset special effects are displayed. The facial features of the virtual characters are determined based on the facial features of the subject being filmed. The physical text includes account, location, and event text. The virtual characters are always dynamic, and the text area is linked with the virtual characters. Voice changes and text switching are supported, and rich playback text is generated.

Benefits of technology

By adding personalized information through interactive operations, more excellent multimedia works can be generated, enhancing the richness of application content and page interactivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119967276B_ABST
    Figure CN119967276B_ABST
Patent Text Reader

Abstract

This disclosure relates to a multimedia interactive method, apparatus, electronic device, and storage medium. The method includes: in response to a shooting start command, displaying fixed text and a virtual character corresponding to preset special effects on a resource shooting page. The facial features of the virtual character are determined based on the facial features of the subject being shot. The fixed text includes at least one entity prompt text. Within each entity prompt text area, entity text and a corresponding entity image are displayed. The entity text includes at least one of account text, location text, and event text. The fixed text and the entity text corresponding to each entity prompt text constitute the playback text. During the shooting process, the virtual character is always in the first dynamic position. This application, based on preset special effects, adds more personalized information to the pre-set content through interactive operations, thereby generating more excellent works, enhancing the richness of content produced in the application, and improving page interactivity.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of Internet technology, and in particular to a multimedia interactive method, apparatus, electronic device and storage medium. Background Technology

[0002] With the rapid development of the mobile internet, information dissemination and multimedia interaction methods based on mobile terminals have become increasingly mature. Typically, multimedia resources can be shared and disseminated through various browsers or applications on a mobile device.

[0003] Currently, multimedia resource shooting can be based on the magic effects provided by the application. In related technologies, in order to enrich the content of the shooting footage, magic expressions including text, actions and expressions can be set in advance. However, this shooting method using magic expressions is still relatively fixed and monotonous in terms of expression and presentation, and the interactive experience of the shooting process is not good. Summary of the Invention

[0004] This disclosure provides a multimedia interactive method, apparatus, electronic device, and storage medium. The technical solution of this disclosure is as follows:

[0005] According to a first aspect of the present disclosure, a multimedia interaction method is provided, comprising:

[0006] In response to the start shooting command, the fixed text and virtual character corresponding to the preset effects are displayed on the resource shooting page; the facial features of the virtual character are determined based on the facial features of the subject being shot; the fixed text includes at least one entity prompt text.

[0007] The entity text and its corresponding entity image are displayed in the area corresponding to each entity prompt text; the entity text includes at least one of account text, location text, and event text; the fixed text and the entity text corresponding to each entity prompt text constitute the playback text; during the shooting process, the virtual character is always in the first dynamic position.

[0008] In some possible embodiments, at least one entity prompt text includes account prompt text, location prompt text, and event prompt text; the entity text includes account text, location text, and event text;

[0009] Display the entity text and its corresponding entity image within the area corresponding to each entity prompt text, including:

[0010] In response to the first display command, the account text and the corresponding account image are displayed in the account area corresponding to the account prompt text.

[0011] In response to the second display command, the location text and the corresponding location image are displayed in the location area corresponding to the location prompt text;

[0012] In response to the third display instruction, the event text and the corresponding event image are displayed in the event area corresponding to the event prompt text.

[0013] In some possible embodiments,

[0014] The first display instruction is a display instruction triggered by the first operation, the second display instruction is a display instruction triggered by the second operation, and the third display instruction is a display instruction triggered by the third operation;

[0015] The first display instruction is triggered when the first time period ends, the second display instruction is triggered when the second time period ends, and the third display instruction is triggered when the third time period ends; the first time period, the second time period, and the third time period have a temporal order.

[0016] In some possible embodiments, the entity text and the corresponding entity image are displayed within the area corresponding to each entity hint text, including:

[0017] Display the entity text and its corresponding entity image within the area corresponding to each entity's prompt text;

[0018] In response to the text switching command corresponding to the entity text to be switched, display the switched entity text and the entity image corresponding to the switched entity text;

[0019] The entity text to be switched is at least one of the following: account text, location text, and event text.

[0020] In some possible embodiments, the resource capture page includes a text area; playback text is displayed in the text area;

[0021] There is a linkage between the text area and the virtual character; the linkage indicates that the position of the text area on the resource shooting page changes with the position of the preset part of the virtual character.

[0022] In some possible embodiments, after displaying the entity text and the corresponding entity image within the area corresponding to each entity hint text, the method further includes:

[0023] In response to the end-of-shoot command, the virtual character in first-motion mode is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page;

[0024] The multiple entity texts and their corresponding entity images contained in the playback text are displayed sequentially in the text area.

[0025] The position of the text area on the resource preview page changes according to the position of the virtual character's preset parts.

[0026] In some possible embodiments, when the first voice information is acquired during filming, in response to a filming end command, a virtual character in a first dynamic state is displayed on the resource preview page and playback text is displayed in the text area of ​​the resource preview page, including:

[0027] In response to the end-of-shoot command, the virtual character in the first dynamic pose is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice message is played.

[0028] The first audio information is the audio information generated by the subject reading and playing text.

[0029] In some possible embodiments, in response to a shooting end command, a virtual character in a first dynamic pose is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as first audio information is played, including:

[0030] In response to the end-of-shoot command, a voice change control is displayed on the resource preview page;

[0031] In response to a voice change command triggered by a voice change control, the first voice information is processed to obtain the second voice information; the voice processing includes at least one of timbre change, volume change, and speech rate change;

[0032] During the first preview period, the virtual character in the first dynamic state is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice information is played.

[0033] In some possible embodiments, the method further includes:

[0034] During the second preview period, a virtual character in a second dynamic state is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as second voice information is played.

[0035] The first preview period is before the second preview period.

[0036] In some possible embodiments, the virtual character is the first virtual character corresponding to the shooting account; the method further includes:

[0037] During the third preview period, the first and second virtual characters located in the target scene are displayed on the resource preview page;

[0038] The second virtual character is the virtual character corresponding to the account text;

[0039] The target scene is generated based on location text and event text;

[0040] The actions of the first and second virtual characters in the target scene are determined based on event text.

[0041] In some possible embodiments, the resource preview page also includes a publishing control; the method further includes:

[0042] Responding to the publish control triggered by the publish control, publish the resource to be published based on the playing text and virtual character, and obtain the target resource.

[0043] In some possible implementations, the account text is used to prompt the client corresponding to the account text after the resource to be published has been published.

[0044] According to a second aspect of the present disclosure, a multimedia interactive device is provided, comprising:

[0045] The first display module is configured to respond to the shooting start command by displaying fixed text and a virtual character corresponding to preset effects on the resource shooting page; the facial features of the virtual character are determined based on the facial features of the subject being shot; the fixed text includes at least one entity prompt text.

[0046] The second display module is configured to display entity text and entity images corresponding to each entity prompt text within the area corresponding to each entity prompt text; the entity text includes at least one of account text, location text, and event text; the fixed text and the entity text corresponding to each entity prompt text constitute the playback text; during the shooting process, the virtual character is always in the first dynamic position.

[0047] In some possible embodiments, at least one entity prompt text includes account prompt text, location prompt text, and event prompt text; the entity text includes account text, location text, and event text;

[0048] The second display module is configured to execute:

[0049] In response to the first display command, the account text and the corresponding account image are displayed in the account area corresponding to the account prompt text.

[0050] In response to the second display command, the location text and the corresponding location image are displayed in the location area corresponding to the location prompt text;

[0051] In response to the third display instruction, the event text and the corresponding event image are displayed in the event area corresponding to the event prompt text.

[0052] In some possible embodiments,

[0053] The first display instruction is a display instruction triggered by the first operation, the second display instruction is a display instruction triggered by the second operation, and the third display instruction is a display instruction triggered by the third operation;

[0054] The first display instruction is triggered when the first time period ends, the second display instruction is triggered when the second time period ends, and the third display instruction is triggered when the third time period ends; the first time period, the second time period, and the third time period have a temporal order.

[0055] In some possible embodiments, the second display module is configured to perform:

[0056] Display the entity text and its corresponding entity image within the area corresponding to each entity's prompt text;

[0057] In response to the text switching command corresponding to the entity text to be switched, display the switched entity text and the entity image corresponding to the switched entity text;

[0058] The entity text to be switched is at least one of the following: account text, location text, and event text.

[0059] In some possible embodiments, the resource capture page includes a text area; playback text is displayed in the text area;

[0060] There is a linkage between the text area and the virtual character; the linkage indicates that the position of the text area on the resource shooting page changes with the position of the preset part of the virtual character.

[0061] In some possible embodiments, the apparatus further includes a third display module; the third display module is configured to perform:

[0062] In response to the end-of-shoot command, the virtual character in first-motion mode is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page;

[0063] The multiple entity texts and their corresponding entity images contained in the playback text are displayed sequentially in the text area.

[0064] The position of the text area on the resource preview page changes according to the position of the virtual character's preset parts.

[0065] In some possible embodiments, when the first voice information is acquired during the shooting process, the third display module is configured to perform:

[0066] In response to the end-of-shoot command, the virtual character in the first dynamic pose is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice message is played.

[0067] The first audio information is the audio information generated by the subject reading and playing text.

[0068] In some possible embodiments, the third display module is configured to perform:

[0069] In response to the end-of-shoot command, a voice change control is displayed on the resource preview page;

[0070] In response to a voice change command triggered by a voice change control, the first voice information is processed to obtain the second voice information; the voice processing includes at least one of timbre change, volume change, and speech rate change;

[0071] During the first preview period, the virtual character in the first dynamic state is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice information is played.

[0072] In some possible embodiments, the third display module is configured to perform:

[0073] During the second preview period, a virtual character in a second dynamic state is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as second voice information is played.

[0074] The first preview period is before the second preview period.

[0075] In some possible embodiments, the virtual character is the first virtual character corresponding to the shooting account; the third display module is configured to perform:

[0076] During the third preview period, the first and second virtual characters located in the target scene are displayed on the resource preview page;

[0077] The second virtual character is the virtual character corresponding to the account text;

[0078] The target scene is generated based on location text and event text;

[0079] The actions of the first and second virtual characters in the target scene are determined based on event text.

[0080] In some possible embodiments, the resource preview page also includes a publishing control; the apparatus also includes a publishing module; the publishing module is configured to perform:

[0081] Responding to the publish control triggered by the publish control, publish the resource to be published based on the playing text and virtual character, and obtain the target resource.

[0082] In some possible implementations, the account text is used to prompt the client corresponding to the account text after the resource to be published has been published.

[0083] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the method as described in any of the first aspects above.

[0084] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided such that, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method of any one of the first aspects of the present disclosure.

[0085] According to a fifth aspect of the present disclosure, a computer program product is provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the computer device to perform the method of any one of the first aspects of the present disclosure.

[0086] The technical solutions provided by the embodiments of this disclosure bring at least the following beneficial effects:

[0087] In response to the start-of-shoot command, fixed text and a virtual character corresponding to preset effects are displayed on the resource shooting page. The facial features of the virtual character are determined based on the facial features of the subject being shot. The fixed text includes at least one entity prompt text. Within the area corresponding to each entity prompt text, entity text and its corresponding entity image are displayed. The entity text includes at least one of account text, location text, and event text. The fixed text and the entity text corresponding to each entity prompt text constitute the playback text. During shooting, the virtual character remains in the first dynamic position. This embodiment of the application, based on preset effects, adds more personalized information to the pre-set content through interactive operations, thereby generating more excellent works, enriching the content produced in the application, making the most rational use of information resources, and improving page interactivity.

[0088] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0089] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0090] Figure 1 This is a schematic diagram illustrating an application environment of a multimedia interactive method according to an exemplary embodiment;

[0091] Figure 2 This is a flowchart illustrating a multimedia interaction method according to an exemplary embodiment;

[0092] Figure 3 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 1 ;

[0093] Figure 4 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 2 ;

[0094] Figure 5 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 3 ;

[0095] Figure 6 This is a schematic diagram illustrating the element changes of a resource shooting page according to an exemplary embodiment;

[0096] Figure 7 This is a schematic diagram illustrating the element changes of a resource shooting page according to an exemplary embodiment;

[0097] Figure 8 This is a flowchart illustrating a multimedia interaction method according to an exemplary embodiment;

[0098] Figure 9 This is a schematic diagram illustrating the element changes of a resource preview page according to an exemplary embodiment;

[0099] Figure 10 This is a block diagram illustrating a multimedia interactive device according to an exemplary embodiment;

[0100] Figure 11 This is a block diagram illustrating an electronic device for multimedia interaction according to an exemplary embodiment. Detailed Implementation

[0101] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0102] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar first objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0103] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0104] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating an application environment of a multimedia interactive method according to an exemplary embodiment, such as... Figure 1 As shown, the application environment may include server 011, first client 012, and second client 013.

[0105] In some possible embodiments, server 011 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The operating system running on the server may include, but is not limited to, Android, iOS, Linux, Windows, Unix, etc.

[0106] In some possible embodiments, the first client 012 and the second client 013 described above may include, but are not limited to, image-type clients such as smartphones, desktop computers, tablets, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices. They may also be software running on the aforementioned clients, such as applications or mini-programs. Optionally, the operating system running on the client may include, but is not limited to, Android, iOS, Linux, Windows, and Unix systems.

[0107] In some possible embodiments, the first client 012 can respond to a shooting start command by displaying fixed text and a virtual character corresponding to preset effects on the resource shooting page. The facial features of the virtual character are determined based on the facial features of the subject being shot. The fixed text includes at least one entity prompt text. Within each entity prompt text area, entity text and a corresponding entity image are displayed. The entity text includes at least one of account text, location text, and event text. The fixed text and the entity text corresponding to each entity prompt text constitute the playback text. During the shooting process, the virtual character remains in the first dynamic position. This application embodiment, based on preset effects, adds more personalized information to the pre-set content through interactive operations, thereby generating more excellent works, enriching the content produced in the application, making the most rational use of information resources, and improving page interactivity.

[0108] In one exemplary implementation, both the client and server databases can be node devices in the blockchain system, capable of sharing acquired and generated information with other node devices within the blockchain system, thus enabling information sharing among multiple node devices. Multiple node devices in the blockchain system can be configured with the same blockchain, which consists of multiple blocks. Adjacent blocks are related, ensuring that any data tampering in any block can be detected by the next block, thereby preventing data tampering and guaranteeing the security and reliability of the data in the blockchain.

[0109] Figure 2 This is a flowchart illustrating a multimedia interaction method according to an exemplary embodiment. It should be noted that this specification provides the operational steps of the method as described in the embodiments or flowcharts, but based on conventional or non-inventive labor, more or fewer operational steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many steps and does not represent the only execution order. In actual system or product execution, the method can be executed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment) as shown in the embodiments or drawings. Specifically, as... Figure 2 As shown, this flowchart includes at least the following steps S201-S203:

[0110] In step S201, in response to the shooting start command, fixed text and virtual characters corresponding to preset effects are displayed on the resource shooting page; the facial features of the virtual characters are determined based on the facial features of the subject being shot; the fixed text includes at least one entity prompt text.

[0111] In this embodiment, the subject of execution for steps S201 to S203 and the embodiments extended from steps S201 to S203 is a first client, on which a first account created by a first user may exist. Correspondingly, a second client may also exist, on which a second account created by a second user may exist.

[0112] In this embodiment, the first client and the second client can be the same application installed on different terminals. For example, the first client and the second client may correspond to the same instant messaging application, the same short video application, or the same lifestyle service application, etc.

[0113] In this embodiment of the application, the first client may be a client that publishes the target resource, and the second client may be a client that browses the published target resource.

[0114] In this embodiment of the application, the resource shooting page may refer to a page used for shooting multimedia resources, such as the short video shooting page in a short video application. Figure 3 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 1 ,like Figure 3 As shown, it includes a resource shooting page 300 and shooting controls 301 and special effects controls 302 located on the resource shooting page 300.

[0115] Optionally, the shooting control 301 is used to be triggered to start shooting. Alternatively, the shooting control 301 is used to be triggered to end shooting during the shooting process.

[0116] Optionally, the effects control 302 is triggered to display multiple usable effects on the resource shooting page. The preset effects mentioned above are one of the multiple usable effects after the effects control is expanded. In some possible embodiments, the aforementioned effects control may also be referred to as a magic control.

[0117] Optionally, the resource shooting page may also include other controls located on the right side of the page. These other controls may include camera flip controls, countdown controls, face beautification controls, sticker controls, etc.

[0118] In some possible embodiments, the client, in response to a display instruction on the resource capture page, may display something like... Figure 3 The resource capture page is shown below. Optionally, when displaying the resource capture page, the client can use the front-facing camera to capture images in real time. In this case, the captured images can be displayed on the resource capture page. For example, the captured images can be images of the subject being captured.

[0119] Optionally, in response to effects display commands triggered by effects controls, the client can display multiple usable effects on the resource display page. When the client detects that a preset effect among the multiple usable effects has been selected (i.e., the screen area corresponding to the preset effect has been clicked), sample resources can be displayed on the resource capture page.

[0120] In this embodiment of the application, the sample resource may be a video, audio and video, text and images, a single image, or a collection of images.

[0121] Optionally, the sample resource may contain similar or identical elements to the final published resource. In this embodiment, the sample resource is used to provide reference information for generating the published resource. That is, the sample resource can be used to show the user what the generated published resource looks like and what content it may contain.

[0122] In some possible embodiments, the sample resources include fixed text corresponding to preset special effects and virtual characters, wherein the facial features of the virtual characters can be determined based on the facial features of the subject being filmed in real time. The subject being filmed can be the owner of the first device on which the first client is located, that is, the subject being filmed can be the person using the first device on which the first client is located.

[0123] In this embodiment, in response to a shooting start command, the client can display fixed text and a virtual character corresponding to preset effects on the resource shooting page. Specifically, when the client detects that the shooting control on the resource shooting page is triggered (e.g., clicked or double-clicked by the user), it can trigger a shooting start command, and the client can display fixed text and a virtual character corresponding to preset effects on the resource shooting page in response to the shooting start command.

[0124] Figure 4 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 2 ,like Figure 4 As shown, it includes a resource shooting page 300 and shooting controls 301, a text area 400, a virtual character 303, and fixed text 401 located in the text area 400.

[0125] In this embodiment, the shooting control 301 may carry a timing attribute. Optionally, when the shooting control is triggered to cause the client to start shooting, the shooting control may be... Figure 3 The first state shown is switched to Figure 4 The second state is shown. In this second state, the edge of the shooting control can display a timing element to indicate how long the current shooting time has been.

[0126] In this embodiment of the application, the client can display the following on the resource shooting page: Figure 4The virtual character 303 shown. Optionally, the virtual character's facial features or parts thereof (e.g., Figure 4 The eyes and mouth shown can be determined based on the facial features or parts thereof of the subject captured in real-time and recorded by the client. Optionally, in the virtual character, parts other than the facial features or parts thereof can be pre-set to be uniform.

[0127] In this embodiment of the application, the client can display a text area 400 on the resource shooting page, and display fixed text 401 in the text area 400. For example... Figure 4 As shown, the fixed text could be "This year during Chinese New Year I will be doing [something]".

[0128] In some possible implementations, the fixed text can be the playback text in the final published resource. That is, the fixed text that appears at the beginning of shooting is the entire text.

[0129] In other possible embodiments, the fixed text may be a portion of the play text in the final published resource. Optionally, the fixed text may include entity cue text.

[0130] In this embodiment, the number of entity prompt texts can be one or more. Optionally, the number of entity prompt texts can be determined based on a setting.

[0131] In this embodiment of the application, entity hint text is used to indicate possible entity text. According to... Figure 4 The entity prompt text can be "and", "at", or "do". Based on the semantics of the entity prompt text "and" and the semantics of "I will this year", it can be deduced that what follows the entity prompt text "and" can be a person's name, object name, or account name. Similarly, based on the semantics of the entity prompt text "at", it can be deduced that what follows the entity prompt text "at" can be a location name or place name. Likewise, based on the semantics of the entity prompt text "and", it can be deduced that what follows the entity prompt text "do" can be an action name or event name.

[0132] In step S203, the entity text and the entity image corresponding to the entity text are displayed in the area corresponding to each entity prompt text; the entity text includes at least one of account text, location text and event text; the fixed text and the entity text corresponding to each entity prompt text constitute the playback text; during the shooting process, the virtual character is always in the first dynamic position.

[0133] In this embodiment, in response to a shooting start command, the client can display fixed text and a virtual character corresponding to a preset effect on the resource shooting page, including at least one entity prompt text. Then, the client can display entity text and a corresponding entity image within the area corresponding to each entity prompt text. The entity text includes at least one of account text, location text, and event text.

[0134] Optionally, the number of entity texts corresponds to the number of entity hint texts.

[0135] In some possible embodiments, at least one entity prompt text may include account prompt text, location prompt text, and event prompt text. Thus, the entity text may include account text, location text, and event text. That is, the account prompt text "and" can correspond to account text, the location prompt text "at" can correspond to location text, and the event prompt text "do" can correspond to event text.

[0136] In this embodiment of the application, the client can display the account text and the account image corresponding to the account text in the area corresponding to the account prompt text, display the location text and the location image corresponding to the location text in the location prompt text area, and display the event text and the event image corresponding to the event text in the event prompt text area.

[0137] Figure 5 This is a schematic diagram of a resource capture page according to an exemplary embodiment. Figure 3 ,like Figure 5 As shown, it includes a resource shooting page 300 and a shooting control 301, a text area 400 and a virtual character 303 located on the resource shooting page 300, and fixed text 401, physical text 402 and physical image 403 located in the text area 400.

[0138] In some possible embodiments, the text area can display the corresponding three entity texts 402 and the corresponding three entity images 403 in the areas corresponding to the three entity prompt texts, namely "and", "at", and "do". Optionally, such as Figure 5 As shown, each entity text can be displayed on top of the entity image corresponding to that entity text. Optionally, each entity text can be displayed above the entity image corresponding to that entity text. This disclosure does not restrict the specific positions of the entity text and entity image.

[0139] Figure 6 This is a schematic diagram illustrating the element changes of a resource shooting page according to an exemplary embodiment, such as... Figure 6As shown, there are two resource capture pages before and after displaying three entity texts 402 and three corresponding entity images 403 in the text area.

[0140] In this embodiment of the application, before the three entity texts 402 and the corresponding three entity images 403 are displayed in the text area, in response to the shooting start command, the client can display fixed text and a virtual character corresponding to the preset special effects on the resource shooting page, which includes at least one entity prompt text. At this time, Figure 6 In the resource shooting page on the left, images continuously scroll across the three areas corresponding to the three entity prompt texts. Then, responding to the first display instruction, the account text and its corresponding account image are displayed in the account area corresponding to the account prompt text. Responding to the second display instruction, the location text and its corresponding location image are displayed in the location area corresponding to the location prompt text. Responding to the third display instruction, the event text and its corresponding event image are displayed in the event area corresponding to the event prompt text. After the three entity texts and three entity images are determined, the following can be displayed: Figure 6 As shown, this is the resource capture page on the right.

[0141] In some possible embodiments, the first display instruction, the second display instruction, and the third display instruction are all triggered based on a preset operation. Optionally, the first display instruction is a display instruction triggered by a first operation, the second display instruction is a display instruction triggered by a second operation, and the third display instruction is a display instruction triggered by a third operation. Optionally, the first operation, the second operation, and the third operation are all operations such as clicking the screen or double-clicking the screen.

[0142] Specifically, as the image scrolls through the three areas corresponding to the three entity prompt texts, when the client detects the first operation, it can generate the first display command. At this time, the image in the first area corresponding to the account prompt text stops scrolling, displaying the final account text "@AAA" and the account image, i.e., the avatar of account "AAA". During this process, the images in the second area corresponding to the location prompt text and the third area corresponding to the event prompt text continue scrolling. Next, when the client detects the second operation, it can generate the second display command. At this time, the image in the second area corresponding to the location prompt text stops scrolling, displaying the final location text "in the snow" and the location image, i.e., an image of a snow scene. During this process, the image in the third area corresponding to the event prompt text continues scrolling. Next, when the client detects the third operation, it can generate the third display command. At this time, the image in the third area corresponding to the event prompt text stops scrolling, resulting in the final event text "building a snowman" and the event image, i.e., an image related to building a snowman.

[0143] In some other possible embodiments, the first display instruction, the second display instruction, and the third display instruction are all triggered based on time. Optionally, the first display instruction is triggered at the end of a first time period, the second display instruction is triggered at the end of a second time period, and the third display instruction is triggered at the end of a third time period. The first, second, and third time periods are arranged in a specific temporal order.

[0144] Specifically, as the image scrolls through the three areas corresponding to the three entity prompt texts, when the client detects that the first time period is about to end, it can generate the first display command. At this time, the image in the first area corresponding to the account prompt text can stop scrolling, displaying the final account text "@AAA" and the account image, i.e., the avatar of account "AAA". During this process, the images in the second area corresponding to the location prompt text and the third area corresponding to the event prompt text continue scrolling. Next, when the client detects that the second time period is about to end, it can generate the second display command. At this time, the second image in the area corresponding to the location prompt text can stop scrolling, displaying the final location text "in the snow" and the location image, i.e., an image of a snow scene. During this process, the third image in the area corresponding to the event prompt text continues scrolling. Next, when the client detects that the third time period is about to end, it can generate the third display command. At this time, the third image in the area corresponding to the event prompt text can stop scrolling, resulting in the final event text "building a snowman" and the event image, i.e., an image related to building a snowman.

[0145] The above implementation plan, through the application of special effects, can enrich the expression and presentation of shooting resources, while improving the interactive experience of the shooting process.

[0146] In this embodiment of the application, after the client displays the entity text and the entity image corresponding to the entity text in the area corresponding to each entity prompt text, it can also change a certain entity text and the entity image corresponding to the entity text based on a switching command.

[0147] In some possible embodiments, in response to a text switching instruction corresponding to the entity text to be switched, the client can display the switched entity text and the entity image corresponding to the switched entity text. The entity text to be switched can be at least one of account text, location text, and event text.

[0148] The following example uses account text. After displaying the entity text and its corresponding image within the area corresponding to each entity prompt text, if you want to change the account text, you can click on the screen position corresponding to the first area where the account text is located. At this point, the client detects that the screen position corresponding to the first area where the account text is located has been clicked, and can then resume scrolling the account text and account image. After a preset time period, scrolling stops, and the new account text and account image are displayed. Thus, the fixed text and the entity text obtained after the text switching action together form the final playback text for the resource to be published.

[0149] The above implementation scheme can provide users with the opportunity to switch between text options, thereby improving the interactivity of the page.

[0150] In some possible embodiments, in response to a shooting end command, the client can stop shooting and obtain preview resources.

[0151] In this embodiment, during the filming process, the virtual character can remain stationary, such as standing at attention. Alternatively, the virtual character can always maintain a primary dynamic pose. Optionally, the primary dynamic pose could be walking forward while carrying a backpack.

[0152] In some possible embodiments, the text area and the virtual character are linked, wherein the linkage indicates that the position of the text area on the resource shooting page changes with the position of a preset part of the virtual character.

[0153] Figure 7 This is a schematic diagram illustrating the element changes of a resource shooting page according to an exemplary embodiment, such as... Figure 7 As shown, there are two resource shooting pages, one before and one after the preset parts of the virtual character have changed.

[0154] Optionally, the default part of the virtual character is the entire virtual character; alternatively, the default part of the virtual character is a specific part of the virtual character, such as the head.

[0155] Figure 7 On the resource shooting page on the left side, from a visual perspective, the virtual character is quite close to the user, so the text area above the virtual character's head occupies a large space. Figure 7 On the right side of the resource shooting page, from a visual perspective, the virtual character is quite far from the user; therefore, the text area above the virtual character's head occupies a relatively small space. In summary, the positions of the two text areas on the resource shooting page also differ.

[0156] Optionally, as the virtual character walks forward with a backpack, there is a possibility that its head may tilt to the left or right. Therefore, the text area above the virtual character's head may also be displayed as tilted to the left or right.

[0157] In this way, the interaction between text areas and virtual characters can increase the fun of elements on the page and enhance the realism of animation effects.

[0158] In some possible embodiments, the aforementioned end-of-shoot instruction can be triggered by a shooting control on the resource shooting page. Specifically, after displaying the entity text and its corresponding entity image in the area corresponding to each entity prompt text, when the client detects that the shooting control has been clicked again, the client can trigger the generation of an end-of-shoot instruction. In this way, the client can stop shooting, display the first animated virtual character on the resource preview page, and display the playback text in the text area of ​​the resource preview page.

[0159] In other possible embodiments, the aforementioned end-of-shoot instruction can be triggered by a countdown timer on the shooting control. Specifically, after displaying the entity text and its corresponding entity image in the area corresponding to each entity prompt text, when the client detects the countdown has ended, the client can trigger the generation of an end-of-shoot instruction. This allows the client to stop shooting, display the first animated virtual character on the resource preview page, and display the playback text in the text area of ​​the resource preview page.

[0160] The playback text includes a fixed text preset with special effects, and multiple entity texts and corresponding entity images that are subsequently scrolled and displayed in sequence.

[0161] Optionally, the resource preview page mentioned above can be the same page as the resource shooting page. Optionally, the resource preview page mentioned above can be switched between the resource shooting page and the resource shooting page.

[0162] In some optional embodiments, the process of sequentially scrolling multiple entity texts and multiple entity images corresponding to the multiple entity texts on the resource preview page can be the same as the process of sequentially scrolling multiple entity texts and multiple entity images corresponding to the multiple entity texts on the resource shooting page during the shooting process.

[0163] In some alternative embodiments, if there are entity text and entity images obtained by switching based on the switching command, the process of sequentially scrolling multiple entity texts and multiple entity images corresponding to multiple entity texts on the resource preview page can be roughly the same as the process of sequentially scrolling multiple entity texts and multiple entity images corresponding to multiple entity texts on the resource shooting page during the shooting process, that is, directly displaying the switching result without displaying the switching process.

[0164] For example, suppose the process of capturing multiple entity texts and their corresponding entity images displayed sequentially is as follows: First, the account text "@AAA" and the account image (the avatar of account "AAA") are displayed. Next, the location text "in the snow" and the location image (an image of a snowy scene) are displayed. Finally, the event text "building a snowman" and the event image (an image related to building a snowman) are displayed. Then, based on a switching command, the account text "@AAA" and the account image (the avatar of account "AAA") are switched to the account text "@BBB" and the account image (the avatar of account "BBB"). The preview process for the sequentially scrolling multiple entity texts and their corresponding entity images is then as follows: First, the account text "@BBB" and the account image (the avatar of account "BBB") are displayed. Next, the location text "in the snow" and the location image (an image of a snowy scene) are displayed. Finally, the event text "building a snowman" and the event image (an image related to building a snowman) are displayed.

[0165] Optionally, during the preview process of the resource, the position of the text area on the resource preview page also changes according to the position of the preset parts of the virtual character.

[0166] In this embodiment of the application, voice information can also be acquired during the shooting process. For example, if the user reads the text being played during the shooting process, the client can record the user's voice to obtain the first voice information.

[0167] In this embodiment, when the first voice information is acquired during the shooting process, if the client detects that the shooting control has been clicked again, or if the client detects that the countdown has ended, the client can trigger the generation of a shooting end command. Thus, the client can stop shooting, display a virtual character in a first dynamic state on the resource preview page, display playback text in the text area of ​​the resource preview page, and play the first voice information. Optionally, the first voice information is the voice information generated by the subject reading the playback text.

[0168] In this embodiment of the application, in order to increase the fun of the resources to be released based on preset special effects and to carry more interactive elements, the process of displaying a virtual character in the first dynamic state on the resource preview page and displaying playback text in the text area of ​​the resource preview page and playing the first voice information can be the process of previewing the first part of the resource, and can also include other parts processed based on the first part.

[0169] Figure 8 This is a flowchart illustrating a multimedia interactive preview method according to an exemplary embodiment, such as... Figure 8 As shown, it includes at least:

[0170] In step S801, in response to the shooting end command, a voice change control is displayed on the resource preview page.

[0171] Optionally, when the client detects that the shooting control has been clicked again, the client can trigger the generation of a shooting end command, so that the client can stop shooting and display the voice change control on the resource preview page.

[0172] Alternatively, when the client detects that the countdown has ended, it can trigger a shooting end command, thus stopping the shooting and displaying a voice change control on the resource preview page.

[0173] In step S803, in response to a voice change instruction triggered by a voice change control, the first voice information is processed to obtain the second voice information; the voice processing includes at least one of timbre change, volume change, and speech rate change.

[0174] In some possible embodiments, if the client records the user's voice during the shooting process and obtains the first voice information, the client can perform voice processing on the first voice information to obtain the second voice information.

[0175] In some possible embodiments, if the first voice information obtained by the client is complete first voice information, such as the first voice information "This year during the Spring Festival, I will build a snowman with AAA in the snow", then the client can perform one or more of the following processing on the first voice information: timbre change, volume change, and speech rate change to obtain the second voice information.

[0176] In some other possible embodiments, if the first voice information obtained by the client is incomplete, such as the first voice information "This year during Chinese New Year, I will build a snowman with AAA in the snow," the client can first complete the first voice information to obtain the complete first voice information "This year during Chinese New Year, I will build a snowman with AAA in the snow." Then, the client can perform one or more of the following processing on the complete first voice information: timbre change, volume change, and speech rate change, to obtain the second voice information.

[0177] In some other possible embodiments, if the first voice information is not acquired during the shooting process, the client can process the played text using at least one of preset timbre, preset volume, and preset speech rate to obtain the second voice information.

[0178] In the embodiments of this application, Figures 5-7The displayed text, "This year during Chinese New Year, I will build a snowman with AAA in the snow," is clearly grammatically incorrect, containing an extra verb, "build." Based on this, the client can preprocess the text to obtain a coherent version, namely the audio text, "This year during Chinese New Year, I will build a snowman with AAA in the snow." Subsequently, the client can further process the audio text based on at least one of preset timbre, preset volume, and preset speech rate to obtain the second audio information.

[0179] In step S805, during the first preview time period, a virtual character in the first dynamic state is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as the first voice information is played.

[0180] In this embodiment of the application, the client can display a virtual character in a first dynamic state on the resource preview page and display playback text in the text area of ​​the resource preview page, as well as play the first voice information, during the first preview time period.

[0181] Optionally, in the absence of a physical transition, the virtual character displayed in the first dynamic pose on the resource preview page and the playback text displayed in the text area of ​​the resource preview page can be the same as during filming.

[0182] In step S807, during the second preview time period, a virtual character in a second dynamic state is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as second voice information is played; the first preview time period is located before the second preview time period.

[0183] Next, during a second preview period following the first preview period, the client can display a second animated virtual character on the resource preview page, display playback text in the text area of ​​the resource preview page, and play second voice information.

[0184] Figure 9 This is a schematic diagram illustrating the element change process of a resource preview page according to an exemplary embodiment, such as... Figure 9 As shown, this includes the performance of the virtual character during the first preview period and the performance of the virtual character during the second preview period.

[0185] Optionally, the virtual character in the first preview period is shown walking forward with a backpack, and the virtual character in the second preview period is shown running forward with a backpack.

[0186] Optionally, the second voice information in the second preview time period can have a faster speaking speed, a higher volume, and a more enthusiastic and excited tone compared to the first voice information in the first preview time period.

[0187] Optionally, the position of the text area on the resource preview page during the second preview period can also change with the position of the virtual character's preset parts.

[0188] In step S809, during the third preview time period, a first virtual character and a second virtual character located in the target scene are displayed on the resource preview page; wherein, the virtual character is the first virtual character corresponding to the shooting account; the second virtual character is the virtual character corresponding to the account text; the target scene is generated based on location text and event text; the actions of the first virtual character and the second virtual character in the target scene are determined based on the event text.

[0189] In some possible embodiments, the preview resource may include content for a first preview time period. In some possible embodiments, the preview resource may include content for a first preview time period and content for a second preview time period.

[0190] In some possible embodiments, the preview resource may include content for a first preview time period, content for a second preview time period, and content for more preview time periods.

[0191] Optionally, the client can display a first virtual character and a second virtual character located in the target scene on the resource preview page during the third preview period. The first virtual character is the one corresponding to the shooting account, and the second virtual character is the one corresponding to the account text. The target scene is generated based on location text and event text, and the actions of the first and second virtual characters in the target scene are determined based on the event text.

[0192] For example, the first virtual character can be the shooting account, that is, the virtual character corresponding to the account of the first device, and the second virtual character can be the virtual character corresponding to the account text.

[0193] Optionally, if multiple account texts exist, such as "@AAA" and "@BBB", then multiple second virtual characters corresponding to multiple account texts can appear.

[0194] Optionally, if the location text is "in the snow" and the event text is "building a snowman", a snowy background can be generated on the resource preview page based on the location text "in the snow" and the event text "building a snowman". A snowman exists in the snowy background, and then the first virtual character and the second virtual character can build a snowman in the scene.

[0195] Optionally, in the resource preview scene during the third preview period, account information can be marked above the head of each virtual character.

[0196] In some possible embodiments, the resource preview page also includes a publish control. Optionally, in response to a publish control triggered by the publish control, the client can publish the resource to be published based on the playback text and virtual character, thereby obtaining the target resource.

[0197] In this embodiment, the account text is used to notify the client corresponding to the account text after the resource to be published is published. That is, when the first client publishes the target resource, the server can send a notification message to the second device where the second client corresponding to the account text is located, so that the user corresponding to the account text can view the target resource based on preset effects.

[0198] In summary, this application embodiment, based on preset special effects, adds more personalized information to the content set in advance through interactive operations, thereby generating more excellent works, enhancing the richness of the content produced in the application, making the most rational use of information resources, and improving page interactivity.

[0199] Figure 10 This is a block diagram illustrating a multimedia interactive device according to an exemplary embodiment. It has the functionality to implement the data processing method in the above-described method embodiments; the functionality can be implemented in hardware or by hardware executing corresponding software. (Refer to...) Figure 10 The device includes a first display module 1001 and a second display module 1002:

[0200] The first display module 1001 is configured to respond to a shooting start command by displaying fixed text and a virtual character corresponding to preset effects on a resource shooting page; the facial features of the virtual character are determined based on the facial features of the subject being shot; the fixed text includes at least one entity prompt text.

[0201] The second display module 1002 is configured to display entity text and entity images corresponding to each entity prompt text within the area corresponding to each entity prompt text; the entity text includes at least one of account text, location text, and event text; the fixed text and the entity text corresponding to each entity prompt text constitute the playback text; during the shooting process, the virtual character is always in the first dynamic position.

[0202] In some possible embodiments, at least one entity prompt text includes account prompt text, location prompt text, and event prompt text; the entity text includes account text, location text, and event text;

[0203] The second display module is configured to execute:

[0204] In response to the first display command, the account text and the corresponding account image are displayed in the account area corresponding to the account prompt text.

[0205] In response to the second display command, the location text and the corresponding location image are displayed in the location area corresponding to the location prompt text;

[0206] In response to the third display instruction, the event text and the corresponding event image are displayed in the event area corresponding to the event prompt text.

[0207] In some possible embodiments,

[0208] The first display instruction is a display instruction triggered by the first operation, the second display instruction is a display instruction triggered by the second operation, and the third display instruction is a display instruction triggered by the third operation;

[0209] The first display instruction is triggered when the first time period ends, the second display instruction is triggered when the second time period ends, and the third display instruction is triggered when the third time period ends; the first time period, the second time period, and the third time period have a temporal order.

[0210] In some possible embodiments, the second display module is configured to perform:

[0211] Display the entity text and its corresponding entity image within the area corresponding to each entity's prompt text;

[0212] In response to the text switching command corresponding to the entity text to be switched, display the switched entity text and the entity image corresponding to the switched entity text;

[0213] The entity text to be switched is at least one of the following: account text, location text, and event text.

[0214] In some possible embodiments, the resource capture page includes a text area; playback text is displayed in the text area;

[0215] There is a linkage between the text area and the virtual character; the linkage indicates that the position of the text area on the resource shooting page changes with the position of the preset part of the virtual character.

[0216] In some possible embodiments, the apparatus further includes a third display module; the third display module is configured to perform:

[0217] In response to the end-of-shoot command, the virtual character in first-motion mode is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page;

[0218] The multiple entity texts and their corresponding entity images contained in the playback text are displayed sequentially in the text area.

[0219] The position of the text area on the resource preview page changes according to the position of the virtual character's preset parts.

[0220] In some possible embodiments, when the first voice information is acquired during the shooting process, the third display module is configured to perform:

[0221] In response to the end-of-shoot command, the virtual character in the first dynamic pose is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice message is played.

[0222] The first audio information is the audio information generated by the subject reading and playing text.

[0223] In some possible embodiments, the third display module is configured to perform:

[0224] In response to the end-of-shoot command, a voice change control is displayed on the resource preview page;

[0225] In response to a voice change command triggered by a voice change control, the first voice information is processed to obtain the second voice information; the voice processing includes at least one of timbre change, volume change, and speech rate change;

[0226] During the first preview period, the virtual character in the first dynamic state is displayed on the resource preview page, and the playback text is displayed in the text area of ​​the resource preview page, as well as the first voice information is played.

[0227] In some possible embodiments, the third display module is configured to perform:

[0228] During the second preview period, a virtual character in a second dynamic state is displayed on the resource preview page, and playback text is displayed in the text area of ​​the resource preview page, as well as second voice information is played.

[0229] The first preview period is before the second preview period.

[0230] In some possible embodiments, the virtual character is the first virtual character corresponding to the shooting account; the third display module is configured to perform:

[0231] During the third preview period, the first and second virtual characters located in the target scene are displayed on the resource preview page;

[0232] The second virtual character is the virtual character corresponding to the account text;

[0233] The target scene is generated based on location text and event text;

[0234] The actions of the first and second virtual characters in the target scene are determined based on event text.

[0235] In some possible embodiments, the resource preview page also includes a publishing control; the apparatus also includes a publishing module; the publishing module is configured to perform:

[0236] Responding to the publish control triggered by the publish control, publish the resource to be published based on the playing text and virtual character, and obtain the target resource.

[0237] In some possible implementations, the account text is used to prompt the client corresponding to the account text after the resource to be published has been published.

[0238] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0239] Figure 11 This is a block diagram illustrating a multimedia interaction device 3000 according to an exemplary embodiment. For example, device 3000 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0240] Reference Figure 11 The device 3000 may include one or more of the following components: a processing component 3002, a memory 3004, a power component 3006, a multimedia component 3008, an audio component 3010, an input / output (I / O) interface 3012, a sensor component 3014, and a communication component 3016.

[0241] Processing component 3002 typically controls the overall operation of device 3000, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 3002 may include one or more processors 3020 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 3002 may include one or more modules to facilitate interaction between processing component 3002 and other components. For example, processing component 3002 may include a multimedia module to facilitate interaction between multimedia component 3008 and processing component 3002.

[0242] Memory 3004 is configured to store various image types of data to support operation of device 3000. Examples of this data include instructions for any application or method operating on device 3000, contact data, phonebook data, messages, pictures, videos, etc. Memory 3004 can be implemented by any image type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0243] Power supply component 3006 provides power to various components of device 3000. Power supply component 3006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 3000.

[0244] Multimedia component 3008 includes a screen that provides an output interface between the device 3000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 3008 includes a front-facing camera and / or a rear-facing camera. When the device 3000 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0245] Audio component 3010 is configured to output and / or input audio signals. For example, audio component 3010 includes a microphone (MIC) configured to receive external audio signals when device 3000 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 3004 or transmitted via communication component 3016. In some embodiments, audio component 3010 also includes a speaker for outputting audio signals.

[0246] I / O interface 3012 provides an interface between processing component 3002 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0247] Sensor assembly 3014 includes one or more sensors for providing status assessments of various aspects of device 3000. For example, sensor assembly 3014 can detect the on / off state of device 3000, the relative positioning of components such as the display and keypad of device 3000, changes in the position of device 3000 or a component of device 3000, the presence or absence of user contact with device 3000, the orientation or acceleration / deceleration of device 3000, and temperature changes of device 3000. Sensor assembly 3014 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 3014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 3014 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0248] Communication component 3016 is configured to facilitate wired or wireless communication between device 3000 and other devices. Device 3000 can access wireless networks based on communication standards, such as WiFi, carrier networks (such as 2G, 3G, 4G, or 5G), or combinations thereof. In one exemplary embodiment, communication component 3016 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 3016 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0249] In an exemplary embodiment, the apparatus 3000 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0250] Embodiments of the present invention also provide a computer-readable storage medium, which can be disposed in an electronic device to store at least one instruction or at least one program related to implementing a multimedia interactive method, wherein the at least one instruction or the at least one program is loaded and executed by the processor to implement the multimedia interactive method provided in the above-described method embodiments.

[0251] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory 3004 including instructions, which can be executed by a processor 3020 of the device 3000 to perform the above method. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.

[0252] Embodiments of the present invention also provide a computer-readable storage medium that, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the method of any one of the first aspects of the embodiments of the present disclosure.

[0253] Embodiments of the present invention also provide a computer program product comprising a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the computer device to perform the method of any of the first aspects of the embodiments of the present disclosure.

[0254] It should be noted that the order of the above embodiments of the present invention is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multimedia interaction and parallel processing are also possible or may be advantageous.

[0255] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0256] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0257] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A multimedia interactive method, characterized by, The method comprises the following steps: in response to a shooting start instruction, displaying preset special effects corresponding fixed text and virtual characters on a resource shooting page; the five features of the virtual characters are determined based on the five features of the photographed object obtained by shooting; the fixed text comprises at least one entity prompt text; the at least one entity prompt text comprises account prompt text, location prompt text and event prompt text; displaying entity text and entity pictures corresponding to the entity text in the region corresponding to each entity prompt text; the entity text comprises the account text, the location text and the event text; the fixed text and the entity text corresponding to each entity prompt text constitute a playing text; during the shooting process, the virtual characters always present a first dynamic; the step of displaying the entity text and the entity pictures corresponding to the entity text in the region corresponding to each entity prompt text comprises the following steps: in response to a first display instruction, displaying the account text and the account pictures corresponding to the account text in the account region corresponding to the account prompt text; in response to a second display instruction, displaying the location text and the location pictures corresponding to the location text in the location region corresponding to the location prompt text; in response to a third display instruction, displaying the event text and the event pictures corresponding to the event text in the event region corresponding to the event prompt text.

2. The multimedia interaction method of claim 1, wherein the first display instruction is a display instruction triggered by a first operation, the second display instruction is a display instruction triggered by a second operation, and the third display instruction is a display instruction triggered by a third operation; the first display instruction is a display instruction triggered by the end of a first time period, the second display instruction is a display instruction triggered by the end of a second time period, and the third display instruction is a display instruction triggered by the end of a third time period; the first time period, the second time period and the third time period have a time sequence.

3. The multimedia interactive method of claim 1, wherein, the step of displaying the entity text and the entity pictures corresponding to the entity text in the region corresponding to each entity prompt text comprises the following steps: displaying the entity text and the entity pictures corresponding to the entity text in the region corresponding to each entity prompt text; in response to a text switching instruction corresponding to the entity text to be switched, displaying the switched entity text and the entity pictures corresponding to the switched entity text; the entity text to be switched is at least one of the account text, the location text and the event text.

4. The multimedia interactive method according to any of claims 1-3, characterized by, the resource shooting page comprises a text region; the playing text is displayed in the text region; the text region and the virtual characters have a linkage relationship; the linkage relationship indicates that the position of the text region on the resource shooting page changes with the position of a preset part of the virtual characters.

5. The multimedia interactive method of claim 1, wherein, after the step of displaying the entity text and the entity pictures corresponding to the entity text in the region corresponding to each entity prompt text, the method further comprises the following steps: in response to a shooting end instruction, displaying the virtual characters presenting the first dynamic on a resource preview page and displaying the playing text in the text region of the resource preview page; The multiple entity texts included in the playing text and the multiple entity pictures corresponding to the multiple entity texts are sequentially and scrollably displayed in the text area; The position of the text area on the resource preview page changes with the position of the preset part of the virtual character.

6. The multimedia interactive method according to claim 5, characterized in that, When the first voice information is acquired during the shooting process, the virtual character in the first dynamic is displayed on the resource preview page in response to a shooting end instruction, and the playing text is displayed in the text area of the resource preview page, including: In response to the shooting end instruction, the virtual character in the first dynamic is displayed on the resource preview page, and the playing text is displayed in the text area of the resource preview page, and the first voice information is played. The first voice information is voice information formed by the shooting object reading the playing text.

7. The multimedia interactive method according to claim 6, characterized in that, The virtual character in the first dynamic is displayed on the resource preview page in response to the shooting end instruction, and the playing text is displayed in the text area of the resource preview page, and the first voice information is played, including: In response to the shooting end instruction, a voice changing control is displayed on the resource preview page; In response to a voice changing instruction triggered based on the voice changing control, the first voice information is voice processed to obtain second voice information; the voice processing includes at least one of timbre changing, volume changing, and speed changing. In a first preview time period, the virtual character in the first dynamic is displayed on the resource preview page, the playing text is displayed in the text area of the resource preview page, and the first voice information is played.

8. The multimedia interactive method according to claim 7, characterized in that, The method further includes: In a second preview time period, the virtual character in the second dynamic is displayed on the resource preview page, the playing text is displayed in the text area of the resource preview page, and the second voice information is played. The first preview time period is located before the second preview time period.

9. The multimedia interactive method according to claim 8, characterized in that, The virtual character is a first virtual character corresponding to a shooting account; the method further includes: In a third preview time period, the first virtual character and a second virtual character located in a target scene are displayed on the resource preview page; The second virtual character is a virtual character corresponding to the account text; The target scene is generated based on the position text and the event text; The actions of the first virtual character and the second virtual character in the target scene are determined based on the event text.

10. The multimedia interactive method according to any of claims 5-9, characterized by, The resource preview page further includes a publishing control; the method further includes: In response to a publishing instruction triggered based on the publishing control, a to-be-published resource obtained based on the playing text and the virtual character is published to obtain a target resource.

11. The multimedia interactive method of claim 10, wherein, The account text is used to prompt a client corresponding to the account text after the to-be-published resource is published.

12. A multimedia interactive device, characterized by including: The first display module is configured to display fixed text corresponding to a preset special effect and a virtual character on a resource shooting page in response to a shooting start instruction; the facial features of the virtual character are determined based on the facial features of a photographed object obtained through shooting; the fixed text includes at least one entity prompt text; the at least one entity prompt text includes account prompt text, location prompt text, and event prompt text; The second display module is configured to display entity text and an entity picture corresponding to the entity text in a region corresponding to each entity prompt text; the entity text includes the account text, the location text, and the event text; the fixed text and the entity text corresponding to each entity prompt text constitute playing text; during shooting, the virtual character always presents a first dynamic; The second display module is configured to: in response to a first display instruction, display the account text and an account picture corresponding to the account text in an account region corresponding to the account prompt text; in response to a second display instruction, display the location text and a location picture corresponding to the location text in a location region corresponding to the location prompt text; in response to a third display instruction, display the event text and an event picture corresponding to the event text in an event region corresponding to the event prompt text.

13. An electronic device, comprising: comprise: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the multimedia interaction method of any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, When the instructions in the computer readable storage medium are executed by the processor of the electronic device, the electronic device can execute the multimedia interaction method of any one of claims 1 to 11.

15. A computer program product, characterised in that, The computer program product comprises a computer program stored in a readable storage medium, and at least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device executes the multimedia interaction method of any one of claims 1 to 11.

Citation Information

Patent Citations

  • Personalized Dynamic Video Overlay in an Online Media Player

    US20240196043A1

  • Special-effect generation method and apparatus, and computer device and storage medium

    WO2024222356A1