Interactive methods, devices, electronic equipment, storage media, and software products for live streaming rooms
By displaying interactive controls in the live stream room to generate customized virtual items based on the streamer's individual content, the problem of monotonous virtual item formats is solved, and the efficiency and fun of live stream interaction are improved.
Patent Information
- Application Number
- CN202611169112.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-03
- Publication Date
- 2026-11-10
AI Technical Summary
The virtual items gifted by viewers during live streams are often limited in form and content, which affects the efficiency of interaction between viewers and streamers.
Interactive controls are displayed in the target live stream room. Once triggered, customized media content based on the first streamer's individual material is generated and displayed as virtual items. Combined with the live stream footage, exclusive customized virtual gifts are generated.
It enhances the interactivity and fun of virtual gifts, brings viewers and streamers closer, meets personalized interaction needs, and improves the efficiency of live streaming interaction.
Smart Images

Figure CN123075196A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of computer technology, and in particular to a live streaming interactive method, apparatus, electronic device, storage medium, and program product. Background Technology
[0002] With the development of internet technology and the widespread application of live streaming functions, more and more streamers are entering the live streaming field and starting to broadcast. During the live stream, streamers can interact with viewers, thereby enhancing the fun and efficiency of information interaction. For example, viewers can send virtual items to the streamer to express their recognition and support, and to promote interaction with the streamer.
[0003] However, currently, the virtual items that viewers give to streamers are limited in form and content, thus restricting their expressive power and affecting the efficiency of interaction between viewers and streamers. Summary of the Invention
[0004] This disclosure provides a live streaming interaction method, apparatus, electronic device, storage medium, and program product to solve at least one of the aforementioned technical problems. The technical solution of this disclosure is as follows: According to a first aspect of the present disclosure, a live streaming room interaction method is provided, comprising: In the target live stream room, interactive controls are displayed. The target live stream room is any live stream room that is currently in a live streaming state. When the interactive control is triggered, a first object is displayed in the target live streaming room, the first object representing a first virtual item gifted to the first streamer in the target live streaming room; Wherein, the first object is media content generated based on at least one first material, and the first material is a single material for the first anchor obtained based on the live broadcast screen presented by the target live broadcast room in the live broadcast state.
[0005] In one exemplary implementation, the first object is media content generated by an artificial intelligence model based on at least one target material, wherein the target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material.
[0006] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a first element processing area corresponding to the target material is displayed, and the first element processing area includes multiple first visual elements in the target material; When the first element processing area is triggered, the target material is updated based on the selected first visual element, and the updated target material is used to generate the first object.
[0007] In one exemplary embodiment, the first element processing area further includes a plurality of preset visual elements, which do not belong to the target material. When the first element processing area is triggered, updating the target material based on the selected first visual element includes: When the first element processing area is triggered, the target material is updated based on the selected first visual element and the selected preset visual element.
[0008] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a second element processing area is displayed, which includes multiple second visual elements corresponding to each target material. When the second element processing area is triggered, the first object is displayed, which is media content generated based on all the second visual elements selected in the second element processing area.
[0009] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: The target live streaming room displays a first preview object and object adjustment controls. The first preview object is media content generated based on at least one target material. The target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material. When the object adjustment control is triggered, a second preview object is displayed in the target live stream room. The second preview object is media content generated based on at least one of the target materials. The second preview object is different from the first preview object. When the interactive control is triggered, the second preview object is displayed as the first object.
[0010] In one exemplary embodiment, both the first preview object and the second preview object are obtained by stitching together images from at least two target materials. The first preview object and the second preview object differ in at least one of the following ways: they use different target materials, they use different stitching templates, and they have different display effects. The difference in the target materials used includes at least one of the following: The content of the target materials used are not exactly the same; The number of target materials used is not exactly the same; The display effects of the target materials used are not entirely the same.
[0011] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, multiple candidate target materials are displayed; In response to the selection operation of the plurality of candidate target materials, the second preview object is displayed in the target live room. The second preview object is media content generated based on the selected target material.
[0012] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, a keyword control is displayed. The keyword control is used to input or select a target keyword, which is the guidance information required to guide the generation of the second preview object. Based on the operation of the keyword control, the second preview object is displayed. The second preview object is media content generated based on at least one of the target materials under the guidance of the target keyword.
[0013] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, the second preview object is displayed. The second preview object is media content randomly generated based on the same target material corresponding to the first preview object.
[0014] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: In the target live streaming room, the first virtual item and the second virtual item are displayed, and the first level of the first virtual item is lower than the second level of the second virtual item. When the interactive control corresponding to the first virtual item is triggered, the first object is displayed in the target live broadcast room. The first object is media content generated based on at least one of the first materials and the display effect corresponding to the first level. The method further includes: When the first virtual item is sent and the interactive control corresponding to the second virtual item is triggered, a second object is displayed in the target live stream room. The second object represents the second virtual item gifted to the first streamer in the target live stream room. The second object is media content generated based on at least one of the first materials and the display effect corresponding to the second level. The display effect corresponding to the first level is different from that corresponding to the second level.
[0015] In one exemplary implementation, displaying the first virtual item and the second virtual item in the target live streaming room includes: In the target live stream room, the conditions for gifting the first virtual item, the second virtual item, and the conditions for gifting the second virtual item are displayed, including the quantity of the first virtual item that needs to be gifted.
[0016] In one exemplary embodiment, the method further includes: If the target live stream room is a group broadcast live stream room, display the anchor switching information; When the anchor switching information is triggered, if the interactive control is triggered, a third object is displayed in the target live room. The third object is used to represent the first virtual item gifted to the second anchor in the target live room. The second anchor is another anchor in the target live room that is different from the first anchor. The third object is media content generated based on at least one third material, which is a single-person material for the second anchor obtained by taking a screenshot of the live broadcast screen generated by the target live broadcast room in the live broadcast state.
[0017] In one exemplary implementation, the first virtual item is set as the cover of the target live stream room, or the avatar of the first streamer.
[0018] According to a second aspect of the present disclosure, a live streaming interactive device is provided, the device comprising: The display module is configured to execute in the target live room and display interactive controls, wherein the target live room is any live room that is currently in a live state; The interaction module is configured to display a first object in the target live streaming room when the interaction control is triggered. The first object represents a first virtual item gifted to the first streamer in the target live streaming room. Wherein, the first object is media content generated based on at least one first material, and the first material is a single material for the first anchor obtained based on the live broadcast screen presented by the target live broadcast room in the live broadcast state.
[0019] In one exemplary implementation, the first object is media content generated by an artificial intelligence model based on at least one target material, wherein the target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material.
[0020] In one exemplary implementation, the interaction module is configured to execute: When the interactive control is triggered, a first element processing area corresponding to the target material is displayed, and the first element processing area includes multiple first visual elements in the target material; When the first element processing area is triggered, the target material is updated based on the selected first visual element, and the updated target material is used to generate the first object.
[0021] In one exemplary embodiment, the first element processing area further includes a plurality of preset visual elements, which do not belong to the target material, and the interaction module is configured to execute: When the first element processing area is triggered, the target material is updated based on the selected first visual element and the selected preset visual element.
[0022] In one exemplary implementation, the interaction module is configured to execute: When the interactive control is triggered, a second element processing area is displayed, which includes multiple second visual elements corresponding to each target material. When the second element processing area is triggered, the first object is displayed, which is media content generated based on all the second visual elements selected in the second element processing area.
[0023] In one exemplary implementation, the interaction module is configured to execute: The target live streaming room displays a first preview object and object adjustment controls. The first preview object is media content generated based on at least one target material. The target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material. When the object adjustment control is triggered, a second preview object is displayed in the target live stream room. The second preview object is media content generated based on at least one of the target materials. The second preview object is different from the first preview object. When the interactive control is triggered, the second preview object is displayed as the first object.
[0024] In one exemplary embodiment, both the first preview object and the second preview object are obtained by stitching together images from at least two target materials. The first preview object and the second preview object differ in at least one of the following ways: they use different target materials, they use different stitching templates, and they have different display effects. The difference in the target materials used includes at least one of the following: The content of the target materials used are not exactly the same; The number of target materials used is not exactly the same; The display effects of the target materials used are not entirely the same.
[0025] In one exemplary implementation, the interaction module is configured to execute: When the object adjustment control is triggered, multiple candidate target materials are displayed; In response to the selection operation of the plurality of candidate target materials, the second preview object is displayed in the target live room. The second preview object is media content generated based on the selected target material.
[0026] In one exemplary implementation, the interaction module is configured to execute: When the object adjustment control is triggered, a keyword control is displayed. The keyword control is used to input or select a target keyword, which is the guidance information required to guide the generation of the second preview object. Based on the operation of the keyword control, the second preview object is displayed. The second preview object is media content generated based on at least one of the target materials under the guidance of the target keyword.
[0027] In one exemplary implementation, the interaction module is configured to execute: When the object adjustment control is triggered, the second preview object is displayed. The second preview object is media content randomly generated based on the same target material corresponding to the first preview object.
[0028] In one exemplary implementation, the interaction module is configured to execute: In the target live streaming room, the first virtual item and the second virtual item are displayed, and the first level of the first virtual item is lower than the second level of the second virtual item. When the interactive control corresponding to the first virtual item is triggered, the first object is displayed in the target live broadcast room. The first object is media content generated based on at least one of the first materials and the display effect corresponding to the first level. When the first virtual item is sent and the interactive control corresponding to the second virtual item is triggered, a second object is displayed in the target live stream room. The second object represents the second virtual item gifted to the first streamer in the target live stream room. The second object is media content generated based on at least one of the first materials and the display effect corresponding to the second level. The display effect corresponding to the first level is different from that corresponding to the second level.
[0029] In one exemplary implementation, the interaction module is configured to execute: In the target live stream room, the conditions for gifting the first virtual item, the second virtual item, and the conditions for gifting the second virtual item are displayed, including the quantity of the first virtual item that needs to be gifted.
[0030] In one exemplary implementation, the interaction module is configured to execute: If the target live stream room is a group broadcast live stream room, display the anchor switching information; When the anchor switching information is triggered, if the interactive control is triggered, a third object is displayed in the target live room. The third object is used to represent the first virtual item gifted to the second anchor in the target live room. The second anchor is another anchor in the target live room that is different from the first anchor. The third object is media content generated based on at least one third material, which is a single-person material for the second anchor obtained by taking a screenshot of the live broadcast screen generated by the target live broadcast room in the live broadcast state.
[0031] In one exemplary implementation, the interaction module is configured to set the first virtual item as the cover of the target live stream room, or the avatar of the first streamer.
[0032] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the live streaming interaction method as described above.
[0033] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, which, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the live streaming interaction method as described above.
[0034] According to a fifth aspect of the present disclosure, a computer program product is provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the device to perform the above-described live streaming interaction method.
[0035] The technical solutions provided by the embodiments of this disclosure bring at least the following beneficial effects: This disclosure displays interactive controls in the target live stream room. When the interactive controls are triggered, a first object generated based on the live stream footage of the first streamer is displayed as a virtual gift. This can directly combine the current live stream footage to generate a customized virtual gift, making the virtual gift display more relevant to the current live stream scene and content. This enhances the targeted dissemination and promotion effect based on specific live stream content, effectively increasing viewers' willingness to send virtual gifts. It also makes the display of virtual gifts more unique and interesting, bringing viewers and streamers closer together, meeting the personalized interaction needs of live stream viewers, and thus improving the interaction efficiency between live stream viewers and streamers.
[0036] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.
[0038] Figure 1 This is a schematic diagram of an implementation environment according to an exemplary embodiment.
[0039] Figure 2 This is a flowchart illustrating a live streaming room interaction method according to an exemplary embodiment.
[0040] Figure 3 This is a schematic diagram of a live streaming interaction process according to an exemplary embodiment. Figure 1 .
[0041] Figure 4 This is a schematic diagram of a live streaming interaction process according to an exemplary embodiment. Figure 2 .
[0042] Figure 5 This is a block diagram of a live streaming interactive device according to an exemplary embodiment.
[0043] Figure 6 This is a block diagram illustrating an electronic device for live streaming interaction according to an exemplary embodiment.
[0044] Figure 7 This is another block diagram illustrating an electronic device for live streaming interaction according to an exemplary embodiment. Detailed Implementation
[0045] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.
[0046] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0047] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.
[0048] Please see Figure 1 The illustration shows an implementation environment provided by an embodiment of the present disclosure. The implementation environment may include at least one live streaming interactive terminal 110 and a live streaming server 120, which can communicate with each other via a network.
[0049] The live streaming server 120 can provide live streaming services to various live streaming rooms. The target live streaming room is any live streaming room that is currently broadcasting. The broadcaster's terminal (broadcaster end) and the viewer's terminal (viewer end) in the target live streaming room both belong to the live streaming room interaction terminal 110. That is, both the broadcaster and the viewer use the corresponding live streaming room interaction terminal 110 to interact with the live streaming server 120 to achieve the purpose of interaction.
[0050] Specifically, the live streaming interactive terminal 110 held by the live streaming viewer can display interactive controls in the target live streaming room, which is any live streaming room in a live streaming state; when the interactive control is triggered, a first object is displayed in the target live streaming room, which represents a first virtual item gifted to the first streamer in the target live streaming room; wherein, the first object is media content generated based on at least one first material, and the first material is a single-person material for the first streamer obtained based on the live streaming screen presented by the target live streaming room in the live streaming state.
[0051] The live streaming interactive terminal 110 can communicate with the live streaming server 120 based on a browser / server (B / S) mode or a client / server (C / S) mode. The live streaming interactive terminal 110 may include physical devices such as smartphones, tablets, laptops, digital assistants, smart wearable devices, in-vehicle terminals, and servers, and may also include software running on the physical device, such as applications. The operating system running on the live streaming interactive terminal 110 in this embodiment may include, but is not limited to, Android, iOS, Linux, and Windows.
[0052] The live streaming server 120 and the live streaming interactive terminal 110 can establish a communication connection and display the live stream via wired or wireless means. The live streaming server 120 may include a standalone server, a distributed server, or a server cluster consisting of multiple servers, wherein the server may be a cloud server.
[0053] Please refer to Figure 2 The diagram illustrates a flowchart of a live-streaming interaction method in an exemplary embodiment of this disclosure. The execution subject of this method can be the live-streaming interaction terminal corresponding to the live-streaming viewer. Please refer to [link / reference] for details. Figure 2 The method may include: S210. In the target live room, display interactive controls, wherein the target live room is any live room that is currently in a live state.
[0054] A target live streaming room refers to a public or private live streaming room that currently meets the conditions for live streaming operation, where the host has started live streaming, and users can enter and watch and participate in the interaction normally. It may cover various live streaming scenarios, such as e-commerce live streaming rooms, entertainment and talent show live streaming rooms, knowledge sharing live streaming rooms, corporate event live streaming rooms, etc. As long as it is in an active state of live streaming, it can be judged as a target live streaming room that meets the requirements.
[0055] For example, when a user opens the recommendation page of a mainstream live streaming platform, all live streams marked "Live Now" can be considered the target live stream mentioned here.
[0056] The interactive controls in this step refer to visual interactive components presented in the target live broadcast room that can be clicked, touched, or input by the viewers to enable audience interaction.
[0057] S220. When the interactive control is triggered, a first object is displayed in the target live streaming room. The first object represents a first virtual item gifted to the first streamer in the target live streaming room. The first object is media content generated based on at least one first material. The first material is a single-person material for the first streamer obtained based on the live streaming screen presented by the target live streaming room in the live streaming state.
[0058] Users can trigger the aforementioned interactive controls through preset actions such as clicking, touching, and inputting. For example, in an entertainment live stream, a user can send virtual items to the streamer by clicking the gift button (interactive control) on the side. In an e-commerce live stream, clicking the "Support the Streamer" interactive control, clicking the "Send a Fan Club Light Stick" interactive control in the bullet screen area, and even double-tapping the screen in some cases can trigger interactive controls. Only when a user actively triggers an interactive control will the process of generating and displaying the first object begin. This design gives the initiative of interaction to the user, accurately responding to the user's true interactive intentions and effectively improving the user's comfort and sense of participation.
[0059] When a user actively triggers the event, the first virtual gift (the first object) is rendered and output in the currently accessed target live stream room. Both the viewers and the streamer can see the virtual gift (the first object). This design, which displays the virtual gift in its original location within the target live stream room, does not interrupt the user's continuous viewing rhythm. At the same time, it allows all users present in the live stream room to directly see the interactive content of gifting virtual items, enhancing the interactive atmosphere within the live stream room.
[0060] The core function of the first object is to visually represent the first virtual item gifted by a user to the first streamer in the target live stream room. The first object can have images, sound effects, and animations, and can also include basic information about the first streamer or the live stream viewer who gifted the first object, such as nickname, live stream room identity, level, ID, etc.
[0061] In this disclosure, the first object is media content generated based on the first material. It is not generated using generic, fixed materials, but rather customized media content generated by combining exclusive first materials obtained from the live stream. The content format can include various media forms such as animated images, short videos, and dynamic stickers. Compared to traditional, fixed, and generic virtual item display content, the customized media content of the first object is more tailored to the characteristics of the current live stream and the streamer, offering a greater sense of exclusivity and novelty, and increasing users' willingness to interact.
[0062] The primary source material is extracted from the live feed of the target livestream room, containing only footage of the primary streamer. For example, if a two-person livestream is currently underway, screenshots can be taken periodically or intermittently from the live feed, and the primary streamer's image area can be identified and segmented to extract a single shot containing only that streamer as the primary source material. If multiple streamers are broadcasting simultaneously, the primary streamer corresponding to the target livestream room can be accurately identified, and their individual footage can be extracted without mixing in content from other streamers. Even if the streamer is constantly moving, the system will track and identify them in real time, extracting only the required individual footage. This extraction rule ensures a strong correspondence between the primary source material and the primary streamer, guaranteeing that the generated primary source material always precisely matches the streamer being gifted the content.
[0063] In some implementations, in response to a user's triggering of an interactive control, a full screenshot containing all live content can be captured in real time. Then, an image recognition algorithm is used to detect and segment the area where the first streamer is located from the full live screen. The segmented area is then cropped and saved to obtain the first material containing only the first streamer. The entire screenshotting and extraction process is completed instantly after the interactive operation is triggered, which can capture the state of the first streamer in the live screen at the moment the operation is triggered, ensuring the timeliness and uniqueness of the first material and making the generated first object more exclusive.
[0064] In some implementations, the first object can be generated using only the extracted footage of the first streamer, ensuring that the content of the first object revolves entirely around the streamer who received the virtual item. For example, if a user gives a virtual gift to streamer A in a live stream, the first object will only use the extracted footage of streamer A, and the generated content will only correspond to streamer A, without including content from streamer B. Similarly, when multiple streamers are live streaming together, if a user gives a virtual item to one of the streamers, the first object will only be generated based on that streamer's footage, without including footage from other streamers. This rule ensures the uniqueness of the first object at the footage level, avoiding the error of confusing interactive objects when multiple streamers are on screen together, respecting the rights of different streamers, and improving the accuracy of interaction and the standardization of live stream content.
[0065] In summary, this disclosure displays interactive controls in the target live stream room. When the interactive controls are triggered, a first object generated from the live stream footage of the first streamer is displayed as a virtual gift. This directly combines the current live stream footage to generate a customized virtual gift, making the virtual gift display more relevant to the current live stream scene and content. This enhances the targeted dissemination and promotion effect based on specific live stream content, effectively increasing viewers' willingness to send virtual gifts. It also makes the display of virtual gifts more unique and interesting, bringing viewers and streamers closer together, meeting the personalized interaction needs of live stream viewers, and thus improving the interaction efficiency between live stream viewers and streamers.
[0066] In one exemplary implementation, the first object is media content generated by an artificial intelligence model based on at least one target material, wherein the target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material.
[0067] This implementation method can rely on an artificial intelligence model to output customized media content that meets requirements based on the input first and / or second materials, such as images, animations, and short videos adapted to the display of virtual gifts in the live broadcast room. For example, the current mainstream text-to-image and image-to-image diffusion models, or a dedicated generation model fine-tuned for the live broadcast scenario, can be selected as the artificial intelligence model. The model has pre-learned a large number of gift styles and can directly generate content that meets the specifications for virtual gift display based on the input anchor materials.
[0068] The target material serves as the foundational input data for generating the first object, and may include two categories: first material and second material. The first material can be a single-person image of the first streamer, captured directly from the live stream of the target livestream room. The second material is a derivative material obtained by performing at least one image processing step on the first material. Common processing steps include background removal, skin smoothing, filters, style transfer, silhouette extraction, and costume changes. For example, the first material can be converted into a two-dimensional character image with an outline style, or the streamer's silhouette can be extracted as a base for secondary creation. In practice, material processing options can be provided, allowing viewers to choose to use the original first material directly or generate a processed second material with a single click, meeting different generation needs.
[0069] This implementation method ensures that the generated content is anchored to the current live streamer and retains the characteristics of the live stream scene, while also providing room for material adjustment to adapt to different aesthetic preferences of the audience, so that the generated gift content is both relevant to the scene and meets the audience's expectations.
[0070] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a first element processing area corresponding to the target material is displayed, and the first element processing area includes multiple first visual elements in the target material; When the first element processing area is triggered, the target material is updated based on the selected first visual element, and the updated target material is used to generate the first object.
[0071] The first element processing area is an interactive area open to the audience, used to select visual elements within the target material. Its core function is to break down and display different independent visual units (first visual elements) within the target material, allowing users to selectively choose elements they want to keep or modify. For example, when the target material featuring a single anchor includes three different first visual elements—the anchor's image, the product held by the anchor, and background decorations—the first element processing area will automatically break down these three units, marking the scope of each element through a semi-transparent overlay and a selection border, allowing users to clearly distinguish and select them.
[0072] The first visual element is the smallest unit that a user can interact with individually. For example, from the material of "the host showing off a new lipstick", we can break it down into four first visual elements: the host's portrait, the lipstick product, the earrings worn by the host, and the background decoration. Each element is an independent and operable entity.
[0073] Based on the user-selected elements, the target material used to generate the first object can be readjusted, allowing for customized adjustments down to the individual element level, rather than simply replacing the entire material. For example, if the user only keeps the selected streamer portrait element and replaces the lipstick in the original material with the desired light stick element, a new target material can be generated with the streamer portrait as the core and paired with the light stick. If the user doesn't want the background decoration in the original material, they can simply deselect that element and keep all other elements to complete the update.
[0074] This technical solution breaks down materials into individual elements, allowing users to customize specific parts of the target material. This enables personalized content modification, preserving the original features desired by the user while satisfying their need for localized adjustments. By refining the customization granularity from complete materials to individual visual elements, it lowers the barrier to entry for users to customize gifts, meeting their needs for more refined personalization. It retains the advantage of the original material being relevant to the current livestream scenario while providing users with more flexible creative space, further enhancing their willingness to customize gifts and optimizing the livestream interactive experience.
[0075] In one exemplary embodiment, the first element processing area further includes a plurality of preset visual elements, which do not belong to the target material. When the first element processing area is triggered, updating the target material based on the selected first visual element includes: When the first element processing area is triggered, the target material is updated based on the selected first visual element and the selected preset visual element.
[0076] Preset visual elements that are not part of the target content can be general, common elements. They do not need to be extracted or split from the current live stream screen and can be directly selected and combined by users. Their core function is to supplement the existing target content and enrich the possibilities for customized combinations. Preset visual elements cover a variety of commonly used content in live streaming scenarios, such as lanterns and fireworks for holiday greetings, support signs and glow sticks for cheering, and cakes and flowers for hobbies. Each element is an independent, interactive unit that can adapt to different customization needs.
[0077] By combining the selected primary visual element and preset visual elements to update the target material, users can retain their own elements extracted from the original material and combine them with the platform's general preset elements to generate new customized target materials. This does not require complete reliance on the original material content, nor does it require users to prepare additional materials themselves.
[0078] For example, users can retain the anchor's portrait element in the original material and then select the preset birthday cake element to create a new target material that combines "anchor portrait + birthday cake".
[0079] This implementation method can rely on the universal preset elements pre-made in the live streaming application, which not only gives users a richer space for material combinations and meets their customization needs, but also eliminates the need for users to prepare additional materials themselves, further lowering the threshold for personalized customization. It can effectively increase users' willingness to customize gifts, enrich the content scenarios of customized gifts, and further enhance the flexibility and personalization of live streaming interaction.
[0080] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a second element processing area is displayed, which includes multiple second visual elements corresponding to each target material. When the second element processing area is triggered, the first object is displayed, which is media content generated based on all the second visual elements selected in the second element processing area.
[0081] The second element processing area gathers independent visual elements from multiple different target materials, allowing users to freely select and combine the elements they need across the original materials. For example, users can freely select and combine all the second visual elements from two target materials, and the first object is generated and presented based on the combination result. Combining these cross-material elements together can generate more diverse virtual gifts.
[0082] This implementation allows users to freely select and combine elements from multiple materials to create their own content, further relaxing the restrictions on material combinations and giving users greater creative freedom. It can meet users' more complex personalized customization needs, further enhance the exclusive attributes of customized gifts, increase users' enthusiasm for interactive participation, and optimize the personalized experience of live streaming interaction.
[0083] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: The target live streaming room displays a first preview object and object adjustment controls. The first preview object is media content generated based on at least one target material. The target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material. When the object adjustment control is triggered, a second preview object is displayed in the target live stream room. The second preview object is media content generated based on at least one of the target materials. The second preview object is different from the first preview object. When the interactive control is triggered, the second preview object is displayed as the first object.
[0084] Before a user confirms the sending of a customized gift, a first preview object is generated and displayed based on the selected target material. This preview object showcases the result generated by the AI model and provides adjustment options for users to make secondary modifications, preventing the direct sending of content that does not meet expectations. For example, after the user selects material and triggers AI generation, a preview window can pop up to display the generated first preview object, along with "Regenerate" adjustment controls. In practice, the first preview object can be generated directly based on the user-selected target material. The pop-up window floats directly on the side of the live stream interface without obstructing the main live stream content, allowing users to make adjustments while watching the live stream without interfering with their viewing experience.
[0085] When a user triggers the object adjustment control, if the user adjusts the target asset, a second preview result is generated based on the adjusted target asset. If the user does not adjust the target asset but adjusts the generation method, a second preview result can be generated based on the adjusted generation method.
[0086] If the user confirms the preview result at this point, the final selected second preview result will be sent as the first recipient and displayed in the public domain of the live stream, completing the gift-giving process.
[0087] In this implementation, by pre-generating preview content and allowing users to trigger adjustments and regeneration, the right to confirm the final content is given to the user. This ensures that the final customized gift meets the user's needs and avoids the experience problems caused by the generated result not meeting expectations. This further improves the final presentation effect of the customized gift and optimizes the user's creative customization experience.
[0088] In one exemplary embodiment, both the first preview object and the second preview object are obtained by stitching together images from at least two target materials. The first preview object and the second preview object differ in at least one of the following ways: they use different target materials, they use different stitching templates, and they have different display effects. The difference in the target materials used includes at least one of the following: The content of the target materials used are not exactly the same; The number of target materials used is not exactly the same; The display effects of the target materials used are not entirely the same.
[0089] Both the first and second preview objects are generated by splicing together at least two target materials. The AI model can generate preview objects by integrating multiple materials. The first and second preview objects may have slightly different target material content. In other words, during the generation process, target materials can be added, removed, or replaced to change the target materials used in the final generation. For example, if the first preview uses two materials, a streamer's portrait and a cake, the generation process can replace them with two materials: a streamer's portrait and fireworks.
[0090] The first and second preview objects may differ in the number of target assets used. This means that the number of target assets used in the splicing can be increased or decreased during the adjustment and generation process to accommodate the user's needs for adding or removing content. For example, if the first preview uses two target assets and the user feels that there are too few elements, the number of target assets can be increased to three during the adjustment and generation process to supplement more customized content.
[0091] The first and second preview objects may have slightly different display effects using the target materials. This means the content of the materials themselves remains the same, but their size, position, transparency, and other display attributes can be adjusted to meet fine-tuning needs. For example, if the cake material is positioned slightly off-center and obscures the streamer's image in the first preview, the cake's position can be moved during the final edit, optimizing the effect without changing the material itself.
[0092] The first and second preview objects can have different splicing templates. This means the target material itself remains the same, but the splicing combination of different materials is adjusted to generate preview content with different layouts. For example, if a top-bottom splicing template was used to arrange the materials initially, a left-right splicing template can be used during the adjustment to obtain a preview effect with a different composition.
[0093] The first and second preview objects may have different display effects. That is, the basic spliced content remains the same, but the overall filter, style, and dynamic effects can be adjusted to meet different visual preferences. For example, the first preview is a fresh and clean style preview, and the generated preview can be changed to a festive and warm color scheme to adapt to different scene requirements.
[0094] All difference types are independent and can be combined and adjusted. When a user triggers regeneration, adjustments can be made in a single dimension or multiple dimensions at the same time, providing a full range of differentiated preview results to cover different user adjustment needs and avoid the problem of homogenized results from multiple adjustments.
[0095] This implementation method clarifies the differentiated direction generated by multiple previews, which can meet the different adjustment needs of users from multiple dimensions. It can support users to make fine adjustments as well as major changes, effectively increasing the probability that the preview results after adjustment meet the user's expectations and further optimizing the user customization experience.
[0096] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: displaying multiple candidate target materials when the object adjustment control is triggered; and displaying the second preview object in the target live stream room in response to a selection operation of the multiple candidate target materials, wherein the second preview object is media content generated based on the selected target material.
[0097] After triggering the object adjustment control, multiple candidate target materials can be displayed. The live streaming application can proactively collect candidate materials that can be regenerated and provide them to the user for selection. The core purpose is to facilitate users to quickly change and adjust the generation base. For example, if a user is not satisfied with the current preview effect, clicking the readjustment control will automatically pop up a list of candidate materials. In practice, the candidate materials will be displayed in order of time and relevance, and the selected materials will also be marked. Users can intuitively view and directly click to complete the selection. The operation path is very short and will not bring any additional operational burden to the user.
[0098] After users reselect candidate materials, a new second preview object can be generated directly based on the newly selected materials. This simplifies the operation path for users to change and adjust materials, allows users to modify the generated base more conveniently, and obtain the expected preview results more quickly. It effectively reduces the cost of adjustment operations, increases users' willingness to adjust content, and optimizes the creation experience of customized gifts.
[0099] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, a keyword control is displayed. The keyword control is used to input or select a target keyword, which is the guidance information required to guide the generation of the second preview object. Based on the operation of the keyword control, the second preview object is displayed. The second preview object is media content generated based on at least one of the target materials under the guidance of the target keyword.
[0100] In this implementation, a keyword control pops up after the object adjustment control is triggered, allowing users to input keywords themselves or select target keywords from preset options. These keywords serve as core guiding information for generating the adjusted content, essentially providing the AI model with clear direction for the adjustment. For example, if the user's initial virtual gift preview is a "pink heart floating screen," clicking the adjustment control will bring up a keyword input box. The user can directly input "Christmas-style red ribbon" or select "retro black and gold" from preset style keywords, without needing to navigate to another page to complete the settings.
[0101] By using the target keywords obtained from the user's interaction with the keyword control, and combining them with the selected target materials, a corresponding second preview object can be generated. This provides users with a clear entry point for expressing their needs, lowers the barrier to entry for users to describe and adjust their requirements, and eliminates the complex steps of manually adjusting parameters. While preserving the user's freedom of customization, it simplifies the operation process, further improving the efficiency of users adjusting content and optimizing the creation experience.
[0102] In one exemplary implementation, displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, the second preview object is displayed. The second preview object is media content randomly generated based on the same target material corresponding to the first preview object.
[0103] In this implementation, after the user triggers the object adjustment control, the second preview object can still be generated using all the same target materials corresponding to the first preview object. The user does not need to reselect materials or adjust parameters. The core is to simplify the operation process of purely random adjustment and adapt to the needs of users who only want to change the display effect but do not want to change the basic materials.
[0104] The second preview object is media content randomly generated based on the same source material. This means it automatically adjusts the generation parameters (excluding the base material) to produce a different result from the first preview object, eliminating the need for users to provide additional adjustment directions and further lowering the operational threshold for user adjustments. While preserving the differentiated generation effect, it eliminates the need for secondary settings by the user, thus reducing the operational threshold, improving the efficiency of adjustment generation, and optimizing the user experience in lightweight adjustment scenarios.
[0105] In one exemplary implementation, displaying the first object in the target live stream room when the interactive control is triggered includes: In the target live streaming room, the first virtual item and the second virtual item are displayed, and the first level of the first virtual item is lower than the second level of the second virtual item. When the interactive control corresponding to the first virtual item is triggered, the first object is displayed in the target live broadcast room. The first object is media content generated based on at least one of the first materials and the display effect corresponding to the first level. The method further includes: When the first virtual item is sent and the interactive control corresponding to the second virtual item is triggered, a second object is displayed in the target live stream room. The second object represents the second virtual item gifted to the first streamer in the target live stream room. The second object is media content generated based on at least one of the first materials and the display effect corresponding to the second level. The display effect corresponding to the first level is different from that corresponding to the second level.
[0106] In this implementation, the target live stream room can simultaneously display first and second virtual items of different levels, with the first virtual item being of a lower level than the second. The core idea is to ensure that users with varying gifting abilities can find matching interactive options, while clearly showing users the upgrade paths available, thus incentivizing them to complete upgrade tasks. For example, the live stream room's gift section can simultaneously display level 1 customized small gifts and higher-level level 2 customized gifts. Users can directly choose to send lower-level gifts, and also clearly see the higher-level gift options that can be upgraded to, thus clarifying their subsequent upgrade goals.
[0107] After triggering the interactive control for the first virtual item, a first object will be generated based on the target material selected by the user and the display effect corresponding to the first level. Lower-level gifts can also generate exclusive effects based on user-customized materials, but they can only have the effects of the lower level. After sending the first virtual item, the interactive control for the second virtual item can be triggered. In other words, after sending a first-level gift, the trigger entry for higher-level gifts will be opened, guiding users to upgrade their gifts after completing the basic gift-giving, forming a progressive interactive path.
[0108] For example, after a user sends a Level 1 customized gift, a quick access button for higher-level gifts can automatically pop up, prompting the user to upgrade the gift for better display effects, attracting the user to click to complete the upgrade operation, and improving the conversion rate of higher-level gifts.
[0109] After triggering the interactive control corresponding to the second virtual item, the corresponding second object can be displayed in the live stream room to indicate that the second virtual item has been gifted to the streamer. This second object has a superior gift effect compared to the first virtual item. The generation process of the second object is the same as that of the first object, and will not be elaborated upon. The second object is generated in conjunction with the display effects corresponding to the second level; that is, different levels correspond to different display effects. The higher the level, the richer and more advanced the display effects, reflecting the upgraded experience brought by the level difference and encouraging users to upgrade and gift.
[0110] This implementation method establishes a progressive customized gift upgrade path, which not only covers the customized interaction needs of users at different demand levels, but also incentivizes users to continue interacting through clear level differences. While ensuring a good customized experience at all levels, it increases the frequency and efficiency of live broadcast interaction and optimizes the interactive experience for both the host and the user.
[0111] In one exemplary implementation, displaying the first virtual item and the second virtual item in the target live streaming room includes: In the target live stream room, the conditions for gifting the first virtual item, the second virtual item, and the conditions for gifting the second virtual item are displayed, including the quantity of the first virtual item that needs to be gifted.
[0112] This implementation method simultaneously displays the first virtual item, the second virtual item, and the corresponding gifting conditions for the second virtual item in the live broadcast room. By publicly disclosing the upgrade requirements in advance, users can clearly understand the tasks required to unlock higher-level gifts, eliminating information gaps and facilitating users to plan their actions in advance.
[0113] For example, when users see the Level 1 Heart Custom Gift and the Level 2 Gift Box Custom Gift in the gift section, they can also see that the Level 2 gift requires three Level 1 gifts to unlock, clearly indicating the threshold to be reached and increasing users' motivation to upgrade.
[0114] The plan will make the upgrade conditions public and quantifiable, and incentivize users to continue interacting through clear progress feedback, thereby increasing the interactive popularity of the live broadcast room.
[0115] In one exemplary embodiment, the method further includes: If the target live stream room is a group broadcast live stream room, display the anchor switching information; When the anchor switching information is triggered, if the interactive control is triggered, a third object is displayed in the target live room. The third object is used to represent the first virtual item gifted to the second anchor in the target live room. The second anchor is another anchor in the target live room that is different from the first anchor. The third object is media content generated based on at least one third material, which is a single-person material for the second anchor obtained by taking a screenshot of the live broadcast screen generated by the target live broadcast room in the live broadcast state.
[0116] When the target live stream is a group broadcast, the system can display streamer switching information. In scenarios with multiple streamers broadcasting simultaneously, it can provide users with an entry point to select the recipient of their gifts, adapting to the needs of users sending gifts to different streamers in group broadcast scenarios and avoiding the limitation of users only being able to send gifts to the currently default first streamer. For example, when two streamers start a group broadcast together, the option to switch streamers will automatically appear. For instance, the avatars or names of each streamer can be displayed simultaneously, making it easy for users to quickly identify the streamer they want to send gifts to, reducing the probability of selecting the wrong target and improving the accuracy of the operation.
[0117] After triggering the streamer switching information and the interactive controls, a third object is displayed for the second streamer. That is, after switching targets, you can give the corresponding virtual gift to the newly selected streamer. This process is similar to the process of giving the first object to the first streamer mentioned earlier, so I will not repeat it here.
[0118] This implementation method is adapted to the needs of multi-host group broadcasts, simplifies the process of users switching gift recipients, satisfies users' needs to customize gifts for any host in the group broadcast, improves the efficiency of gift-giving, effectively enhances the interactive participation in the group broadcast room, and optimizes the gift-giving experience in the group broadcast scenario.
[0119] In one exemplary implementation, the first virtual item is set as the cover of the target live stream room, or the avatar of the first streamer.
[0120] This implementation method allows the customized first virtual item to be reused as the cover of the live stream or the corresponding streamer's avatar, realizing the secondary use of customized content and avoiding waste of user-generated customized content. It also makes the content displayed in the live stream more closely reflect the interaction between the streamer and the user, creating a more personalized live stream entrance display. The live stream cover or the corresponding streamer's avatar can be displayed exclusively on the user's interface, unrelated to other users, thus achieving a personalized customization effect.
[0121] For example, User A creates a virtual gift for streamer Xiao Jia, featuring the message "Xiao Jia is the best." This customized gift can be given to Xiao Jia as a present, and can also be used as the exclusive cover image for the stream from the user's personal perspective, or as Xiao Jia's exclusive avatar in the stream's card from that user's perspective. It will not be displayed from other users' perspectives. This enhances User A's sense of accomplishment without affecting other users.
[0122] Alternatively, streamers can receive personalized virtual items customized for them by users and then choose any one as the cover image for their live stream or as their personal avatar. For example, streamer Xiaojia received dozens of customized virtual gifts from users. He can choose his favorite and set it as the public cover image for all viewers in the live stream, or as his public avatar on his live stream profile page, allowing all viewers to see the customized content created by the audience. This method effectively motivates viewers to create and interact, encouraging them to create high-quality customized content to be selected for public display. This further incentivizes users to customize and send gifts, while also saving the streamer the cost of designing and producing the cover image or avatar themselves, creating a more engaging and audience-centric live stream presentation style.
[0123] Please refer to Figure 3 It illustrates an exemplary live-streaming interaction process of this disclosure. Figure 1 . Figure 3 (a) shows the target live stream room, where interactive prompt information 310 is displayed. This prompt information suggests that the user can participate in the customization and gifting of personalized gifts (virtual items) through authorization. If the user authorizes by triggering the "agree" control, the live stream application can take screenshots of the live stream in a preset manner, resulting in multiple live stream screenshots.
[0124] Please refer to Figure 3 In Figure (b), if the "Agree" control is triggered to authorize, a prompt may appear to enable the customized gift.
[0125] exist Figure 3(c) The figure can show the first material 320 of the first anchor and the third material 330 of the second anchor, which are obtained by taking screenshots of the live broadcast and identifying the anchor.
[0126] Please refer to Figure 3 Figure (c) can also be used to obtain the second material 340 of the first anchor based on the relevant image processing of the first material of the first anchor, and to obtain the fourth material 350 of the second anchor based on the relevant image processing of the third material of the second anchor.
[0127] exist Figure 3 Figure (d) shows virtual items created based on various materials related to a particular streamer, in response to user personalization. These virtual items can be given as personalized gifts to the corresponding streamer in the target live stream room.
[0128] Please refer to Figure 4 It illustrates an exemplary live-streaming interaction process of this disclosure. Figure 2 . Figure 4 Figure (a) shows the target live stream room 410 for the group broadcast. If the user has authorized the customization and gifting of personalized gifts in this live stream room, interactive controls 420 corresponding to the first virtual item, prompt information 430 corresponding to the second virtual item, and prompt information 440 corresponding to the third virtual item can be displayed to the user in this live stream room. Among them, the first virtual item corresponds to the first level of display effect, the second virtual item corresponds to the second level of display effect, and the third virtual item corresponds to the third level of display effect. The first level is less than the second level, which is less than the third level.
[0129] The first virtual item can be gifted directly. In addition, the gifting conditions for the second virtual item can be displayed, which may include the quantity of the first virtual item to be gifted. The gifting conditions for the third virtual item can also be displayed, which may include the quantity of the second virtual item to be gifted.
[0130] If interactive control 420 is triggered, a first virtual item can be customized and gifted to the corresponding first streamer, and the first virtual item can be displayed in that live stream room, such as... Figure 4 As shown in Figure (b).
[0131] If a user sends a sufficient number of the first virtual items, they can... Figure 4 In diagram (c), an interactive control 450 corresponding to the second virtual item is displayed. If triggered, the second virtual item can be customized and gifted to the corresponding first streamer, and the second virtual item can be displayed in the live stream room. Figure 4 As shown in Figure (d).
[0132] If a user sends a sufficient number of second-tier virtual items, they can customize third-tier virtual items and gift them to the corresponding top streamer, where they will be displayed in that live stream. Figure 4 As shown in Figure (e).
[0133] Figure 5 This is a block diagram illustrating a live streaming interactive device according to an exemplary embodiment. (Refer to...) Figure 5 The device includes: The display module 510 is configured to display interactive controls in the target live room, which is any live room that is currently in a live state; The interaction module 520 is configured to display a first object in the target live streaming room when the interaction control is triggered. The first object represents a first virtual item gifted to a first streamer in the target live streaming room. The first object is media content generated based on at least one first material, which is a single-person material for the first streamer obtained based on the live streaming screen presented in the live streaming state of the target live streaming room.
[0134] In one exemplary implementation, the first object is media content generated by an artificial intelligence model based on at least one target material, wherein the target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material.
[0135] In one exemplary implementation, the interaction module 520 is configured to perform: When the interactive control is triggered, a first element processing area corresponding to the target material is displayed, and the first element processing area includes multiple first visual elements in the target material; When the first element processing area is triggered, the target material is updated based on the selected first visual element, and the updated target material is used to generate the first object.
[0136] In one exemplary embodiment, the first element processing area further includes a plurality of preset visual elements, which do not belong to the target material. The interaction module 520 is configured to execute: When the first element processing area is triggered, the target material is updated based on the selected first visual element and the selected preset visual element.
[0137] In one exemplary implementation, the interaction module 520 is configured to perform: When the interactive control is triggered, a second element processing area is displayed, which includes multiple second visual elements corresponding to each target material. When the second element processing area is triggered, the first object is displayed, which is media content generated based on all the second visual elements selected in the second element processing area.
[0138] In one exemplary implementation, the interaction module 520 is configured to perform: The target live streaming room displays a first preview object and object adjustment controls. The first preview object is media content generated based on at least one target material. The target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material. When the object adjustment control is triggered, a second preview object is displayed in the target live stream room. The second preview object is media content generated based on at least one of the target materials. The second preview object is different from the first preview object. When the interactive control is triggered, the second preview object is displayed as the first object.
[0139] In one exemplary embodiment, both the first preview object and the second preview object are obtained by stitching together images from at least two target materials. The first preview object and the second preview object differ in at least one of the following ways: they use different target materials, they use different stitching templates, and they have different display effects. The difference in the target materials used includes at least one of the following: The content of the target materials used are not exactly the same; The number of target materials used is not exactly the same; The display effects of the target materials used are not entirely the same.
[0140] In one exemplary implementation, the interaction module 520 is configured to perform: When the object adjustment control is triggered, multiple candidate target materials are displayed; In response to the selection operation of the plurality of candidate target materials, the second preview object is displayed in the target live room. The second preview object is media content generated based on the selected target material.
[0141] In one exemplary implementation, the interaction module 520 is configured to perform: When the object adjustment control is triggered, a keyword control is displayed. The keyword control is used to input or select a target keyword, which is the guidance information required to guide the generation of the second preview object. Based on the operation of the keyword control, the second preview object is displayed. The second preview object is media content generated based on at least one of the target materials under the guidance of the target keyword.
[0142] In one exemplary implementation, the interaction module 520 is configured to perform: When the object adjustment control is triggered, the second preview object is displayed. The second preview object is media content randomly generated based on the same target material corresponding to the first preview object.
[0143] In one exemplary implementation, the interaction module 520 is configured to perform: In the target live streaming room, the first virtual item and the second virtual item are displayed, and the first level of the first virtual item is lower than the second level of the second virtual item. When the interactive control corresponding to the first virtual item is triggered, the first object is displayed in the target live broadcast room. The first object is media content generated based on at least one of the first materials and the display effect corresponding to the first level. When the first virtual item is sent and the interactive control corresponding to the second virtual item is triggered, a second object is displayed in the target live stream room. The second object represents the second virtual item gifted to the first streamer in the target live stream room. The second object is media content generated based on at least one of the first materials and the display effect corresponding to the second level. The display effect corresponding to the first level is different from that corresponding to the second level.
[0144] In one exemplary implementation, the interaction module 520 is configured to perform: In the target live stream room, the conditions for gifting the first virtual item, the second virtual item, and the conditions for gifting the second virtual item are displayed, including the quantity of the first virtual item that needs to be gifted.
[0145] In one exemplary implementation, the interaction module 520 is configured to perform: If the target live stream room is a group broadcast live stream room, display the anchor switching information; When the anchor switching information is triggered, if the interactive control is triggered, a third object is displayed in the target live room. The third object is used to represent the first virtual item gifted to the second anchor in the target live room. The second anchor is another anchor in the target live room that is different from the first anchor. The third object is media content generated based on at least one third material, which is a single-person material for the second anchor obtained by taking a screenshot of the live broadcast screen generated by the target live broadcast room in the live broadcast state.
[0146] In one exemplary implementation, the interaction module 520 is configured to set the first virtual item as the cover of the target live stream room, or the avatar of the first streamer.
[0147] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0148] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is able to perform any of the methods described above.
[0149] In an exemplary embodiment, a computer program product is also provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the device to perform any of the methods described above.
[0150] Figure 6 This is a block diagram illustrating an electronic device for live streaming interaction according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as follows: Figure 6 As shown, the device may include an RF (Radio Frequency) circuit 610, a memory 620 including one or more computer-readable storage media, an input unit 630, a display unit 640, a sensor 650, an audio circuit 660, a WiFi (Wireless Fidelity) module 670, a processor 680 including one or more processing cores, and a power supply 690, among other components. Those skilled in the art will understand that... Figure 6The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The RF circuit 610 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and hands it over to one or more processors 680 for processing; additionally, it transmits uplink data to the base station. Typically, the RF circuit 610 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. Furthermore, the RF circuit 610 can also communicate wirelessly with networks and other terminals. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.
[0151] The memory 620 can be used to store software programs and modules. The processor 680 executes various functional applications and data processing by running the software programs and modules stored in the memory 620. The memory 620 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for the functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 620 may also include a memory controller to provide access to the memory 620 for the processor 680 and the input unit 630.
[0152] The input unit 630 can be used to receive input digital or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 630 may include a touch-sensitive surface 631 and other input devices 632. The touch-sensitive surface 631, also known as a touch display screen or touchpad, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch-sensitive surface 631), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface 631 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch-sensitive surface 631 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 631, the input unit 630 may also include other input devices 632. Specifically, other input devices 632 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc. The display unit 640 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. The display unit 640 may include a display panel 641, which may optionally be configured as an LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or similar display. Furthermore, a touch-sensitive surface 631 may cover the display panel 641. When the touch-sensitive surface 631 detects a touch operation on or near it, it transmits the information to the processor 680 to determine the type of touch event. Subsequently, the processor 680 provides corresponding visual output on the display panel 641 according to the type of touch event. The touch-sensitive surface 631 and the display panel 641 can be two independent components to implement input and output functions. However, in some embodiments, the touch-sensitive surface 631 and the display panel 641 can be integrated to achieve both input and output functions.
[0153] The terminal may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 641 according to the ambient light level, and the proximity sensor can turn off the display panel 641 and / or backlight when the terminal is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that identify the terminal's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometer, tapping), etc. Other sensors that may be configured on the terminal, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.
[0154] Audio circuitry 660, speaker 661, and microphone 662 provide an audio interface between the user and the terminal. Audio circuitry 660 converts received audio data into electrical signals, which are then transmitted to speaker 661, where they are converted into sound signals for output. Conversely, microphone 662 converts collected sound signals into electrical signals, which are received by audio circuitry 660, converted back into audio data, and then processed by processor 680 before being transmitted via RF circuitry 610 to, for example, another terminal, or output to memory 620 for further processing. Audio circuitry 660 may also include an earphone jack to facilitate communication between a peripheral headset and the terminal.
[0155] WiFi is a short-range wireless transmission technology. This terminal, through the WiFi module 670, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 6 WiFi module 670 is shown, but it is understood that it is not an essential component of the terminal and can be omitted as needed without changing the nature of the invention.
[0156] The processor 680 is the control center of the terminal, connecting various parts of the terminal via various interfaces and lines. It executes software programs and / or modules stored in the memory 620, and calls data stored in the memory 620, to perform various functions and process data, thereby enabling overall monitoring of the terminal. Optionally, the processor 680 may include one or more processing cores; preferably, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interaction area, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 680.
[0157] The terminal also includes a power supply 690 (such as a battery) to power various components. Preferably, the power supply can be logically connected to the processor 680 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 690 may also include one or more DC or AC power supplies, a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.
[0158] Although not shown, the terminal may also include a camera, Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the display unit of the terminal is a touch screen display, and the terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors of the instructions in the method embodiment of the present invention.
[0159] Please refer to Figure 7 This illustration shows another block diagram of an electronic device for live-stream interaction provided in another exemplary embodiment of this disclosure. The computer device may be a server for executing the aforementioned live-stream interaction method. Specifically: Computer device 700 includes a central processing unit (CPU) 701, a system memory 704 including random access memory (RAM) 702 and read-only memory (ROM) 703, and a system bus 705 connecting the system memory 704 and the CPU 701. Computer device 700 also includes a basic input / output system (I / O system) 706 that facilitates information transfer between various devices within the computer, and a mass storage device 707 for storing the operating system 713, application programs 714, and other program modules 711.
[0160] The basic input / output system 706 includes a display 708 for displaying information and an input device 709 for user input, such as a mouse or keyboard. Both the display 708 and the input device 709 are connected to the central processing unit 701 via an input / output controller 170 connected to the system bus 705. The basic input / output system 706 may also include the input / output controller 170 for receiving and processing input from multiple other devices such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 170 also provides output to a display screen, printer, or other types of output devices.
[0161] Mass storage device 707 is connected to central processing unit 701 via a mass storage controller (not shown) connected to system bus 705. Mass storage device 707 and its associated computer-readable media provide non-volatile storage for computer device 700. That is, mass storage device 707 may include computer-readable media (not shown) such as hard disk or CD-ROM (CompactDisc Read-Only Memory) drive.
[0162] Without loss of generality, computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented using any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc) or other optical storage, magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will recognize that computer storage media are not limited to the above-mentioned types. The system memory 704 and mass storage device 707 described above can be collectively referred to as memory.
[0163] According to various embodiments of this disclosure, the computer device 700 can also be connected to a remote computer on a network, such as the Internet. That is, the computer device 700 can be connected to a network 712 via a network interface unit 711 connected to the system bus 705, or the network interface unit 711 can be used to connect to other types of networks or remote computer systems (not shown).
[0164] The aforementioned memory also includes a computer program stored in the memory and configured to be executed by one or more processors to implement the aforementioned live streaming interaction method.
[0165] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, at least one program, code set, or instruction set is executed by a processor to implement the live streaming interaction method.
[0166] Optionally, the computer-readable storage medium may include: ROM (Read Only Memory), RAM (Random Access Memory), SSD (Solid State Drives), or optical disc, etc. The random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).
[0167] In an exemplary embodiment, a computer-readable storage medium including program code is also provided, such as a memory including program code, which can be executed by a processor to complete the above-described live streaming interaction method. Optionally, the computer-readable storage medium may be read-only memory (ROM), random access memory (RAM), compact-disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.
[0168] In an exemplary embodiment, a computer program product is also provided, including a computer program that, when executed by a processor, implements the above-described live streaming interaction method.
[0169] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0170] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A live streaming interaction method, characterized in that, The method includes: In the target live stream room, interactive controls are displayed. The target live stream room is any live stream room that is currently in a live streaming state. When the interactive control is triggered, a first object is displayed in the target live streaming room, the first object representing a first virtual item gifted to the first streamer in the target live streaming room; Wherein, the first object is media content generated based on at least one first material, and the first material is a single material for the first anchor obtained based on the live broadcast screen presented by the target live broadcast room in the live broadcast state.
2. The method according to claim 1, characterized in that, The first object is media content generated by an artificial intelligence model based on at least one target material, wherein the target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material.
3. The method according to claim 2, characterized in that, The step of displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a first element processing area corresponding to the target material is displayed, and the first element processing area includes multiple first visual elements in the target material; When the first element processing area is triggered, the target material is updated based on the selected first visual element, and the updated target material is used to generate the first object.
4. The method according to claim 3, characterized in that, The first element processing area also includes multiple preset visual elements, which do not belong to the target material. When the first element processing area is triggered, updating the target material based on the selected first visual element includes: When the first element processing area is triggered, the target material is updated based on the selected first visual element and the selected preset visual element.
5. The method according to claim 2, characterized in that, The step of displaying the first object in the target live stream room when the interactive control is triggered includes: When the interactive control is triggered, a second element processing area is displayed, which includes multiple second visual elements corresponding to each target material. When the second element processing area is triggered, the first object is displayed, which is media content generated based on all the second visual elements selected in the second element processing area.
6. The method according to claim 1 or 2, characterized in that, The step of displaying the first object in the target live stream room when the interactive control is triggered includes: The target live streaming room displays a first preview object and object adjustment controls. The first preview object is media content generated based on at least one target material. The target material is either the first material or the second material, and the second material is material obtained by performing at least one image processing on the first material. When the object adjustment control is triggered, a second preview object is displayed in the target live stream room. The second preview object is media content generated based on at least one of the target materials. The second preview object is different from the first preview object. When the interactive control is triggered, the second preview object is displayed as the first object.
7. The method according to claim 6, characterized in that, Both the first preview object and the second preview object are obtained by stitching together images from at least two target materials. The first preview object and the second preview object differ in at least one of the following ways: they use different target materials, they use different stitching templates, and they have different display effects. The difference in the target materials used includes at least one of the following: The content of the target materials used are not exactly the same; The number of target materials used is not exactly the same; The display effects of the target materials used are not entirely the same.
8. The method according to claim 6, characterized in that, The step of displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, multiple candidate target materials are displayed; In response to the selection operation of the plurality of candidate target materials, the second preview object is displayed in the target live room. The second preview object is media content generated based on the selected target material.
9. The method according to claim 6, characterized in that, The step of displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, a keyword control is displayed. The keyword control is used to input or select a target keyword, which is the guidance information required to guide the generation of the second preview object. Based on the operation of the keyword control, the second preview object is displayed. The second preview object is media content generated based on at least one of the target materials under the guidance of the target keyword.
10. The method according to claim 6, characterized in that, The step of displaying a second preview object in the target live stream room when the object adjustment control is triggered includes: When the object adjustment control is triggered, the second preview object is displayed. The second preview object is media content randomly generated based on the same target material corresponding to the first preview object.
11. The method according to claim 1, characterized in that, The step of displaying the first object in the target live stream room when the interactive control is triggered includes: In the target live streaming room, the first virtual item and the second virtual item are displayed, and the first level of the first virtual item is lower than the second level of the second virtual item. When the interactive control corresponding to the first virtual item is triggered, the first object is displayed in the target live broadcast room. The first object is media content generated based on at least one of the first materials and the display effect corresponding to the first level. The method further includes: When the first virtual item is sent and the interactive control corresponding to the second virtual item is triggered, a second object is displayed in the target live stream room. The second object represents the second virtual item gifted to the first streamer in the target live stream room. The second object is media content generated based on at least one of the first materials and the display effect corresponding to the second level. The display effect corresponding to the first level is different from that corresponding to the second level.
12. The method according to claim 11, characterized in that, The process of displaying the first virtual item and the second virtual item in the target live streaming room includes: In the target live stream room, the conditions for gifting the first virtual item, the second virtual item, and the conditions for gifting the second virtual item are displayed, including the quantity of the first virtual item that needs to be gifted.
13. The method according to claim 1, characterized in that, The method further includes: If the target live stream room is a group broadcast live stream room, display the anchor switching information; When the anchor switching information is triggered, if the interactive control is triggered, a third object is displayed in the target live room. The third object is used to represent the first virtual item gifted to the second anchor in the target live room. The second anchor is another anchor in the target live room that is different from the first anchor. The third object is media content generated based on at least one third material, which is a single-person material for the second anchor obtained by taking a screenshot of the live broadcast screen generated by the target live broadcast room in the live broadcast state.
14. The method according to claim 1, characterized in that, Set the first virtual item as the cover of the target live stream room, or the avatar of the first streamer.
15. A live streaming interactive device, characterized in that, The device includes: The display module is configured to execute in the target live room and display interactive controls, wherein the target live room is any live room that is currently in a live state; The interaction module is configured to display a first object in the target live streaming room when the interaction control is triggered. The first object represents a first virtual item gifted to the first streamer in the target live streaming room. Wherein, the first object is media content generated based on at least one first material, and the first material is a single material for the first anchor obtained based on the live broadcast screen presented by the target live broadcast room in the live broadcast state.
16. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the live streaming interaction method as described in any one of claims 1 to 14.
17. A computer-readable storage medium, characterized in that, When the program code in the computer-readable storage medium is executed by the processor of the electronic device, the electronic device is able to perform the live streaming interaction method as described in any one of claims 1 to 14.
18. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the live streaming interaction method as described in any one of claims 1 to 14.
