Virtual gift generation method, device, equipment, medium, and computer program

The method and apparatus allow users to generate customizable virtual gifts with dynamic effects, addressing the limitations of fixed gifts in live streaming platforms by enabling personalized and engaging interactions.

JP2025537558APending Publication Date: 2025-11-18BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025526667
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-02-28
Filing Date
2024-02-28
Publication Date
2025-11-18

AI Technical Summary

Technical Problem

Existing virtual gift systems in live streaming platforms limit user interaction by offering only fixed virtual gifts, failing to meet diverse user needs and enhancing the user experience.

Method used

A method and apparatus for generating customizable virtual gifts by allowing users to input their own information, selecting a virtual gift template, and applying foreground, background, and transformation models to create dynamic effects.

Benefits of technology

Enables users to create personalized virtual gifts with unique animation effects, improving user interaction and experience by allowing for tailored and engaging virtual gift presentations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025537558000001_ABST
    Figure 2025537558000001_ABST
Patent Text Reader

Abstract

The present application discloses a method, apparatus, device, and medium for generating a virtual gift, which includes: acquiring pending information in response to a trigger operation in a user's live streaming studio, the pending information being information used to generate the virtual gift; determining a virtual gift template corresponding to the pending information after acquiring the pending information, where different virtual gift templates correspond to different video effects; generating a virtual gift based on the virtual gift template and the pending information, the virtual gift presenting the video effect corresponding to the virtual gift template.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims priority from a Chinese patent application filed with the China Patent Office on February 28, 2023, bearing application number 202310214449.7 and entitled "Virtual Gift Generation Method, Apparatus, Device and Medium," the entire contents of which are incorporated herein by reference.

[0002] [Technical field] TECHNICAL FIELD This application relates to the field of computer technology, and more particularly to a virtual gift generation method, device, apparatus and medium. [Background technology]

[0003] With the continuous development of online live streaming technology, more and more users interact with anchors through live streaming studios. Common interaction methods include sending virtual gifts, making comments in the public screen area, etc. Currently, when users send virtual gifts to anchors through live streaming studios, they can only select fixed virtual gifts provided by the live streaming platform, which makes it difficult to meet users' needs and affects the user experience. Summary of the Invention [Problem to be solved by the invention]

[0004] In view of this, embodiments of the present application provide a method, device, apparatus, and medium for generating a virtual gift. [Means for solving the problem]

[0005] To achieve the above objectives, the technical solutions provided by this application are as follows:

[0006] A first aspect of the present application is a method for generating a virtual gift, the method comprising: In response to a trigger operation by a user, acquiring pending information that is information used to generate a virtual gift; determining a virtual gift template corresponding to the to-be-processed information, the virtual gift template including at least one of foreground information, background information, and a transformation model, the foreground information being used to provide a foreground image for the virtual gift being generated, the background information being used to provide a background image for the virtual gift being generated, and the transformation model being used to add a dynamic transformation effect to the to-be-processed information; generating a virtual gift based on the virtual gift template and the pending information.

[0007] According to a second aspect of the present application, there is provided an apparatus for generating a virtual gift, the apparatus comprising: an acquisition unit for acquiring pending information, which is information used to generate the virtual gift, in response to a trigger operation by a user; A determination unit for determining a virtual gift template corresponding to the waiting information, the virtual gift template including at least one of foreground information, background information, and a transformation model, the foreground information being used to provide a foreground image for the virtual gift being generated, the background information being used to provide a background image for the virtual gift being generated, and the transformation model being used to add a dynamic transformation effect to the waiting information; a generating unit for generating a virtual gift based on the virtual gift template and the to-be-processed information.

[0008] According to a third aspect of the present application, there is provided an electronic device, the electronic device including a processor and a memory; the memory is used to store instructions or computer programs; The processor is adapted to execute the instructions or computer programs stored in the memory to cause the electronic device to perform the method of the first aspect.

[0009] According to a fourth aspect of the present application, there is provided a computer-readable storage medium having instructions stored therein that, when executed by an apparatus, cause the apparatus to perform the method of the first aspect.

[0010] According to a fifth aspect of the present application, there is provided a computer program product, the computer program product comprising computer programs / instructions which, when executed by a processor, implement the method according to the first aspect. [Brief explanation of the drawings]

[0011] In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following briefly introduces the drawings that need to be used in the description of the embodiments or the prior art. The drawings in the following description are only some of the multiple embodiments described in the present application, and it is obvious that those skilled in the art can obtain other drawings based on these drawings without any creative efforts.

[0012] [Figure 1] 1 is a flowchart of a virtual gift generation method provided by an embodiment of the present application; [Figure 2] FIG. 1 is a schematic diagram of photo upload provided by an embodiment of the present application. [Figure 3A] FIG. 10 is a schematic diagram of a background video in a virtual gift template provided by an embodiment of the present application. [Figure 3B] FIG. 10 is a schematic diagram of a background video in another virtual gift template provided by an embodiment of the present application. [Figure 3C] 1 is a schematic diagram of a text display provided by an embodiment of the present application. [Figure 3D] FIG. 10 is a schematic diagram of another text display provided by an embodiment of the present application. [Figure 4A] 1 is a schematic diagram of a virtual gift provided by an embodiment of the present application. [Figure 4B] FIG. 10 is a schematic diagram of another virtual gift provided by an embodiment of the present application. [Figure 5] 1 is a structural diagram of a virtual gift generating device provided by an embodiment of the present application; [Figure 6] 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0013] In order to help those skilled in the art better understand the solutions of the present application, the following clearly and completely describes the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, but it is obvious that the described embodiments are only some of the embodiments of the present application and do not represent all of the embodiments. Based on the embodiments of the present application, all other embodiments that can be obtained by those skilled in the art without any creative efforts fall within the scope of protection of the present application.

[0014] In order to improve the interactivity between the anchor and the viewer during live streaming, a function for sending virtual gifts is generally set in the viewer client. The viewer can select a virtual gift to send through a gift panel in the client and send the selected virtual gift to the anchor through the gift sending function. Generally, the multiple selectable virtual gifts displayed on the virtual gift panel are preset by the live streaming platform, and the virtual gifts that viewers from different live streaming studios or the same live streaming studio can select are all the same, which cannot meet the needs of different live streaming studios or different viewers.

[0015] Based on this, the present application provides a method for generating a virtual gift for a user of a live streaming studio, which may be a viewer or a host. The method acquires pending information in response to a trigger operation by the user and determines a virtual gift template corresponding to the pending information. The virtual gift template includes at least one of foreground information, background information, and a transformation model. The foreground information is used to provide a foreground image for the virtual gift being generated, the background information is used to provide a background image for the virtual gift being generated, and the transformation model is used to add dynamic transformation effects to the pending information. Based on the acquired pending information and the virtual gift template, virtual gifts with different animation effects are generated, allowing interactions with the host to be performed using the virtual gift, thereby satisfying the user's needs.

[0016] To facilitate understanding of the technical solutions provided by the embodiments of the present application, the following description will be made with reference to the drawings.

[0017] Referring to FIG. 1, this figure is a flowchart of a method for generating a virtual gift provided by an embodiment of the present application. As shown in FIG. 1, this method may be executed by a live streaming client or server. The live streaming client may be a live streaming client corresponding to a viewer or a live streaming client corresponding to a host, and may be installed in an electronic device. Here, the electronic device may include a device with a communication function, such as a mobile phone, a tablet PC, a laptop, a desktop PC, an in-vehicle device, a wearable electronic device, an all-in-one device, or a smart home device, or may be a device simulated by a virtual device or a simulator. As shown in FIG. 1, this method may include the following steps:

[0018] S101: In response to a trigger operation by the user, information on pending processes is obtained.

[0019] In this embodiment, a user may upload information to be used to generate a virtual gift, i.e., to-be-processed information, via a live streaming client. Here, the to-be-processed information may be to-be-processed images or to-be-processed text. That is, to-be-processed images may be used to generate a virtual gift, or to-be-processed text may be used to generate a virtual gift.

[0020] Here, the user may be a viewer or a host in a live streaming studio. If the user is a viewer in the live streaming studio, the user uploads the to-be-processed information through a live streaming client on the viewer side. If the user is a host in the live streaming studio, the user uploads the to-be-processed information through a live streaming client on the host side. It should be noted that generating the virtual gift based on the to-be-processed information may be performed by the live streaming client, or the live streaming client may obtain the to-be-processed information and then upload the to-be-processed information to a server, and the server may use the to-be-processed information to generate the virtual gift.

[0021] In some embodiments, the to-be-processed information may be obtained in the following manner.

[0022] One is to display a first page in response to a user's trigger operation on a first control on a gift panel in a live streaming studio, and to obtain the uploaded pending information in response to an upload operation triggered by the user on the first page. That is, an upload entrance may be set on the gift panel in the live streaming studio, and the user uploads the pending information required to generate the virtual gift through this upload entrance.

[0023] The other is to display a second page in response to a user's trigger operation on a second control on the personal homepage, and to acquire the uploaded pending information in response to an upload operation triggered by the user on the second page. That is, an upload entrance may be set on the personal homepage of the live streaming client corresponding to the user, and the user may upload the pending information required for generating the virtual gift through this upload entrance.

[0024] Here, if the waiting information being uploaded by the user is a waiting image, after entering the first page, an "Upload Photo" control may be displayed on the first page, allowing the user to select a photo they want to upload from a local album or a photo taken in real time using a local camera.

[0025] Specifically, when the pending information being uploaded by the user is pending text, after entering the first page, the "upload photo" control is displayed on the first page, and the user can select a photo containing the text to be uploaded from a local album through the "upload photo" control, or a photo containing the pending text that is taken in real time using a local camera. Alternatively, after entering the first page, an input box is displayed, and the user can input the pending text information into the input box.

[0026] For ease of understanding, refer to the application scene diagram shown in FIG. 2. This scene will be described by taking the example of setting up an upload entry in a gift panel and uploading images to be processed. When a user opens the gift panel, a first control 201 may be displayed on the gift panel. In response to the user's trigger operation on the first control 201, a first page 300 is displayed. The first page 300 displays an "Upload Photo" control and prompt information, which is used to prompt the user for requirements that the uploaded photo must meet. After the user uploads a photo, in response to a trigger operation on the instant creation control, a suggestion page 400 may be displayed. The suggestion page may allow the user to select a desired effect, i.e., a virtual gift template, and display a preview image corresponding to the virtual gift template. At the same time, the suggestion page 400 may also perform a submission review of the uploaded photo. If the review is successful, the uploaded photo can be used to create a virtual gift.

[0027] Here, the representation format of the second page can refer to the first page 300 in FIG. 2, and this embodiment will not be further described here.

[0028] S102: Determine a virtual gift template corresponding to the pending information.

[0029] In this embodiment, in order to meet different needs, users can determine the matching virtual gift template according to their needs or the type of pending information, and multiple virtual gift templates may be pre-customized to enhance the presentation effect of the virtual gift, where different virtual gift templates correspond to different animation effects.

[0030] Here, the virtual gift template corresponding to the pending information may be determined in the following manner.

[0031] One is to obtain a virtual gift template corresponding to a selection operation triggered by a user in response to the selection operation, that is, after the user uploads the waiting information, the user may select a virtual gift template required by the user, so that the user can generate a virtual gift using the selected virtual gift template and the waiting information.

[0032] The other is to determine a virtual gift template corresponding to the pending information based on the type of the pending information. That is, virtual gift templates corresponding to different types of pending information may be pre-configured, and after obtaining the pending information, a virtual gift template matching the pending information is determined based on the type of the pending information. Here, the type of the pending information may include image or text, and if the type of the pending information is image, it may correspond to a virtual template that processes images, and if the type of the pending information is text, it may correspond to a virtual template that processes text.

[0033] In some embodiments, if the to-be-processed information includes a target object, the virtual gift template is a scene template, and the scene template includes scene elements for displaying the target object, and the target object in the virtual gift is rendered in the scene elements. Here, the target object may be an object such as text, a person, or an animal. For example, the scene element for displaying the text shown in FIG. 3a is a rectangular display frame, and the scene element for displaying the person shown in FIG. 3b is a display screen. Here, if the target object is a text object and the display length of the text object is longer than the display length of the scene elements, the text object in the virtual gift is displayed in a loop scroll manner.

[0034] Here, the virtual gift template may include at least one of foreground information, background information, and a transformation model. The foreground information is used to provide a foreground image for the virtual gift being generated, the background information is used to provide a background image for the virtual gift being generated, and the transformation model is used to add a dynamic transformation effect to the pending information. That is, the input of the transformation model is the pending information, and the transformation model output information is processed information output after processing the pending information. Here, the dynamic transformation effect may include a dynamic effect, such as changing the pending information in the virtual gift from large to small or from close to far when displaying the virtual gift.

[0035] Here, the foreground information may be a foreground sequence frame, the transformation model may be a 3D model, and the background information may be a background video. Here, the foreground sequence frame is used to provide a foreground video for the virtual gift that is finally generated. Here, the foreground sequence frame is obtained by integrating multiple pictures.

[0036] The 3D model is used to process the information to be processed so that the processed information can have dynamic transformation effects. Here, the processing operation of the 3D model may include static processing and dynamic processing, where the static processing may refer to color correction of the information to be processed, and the dynamic processing may refer to adding dynamic transformation effects to the information to be processed. Here, the static processing may include pixelation, gradation, color mapping, glow processing, exposure correction, and verification adjustment. The dynamic processing may further include adding streamer sequence frames and adding flash effects.

[0037] Here, pixelation refers to dividing a target image into a certain number of pixel points, extracting color values ​​from the pixel points as the pixel values ​​of the current pixel block, and then converting them into circular pixel points. Gradient conversion refers to converting a color image into a gradient image. Specifically, the maximum RGB value in the target image is extracted, and this maximum value is used as the gradient value to gradient the target image. Color mapping refers to color mapping based on gradient difference values. Specifically, the difference value is calculated based on the gradient value, a boundary is determined based on the difference value, and the colors on both sides of the boundary are blended to obtain the mapped color. Color adjustment mainly refers to contrast adjustment, which employs a general-purpose contrast algorithm to adjust graphics, enhance contrast, and make the glow effect more pronounced.

[0038] Here, realizing the streamer sequence frame may include calculating an index for each frame based on the number of frames in each row and column of the sequence frame texture, and switching the position of the texture based on the index. When rendering each frame, update the timestamp, calculate the index of the target frame that needs to be currently displayed based on the time interval, and update the UV coordinates of the map as the position of the target frame, thereby realizing the playback of the sequence frame video.

[0039] The implementation of adding flash effects may include using an additional random noise picture to determine the location of flash points. Specifically, by determining points in the noise picture with color values ​​greater than a certain color value as flash points, randomly distributed flash points can be obtained. At the same time, by combining a sine function with a time parameter, flash points with different brightness and flickering alternately can be obtained.

[0040] The background video is used to output a moving image with a background effect. For example, if the information to be processed is text, the background video shown in Fig. 3a provides a display frame for the text, and if the information to be processed is a portrait, the background video shown in Fig. 3b provides a display screen for the portrait.

[0041] If the waiting information is text, text typesetting and font adjustment can be performed. If the text length is longer than the preset display length, it can be scrolled for display. If the text length is shorter than the preset display length, it can be centered for display. Specifically, as shown in Figure 3c, text is drawn on a canvas and the canvas width is set according to the text width. If the canvas size is long, direct rendering, as shown in Figure 3d, can result in the text height being stretched. To avoid this stretching, the aspect ratio of the characters can be guaranteed by zooming the horizontal axis of the texture coordinates on the canvas. Specifically, the horizontal axis coordinate of the texture is divided by a scaling ratio, and the zoomed texture is then rendered. The scaling ratio should be determined according to the actual application situation and the size of the texture. The texture size changes depending on the number of characters.

[0042] S103: Generate a virtual gift based on the virtual gift template and the pending information.

[0043] After obtaining the virtual gift template and the waiting information, a virtual gift required by the user is obtained by generating a virtual gift based on the virtual gift template and the waiting information.

[0044] For example, if the waiting information is waiting text, the virtual gift generated based on the virtual gift template is a lamp plate gift, and the presentation effect is as shown in Figure 4a, where the waiting text is displayed on the lamp plate. In specific application, after the lamp plate gift is presented to the host, the lamp plate will have a dynamic display effect in the live streaming studio. If the waiting information is waiting person image, the virtual gift generated based on the virtual gift template is a gift including a person image, and the presentation effect is as shown in Figure 4b.

[0045] In some embodiments, generating a virtual gift based on the virtual gift template and the waiting-for-processing information includes obtaining a playback time of target information and generating a virtual gift based on the playback time of the target information, where the target information is at least one of foreground information, background information, waiting-for-processing information, and converted model output information. That is, the playback time corresponding to each component of the virtual gift is obtained, and the virtual gift is generated based on the playback time corresponding to each component. The playback time corresponding to each component may be pre-configured. For example, the playback time length of the background information is 2 seconds, the playback time length of the background information is 10 seconds, and the playback time length of the waiting-for-processing information or the converted model output information is 8 seconds. Generally, when the playback time length of the background information is the longest, each component can be played based on the playback time axis of the background information. For example, when playback of the background information is started, the foreground information is played for the first 2 seconds, followed by the waiting-for-processing information or the converted model output information, for a total of 8 seconds.

[0046] Alternatively, the video playback time corresponding to the virtual gift template may be first obtained, and then the playback time of the target information may be determined based on the video playback time corresponding to the virtual gift template. That is, the playback time of each piece of information may be determined based on the video playback time corresponding to the virtual gift template, and a virtual gift may be generated based on the playback time of each piece of information, thereby enabling a virtual gift with video effects to exhibit different information effects. Here, the virtual gift generated using the virtual gift template has video effects, and the video playback time corresponds to the presentation of the video effects corresponding to the virtual gift. This video playback time may be pre-configured when creating the virtual gift template, or may be dynamically configured based on the amount of information waiting to be processed, so that the generated virtual gift presents the information waiting to be processed relatively appropriately. For example, if the information waiting to be processed is a text object, the video playback time may be determined based on the number of characters contained in the text object.

[0047] Here, when the content included in the virtual gift template is different, determining the playback time of the target information based on the video playback time corresponding to the virtual gift template may specifically include:

[0048] First, when a virtual gift template includes foreground information and the target information is foreground information and waiting information, the start and end times of the foreground information and the waiting information are determined based on the video playback time corresponding to the virtual gift template. Here, the start time of the foreground information is earlier than the start time of the waiting information, and the end time of the foreground information is earlier than the end time of the video playback time. That is, when a virtual gift with an animation effect is played, the foreground information is first played and then the waiting information is played, thereby blending the foreground information and the waiting information according to the playback time and embodying the foreground image provided by the foreground information. Generally, the end time of the foreground information is equal to the start time of the waiting information, i.e., the waiting information is played immediately after the foreground information ends. The end time of the waiting information is generally equal to the end time of the video playback time corresponding to the virtual gift template.

[0049] The other is that when the virtual gift template includes background information and the target information includes background information and waiting information, the video playback time corresponding to the virtual gift template is set to the playback time of the background information, and the playback start time of the waiting information is determined based on the video playback time corresponding to the virtual gift template. That is, when the virtual gift template includes background information, a playback background is added to the waiting information to highlight the waiting information and enhance the sense of space when generating the virtual gift.

[0050] Here, the playback time of the background information is equal to the video playback time, i.e., the playback start time of the background information is equal to the playback start time of the video playback time, and the playback end time of the background information is equal to the playback end time of the video playback time. Playback of the background information begins when playback of the virtual gift video begins. Here, the playback start time of the waiting information may be equal to or later than the playback start time of the video playback time. If the playback start time of the waiting information is later than the playback start time of the video playback time, the playback start time corresponding to the waiting information may be preset. That is, the waiting information may be played simultaneously with the background information or may be played with a delay. Here, the playback end time of the waiting information may generally be equal to or earlier than the playback end time of the video playback time. If the playback end time of the waiting information is earlier than the playback end time of the video playback time, the playback duration corresponding to the waiting information may be preset, and the playback end time may be determined based on the preset playback start time and playback duration.

[0051] One is to set the video playback time corresponding to the virtual gift template to the playback time of the converted model output information when the virtual gift template includes a conversion model and the target information is the converted model output information. That is, when there is only a conversion model, the conversion model is used to process the waiting information and obtain the processed information, and the playback time of the processed information is equal to the video playback time corresponding to the virtual gift template. That is, the playback start time of the processed information is equal to the playback start time of the video playback time, and the playback end time of the processed information is equal to the playback end time of the video playback time.

[0052] Another method is to set the video playback time corresponding to the virtual gift template to the playback time of the background information, where the target information includes the foreground information, background information, and waiting information. The playback start time and end time of the foreground information are determined based on the video playback time corresponding to the virtual gift template. The playback start time of the foreground information is the same as the playback start time of the background information. The playback start time of the waiting information is determined based on the video playback time corresponding to the virtual gift template. The playback start time of the foreground information is earlier than the playback start time of the waiting information. Generally, the playback end time of the foreground information may be earlier than the playback start time of the waiting information. That is, when the virtual gift video is played, the foreground information and background information are played simultaneously, but the foreground information is played for only a certain period of time, and the background information is played throughout the entire process. The waiting information begins to play after the playback of the foreground information ends. For example, if the video playback time corresponding to the virtual gift template is 10 seconds, the background information is played for 10 seconds, the foreground information is played for only the first 2 seconds, and the waiting information starts to play from the 2nd second.

[0053] When the background information is a background video, the foreground information and the output result of the transformation model are both realized by the renderer loop, and theoretically, the playback order can be controlled based on the time difference of the renderer. However, the playback of the background video is heavily dependent on the control of the underlying player, and rendering is only performed when the video frame is updated, which creates the problem of asynchronous playback between the video and the foreground information. Based on this, the rendering of other parts is updated around the time axis of the background video.

[0054] In some embodiments, when a video playback time corresponding to a virtual gift template exists and each piece of target information also has a corresponding playback time, if the video playback time does not match the playback time corresponding to the target information, the playback time corresponding to the target information may be adjusted based on the video playback time. For example, if the video playback time is 10 seconds and the playback time of the background information is 8 seconds, the playback time of the background information is corrected to 10 seconds. Alternatively, the playback time corresponding to a certain piece of target information is determined as the video playback time. For example, if the video playback time is 8 seconds and the playback time of the background information is 10 seconds, the video playback time is corrected to 10 seconds.

[0055] In some embodiments, if a user is a viewer of a live streaming studio, after generating a virtual gift, the virtual gift may be displayed on a gift panel of the live streaming studio corresponding to the user so that the user can give the virtual gift to the host. If a user is a host of a live streaming studio, the virtual gift may be displayed on a gift panel of all viewers who enter the live streaming studio corresponding to the host.

[0056] In response to a trigger operation in a user's live streaming studio, pending information is acquired, and the pending information is identified as information used to generate a virtual gift. After acquiring the pending information, a virtual gift template corresponding to the pending information is determined. Different virtual gift templates correspond to different video effects, and the virtual gift template includes at least one of foreground information, background information, and a transformation model. The foreground information is used to provide a foreground image for the virtual gift being generated, the background information is used to provide a background image for the virtual gift being generated, and the transformation model is used to add a dynamic transformation effect to the pending information. A virtual gift is generated based on the virtual gift template and the pending information, and the virtual gift exhibits an effect corresponding to the virtual gift template. That is, the present application helps users create the virtual gift they need using different virtual gift templates and pending information, thereby interacting with the host using the virtual gift to enhance the interaction effect and the user experience.

[0057] Based on the above method embodiments, the embodiments of the present application provide an apparatus and an electronic device for generating a virtual gift, which will be described below with reference to the drawings.

[0058] Referring to FIG. 5, this figure is a structural diagram of an apparatus for generating a virtual gift according to an embodiment of the present application, and as shown in FIG. 5, the apparatus 500 may include: an obtaining unit 501, a determining unit 502, and a generating unit 503.

[0059] The acquisition unit 501 is used to acquire pending information, which is information used to generate a virtual gift, in response to a trigger operation by a user; The determining unit 502 is used to determine a virtual gift template corresponding to the to-be-processed information, the virtual gift template including at least one of foreground information, background information, and a transformation model, the foreground information being used to provide a foreground image for the virtual gift being generated, the background information being used to provide a background image for the virtual gift being generated, and the transformation model being used to add a dynamic transformation effect to the to-be-processed information; The generating unit 503 is used for generating a virtual gift according to the virtual gift template and the pending information.

[0060] In some embodiments, the generation unit 503 is specifically used for obtaining a playback time of target information, where the target information is at least one of the foreground information, the background information, the waiting information, and the conversion model output information; and generating a virtual gift based on the playback time of the target information.

[0061] In some embodiments, the generating unit 503 is specifically used to determine the play time of the target information based on the video play time corresponding to the virtual gift template.

[0062] In some embodiments, when the virtual gift template includes the foreground information and the target information includes the foreground information and the waiting information, the generation unit 503 is specifically used to determine the playback start time and playback end time of the foreground information and the playback start time of the waiting information based on the video playback time corresponding to the virtual gift template, wherein the playback start time of the foreground information is earlier than the playback start time of the waiting information, and the playback end time of the foreground information is earlier than the playback end time of the video playback time.

[0063] In some embodiments, when the virtual gift template includes the background information and the target information includes the background information and the waiting information, in some embodiments, the generation unit 503 is specifically used to set the video playback time corresponding to the virtual gift template to the playback time of the background information, and to determine the playback start time of the waiting information based on the video playback time corresponding to the virtual gift template.

[0064] In some embodiments, when the virtual gift template includes the conversion model and the target information is the conversion model output information, in some embodiments, the generation unit 503 is specifically used to set the video playback time corresponding to the virtual gift template to the playback time of the conversion model output information.

[0065] In some embodiments, when the virtual gift template includes the foreground information and the background information, and the target information includes the foreground information, the background information, and waiting-for-processing information, in some embodiments, the generation unit 503 is specifically used to: set the video playback time corresponding to the virtual gift template to the playback time of the background information; determine the playback start time and playback end time of the foreground information based on the video playback time corresponding to the virtual gift template, where the playback start time of the foreground information and the playback start time of the background information are the same; and determine the playback start time of the waiting-for-processing information based on the video playback time corresponding to the virtual gift template, where the playback start time of the foreground information is earlier than the playback start time of the waiting-for-processing information.

[0066] In some embodiments, the acquisition unit 501 is specifically used to display a first page in response to a user's trigger operation on a first control on a gift panel of a live streaming studio, and to acquire information to be uploaded and processed in response to an upload operation triggered by the user on the first page, or to display a second page in response to a user's trigger operation on a second control on a personal homepage of a live streaming client, and to acquire information to be uploaded and processed in response to an upload operation triggered by the user on the second page.

[0067] In some embodiments, the determination unit 502 is specifically used to obtain a virtual gift template corresponding to a selection operation triggered by a user, or to determine a virtual gift template corresponding to the pending information based on the type of the pending information.

[0068] In some embodiments, if the user is a viewer, a gift panel in the live streaming studio corresponding to the user includes the virtual gift, and if the user is a host, gift panels of all viewers entering the live streaming studio corresponding to the host include the virtual gift.

[0069] In some embodiments, when the to-be-processed information includes a target object, the virtual gift template is a scene template, the scene template includes scene elements that display the target object, and the target object in the virtual gift is rendered on top of the scene elements.

[0070] In some embodiments, if the target object is a text object and the display length of the text object is greater than the display length of the scene element, the text object in the virtual gift is displayed in a loop scrolling manner.

[0071] It should be noted that for the specific implementation of each unit in this embodiment, reference can be made to the relevant descriptions in the above method embodiments. The division of units in the embodiments of this application is only a rough outline and is merely a logical functional division. In actual implementation, other division methods may be used. Each functional unit in the embodiments of this application may be integrated into a single processing unit, each unit may exist physically independently, or two or more units may be integrated into a single unit. For example, in the above embodiment, the processing unit and the transmitting unit may be the same unit or different units. The integrated unit may be implemented in the form of hardware or a software functional unit.

[0072] Referring to Figure 6, it shows a structural schematic diagram of an electronic device 600 suitable for implementing an embodiment of the present disclosure. Terminal devices in the embodiment of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet personal computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 6 is merely an example and should not impose any limitations on the functionality and scope of use of the embodiment of the present disclosure.

[0073] 6, electronic device 600 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 601, which can perform various appropriate operations and processes based on programs stored in read-only memory (ROM) 602 or programs loaded from storage device 608 into random access memory (RAM) 603. RAM 603 further stores various programs and data necessary for the operation of electronic device 600. Processing unit 601, ROM 602, and RAM 603 are connected to each other via bus 604. Input / output (I / O) interface 605 is also connected to bus 604.

[0074] Generally, input devices 606, including, for example, a touch screen, touch board, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 608, including, for example, a magnetic tape, hard disk, etc.; and communication devices 609, can be connected to the I / O interface 605. The communication devices 609 can allow the electronic device 600 to exchange data with other devices through wireless or wired communication. While FIG. 6 illustrates the electronic device 600 having various devices, it should be understood that it is not required to implement or include all of the devices shown. Alternatively, more or fewer devices can be implemented or included.

[0075] In particular, according to embodiments of the present disclosure, the processes described with reference to the flowcharts above can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product, which includes a computer program stored on a non-transitory computer-readable medium, the computer program including program code for performing the methods shown in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, or may be installed from the storage device 608, or may be installed from the ROM 602. When the computer program is executed by the processing device 601, the functions defined in the methods of the embodiments of the present disclosure are performed.

[0076] The electronic device according to the embodiment of the present disclosure belongs to the same inventive concept as the method according to the above embodiment, and the technical details not described in detail in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0077] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements a method according to the above embodiment.

[0078] It should be noted that the computer-readable medium of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. However, in this disclosure, a computer-readable signal medium may include a propagated data signal, either in baseband or as part of a carrier, bearing computer-readable program code. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which is capable of transmitting, propagating, or carrying a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

[0079] In some embodiments, clients and servers may communicate using any network protocol now known or hereafter developed, such as HyperText Transfer Protocol (HTTP), and may interconnect via any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any network now known or hereafter developed.

[0080] The computer-readable medium may be included in the electronic device, or may exist independently of the electronic device.

[0081] The computer-readable medium has one or more programs stored thereon, which, when executed by the electronic device, cause the electronic device to perform the method.

[0082] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as general procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user computer, partially on the user computer, as a separate software package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0083] The flowcharts and block diagrams in the figures illustrate the system architecture, functions, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should also be noted that in some implementations, the functions illustrated in the blocks may occur in a different order than illustrated in the figures. For example, two consecutive blocks may actually be executed essentially in parallel, or may be executed in the reverse order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or operation, or by a combination of dedicated hardware and computer instructions.

[0084] The units described in relation to the embodiments of the present disclosure may be implemented in a software or hardware manner, and the names of the units / modules in some cases do not limit the units themselves.

[0085] The functionality described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, typical types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0086] In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more line-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

[0087] It should be noted that in this specification, each embodiment will be described in a step-by-step manner, and each embodiment will be described by focusing on the differences from other embodiments, and the same similar parts between each embodiment can be mutually referred to. As for the system or device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description will be relatively simple, and the relevant points can be referred to the description of the method part.

[0088] It should be understood that in this application, "at least one" means one or more, and "plurality" means two or more. "And / or" is used to describe a relationship between related objects and indicates that three relationships may exist. For example, "A and / or B" may represent three cases: the presence of only A, the presence of only B, and the simultaneous presence of A and B, where A and B may be singular or plural. The character " / " generally indicates that the related objects before and after it are in an "or" relationship. "At least one of" or similar expressions refers to any combination of these items, including any combination of single items or multiple items. For example, "at least one of a, b, or c" may represent a, b, c, "a and b," "a and c," "b and c," or "a, b, and c," where a, b, and c may be singular or plural.

[0089] It should be further explained that, in this specification, relational terms such as "first" and "second" are used solely to distinguish one entity or operation from another and do not necessarily require or imply the existence of any such actual relationship or ordering between those entities or operations. Furthermore, the terms "comprise," "include," "includes," or any other variation thereof are intended to cover a non-exclusive "comprise," whereby a process, method, article, or device comprising a set of elements not only includes those elements, but also other elements not expressly listed, or further elements inherent in such process, method, article, or device. Absent further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, article, or device that includes said element.

[0090] The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may be located in Random Access Memory (RAM), memory, Read Only Memory (ROM), Electrically Programmable ROM, Electrically Erasable Programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0091] The above description of the disclosed embodiments enables those skilled in the art to make or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Thus, the present application is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. 1. A method for generating a virtual gift, the method comprising: In response to a trigger operation by a user, acquiring pending information that is information used to generate a virtual gift; determining a virtual gift template corresponding to the to-be-processed information, the virtual gift template including at least one of foreground information, background information, and a transformation model, the foreground information being used to provide a foreground image for the virtual gift being generated, the background information being used to provide a background image for the virtual gift being generated, and the transformation model being used to add a dynamic transformation effect to the to-be-processed information; generating a virtual gift based on the virtual gift template and the pending information; method.

2. generating a virtual gift based on the virtual gift template and the pending information, acquiring a playback time of target information, wherein the target information is at least one of the foreground information, the background information, the waiting information, and the transformation model output information; and generating a virtual gift based on the play time of the target information.

3. The step of obtaining the playback time of the target information includes: The method of claim 2 , further comprising determining a play time of the target information based on a video play time corresponding to the virtual gift template.

4. When the virtual gift template includes the foreground information and the target information includes the foreground information and the waiting information, determining a playback time of the target information based on a video playback time corresponding to the virtual gift template includes:

4. The method of claim 3, further comprising: determining a playback start time and a playback end time of the foreground information and a playback start time of the waiting information based on a video playback time corresponding to the virtual gift template, wherein the playback start time of the foreground information is earlier than the playback start time of the waiting information, and the playback end time of the foreground information is earlier than the playback end time of the video playback time.

5. When the virtual gift template includes the background information and the target information includes the background information and the waiting information, determining a playback time of the target information based on a video playback time corresponding to the virtual gift template includes: The method of claim 3, including a step of setting the video playback time corresponding to the virtual gift template to the playback time of the background information, and a step of determining the playback start time of the waiting information based on the video playback time corresponding to the virtual gift template.

6. When the virtual gift template includes the conversion model and the target information is the conversion model output information, determining a playback time of the target information based on the video playback corresponding to the virtual gift template includes: The method of claim 3 , further comprising: setting a video playback time corresponding to the virtual gift template to a playback time of the conversion model output information.

7. When the virtual gift template includes the foreground information and the background information, and the target information includes the foreground information, the background information, and the waiting information, the step of determining a playback time of the target information based on a video playback time corresponding to the virtual gift template includes: setting a video playback time corresponding to the virtual gift template to a playback time of the background information; determining a playback start time and a playback end time of the foreground information based on a video playback time corresponding to the virtual gift template, wherein the playback start time of the foreground information is the same as the playback start time of the background information; The method of claim 3, further comprising: determining a playback start time of the waiting information based on a video playback time corresponding to the virtual gift template, wherein the playback start time of the foreground information is earlier than the playback start time of the waiting information.

8. The step of acquiring waiting-for-processing information, which is information used to generate the virtual gift, in response to the trigger operation of the user includes: displaying a first page in response to a user's trigger operation on a first control on a gift panel of a live streaming studio, and acquiring pending uploaded information in response to an upload operation triggered by the user on the first page; Or, 2. The method of claim 1, further comprising: displaying a second page in response to a user's trigger operation on a second control on a personal home page of the live streaming client; and acquiring pending uploaded information in response to an upload operation triggered by the user on the second page.

9. The step of determining a virtual gift template corresponding to the pending information includes: In response to a selection operation triggered by a user, obtaining a virtual gift template corresponding to the selection operation; Or, The method of claim 1 , comprising determining a virtual gift template corresponding to the pending information based on a type of the pending information.

10. The method of claim 1, wherein, when the user is a viewer, a gift panel in a live streaming studio corresponding to the user includes the virtual gift, and when the user is a host, gift panels of all viewers entering the live streaming studio corresponding to the host include the virtual gift.

11. The method of claim 1, wherein if the to-be-processed information includes a target object, the virtual gift template is a scene template, the scene template includes scene elements that display the target object, and the target object in the virtual gift is rendered on top of the scene elements.

12. The method of claim 11, wherein when the target object is a text object and the display length of the text object is greater than the display length of the scene element, the text object in the virtual gift is displayed in a loop scroll manner.

13. 1. An apparatus for generating a virtual gift, the apparatus comprising: an acquisition unit for acquiring pending information, which is information used to generate the virtual gift, in response to a trigger operation by a user; A determination unit for determining a virtual gift template corresponding to the waiting information, the virtual gift template including at least one of foreground information, background information, and a transformation model, the foreground information being used to provide a foreground image for the virtual gift being generated, the background information being used to provide a background image for the virtual gift being generated, and the transformation model being used to add a dynamic transformation effect to the waiting information; a generating unit for generating a virtual gift based on the virtual gift template and the pending information; Device.

14. An electronic device, the electronic device including a processor and a memory; the memory is used to store instructions or computer programs; 13. An electronic device, wherein the processor is adapted to execute the instructions or computer programs stored in the memory to cause the electronic device to perform the method of any one of claims 1 to 12.

15. 13. A computer-readable storage medium having instructions stored therein that, when executed by an apparatus, cause the apparatus to perform the method of any one of claims 1 to 12.

Citation Information

Patent Citations

  • Dynamic effect display method and device of virtual gift, storage medium and electronic equipment

    CN112135161A

  • Live broadcast interaction method and system based on custom virtual gift and computer equipment

    CN113938696A