Processing method and device for live broadcasting room

Abstract

The embodiment of the invention provides a live broadcast room processing method. The method comprises the following steps: displaying a target live broadcast room; displaying a target gift giving control in the target live broadcast room, wherein the target gift giving control is triggered to be displayed according to the live broadcast content; in response to the triggering of the target gift sending control, obtaining a target gift corresponding to the target gift sending control; and displaying the target gift special effect of the target gift to the target live broadcast room. According to the technical scheme, the display effect of the gift special effect can be associated with the live broadcast content, a content-driven feeding mode is formed, gift display is flexibly triggered according to the live broadcast content, the real-time performance and naturalness of gift sending in the live broadcast room are improved, and the monotonous gift sending interaction mode of the live broadcast room is optimized. In addition, by popping up the target gift sending control of the target gift associated with the live broadcast content, the gift sending interaction efficiency is improved, the gift sending interaction way is optimized, and the interaction experience of the live broadcast room is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of live broadcast technology, and in particular, to a method, device, computer equipment, computer-readable storage medium, and computer program product for processing a live broadcast room. Background Art

[0002] With the rapid popularization of Internet technology, live streaming is being accepted and loved by more and more people. During live streaming, viewers can send virtual gifts to the anchor through the audience terminal. These virtual gifts can be displayed in real time on the live streaming room interface of the anchor terminal and each audience terminal, thereby realizing gift-giving interaction in the live streaming room and increasing the popularity and attention of the anchor. Virtual gifts generally have value attributes. Virtual gifts with different value attributes are displayed differently in the live streaming room interface, so as to display gifts differently.

[0003] However, the existing gift-giving method in live broadcast rooms has problems such as monotony and poor interaction efficiency.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the invention

[0005] The embodiments of the present application provide a live broadcast room processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a method for processing a live broadcast room, which is used at a viewer end, and the method includes: Display the target live broadcast room; Displaying a target gift-giving control in the target live broadcast room, wherein the target gift-giving control is triggered to be displayed according to the live broadcast content; and In response to the target gift-giving control being triggered, obtaining a target gift corresponding to the target gift-giving control; The target gift special effects of the target gift are displayed in the target live broadcast room.

[0007] Optionally, the live broadcast content includes current voice data; and the triggering display of the target gift control includes: Acquire, according to the current voice data, a voice keyword associated with a gift giving request; Determine the target gift from a preset gift library according to the voice keyword; Determine the target gift control associated with the target gift so that the target gift control can be displayed in the target live broadcast room.

[0008] Optionally, the preset gift library includes a gift mapping table for providing a mapping relationship between keywords and gifts; determining the target gift from the preset gift library according to the voice keyword includes: Matching the voice keyword with each keyword in the gift mapping table; In case of successful matching, the target gift mapped to the voice keyword is determined according to the gift mapping table.

[0009] Optionally, the target gift control is displayed in a target display area of ​​a target live broadcast room; The target display area is determined by the following operations: Get the anchor's gesture and location information; According to the gesture and position information of the anchor, a target display area of ​​the target gift control in the target live broadcast room is determined.

[0010] Optionally, displaying the target gift special effect of the target gift in the target live broadcast room includes: The target gift special effects are displayed in the target display area.

[0011] Optionally, the method further comprises: When the target gift giving control has been triggered, the gift giving event is fed back by displaying a bullet screen or outputting a sound effect.

[0012] Another aspect of an embodiment of the present application provides a method for processing a live broadcast room, which is used for a server, and the method includes: Get the voice keywords in the current voice data of the target live broadcast room; Determine the target gift according to the voice keyword; Sending the target gift or the identifier of the target gift to each viewer terminal, so as to display the target gift control associated with the target gift on each viewer terminal; Receiving a target gift-giving request generated by a viewer end by triggering the target gift-giving control; According to the target gift sending request, the gift information of the target gift is sent to the anchor end and each audience end to display the corresponding gift special effects.

[0013] Optionally, determining a target gift according to the voice keyword includes: Matching the voice keyword with each keyword row of the gift mapping table; In case of a successful match, the target gift mapped to the voice keyword is determined according to a preset gift mapping table.

[0014] Optionally, the method further comprises: Acquire the anchor's gesture and position information through the anchor terminal; According to the gesture and position information of the anchor, determine the target display area of ​​the target gift control and / or the target gift in the target live broadcast room.

[0015] Another aspect of the embodiment of the present application provides a live broadcast room processing device for a viewer end, the device comprising: The first display module is used to display the target live broadcast room; A second display module is used to display a target gift control in a target live broadcast room, wherein the target gift control is triggered for display according to the live broadcast content; and An acquisition module, configured to acquire a target gift corresponding to the target gift control in response to the target gift control being triggered; The third display module is used to display the target gift special effects of the target gift in the target live broadcast room.

[0016] Another aspect of an embodiment of the present application provides a live broadcast room processing device for a server, the device comprising: An acquisition module is used to acquire voice keywords in the current voice data of the target live broadcast room; A determination module, used to determine a target gift according to the voice keyword; A first sending module, used for sending the target gift or the identifier of the target gift to each audience terminal, so as to display the target gift control associated with the target gift on each audience terminal; A receiving module, used for receiving a target gift sending request generated by a viewer terminal by triggering the target gift sending control; The second sending module is used to send the gift information of the target gift to the anchor end and each audience end according to the target gift sending request, so as to display the corresponding gift special effects.

[0017] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0018] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0019] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the method described above when executed by a processor.

[0020] The embodiment of the present application adopts the above-mentioned technical solution and may include the following advantages: by triggering the display of the target gift control in the target live broadcast room according to the live broadcast content. For example, the display of the target control is triggered according to the speech of the anchor. When the audience triggers the target gift control, the target gift special effect of the target gift corresponding to the target gift control is displayed to the target live broadcast room. It can be seen that in the embodiment of the present application, the display effect of the gift special effect is associated with the live broadcast content, forming a content-driven feeding method (guiding the gifting of different gifts according to different live broadcast content), that is, the gift display is flexibly triggered according to the live broadcast content, which improves the real-time and naturalness of the gift giving in the live broadcast room, and optimizes the monotonous gift giving interaction method in the live broadcast room. In addition, by popping up the target gift control of the target gift associated with the live broadcast content, the gift giving interaction efficiency is improved and the gift giving interaction path is optimized, thereby improving the interactive experience of the live broadcast room. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0022] Figure 1 The operating environment diagram of the live broadcast room processing method according to the first embodiment of the present application is schematically shown; Figure 2 A flowchart schematically shows a method for processing a live broadcast room according to Embodiment 1 of the present application; Figure 3 A flowchart of the steps for triggering the display of a target gift giving control is schematically shown; Figure 4 Schematically shows Figure 3 Flow chart of sub-steps of step S302; Figure 5 A flowchart schematically shows the steps of determining a target display area; Figure 6 A flowchart schematically shows a method for processing a live broadcast room according to Embodiment 2 of the present application; Figure 7 Schematically shows Figure 6 Flow chart of sub-steps of step S602; Figure 8 A newly added flow chart of the processing method of the live broadcast room according to the second embodiment of the present application is schematically shown; Fig. 9Schematically shows an exemplary application flow chart according to the present application; Fig.10 A block diagram schematically shows a processing device for a live broadcast room according to Embodiment 3 of the present application; and Fig.11 A block diagram schematically shows a processing device for a live broadcast room according to a fourth embodiment of the present application; and Fig.12 The hardware architecture diagram of the computer device according to the fifth embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0024] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0025] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.

[0026] First, the following terms are explained: ASR (Automatic Speech Recognition): Technology that converts speech into text, including audio analysis, audio decomposition, format conversion, text matching, etc.

[0027] Secondly, to facilitate those skilled in the art to understand the technical solutions provided by the embodiments of the present application, the following is an explanation of the relevant technologies: The gift feeding method known to the inventor requires the audience to manually select and click on the gift to send, and relies on the active participation and preset options of the audience: it lacks real-time and naturalness, and it is difficult for the audience to establish an instant interactive connection with the host's words and actions; the interactive means are separated from the host's voice content and actions, and a content-driven feeding method is not formed: it is impossible to flexibly trigger the gift display according to the live broadcast content, and the interactive experience between the audience and the host is monotonous and mechanical; the location and trigger mechanism of the gift display are usually fixed and there is no intelligent adjustment: it is impossible to dynamically adapt to the host's gestures and live broadcast scenes, resulting in a poor correlation between the display effect and the live broadcast content. In short, there is a lack of real-time and naturalness, the interactive method is monotonous, and the correlation with the content is poor.

[0028] To this end, an embodiment of the present application provides a technical solution for processing a live broadcast room to overcome the above-mentioned problems, as described below for details.

[0029] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0030] like Figure 1 As shown, the operating environment diagram includes: the environment diagram may include a server 2, an anchor terminal (4A, 4B, ..., 4M), and an audience terminal (6A, 6B, ..., 6N). In a live broadcast scenario, the anchor terminal (4A, 4B, ..., 4M) logs in to the server 2, and the live broadcast data is pushed to the audience terminal (6A, 6B, ..., 6N) in real time through the server 2.

[0031] Server 2 can provide live broadcast service, which can be a single server, a server cluster or a cloud computing service center.

[0032] The host terminal (4A, 4B, ..., 4M) is used to generate live broadcast data in real time and perform streaming operations on the live broadcast data. The live broadcast data may include audio data or video data. The host terminal may be an electronic device such as a smart phone or a tablet computer. Of course, the host terminal may be a virtual computing instance in the server 2.

[0033] The audience terminal (6A, 6B, ..., 6N) may be configured to receive the live broadcast data of the anchor terminal in real time. The audience terminal (6A, 6B, ..., 6N) may be any type of computing device, such as a smart phone, a tablet device, a laptop computer, a smart TV, a vehicle-mounted terminal, etc. The audience terminal (6A, 6B, ..., 6N) may have a built-in browser or a special program, and receive the live broadcast data through the browser or the special program to output content to the audience. The content may include video, audio, comments, text data and / or the like.

[0034] The audience terminal (6A, 6B, ..., 6N) may include a player. The player outputs (e.g., displays, presents) content to the audience. The content may include video, audio, comments, text data and / or the like. The audience terminal (6A, 6B, ..., 6N) may include an interface, which may include an input element (touch screen). For example, the input element may be configured to receive audience instructions, which may enable the audience terminal (6A, 6B, ..., 6N) to perform various operations, such as sending bullet comments, entering comments, giving gifts, etc.

[0035] The anchor terminal (4A, 4B, ..., 4M), the audience terminal (6A, 6B, ..., 6N) and the server 2 may be connected via a network. The network may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls and / or proxy devices, etc. The network may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links, combinations thereof and / or the like. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links and / or the like.

[0036] It should be noted that the number of the host terminals and the audience terminals in the figure is only for illustration and is not used to limit the scope of patent protection of this application. According to the actual situation, there can be any number of host terminals and audience terminals.

[0037] The following describes the technical solution of the present application through multiple embodiments, taking the server and the viewer as the execution subjects. It should be noted that these embodiments can be implemented in many different forms and should not be interpreted as being limited to the embodiments described here.

[0038] Embodiment 1 This method embodiment can be executed in the viewer end (eg, 6A). Below, the host end is taken as the execution subject of this process.

[0039] Figure 2 The flowchart of the processing method of the live broadcast room according to the first embodiment of the present application is schematically shown.

[0040] like Figure 2 As shown, the processing method of the live broadcast room may include steps S200 to S206, wherein: Step S200, displaying the target live broadcast room; Step S202, displaying a target gift-giving control in the target live broadcast room, wherein the target gift-giving control is triggered to be displayed according to the live broadcast content; and Step S204, in response to the target gift-giving control being triggered, obtaining a target gift corresponding to the target gift-giving control; Step S206, displaying the target gift special effects of the target gift in the target live broadcast room.

[0041] The processing method of the live broadcast room provided in this embodiment displays the target gift control in the target live broadcast room by triggering it according to the live broadcast content. For example, the display of the target control is triggered according to the speech of the anchor. When the audience triggers the target gift control, the target gift special effect of the target gift corresponding to the target gift control is displayed to the target live broadcast room. It can be seen that, unlike the gift-giving method in which the audience manually selects and clicks on the gift panel, this embodiment provides a new gift-giving method in the live broadcast room, specifically: the display effect of the gift special effect is associated with the live broadcast content, forming a content-driven feeding method (guiding the gifting of different gifts according to different live broadcast content), combining gift-giving with live broadcast content (such as anchor voice or action), that is, flexibly triggering the gift display according to the live broadcast content, improving the real-time and naturalness of the gift-giving in the live broadcast room, and thereby optimizing the gift-giving interactive experience in the live broadcast room. In addition, by actively popping up the target gift control of the target gift associated with the live broadcast content, the gift-giving interaction efficiency is improved and the gift-giving interaction path is optimized, and the interactive experience of the live broadcast room is further optimized.

[0042] The following combination Figure 2 , each step in steps S200~S206 and other optional steps are described in detail.

[0043] Step S200 , display the target live broadcast room.

[0044] The target live broadcast room is a room for online video broadcast, where the anchor shares real-time content, and the audience can watch and interact through the network platform. The video stream, anchor information, audience list, chat window, etc. of the target live broadcast room can be displayed through web pages, mobile applications or other client interfaces. The audience can enter the target live broadcast room through search, recommendation or other methods. The target live broadcast room includes a live broadcast area and an interactive area. The live broadcast area is the area where the anchor conducts live broadcast activities, which is used to display the anchor's image, actions and live broadcast content, such as product introductions, game live broadcasts, talent shows, etc. The interactive area is the area in the live broadcast room for the audience to interact with the anchor, including the barrage area, gift area, comment area, etc.

[0045] Step S202 , displaying a target gift control in the target live broadcast room, wherein the target gift control is triggered for display according to the live broadcast content.

[0046] The target gift control can be a button, icon, or animation. It is used to guide the audience to perform gift giving operations. In some embodiments, the target gift control can include an icon, name, or preview image of the gift. In some embodiments, the target gift control can be set with a close button to reduce interference to the audience and improve user experience.

[0047] The target gift control is triggered and displayed according to the live broadcast content. For example: (1) Voice prompt: During the live broadcast, the host can request the audience to send gifts, such as "Can you send me some flowers?", and the system will automatically trigger the display of the target gift control.

[0048] (2) Specific actions: The host requests viewers to send gifts through specific actions (such as making a heart shape, blinking, clicking a button, etc.), triggering the display of the target gift control.

[0049] (3) Specific performances or interactive sessions: For example, when the host completes a challenge or wins a game, the system automatically triggers the display of the target gift control.

[0050] (4) Preset time points or events: For example, at certain intervals or when a certain number of viewers are reached, the system automatically triggers the display of the target gift control.

[0051] In some embodiments, the host can be prompted by various means such as pop-up windows and voice on the host's end on how to trigger the display of the target gift control.

[0052] Step S204 In response to the target gift-giving control being triggered, a target gift corresponding to the target gift-giving control is obtained.

[0053] Target gifts are virtual gifts given to the anchor by viewers triggering the gift control on live broadcasts or social media platforms. These virtual gifts include different values, appearances, and gift effects. Different gift controls correspond to different virtual gifts. In some embodiments, in addition to triggering the target control, the target gift can also be obtained through the audience's actions such as blinking and nodding.

[0054] Step S206 , and display the target gift special effects of the target gift in the target live broadcast room.

[0055] The target gift special effects can be visual effects (such as fireworks blooming, hearts falling, rainbows across the screen, etc.), sound effects (such as applause, cheers, special sounds, etc.), interactive effects (such as barrage interaction, gift rain, etc.), big rockets, etc.

[0056] When the audience presents a target gift, the corresponding target gift special effects can be displayed in real time in the live broadcast area. For example, if the audience presents a "bouquet" gift, a blooming virtual bouquet animation can be immediately displayed in the live broadcast area. In some embodiments, after the audience presents the target gift, feedback information can be automatically displayed in the interactive area as instant feedback on the gifting behavior. In some embodiments, after the audience presents the target gift, a specific button can be displayed on the anchor end, and feedback information is presented after the anchor triggers the button. For example, after the anchor manually clicks the button, the anchor's voice feedback "Thanks XX for the luxurious gift!" is presented in the target live broadcast room to improve the convenience of feedback.

[0057] In an optional embodiment, the live broadcast content includes current voice data; Figure 3 As shown, the triggering display of the target gift control includes: Step S300, obtaining voice keywords associated with a gift giving request according to the current voice data; Step S302, determining the target gift from a preset gift library according to the voice keyword; Step S304, determining the target gift-giving control associated with the target gift, so as to display the target gift-giving control in the target live broadcast room.

[0058] In some embodiments, the current voice data can be preprocessed. For example, noise reduction, voice enhancement, voice recognition, speech speed adjustment, accent adaptation, etc., to improve the accuracy of subsequent analysis. In some embodiments, entity recognition can be performed through the BERT (Bidirectional Encoder Representations from Transformers) model, focusing on identifying gift-related keywords in the current voice data, such as "rocket" and "flower". In some embodiments, the model for identifying voice keywords can be optimized by adopting open source ASR technology (such as DeepSpeech, Whisper) and combining it with the corpus in the live broadcast field to improve the accuracy of recognition.

[0059] An associated gift giving request can be an action in which the host requests the audience to give a specific gift (for example, a target gift) through specific voice content, actions or other preset trigger conditions. For example, the current voice data can be classified by intent (such as "request a gift", "thank you", "irrelevant sentence", etc.) based on an NLU model based on the Transformer architecture (such as BERT or GPT). Determine whether to display the gift control triggered by the voice keyword in the target live broadcast room based on the intent classification result. Specifically, if the intent is classified as a voice keyword such as "thank you", "irrelevant sentence", etc., the gift control corresponding to the voice keyword does not need to be displayed in the target live broadcast room; if the intent is classified as a voice keyword such as "request a gift", the gift control corresponding to the voice keyword needs to be displayed in the target live broadcast room.

[0060] Two examples are used to illustrate the above process: Example 1: During a live broadcast, the anchor said, "Do you like me? Give me some flowers!" The system recognizes the keyword "flowers" and the semantic analysis is "requesting everyone to give gifts." Then "flowers" is determined as the voice keyword, and the bouquet icon (i.e. the target gift control) is displayed in the target live broadcast room. The audience can click on the bouquet icon to complete the gift-giving behavior and display the special effects of the bouquet.

[0061] Example 2: During a live broadcast, the host said, "I give everyone a heart!" The system recognizes the keyword as "heart", but the semantic analysis is "thank you", so the target gift control is not triggered.

[0062] In this embodiment, the target gift and its corresponding target gift control are determined from the preset gift library by obtaining voice keywords associated with the gift giving request, thereby improving the efficiency of human-computer interaction and the convenience of live interaction, and improving the accuracy of pushing the target gift control, thereby improving the audience experience.

[0063] In an optional embodiment, the preset gift library includes a gift mapping table for providing a mapping relationship between keywords and gifts; Figure 4 As shown, step S302 may include: Step S400, matching the voice keyword with each keyword in the gift mapping table; Step S402, when the match is successful, determine the target gift mapped to the voice keyword according to the gift mapping table.

[0064] A gift mapping table can be pre-established in the background system to associate each keyword with a specific gift type (such as bouquets, hearts, etc.).

[0065] In some embodiments, before matching the voice keywords with the keywords in the gift mapping table, the voice keywords may be preprocessed, such as removing stop words, stemming, restoring morphology, etc., to improve the accuracy of subsequent matching.

[0066] Voice keywords can be matched with various keywords in the gift mapping table through various methods such as exact matching, fuzzy matching, synonym matching, context-aware matching, etc. In some embodiments, if the current voice data contains multiple keywords that match the gift mapping table, the system can set priority rules or use a weighted average method to determine the final target gift. For example, if "rose" and "bouquet" are both matching keywords, but "bouquet" is marked with a higher priority in the gift mapping table, then the system can prioritize "bouquet" as the target gift. In some embodiments, the gifts in the gift mapping table can be personalized and sorted or recommended in combination with the personalized information of the host and the audience (such as historical preferences, purchase records, etc.), so that when multiple gifts are matched, the system can prioritize the gifts that are more in line with the expectations of the host or the audience.

[0067] In this embodiment, the target gift corresponding to the voice keyword is quickly determined through gift mapping table matching, thereby improving the accuracy and efficiency of gift push.

[0068] The target gifting control is displayed in various locations in the target live broadcast room, such as near the scroll bar at the bottom of the screen, the sidebar of the screen, the floating area around the anchor's avatar, the anchor's gesture position, and a specific ad position in the background of the live broadcast room.

[0069] In an optional embodiment, the target gift control is displayed in a target display area of ​​a target live broadcast room; like Figure 5 As shown, the target display area is determined by the following operations: Step S500, obtaining the anchor's gesture and position information; Step S502: determining a target display area of ​​the target gift-giving control in the target live broadcast room according to the gesture and position information of the anchor.

[0070] The gestures may be of various types such as pointing, waving, and clenching fists. The host's movements and gesture positions can be captured by a camera, and the position can be tracked by a pre-trained deep learning model to determine the spatial coordinates corresponding to the host's gesture. When the viewer clicks on the target gift control, the target gift is displayed at the host's gesture. In some embodiments, rules or mapping relationships can be preset to associate the host's different gestures with the display area of ​​the target gift control. For example, if the host makes a pointing gesture, the target gift control can be displayed near the position where the host's finger is pointing; if the host waves, the target gift control can be displayed in a corner or edge of the screen. In some embodiments, the display area of ​​the target gift control can be dynamically adjusted according to the host's position change in the live broadcast screen. If the host moves, the gift control can follow the movement and keep the relative position relationship with the host unchanged.

[0071] Different from displaying gift controls through the gift panel, in this embodiment, the location and trigger mechanism of smart gift display are combined with the voice content of the live broadcast room and the host's actions. Based on this intelligent display mechanism, the audience can interact with the host more naturally, enhancing the fun and participation of the live broadcast. Specifically, by obtaining the host's gestures and location information to determine the display area of ​​the target gift control in the live broadcast room, it is possible to dynamically adapt to the host's gestures and live broadcast scenes, improve the relevance of the display effect to the live broadcast content, and enhance the fun of the live broadcast.

[0072] In an optional embodiment, step S206 may include: The target gift special effects are displayed in the target display area.

[0073] It should be noted that the display area of ​​the target gift special effect and the display area of ​​the target gift sending control can be the same or different.

[0074] In some embodiments, a duration of a target special effect may be set, and if the display time of the target special effect exceeds the duration, the display of the target special effect is terminated.

[0075] In this embodiment, when the audience triggers the target gift control of the target display area, the target gift special effects corresponding to the target gift are displayed in the target display area, thereby forming a dynamic gift feeding method, improving the efficiency of human-computer interaction and the fun of live broadcast.

[0076] In an optional embodiment, the live broadcast room processing method further includes: When the target gift giving control has been triggered, the gift giving event is fed back by displaying a bullet screen or outputting a sound effect.

[0077] The content of the barrage can include the nickname of the donor, the name and quantity of the gift, preset blessings or thanks, etc. You can select the corresponding sound effect according to the type or level of the gift. The sound effect can be cheerful music, applause, special effects, etc.

[0078] In this embodiment, the interactivity of the live broadcast room and the audience experience are enhanced by immediately providing feedback on the audience's gift-giving behavior.

[0079] Embodiment 2 This method embodiment can be executed in the server 2. The server is taken as the execution subject of this process. It should be noted that the technical details and technical effects of this embodiment can refer to or be introduced in combination with the first embodiment.

[0080] Figure 6 The flowchart of the live broadcast room processing method according to the second embodiment of the present application is schematically shown.

[0081] like Figure 6 As shown, the processing method of the live broadcast room may include steps S600 to S608, wherein: Step S600, obtaining voice keywords in the current voice data of the target live broadcast room; Step S602, determining a target gift according to the voice keyword; Step S604, sending the target gift or the identifier of the target gift to each viewer terminal, so as to display the target gift control associated with the target gift on each viewer terminal; Step S606, receiving a target gift sending request generated by the viewer end by triggering the target gift sending control; Step S608, according to the target gift sending request, the gift information of the target gift is sent to the anchor end and each viewer end to display the corresponding gift special effects.

[0082] The audio input device (such as a microphone) in the live broadcast room can be used to collect the current voice data of the anchor or the audience in real time. The collected current voice data is input into the speech recognition model (such as Transformer, etc.) to convert speech to text. Then, the semantic recognition module automatically analyzes the voice keywords in the current voice data and triggers the display of the target gift control in real time. In this embodiment, the display of the target gift control is triggered by voice keywords, thereby eliminating the need for the audience to manually select, improving the efficiency of human-computer interaction, and enhancing the interactivity of the live broadcast and the audience experience.

[0083] In an optional embodiment, if Figure 7 As shown, step S602 may include: Step S700, matching the voice keyword with each keyword row of the gift mapping table; Step S702, when the match is successful, determine the target gift mapped to the voice keyword according to a preset gift mapping table.

[0084] In this embodiment, the voice keyword is quickly determined to correspond to the target gift through gift mapping table matching, thereby improving the accuracy and efficiency of gift push.

[0085] In an optional embodiment, if Figure 8 As shown, the live broadcast room processing method may also include: Step S800, obtaining the anchor's gesture and position information through the anchor terminal; Step S802: Determine the target display area of ​​the target gift control and / or the target gift in the target live broadcast room according to the gesture and position information of the anchor.

[0086] In this embodiment, by combining the gift special effects with the current voice data and the host's actions, the visual appeal and interactive effect are increased, and the naturalness of the interaction between the host and the audience is improved.

[0087] In order to make this application easier to understand, the following Fig. 9 An exemplary application is provided.

[0088] Step S11, the anchor terminal collects the anchor's current voice data and captures the anchor's movements and gestures in real time: (1) Receive and analyze the host’s current voice data in real time through the voice recognition module.

[0089] (2) The gesture recognition module captures the host’s movements and gesture positions through a camera, and tracks the position through a pre-trained deep learning model to determine the current position of the host’s gesture (e.g., spatial coordinates).

[0090] Step S12, the host uploads the current voice data and the current position of the host's gesture to the server.

[0091] Step S13: the server determines the voice keywords in the current voice data.

[0092] (1) Use the BERT model to perform entity recognition on the current voice data, focusing on identifying keywords related to gifts in the current voice data, such as "rocket" and "flower".

[0093] (2) The NLU model based on the Transformer architecture (such as BERT or GPT) performs intent classification on the current voice data to determine the voice keywords (such as rocket, etc.) in the current voice data. The categories of the intent classification may include "request for a gift", "thank you", "irrelevant sentence", etc.

[0094] In step S14, the server matches the voice keyword with each keyword in a preset gift mapping table to determine the target gift (such as a rocket, etc.).

[0095] Step S15, the server sends the target gift control or control ID corresponding to the target gift to the audience.

[0096] Step S16, when the viewer triggers the target gift sending control, the target gift sending request generated by triggering the target gift sending control is sent to the server.

[0097] Step S17A: The server sends the gift information of the target gift to the viewer according to the target gift sending request, wherein the gift information includes the target gift special effects.

[0098] Step S17A, the server sends the gift information of the target gift to the anchor end according to the target gift sending request.

[0099] Step S18A: The audience displays the target gift special effect at the host's gesture position.

[0100] Step S18B, the host displays the target gift special effect at the host's gesture position.

[0101] Step S19A, when the target gift control has been triggered, the server sends the preset gift feedback data to the viewer end.

[0102] Step S19B, when the target gift control has been triggered, the server sends the preset gift feedback data to the anchor end.

[0103] Step S20A: the audience terminal displays feedback data in the form of bullet screen or sound effects.

[0104] Step S20B: the host terminal displays the feedback data in the form of barrage or sound effects.

[0105] By combining voice and gestures, a more natural and interactive live broadcast experience is achieved. By directly interacting with the host's voice and actions, the audience not only improves the viewing experience, but also strengthens social interaction. Through dynamic gift feeding, the audience can send gifts in real time according to the host's behavior, making the live broadcast content more participatory and entertaining.

[0106] Embodiment 3 Fig.10The block diagram of the processing device of the live broadcast room according to the third embodiment of the present application is schematically shown. The device is used at the audience end. The device can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.10 As shown, the device 1000 may include: a first display module 1100, a second display module 1200, an acquisition module 1300, and a third display module 1400, wherein: The first display module 1100 is used to display the target live broadcast room; The second display module 1200 is used to display a target gift-giving control in a target live broadcast room, wherein the target gift-giving control is triggered to be displayed according to the live broadcast content; and An acquisition module 1300 is used for acquiring a target gift corresponding to the target gift control in response to the target gift control being triggered; The third display module 1400 is used to display the target gift special effects of the target gift in the target live broadcast room.

[0107] In an optional embodiment, the live broadcast content includes current voice data; and the triggering display of the target gift control includes: Acquire, according to the current voice data, a voice keyword associated with a gift giving request; Determine the target gift from a preset gift library according to the voice keyword; Determine the target gift control associated with the target gift so that the target gift control can be displayed in the target live broadcast room.

[0108] In an optional embodiment, the preset gift library includes a gift mapping table for providing a mapping relationship between keywords and gifts; determining the target gift from the preset gift library according to the voice keyword includes: Matching the voice keyword with each keyword in the gift mapping table; In case of successful matching, the target gift mapped to the voice keyword is determined according to the gift mapping table.

[0109] In an optional embodiment, the target gift control is displayed in a target display area of ​​a target live broadcast room; The target display area is determined by the following operations: Get the anchor's gesture and location information; According to the gesture and position information of the anchor, a target display area of ​​the target gift control in the target live broadcast room is determined.

[0110] In an optional embodiment, the third display module 1400 is further used for: The target gift special effects are displayed in the target display area.

[0111] In an optional embodiment, the live broadcast room processing device further includes a feedback module 1500, which is used to: When the target gift giving control has been triggered, the gift giving event is fed back by displaying a bullet screen or outputting a sound effect.

[0112] Embodiment 4 Fig.11 The block diagram of the processing device of the live broadcast room according to the fourth embodiment of the present application is schematically shown. The device is used for a server. The device can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.11 As shown, the apparatus 2000 may include: an acquisition module 2100, a determination module 2200, a first sending module 2300, a receiving module 2400, and a second sending module 2500, wherein: An acquisition module 2100 is used to acquire voice keywords in the current voice data of the target live broadcast room; A determination module 2200 is used to determine a target gift according to the voice keyword; A first sending module 2300 is used to send the target gift or the identifier of the target gift to each viewer terminal, so as to display the target gift control associated with the target gift on each viewer terminal; The receiving module 2400 is used to receive a target gift sending request generated by the viewer end by triggering the target gift sending control; The second sending module 2500 is used to send the gift information of the target gift to the anchor end and each audience end according to the target gift sending request, so as to display the corresponding gift special effects.

[0113] In an optional embodiment, the determination module 2200 is further configured to: Matching the voice keyword with each keyword row of the gift mapping table; In case of a successful match, the target gift mapped to the voice keyword is determined according to a preset gift mapping table.

[0114] In an optional embodiment, the live broadcast room processing device further includes a determination module, which is used to: Acquire the anchor's gesture and position information through the anchor terminal; According to the gesture and position information of the anchor, determine the target display area of ​​the target gift control and / or the target gift in the target live broadcast room.

[0115] Embodiment 5 Fig.12 The hardware architecture diagram of the computer device 10000 suitable for implementing the processing method of the live broadcast room according to the fifth embodiment of the present application is schematically shown. In some embodiments, the computer device 10000 can be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 can be a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig.12 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Among them: The memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 can be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 can also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 can also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed on the computer device 10000, such as the program code of the processing method of the live broadcast room, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0116] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0117] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0118] It should be pointed out that Fig.12 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0119] In this embodiment, the live broadcast room processing method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0120] Embodiment 6 An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the live broadcast room processing method in the embodiment are implemented.

[0121] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on the computer device, such as the program code of the processing method of the live broadcast room in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

[0122] Embodiment 7 An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0123] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by general-purpose computer devices, they can be concentrated on a single computer device, or distributed on a network composed of multiple computer devices, optionally, they can be implemented by executable program codes of computer devices, so that they can be stored in a storage device and executed by the computer device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0124] It should be noted that the above are only preferred embodiments of the present application, and the patent protection scope of the present application is not limited thereto. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for processing a live broadcast room, characterized in that: For the audience, the method includes: Display the target live broadcast room; Displaying a target gift-giving control in the target live broadcast room, wherein the target gift-giving control is triggered to be displayed according to the live broadcast content; In response to the target gift-giving control being triggered, obtaining a target gift corresponding to the target gift-giving control; The target gift special effects of the target gift are displayed in the target live broadcast room.

2. The method according to claim 1, characterized in that The live broadcast content includes current voice data; the triggering display of the target gift control includes: Acquire, according to the current voice data, a voice keyword associated with a gift giving request; Determine the target gift from a preset gift library according to the voice keyword; Determine the target gift control associated with the target gift so that the target gift control can be displayed in the target live broadcast room.

3. The method according to claim 2, characterized in that The preset gift library includes a gift mapping table, which is used to provide a mapping relationship between keywords and gifts; Determining the target gift from a preset gift library according to the voice keyword includes: Matching the voice keyword with each keyword in the gift mapping table; In case of successful matching, the target gift mapped to the voice keyword is determined according to the gift mapping table.

4. The method according to claim 1, characterized in that The target gift-giving control is displayed in the target display area of ​​the target live broadcast room; The target display area is determined by the following operations: Get the anchor's gesture and location information; According to the gesture and position information of the anchor, a target display area of ​​the target gift control in the target live broadcast room is determined.

5. The method according to claim 1, characterized in that Displaying the target gift special effects of the target gift in the target live broadcast room includes: The target gift special effects are displayed in the target display area.

6. The method according to claim 1, characterized in that The method further comprises: When the target gift giving control has been triggered, the gift giving event is fed back by displaying a bullet screen or outputting a sound effect.

7. A method for processing a live broadcast room, characterized in that: For a server, the method comprises: Get the voice keywords in the current voice data of the target live broadcast room; Determine the target gift according to the voice keyword; Sending the target gift or the identifier of the target gift to each viewer terminal, so as to display the target gift control associated with the target gift on each viewer terminal; Receiving a target gift-giving request generated by a viewer end by triggering the target gift-giving control; According to the target gift sending request, the gift information of the target gift is sent to the anchor end and each audience end to display the corresponding gift special effects.

8. The method according to claim 7, characterized in that Determining a target gift according to the voice keyword includes: Matching the voice keyword with each keyword row of the gift mapping table; In case of a successful match, the target gift mapped to the voice keyword is determined according to a preset gift mapping table.

9. The method according to claim 7, characterized in that: The method further comprises: Acquire the anchor's gesture and position information through the anchor terminal; According to the gesture and position information of the anchor, determine the target display area of ​​the target gift control and / or the target gift in the target live broadcast room.

10. A processing device for a live broadcast room, characterized in that: For the audience, the device comprises: The first display module is used to display the target live broadcast room; The second display module is used to display a target gift-giving control in a target live broadcast room, wherein the target gift-giving control is triggered and displayed according to the live broadcast content; An acquisition module, configured to acquire a target gift corresponding to the target gift control in response to the target gift control being triggered; The third display module is used to display the target gift special effects of the target gift in the target live broadcast room.

11. A processing device for a live broadcast room, characterized in that: For a server, the device comprises: An acquisition module is used to acquire voice keywords in the current voice data of the target live broadcast room; A determination module, used to determine a target gift according to the voice keyword; A first sending module, used for sending the target gift or the identifier of the target gift to each audience terminal, so as to display the target gift control associated with the target gift on each audience terminal; A receiving module, used for receiving a target gift sending request generated by a viewer terminal by triggering the target gift sending control; The second sending module is used to send the gift information of the target gift to the anchor end and each audience end according to the target gift sending request, so as to display the corresponding gift special effects.

12. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 9 is implemented.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 9 are implemented.

Images