Live broadcast interaction method and device, equipment, medium and program product

Abstract

The invention discloses a live broadcast interaction method, device and equipment, a medium and a program product, and relates to the field of live broadcast. The method comprises the steps of displaying a live broadcast interface; in the process of displaying the live broadcast interaction content in the live broadcast interface, collecting presentation audios; and under the condition that the performance quality of the performance audio meets a preset quality requirement, displaying a state conversion result of the controlled element in the live broadcast interaction content on the live broadcast interface. The audience triggers the change of the controlled element through the performance, and does not need to memorize a complex control instruction, so that the tedious process that the audience needs to learn and remember a specific bullet screen instruction and then send the bullet screen in the related technology is avoided, and the man-machine interaction efficiency is improved. Besides, sound production is carried out in an audience performance form so as to control the state of the controlled element in the live broadcast interaction content, the sense of participation of the audience and the interactivity of the live broadcast interaction content are enhanced, and thus the attraction of live broadcast and the retention rate of the audience are improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of live broadcasting, and in particular to a live broadcasting interactive method, device, equipment, medium and program product. Background Art

[0002] With the rapid popularity of online live broadcasting, bullet comments have become one of the main ways for viewers to interact with anchors. In order to enhance the audience's sense of participation, many live broadcast platforms have introduced bullet comment games, allowing viewers to influence the game process by sending bullet comments.

[0003] In the related art, taking the barrage shooting game as an example, the audience can send a specified barrage in the chat area of ​​the live broadcast room, for example: barrage "333", through which the virtual character in the shooting game can be controlled to shoot.

[0004] However, for viewers who are not familiar with the barrage system, sending designated barrages to control game characters is a relatively complicated operation process, and viewers need a long time to learn the operation, resulting in low human-computer interaction efficiency in barrage games. Summary of the invention

[0005] The present application provides a live interactive method, device, equipment, medium and program product, and the technical solution is as follows:

[0006] In one aspect, a live interactive method is provided, the method comprising:

[0007] Displaying a live broadcast interface, wherein the live broadcast interface includes live broadcast interactive content, wherein the live broadcast interactive content includes controlled elements, and the controlled elements are elements in the live broadcast interactive content whose status is to be controlled;

[0008] In the process of displaying the live interactive content on the live interface, collecting performance audio, where the performance audio is audio data acquired by the terminal in the form of a performance;

[0009] When the performance quality of the audio performance meets the preset quality requirements, the state change result of the controlled element in the live interactive content is displayed on the live interface, and the state change result of the controlled element is used to determine the content direction of the live interactive content.

[0010] In another aspect, a live interactive device is provided, the device comprising:

[0011] An interface display module, used for displaying a live broadcast interface, wherein the live broadcast interface includes live broadcast interactive content, wherein the live broadcast interactive content includes controlled elements, and wherein the controlled elements are elements in the live broadcast interactive content whose status is to be controlled;

[0012] A data acquisition module, used for collecting performance audio during the process of displaying the live interactive content on the live interface, wherein the performance audio is audio data acquired by the terminal in the form of a performance;

[0013] The interface display module is used to display the state change result of the controlled element in the live interactive content on the live interface when the performance quality of the audio performance meets the preset quality requirements. The state change result of the controlled element is used to determine the content direction of the live interactive content.

[0014] In some embodiments, the live broadcast interface includes performance instruction information, and the performance instruction information is used to indicate the performance of the first work in a first performance form; the data acquisition module is used to collect performance audio matching the first work during the process of displaying the live interactive content on the live broadcast interface, and the performance audio is audio data collected by the terminal when the first work is performed in the first performance form.

[0015] In some embodiments, the method is executed by an audience terminal device, in which an audience account is logged in, and the live interactive content is live content provided by the anchor account; the data acquisition module is used to display the performance invitation information sent by the anchor account during the process of displaying the live interactive content on the live interface, and the performance invitation information includes the performance instruction information, and the performance invitation information is used to invite the audience account to perform according to the performance instruction information; when a trigger operation is received on the performance entrance in the performance invitation information, performance audio matching the first work is collected.

[0016] In some embodiments, the performance instruction information is used to indicate the performance of the first audio work in the form of singing; the data acquisition module is used to play the accompaniment audio of the first audio work while the live interactive content is displayed on the live interface; and while playing the accompaniment audio of the first audio work, collect the performance audio that matches the first work.

[0017] In some embodiments, the first audio work includes multiple work segments; the performance audio refers to multiple audio segments that match the multiple work segments; or, the performance audio refers to a specified audio segment that matches a specified work segment among the multiple work segments.

[0018] In some embodiments, the interface display module is used to display the state change result of the controlled element under the control of the target control instruction in the live broadcast interface when the performance quality of the performance audio meets the preset quality requirements, and the state change result is related to the instruction content of the target control instruction.

[0019] In some embodiments, the target control instruction is associated with a target barrage; the interface display module is used to trigger the playback of the target barrage in the live broadcast interface when the performance quality of the presentation audio meets the preset quality requirements.

[0020] In some embodiments, the live interactive content corresponds to multiple candidate control instructions; the interface display module is used to scroll and display the barrage content corresponding to the multiple candidate control instructions at a preset scrolling frequency during the process of the terminal collecting the performance audio; when the performance audio collection is completed, stop scrolling the barrage content corresponding to the multiple candidate control instructions, wherein the barrage content corresponding to the first candidate control instruction is displayed at the first display position when the scrolling display stops; when the performance quality of the performance audio meets the preset quality requirement, the barrage content corresponding to the first candidate control instruction is played on the live interface as the target barrage.

[0021] In some embodiments, the target control instruction is associated with a target gift; the interface display module is used to trigger the playing of a gift giving special effect corresponding to the target gift in the live broadcast interface when the performance quality of the presentation audio meets the preset quality requirements.

[0022] In some embodiments, the situation where the performance quality of the audio performance meets the preset quality requirement includes at least one of the following situations:

[0023] The performance score of the performance audio is greater than a preset score;

[0024] The recording quality of the performance audio meets the preset noise requirement;

[0025] The performance difficulty coefficient of the performance audio is greater than the preset difficulty coefficient.

[0026] In some embodiments, the live interactive content includes a live game; the state change result of the controlled element includes the number of target game elements generated; the number of target game elements generated is positively correlated with the performance quality of the performance audio; or, the state change result of the controlled element includes the influence range of the target game element; the influence range of the target game element is positively correlated with the performance quality of the performance audio.

[0027] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement any of the above-mentioned live interactive methods.

[0028] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, a code set or an instruction set is stored in the storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement any of the above-mentioned live interactive methods.

[0029] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs any of the above-mentioned live interactive methods.

[0030] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0031] When the live interface displays live interactive content, the audience can make sounds in the form of performances. The terminal will collect the performance audio of the audience. When the quality of the performance audio meets the quality requirements, the controlled elements in the live interactive content can be triggered to change their states. The audience triggers the change of controlled elements through performances, so there is no need to remember complex control instructions, which avoids the tedious process of the audience needing to learn and remember specific barrage instructions and then send barrages in related technologies, thereby improving the efficiency of human-computer interaction. In addition, by making sounds in the form of audience performances to control the state of controlled elements in the live interactive content, the audience's sense of participation and the interactivity of the live interactive content are enhanced, thereby improving the attractiveness of the live broadcast and the audience's retention rate. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 is a schematic diagram of a computer system provided by an exemplary embodiment of the present application;

[0034] Figure 2 is a schematic diagram of a live interactive method provided by an exemplary embodiment of the present application;

[0035] Figure 3 is a flow chart of a live interactive method provided by an exemplary embodiment of the present application;

[0036] Figure 4 is a flow chart of a live interactive method provided by another exemplary embodiment of the present application;

[0037] Figure 5 is a flow chart of a live interactive method provided by another exemplary embodiment of the present application;

[0038] Figure 6 is an interactive flow chart of a live interactive method provided by an exemplary embodiment of the present application;

[0039] Figure 7 is a structural block diagram of a live interactive device provided by an exemplary embodiment of the present application;

[0040] Figure 8 It is a structural block diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation mode of the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0042] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first" and "second", nor is there any limitation on quantity and execution order.

[0043] It should be noted that before collecting relevant data of users and during the process of collecting relevant data of users, this application can display a prompt interface, pop-up window or output voice prompt information, and the prompt interface, pop-up window or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data collected by this application are collected with the consent and authorization of the user, and the collection, use and processing of relevant user data need to comply with relevant laws, regulations and standards.

[0044] Please refer to Figure 1 , which shows a schematic diagram of a computer system provided by an embodiment of the present application. The computer system includes: an anchor terminal device 110, an audience terminal device 120 and a server 130.

[0045] The anchor terminal device 110 and the audience terminal device 120 can be electronic devices such as mobile phones, tablet computers, PCs (Personal Computers), wearable devices, VR (Virtual Reality) devices, AR (Augmented Reality) devices, vehicle-mounted devices, etc., which are not limited in this application. The anchor terminal device 110 and the audience terminal device 120 can run the client of the target application (such as a live broadcast application). Optionally, the target application can be an application that needs to be downloaded and installed, or it can be in the form of a web page or a small program, which is not limited in this embodiment of the application.

[0046] The anchor terminal device 110 is used to run the anchor user's client, which can be called the anchor client. The audience terminal device 120 is used to run the audience user's client, which can be called the audience client. The anchor user refers to a user who interacts with the audience user through a real-time video stream on the target application, and the audience user refers to a user who watches the live broadcast and interacts with the anchor user on the target application. Schematically, the anchor user logs in to the anchor account on the anchor client and broadcasts the live broadcast through the target application. The audience user logs in to the audience account on the audience client and watches the live broadcast online through the target application.

[0047] Optionally, the target application may include, but is not limited to, any one of: live broadcast applications, social application applications, shopping applications, video playback applications, remote conferencing applications, music playback applications, game applications, educational applications, and instant messaging applications.

[0048] The server 130 is used to provide background services for the client of the target application running in the anchor terminal device 110 and the audience terminal device 120. The server 130 can be a single server, or a server cluster consisting of multiple servers, or a cloud computing service center. The server 130 can be the background server of the above-mentioned target application, and is used to provide background services for the client of the target application.

[0049] The above-mentioned terminal devices (including the anchor terminal device 110 and the audience terminal device 120) can communicate with the server 30 through a wired network or a wireless network.

[0050] Optionally, the live broadcast interactive method is executed by the terminal device (the anchor terminal device 110 or the audience terminal device 120), or the terminal device (the anchor terminal device 110 or the audience terminal device 120) and the server 130 interact and cooperate to execute the live broadcast interactive method, which is not limited in this application.

[0051] With the rapid popularization of online live broadcasting, barrage has become one of the main ways for viewers to interact with anchors. In order to enhance the audience's sense of participation, many live broadcast platforms have introduced barrage games, allowing viewers to influence the game process by sending barrages. In related technologies, taking barrage shooting games as an example, viewers can send specified barrages in the chat area of ​​the live broadcast room, such as: barrage "333", through which the virtual character in the shooting game can be controlled to shoot. However, for viewers who are not familiar with the barrage system, sending specified barrages to control the game characters is a relatively complicated operation process, and viewers need a long time to learn the operation, resulting in low human-computer interaction efficiency of barrage games.

[0052] Based on this, this application provides a live interactive method, taking the live interactive content as a live game (such as a bullet screen game) as an example, please refer to Figure 2 , which shows a schematic diagram of a live interactive method, such as Figure 2 As shown:

[0053] A live broadcast interface 200 is displayed in the audience terminal device, and the live broadcast interface 200 includes a live broadcast screen area 210. The live broadcast screen area 210 displays the live screen of the barrage game being broadcast by "Anchor 1". The audience user can input in the chat box of the live broadcast interface 200 and send the specified barrage to the chat area 220 to trigger the corresponding barrage command, but the barrage command can control the game process of the barrage game. For example: if the audience user sends a "666" barrage, it can trigger the "send troops" barrage command, and the "send troops" barrage command can place a virtual soldier character in the barrage game; if the audience user sends a "shoot" barrage, it can trigger the "shoot" barrage command, and the "shoot" barrage command can control the virtual soldier character in the barrage game to shoot.

[0054] In the embodiment of the present application, in addition to the above-mentioned input barrage triggering barrage command, the live broadcast interface 200 provides an entrance for singing to trigger barrage command, schematically, as shown in FIG. Figure 2 As shown, the live broadcast interface 200 includes a performance control 201. After clicking the performance control 201, the audience user can sing the target song through the microphone of the audience terminal device to trigger the barrage command.

[0055] Among them, the target song can be a song specified by "Anchor 1", or the target song can be a song randomly provided by the live broadcast platform, etc. This embodiment of the present application does not limit this.

[0056] When the audience user sings the target song, the audience terminal device collects the performance audio of the audience's singing through the microphone and obtains the singing score of the performance audio. If the singing score is greater than the preset score, the preset barrage command is automatically triggered. For example: when the singing score is greater than 80 points, the "shoot" barrage command is automatically triggered.

[0057] After the "shoot" barrage command is automatically triggered, the shooting process of the virtual soldier character in the barrage game is displayed in the live screen area 210, and the shooting result is displayed.

[0058] In some embodiments, when the "shoot" barrage command is automatically triggered, the corresponding barrage content can also be displayed in the chat area 220, such as Figure 2 As shown, when the audience user's singing score is greater than 80 points, the "shoot" barrage 202 is automatically displayed in the chat area and the "shoot" barrage instruction is triggered.

[0059] It should be noted that the above example of singing a song through the performance control 201 to trigger the barrage instruction is only an illustrative description, and the actual implementation can also be achieved in other ways, such as: the anchor user sends a singing invitation to the audience user, and the audience user agrees to sing, thereby triggering the barrage instruction. This embodiment of the application is not limited to this.

[0060] In summary, the live interactive method provided by the embodiment of the present application is that when the live interface displays a live game, the audience user can sing a song in the live interface, and the audience terminal will collect the performance audio of the audience user's singing. When the singing score of the performance audio is greater than the preset score, the barrage command is automatically triggered. The barrage command can control the controlled elements in the live game (for example: virtual characters, virtual props, etc.) to change their states. The audience triggers the change of controlled elements through singing, and there is no need to remember complex control commands (for example: remembering "666" corresponding to the "dispatch" barrage command), avoiding the tedious process of the audience needing to learn and remember specific barrage commands and then send barrages in related technologies, thereby improving the efficiency of human-computer interaction. In addition, controlling the state of the controlled elements in the live game through the singing of the audience user enhances the audience's sense of participation and the interactivity of the live game, thereby improving the attractiveness of the live broadcast and the audience's retention rate.

[0061] The following is an introduction to the process of the live interactive method provided in the embodiment of the present application.

[0062] Figure 3 1 is a flowchart of a live interactive method provided by an exemplary embodiment of the present application. Taking the method executed by a viewer terminal device as an example, the method includes the following steps 310 to 330.

[0063] Step 310, display the live broadcast interface.

[0064] Optionally, the live broadcast interface refers to a user interface provided by the target application for audience users to watch live broadcasts, wherein the live broadcast interface includes live broadcast interactive content.

[0065] In some embodiments, a first live broadcast screen is displayed in the live broadcast interface, and the first live broadcast screen includes live interactive content. Optionally, the first live broadcast screen is a live broadcast screen provided by the anchor user. Schematically, the audience user watches the first live broadcast screen provided by the anchor user in the live broadcast interface through the audience terminal device.

[0066] Optionally, the live broadcast interface includes at least one of a live screen area, an interactive area, an information display area, etc., which is not limited in the embodiments of the present application. The live screen area is used to display the live screen (for example, displaying the first live screen provided by the anchor user); the interactive area is used to display various interactive controls, including but not limited to: a chat box, a barrage control, a like control, a gift control, a gift bar, a performance control, etc., which is not limited in the embodiments of the present application. The information display area includes a chat area, which is used to display barrages sent by audience users, etc., which is not limited in the embodiments of the present application.

[0067] Optionally, the live interactive content is used to indicate multimedia content being broadcast live, wherein the live interactive content includes controlled elements, and the controlled elements are elements in the live interactive content whose status is to be controlled.

[0068] Illustratively, the types of live interactive content include at least one of live games, virtual live broadcasts (live broadcasts using virtual images or characters), live music performances, live teaching, etc., which are not limited here.

[0069] Optionally, the controlled elements include at least one of text, image, sound, animation and the like. The controlled elements are controllable performance elements in the live interactive content. During the live broadcast, the server will convert the state of the controlled elements according to the received control instructions.

[0070] Optionally, the controlled elements in different live interactive contents are different.

[0071] Illustratively, in live games, the controlled elements may be virtual characters, virtual props, virtual skills, virtual pets, scene elements (such as building elements, ground elements, plant elements, meteorological elements), game background audio, etc.; in virtual live broadcasts, the controlled elements may be the actions, expressions, appearance, etc. of the virtual images or characters; in live music performances, the controlled elements may be the performance form of the music performance (for example, singing, playing the piano, playing the violin, etc.), the performance content of the music performance, the number of performers in the music performance, the lighting effects of the music performance, etc.; in live teaching, the controlled elements may be the teaching form of teaching (for example, teaching through lectures, teaching through answering questions, etc.), background audio of live teaching, etc., which are not limited here.

[0072] In the application embodiments, the live interactive content is mainly implemented as a live game as an example for explanation.

[0073] In live games, the state of controlled elements refers to the specific conditions or properties of controlled elements during the game. For example, the existence, position, health, and skill status of virtual characters; the existence, quantity, type, and position of virtual props; the health status and level of virtual pets; scene elements such as the integrity of buildings, the state of the ground (such as whether it is frozen), the growth status of plants, changes in weather (such as rain, snow, and sunny days); and the playback status of the game background audio (such as whether it is playing, the volume, etc.).

[0074] Step 320, while the live interactive content is displayed on the live interface, the performance audio is collected.

[0075] Performance audio is audio data that is produced in the form of a performance and collected by a terminal.

[0076] Schematically, during the process of displaying live interactive content on the live interface, the audience user performs through the microphone or other audio acquisition devices of the audience terminal device. During the audience performance, the audio data collected by the audience terminal device through the microphone or other audio acquisition devices is the performance audio.

[0077] Optionally, the performance audio is used to trigger and control the controlled elements in the live interactive content, and the performance form corresponding to the performance audio includes at least one of singing, reciting, talk show, etc., which is not limited here. Schematically, in the process of displaying the live interactive content on the live interface, the audience user can trigger and control the controlled elements in the live interactive content by singing a song; or the audience user can trigger and control the controlled elements in the live interactive content by reciting a poem; or the audience user can trigger and control the controlled elements in the live interactive content by performing a talk show.

[0078] In some embodiments, the performance audio includes audio data of a random performance by an audience user.

[0079] In an illustrative manner, an audience user may initiate a performance on the live broadcast interface, such as randomly singing a song, or randomly reciting a poem, or randomly performing a talk show. The audience terminal device collects the audio data of the audience user's performance to obtain the performance audio.

[0080] In other embodiments, the performance audio includes audio data performed by the audience user according to the performance instruction information.

[0081] Schematically, the live broadcast interface includes performance instruction information, and the performance instruction information is used to indicate the performance of a first work in a first performance form. The audience user initiates a performance in the live broadcast interface according to the performance instruction information, and performs the first work according to the first performance form indicated by the performance instruction information. The audience terminal device collects audio data of the audience user during the performance to obtain performance audio.

[0082] Optionally, the live broadcast interface includes a performance control, and when a trigger operation on the performance control is received, the performance audio is collected. The trigger operation includes at least one of a single-click operation, a double-click operation, a voice command operation, a gesture command operation, etc., which are not limited here.

[0083] Indicatively, a "singing control" is displayed on the live broadcast interface. After the audience user clicks the "singing control", they sing a random song, or sing a target song specified by the anchor or the live broadcast platform. When the audience user sings a song, the microphone of the audience terminal device will collect the song sung by the audience.

[0084] In the above scheme, by setting performance controls (such as singing controls) on the live broadcast interface, the audience can intuitively see and participate in the interaction. This intuitive participation method makes the process of audience participation in controlling the controlled elements easier, thereby improving the efficiency and enthusiasm of the audience's participation in the interaction.

[0085] In some embodiments, a viewer account is logged in to the viewer terminal device, and the live interactive content is the live content provided by the anchor account. In the process of displaying the live interactive content on the live interface, the performance invitation information sent by the anchor account is displayed, and the performance invitation information is used to invite the viewer account to perform; when a trigger operation is received on the performance entrance in the performance invitation information, the performance audio is collected.

[0086] Indicatively, the performance invitation information is information sent by the host user to the audience user, wherein the performance invitation information is used to invite the audience user to sing a random song, or the performance invitation information is used to invite the audience user to sing a target song specified by the host. When the audience user triggers the performance entrance, it means that the audience user agrees to perform, and the audience terminal device can start collecting audio data of the audience user's performance.

[0087] Step 330, when the performance quality of the audio meets the preset quality requirements, the state change results of the controlled elements in the live interactive content are displayed on the live interface.

[0088] Optionally, the situation where the performance quality of the audio meets the preset quality requirement includes at least one of the following situations:

[0089] Case 1: The performance score of the performance audio is greater than the preset score.

[0090] Among them, the performance score is used to evaluate the performance effect of the performance audio.

[0091] Indicatively, a score is preset as a quality standard, namely, a preset score. When the performance score of the performance audio is greater than the preset score, it indicates that the performance effect of the audience user is good, and thus it can be considered that the performance quality of the performance audio meets the preset quality requirements.

[0092] Optionally, the performance score includes at least one of the following scores: (1) a score determined by an automatic scoring system; (2) a score provided by a host account associated with the live interactive content; (3) a score provided by a viewer account watching the live interactive content, which is not limited here.

[0093] Optionally, the anchor accounts associated with the live interactive content include the anchor accounts that provide the live interactive content, for example: the live broadcast interface refers to the live broadcast room of anchor account 1, and the live broadcast interactive content in the live broadcast interface is provided by anchor account 1; the anchor accounts associated with the live broadcast interactive content can also include anchor accounts participating in the live broadcast, for example: in the live broadcast room of anchor account 1, the live broadcast interactive content is a confrontational live game, in which anchor account 1 is the red side and anchor account 2 is the blue side, then after the audience user performs, anchor account 1 and anchor account 2 can both score the audience user's performance.

[0094] Optionally, the audience account for watching the live interactive content includes the audience account corresponding to other audience users watching the live interactive content, and the audience account does not include the audience account corresponding to the audience user performing the audio. Schematically, in the live broadcast room of anchor account 1, there are audience account a, audience account b and audience account c. After the audience user corresponding to audience account a performs, audience account b and audience account c can rate the performance of the audience user corresponding to audience account a.

[0095] Case 2: The recording quality of the performance audio meets the preset noise requirements.

[0096] Among other things, recording quality includes the noise level present in the audio.

[0097] Illustratively, a noise level is preset as the quality standard, i.e., the preset noise requirement, and whether the recording quality meets the standard is determined by measuring the noise level in the performance audio. If the noise in the performance audio is lower than the preset noise level indicated by the preset noise requirement, then the recording quality of the performance audio is considered to be good, and further, it can be considered that the performance quality of the performance audio meets the preset quality requirement.

[0098] Case 3: The performance difficulty coefficient of the audio is greater than the preset difficulty coefficient.

[0099] Among them, the performance difficulty coefficient is used to evaluate the performance difficulty of the performance audio.

[0100] Indicatively, a difficulty coefficient is preset as the quality standard, that is, the difficulty coefficient is preset, and the performance difficulty coefficient of the performance audio is calculated. If the performance difficulty coefficient is higher than the preset difficulty coefficient, it is considered that the difficulty of the performance audio is high, and further, it can be considered that the performance quality of the performance audio meets the preset quality requirements.

[0101] Optionally, the performance difficulty coefficient includes at least one of the following coefficients: (1) a coefficient determined by an automatic difficulty assessment system; (2) a coefficient provided by a host account associated with the live interactive content; (3) a coefficient provided by a viewer account watching the live interactive content, which is not limited here.

[0102] It should be noted that the above examples of situations where the performance quality of the audio performance meets the preset quality requirements are only illustrative and are not limited here.

[0103] In some embodiments, the performance quality of the expressive audio is quantitatively evaluated by a performance quality score, and the higher the performance quality score, the higher the performance quality of the expressive audio.

[0104] Optionally, when the performance quality score of the performance audio is greater than a preset quality score, the state change result of the controlled element in the live interactive content is displayed on the live interface, wherein the performance quality score is determined by at least one of the performance score of the performance audio, the recording quality of the performance audio, and the performance difficulty coefficient of the performance audio.

[0105] For example: the performance quality score of the performance audio is determined based on the performance score of the performance audio, the recording quality of the performance audio, and the performance difficulty coefficient of the performance audio. When the performance quality score is greater than the preset quality score, the state change result of the controlled element in the live interactive content is displayed on the live interface. Schematically, a first quality score is determined based on the performance score of the performance audio and a first weight, a second quality score is determined based on the recording quality of the performance audio and a second weight, and a third quality score is determined based on the performance difficulty coefficient of the performance audio and a third weight. The first quality score, the second quality score, and the third quality score are added together to obtain the performance quality score.

[0106] In the above situation one, by presetting a specific score as the evaluation standard, when the performance score reaches the preset score, the controlled element is triggered to change its state, avoiding the process of manually sending barrage to trigger the controlled element to change its state, improving the control efficiency of the controlled elements, and increasing the enthusiasm and interest of the audience in participating in the controlled elements.

[0107] In the above situations 2 and 3, by presetting the noise level and difficulty coefficient as the quality standard, it is possible to exclude a portion of the low-quality performance audio from controlling the controlled elements, thereby reducing the frequency of controlling the controlled elements and reducing the waste of computer resources. In addition, it can also encourage audience users to improve the performance quality, thereby increasing the stickiness between the audience users and the live broadcast interface.

[0108] Optionally, when it is determined that the performance quality of the audio meets the preset quality requirements, the state change of the controlled elements in the live interactive content is automatically triggered, and the state change results of the controlled elements in the live interactive content are displayed on the live interface.

[0109] Illustratively, taking a live game as an example, when it is determined that the performance quality of the audio meets the preset quality requirements, the virtual character in the game is automatically triggered to execute the shooting process and display the shooting results.

[0110] In some embodiments, when the performance quality of the audio meets the preset quality requirements, the state change result of the controlled element under the control of the target control instruction is displayed on the live broadcast interface, and the state change result is related to the instruction content of the target control instruction.

[0111] The target control instruction is a randomly generated control instruction; or the target control instruction is related to the performance audio.

[0112] Optionally, when the target control instruction is related to the performance audio, the target control instruction is related to at least one of the performance form, performance content, performance quality, etc. of the performance audio.

[0113] For example, take live games as an example. Different performance forms correspond to different target control instructions. When the performance form is singing, the target control instruction is used to control the placement of virtual attack elements (for example, virtual soldier characters) in the game; when the performance form is talk show, the target control instruction is used to execute attack skills in the game; when the performance form is recitation, the target control instruction is used to control the execution of healing skills in the game.

[0114] Different performance contents correspond to different target control instructions. Taking singing as an example, when singing pop songs, the target control instructions are used to control the placement of virtual attack elements in the game; when singing opera, the target control instructions are used to execute attack skills in the game; when singing musicals, the target control instructions are used to control the execution of healing skills in the game.

[0115] Different performance qualities correspond to different target control instructions. Taking the performance quality quantified by the performance quality score as an example, when the performance quality score is greater than the preset quality score and less than or equal to the first score, the target control instruction is used to control the placement of virtual attack elements in the game; when the performance quality score is greater than the first score and less than or equal to the second score, the target control instruction is used to execute attack skills in the game; when the performance quality score is greater than the second score, the target control instruction is used to control the execution of treatment skills in the game. Among them, the preset quality score is less than the first score, and the first score is less than the second score.

[0116] In the above embodiment, when the performance quality of the audio meets the preset quality requirements, the target control instruction can be triggered without complicated operations or additional steps, thereby improving the efficiency of human-computer interaction. The state change result of the controlled element is closely related to the instruction content of the target control instruction, and the control of the controlled element is limited to the range specified by the control instruction, thereby avoiding live broadcast accidents caused by misoperation.

[0117] In some embodiments, the above-mentioned target control instruction is associated with the target barrage, and the target control instruction can be called a barrage instruction.

[0118] Optionally, when the performance quality of the audio meets the preset quality requirements, the target bullet screen is triggered in the live interface. In an exemplary manner, when it is determined that the performance quality of the audio meets the preset quality requirements, the target bullet screen is automatically displayed in the chat area of ​​the live interface and the live interactive content is triggered to execute the target control instruction corresponding to the target bullet screen.

[0119] In the above embodiment, the automatic playback of the target barrage provides the user with instant feedback, indicating that the target control instruction has taken effect, avoiding the tedious steps of the user confirming whether the target control instruction is effective through channels, thereby improving the efficiency of human-computer interaction.

[0120] In other embodiments, the target control instruction is associated with a target gift, and the target control instruction may be referred to as a gift instruction.

[0121] Optionally, when the performance quality of the audio meets the preset quality requirements, the gift giving special effect corresponding to the target gift is triggered in the live broadcast interface. Indicatively, when it is determined that the performance quality of the audio meets the preset quality requirements, the target gift is automatically given to the anchor account providing the live broadcast interactive content in the live broadcast interface, thereby displaying the gift giving special effect corresponding to the target gift, and triggering the live broadcast interactive content to execute the target control instruction.

[0122] In some embodiments, the performance quality score of the performance audio is positively correlated with the number of resources of the gift redemption resource.

[0123] Optionally, the target gift is determined from multiple candidate gifts based on the number of resources corresponding to the performance quality score of the performance audio. In an exemplary manner, if the performance quality score is 90, the number of resources for gift exchange is 1000, and multiple candidate gifts are gifts that can be exchanged for resources within 1000 (including 1000), then the target gift is a gift randomly determined by the live broadcast platform from multiple candidate gifts, or the target gift is a gift selected by the audience user from multiple candidate gifts.

[0124] Optionally, a target gift is generated based on the number of resources corresponding to the performance quality score of the performance audio and the performance audio. Schematically, the target gift is a personalized gift resource automatically generated by the live broadcast platform based on the gift redemption resources and the performance audio, wherein the value of the target gift is the number of resources corresponding to the performance quality score, and the gift giving special effects of the target gift include audio special effects, which can be implemented as a highlight clip in the performance audio, wherein the highlight clip is the clip with the highest performance quality score in the performance audio, for example: when the performance audio is a song sung by an audience user, the highlight clip refers to the singing clip with the highest comprehensive singing score in the song sung by the user.

[0125] In the above embodiment, by setting preset quality requirements, when the audience's performance quality meets the requirements, the system automatically gives the target gift and displays the corresponding gift effects, thereby attracting more audiences to participate in the interaction and increasing the activity and stickiness of the live broadcast room.

[0126] In some embodiments, the state transition results of the controlled element are related to the performance quality of the presentation audio.

[0127] Optionally, taking the implementation of live interactive content as a live game as an example, the state transformation result of the controlled element includes the number of target game elements generated, and the number of target game elements generated is positively correlated with the performance quality of the presentation audio, wherein the target game elements are used to indicate the game elements that can be placed (or generated) in the game, such as: attack elements (such as virtual characters, virtual turrets, etc.), defense elements (such as virtual defense towers, virtual traps, etc.).

[0128] Indicatively, the number of target game elements generated is positively correlated with the performance quality score of the performance audio. If the controlled element is an attack element in the game, triggering the controlled element to change state means placing (or generating) an attack element in the game. When the performance quality score is greater than the preset quality score and less than or equal to the third score, 1 attack element is placed in the game; when the performance quality score is greater than the third score and less than or equal to the fourth score, 2 attack elements are placed in the game; when the performance quality score is greater than the fourth score, 3 attack elements are placed in the game. Among them, the preset quality score is less than the third score, and the third score is less than the fourth score.

[0129] Optionally, the state transformation result of the controlled element includes the influence range of the target game element; the influence range of the target game element is positively correlated with the performance quality of the performance audio. The target game element is used to indicate the elements of the game with an influence range, such as the effective range of a virtual prop, the effective range of a virtual skill, etc.

[0130] Indicatively, the impact range of the target game element is positively correlated with the performance quality score of the performance audio. If the controlled element is a healing skill in the game, triggering the controlled element to change state means using the healing skill in the game. When the performance quality score is greater than the preset quality score and less than or equal to the fifth score, the healing skill can heal 1 virtual character; when the performance quality score is greater than the fifth score and less than or equal to the sixth score, the healing skill can heal 2 virtual characters; when the performance quality score is greater than the sixth score, the healing skill can heal 3 virtual characters. Among them, the preset quality score is less than the fifth score, and the fifth score is less than the sixth score.

[0131] In the above embodiment, by directly associating the performance quality of the performance audio with the state change results of the in-game elements (such as the number of generated or the influence range of the target game element), the audience is encouraged to perform more attentively because their performance will directly affect the game process and results, thereby enhancing the interactivity between the audience and the live game.

[0132] Among them, the state change result of the controlled element is used to determine the content direction of the live interactive content.

[0133] Schematically, taking live games as an example, audience users trigger the state changes of controlled elements such as virtual characters, virtual props, virtual skills, etc. in the game through performances. When the states of these controlled elements change, the game process of the live game also changes accordingly, thereby realizing the interaction between the audience and the live game content.

[0134] In summary, in the live interactive method provided by the embodiment of the present application, when the live interface displays the live interactive content, the audience can make sounds in the form of performance, and the terminal will collect the performance audio of the audience's performance. When the quality of the performance audio meets the quality requirements, the controlled elements in the live interactive content can be triggered to change their states. The audience triggers the change of controlled elements through performance, so there is no need to remember complex control instructions, which avoids the tedious process of the audience needing to learn and remember specific barrage instructions and then send barrages in related technologies, thereby improving the efficiency of human-computer interaction. In addition, by making sounds in the form of audience performances to control the state of the controlled elements in the live interactive content, the audience's sense of participation and the interactivity of the live interactive content are enhanced, thereby improving the attractiveness of the live broadcast and the audience's retention rate.

[0135] In some embodiments, the audience can trigger the state change of the controlled elements in the live interactive content by performing a specified work in the live broadcast interface. Figure 4 , the above Figure 3 The illustrated embodiment may also be implemented as steps 410 to 430 .

[0136] Step 410, display the live broadcast interface.

[0137] The live broadcast interface includes live broadcast interactive content, and the live broadcast interactive content includes controlled elements. The controlled elements are elements in the live broadcast interactive content whose status is to be controlled.

[0138] In an illustrative example, taking the live interactive content as a game, the state of the controlled element can be implemented as the existence state of the controlled element. For example, if the controlled element is an attack element, then generating an attack element in the game indicates that the controlled element is in the existence state. In the embodiment of the present application, the audience user can trigger the attack element in the game to switch to the existence state in the form of a performance, that is, place (or generate) a virtual attack element in the game.

[0139] The state of the controlled element can be realized as the use state of the controlled element. For example, if the controlled element is a virtual skill, using the virtual skill in the game indicates that the controlled element is in use. In the embodiment of the present application, the audience user can trigger the control of the virtual skill in the game to switch to the use state in the form of performance, that is, trigger the use of the virtual skill in the game.

[0140] In some embodiments, the live broadcast interface includes performance instruction information, and the performance instruction information is used to indicate the performance of the first work in a first performance form.

[0141] Optionally, the first performance form includes at least one of singing, reciting, talk show, etc., which is not limited here. Optionally, the first work is a specified work. For example, if the first performance form is singing, the first work can be a specified song A, and the audience user needs to perform song A; or the first work generally refers to songs, and the audience user can sing a random song.

[0142] Optionally, the performance instruction information is instruction information pre-configured by the anchor user in the live broadcast room, or the performance instruction information is instruction information in the performance invitation information sent by the anchor user to the audience user in real time, which is not limited here.

[0143] Step 420, while the live interactive content is displayed on the live interface, performance audio matching the first work is collected.

[0144] The performance audio is audio data collected by the terminal when the first work is performed in the first performance form. Schematically, the audience user initiates a performance on the live broadcast interface according to the performance instruction information, and performs the first work according to the first performance form indicated by the performance instruction information, and the audience terminal device collects audio data during the performance of the audience user to obtain the performance audio.

[0145] In some embodiments, the live broadcast interface includes a performance control, and when a trigger operation on the performance control is received, the performance audio matching the first work is collected. The trigger operation includes at least one of a single-click operation, a double-click operation, a voice command operation, a gesture command operation, etc., which are not limited here.

[0146] Indicatively, the first performance form is singing. The "singing control" is displayed on the live broadcast interface. When the "singing control" is triggered, the audience user starts to sing a random song, or sings a target song specified by the anchor or the live broadcast platform. When the audience user sings a song, the microphone of the audience terminal device will collect the song sung by the audience.

[0147] When the audience user is performing, the collected performance audio can be synchronized to the live broadcast interface for playback, that is, other audience users and / or anchor users in the live broadcast room can listen to the audience's performance audio; or the performance audio may not be played on the live broadcast interface.

[0148] In other embodiments, a viewer account is logged in to the viewer terminal device, and the live interactive content is the live content provided by the anchor account. In the process of displaying the live interactive content on the live interface, the performance invitation information sent by the anchor account is displayed, and the performance invitation information includes performance instruction information, and the performance invitation information is used to invite the viewer account to perform according to the performance instruction information; when a trigger operation is received on the performance entry in the performance invitation information, the performance audio matching the first work is collected.

[0149] Indicatively, the host account may send performance invitation information to all audience accounts in the live broadcast room; or, the host account may send performance invitation information to designated audience accounts (including at least one audience account) in the live broadcast room. When the audience account in the current audience terminal device receives the performance invitation information, the performance invitation information is displayed to the audience user in a preset form (such as a pop-up window, a scroll bar, or text embedded in the live broadcast screen, etc.) on the live broadcast interface of the audience terminal device. When the audience user triggers the performance entry in the performance invitation information, it means that the audience user agrees to perform, and the audience terminal device can start collecting audio data of the audience user's performance according to the performance instruction information.

[0150] In the above scheme, the performance invitation information is sent through the anchor account and includes specific performance instruction information, so that the audience can clearly know how to perform to participate in the process of controlling the controlled elements. This clear invitation and response mechanism helps to improve the efficiency and accuracy of the interaction.

[0151] In some embodiments, the performance instruction information is used to instruct to perform the designated work in a first performance form.

[0152] The following is explained by taking the example of the performance instruction information being used to instruct the performance of the first audio work in the form of singing.

[0153] Optionally, while the live interactive content is displayed on the live interface, the accompaniment audio of the first audio work is played; while the accompaniment audio of the first audio work is played, the performance audio matching the first audio work is collected.

[0154] In an illustrative manner, the first audio work includes a designated song, the accompaniment of the designated song is played in real time on the live broadcast interface, and the audience user sings the designated song in real time according to the accompaniment. Lyrics can also be displayed at a suitable position on the live broadcast interface, and the audience user sings the designated song in real time according to the accompaniment and lyrics.

[0155] In the above embodiment, by playing the accompaniment of the first audio work, the performance quality of the audience user can be improved, and the occurrence of a large amount of low-quality performance audio can be avoided, which results in the inability to trigger the controlled elements and thus excessive invalid interactions. By playing the accompaniment, the performance quality of the audience user is improved and the waste of computer resources is reduced.

[0156] Step 430, when the performance quality of the audio meets the preset quality requirements, the state change results of the controlled elements in the live interactive content are displayed on the live interface.

[0157] Among them, the state change result of the controlled element is used to determine the content direction of the live interactive content.

[0158] Optionally, when the performance quality of the performance audio meets the quality requirements corresponding to the first work, the state change result of the controlled element in the live interactive content is displayed on the live interface. In an exemplary embodiment, when the performance quality score of the performance audio is greater than the quality score corresponding to the first work, the state change result of the controlled element in the live interactive content is displayed on the live interface. The performance quality score is determined by at least one of the performance score of the performance audio, the recording quality of the performance audio, and the performance difficulty coefficient of the performance audio.

[0159] Optionally, different works have uniform quality requirements, for example, the measurement standard for different works is a preset quality score, and when the performance quality of the audio is greater than the preset quality score, the state change result of the controlled element in the live interactive content is displayed on the live interface.

[0160] Alternatively, multiple works have different quality requirements, for example, the first work corresponds to a first quality score, the second work corresponds to a second quality score, and the first quality score and the second quality score are different. When the performance audio is the audio data collected by the terminal when the audience user performs the first work, if the performance quality of the performance audio is greater than the first quality score, the state change result of the controlled element in the live interactive content is displayed on the live interface. When the performance audio is the audio data collected by the terminal when the audience user performs the second work, if the performance quality of the performance audio is greater than the second quality score, the state change result of the controlled element in the live interactive content is displayed on the live interface.

[0161] In some embodiments, the performance instruction information is used to instruct the specified work to be performed in a first performance form. For example, the performance instruction information is used to instruct the first audio work to be performed in a singing form.

[0162] Optionally, the first audio work includes a plurality of work segments, wherein the performance audio refers to a plurality of audio segments matching the plurality of work segments.

[0163] Optionally, when the performance quality of the multiple audio clips meets the preset quality requirements, the state change results of the controlled elements in the live interactive content are displayed on the live interface.

[0164] Illustratively, the audience user sings a designated song in real time. When the song is finished, the singing results of multiple lines of lyrics in the song, i.e., multiple audio clips, are sent to a server or scored by an automatic scoring system in the audience terminal device. If the singing score of the singing result is greater than a preset score, it is determined that the performance quality of the multiple audio clips meets the preset quality requirements, and the state change results of the controlled elements in the live interactive content are then displayed on the live interface.

[0165] Among them, the singing score of the singing result is realized as at least one of the overall singing score, the sum of the singing scores of each line of lyrics in multiple lines, etc., which is not limited here.

[0166] Alternatively, the performance audio refers to a specified audio segment that matches a specified production segment among the plurality of production segments.

[0167] Optionally, when the performance quality of the specified audio segment meets the preset quality requirements, the state change results of the controlled elements in the live interactive content are displayed on the live interface.

[0168] Illustratively, the audience user sings a designated song in real time. While the song is being sung, the server or the audience terminal device scores each line of lyrics in real time to obtain a singing score for each line of lyrics. If the singing score of a certain line of lyrics is greater than a preset score, it is determined that the performance quality of the designated audio clip meets the preset quality requirements, and the state change results of the controlled elements in the live interactive content are then displayed on the live interface.

[0169] By dividing the first audio work into multiple work segments and scoring multiple audio segments performed by audience users, the pertinence and accuracy of the scoring are improved. Under this premise, the global performance quality of multiple audio segments (i.e., the overall performance audio) can be considered as evaluation data, or the local performance quality of designated audio segments (i.e., partial performance audio) can be considered as evaluation data, thereby increasing the diversity of the scoring.

[0170] In summary, in the live interactive method provided by the embodiment of the present application, when the live interactive content is displayed on the live interface, the audience can perform in the form of performance according to the performance instruction information, and the terminal will collect the performance audio of the audience's performance. When the quality of the performance audio meets the quality requirements, the controlled elements in the live interactive content can be triggered to change their states. The audience triggers the change of the controlled elements through performance, so there is no need to remember complex control instructions, which avoids the cumbersome process of the audience needing to learn and remember specific barrage instructions and then send barrages in related technologies, thereby improving the efficiency of human-computer interaction. In addition, the performance instruction information clarifies the method and content of the audience's performance, avoids invalid interactive operations caused by invalid performances by the audience, improves the success rate of the audience's performance to trigger the control of the controlled elements, and reduces the consumption of computer resources.

[0171] In some embodiments, when the quality of the audience's performance audio meets the quality requirements, it will trigger the playback of the target barrage, which corresponds to a target control instruction, and the controlled elements in the live interactive content will change their states according to the target control instruction. Figure 5 , the above Figure 3 or Figure 4 The illustrated embodiment may also be implemented as steps 510 to 532 .

[0172] Step 510, display the live broadcast interface.

[0173] The live broadcast interface includes live broadcast interactive content, and the live broadcast interactive content includes controlled elements. The controlled elements are elements in the live broadcast interactive content whose status is to be controlled.

[0174] In some embodiments, the live broadcast interface includes performance instruction information, and the performance instruction information is used to indicate that the first work is performed in the first performance form. Optionally, the performance instruction information is instruction information pre-configured by the anchor user in the live broadcast room, or the performance instruction information is instruction information in the performance invitation information sent by the anchor user to the audience user in real time, which is not limited here.

[0175] Step 520, while the live interactive content is displayed on the live interface, the performance audio is collected.

[0176] Performance audio is audio data that is produced in the form of a performance and collected by a terminal.

[0177] In some embodiments, when the live broadcast interface includes performance instruction information, during the process of displaying the live interactive content on the live broadcast interface, performance audio matching the first work is collected, wherein the performance audio is audio data collected by the terminal when the first work is performed in the first performance form.

[0178] Illustratively, the audience user initiates a performance on the live broadcast interface according to the performance instruction information, and performs the first work according to the first performance form indicated by the performance instruction information, and the audience terminal device collects audio data of the audience user during the performance to obtain performance audio.

[0179] Step 531, when the performance quality of the audio meets the preset quality requirements, trigger the playback of the target barrage in the live broadcast interface.

[0180] In some embodiments, when the live broadcast interface includes performance instruction information, when the performance quality of the audio meets the quality requirements corresponding to the first work, the target barrage is triggered to be played in the live broadcast interface.

[0181] Among them, the target barrage corresponds to the target control instruction, and the target control instruction is used to control the state change of the controlled elements in the live interactive content.

[0182] Optionally, the target control instruction is a randomly generated control instruction; or, the target control instruction is related to the performance audio.

[0183] Illustratively, the target barrage is configured with target control instructions. For example, in a shooting game, the barrage "666" is configured with a control instruction for generating a virtual character. By executing the target control instruction in the shooting game, the virtual character can be placed in the virtual game scene of the shooting game. For another example, the barrage "shooting" is configured with a control instruction for executing shooting skills. By executing the target control instruction in the shooting game, the virtual character in the virtual game scene of the shooting game can be controlled to perform shooting skills to attack the enemy.

[0184] Optionally, when it is determined that the performance quality of the audio meets the preset quality requirements, the target barrage is displayed in the barrage display area of ​​the live broadcast interface, where the barrage display area includes at least one of the chat area of ​​the live broadcast interface, the transparent area covering the live broadcast screen of the live broadcast interface, etc., which is not limited here.

[0185] In some embodiments, the live interactive content corresponds to a plurality of candidate control instructions, wherein each candidate control instruction is associated with a specific bullet screen content.

[0186] Optionally, during the process of the terminal collecting and performing audio, the bullet screen contents corresponding to the plurality of candidate control instructions are scrolled and displayed at a preset scrolling frequency.

[0187] In schematic form, the process of the terminal collecting and performing audio can be understood as the process of the audience user's performance. During the audience user's performance, the live broadcast interface will scroll and display the barrage content corresponding to multiple candidate control instructions at a preset scrolling frequency.

[0188] Optionally, when the audio collection is finished, the scrolling display of the bullet screen contents corresponding to the multiple candidate control instructions is stopped, wherein the bullet screen contents corresponding to the first candidate control instruction are displayed at the first display position when the scrolling display is stopped.

[0189] In an illustrative manner, when the audience user's performance ends, such as when the audience user completes singing a song, the scrolling display stops. At this time, the barrage content corresponding to the first candidate control instruction is displayed at the first display position where the scrolling display stops.

[0190] Among them, the first display position can be the final stop position of the barrage content when it stops scrolling. For example: multiple barrage contents are displayed in a pop-up window in sequence. When scrolling stops, the pop-up window position is the first display position, and the barrage content displayed at the pop-up window position is the barrage content corresponding to the first candidate control instruction.

[0191] When the performance quality of the audio meets the preset quality requirements, the barrage content corresponding to the first candidate control instruction is played on the live broadcast interface as the target barrage.

[0192] In an illustrative manner, when the audience user's performance ends, the quality of the performance audio collected during the audience performance is evaluated. When the performance quality of the performance audio meets the preset quality requirements, the barrage content displayed at the first display position is sent to the barrage display area of ​​the live broadcast interface, and the first candidate control instruction is executed in the live broadcast interactive content, and the first candidate control instruction is the target control instruction.

[0193] In the above embodiment, during the audience's performance, the barrage contents corresponding to multiple candidate control instructions are scrolled and displayed. The audience can control the performance rhythm according to the scrolled barrage contents and thus select the barrage instructions they want to send, thereby improving the audience's ability to control the process of triggering the barrage instructions and enhancing the audience's participation and interactivity.

[0194] Step 532, displaying the state change result of the controlled element under the control of the target control instruction on the live broadcast interface.

[0195] Among them, the state change result is used to determine the content direction of the live interactive content.

[0196] Optionally, the state change result is related to the instruction content of the target control instruction.

[0197] For example, the live interactive content is a shooting game, and the live interactive content includes a first controlled element and a second controlled element, wherein the first controlled element is a virtual character and the second controlled element is a virtual shooting prop. The instruction content corresponding to the target control instruction is as follows: "The virtual character uses the virtual shooting prop to attack", and when the live interface displays the target barrage, the virtual character in the live interactive content is displayed to perform a shooting action using the virtual shooting prop.

[0198] In summary, in the live interactive method provided by the embodiment of the present application, when the live interactive content is displayed on the live interface, the audience can make sounds in the form of performances, and the terminal will collect the performance audio of the audience's performance. When the quality of the performance audio meets the quality requirements, the target barrage can be triggered to play and the corresponding target control instructions can be executed in the live interactive content. The controlled elements in the live interactive content can be controlled to change their states through the target control instructions. The audience triggers the change of the controlled elements through performance, so there is no need to remember complex control instructions, which avoids the cumbersome process in the related technology that the audience needs to learn and remember specific barrage instructions and then send barrages, thereby improving the efficiency of human-computer interaction. In addition, the automatic playback of the target barrage provides users with instant feedback, indicating that the target control instruction has taken effect, avoiding the cumbersome steps of users confirming whether the target control instruction is effective through channels, thereby improving the efficiency of human-computer interaction.

[0199] The following is an interactive process between the host terminal device, the audience terminal device and the server in the embodiment of the present application. Make an introduction.

[0200] For illustration, please refer to Figure 6 , which shows an interaction flow chart of a live interactive method provided by an embodiment of the present application, the method includes the following steps 601 to 611.

[0201] Step 601: The viewer terminal device displays a live broadcast interface.

[0202] The live broadcast interface includes live broadcast interactive content, and the live broadcast interactive content includes controlled elements. The controlled elements are elements in the live broadcast interactive content whose status is to be controlled.

[0203] Step 602: The server sends performance instruction information to the audience terminal device.

[0204] The performance instruction information is used to instruct the performance of the first work in the first performance form.

[0205] Optionally, the situation in which the server sends the performance instruction information to the audience terminal device includes at least one of the following situations:

[0206] Case 1: Step 6021a, the anchor terminal device sends a performance instruction request to the server; Step 6022a: the server receives the performance instruction request and generates performance instruction information.

[0207] Schematically, the anchor user sends a performance instruction request to the server through the anchor terminal device, and the performance instruction request includes some instruction information about the upcoming performance, such as the first performance form and the first work. The performance instruction request is initiated by the anchor user, indicating that the anchor wants to perform in a certain way and hopes that the server can generate corresponding performance instruction information accordingly. After receiving the performance instruction request sent by the anchor user, the server will parse the content in the performance instruction request and generate performance instruction information, which will be used to guide the performance process of subsequent audience users.

[0208] Case 2: Step 6021b: The server randomly generates performance instruction information.

[0209] Illustratively, the server randomly determines the performance form and performance work, and generates performance instruction information based on this.

[0210] Step 603: The audience terminal device receives the performance instruction information and displays the performance instruction information on the live broadcast interface.

[0211] Schematically, the performance instruction information may appear in a specific area of ​​the live broadcast interface in the form of text, icons, animations, etc., such as above, below, or on the side of the screen.

[0212] In some embodiments, if the performance instruction information is generated based on the performance instruction request sent by the anchor user, the performance instruction information can also be displayed in the performance invitation information sent by the anchor user, that is, the performance invitation information is displayed on the live broadcast interface of the audience terminal, and the performance invitation information includes the performance instruction information.

[0213] Step 604: The audience terminal device obtains the performance audio.

[0214] In an illustrative manner, the user of the audience terminal, i.e., the audience user, can perform according to the instructions of the performance instruction information. During the audience performance, the audience terminal device collects the audio data of the audience user's performance through an audio collection device such as a microphone. The audio data is the performance audio.

[0215] Step 605: The viewer terminal device sends the performance audio to the server.

[0216] Illustratively, the viewer terminal device sends the performance audio to the server.

[0217] In other embodiments, the audience terminal device includes an automatic scoring system, and the audience terminal device determines whether the performance quality of the presentation audio meets the preset quality requirements. If the performance quality of the presentation audio meets the preset quality requirements, the instruction generation request is sent to the server.

[0218] Step 606, the server determines whether the performance quality of the audio meets the preset quality requirements, and generates barrage playback instructions and target control instructions if the performance quality of the audio meets the preset quality requirements.

[0219] In an illustrative manner, after receiving the performance audio, the server scores the performance audio through an automatic scoring system. If the performance quality of the performance audio meets the preset quality requirements, a barrage playback instruction and a target control instruction are generated.

[0220] Alternatively, when the server receives an instruction generation request, the server generates a bullet screen playback instruction and a target control instruction according to the instruction generation request.

[0221] Step 607: The server sends a bullet screen playback instruction to the viewer's terminal device.

[0222] In an illustrative manner, after the server generates the barrage playback instruction, it sends the barrage playback instruction to the viewer terminal device.

[0223] Step 608, the viewer terminal device receives the barrage playback instruction and triggers the playback of the target barrage in the live broadcast interface.

[0224] In an illustrative manner, after receiving the bullet screen playback instruction, the viewer terminal device automatically plays the target bullet screen in the bullet screen display area of ​​the live broadcast interface. It should be noted that the target bullet screen is an automatically generated and played bullet screen, which is different from the bullet screen manually input and sent by the viewer user.

[0225] Step 609: The server generates state transformation data of the controlled element based on the target control instruction.

[0226] In an illustrative manner, the server also controls the controlled elements in the live interactive content to perform state changes according to the target control instructions, and obtains the rendering data of the controlled elements during the state change process as state change data.

[0227] Step 610: The server sends state change data to the viewer terminal device.

[0228] Schematically, the server sends the rendering data of the controlled element during the state change process to the viewer terminal device.

[0229] Step 611: The viewer terminal device receives the state change data and displays the state change result of the controlled element on the live broadcast interface.

[0230] In an illustrative manner, after receiving the rendering data of the controlled element in the state change process, the viewer terminal device can render and display the state change process of the controlled element in the live broadcast interface, thereby displaying the state change result of the controlled element.

[0231] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0232] Please refer to Figure 7 , which shows a structural block diagram of a live interactive device provided by an embodiment of the present application. The device has the functions of implementing the above examples, and the functions can be implemented by hardware or by hardware executing corresponding software. Figure 7 As shown, the device may include an interface display module 710 and a data acquisition module 720 .

[0233] The interface display module 710 is used to display a live broadcast interface, wherein the live broadcast interface includes live broadcast interactive content, wherein the live broadcast interactive content includes controlled elements, and the controlled elements are elements in the live broadcast interactive content whose status is to be controlled;

[0234] The data acquisition module 720 is used to collect performance audio during the process of displaying the live interactive content on the live interface, where the performance audio is audio data acquired by the terminal in the form of a performance;

[0235] The interface display module 710 is used to display the state change result of the controlled element in the live interactive content on the live interface when the performance quality of the audio performance meets the preset quality requirements. The state change result of the controlled element is used to determine the content direction of the live interactive content.

[0236] In some embodiments, the live broadcast interface includes performance instruction information, and the performance instruction information is used to indicate that the first work is performed in a first performance form; the data acquisition module 720 is used to collect performance audio matching the first work during the process of displaying the live interactive content on the live broadcast interface, and the performance audio is audio data collected by the terminal when the first work is performed in the first performance form.

[0237] In some embodiments, the method is executed by an audience terminal device, in which an audience account is logged in, and the live interactive content is live content provided by the anchor account; the data acquisition module 720 is used to display the performance invitation information sent by the anchor account during the process of displaying the live interactive content on the live interface, and the performance invitation information includes the performance instruction information, and the performance invitation information is used to invite the audience account to perform according to the performance instruction information; when a trigger operation is received on the performance entrance in the performance invitation information, performance audio matching the first work is collected.

[0238] In some embodiments, the performance instruction information is used to indicate the performance of the first audio work in the form of singing; the data acquisition module 720 is used to play the accompaniment audio of the first audio work while the live interactive content is displayed on the live interface; and in the process of playing the accompaniment audio of the first audio work, collect the performance audio matching the first work.

[0239] In some embodiments, the first audio work includes multiple work segments; the performance audio refers to multiple audio segments that match the multiple work segments; or, the performance audio refers to a specified audio segment that matches a specified work segment among the multiple work segments.

[0240] In some embodiments, the interface display module 710 is used to display the state change result of the controlled element under the control of the target control instruction in the live broadcast interface when the performance quality of the performance audio meets the preset quality requirements, and the state change result is related to the instruction content of the target control instruction.

[0241] In some embodiments, the target control instruction is associated with a target barrage; the interface display module 710 is used to trigger the playback of the target barrage in the live broadcast interface when the performance quality of the presentation audio meets the preset quality requirements.

[0242] In some embodiments, the live interactive content corresponds to multiple candidate control instructions; the interface display module 710 is used to scroll and display the barrage content corresponding to the multiple candidate control instructions at a preset scrolling frequency during the process of the terminal collecting the performance audio; when the performance audio collection is completed, stop scrolling the barrage content corresponding to the multiple candidate control instructions, wherein the barrage content corresponding to the first candidate control instruction is displayed at the first display position when the scrolling display stops; when the performance quality of the performance audio meets the preset quality requirement, the barrage content corresponding to the first candidate control instruction is played on the live interface as the target barrage.

[0243] In some embodiments, the target control instruction is associated with a target gift; the interface display module 710 is used to trigger the playing of a gift giving special effect corresponding to the target gift in the live broadcast interface when the performance quality of the presentation audio meets the preset quality requirements.

[0244] In some embodiments, the situation where the performance quality of the audio performance meets the preset quality requirement includes at least one of the following situations:

[0245] The performance score of the performance audio is greater than a preset score;

[0246] The recording quality of the performance audio meets the preset noise requirement;

[0247] The performance difficulty coefficient of the performance audio is greater than the preset difficulty coefficient.

[0248] In some embodiments, the live interactive content includes a live game; the state change result of the controlled element includes the number of target game elements generated; the number of target game elements generated is positively correlated with the performance quality of the performance audio; or, the state change result of the controlled element includes the influence range of the target game element; the influence range of the target game element is positively correlated with the performance quality of the performance audio.

[0249] In summary, in the live interactive device provided by the embodiment of the present application, when the live interface displays the live interactive content, the audience can make sounds in the form of performance, and the terminal will collect the performance audio of the audience's performance. When the quality of the performance audio meets the quality requirements, the controlled elements in the live interactive content can be triggered to change their states. The audience triggers the change of controlled elements through performance, so there is no need to remember complex control instructions, which avoids the tedious process of the audience needing to learn and remember specific barrage instructions and then send barrages in related technologies, thereby improving the efficiency of human-computer interaction. In addition, by making sounds in the form of audience performances to control the state of the controlled elements in the live interactive content, the audience's sense of participation and the interactivity of the live interactive content are enhanced, thereby improving the attractiveness of the live broadcast and the audience's retention rate.

[0250] Please refer to Figure 8 , which shows a block diagram of a computer device 800 provided in one embodiment of the present application. The computer device 800 may be Figure 1 The anchor terminal device shown can also be Figure 1 The audience terminal device shown can also be Figure 1 The server shown is used to implement the live interactive method provided in the above embodiment. Specifically:

[0251] Typically, the computer device 800 includes a processor 810 and a memory 820 .

[0252] The processor 810 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 810 may be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 810 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 810 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 810 may also include an AI processor, which is used to process computing operations related to machine learning.

[0253] The memory 820 may include one or more computer-readable storage media, which may be non-transitory. The memory 820 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 820 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned live interactive method.

[0254] Those skilled in the art will understand that Figure 8 The structure shown in the figure does not constitute a limitation on the computer device 800, and the computer device 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different arrangement of components.

[0255] In an exemplary embodiment, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned live interactive method is implemented. Optionally, the computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid state drive (SSD) or an optical disk, etc. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM).

[0256] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the live interactive method.

[0257] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0258] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A live interactive method, characterized in that: The method comprises: Displaying a live broadcast interface, wherein the live broadcast interface includes live broadcast interactive content, wherein the live broadcast interactive content includes controlled elements, and the controlled elements are elements in the live broadcast interactive content whose status is to be controlled; In the process of displaying the live interactive content on the live interface, collecting performance audio, where the performance audio is audio data acquired by the terminal in the form of a performance; When the performance quality of the audio performance meets the preset quality requirements, the state change result of the controlled element in the live interactive content is displayed on the live interface, and the state change result of the controlled element is used to determine the content direction of the live interactive content.

2. The method according to claim 1, characterized in that The live broadcast interface includes performance instruction information, and the performance instruction information is used to instruct to perform the first work in a first performance form; In the process of displaying the live interactive content on the live interface, collecting the performance audio includes: During the process of displaying the live interactive content on the live interface, performance audio matching the first work is collected, where the performance audio is audio data collected by the terminal when the first work is performed in the first performance form.

3. The method according to claim 2, characterized in that The method is performed by a viewer terminal device, a viewer account is logged into the viewer terminal device, and the live interactive content is the live content provided by the anchor account; In the process of displaying the live interactive content on the live interface, collecting the performance audio includes: During the process of displaying the live interactive content on the live interface, displaying the performance invitation information sent by the anchor account, wherein the performance invitation information includes the performance instruction information, and the performance invitation information is used to invite the audience account to perform according to the performance instruction information; When a trigger operation on a performance entry in the performance invitation information is received, performance audio matching the first work is collected.

4. The method according to claim 2, characterized in that: The performance instruction information is used to instruct to perform the first audio work in the form of singing; In the process of displaying the live interactive content on the live interface, collecting the performance audio includes: During the process of displaying the live interactive content on the live interface, playing the accompaniment audio of the first audio work; During the process of playing the accompaniment audio of the first audio work, performance audio matching the first work is collected.

5. The method according to claim 4, characterized in that The first audio work includes a plurality of work segments; The performance audio refers to a plurality of audio segments that match the plurality of work segments; or, the performance audio refers to a specified audio segment that matches a specified work segment among the plurality of work segments.

6. The method according to any one of claims 1 to 5, characterized in that: When the performance quality of the audio performance meets the preset quality requirement, displaying the state change result of the controlled element in the live interactive content on the live interface includes: When the performance quality of the audio performance meets the preset quality requirement, the state change result of the controlled element under the control of the target control instruction is displayed on the live broadcast interface, and the state change result is related to the instruction content of the target control instruction.

7. The method according to claim 6, characterized in that The target control instruction is associated with the target barrage; The method further comprises: When the performance quality of the performance audio meets the preset quality requirement, the target barrage is triggered to be played in the live broadcast interface.

8. The method according to claim 7, characterized in that The live interactive content corresponds to a plurality of candidate control instructions; When the performance quality of the audio performance meets the preset quality requirement, before triggering the playing of the target barrage in the live broadcast interface, the method further includes: In the process of the terminal collecting the performance audio, scrolling and displaying the bullet screen contents corresponding to the multiple candidate control instructions respectively at a preset scrolling frequency; When the performance audio collection is finished, the scrolling display of the bullet screen contents corresponding to the multiple candidate control instructions is stopped, wherein the bullet screen contents corresponding to the first candidate control instruction are displayed at the first display position when the scrolling display is stopped; When the performance quality of the audio performance meets the preset quality requirement, triggering the playing of the target bullet screen in the live broadcast interface includes: When the performance quality of the performance audio meets the preset quality requirement, the barrage content corresponding to the first candidate control instruction is played on the live broadcast interface as the target barrage.

9. The method according to claim 6, characterized in that The target control instruction is associated with the target gift; The method further comprises: When the performance quality of the performance audio meets the preset quality requirement, the gift giving special effect corresponding to the target gift is triggered and played in the live broadcast interface.

10. The method according to any one of claims 1 to 5, characterized in that: The situation where the performance quality of the audio performance meets the preset quality requirement includes at least one of the following situations: The performance score of the performance audio is greater than a preset score; The recording quality of the performance audio meets the preset noise requirement; The performance difficulty coefficient of the performance audio is greater than the preset difficulty coefficient.

11. The method according to any one of claims 1 to 5, characterized in that: The live interactive content includes live games; The state transformation result of the controlled element includes the number of generated target game elements; the number of generated target game elements is positively correlated with the performance quality of the performance audio; or, The state transformation result of the controlled element includes the influence range of the target game element; the influence range of the target game element is positively correlated with the performance quality of the performance audio.

12. A live interactive device, characterized in that: The device comprises: An interface display module, used for displaying a live broadcast interface, wherein the live broadcast interface includes live broadcast interactive content, wherein the live broadcast interactive content includes controlled elements, and wherein the controlled elements are elements in the live broadcast interactive content whose status is to be controlled; A data acquisition module, used for collecting performance audio during the process of displaying the live interactive content on the live interface, wherein the performance audio is audio data acquired by the terminal in the form of a performance; The interface display module is used to display the state change result of the controlled element in the live interactive content on the live interface when the performance quality of the audio performance meets the preset quality requirements. The state change result of the controlled element is used to determine the content direction of the live interactive content.

13. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the live interactive method as described in any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: The storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the live interactive method as described in any one of claims 1 to 11.

15. A computer program product, characterized in that It includes a computer program, which, when executed by a processor, implements the live interactive method as described in any one of claims 1 to 11.

Images