Live broadcast content display method and device, equipment, medium and program product

Abstract

The invention discloses a live broadcast content display method and device, equipment, a medium and a program product, and relates to the technical field of live broadcast, and the method comprises the following steps: displaying live broadcast content, the live broadcast content being multimedia content displayed in a live broadcast interface, the multimedia content comprising controlled elements, and the controlled elements being expression elements whose states are to be controlled; collecting a first voice instruction in the process of displaying the live broadcast content; the controlled element in the live broadcast content is displayed to perform state conversion based on the first voice instruction, and the state conversion result of the controlled element is related to the instruction content corresponding to the first voice instruction. According to the embodiment of the invention, the controlled element in the live broadcast content can be controlled based on the instruction content corresponding to the voice instruction by collecting the voice instruction input by the user, so that the problem of singleness of a live broadcast interaction mode is solved, the man-machine interaction efficiency is improved, and the efficiency of controlling the controlled element in the live broadcast content is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of live broadcast technology, and in particular to a method, device, equipment, medium and program product for displaying live broadcast content. Background Art

[0002] Live barrage games are a new interactive method that allows viewers to send barrages to participate in the interaction in the live broadcast room, and then control the game process and screen in the live broadcast room. By sending barrages, viewers can influence the direction of the game in real time, making the live broadcast content richer and more interesting.

[0003] In the related art, the user inputs specific text instructions (i.e., bullet screen) to interact with the game server. The server parses the text instructions and determines the control operation of the game, such as moving a character, firing a weapon, or triggering a specific event.

[0004] However, the gameplay of participating in the game by inputting text is relatively simple and lacks diversified interactive methods. In addition, the user input speed directly affects the control efficiency of the game. In game scenarios that require quick response, users with slow typing speeds may not be able to participate in time, and the human-computer interaction efficiency is low. Summary of the invention

[0005] The embodiments of the present application provide a method, device, equipment, medium and program product for displaying live content, which can control the progress of live content by inputting voice commands, thereby improving the efficiency of human-computer interaction. The technical solution is as follows:

[0006] In one aspect, a method for displaying live content is provided, the method comprising:

[0007] Displaying live content, wherein the live content is multimedia content displayed in a live interface, wherein the multimedia content includes controlled elements, and the controlled elements are presentation elements whose states are to be controlled;

[0008] Collecting a first voice command during the process of displaying the live content;

[0009] The controlled element in the live broadcast content is displayed to undergo a state change based on the first voice instruction, wherein a state change result of the controlled element is related to instruction content corresponding to the first voice instruction.

[0010] In another aspect, a live content display device is provided, the device comprising:

[0011] A display module is used to display live content, where the live content is multimedia content displayed in a live interface, and the multimedia content includes controlled elements, which are expression elements whose states are to be controlled;

[0012] A collection module, used for collecting a first voice command during the process of displaying the live content;

[0013] The display module is further used to display the state change of the controlled element in the live content based on the first voice instruction, wherein the state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

[0014] In an optional embodiment, the device further comprises:

[0015] A conversion module, used to convert the first voice instruction into text to obtain instruction content corresponding to the first voice instruction;

[0016] The display module is also used to display a first bullet screen in the live broadcast interface, wherein the first bullet screen includes instruction content corresponding to the first voice instruction.

[0017] In an optional embodiment, the display module is also used to display a second barrage in the live broadcast interface, wherein the second barrage includes instruction content corresponding to a second voice instruction, wherein the second moment when the second voice instruction is collected is after the first moment when the first voice instruction is collected; the display positions of the first barrage and the second barrage in the live broadcast interface are determined based on the first moment and the second moment.

[0018] In an optional embodiment, the display module is further used to display the state change of the controlled element based on the instruction content corresponding to the second voice instruction when the state change of the controlled element based on the first voice instruction is completed.

[0019] In an optional embodiment, the display module is also used to display a third barrage in the live broadcast interface in response to receiving a copy operation on the first barrage, the copy operation is used to control the controlled element in the live broadcast content to change its state again based on the instruction content corresponding to the first voice instruction, and the third barrage is the same as the first barrage; when the state change of the controlled element based on the first voice instruction is completed, the controlled element is displayed to change its state again based on the instruction content corresponding to the first voice instruction.

[0020] In an optional embodiment, the display module is further used to display voice collection function prompt information when the live broadcast interface starts to load the live broadcast content, and the voice collection function prompt information is used to indicate to turn on the voice collection function of the live broadcast interface;

[0021] The acquisition module is further used to collect the first voice instruction during the process of displaying the live content in response to turning on the voice acquisition function.

[0022] In an optional embodiment, the conversion module is also used to perform text conversion on the first voice instruction to obtain the text content of the first voice instruction; obtain multiple preset keywords, and there is a corresponding relationship between the multiple keywords and the multiple instruction contents, the i-th keyword among the multiple keywords corresponds to the i-th instruction content among the multiple instruction contents, and i is a positive integer; in response to the matching degree between the first keyword among the multiple keywords and the text content reaching a preset matching degree threshold, determine the instruction content corresponding to the first keyword as the instruction content corresponding to the first voice instruction.

[0023] In an optional embodiment, the conversion module is also used to split the text content of the first voice instruction into at least one word; calculate the matching degree between the at least one word and the multiple keywords respectively, and obtain the matching result corresponding to the text content; in response to the indication in the matching result that the matching degree between the first word in the at least one word and the first keyword in the multiple keywords reaches the preset matching degree threshold, determine the instruction content corresponding to the first keyword as the instruction content corresponding to the first voice instruction.

[0024] In an optional embodiment, the live broadcast interface includes a voice collection control;

[0025] The acquisition module is also used to acquire the first voice instruction in response to receiving a trigger operation on the voice acquisition control during the display of the live content; or, in response to receiving a sliding operation on the live interface and the sliding trajectory of the sliding operation meets the preset voice acquisition conditions during the display of the live content, to acquire the first voice instruction.

[0026] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement a live content display method as described in any of the above-mentioned embodiments of the present application.

[0027] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement a live content display method as described in any of the above-mentioned embodiments of the present application.

[0028] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the live content display method described in any of the above embodiments.

[0029] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0030] The controlled elements in the live content can change their states according to the voice commands input by the user, so that the user can participate in the interaction and control the progress and direction of the live content while watching the live broadcast, which improves the fun of watching the live content. By collecting the voice commands input by the user and controlling the controlled elements in the live content based on the command content corresponding to the voice commands, compared with the method in the related art where the user controls the live content by inputting text commands, this method can solve the problem of the single interactive method of the live broadcast, and make the control process unaffected by the user's text input speed, thereby improving the efficiency of human-computer interaction and the efficiency of controlling the controlled elements in the live content. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0032] Figure 1 is a schematic diagram of a live content display system provided by an exemplary embodiment of the present application;

[0033] Figure 2 is a flow chart of a live content display method provided by an exemplary embodiment of the present application;

[0034] Figure 3 is a schematic diagram of collecting voice commands through controls provided by an exemplary embodiment of the present application;

[0035] Figure 4 is a flowchart of a live content display method provided by another exemplary embodiment of the present application;

[0036] Figure 5 is a flowchart of a live content display method provided by another exemplary embodiment of the present application;

[0037] Figure 6 is a structural block diagram of a live content display device provided by an exemplary embodiment of the present application;

[0038] Figure 7 is a structural block diagram of a live content display device provided by another exemplary embodiment of the present application;

[0039] Figure 8 It is a structural block diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0040] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0041] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0042] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0043] It should be noted that the information and data involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0044] It should be understood that, although the terms first, second, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first parameter may also be referred to as the second parameter, and similarly, the second parameter may also be referred to as the first parameter. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0045] First, a brief introduction is given to the terms involved in the embodiments of this application:

[0046] Live barrage games: Live barrage games are a new form of live broadcasting that allows viewers to participate in and influence the progress of the game by sending text barrages or giving gifts in the live broadcast room. When the anchor broadcasts the barrage game, he guides the audience to help them understand the rules of the game, so that the audience can send barrages that comply with the rules of the game to control the direction of the game.

[0047] For example, the anchor starts a shooting barrage game during a live broadcast. Users can see the barrage game screen when they enter the live broadcast room to watch the live broadcast. During the running of the barrage game, the anchor does not directly operate the barrage game, but introduces the rules of the game to the audience through oral broadcasting or setting prompt information, and the audience controls the game progress based on the game rules.

[0048] The host explains the rules of the game in the live broadcast room, or sets up permanent text prompt information in the live broadcast room. The text prompt information is used to introduce the rules of the game: the audience sends bullet screens containing specified keywords in the live broadcast room, and the server controls the game process according to the bullet screen input by the user, so that the game runs in the manner indicated by the bullet screen. Among them, the way the host sets the text prompt information is related to the live broadcast content directly displayed in the live broadcast room. If the host uses the terminal screen image used when starting the live broadcast as the live broadcast content, the text prompt information can be the text prompt information displayed on the screen; if the live broadcast content when the host starts the live broadcast is the screen of the host running the bullet screen game through the terminal in a real scene, the text prompt information can be the text information displayed by the host through physical media, for example, the user sets up physical media such as posters or banners in the live broadcast scene, and there is text introducing the rules of the game on the physical media.

[0049] Controlled elements: refers to the performance elements in the live content whose status is to be controlled. The controlled elements include at least one of the elements such as text, image, sound, animation, etc., which can be integrated and controlled to achieve specific performance tasks or provide interactive experience for users. During the live broadcast process, the server will convert the status of the controlled elements according to the received instructions.

[0050] For example, in a live barrage game, the controlled elements can be virtual characters, virtual props, virtual items, virtual pets, buildings in virtual scenes, game background audio, redeemable virtual resources, etc. that appear in the game screen.

[0051] For example, when broadcasting a live video channel, the controlled elements may be a list of playable programs in the video channel, the background style of the video channel, the picture specifications when playing the video content (the ratio of the picture height to the width), the playback status of the video content (pause and play), etc.

[0052] For example, when broadcasting teaching content live, the controlled elements may be the page number of the electronic teaching courseware, the proportion of the electronic teaching courseware and the host in the live broadcast screen, the volume of the host's teaching, the content displayed in the custom display area (the content in this area is input or modified by the audience), etc.

[0053] Barrage command: The text barrage sent by the audience through the terminal when watching live content. When the text barrage contains preset keywords, it means that the text barrage has the effect of controlling the controlled elements. At this time, the text barrage sent by the audience acts as a barrage command to control the controlled elements in the live content.

[0054] For example, in a live barrage game, the controlled element refers to the main virtual character in the game. The audience inputs barrage 1 containing the keyword "shooting". Barrage 1, as a barrage instruction, can control the virtual character in the barrage game to perform shooting tasks; input barrage 2 containing the keyword "join camp A" or barrage 3 containing the keyword "join camp B", the server will count the number of the two types of barrages. If the counted number of barrage 2 containing the keyword "join camp A" is greater, the virtual character in the barrage game is controlled to join camp A to carry out activities; if the counted number of barrage 3 containing the keyword "join camp B" is greater, the virtual character in the barrage game is controlled to join camp B to carry out activities.

[0055] Live barrage games provide a novel audience participation mechanism, allowing viewers to participate in and influence the game process and screen of the live broadcast room by sending real-time barrages. This participation method not only enhances the richness and fun of the live broadcast content, but also provides viewers with a new interactive experience through a real-time feedback mechanism.

[0056] In related technologies, viewers can interact with the game server by inputting specific text instructions, namely bullet screens. After receiving the text instructions, the server will parse and execute corresponding control operations, such as moving game characters, firing weapons, triggering specific events, etc. This mechanism allows viewers to indirectly control the progress of the game through bullet screen input without directly operating the game.

[0057] However, the above interaction methods are relatively simple, and users need to interact with the game server by typing specific text instructions. The speed at which users input text directly affects the efficiency of controlling the game. In game scenarios that require quick reactions, users with slow typing speeds may not be able to participate in time, resulting in low human-computer interaction efficiency.

[0058] The present application provides a method for displaying live content, which can control the game process by inputting voice commands in the scenario of live broadcast of barrage games, control the live content based on the command content indicated by the voice commands, and improve the efficiency of human-computer interaction.

[0059] Next, the live content display system involved in the embodiment of the present application is described. For illustration, please refer to Figure 1 The system includes a first client 110, a server 120, and a second client 130.

[0060] There is a communication connection between the first client 110 , the server 120 , and the second client 130 .

[0061] The first client 110 is a user terminal for watching live broadcasts, and the second client 130 is a host terminal for starting live broadcasts. The first client 110 displays a live broadcast interface corresponding to the first live broadcast room, which is a live broadcast room when the second client 130 broadcasts live. Multimedia content is displayed in the live broadcast interface, and the server 120 is used to control the progress and direction of the multimedia content.

[0062] This embodiment is described by taking the multimedia content as a bullet screen game, and the game screen of the bullet screen game is displayed in the live broadcast interface. The server end 120 provides support for the operation of the bullet screen game.

[0063] Multimedia content contains controlled elements, which are presentation elements whose states are to be controlled. Controlled elements include at least one of text, image, sound, animation, etc., and can be integrated and controlled to achieve specific presentation tasks or provide users with interactive experience. During the live broadcast process, the server will convert the state of the controlled elements according to the received instructions.

[0064] For example, the multimedia content is a bullet-hell game with shooting as its theme, and the controlled elements include virtual characters, virtual props, virtual items, virtual pets, buildings in virtual scenes, game background audio, redeemable virtual resources, game screen style, etc. that appear in the game screen.

[0065] For example, the multimedia content is the film and television content played by a certain film and television channel, and the controlled elements can be the list of playable programs in the film and television channel, the background style of the film and television channel (the style of the background part of the live screen except the film and television content), the picture specifications when playing the film and television content (the ratio of the height and width of the film and television content in the live screen), the playback status of the film and television content (pause and play), etc.

[0066] For example, multimedia content is the knowledge content of the host's live teaching, and the controlled elements can be the page number of the electronic teaching courseware, the proportion of the electronic teaching courseware and the host in the live broadcast screen, the volume of the host's teaching, the content displayed in the custom display area (the content in this area is input or modified by the audience), etc.

[0067] During the live broadcast process, when the voice collection function is turned on in the live broadcast interface, the first client 110 collects the voice command input by the user and parses the voice command to obtain the command content corresponding to the voice command. The first client 110 sends the command content corresponding to the voice command to the server 120, and the server 120 responds to the command content and controls the state of the controlled element to change.

[0068] The controlled elements displayed in the first client 110 and the second client 130 change their states based on the voice command.

[0069] In some embodiments, after the first client 110 collects the voice command, it converts the voice command into text to obtain the command content corresponding to the voice command, and the command content is expressed as text content, and the command content is displayed in the form of bullet screen in the live broadcast interface of the first client 110. This allows the user to input text bullet screen in the live broadcast interface by inputting voice audio, control the controlled elements in the live broadcast content, and improve the efficiency of human-computer interaction.

[0070] The first client 110 and the second client 130 may be clients running on various terminal devices such as mobile phones, tablet computers, desktop computers, portable laptops, smart TVs, vehicle-mounted terminals, smart home devices, etc., and the embodiments of the present application are not limited to this.

[0071] It is worth noting that the above-mentioned server end 120 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), as well as big data and artificial intelligence platforms.

[0072] Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other resources in a wide area network or local area network to realize data computing, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which is used on demand and flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately. All kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

[0073] In some embodiments, the above server can also be implemented as a node in a blockchain system.

[0074] In combination with the above-mentioned noun introduction and application scenarios, the live content display method provided by the present application is described. The method can be executed by a server or a terminal, or can be executed by a server and a terminal together. In the embodiment of the present application, the method is described by taking the execution of the terminal as an example. Figure 2 As shown, Figure 2 FIG. 1 is a flow chart of a method for displaying live content provided by an exemplary embodiment of the present application. The method comprises the following steps.

[0075] Step 210: display the live content.

[0076] The live broadcast content is the multimedia content displayed in the live broadcast interface. The multimedia content includes controlled elements, and the controlled elements are performance elements whose status is to be controlled.

[0077] Optionally, the types of live content include but are not limited to the following: 1. Game live broadcast: the host plays games in the live broadcast, and the audience can watch the game process and participate in the interaction; 2. Education live broadcast: including online courses, lectures, seminars, etc. for teaching and learning; 3. Sports live broadcast: live broadcast of sports events, such as football, basketball, tennis, etc.; 4. Music live broadcast: musicians or bands perform live, and the audience can watch online; 5. News live broadcast: real-time reporting of news events and providing the latest information; 6. Virtual live broadcast: using virtual images or characters for live broadcast.

[0078] Exemplarily, the live broadcast content is a live broadcast of a bullet screen game as an example for explanation. The game screen is displayed in the live broadcast interface, and the controlled elements in the multimedia content are the elements in the bullet screen game.

[0079] Among them, the controlled elements include at least one of the following elements: (1) virtual characters: virtual characters can be controlled to move, perform actions, switch character states, etc.; (2) virtual props: virtual props can be controlled to realize prop functions, such as virtual shooting props with shooting functions, virtual shoe props that assist virtual characters to move positions; (3) virtual items: virtual items can be used by other virtual elements (such as virtual characters) as decorations in the picture; (4) virtual pets: virtual pets can be controlled to move, interact with virtual characters, etc.; (5) scene elements: used to form virtual scenes, such as building elements, ground elements, plant elements, and meteorological elements; (6) game background audio; (7) virtual resources: virtual resources can be used in redemption events, in which virtual resources are consumed in exchange for other elements, or other elements are sold in exchange for virtual resources, etc.

[0080] For example, the live broadcast content is a shooting bullet screen game, and the live broadcast content contains a first controlled element and a second controlled element. The first controlled element is a main virtual character, and the second controlled element is a virtual shooting prop. When the text bullet screen appears in the live broadcast interface and meets the control requirements of the controlled elements, the main virtual character is controlled based on the text bullet screen to equip the virtual shooting prop to perform shooting actions in the game, and the virtual shooting prop realizes the prop function. In some embodiments, when broadcasting a bullet screen game, the user can also control the game process by giving gifts (resources). For example, a variety of resource options are displayed in the live broadcast interface, and each resource option corresponds to a state transition result of the controlled element. After receiving a selection operation for the first resource among the multiple resource options, the controlled element is controlled based on the state transition result corresponding to the first resource.

[0081] For example, the barrage game is a home building game, the controlled element is the home background element, and the first resource that the user gives to the live broadcast room is "flowers". The state conversion result corresponding to the first resource is displayed on the game screen: the home appearance adds flower special effects.

[0082] The text barrage that appears in the live broadcast interface is sent by the user through the client. The client displays the live broadcast interface, receives the text input operation to obtain the text barrage, and displays the text barrage in the live broadcast interface.

[0083] Exemplarily, taking the live broadcast content as live teaching knowledge as an example, the live broadcast interface displays the host's teaching screen as multimedia content, and the controlled elements in the multimedia content are elements related to the live broadcast teaching progress and the teaching knowledge content.

[0084] Among them, the controlled elements include at least one of the following elements: (1) electronic teaching courseware page number: teaching courseware in the form of an e-book is displayed in the live broadcast content, and the teaching courseware can be controlled to turn pages or jump to a specified page number; (2) the proportion of electronic teaching courseware and anchor in the screen: when the anchor is teaching in person, the anchor and the electronic teaching courseware occupy some screen space in the screen respectively, and the size of the electronic teaching courseware or anchor in the screen can be controlled to change. For example, the proportion of electronic teaching courseware and anchor in the screen is 1:1, and the proportion is adjusted to 3:1; (3) the volume of the anchor teaching: the volume of the anchor's voice can be increased or decreased; (4) the content displayed in the custom display area (the content in this area is input or modified by the audience), for example, the custom display area is the area where the audience and the anchor interact online. When the audience demonstrates or answers questions online, they can upload answers by inputting text, drawing, handwriting, etc. in the custom display area. The content in the custom display area is presented to all viewers and anchors in the live broadcast room.

[0085] Step 220: collecting a first voice command during the process of displaying the live content.

[0086] Optionally, the methods for collecting the first voice command include but are not limited to the following:

[0087] 1. Collecting voice commands through controls: The live broadcast interface includes a voice collection control. During the display of the live broadcast content, in response to receiving a trigger operation on the voice collection control, a first voice command is collected.

[0088] For example, after the voice collection control is triggered, the voice content input by the user is collected as the first voice instruction, and the first voice instruction includes an audio with a duration of 3 seconds.

[0089] 2. Collecting voice commands through operation gestures: In the process of displaying live content, in response to receiving a sliding operation on the live interface and the sliding trajectory of the sliding operation meets the preset voice collection conditions, a first voice command is collected.

[0090] Exemplarily, the preset voice collection condition refers to that the distance moved by the sliding track of the sliding operation in the first direction reaches a preset distance threshold. The first direction can be any direction within the plane where the live broadcast interface is located. For example, there are specified points A and B in the live broadcast interface, and the direction parallel to the straight line where A and B are located is the first direction. The preset distance threshold is 3 unit distances.

[0091] Optionally, after collecting the first voice instruction, the first voice instruction is converted into text to obtain instruction content corresponding to the first voice instruction.

[0092] The instruction content is text content, which includes the name of the controlled element that needs to undergo state change and the method of state control of the controlled element, and determines the state change result of the controlled element.

[0093] For example, the first voice instruction is the voice content input by the user: "Character A shoots", indicating that the controlled element is a virtual character, the name of the virtual character is A, and character A performs a shooting action.

[0094] Since there are at least one user watching the same live broadcast content, the collected voice commands are converted into barrages and displayed in the live broadcast interface, so that users can understand the control commands issued by other users watching the live broadcast content, determine the subsequent state change results of the controlled elements, and help users decide whether to issue voice commands and the type of voice commands.

[0095] Optionally, a first bullet screen is displayed in the live broadcast interface, and the first bullet screen includes instruction content corresponding to the first voice instruction.

[0096] Indicative, such as Figure 3 As shown, Figure 3 This is a schematic diagram of collecting voice commands through controls.

[0097] The live broadcast interface 300 displayed on the terminal screen includes a voice collection control 301. After the voice collection control 301 is triggered, the first voice command is immediately collected. The first voice command includes an audio of 3 seconds in length. The first voice command is converted into text to obtain the command content, and the first barrage 302 is displayed in the live broadcast interface 300 in the form of barrage.

[0098] In addition to the instruction content, the first bullet screen 302 also includes the time when the first voice instruction was collected and the audio duration corresponding to the first voice instruction. Figure 3 In the example, the time when the first voice command is collected is 12:00:00, and the audio duration corresponding to the first voice command is 3 seconds.

[0099] When the first barrage 302 displayed in the live broadcast interface 300 is triggered, the audio corresponding to the first voice command can be played.

[0100] Optionally, the process of obtaining the instruction content corresponding to the first voice instruction is as follows.

[0101] The first voice instruction is converted into text to obtain text content of the first voice instruction, where the text content is content obtained after converting the audio content into text.

[0102] A plurality of preset keywords are obtained, wherein the plurality of keywords respectively correspond to the plurality of instruction contents, the i-th keyword among the plurality of keywords corresponds to the i-th instruction content among the plurality of instruction contents, and i is a positive integer.

[0103] In response to a matching degree between a first keyword among the multiple keywords and the text content reaching a preset matching degree threshold, the instruction content corresponding to the first keyword is determined as the instruction content corresponding to the first voice instruction.

[0104] Exemplarily, after feature extraction is performed on the keywords and the text content, corresponding feature vectors are obtained, and the cosine similarity between the vectors is calculated as the matching degree between the keywords and the text content.

[0105] Methods for obtaining feature vectors include but are not limited to the following: (1) using a pre-trained model to extract features from the input keywords and text content respectively, and outputting feature vectors; the pre-trained model may be a BERT (Bidirectional Encoder Representations from Transformers) model, a Word2Vec (Word to Vector) model, or the like; (2) obtaining a vocabulary, which contains mapping relationships between multiple words and feature vectors, and using keywords and text content as index conditions to index corresponding feature vectors from the vocabulary.

[0106] In some embodiments, when the matching degree between the text content and the first keyword reaches the highest among the matching degrees between the text content and all the keywords, the instruction content corresponding to the first keyword is determined as the instruction content corresponding to the first voice instruction.

[0107] Exemplarily, the preset multiple keywords are as follows: join camp A, join camp B, attack, launch, upgrade, and send gifts.

[0108] The command contents corresponding to the above keywords are as follows: the command content corresponding to "join camp A" is to control the controlled element to join camp A, the command content corresponding to "join camp B" is to control the controlled element to join camp B, the command content corresponding to "attack" is to control the controlled element to perform attack actions, the command content corresponding to "launch" is to control the controlled element to perform launching actions, the command content corresponding to "upgrade" is to make the controlled element upgrade the game level, and the command content corresponding to "give gifts" is to display the animation of giving gifts in the live broadcast content.

[0109] For example, the first voice command is the collected user voice content, and the user voice command is expressed by human voice: "Camp A", then the first voice command is converted into text, and the obtained text content is "Camp A".

[0110] Among them, the preset matching threshold is 90%, and the matching degrees between the text content and the above-mentioned multiple keywords [Join camp A, Join camp B, Attack, Launch, Upgrade, Gift] are 90%, 50%, 20%, 20%, 10%, and 0% respectively. Then, the first keyword is "Join camp A", and the matching degree between it and the text content reaches the preset matching threshold, and the instruction content corresponding to "Join camp A" "Control the controlled element to join camp A" is determined as the instruction content corresponding to the first voice command.

[0111] In some embodiments, the text content contains multiple words. In order to improve the matching accuracy, the text content can be split and the matching degree between the keywords can be calculated separately.

[0112] Optionally, the text content of the first voice instruction is split into at least one word, and the matching degree between the at least one word and the multiple keywords is calculated to obtain the matching result corresponding to the text content.

[0113] In response to an indication in the matching result that the degree of match between the first word in at least one word and the first keyword in the multiple keywords reaches a preset matching threshold, the instruction content corresponding to the first keyword is determined as the instruction content corresponding to the first voice instruction.

[0114] For example, the text content of the first voice command is "character joins camp A", and the text content is split into three words: "character", "join", and "camp A".

[0115] The matching degrees between the above three words and the multiple keywords are calculated respectively, and it is determined that there is a first word "camp A", and the matching degree with "join camp A" in the multiple keywords reaches a preset matching degree threshold.

[0116] Step 230, displaying the state change of the controlled element in the live content based on the first voice command.

[0117] The state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

[0118] For example, the live broadcast content is a shooting bullet screen game, and the live broadcast content includes a first controlled element and a second controlled element, wherein the first controlled element is a main control virtual character and the second controlled element is a virtual shooting prop. The command content corresponding to the first voice command is as follows: "The main control virtual character uses the virtual shooting prop to attack", and when the command content corresponding to the first voice command is displayed in the form of bullet screen on the live broadcast interface, the main control virtual character in the live broadcast content is displayed to perform an attack action using the virtual shooting prop.

[0119] For example, the live broadcast content is a bullet screen game such as Gobang, and the controlled elements contained in the live broadcast content refer to the virtual chess pieces that have not landed on the chessboard. The command content corresponding to the first voice command is as follows: "3, 4", indicating that the virtual chess piece in the live broadcast content is moved to the third row and fourth column position on the virtual chessboard.

[0120] In summary, the live content display method provided by the present application is that the controlled elements in the live content can change their states according to the instructions input by the user, so that the user can participate in the interaction and control the progress and direction of the live content while watching the live broadcast, thereby improving the fun of the user when watching the live content. By collecting the voice instructions input by the user and controlling the controlled elements in the live content based on the instruction content corresponding to the voice instructions, compared with the method in the related art where the user controls the live content by inputting text instructions, this method can solve the problem of the singleness of the live interaction method, and make the control process unaffected by the user's text input speed, thereby improving the efficiency of human-computer interaction and the efficiency of controlling the controlled elements in the live content.

[0121] In some embodiments, the terminal can collect multiple voice commands and display the commands corresponding to the voice commands in the live broadcast interface in the form of bullet screens. Multiple bullet screens are displayed in the live broadcast interface according to the order in which the voice commands are collected, and the controlled elements are controlled to perform state transitions in the live broadcast content in sequence according to the voice commands. Figure 4 It is a flowchart of a live content display method provided by another exemplary embodiment of the present application.

[0122] Step 410, when the live broadcast interface starts to load the live broadcast content, the voice collection function prompt information is displayed.

[0123] The voice collection function prompt information is used to indicate that the voice collection function of the live broadcast interface is turned on. When the live broadcast interface starts to load live content, the voice collection function prompt information is displayed, indicating that the voice collection function of the current live broadcast interface has been turned on.

[0124] When the voice collection function is turned on, users can input voice commands to control the live broadcast content. The voice collection function can be turned on by the live broadcast end or by the user end that plays the live broadcast, or it can be turned on by default when entering the live broadcast interface.

[0125] Exemplarily, the host starts the live broadcast through the live broadcast terminal, and after selecting the live broadcast content, the live broadcast interface starts to load the live broadcast content. During the process of loading the live broadcast content, the host can operate the live broadcast terminal to manually start the voice collection function. When the voice collection function is successfully turned on, the voice collection function prompt information is displayed in the live broadcast interface, prompting the audience watching the live broadcast to send voice commands to participate in the interaction. In some embodiments, the host can set whether the voice collection function of the live broadcast interface is permanently turned on. When the voice collection function is configured to be permanently turned on, the voice collection function is turned on by default every time the host broadcasts live, and the voice collection function prompt information is immediately displayed when the live broadcast interface is turned on to load the live broadcast content.

[0126] Among them, the voice collection function can be turned off by the anchor at any time. When the anchor turns off the voice collection function, no audience can send voice commands. The audience can turn off their own voice collection function on the user side. At this time, the audience cannot send voice commands, but it does not affect the anchor and other audiences using the voice collection function to send voice commands. Exemplarily, the voice collection function prompt information and the corresponding confirmation control / rejection control are displayed in the live broadcast interface corresponding to the user side. The voice collection function prompt information is used to request the user side to open the voice collection permission. If a trigger operation of the confirmation control is received, the voice collection function of the user side is turned on; if a trigger operation of the rejection control is received, the voice collection function of the user side is turned off.

[0127] Step 420, display the live content.

[0128] The live broadcast content is the multimedia content displayed in the live broadcast interface. The multimedia content includes controlled elements, and the controlled elements are the performance elements whose status is to be controlled.

[0129] Taking the live broadcast content of the bullet-chasing game as an example, the controlled elements refer to the elements in the game, including but not limited to virtual characters, virtual props, and virtual elements that constitute the game screen. In the bullet-chasing game, the game process can be controlled by receiving voice commands / text commands input by the user, receiving virtual resources during the live broadcast, etc.

[0130] Step 430: collecting a first voice command during the process of displaying the live content.

[0131] In response to starting the voice collection function, a first voice instruction is collected during the process of displaying the live content.

[0132] Optionally, when the voice collection function is turned on, voice signals are collected in real time, and the voice signals include voice signals collected by the terminal playing the live content from the environment in which it is located.

[0133] The voice signal collected in real time is analyzed, the voice signal is divided into multiple sub-signals at intervals of preset time length, and the sound type and volume corresponding to each voice sub-signal are determined.

[0134] Exemplarily, a plurality of preset sound type reference samples are obtained, each sound type reference sample includes a signal waveform and an amplitude range obtained after collecting different types of sounds, and the plurality of preset sound type reference samples are respectively compared with the signal waveform of the speech sub-signal within a unit period, and a first candidate type sample corresponding to the speech sub-signal includes at least one sample having the same signal waveform shape as the speech sub-signal. Based on the amplitude range in which the speech sub-signal is located, the target sound type corresponding to the speech sub-signal is determined from the first candidate type sample, wherein the amplitude of the speech sub-signal is within the amplitude range of the target sound type.

[0135] When there is a voice sub-signal whose sound type is human voice and whose volume reaches a preset decibel threshold, the voice sub-signal is determined as the first voice command.

[0136] For example, when the voice collection function is turned on, the collected voice signal is divided into sub-signal 1, sub-signal 2, ..., sub-signal n (n is a positive integer) at intervals of 5 seconds.

[0137] The sound type of sub-signal 1 is meteorological sound (for example, natural meteorological sounds such as thunder, rain, and wind), and the sound type of sub-signal 2 is human voice.

[0138] The volume corresponding to sub-signal 2 is 45 decibels, reaching the preset decibel threshold of 40 decibels, and sub-signal 2 is determined as the first voice command.

[0139] Step 440: convert the first voice instruction into text to obtain instruction content corresponding to the first voice instruction.

[0140] The instruction content is text content obtained by converting the voice content in the first voice instruction, that is, the text content expressed by the human voice.

[0141] Exemplarily, the voice content (audio) in the first voice instruction is preprocessed to remove noise in the audio and improve the sound quality, thereby obtaining the preprocessed voice content. Feature extraction is performed on the preprocessed voice content based on the Fourier transform method to obtain the first voice feature. The first voice feature is input into a pretrained acoustic model, and the model converts the first voice feature into text content to obtain the instruction content corresponding to the first voice instruction.

[0142] Step 450, display the first bullet screen in the live broadcast interface.

[0143] Among them, the first barrage contains the instruction content and audio duration corresponding to the first voice instruction, and the first barrage is configured to play the audio corresponding to the first voice instruction after being triggered.

[0144] In some embodiments, the first bullet screen corresponds to an audio playback control, the audio playback control moves with the first bullet screen and is between the first bullet screen, or the audio playback control is used to carry the first bullet screen (that is, the positions of the first bullet screen and the audio playback control overlap), and the audio corresponding to the first voice can be played after the audio playback control is triggered. Alternatively, the audio playback control is located in the live broadcast interface, and after the audio playback control is triggered, the command audio corresponding to each bullet screen will be played in sequence according to the order of all bullet screens displayed in the current live broadcast interface.

[0145] Step 460, displaying the state change of the controlled element in the live content based on the first voice command.

[0146] The state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

[0147] Step 470, display the second bullet screen in the live broadcast interface.

[0148] The second bullet screen includes the instruction content corresponding to the second voice instruction. The second moment when the second voice instruction is collected is after the first moment when the first voice instruction is collected, and the display positions of the first bullet screen and the second bullet screen in the live broadcast interface are determined based on the first moment and the second moment.

[0149] The second voice instruction and the first voice instruction may be collected by the same user terminal or by different user terminals, and the instruction contents indicated by the first voice instruction and the second voice instruction may be the same or different.

[0150] Optionally, the live broadcast interface includes a barrage display area, which displays each barrage in a specified direction in the order of the command collection time corresponding to each barrage. The specified direction refers to the direction from the first position point in the barrage display area to the second position point in the barrage display area, and the first position point and the second position point are different.

[0151] For example, the live broadcast interface includes a bullet screen display area, which will display bullet screens from top to bottom in the order of the command collection time corresponding to each bullet screen. After entering the bullet screen display area, the bullet screen moves from bottom to top, and is cancelled when it reaches the top of the bullet screen display area. Alternatively, the bullet screen is displayed from right to left in the bullet screen display area in the order of the command collection time corresponding to each bullet screen; or, the bullet screen is displayed from left to right in the bullet screen display area in the order of the command collection time corresponding to each bullet screen; or, the bullet screen is displayed clockwise / counterclockwise in the bullet screen display area in the order of the command collection time corresponding to each bullet screen.

[0152] Step 480, when the state change of the controlled element based on the first voice instruction is completed, the state change of the controlled element based on the instruction content corresponding to the second voice instruction is displayed.

[0153] For example, the controlled element refers to the main virtual character in the game, the first voice command is collected at 12:00:11, and the command content corresponding to the first voice command is: "Equip virtual props". The second voice command is collected at 12:00:15, and the command content corresponding to the second voice command is: "Use virtual props to shoot".

[0154] Then, the live broadcast content displays a screen in which the master virtual character equips the virtual props based on the first voice command, and when the master virtual character is fully equipped, the master virtual character is displayed to perform a shooting action using the virtual props based on the second voice command.

[0155] In some embodiments, other barrages besides the first barrage and the second barrage are displayed in the live broadcast interface, and the other barrages correspond to the text instructions input by the user end, that is, after receiving the text instruction input operation, the text instruction is determined and displayed in the form of barrage in the live broadcast interface. Both text instructions and voice instructions are used to control the controlled elements to perform state transitions.

[0156] In some embodiments, when the controlled element changes state based on the instruction content corresponding to the first voice instruction, the first barrage is displayed in the live broadcast interface in a first style, and barrages other than the first barrage are displayed in a second style, and the first style and the second style are different.

[0157] When the controlled element completes the state change based on the first voice command, the first barrage is displayed in the second style. At this time, the controlled element changes its state based on the instruction content corresponding to the second voice command, and displays the first barrage in the first style in the live broadcast interface.

[0158] By distinctively displaying the voice command when the controlled element changes state based on the voice command, users watching the live content can be prompted with the current state of the controlled element and the situations in which a state transition is required subsequently.

[0159] To sum up, the live content display method provided by the present application can control the controlled elements in sequence based on the collected different voice commands, and quickly decide the control results of the state change of the controlled elements when multiple voice commands are received in a short time.

[0160] In some embodiments, the barrage displayed on the live broadcast interface can represent the corresponding instruction content. The terminal can receive a copy operation on the barrage and control the controlled elements to repeatedly switch to the corresponding state, thereby meeting the user's needs to send the same voice command multiple times in a short period of time. Figure 5 It is a flowchart of a live content display method provided by another exemplary embodiment of the present application.

[0161] Step 510: display the live content.

[0162] The live broadcast content is the multimedia content displayed in the live broadcast interface. The multimedia content includes controlled elements, and the controlled elements are the performance elements whose status is to be controlled.

[0163] Exemplarily, the live broadcast content is a barrage game, and the progress of the barrage game is controlled by voice commands or text commands input by the user.

[0164] Step 520: collecting a first voice command during the process of displaying the live content.

[0165] The terminal that plays the live content obtains a first voice instruction after collecting the voice content input by the user, and the first voice instruction includes human voice audio.

[0166] Step 530: convert the first voice instruction into text to obtain instruction content corresponding to the first voice instruction.

[0167] The instruction content is text content obtained by converting the voice content in the first voice instruction, that is, the text content expressed by the human voice.

[0168] Step 540, display the first bullet screen in the live broadcast interface.

[0169] Among them, the first barrage contains the instruction content corresponding to the first voice instruction and the audio duration of the first voice instruction, and the first barrage is configured to play the audio corresponding to the first voice instruction after being triggered.

[0170] In some embodiments, a plurality of bullet screens are displayed in the live broadcast interface, and the plurality of bullet screens correspond to text instructions and voice instructions input by the user. When the terminal receives a voice instruction or a text instruction input by the user, the instruction content corresponding to the instruction is displayed in the live broadcast interface in the form of bullet screens, wherein the bullet screen corresponding to the voice instruction can play the audio corresponding to the voice instruction after receiving a trigger operation.

[0171] Step 550, in response to receiving a copy operation on the first bullet screen, displaying a third bullet screen in the live broadcast interface.

[0172] Among them, the copy operation is used to control the controlled element in the live broadcast content to change its state again based on the instruction content corresponding to the first voice instruction, and the third barrage is the same as the first barrage.

[0173] Exemplarily, the live broadcast interface displays a first barrage and a second barrage from top to bottom in a preset order, the first barrage corresponds to the instruction content of the first voice instruction, and the second barrage corresponds to the instruction content of the second voice instruction, wherein the terminal collects the first voice instruction earlier than the terminal collects the second voice instruction.

[0174] When a copy operation of the first barrage is received, a third barrage is displayed in the live broadcast interface. The display position of the third barrage is located below the second barrage. The third barrage corresponds to the instruction content of the third voice instruction, and the third voice instruction is the same as the first voice instruction.

[0175] Exemplarily, the methods of receiving a copy operation on the first barrage include but are not limited to the following: (1) receiving a trigger operation on the first barrage, the trigger operation corresponds to a trigger duration or a trigger count, and when the trigger duration reaches a preset duration threshold, copying the first barrage to obtain a third barrage; or, when the trigger count reaches a preset count threshold within a preset time interval, copying the first barrage to obtain a third barrage; (2) receiving a drag operation on the first barrage, and obtaining a third barrage when the drag operation ends (when the user releases the hand), wherein the drag operation corresponds to a drag distance, and the drag distance refers to the distance between the start position and the end position of the drag operation, and the drag distance reaches a preset distance threshold; (3) the first barrage corresponds to a copy control, and the copy control is displayed following the first barrage, and a trigger operation on the copy control corresponding to the first barrage is received, and the first barrage is copied to obtain the third barrage.

[0176] By copying the existing barrage in the live broadcast interface, the repeated collection of voice commands can be achieved, which can satisfy the user's need to control the controlled elements to perform the same state transition in a short period of time. There is no need to repeatedly collect the voice commands input by the user, thereby improving the efficiency of human-computer interaction.

[0177] Step 560, displaying the state change of the controlled element in the live content based on the first voice command.

[0178] The state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

[0179] For example, the live broadcast content is a shooting bullet screen game, and the live broadcast content includes a first controlled element and a second controlled element, wherein the first controlled element is a main control virtual character and the second controlled element is a virtual shooting prop. The command content corresponding to the first voice command is as follows: "The main control virtual character uses the virtual shooting prop to attack", and when the command content corresponding to the first voice command is displayed in the form of bullet screen on the live broadcast interface, the main control virtual character in the live broadcast content is displayed to perform an attack action using the virtual shooting prop.

[0180] Step 570, when the controlled element has completed the state change based on the first voice instruction, the controlled element is displayed to change its state again based on the instruction content corresponding to the first voice instruction.

[0181] That is, after the controlled element completes the state change based on the voice command corresponding to the first barrage, the controlled element continues to be displayed to change its state based on the voice command corresponding to the third barrage. Since the first barrage is the same as the third barrage, the voice command corresponding to the first barrage is also the same as the voice command corresponding to the third barrage. Therefore, the state change of the controlled element based on the voice command corresponding to the third barrage is actually manifested as a repeated state change based on the command content corresponding to the first voice command.

[0182] To summarize, the method provided by the present application collects voice commands input by the user and controls the controlled elements in the live broadcast content based on the command content corresponding to the voice commands. Compared with the method in the related art where the user controls the live broadcast content by inputting text commands, this method can solve the problem of the single interactive method of the live broadcast, and make the control process unaffected by the user's text input speed, thereby improving the efficiency of human-computer interaction and the efficiency of controlling the controlled elements in the live broadcast content.

[0183] Figure 6 is a structural block diagram of a live content display device provided by an exemplary embodiment of the present application, such as Figure 6 As shown, the device includes the following parts.

[0184] The display module 610 is used to display live content, where the live content is multimedia content displayed in the live interface, and the multimedia content includes controlled elements, which are expression elements whose status is to be controlled;

[0185] A collection module 620 is used to collect a first voice command during the process of displaying the live content;

[0186] The display module 610 is further used to display the state change of the controlled element in the live content based on the first voice instruction, wherein the state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

[0187] In an optional embodiment, if Figure 7 As shown, the device also includes:

[0188] The conversion module 630 is used to convert the first voice instruction into text to obtain the instruction content corresponding to the first voice instruction;

[0189] The display module 610 is further used to display a first bullet screen in the live broadcast interface, wherein the first bullet screen includes instruction content corresponding to the first voice instruction.

[0190] In an optional embodiment, the display module 610 is also used to display a second barrage in the live broadcast interface, wherein the second barrage includes instruction content corresponding to a second voice instruction, wherein the second moment when the second voice instruction is collected is after the first moment when the first voice instruction is collected; the display positions of the first barrage and the second barrage in the live broadcast interface are determined based on the first moment and the second moment.

[0191] In an optional embodiment, the display module 610 is further used to display the state change of the controlled element based on the instruction content corresponding to the second voice instruction when the state change of the controlled element based on the first voice instruction is completed.

[0192] In an optional embodiment, the display module 610 is also used to display a third barrage in the live broadcast interface in response to receiving a copy operation on the first barrage, the copy operation is used to control the controlled element in the live broadcast content to change its state again based on the instruction content corresponding to the first voice instruction, and the third barrage is the same as the first barrage; when the state change of the controlled element based on the first voice instruction is completed, the controlled element is displayed to change its state again based on the instruction content corresponding to the first voice instruction.

[0193] In an optional embodiment, the display module 610 is further used to display a voice collection function prompt information when the live broadcast interface starts to load the live broadcast content, and the voice collection function prompt information is used to indicate to turn on the voice collection function of the live broadcast interface;

[0194] The collection module 620 is further configured to collect the first voice instruction in response to enabling the voice collection function during the process of displaying the live content.

[0195] In an optional embodiment, the conversion module 630 is also used to perform text conversion on the first voice instruction to obtain the text content of the first voice instruction; obtain multiple preset keywords, and there is a corresponding relationship between the multiple keywords and the multiple instruction contents, the i-th keyword among the multiple keywords corresponds to the i-th instruction content among the multiple instruction contents, and i is a positive integer; in response to the matching degree between the first keyword among the multiple keywords and the text content reaching a preset matching degree threshold, determine the instruction content corresponding to the first keyword as the instruction content corresponding to the first voice instruction.

[0196] In an optional embodiment, the conversion module 630 is also used to split the text content of the first voice instruction into at least one word; calculate the matching degree between the at least one word and the multiple keywords respectively, and obtain the matching result corresponding to the text content; in response to the indication in the matching result that the matching degree between the first word in the at least one word and the first keyword in the multiple keywords reaches the preset matching degree threshold, determine the instruction content corresponding to the first keyword as the instruction content corresponding to the first voice instruction.

[0197] In an optional embodiment, the live broadcast interface includes a voice collection control;

[0198] The acquisition module 620 is also used to acquire the first voice instruction in response to receiving a trigger operation on the voice acquisition control during the display of the live content; or, in response to receiving a sliding operation on the live interface and the sliding trajectory of the sliding operation meets the preset voice acquisition conditions during the display of the live content, to acquire the first voice instruction.

[0199] In summary, the live content display device provided by the present application can change the state of the controlled elements in the live content according to the instructions input by the user, so that the user can participate in the interaction and control the progress and direction of the live content while watching the live broadcast, thereby improving the interest of the user when watching the live content. By collecting the voice instructions input by the user and controlling the controlled elements in the live content based on the instruction content corresponding to the voice instructions, compared with the method in the related art where the user controls the live content by inputting text instructions, it can solve the problem of the singleness of the live interaction method, and make the control process unaffected by the user's text input speed, thereby improving the efficiency of human-computer interaction and the efficiency of controlling the controlled elements in the live content.

[0200] It should be noted that the live content display device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the live content display device provided in the above embodiment and the live content display method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0201] Figure 8 The block diagram of a computer device 800 provided by an exemplary embodiment of the present application is shown. The computer device 800 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3), an MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Compression Standard Audio Layer 4) player, a laptop computer or a desktop computer. The computer device 800 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0202] Typically, the computer device 800 includes a processor 801 and a memory 802 .

[0203] The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0204] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction, which is used to be executed by the processor 801 to implement the live content display method provided in the method embodiment of the present application.

[0205] In some embodiments, the computer device 800 further includes some other components 803, and the type and quantity of the other components 803 can be selected based on the functional requirements of the computer device 800. Those skilled in the art will appreciate that Figure 8 The structure shown in the figure does not constitute a limitation on the computer device 800, and the computer device 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different arrangement of components.

[0206] Optionally, the computer readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid state drive (SSD), or an optical disk. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM). The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0207] An embodiment of the present application also provides a computer device, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set, or an instruction set, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement a live content display method as described in any one of the above embodiments of the present application.

[0208] An embodiment of the present application also provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set or an instruction set is stored. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement a live content display method as described in any of the above embodiments of the present application.

[0209] The embodiment of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the live content display method described in any of the above embodiments.

[0210] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0211] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for displaying live content, characterized in that: The method comprises: Displaying live content, wherein the live content is multimedia content displayed in a live interface, wherein the multimedia content includes controlled elements, and the controlled elements are presentation elements whose states are to be controlled; Collecting a first voice command during the process of displaying the live content; The controlled element in the live broadcast content is displayed to undergo a state change based on the first voice instruction, wherein a state change result of the controlled element is related to instruction content corresponding to the first voice instruction.

2. The method according to claim 1, characterized in that After collecting the first voice instruction during the process of displaying the live content, the method further includes: Converting the first voice instruction into text to obtain instruction content corresponding to the first voice instruction; A first bullet screen is displayed in the live broadcast interface, wherein the first bullet screen includes instruction content corresponding to the first voice instruction.

3. The method according to claim 2, characterized in that After the controlled element in the live content is displayed to change state based on the first voice command, the method further includes: A second barrage is displayed in the live broadcast interface, wherein the second barrage includes instruction content corresponding to a second voice instruction, wherein the second moment when the second voice instruction is collected is after the first moment when the first voice instruction is collected, and the display positions of the first barrage and the second barrage in the live broadcast interface are determined based on the first moment and the second moment.

4. The method according to claim 3, characterized in that The method further comprises: When the state change of the controlled element based on the first voice instruction is completed, the state change of the controlled element based on the instruction content corresponding to the second voice instruction is displayed.

5. The method according to claim 2, characterized in that: After the first bullet screen is displayed in the live broadcast interface, the method further includes: In response to receiving a copy operation on the first bullet screen, displaying a third bullet screen in the live broadcast interface, wherein the copy operation is used to control the controlled element in the live broadcast content to change state again based on the instruction content corresponding to the first voice instruction, and the third bullet screen is the same as the first bullet screen; When the controlled element has completed the state change based on the first voice instruction, it is displayed that the controlled element has again changed its state based on the instruction content corresponding to the first voice instruction.

6. The method according to any one of claims 1 to 5, characterized in that: Before displaying the live content, the method further includes: When the live broadcast interface starts to load the live broadcast content, a voice collection function prompt information is displayed, wherein the voice collection function prompt information is used to indicate to start the voice collection function of the live broadcast interface; The collecting of the first voice command during the process of displaying the live content includes: In response to enabling the voice collection function, the first voice instruction is collected during the process of displaying the live content.

7. The method according to claim 2, characterized in that: The converting the first voice instruction into text to obtain instruction content corresponding to the first voice instruction includes: Converting the first voice command into text to obtain text content of the first voice command; Acquire a plurality of preset keywords, wherein the plurality of keywords respectively correspond to a plurality of instruction contents, the i-th keyword in the plurality of keywords corresponds to the i-th instruction content in the plurality of instruction contents, and i is a positive integer; In response to a first keyword among the multiple keywords having a matching degree between the text content reaching a preset matching degree threshold, the instruction content corresponding to the first keyword is determined as the instruction content corresponding to the first voice instruction.

8. The method according to claim 7, characterized in that In response to the matching degree between a first keyword among the plurality of keywords and the text content reaching a preset matching degree threshold, determining the instruction content corresponding to the first keyword as the instruction content corresponding to the first voice instruction includes: Splitting the text content of the first voice instruction into at least one word; Calculating the matching degree between the at least one word and the multiple keywords respectively, and obtaining the matching result corresponding to the text content; In response to the matching result indicating that the degree of match between a first word in the at least one word and the first keyword in the multiple keywords reaches the preset matching threshold, the instruction content corresponding to the first keyword is determined as the instruction content corresponding to the first voice instruction.

9. The method according to any one of claims 1 to 5, characterized in that: The live broadcast interface includes a voice collection control; The collecting of the first voice command during the process of displaying the live content includes: In the process of displaying the live content, in response to receiving a trigger operation on the voice collection control, collecting the first voice instruction; or, In the process of displaying the live broadcast content, in response to receiving a sliding operation on the live broadcast interface and a sliding track of the sliding operation meeting a preset voice collection condition, the first voice instruction is collected.

10. A live content display device, characterized in that: The device comprises: A display module is used to display live content, where the live content is multimedia content displayed in a live interface, and the multimedia content includes controlled elements, which are expression elements whose states are to be controlled; A collection module, used for collecting a first voice command during the process of displaying the live content; The display module is further used to display the state change of the controlled element in the live content based on the first voice instruction, wherein the state change result of the controlled element is related to the instruction content corresponding to the first voice instruction.

11. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the live content display method as described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The storage medium stores at least one program, and the at least one program is loaded and executed by the processor to implement the live content display method as described in any one of claims 1 to 9.

13. A computer program product, characterized in that It includes a computer program, which, when executed by a processor, implements the live content display method as described in any one of claims 1 to 9.

Images