Information determination method in live broadcast scene and related equipment

Abstract

The invention discloses an information determination method in a live broadcast scene and related equipment, and the method comprises the steps: receiving multimedia data sent by a live broadcast server, the multimedia data comprising audio data and video data, and the multimedia data being collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server; performing duration analysis processing on the audio data to obtain a first duration of each audio frame, and performing duration analysis processing on the video data to obtain a second duration of each video frame; and determining code rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame. Through the method, the code rate information in a live broadcast scene can be counted in real time, so that the performance of a live broadcast player is effectively improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and specifically to a method for determining information in a live broadcast scenario, an apparatus for determining information in a live broadcast scenario, a computer device, a computer-readable storage medium, and a computer program product. Background Art

[0002] With the rapid development of the Internet and mobile communication technology, live broadcast technology has been widely used and promoted. The popularity of high-speed networks and mobile devices allows people to watch live broadcast content anytime and anywhere through mobile phones, tablets and other devices. Live broadcast technology requires real-time and smooth content, and needs to ensure real-time transmission and playback of video and audio to meet users' demand for the immediacy of live broadcast content.

[0003] Among them, bit rate is an important indicator to measure the decoding performance of the player. Therefore, determining the bit rate of audio and video in real time during live broadcast can also determine the performance of the player in real time. At present, the method of obtaining bit rate information is to obtain video clips, process the key frames of the video clips, and determine the bit rate information of the audio and video clips through the key frames, thereby determining the performance of the player. Since this method analyzes the key frames of the video clips, it cannot analyze non-key frames in real time. Therefore, it lacks the real-time analysis of the player in the live broadcast scenario.

[0004] In view of this, how to solve the problem that the bit rate information cannot be counted in real time when the mobile terminal plays live broadcasts, so as to improve the real-time analysis of the bit rate information in the live broadcast scenario has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The embodiments of the present application provide a method for determining information in a live broadcast scenario and related devices, which can count the bit rate information in the live broadcast scenario in real time, thereby effectively improving the performance of the live broadcast player.

[0006] In a first aspect, an embodiment of the present application discloses a method for determining information in a live broadcast scenario, the method comprising:

[0007] Receiving multimedia data sent by a live broadcast server, the multimedia data including audio data and video data, the multimedia data being collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server;

[0008] Performing a time-length analysis process on the audio data to obtain a first duration of each audio frame, and performing a time-length analysis process on the video data to obtain a second duration of each video frame;

[0009] The bit rate information of the multimedia data is determined according to the first duration of each audio frame and the second duration of each video frame.

[0010] In combination with any implementation manner of the present application, the performing time length analysis and processing on the audio data to obtain a first duration of each audio frame includes:

[0011] Acquire audio frame information carried by the audio data;

[0012] Obtaining a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame from the audio frame information, where M is a positive integer greater than 1;

[0013] Determine a first duration of the Mth audio frame according to a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame.

[0014] In combination with any implementation manner of the present application, the performing time length analysis and processing on the audio data to obtain a first duration of each audio frame includes:

[0015] Acquire audio frame information carried by the audio data, where the audio frame information includes duration information of each audio frame;

[0016] The first duration of each audio frame is read from the duration information of each audio frame.

[0017] In combination with any implementation manner of the present application, the determining the bit rate information of the to-be-processed multimedia segment according to the first duration of each audio frame and the second duration of each video frame includes:

[0018] Processing the first duration of each audio frame to obtain the duration of the audio data;

[0019] Determine the data volume of the audio data, and determine the bit rate information of the audio data according to the data volume of the audio data and the duration of the audio data;

[0020] Processing the second duration of each video frame to obtain the duration of the video data;

[0021] The data volume of the video data is determined, and the bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data.

[0022] In combination with any embodiment of the present application, the method further includes: sending the bit rate information of the multimedia data to a management server, so that the management server determines the playback parameter adjustment indication information according to the bit rate information of the multimedia data;

[0023] Receive the playback parameter adjustment instruction information sent by the management server, and adjust the playback parameters based on the playback parameter adjustment instruction information.

[0024] In combination with any embodiment of the present application, the method further includes: respectively obtaining a first number of lost frames of the audio data and a second number of lost frames of the video data;

[0025] The frame loss rate of the multimedia data is determined according to a first frame loss number of the audio data and a second frame loss number of the video data.

[0026] In a second aspect, an embodiment of the present application discloses an information determination device in a live broadcast scenario, the device comprising:

[0027] A transceiver unit, configured to receive multimedia data sent by a live broadcast server, wherein the multimedia data includes audio data and video data, and the multimedia data is collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server;

[0028] a processing unit, configured to perform a time-length analysis on the audio data to obtain a first duration of each audio frame, and to perform a time-length analysis on the video data to obtain a second duration of each video frame;

[0029] A determination unit is used to determine the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame.

[0030] In combination with any embodiment of the present application, the processing unit performs duration analysis on the audio data to obtain a first duration of each audio frame, including:

[0031] Acquire audio frame information carried by the audio data;

[0032] Obtaining a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame from the audio frame information, where M is a positive integer greater than 1;

[0033] Determine a first duration of the Mth audio frame according to a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame.

[0034] In combination with any embodiment of the present application, the processing unit performs duration analysis on the audio data to obtain a first duration of each audio frame, including:

[0035] Acquire audio frame information carried by the audio data, where the audio frame information includes duration information of each audio frame;

[0036] The first duration of each audio frame is read from the duration information of each audio frame.

[0037] In combination with any embodiment of the present application, the determining unit determines the bit rate information of the to-be-processed multimedia segment according to the first duration of each audio frame and the second duration of each video frame, including:

[0038] Processing the first duration of each audio frame to obtain the duration of the audio data;

[0039] Determine the data volume of the audio data, and determine the bit rate information of the audio data according to the data volume of the audio data and the duration of the audio data;

[0040] Processing the second duration of each video frame to obtain the duration of the video data;

[0041] The data volume of the video data is determined, and the bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data.

[0042] In combination with any implementation manner of the present application, the transceiver unit is further used for:

[0043] Sending the bit rate information of the multimedia data to a management server, so that the management server determines playback parameter adjustment indication information according to the bit rate information of the multimedia data;

[0044] Receive the playback parameter adjustment instruction information sent by the management server, and adjust the playback parameters based on the playback parameter adjustment instruction information.

[0045] In combination with any embodiment of the present application, the method further includes:

[0046] Respectively obtaining a first number of lost frames of the audio data and a second number of lost frames of the video data;

[0047] The frame loss rate of the multimedia data is determined according to a first frame loss number of the audio data and a second frame loss number of the video data.

[0048] In a third aspect, an embodiment of the present application discloses a computer device, which includes a processor, a computer-readable storage medium and a communication interface, wherein the processor, the computer-readable storage medium and the communication interface are interconnected, wherein: the processor is suitable for implementing one or more computer programs; and the computer-readable storage medium stores one or more computer programs, and the one or more computer programs are suitable for being loaded by the processor and executing the above-mentioned information determination method in the live broadcast scenario.

[0049] In a fourth aspect, an embodiment of the present application discloses a computer-readable storage medium, which stores one or more computer programs, and the one or more computer programs are suitable for being loaded by a processor and executing the above-mentioned information determination method in the live broadcast scenario.

[0050] In a fifth aspect, an embodiment of the present application discloses a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the above-mentioned information determination method in the live broadcast scenario.

[0051] In the embodiment of the present application, the live broadcast client corresponding to the target live broadcast room collects multimedia data and sends it to the live broadcast server, and the live broadcast service sends the multimedia data to the audience client. After receiving the multimedia data, the audience client performs a duration analysis on the audio data included in the multimedia data to obtain the first duration of each audio frame, and performs a duration analysis on the video data included in the multimedia data to obtain the second duration of each video frame, and then determines the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame. By analyzing the duration of each video frame and each audio frame, the bit rate information of the multimedia data can be determined. Based on the real-time analysis of the duration of each video frame and each audio frame, the bit rate information of the multimedia data obtained is more accurate and more real-time, which can better achieve real-time analysis of the player performance, and thereby improve the live broadcast quality in the live broadcast scenario. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 It is a schematic diagram of the network architecture of an information determination system in a live broadcast scenario disclosed in an embodiment of the present application;

[0054] Figure 2 It is a flowchart of a method for determining information in a live broadcast scenario disclosed in an embodiment of the present application;

[0055] Figure 3 This is a framework diagram of a process for determining bit rate information disclosed in an embodiment of the present application;

[0056] Figure 4 It is a flowchart of another method for determining information in a live broadcast scenario disclosed in an embodiment of the present application;

[0057] Figure 5 It is a flowchart of another method for determining information in a live broadcast scenario disclosed in an embodiment of the present application;

[0058] Figure 6 It is a schematic diagram of the execution steps of a real-time marking module disclosed in an embodiment of the present application;

[0059] Figure 7 It is a structural diagram of an information determination device in a live broadcast scenario disclosed in an embodiment of the present application;

[0060] Figure 8 It is a structural schematic diagram of a computer device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0062] With the development of the Internet and the improvement of bandwidth environment, the market scale of online live broadcasting continues to expand, and a large number of live broadcasting technologies are gradually becoming known to the public. Whether it is a concert, a press conference, interactive sales or a personal performance, it can be presented to the public in the form of live broadcast. As long as users have a device that can connect to the Internet (such as mobile phones, tablets and other devices) and a good network environment, they can watch live broadcasts anytime and anywhere. The quality of live broadcasts directly affects the user's viewing experience. Users expect a smooth and clear live broadcast. The core factors that affect the quality of live broadcasts are resolution, frame rate and bit rate. The resolution of live broadcast data can be calculated by the size of the video, that is, the total number of rows of video pixels. Common resolution standards include 720P, 1080P, 2K, 4K, etc. These standards describe the clarity of the video. For example, the resolution of 1080P is 1920×1080, which means that the video consists of 1920 horizontal pixels and 1080 vertical pixels. The higher the resolution, the clearer the picture displayed on the audience side. In live broadcast settings, resolution is an important parameter that directly affects the quality of the video and the audience's viewing experience. Choosing the appropriate resolution is crucial to providing a high-quality live broadcast experience. Bitrate refers to the amount of data used by a video per unit time. The higher the bitrate, the higher the video quality, but it also requires viewers to have a higher network bandwidth to watch smoothly. Frame rate refers to the number of frames displayed per second. The higher the frame rate, the smoother the video looks. The selection of these parameters requires finding a balance between video quality and network requirements to ensure that viewers can watch the live broadcast smoothly, while avoiding lag or audience loss due to excessive network requirements.

[0063] Among them, bitrate is a key point and core in the live broadcast process. By determining the bitrate of audio and video during the live broadcast, the performance of the player can be determined in real time. At present, the method of obtaining bitrate information is to obtain video clips, process the key frames of the video clips, and determine the bitrate information of the audio and video clips through the key frames, thereby determining the performance of the player. Since this method analyzes the key frames of the video clips, it cannot analyze non-key frames in real time. Therefore, it lacks the real-time analysis of the player in the live broadcast scenario.

[0064] Based on this, an embodiment of the present application provides a method for determining information in a live broadcast scenario, the method comprising: 1. receiving multimedia data sent by a live broadcast server, the multimedia data comprising audio data and video data, the multimedia data being collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server; 2. performing a duration analysis on the audio data to obtain a first duration of each audio frame, and performing a duration analysis on the video data to obtain a second duration of each video frame; 3. determining the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame. In this method, the bit rate information of the multimedia data is determined by analyzing the duration of each video frame and each audio frame. Based on the real-time analysis of the duration of each video frame and each audio frame, the bit rate information of the multimedia data obtained is more accurate and more real-time, which can better achieve real-time analysis of player performance, and thereby improve the quality of live broadcast in a live broadcast scenario.

[0065] In a possible implementation, the information determination method in the live broadcast scenario provided in the embodiment of the present application can be implemented based on cloud technology. In the embodiment of the present application, it can specifically involve one or more of cloud storage, cloud database, and big data in cloud technology. For example, the data determined by executing the information determination method in the live broadcast scenario (such as the bit rate information of multimedia data and the frame loss rate of multimedia data) is stored in the cloud database.

[0066] In a possible implementation, the information determination method in the live broadcast scenario provided by the present application can also be implemented based on blockchain technology. For example, the data determined by executing the information determination method in the live broadcast scenario (such as the bit rate information of multimedia data and the frame loss rate of multimedia data) can be stored in the form of blocks on the blockchain to prevent internal data from being tampered with, thereby ensuring data security.

[0067] See also Figure 1 , is a network architecture diagram of an information determination system in a live broadcast scenario disclosed in an embodiment of the present application, and the information determination system may at least include a live broadcast client 101, a live broadcast server 102, an audience client 103, and a management server 104. Among them, the live broadcast client 101 and the live broadcast server 102 are connected via a network, the live broadcast server 102 and the audience client 103 are connected via a network, and the audience client 103 and the management server 104 are connected via a network, for example, via a local area network, a wide area network, a mobile Internet, etc. It should be noted that the number of audience clients 103 can be multiple, and the interaction between one audience client 103 and the live broadcast server 102 and the management server 104 is taken as an example in the subsequent embodiments.

[0068] Among them, the live broadcast client 101 is the client corresponding to the live broadcast object, which mainly collects the multimedia data (image and sound of the live broadcast object) of the live broadcast object through the collection device of the live broadcast client, and then sends the multimedia data to the live broadcast server 102. The live broadcast server 102 is mainly responsible for encoding the multimedia data and sending it to the audience client 103. The audience client 103 receives the multimedia data sent by the live broadcast server 102, and analyzes the audio data and video data included in the multimedia data to obtain the bit rate information of the multimedia data. Further, the determined bit rate information is sent to the management server 104, and the management server adjusts the performance of the player used by the audience client 103 to play the multimedia data according to the bit rate information, thereby improving the live broadcast quality.

[0069] In a possible implementation, the live broadcast client 101 and the audience client 103 in the embodiment of the present application include but are not limited to: smart phones, tablet computers, smart wearable devices, smart voice interaction devices, smart home appliances, personal computers, vehicle-mounted terminals, smart cameras, virtual reality devices (such as AR (Augmented Reality) devices) and other devices, and the present application does not limit this. The live broadcast server 102 and the management server 104 in the embodiment of the present application can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, and the embodiment of the present application does not limit this.

[0070] Optionally, Figure 1 The network architecture diagram of the information determination system in the live broadcast scenario is only an exemplary representation and is not intended to limit this. Figure 1 The live broadcast server 102 or the management server 104 can be deployed as a node in the blockchain network, or the live broadcast server 102 or the management server 104 can be connected to the blockchain network, so that the live broadcast server 102 can perform encryption processing during data transmission, and the management server 104 can accurately upload the performance parameters of the player to the blockchain network for storage, so as to prevent internal data from being tampered with, thereby ensuring data security.

[0071] In the embodiment of the present application, in combination with the information determination system in the live broadcast scene, the information determination method in the live broadcast scene provided by the embodiment of the present application is described: the audience client 103 receives the multimedia data sent by the live broadcast server 102, and the multimedia data includes audio data and video data. The multimedia data is collected by the live broadcast client 101 corresponding to the target live broadcast room and sent to the live broadcast server 102; the audience client 103 performs a time analysis on the audio data to obtain the first duration of each audio frame, and performs a time analysis on the video data to obtain the second duration of each video frame; the audience client 103 determines the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame. In this method, the audience client 103 determines the bit rate information of the multimedia data by analyzing the duration of each video frame and each audio frame. Based on the real-time analysis of the duration of each video frame and each audio frame, the bit rate information of the multimedia data obtained is more accurate and more real-time, which can better achieve the real-time analysis of the player performance, and thereby improve the live broadcast quality in the live broadcast scene.

[0072] In a possible implementation, based on the information determination system in the live broadcast scenario, the information determination method in the live broadcast scenario provided by the embodiment of the present application can also be used to determine other performance indicators of the player. For example, the performance indicators corresponding to the player can be determined by determining the frame loss rate information, frame rate information, and resolution information of the multimedia data.

[0073] Taking the frame loss rate information as an example, the corresponding method steps include: the audience client 103 obtains the first frame loss number of the audio data and the second frame loss number of the video data respectively; obtains the total number of audio frames of the audio data, and determines the audio frame loss rate of the audio data according to the total number of audio frames and the first frame loss number of the audio data; obtains the total number of video frames of the video data, and determines the video frame loss rate of the video data according to the total number of video frames and the second frame loss number of the video data. The video frame loss rate of the video data and the frame loss rate of the audio data are used as the frame loss rate information of the multimedia data. After determining the frame loss rate information, the frame loss rate information can also be sent to the management server 104, so that the management server 104 analyzes the performance of the player and determines the corresponding adjustment strategy.

[0074] It should be noted that the collection and processing of relevant data in this application should be strictly in accordance with the requirements of relevant laws and regulations when applied in examples, and the informed consent or separate consent of the personal information subject should be obtained, and subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0075] The following is a detailed introduction to the information determination method in the live broadcast scenario proposed in the embodiment of the present application.

[0076] See also Figure 2 , is a flow chart of a method for determining information in a live broadcast scenario disclosed in an embodiment of the present application. The execution subject of the method for determining information in the live broadcast scenario is a computer device, which may be Figure 1 Specifically, the method for determining information in the live broadcast scenario of the audience client 103 may include but is not limited to the following steps:

[0077] S201: receiving multimedia data sent by a live broadcast server, where the multimedia data includes audio data and video data, and the multimedia data is collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server.

[0078] In various live broadcast scenarios, the live broadcast client corresponding to the target live broadcast room will collect multimedia data in real time. The multimedia data mainly includes audio data and video data. Among them, the equipment for collecting multimedia data includes cameras and microphones. The camera is mainly used to collect video data. The video data is mainly determined by images. The images include the live broadcast object collected by the collection device, the action of the live broadcast object, and the scene of the target live broadcast room (including background, etc.). The microphone is mainly used to collect audio data. The audio data is mainly the sound of the live broadcast object in the target live broadcast room, the audio played by the live broadcast object, and other sounds in the live broadcast scene (including noise, etc.). The live broadcast client continuously collects multimedia data and sends it to the live broadcast server in real time. After receiving the multimedia data, the live broadcast server encodes it and sends the encoded multimedia data to the audience client. The audience client receives the encoded multimedia data, decodes and renders it, and displays it on the playback interface of the audience client. The audience can watch the live broadcast in real time. In order to reflect the real-time nature of the live broadcast scene, the multimedia data sent by the live broadcast server is collected and sent by the live broadcast client.

[0079] Among them, it should be noted that the live broadcast scene is not limited, it can be a live broadcast scene of a concert, a live broadcast scene of a press conference, a live broadcast scene of interactive sales, a live broadcast scene of a game, and a live broadcast scene of a personal performance (including singing, dancing and other talent shows), etc.

[0080] S202: Performing a time-length analysis on the audio data to obtain a first duration of each audio frame, and performing a time-length analysis on the video data to obtain a second duration of each video frame.

[0081] After receiving the multimedia data, the viewer client can perform a duration analysis on the audio data in the multimedia data to obtain a first duration of each audio frame, and perform a duration analysis on the video data in the multimedia data to obtain a second duration of each video frame.

[0082] In one possible implementation, the audio data in the multimedia data is subjected to time-length analysis and processing to obtain the first duration of each audio frame as follows: audio frame information carried by the audio data is obtained; a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame are obtained from the audio frame information, where M is a positive integer greater than 1; a first duration of the Mth audio frame is determined based on the decoding timestamp of the Mth audio frame and the decoding timestamp of the M-1th audio frame, specifically, the decoding timestamp of the Mth audio frame is subtracted from the decoding timestamp of the M-1th audio frame to obtain the first duration of the Mth audio frame. Alternatively, obtain the decoding timestamp of the Mth audio frame and the decoding timestamp of the M+1th audio frame from the audio frame information, where M is an integer greater than or equal to 1; determine the first duration of the Mth audio frame based on the decoding timestamp of the Mth audio frame and the decoding timestamp of the M+1th audio frame, specifically subtract the decoding timestamp of the Mth audio frame from the decoding timestamp of the M+1th audio frame to obtain the first duration of the Mth audio frame. The Mth audio frame is any frame in the audio data, and therefore, the first duration of each audio frame in the audio data can be determined by the above method. This method does not rely on the duration carried in the audio data, but can also accurately analyze the duration of the frame, which can improve the real-time processing of audio data.

[0083] For example, for the first audio frame of the audio data, when the duration information of the first audio frame is not carried in the audio data, the decoding timestamp of the first audio frame and the decoding timestamp of the second audio frame are obtained from the audio frame information, and the decoding timestamp of the first audio frame is subtracted from the decoding timestamp of the second audio frame to obtain the duration of the first audio frame. For another example, for the last audio frame of the audio data, when the duration information of the last audio frame is not carried in the audio data, the decoding timestamp of the last audio frame and the decoding timestamp of the second-to-last audio frame are obtained from the audio frame information, and the decoding timestamp of the second-to-last audio frame is subtracted from the decoding timestamp of the last audio frame to obtain the duration of the last audio frame. The duration of the first audio frame and the last audio frame is special, so an example is given separately here. The duration of non-first audio frames and the last audio frame can be determined based on the decoding timestamps of the current frame and the adjacent frames.

[0084] In a possible implementation, the duration analysis process is performed on the audio data in the multimedia data to obtain the first duration of each audio frame in another implementation as follows: the audio frame information carried by the audio data is obtained, and it is detected whether the audio frame information includes the duration information of each audio frame. If the audio frame information includes the duration information of each audio frame, the first duration of each audio frame is read from the duration information of each audio frame. If the audio frame information does not include the duration information of each audio frame, the decoding timestamp of each audio frame is obtained from the audio frame information, and the first duration of each audio frame is further determined.

[0085] Optionally, the first duration of each audio frame can be determined in combination with the duration information of the audio frame and the decoding timestamp of the audio frame. Specifically, the first duration of the audio frame is determined frame by frame according to the time information of the audio frame of the audio data. First, determine whether the audio data has the duration information of each audio frame. If so, directly obtain the first duration of the audio frame. If not, obtain the decoding timestamp of the current frame and the decoding timestamp of the adjacent frame (the previous audio frame or the next audio frame), and then calculate the first duration of the current frame. In this method, the efficiency is higher by combining the two methods to analyze the duration of the audio frame.

[0086] Similarly, the method for performing duration analysis on video data in multimedia data is consistent with the above-mentioned method for performing duration analysis on audio data, and specifically includes the following three methods:

[0087] The first method: obtaining video frame information carried by video data; obtaining the decoding timestamp of the Nth video frame and the decoding timestamp of the N-1th video frame from the video frame information, where N is a positive integer greater than 1; determining the second duration of the Nth video frame based on the decoding timestamp of the Nth video frame and the decoding timestamp of the N-1th video frame, specifically subtracting the decoding timestamp of the N-1th video frame from the decoding timestamp of the Nth video frame to obtain the second duration of the Nth video frame. Alternatively, obtaining the decoding timestamp of the Nth video frame and the decoding timestamp of the N+1th video frame from the video frame information, where N is an integer greater than or equal to 1; determining the second duration of the Nth video frame based on the decoding timestamp of the Nth video frame and the decoding timestamp of the N+1th video frame, specifically subtracting the decoding timestamp of the Nth video frame from the decoding timestamp of the N+1th video frame to obtain the second duration of the Nth video frame. The Nth video frame is any frame in the video data, so the second duration of each video frame in the video data can be determined by the above method. This method does not rely on the duration carried in the video data, but can accurately analyze the duration of the frame, which can improve the real-time performance of video data processing.

[0088] For example, for the first video frame of audio data, when the duration information of the first video frame is not carried in the audio data, the decoding timestamp of the first video frame and the decoding timestamp of the second video frame are obtained from the video frame information, and the decoding timestamp of the first video frame is subtracted from the decoding timestamp of the second video frame to obtain the duration of the first video frame. For another example, for the last video frame of audio data, when the duration information of the last video frame is not carried in the audio data, the decoding timestamp of the last video frame and the decoding timestamp of the second to last video frame are obtained from the video frame information, and the decoding timestamp of the last video frame is subtracted from the decoding timestamp of the second to last video frame to obtain the duration of the last video frame. The duration of the first video frame and the last video frame is relatively special, so an example is given separately here. The duration of non-first video frames and the last video frame can be determined according to the decoding timestamps of the current frame and the adjacent frames.

[0089] The second method: obtaining the video frame information carried by the video data, detecting whether the video frame information includes the duration information of each video frame, and if the video frame information includes the duration information of each video frame, reading the second duration of each video frame from the duration information of each video frame. If the video frame information does not include the duration information of each video frame, obtaining the decoding timestamp of each video frame from the video frame information, and then determining the second duration of each video frame.

[0090] The third method: according to the time information of the video frame of the video data, the second duration of each video frame is determined frame by frame. First, it is determined whether the duration information of each video frame exists in the video data. If it exists, the second duration of the video frame is directly obtained. If not, the decoding timestamp of the current video frame and the decoding timestamp of the adjacent frame (previous video frame or next video frame) are obtained, and then the second duration of the current video frame is calculated. In this method, the efficiency is higher by combining the two methods to analyze the duration of the video frame.

[0091] The decoding timestamps of the audio frames and the decoding timestamps of the video frames involved in the above analysis of the audio data and the video data are determined when the video data and the audio data are encoded. Therefore, the information is sent to the viewer client at the same time as the live broadcast server sends the video data and the audio data. It should be noted that the audio data and the video data are different, and the corresponding frame numbers are also different. Therefore, determining them separately is more accurate and more real-time.

[0092] In order to reflect the real-time performance, the viewer client analyzes the multimedia data regularly, for example, once every certain period of time. Here, the interval is very short, for example, every 1 second or every 2 seconds. This is the only way to achieve the real-time purpose, analyze the bit rate in real time, and adjust the performance parameters of the player in time. Compared with the technology that relies on key frames, this proposal can analyze audio and video of any size, which can better reflect the real-time performance.

[0093] S203: Determine bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame.

[0094] In a possible implementation, the bit rate information of the multimedia data includes the bit rate information of the audio data and the bit rate information of the video data. The determination process of the bit rate information of the audio data and the bit rate information of the video data is as follows:

[0095] The process of determining the bit rate information of audio data: the first duration of each audio frame is processed to obtain the duration of the audio data. This process is to add the first duration of each video frame to obtain the duration of the audio data. Then the data volume of the audio data is determined according to the received multimedia data. The data volume of the audio data is the size of the audio data, usually in bytes. The bit rate information of the audio data is determined according to the data volume of the audio data and the duration of the audio data, that is, it is calculated according to the specified formula to obtain the bit rate information of the audio data. Among them, the bit rate calculation process is as follows: Formula (1):

[0096] Bit rate (kbps) = file size (bytes) × 8 × 1024 / time (seconds) (1)

[0097] Similarly, the process of determining the bit rate information of the video data is as follows: the second duration of each video frame is processed to obtain the duration of the video data. This process is to add the second duration of each video frame to obtain the duration of the video data. Then, the data volume of the video data is determined according to the received multimedia data. The data volume of the video data is the size of the video data, which is usually in bytes. The bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data. The calculation formula is the same as the above formula (1).

[0098] See also Figure 3 , is a flowchart of a process for determining bit rate information disclosed in an embodiment of the present application, Figure 3This is an overview of the bit rate information of audio data and the bit rate information of video data, including the following process: first obtain multimedia data, the multimedia data includes video data and audio data, and determine whether the video data and audio data have frame (audio frame and video frame) duration information. If it exists, then record the duration of each audio frame and each video frame; if it does not exist, read the decoding timestamp of the current frame and the adjacent frame (the previous frame of the current frame or the next frame of the current frame), and determine the duration of the current audio frame and the current video frame according to the decoding timestamp of the current frame and the adjacent frame. According to this method, the duration of each audio frame and each video frame is determined in turn, and the duration of each audio frame and each video frame is recorded. Finally, the corresponding bit rate information is determined according to the duration of each audio frame, the duration of each video frame, and the file size corresponding to the multimedia data (the file size of the video data and the file size of the audio data).

[0099] Furthermore, after determining the bit rate information of the multimedia data, the bit rate information of the multimedia data can be sent to the management server at regular intervals. In layman's terms, the bit rate information of i multimedia data may have been determined on the viewer client, where i is an integer greater than 1. When the condition for reporting the bit rate information is triggered, the bit rate information of each multimedia data is sent to the management server. The management server determines whether it is necessary to adjust the relevant parameters of the player based on the bit rate information of each multimedia data. If necessary, it determines the playback parameter adjustment indication information and sends the playback parameter adjustment indication information to the viewer client. The viewer client receives the playback parameter adjustment indication information sent by the management server, adjusts the playback parameters based on the playback parameter adjustment indication information, and plays the multimedia data based on the adjusted parameter information, thereby optimizing the live video without the viewer's perception. Among them, the process by which the management server determines whether it is necessary to adjust the relevant parameters of the player based on the bit rate information of each multimedia data can be:

[0100] In the embodiments of the present application, the process of determining the bit rate information of video data and audio data is mainly explained. By analyzing the video data and audio data frame by frame, the duration of each frame is first determined, and then the duration of the video data and the duration of the audio data are determined. Finally, the bit rate information of the audio data is determined according to the file size of the audio data and the duration of the audio data. The bit rate information of the video data is determined according to the file size of the video data and the duration of the video data. In this scheme, based on the real-time analysis of the duration of each video frame and each audio frame, the obtained bit rate information is more accurate and more real-time. Therefore, the real-time analysis of the player performance can be better achieved, thereby improving the live broadcast quality in the live broadcast scenario.

[0101] The information determination method in the live broadcast scenario in the embodiment of the present application can not only count the bit rate information, but also count other information besides the bit rate information, such as frame loss rate information, frame rate information, and resolution information, etc., see Figure 4 , is a flow chart of another method for determining information in a live broadcast scenario disclosed in an embodiment of the present application. The information determined in the method is frame loss rate information of multimedia data. Correspondingly, the method for determining information in the live broadcast scenario includes but is not limited to the following steps:

[0102] S401: Obtain a first number of lost frames of audio data and a second number of lost frames of video data respectively.

[0103] In live broadcast scenarios, frame loss is a common phenomenon. Frame loss can be divided into two types: intentional frame loss and unintentional frame loss. Intentional frame loss is usually to reduce the size of the video for easy storage and transmission. This is an effective way to deal with large video sizes. Unintentional frame loss may be caused by excessive compression, poor network quality, or equipment problems, which may cause the audio and video to be out of sync, negatively affecting the user experience. Excessive frame loss will make the live broadcast picture unsmooth and cause the picture to freeze. Therefore, in live broadcast scenarios, the frame loss rate of audio and video can be counted in real time, so as to achieve real-time adjustment of the player performance, avoid live broadcast freezes, and improve live broadcast quality.

[0104] In a possible implementation, during the process of receiving multimedia data for rendering, the viewer client can use a counter to count the first frame loss data of the audio data and the second frame loss data of the video data. The working process of the counter is as follows: during the rendering process, each frame is rendered, and when a frame loss occurs, the counter is incremented by 1 until the rendering of the received video data and audio data is completed, and the first frame loss data of the audio data and the second frame loss data of the video data are obtained.

[0105] S402: Determine a frame loss rate of multimedia data according to a first frame loss number of audio data and a second frame loss number of video data.

[0106] The frame loss rate of multimedia data includes the frame loss rate of audio data and the frame loss rate of video data. The process of determining the respective frame loss rates is as follows:

[0107] The process of determining the frame loss rate of audio data is as follows: the total number of audio frames of the received audio data is determined, and the audio frame loss rate of the audio data is determined according to the total number of audio frames and the first frame loss number of the audio data. The process is to divide the first frame loss number of the audio data by the total number of audio frames (and then multiply by 100%), and the value obtained is the frame loss rate of the audio data.

[0108] The process of determining the frame loss rate of video data is as follows: the total number of video frames of the received video data is determined, and the video frame loss rate of the video data is determined according to the total number of video frames and the second frame loss number of the video data. The process is to divide the second frame loss number of the video data by the total number of video frames (and then multiply by 100%), and the value obtained is the frame loss rate of the video data.

[0109] Furthermore, after determining the frame loss rate of the multimedia data, the frame loss rate of the multimedia data can be sent to the management server at regular intervals. When the condition for reporting the frame loss rate is triggered, the viewer client sends the frame loss rate of the multimedia data to the management server. The management server determines whether it is necessary to adjust the relevant parameters of the player based on the frame loss rate of the multimedia data. If necessary, it determines the second adjustment indication information of the playback parameters and sends the second playback parameter adjustment indication information to the viewer client. The viewer client receives the second playback parameter adjustment indication information sent by the management server, adjusts the playback parameters based on the second playback parameter adjustment indication information, and plays the multimedia data based on the adjusted parameter information, thereby optimizing the live video without the viewer's perception.

[0110] In addition to the bit rate and frame loss rate mentioned above, other information of the multimedia data can be determined by frame analysis, such as frame rate and resolution information, etc. Since the embodiments of the present application are all analyzed frame by frame, they are more real-time, and can promptly detect emergencies of the player in the live broadcast scene, and adjust the player in a timely manner, thereby improving the live broadcast quality and improving the audience satisfaction.

[0111] Based on the above embodiment, the information determination method in the live broadcast scenario provided by the embodiment of the present application is described in combination with the interaction between the viewer client, the live broadcast server and the management server. Figure 5 , is a flowchart of another method for determining information in a live broadcast scenario disclosed in an embodiment of the present application, including but not limited to the following steps:

[0112] S501: The live broadcast server sends multimedia data including audio data and video data to the viewer client.

[0113] The live broadcast server sends multimedia data to the viewer client in real time. In the actual application process, the live broadcast server performs encoding processing before sending the multimedia data to the viewer client, including encoding of audio data and encoding of video data.

[0114] S502: The viewer client analyzes the multimedia data to obtain the bit rate and frame loss rate of the multimedia data.

[0115] The process of determining the bit rate can be found in Figure 2 The process of determining the frame loss rate can be found in Figure 4 In the actual application process, corresponding to the encoding, after receiving the multimedia data, the viewer client needs to decode the multimedia data, including decoding of the video data and decoding of the audio data.

[0116] In a possible implementation, a real-time counting module can be deployed on the viewer client, which is responsible for executing data statistics. When the player of the viewer client is created, the real-time counting module starts working. The workflow can be found in Figure 6 , that is, obtain the live stream (i.e. multimedia data) from the live backend service (specifically the live server), and perform the initialization of the real-time dotting module when the player is created. After the initialization, it is the processing process after receiving the live stream, including: the real-time dotting module collects the playback information of each frame, the real-time dotting module reports the playback information of each frame, and the real-time dotting module resets the information. Among them, the playback information of each frame reported by the real-time dotting module is regularly reported to the live backend service (specifically the management server) to analyze the performance of the player.

[0117] S503: The viewer client periodically reports the bit rate and frame loss rate of the multimedia data to the management server.

[0118] In a possible implementation, a timed reporting thread can be set on the viewer client. When the timer of the timed reporting thread is reached, the viewer client obtains the frame loss rate and bit rate through the timed reporting thread for timed reporting. At the same time, the viewer client also needs to clear the currently counted frame loss rate and bit rate to avoid data accumulation and affect subsequent data analysis, so as not to affect the real-time nature of data analysis.

[0119] S504: The management server analyzes the bit rate and frame loss rate of the multimedia data respectively, and determines playback parameter adjustment instruction information.

[0120] In a possible implementation, after receiving the bit rate of multimedia data (including the bit rate of video data and the bit rate of audio data), the management server compares the bit rate of video data with the video bit rate threshold, and compares the bit rate of audio data with the audio bit rate threshold. If the bit rate of video data is greater than the video bit rate threshold or the bit rate of audio data is greater than the audio bit rate threshold, then the playback parameter adjustment indication information for the bit rate is determined. After receiving the frame loss rate of multimedia data (including the frame loss rate of video data and the frame loss rate of audio data), the management server compares the frame loss rate of video data with the video frame loss rate threshold, and compares the frame loss rate of audio data with the audio frame loss rate threshold. If the frame loss rate of video data is greater than the video frame loss rate threshold or the frame loss rate of audio data is greater than the audio frame loss rate threshold, then the playback parameter adjustment indication information for the frame loss rate is determined.

[0121] If it is determined based on the bit rate and frame loss rate of the multimedia data that the player parameters do not need to be adjusted, steps S501-S504 are iteratively executed so that problems with the player can be discovered in real time and adjusted in a timely manner.

[0122] S505: The management server returns playback parameter adjustment instruction information to the viewer client.

[0123] S506: The viewer client adjusts the playback parameters according to the playback parameter adjustment indication information, and plays the multimedia data based on the adjusted playback parameters.

[0124] In the embodiments of the present application, the information determination method in the live broadcast scenario is explained in combination with the audience client, the live broadcast server and the management server, so that it can be more intuitive to see how information is counted in the live broadcast scenario. Through the interaction of all parties, information statistics and reporting can be performed in real time, and the performance status of the player can be understood in real time and accurately. When problems occur, timely optimization can be performed, thereby effectively improving the user's viewing experience.

[0125] Based on the above method embodiment, the present application embodiment also provides an information determination device in a live broadcast scenario. Figure 7 , is a schematic diagram of the structure of an information determination device in a live broadcast scenario provided by an embodiment of the present application, Figure 7 The information determination device 700 in the live broadcast scenario shown can run the following units:

[0126] The transceiver unit 701 is used to receive multimedia data sent by the live broadcast server, wherein the multimedia data includes audio data and video data, and the multimedia data is collected by the live broadcast client corresponding to the target live broadcast room and sent to the live broadcast server;

[0127] The processing unit 702 is configured to perform a time-length analysis process on the audio data to obtain a first duration of each audio frame, and to perform a time-length analysis process on the video data to obtain a second duration of each video frame;

[0128] The determination unit 703 is configured to determine the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame.

[0129] In a possible implementation, when the processing unit 702 performs duration analysis on the audio data to obtain the first duration of each audio frame, it is specifically configured to perform the following steps:

[0130] Acquire audio frame information carried by the audio data;

[0131] Obtaining a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame from the audio frame information, where M is a positive integer greater than 1;

[0132] Determine a first duration of the Mth audio frame according to a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame.

[0133] In a possible implementation, when the processing unit 702 performs duration analysis on the audio data to obtain the first duration of each audio frame, it is specifically configured to perform the following steps:

[0134] Acquire audio frame information carried by the audio data, where the audio frame information includes duration information of each audio frame;

[0135] The first duration of each audio frame is read from the duration information of each audio frame.

[0136] In a possible implementation, when the determination unit 703 determines the bit rate information of the to-be-processed multimedia segment according to the first duration of each audio frame and the second duration of each video frame, it is specifically configured to perform the following steps:

[0137] Processing the first duration of each audio frame to obtain the duration of the audio data;

[0138] Determine the data volume of the audio data, and determine the bit rate information of the audio data according to the data volume of the audio data and the duration of the audio data;

[0139] Processing the second duration of each video frame to obtain the duration of the video data;

[0140] The data volume of the video data is determined, and the bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data.

[0141] In a possible implementation, the transceiver unit 701 is further configured to perform the following steps:

[0142] Sending the bit rate information of the multimedia data to a management server, so that the management server determines playback parameter adjustment indication information according to the bit rate information of the multimedia data;

[0143] Receive the playback parameter adjustment instruction information sent by the management server, and adjust the playback parameters based on the playback parameter adjustment instruction information.

[0144] In a possible implementation, the processing unit 702 is further configured to respectively obtain a first number of lost frames of the audio data and a second number of lost frames of the video data;

[0145] The determination unit 703 is further configured to determine a frame loss rate of the multimedia data according to a first frame loss number of the audio data and a second frame loss number of the video data.

[0146] It can be understood that the functions of each functional unit of the information determination device in the live broadcast scenario provided in the embodiment of the present application can be specifically implemented according to the method in the above-mentioned method embodiment, and its specific implementation process can refer to the relevant description in the above-mentioned method embodiment, which will not be repeated here.

[0147] In a feasible embodiment, the information determination device in the live broadcast scenario provided by the embodiment of the present application can be implemented in software. The information determination device in the live broadcast scenario can be stored in a memory. It can be software in the form of programs and plug-ins, and includes a series of units, including a transceiver unit, a processing unit, and a determination unit; wherein the transceiver unit, the processing unit, and the determination unit are used to implement the information determination method in the live broadcast scenario provided by the embodiment of the present application.

[0148] In other feasible embodiments, the information determination device in the live broadcast scenario provided by the embodiment of the present application can also be implemented in a combination of software and hardware. As an example, the information determination device in the live broadcast scenario provided by the embodiment of the present application can be a processor in the form of a hardware decoding processor, which is programmed to execute the information determination method in the live broadcast scenario provided by the embodiment of the present application. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs) or other electronic components.

[0149] In the embodiment of the present application, in combination with the transceiver unit, the processing unit and the determination unit, the method includes: the transceiver unit 701 receives multimedia data sent by the live broadcast server, the multimedia data includes audio data and video data, and the multimedia data is collected by the live broadcast client corresponding to the target live broadcast room and sent to the live broadcast server; the processing unit 702 performs duration analysis processing on the audio data included in the multimedia data to obtain the first duration of each audio frame, and performs duration analysis processing on the video data included in the multimedia data to obtain the second duration of each video frame; the determination unit 703 determines the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame. In this method, by analyzing the duration of each video frame and each audio frame, the bit rate information of the multimedia data can be determined. Based on the real-time analysis of the duration of each video frame and each audio frame, the bit rate information of the multimedia data obtained is more accurate and more real-time, which can better achieve real-time analysis of player performance, and thereby improve the live broadcast quality in the live broadcast scenario.

[0150] Based on the description of the above method embodiment and the device embodiment, the present application embodiment further provides a computer device; the computer device may be the audience client 103 mentioned above. Figure 8 The computer device may include at least a processor 801, an input interface 802, an output interface 803 and a computer-readable storage medium 804; wherein the processor 801, the input interface 802, the output interface 803 and the computer-readable storage medium 804 may be connected via a bus or other connection methods.

[0151] The computer-readable storage medium 804 may be stored in a memory of a computer device, the computer-readable storage medium 804 is used to store a computer program, and the processor 801 is used to execute the computer program stored in the computer-readable storage medium 804. The processor 801 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device, which is suitable for implementing one or more computer programs, and is specifically suitable for loading and executing one or more computer programs to implement corresponding method flows or corresponding functions.

[0152] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the operating system of the computer device. In addition, one or more computer programs (including program codes) suitable for being loaded and executed by the processor are also stored in the storage space. It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory (Non-Volatile Memory), such as at least one disk storage; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.

[0153] In the embodiment of the present application, the processor 801 may load and execute one or more computer programs stored in the computer-readable storage medium 804 to implement the above-mentioned Figure 2-Figure 6 In a specific implementation, the computer program in the computer-readable storage medium 804 is loaded by the processor 801 and executes the following steps:

[0154] Receiving multimedia data sent by a live broadcast server, the multimedia data including audio data and video data, the multimedia data being collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server;

[0155] Performing a time-length analysis process on the audio data to obtain a first duration of each audio frame, and performing a time-length analysis process on the video data to obtain a second duration of each video frame;

[0156] The bit rate information of the multimedia data is determined according to the first duration of each audio frame and the second duration of each video frame.

[0157] In a possible implementation, the computer program in the computer-readable storage medium 804 is loaded by the processor 801 and executed to perform duration analysis on the audio data to obtain the first duration of each audio frame, specifically for performing the following steps:

[0158] Acquire audio frame information carried by the audio data;

[0159] Obtaining a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame from the audio frame information, where M is a positive integer greater than 1;

[0160] Determine a first duration of the Mth audio frame according to a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame.

[0161] In a possible implementation, the computer program in the computer-readable storage medium 804 is loaded by the processor 801 and executed to perform duration analysis on the audio data to obtain the first duration of each audio frame, specifically for performing the following steps:

[0162] Acquire audio frame information carried by the audio data, where the audio frame information includes duration information of each audio frame;

[0163] The first duration of each audio frame is read from the duration information of each audio frame.

[0164] In a possible implementation, when the computer program in the computer-readable storage medium 804 is loaded and executed by the processor 801 to determine the bit rate information of the to-be-processed multimedia segment according to the first duration of each audio frame and the second duration of each video frame, the computer program is specifically configured to perform the following steps:

[0165] Processing the first duration of each audio frame to obtain the duration of the audio data;

[0166] Determine the data volume of the audio data, and determine the bit rate information of the audio data according to the data volume of the audio data and the duration of the audio data;

[0167] Processing the second duration of each video frame to obtain the duration of the video data;

[0168] The data volume of the video data is determined, and the bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data.

[0169] In a possible implementation, the computer program in the computer-readable storage medium 804 is further used by the processor 801 to load and execute the following steps:

[0170] Sending the bit rate information of the multimedia data to a management server, so that the management server determines playback parameter adjustment indication information according to the bit rate information of the multimedia data;

[0171] Receive the playback parameter adjustment instruction information sent by the management server, and adjust the playback parameters based on the playback parameter adjustment instruction information.

[0172] In a possible implementation, the computer program in the computer-readable storage medium 804 is further used by the processor 801 to load and execute the following steps:

[0173] Also respectively obtaining a first number of lost frames of the audio data and a second number of lost frames of the video data;

[0174] The frame loss rate of the multimedia data is determined according to a first frame loss number of the audio data and a second frame loss number of the video data.

[0175] In the embodiment of the present application, the computer program in the computer-readable storage medium 804 is loaded and executed by the processor 801 to receive multimedia data sent by the live broadcast server, the multimedia data includes audio data and video data, and the multimedia data is collected by the live broadcast client corresponding to the target live broadcast room and sent to the live broadcast server; the audio data included in the multimedia data is subjected to time analysis processing to obtain the first duration of each audio frame, and the video data included in the multimedia data is subjected to time analysis processing to obtain the second duration of each video frame; the bit rate information of the multimedia data is determined according to the first duration of each audio frame and the second duration of each video frame. In this method, the bit rate information of the multimedia data can be determined by analyzing the duration of each video frame and each audio frame. Based on the real-time analysis of the duration of each video frame and each audio frame, the bit rate information of the multimedia data obtained is more accurate and more real-time, which can better achieve real-time analysis of the player performance, and thereby improve the live broadcast quality in the live broadcast scenario.

[0176] According to one aspect of the present application, the present application also provides a computer program product, the computer program product includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the information determination method in the live broadcast scenario provided in the above various optional methods.

[0177] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0178] In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, and the division of the modules described above is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0179] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for determining information in a live broadcast scenario, characterized in that: The method comprises: Receiving multimedia data sent by a live broadcast server, the multimedia data including audio data and video data, the multimedia data being collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server; Performing a time-length analysis process on the audio data to obtain a first duration of each audio frame, and performing a time-length analysis process on the video data to obtain a second duration of each video frame; The bit rate information of the multimedia data is determined according to the first duration of each audio frame and the second duration of each video frame.

2. The method according to claim 1, characterized in that The performing time-length analysis on the audio data to obtain a first duration of each audio frame includes: Acquire audio frame information carried by the audio data; Obtaining a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame from the audio frame information, where M is a positive integer greater than 1; Determine a first duration of the Mth audio frame according to a decoding timestamp of the Mth audio frame and a decoding timestamp of the M-1th audio frame.

3. The method according to claim 1, characterized in that The performing time-length analysis on the audio data to obtain a first duration of each audio frame includes: Acquire audio frame information carried by the audio data, where the audio frame information includes duration information of each audio frame; The first duration of each audio frame is read from the duration information of each audio frame.

4. The method according to any one of claims 1 to 3, characterized in that: The determining the bit rate information of the to-be-processed multimedia segment according to the first duration of each audio frame and the second duration of each video frame comprises: Processing the first duration of each audio frame to obtain the duration of the audio data; Determine the data volume of the audio data, and determine the bit rate information of the audio data according to the data volume of the audio data and the duration of the audio data; Processing the second duration of each video frame to obtain the duration of the video data; The data volume of the video data is determined, and the bit rate information of the video data is determined according to the data volume of the video data and the duration of the video data.

5. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Sending the bit rate information of the multimedia data to a management server, so that the management server determines playback parameter adjustment indication information according to the bit rate information of the multimedia data; Receive the playback parameter adjustment instruction information sent by the management server, and adjust the playback parameters based on the playback parameter adjustment instruction information.

6. The method according to claim 1, characterized in that The method further comprises: Respectively obtaining a first number of lost frames of the audio data and a second number of lost frames of the video data; The frame loss rate of the multimedia data is determined according to a first frame loss number of the audio data and a second frame loss number of the video data.

7. An information determination device in a live broadcast scenario, characterized in that: The device comprises: A transceiver unit, configured to receive multimedia data sent by a live broadcast server, wherein the multimedia data includes audio data and video data, and the multimedia data is collected by a live broadcast client corresponding to a target live broadcast room and sent to the live broadcast server; a processing unit, configured to perform a time-length analysis on the audio data to obtain a first duration of each audio frame, and to perform a time-length analysis on the video data to obtain a second duration of each video frame; A determination unit is used to determine the bit rate information of the multimedia data according to the first duration of each audio frame and the second duration of each video frame.

8. A computer device, characterized in that: The computer device comprises a processor, a computer-readable storage medium and a communication interface, wherein the processor, the computer-readable storage medium and the communication interface are connected to each other, wherein: The processor is adapted to implement one or more computer programs; The computer-readable storage medium stores one or more computer programs, and the one or more computer programs are suitable for being loaded by the processor and executing the information determination method in a live broadcast scenario as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more computer programs, and the one or more computer programs are suitable for being loaded by a processor and executing the information determination method in a live broadcast scenario as described in any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the information determination method in the live broadcast scenario as described in any one of claims 1 to 6.

Images