Network response method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a network response method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a video stream corresponding to a first application, so as to display the video stream in a live broadcast room of a second application; in the live broadcast process, at least one video frame in the video stream is acquired, and network delay information corresponding to the video frame is determined based on the picture content of the video frame; and determining a network response state corresponding to the first application based on the network delay information. According to the technical scheme provided by the embodiment of the invention, the technical problem that network delay exists in the process of applying the first application under the condition that the content of the first application is displayed in the live broadcasting room in the related technology is solved; the network response condition of the first application when the first application is applied in the live broadcast can be known in time, and the network delay condition is processed in a targeted manner, so that the jamming phenomenon of the application of the first application is avoided, and the live broadcast effect is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to computer application technologies, and in particular, to a network response method, apparatus, electronic device, and storage medium. Background Art

[0002] With the development of Internet technologies, the live broadcast industry has also developed rapidly. Live broadcast platforms have diversified live broadcast content. For example, the display content of a first application is introduced in a live broadcast.

[0003] In related technologies, the content of the first application displayed in a live broadcast room is usually recorded by screen recording during the process of using the first application. However, in this live broadcast method, network latency usually occurs, thus affecting the live broadcast effect.

[0004] Therefore, there is an urgent need to propose an effective and reliable solution to handle the network response situation of using the first application in a live broadcast. Summary of the Invention

[0005] The present disclosure provides a network response method, apparatus, electronic device, and storage medium to enable timely understanding of the network response situation corresponding to the first application and perform targeted processing on the network latency situation, avoiding the occurrence of lag phenomena, thereby improving the live broadcast effect.

[0006] In a first aspect, embodiments of the present disclosure provide a network response method, which includes:

[0007] Obtain a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application;

[0008] During the live broadcast, obtain at least one video frame in the video stream, and determine network latency information corresponding to the video frame based on the picture content of the video frame;

[0009] Determine a network response status corresponding to the first application based on the network latency information.

[0010] In a second aspect, embodiments of the present disclosure further provide a network response apparatus, which includes:

[0011] A video stream obtaining module, configured to obtain a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application;

[0012] A network latency determining module, configured to obtain at least one video frame in the video stream during the live broadcast, and determine network latency information corresponding to the video frame based on the picture content of the video frame;

[0013] A response status determination module, configured to determine a network response status corresponding to the first application based on the network delay information.

[0014] In a third aspect, an embodiment of the present disclosure further provides an electronic device, which includes:

[0015] One or more processors;

[0016] A storage device, configured to store one or more programs,

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the network response method as described in any one of the embodiments of the present disclosure.

[0018] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium containing computer-executable instructions, and the computer-executable instructions are used to execute the network response method as described in any one of the embodiments of the present disclosure when executed by a computer processor.

[0019] The technical solution of the embodiment of the present disclosure obtains a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application. With this technical solution, by displaying the video stream of the first application in the live broadcast room, the live broadcast content of the live broadcast room is enriched. During the live broadcast, at least one video frame in the video stream is obtained, and network delay information corresponding to the video frame is determined based on the picture content of the video frame; with this technical solution, the network delay information of each video frame can be obtained more conveniently based on the picture content. Furthermore, a network response status corresponding to the first application is determined based on the network delay information. Furthermore, a network response status corresponding to the first application is determined based on the network delay information, solving the technical problem of network delay in the process of applying the first application when the content of the first application is displayed in the live broadcast room in the related art, and realizing the ability to timely understand the network response situation of the first application when applying the first application during the live broadcast and perform targeted processing on the network delay situation, avoiding the phenomenon of the first application getting stuck, thereby improving the live broadcast effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Combined with the drawings and referring to the following specific embodiments, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more obvious. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic, and the original components and elements are not necessarily drawn to scale.

[0021] Figure 1 It is a flowchart of a network response method provided by an embodiment of the present disclosure;

[0022] Figure 2An example diagram of an interface for matching video clarity applicable to the network response method provided by an embodiment of the present disclosure;

[0023] Figure 3 A schematic flowchart of a process for matching video clarity applicable to the network response method provided by an embodiment of the present disclosure;

[0024] Figure 4 A schematic flowchart of a process for another network response method provided by an embodiment of the present disclosure;

[0025] Figure 5 A schematic flowchart of a process for another network response method provided by an embodiment of the present disclosure;

[0026] Figure 6 An example diagram of a live broadcast response framework applicable to the network response method provided by an embodiment of the present disclosure;

[0027] Figure 7 A schematic structural diagram of a network response device provided by an embodiment of the present disclosure;

[0028] Figure 8 A schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0029] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0030] It should be understood that the various steps recited in the method embodiments of the present disclosure can be executed in a different order and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0031] As used herein, the term "including" and its variants are open-ended, that is, "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0032] It should be noted that concepts such as "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependent relationships.

[0033] It should be noted that the modification of "one" and "multiple" mentioned in this disclosure is illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0034] The names of the messages or information exchanged between multiple devices in the embodiments of this disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0035] It can be understood that before using the technical solutions disclosed in the embodiments of this disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved in this disclosure should be informed to users and the authorization of users should be obtained through appropriate means in accordance with relevant laws and regulations.

[0036] For example, when responding to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application program, server or storage medium that performs the operations of the technical solutions of this disclosure according to the prompt message.

[0037] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving an active request from the user can be, for example, in the form of a pop-up window, and the prompt message can be presented in text in the pop-up window. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0038] It can be understood that the above process of notifying and obtaining user authorization is only illustrative and does not constitute a limitation on the implementation manner of this disclosure. Other manners that meet relevant laws and regulations can also be applied to the implementation manner of this disclosure.

[0039] It can be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of corresponding laws, regulations and related provisions.

[0040] Figure 1The figure is a schematic flowchart of a network response method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation of determining the network response status of a first application during a live broadcast. This method can be executed by a network response device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC, or a server, etc.

[0041] As Figure 1 shown, the method of this embodiment specifically may include:

[0042] S110. Obtain a video stream corresponding to the first application to display the video stream in the live broadcast room of the second application.

[0043] Among them, the second application can be understood as the application that needs to display the video stream. The first application can be understood as other applications except the second application. Exemplarily, the second application can be a live broadcast platform. The first application can be other platforms except the live broadcast platform. Optionally, the first application can be a third-party game application. The video stream can be understood as the video stream obtained after recording the display content of the first application. In the embodiment of the present disclosure, specifically, when using the first application, the screen recording method can be used to record the usage process of the first application, so as to obtain the video stream corresponding to the first application.

[0044] Specifically, after receiving a viewing trigger operation for the live broadcast room of the second application, the video stream corresponding to the first application can be obtained. Furthermore, the video stream can be displayed in the live broadcast room to display the video stream in the live broadcast room of the second application. Among them, the viewing trigger operation can be understood as the trigger operation for displaying the live broadcast room.

[0045] In the embodiment of the present disclosure, the displaying the video stream in the live broadcast room may include: determining a target encoding algorithm corresponding to the live broadcast room to display the video stream in the live broadcast room based on the target encoding algorithm, where the target encoding algorithm is used to reduce the maximum push stream bit rate of the live broadcast room based on the target encoding algorithm while keeping the video clarity of the live broadcast room unchanged.

[0046] Among them, the target encoding algorithm can be understood as an encoding algorithm that can reduce the maximum push stream bit rate of the live broadcast room while keeping the video clarity of the live broadcast room unchanged. The video clarity can include ultra-high definition 1080P, high definition 720P, standard definition 540P, standard definition 480P, and smooth 360p. It can be understood that the higher the video clarity, the clearer the live broadcast picture. The maximum push stream bit rate can be understood as the maximum push stream bit rate for pushing the live broadcast video of the live broadcast room.

[0047] In the embodiments of the present disclosure, the purpose of reducing the maximum streaming bitrate of the live broadcast room is as follows: to reduce the use of the uplink bandwidth, avoid the uplink bandwidth of the first application, and thus optimize the network latency problem of the first application, so as to ensure that the audience can watch the live broadcast screen more smoothly while ensuring sufficient clarity. It should be noted that the uplink bandwidth refers to the bandwidth used to upload data in a network connection, which can be expressed as the speed of sending data to the network.

[0048] In the embodiments of the present disclosure, determining the target encoding algorithm corresponding to the live broadcast room may include: determining the optional encoding algorithms corresponding to the live broadcast room; determining the target encoding algorithm corresponding to the live broadcast room based on the optional encoding algorithms. Among them, the optional encoding algorithms can be understood as the encoding algorithms that the live broadcast room can support. The number of optional encoding algorithms can be one or more. The video clarity corresponding to different optional encoding algorithms can be the same or different. The maximum streaming bitrates corresponding to different optional encoding algorithms can be the same or different. In the embodiments of the present disclosure, selecting the target encoding algorithm corresponding to the live broadcast room from the optional encoding algorithms may specifically be, for the video clarity adopted by the live broadcast room, determining that the live broadcast room supports at least one optional encoding algorithm corresponding to the video clarity. Select the encoding algorithm with the lowest maximum streaming bitrate among the optional encoding algorithms as the target encoding algorithm corresponding to the live broadcast room.

[0049] In the embodiments of the present disclosure, there are various ways to determine the target encoding algorithm corresponding to the live broadcast room based on the optional encoding algorithms. For example, when the number of optional encoding algorithms is one, the optional encoding algorithm can be used as the target encoding algorithm corresponding to the live broadcast room; when the number of optional encoding algorithms is multiple, an encoding algorithm that can reduce the maximum streaming bitrate of the live broadcast room while keeping the video clarity of the live broadcast room unchanged can be selected from the optional encoding algorithms as the target encoding algorithm corresponding to the live broadcast room.

[0050] Exemplarily, obtain the encoding algorithm used to encode the video. Among them, the encoding algorithm may include the H264 encoding algorithm and the H265 encoding algorithm. It should be noted that when the video clarity of the live broadcast room remains unchanged, the bitrate of video encoding using the H265 encoding algorithm is less than the bitrate of video encoding using the H264 encoding algorithm.

[0051] Exemplarily, after the live broadcast starts, it can be determined whether H265 encoding algorithm is supported for encoding; if so, the H265 encoding algorithm can be determined as the target encoding algorithm corresponding to the live broadcast room; furthermore, based on the H265 encoding algorithm, the maximum push stream bit rate of the live broadcast room can be reduced at a preset reduction ratio (such as 80%); if not, it can be determined that the H265 encoding algorithm is not the target encoding algorithm corresponding to the live broadcast room.

[0052] Since the higher the video clarity, the higher the uplink network bandwidth. Therefore, in order to avoid network latency caused by the mismatch between the video clarity and bandwidth of the live broadcast room, in the embodiments of the present disclosure, before the video stream is displayed in the live broadcast room, it may further include: determining the video clarity matching the live broadcast room through network speed measurement. Optionally, network speed measurement may include automatic speed measurement and manual speed measurement.

[0053] As an optional implementation manner in the embodiments of the present disclosure, in the case where the network speed measurement is manual network testing, the video clarity matching the live broadcast room can be determined through manual speed measurement.

[0054] Specifically, as Figure 2 shown, a network speed measurement interface is displayed, where the network speed measurement interface includes a video clarity selection control. After receiving a control trigger operation on the video clarity selection control, a video clarity selection window can be displayed on the network speed measurement interface; where the video clarity selection window displays a network speed measurement control and candidate video clarities, and the candidate video clarity corresponding to the initial video clarity is highlighted; after receiving a control trigger operation on the network speed measurement control, a speed measurement buffer interface can be displayed on the network speed measurement interface, and the video clarity matching the live broadcast room can be matched through network speed measurement, and the matched video clarity is displayed. After the network speed measurement is completed, the video clarity selection window can be switched to, and the initial video clarity displayed in the video clarity selection window is updated to the matched video clarity. After the network speed measurement is completed, a video clarity display window can also be displayed on the network speed measurement interface, where the video clarity display window displays the video clarity matching the live broadcast room. Exemplarily, it can be displayed corresponding to the video clarity selection control. For example, it is displayed on the control identifier corresponding to the video clarity selection control.

[0055] Among them, the initial video clarity can be the default video clarity, or the video clarity selected in response to a selection operation for the candidate video clarity, or the video clarity determined based on the video clarity adopted at a historical moment. It can be understood that the video clarity matching the live broadcast room and the initial video clarity can be the same or different. In the embodiments of the present disclosure, the video clarity matching the live broadcast room is matched by network speed measurement. Specifically, the measurement duration of network speed measurement can be preset, and network test processing is performed based on the measurement duration. The measurement duration can be set according to actual needs and is not specifically limited herein. For example, it can be 3 seconds or 5 seconds, etc.

[0056] As another alternative implementation manner in the present disclosure, in the case where the network speed measurement is an automatic network test, the video clarity matching the live broadcast room can be determined by network speed measurement when a preset speed measurement condition is detected. Exemplarily, the preset speed measurement condition can include but is not limited to opening a preset page or triggering a preset control, etc. By adopting this technical solution, the video clarity matching the live broadcast room can be determined by automatic speed measurement without the user's awareness.

[0057] Specifically, as Figure 3 shown, after entering the live broadcast preparation page or the live broadcast preview page, it can be determined whether the label of the first application is displayed on the screen; if so, it can be determined whether the live broadcast room meets the automatic speed measurement condition; if so, the speed measurement function can be triggered. After the speed measurement function is triggered, it can be determined whether a scenario for interrupting the automatic speed measurement is triggered; if not, it can be determined whether the speed measurement is successful; if so, the speed measurement result can be obtained. Furthermore, the video clarity matching the live broadcast room can be obtained according to the speed measurement result. It can be understood that in the case where the label of the first application is not displayed on the screen, it can be switched to the label of the first application. In the embodiments of the present invention, the situations where network test processing cannot be performed can include: the current live broadcast room does not meet the automatic speed measurement condition; or a scenario for interrupting the automatic speed measurement is triggered; or the speed measurement operation fails to be executed successfully.

[0058] In the above embodiments, after matching the video clarity that matches the live broadcast room through network speed measurement, the video clarity of the live broadcast room can be updated based on the matched video clarity; alternatively, a prompt window can be displayed; wherein, the prompt window includes a confirmation control and a cancellation control. Among them, the confirmation control can be understood as a control for using the matched video clarity as the video clarity of the live broadcast room; the cancellation control can be understood as a control for canceling the use of the matched video clarity as the video clarity of the live broadcast room. After receiving a control trigger operation for the confirmation control, the matched video clarity can be used as the video clarity control of the live broadcast room. Similarly, after receiving a control trigger operation for the cancellation control, it can be characterized that the matched video clarity is not used as the video clarity control of the live broadcast room.

[0059] S120. During the live broadcast, obtain at least one video frame in the video stream, and determine network delay information corresponding to the video frame based on the picture content of the video frame.

[0060] Among them, the number of video frames in the video stream can be one, two, or more than two. In practical applications, the number of video frames in the video stream is usually multiple. The network delay information can include the network response time (Ping value). In addition, the network delay information can also include the application identifier of the first application and the timestamp. Among them, the application identifier can be used to distinguish the first application.

[0061] Specifically, during the live broadcast, at least one video frame in the video stream can be obtained. After obtaining the video frame, for each video frame, the video picture of the video frame can be processed to extract delay information, so that the network delay information corresponding to the video frame can be obtained.

[0062] In the implementation of the present disclosure, the methods for obtaining at least one video frame in the video stream include the following two, and the specific obtaining methods are not limited herein.

[0063] As an optional implementation manner in the embodiments of the present disclosure, obtaining at least one video frame in the video stream may include: after obtaining the video stream corresponding to the first application, the video stream can be frame-divided to obtain the video frames in the video stream.

[0064] As an optional implementation manner in the embodiments of the present disclosure, obtaining at least one video frame in the video stream may include: after obtaining the video stream corresponding to the first application, video frames can be extracted from the video stream at a preset sampling rate to obtain the video frames in the video stream. Among them, the preset sampling frequency can be set according to actual needs, and its value is not specifically limited herein.

[0065] S130. Determine the network response status corresponding to the first application based on the network delay information.

[0066] Among them, the network response status can be understood as the network response status of the first application during the live broadcast. The network response status can include a response delay status and a non-response delay status. The response delay status can be characterized as the network response being in a delayed state. The non-response delay status can be understood as the network being in a normal response state.

[0067] In one embodiment, to determine the network response time in the network delay information, it can be judged whether the network response time exceeds a preset response time threshold; if so, it can be determined that the network response status corresponding to the first application is the response delay status; if not, it can be determined that the network response status corresponding to the first application is the non-response delay status. Among them, the preset response time threshold can be set according to actual experience. It should be noted that a good network response time is generally less than 100 ms. If the network response time exceeds 100 ms, it indicates that the response duration of the first application is relatively long. At this time, the network response status corresponding to the first application is the response delay status.

[0068] In another embodiment, after obtaining multiple network delay information, it is possible to determine the first quantity of the network response times that exceed the preset response time threshold in the multiple network delay information, and determine the second quantity of all the network response times in the multiple network delay information. After obtaining the first quantity and the second quantity, the first quantity and the second quantity can be processed by taking the ratio to obtain a ratio result. After obtaining the ratio result, the network response status corresponding to the first application can be determined based on the ratio result.

[0069] Optionally, determining the network response status corresponding to the first application based on the ratio result can specifically be that, in the case where the ratio result exceeds the preset ratio threshold, it can be characterized that the network response status corresponding to the first application is the response delay status; in the case where the ratio result does not exceed the preset ratio threshold, it can be characterized that the network response status corresponding to the first application is the non-response delay status.

[0070] In the embodiments of the present disclosure, the network response status can include a response delay status; after determining the network response status corresponding to the first application based on the network delay information, it can further include: in the case where the network response status is the response delay status, the maximum streaming bitrate of the live broadcast room can be reduced.

[0071] Specifically, when the network response status is the response delay status, the maximum push stream bitrate of the live broadcast room can be obtained, and the maximum push stream bitrate can be used as an actual parameter and passed to the formal parameter of a predefined push stream bitrate reduction method. After the parameter is passed, the maximum push stream bitrate of the live broadcast room can be reduced by executing the push stream bitrate reduction method. Herein, the push stream bitrate reduction method can be understood as a method for reducing the maximum push stream bitrate of a live broadcast room.

[0072] In the embodiment of the present disclosure, reducing the maximum push stream bitrate of the live broadcast room may include: determining the video clarity corresponding to the live broadcast room, determining the bitrate range corresponding to the video clarity, and reducing the maximum push stream bitrate of the live broadcast room within the bitrate range.

[0073] Specifically, when the network response status is the response delay status, the video clarity and the maximum push stream bitrate corresponding to the live broadcast room can be determined. Furthermore, according to the correspondence between the video clarity and the bitrate range, the bitrate range corresponding to the video clarity can be determined. After determining the bitrate range and the maximum push stream bitrate, the maximum push stream bitrate of the live broadcast room can be reduced within the bitrate range. In the implementation of the present disclosure, reducing the maximum push stream bitrate of the live broadcast room within the bitrate range can reduce the bandwidth pressure on the basis of maintaining the picture quality.

[0074] On the basis of the above embodiments, after reducing the maximum push stream bitrate of the live broadcast room within the bitrate range, it may further include: re-determining the network response status corresponding to the first application; when the network response status is still the response delay status, the video clarity of the live broadcast room can be reduced, and the maximum push stream bitrate of the live broadcast room can be adjusted within the bitrate range corresponding to the reduced video clarity.

[0075] In the embodiment of the present disclosure, there are various ways to reduce the video clarity of the live broadcast room, which are not specifically limited herein. For example, determining the current video clarity of the live broadcast room, determining the video clarity in the preset video clarity that is lower than the current video clarity as the alternative video clarity; when the number of the alternative video clarity is one, the alternative video clarity can be used as the target video clarity of the live broadcast room. When the number of the alternative video clarity is multiple, one video clarity can be randomly selected from each of the alternative video clarities as the target video clarity of the live broadcast room; or, the video clarity adjacent to the current video clarity among each of the alternative video clarities can be determined as the target video clarity of the live broadcast room; or, the video clarity with the lowest clarity among each of the alternative video clarities can be determined as the target video clarity of the live broadcast room.

[0076] Among them, the preset video clarity can be understood as the video clarity preset for the live broadcast room. Among them, the number of preset video clarities can be one, two, or more than two. The alternative video clarity can be understood as the video clarity lower than the current video clarity among the preset video clarities. The target video clarity can be understood as the video clarity obtained after reducing the video clarity of the live broadcast room.

[0077] Based on the above embodiments, after reducing the maximum push stream bit rate of the live broadcast room, when it is detected that the network response status corresponding to the first application is a non-response delay status, the maximum push stream bit rate of the live broadcast room can be restored to make the video picture more delicate and the details more abundant.

[0078] The technical solution of the embodiments of the present disclosure obtains the video stream corresponding to the first application to display the video stream in the live broadcast room of the second application. Through this technical solution, the live broadcast content of the live broadcast room is enriched by displaying the video stream of the first application in the live broadcast room. During the live broadcast, at least one video frame in the video stream is obtained, and the network delay information corresponding to the video frame is determined based on the picture content of the video frame; through this technical solution, the intuitive picture content is used as the object for analysis, and the network delay information of each video frame can be obtained more conveniently. Furthermore, the network response status corresponding to the first application is determined based on the network delay information. Furthermore, the network response status corresponding to the first application is determined based on the network delay information. The technical solution of the embodiments of the present disclosure solves the technical problem of network delay in the process of applying the first application when the content of the first application is displayed in the live broadcast room in the related art, realizes the ability to timely understand the network response situation of the first application when applying the first application in the live broadcast and perform targeted processing on the network delay situation, and avoids the phenomenon of card when applying the first application, thereby improving the live broadcast effect.

[0079] Figure 4 It is a schematic flowchart of another network response method provided by the embodiments of the present disclosure. The technical solution of this embodiment further refines the determination of the network delay information corresponding to the video frame based on the picture content of the video frame on the basis of the above embodiments. Optionally, the determining the network delay information corresponding to the video frame based on the picture content of the video frame includes: performing character detection on the picture content of the video frame to obtain a delay correlation string, and determining the network delay information corresponding to the video frame based on the delay correlation string. The specific implementation can refer to the description of this embodiment. Among them, the same or similar technical features as the foregoing embodiments will not be repeated here.

[0080] As Figure 4 shown, the method of this embodiment may specifically include:

[0081] S210. Obtain the video stream corresponding to the first application to display the video stream in the live broadcast room of the second application.

[0082] S220. During the live broadcast, obtain at least one video frame in the video stream, perform character detection on the picture content of the video frame to obtain a delay-related string, and determine the network delay information corresponding to the video frame based on the delay-related string.

[0083] Among them, the delay-related string can be understood as the string related to the delay obtained after performing character detection on the picture content of the video frame.

[0084] Specifically, analyze the picture content of the video frame, so as to determine the characters in the picture content of the video frame. Furthermore, character detection can be performed on the picture content of the video frame to obtain a character detection result. After obtaining the character detection result, a delay-related string can be obtained based on the character detection result.

[0085] Exemplarily, perform character detection on the picture content of the video frame based on the OCR (Optical Character Recognition) technology, so as to obtain a delay-related string.

[0086] In the embodiments of the present disclosure, the determining the network delay information corresponding to the video frame based on the delay-related string may include: processing the delay-related string to obtain a target-related string, and determining the network delay information corresponding to the video frame based on the target-related string.

[0087] Among them, the target-related string can be understood as the string obtained after processing the delay-related string.

[0088] Specifically, the delay-related string can be processed based on a preset regular expression. Thus, a target-related string can be obtained. Furthermore, the target-related string can be parsed to obtain the substring in the target-related string. The network delay information corresponding to the video frame is obtained based on the substring.

[0089] Optionally, parsing the target-related string may specifically be: determining the delimiter in the target-related string; taking the string between two adjacent delimiters as the substring in the target-related string. Among them, the delimiter can be a delimiter preset in the target-related string, for example, "+", "-", "*" or "#", etc.

[0090] In an embodiment of the present disclosure, processing the delayed association string may include at least one of the following operations: processing the delayed association characters based on the correlation between the delayed association string and the original string; when multiple delayed association strings are recognized in the video frame, the video frame corresponding to the delayed association string may be deleted; when the delayed association string includes a network delay value and the network delay value is within a preset first numerical range, the video frame corresponding to the delayed association string may be deleted.

[0091] Wherein, the original string is the actual string corresponding to the delayed association string in the video frame. The network delay value may be the value of the network delay time. Among them, the first numerical range may be the numerical range for deleting the delayed association string.

[0092] In an embodiment of the present disclosure, processing the delayed association characters based on the correlation between the delayed association string and the original string may specifically be calculating the correlation between the delayed association string and the original string; thereby, the correlation between the delayed association string and the original string can be obtained; when the correlation is lower than a preset correlation threshold, it may indicate that the similarity between the recognized delayed association string and the actual field string in the video frame is low. At this time, the delayed association string may be processed. The preset correlation threshold may be set according to actual requirements and will not be specifically limited here.

[0093] In an embodiment of the present disclosure, when multiple delayed association strings are recognized in the video frame, at this time, the accuracy of the multiple delayed association strings cannot be determined. Then, the video frame corresponding to the delayed association string may be deleted.

[0094] S230. Determine the network response status corresponding to the first application based on the network delay information.

[0095] The technical solution of the embodiment of the present disclosure realizes obtaining the network delay information corresponding to the video frame more conveniently and accurately without the user's awareness by performing character detection on the picture content of the video frame to obtain a delayed association string and determining the network delay information corresponding to the video frame based on the delayed association string.

[0096] Figure 5Schematic flowchart of another network response method provided by an embodiment of the present disclosure. Based on the technical solution of the above embodiment, the determination of the network response status corresponding to the first application based on the network delay information is further refined. Optionally, the determination of the network response status corresponding to the first application based on the network delay information includes: for a single video frame, determining frame response information corresponding to the video frame based on the network delay information; determining the network response status corresponding to the first application based on the frame response information corresponding to multiple video frames. For specific implementation manners, reference may be made to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be described herein again.

[0097] As Figure 5 shown, the method of this embodiment may specifically include:

[0098] S310. Obtain a video stream corresponding to a first application to display the video stream in the live broadcast room of a second application.

[0099] S320. During the live broadcast, obtain at least one video frame in the video stream, and determine network delay information corresponding to the video frame based on the picture content of the video frame.

[0100] S330. For a single video frame, determine frame response information corresponding to the video frame based on the network delay information.

[0101] Among them, the frame response information can be understood as the response information of a single video frame. Optionally, the frame response information may be the network response time. Specifically, for a single video frame, the network delay information corresponding to the video frame can be determined; then, frame response information extraction processing can be performed on the network delay information; thus, frame response information corresponding to the video frame can be obtained.

[0102] In the embodiment of the present disclosure, performing frame response information extraction processing on the network delay information may include: matching the frame response information corresponding to the video frame from the network delay information based on a pre-defined regular expression for matching frame response information.

[0103] S340. Determine the network response status corresponding to the first application based on the frame response information corresponding to multiple video frames.

[0104] Specifically, when the frame response information corresponding to the video frame is the network response time, the network response status corresponding to the first application can be determined based on the network response times corresponding to multiple video frames.

[0105] As an alternative implementation manner in the embodiments of the present disclosure, in the case where there are a preset number of video frames whose network response time exceeds a preset response time threshold, it may be determined that the network response state corresponding to the first application is a response delay state. It should be noted that the preset number may be at least one, and its value can be set according to actual situations and will not be specifically limited herein.

[0106] As another alternative implementation manner in the embodiments of the present disclosure, in the case where there are multiple video frames whose network response time exceeds a preset response time threshold within a preset duration, it may be determined that the network response state corresponding to the first application is a response delay state. Among them, the preset duration may be the entire duration corresponding to the multiple video frames; or, the preset duration may be a sub-duration obtained by dividing the entire duration corresponding to the multiple video frames.

[0107] As yet another alternative implementation manner in the embodiments of the present disclosure, in the case where there are continuously multiple video frames whose network response time exceeds a preset response time threshold, it may be determined that the network response state corresponding to the first application is a response delay state.

[0108] The technical solution of the embodiments of the present disclosure realizes the function of determining the network response state corresponding to the first application based on the frame response information corresponding to the video frame by, for a single video frame, determining the frame response information corresponding to the video frame based on the network delay information; and determining the network response state corresponding to the first application based on the frame response information corresponding to the multiple video frames.

[0109] The embodiments of the present disclosure provide an alternative example of a network response method. Refer to Figure 6 , the live response framework of the embodiments of the present disclosure includes a client, a content delivery network (CDN) server, a video architecture server, a first application live server (such as, a game live server), and an image processing server (such as, an ImageX server). Under this live response framework, the network response method may specifically include:

[0110] After the client starts a live broadcast, a video stream corresponding to the first application can be collected, the video stream can be pushed and processed, and transmitted to the CDN server so that the CDN server performs operations such as receiving or transcoding the video stream.

[0111] After the CDN server performs operations such as receiving or transcoding the video stream, the video stream data can be frame-extracted at regular intervals (such as 2s) to obtain the video frames in the video stream, and the video frames can be sent to the message queue.

[0112] In the first application, the live server can determine whether to perform message consumption processing from the message queue according to a preset consumption frequency. If so, it can call the algorithm service to input the picture to obtain all text information, that is, perform character detection on the picture content of the video frame to obtain the Ping information of the video frame, and can package the Ping information to generate a real-time communication (IM) message for the Ping information and send it to the client so that the client can receive the Ping information.

[0113] After the client receives the Ping information, it can parse out the key information from the Ping information and perform data reporting, that is, determine the network response status corresponding to the first application based on the network delay information.

[0114] In the embodiment of the present disclosure, when the first application live server calls the algorithm service to input the picture to obtain all text information, specifically, by calling the OCR service provided by the image processing server to recognize the text in the picture, character detection is performed on the picture content of the video frame to obtain all text information in the picture content of the video frame.

[0115] In the embodiment of the present disclosure, the Ping information of the video frame may include a Ping value. The specific way to obtain the Ping value may be to perform Ping value extraction processing on the obtained text information, and the text of "number + ms" can be matched as the Ping value through regular expressions.

[0116] The technical solution of the embodiment of the present disclosure solves the technical problem of network delay in the process of applying the first application in the case of the content of the first application displayed in the live broadcast room in the related art, realizes the ability to timely understand the network response situation of the first application when applying the first application in the live broadcast and perform targeted processing on the network delay situation, avoids the phenomenon of card in the application of the first application, and thus improves the live broadcast effect.

[0117] Figure 7 The structural schematic diagram of a network response device provided by the embodiment of the present disclosure is as Figure 7 shown, the device includes: a video stream acquisition module 410, a network delay determination module 420, and a response status determination module 430.

[0118] Among them, the video stream acquisition module 410 is used to acquire the video stream corresponding to the first application to display the video stream in the live broadcast room of the second application; the network delay determination module 420 is used to acquire at least one video frame in the video stream during the live broadcast and determine the network delay information corresponding to the video frame based on the picture content of the video frame; the response status determination module 430 is used to determine the network response status corresponding to the first application based on the network delay information.

[0119] In the technical solution of the embodiment of the present disclosure, a video stream acquisition module acquires a video stream corresponding to a first application to display the video stream in the live broadcast room of a second application. In this technical solution, by displaying the video stream of the first application in the live broadcast room, the live broadcast content of the live broadcast room is enriched. During the live broadcast, a network delay determination module acquires at least one video frame in the video stream and determines network delay information corresponding to the video frame based on the picture content of the video frame. In this technical solution, by analyzing the intuitive picture content as the object, the network delay information of each video frame can be obtained more conveniently. A response state determination module determines a network response state corresponding to the first application based on the network delay information. The technical solution of the embodiment of the present disclosure solves the technical problem that in the case of the content of the first application displayed in the live broadcast room, there is network delay during the application of the first application, realizes the ability to timely understand the network response situation of the first application when the first application is used in the live broadcast and perform targeted processing on the network delay situation, avoids the phenomenon of card in the application of the first application, and thus improves the live broadcast effect.

[0120] Based on the above optional technical solutions, optionally, the network delay determination module 420 is configured to: perform character detection on the picture content of the video frame to obtain a delay association string, and determine network delay information corresponding to the video frame based on the delay association string.

[0121] Based on the above optional technical solutions, the network delay determination module 420 is configured to: process the delay association string to obtain a target association string, and determine network delay information corresponding to the video frame based on the target association string.

[0122] Based on the above optional technical solutions, optionally, the network delay determination module 420 is configured to process the delay association string, including at least one of the following operations: process the delay association character based on the relevance between the delay association string and the original string, where the original string is the actual string corresponding to the delay association string in the video frame; in the case where multiple delay association strings are identified in the video frame, delete the video frame corresponding to the delay association string; in the case where the delay association string includes a network delay value and the network delay value is within a preset first numerical range, delete the video frame corresponding to the delay association string.

[0123] Based on the above optional technical solutions, optionally, the response status determination module 430 is configured to: for a single video frame, determine frame response information corresponding to the video frame based on the network delay information; determine a network response status corresponding to the first application based on the frame response information corresponding to multiple video frames.

[0124] Based on the above optional technical solutions, optionally, the network response status includes a response delay status; the apparatus further includes a first push stream bitrate reduction module; wherein, the first push stream bitrate reduction module is configured to: after determining the network response status corresponding to the first application based on the network delay information, when the network response status is the response delay status, reduce the maximum push stream bitrate of the live broadcast room.

[0125] Based on the above optional technical solutions, optionally, the first push stream bitrate reduction module is specifically configured to: determine the video clarity corresponding to the live broadcast room, determine the bitrate range corresponding to the video clarity, and reduce the maximum push stream bitrate of the live broadcast room within the bitrate range.

[0126] Based on the above optional technical solutions, optionally, the apparatus further includes a second push stream bitrate reduction module; wherein, the second push stream bitrate reduction module is configured to: after reducing the maximum push stream bitrate of the live broadcast room within the bitrate range, re-determine the network response status corresponding to the first application; when the network response status is still the response delay status, reduce the video clarity of the live broadcast room, and adjust the maximum push stream bitrate of the live broadcast room within the bitrate range corresponding to the reduced video clarity.

[0127] Based on the above optional technical solutions, optionally, the video stream acquisition module 410 is configured to: determine a target encoding algorithm corresponding to the live broadcast room, so as to display the video stream in the live broadcast room based on the target encoding algorithm, where the target encoding algorithm is used to reduce the maximum push stream bitrate of the live broadcast room based on the target encoding algorithm while keeping the video clarity of the live broadcast room unchanged.

[0128] Based on the above optional technical solutions, optionally, the apparatus further includes a video clarity matching module; wherein, the video clarity matching module is configured to: before displaying the video stream in the live broadcast room, determine the video clarity matching the live broadcast room through network speed measurement.

[0129] The network response apparatus provided by the embodiments of the present disclosure can execute the network response method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects for executing the method.

[0130] It should be noted that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the embodiments of the present disclosure.

[0131] Figure 8 The following is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring below to Figure 8 , which shows a schematic structural diagram of an electronic device 500 suitable for implementing the embodiments of the present disclosure (such as Figure 8 the terminal device or server in). The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The electronic device shown is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present disclosure.

[0132] As Figure 8 shown, the electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage device 508 into the random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. The editing / output (I / O) interface 505 is also connected to the bus 504.

[0133] Generally, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 8 shows the electronic device 500 having various devices, it should be understood that it is not required to implement or have all the shown devices. More or fewer devices may be alternatively implemented or had.

[0134] In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present disclosure includes a computer program product that includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0135] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

[0136] The electronic device provided in the embodiment of the present disclosure and the network response method provided in the above embodiment belong to the same inventive concept. Technical details not described in detail in this embodiment can be referred to in the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0137] The embodiment of the present disclosure provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the network response method provided in the above embodiment is implemented.

[0138] It should be noted that the computer-readable medium described above in this disclosure can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of a computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0139] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0140] The above computer-readable medium can be included in the above electronic device; or it can exist separately and not be assembled into the electronic device.

[0141] The above computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: obtain a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application; during the live broadcast, obtain at least one video frame in the video stream, and determine network delay information corresponding to the video frame based on the content of the video frame; and determine a network response status corresponding to the first application based on the network delay information.

[0142] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

[0143] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that, in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0144] The units involved in the embodiments of the present disclosure may be implemented in software or in hardware. Among them, the name of the unit does not constitute a limitation to the unit itself in some cases. For example, the first acquisition unit may also be described as "the unit for acquiring at least two Internet protocol addresses".

[0145] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0146] In the context of this disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM or Flash memory), an optical fiber, a portable Compact Disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0147] According to one or more embodiments of the present disclosure, [Example 1] provides a network response method, including: obtaining a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application; during the live broadcast, obtaining at least one video frame in the video stream, and determining network delay information corresponding to the video frame based on the content of the video frame; and determining a network response status corresponding to the first application based on the network delay information.

[0148] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further including:

[0149] Optionally, the determining network delay information corresponding to the video frame based on the content of the video frame includes: performing character detection on the content of the video frame to obtain a delay association string, and determining network delay information corresponding to the video frame based on the delay association string.

[0150] According to one or more embodiments of the present disclosure, [Example 3] provides the method of Example 1, further including:

[0151] Optionally, the determining network delay information corresponding to the video frame based on the delay association string includes: processing the delay association string to obtain a target association string, and determining network delay information corresponding to the video frame based on the target association string.

[0152] According to one or more embodiments of the present disclosure, [Example Four] provides the method of Example One, further comprising:

[0153] Optionally, the processing of the delayed association string includes at least one of the following operations: processing the delayed association characters based on the correlation between the delayed association string and the original string, where the original string is the actual string corresponding to the delayed association string in the video frame; when multiple delayed association strings are identified in the video frame, deleting the video frame corresponding to the delayed association string; when the delayed association string includes a network delay value and the network delay value is within a preset first numerical range, deleting the video frame corresponding to the delayed association string.

[0154] According to one or more embodiments of the present disclosure, [Example Five] provides the method of Example One, further comprising:

[0155] Optionally, the determining of the network response status corresponding to the first application based on the network delay information includes: for a single video frame, determining the frame response information corresponding to the video frame based on the network delay information; determining the network response status corresponding to the first application based on the frame response information corresponding to multiple video frames.

[0156] According to one or more embodiments of the present disclosure, [Example Six] provides the method of Example One, further comprising:

[0157] Optionally, the network response status includes a response delay status; after determining the network response status corresponding to the first application based on the network delay information, further comprising: when the network response status is the response delay status, reducing the maximum streaming bitrate of the live broadcast room.

[0158] According to one or more embodiments of the present disclosure, [Example Seven] provides the method of Example One, further comprising:

[0159] Optionally, the reducing of the streaming bitrate of the live broadcast room includes: determining the video clarity corresponding to the live broadcast room, determining the bitrate range corresponding to the video clarity, and reducing the maximum streaming bitrate of the live broadcast room within the bitrate range.

[0160] According to one or more embodiments of the present disclosure, [Example Eight] provides the method of Example One, further comprising:

[0161] Optionally, after reducing the maximum streaming bitrate of the live broadcast room within the bitrate range, the method further includes: re-determining the network response status corresponding to the first application; in the case where the network response status is still the response delay status, reducing the video clarity of the live broadcast room, and adjusting the maximum streaming bitrate of the live broadcast room within the bitrate range corresponding to the reduced video clarity.

[0162] According to one or more embodiments of the present disclosure, [Example Nine] provides the method of Example One, further including:

[0163] Optionally, the displaying the video stream in the live broadcast room includes: determining a target encoding algorithm corresponding to the live broadcast room, so as to display the video stream in the live broadcast room based on the target encoding algorithm, where the target encoding algorithm is used to reduce the maximum streaming bitrate of the live broadcast room based on the target encoding algorithm while keeping the video clarity of the live broadcast room unchanged.

[0164] According to one or more embodiments of the present disclosure, [Example Ten] provides the method of Example One, further including:

[0165] Optionally, before displaying the video stream in the live broadcast room, the method further includes: determining, through network speed measurement, the video clarity matching the live broadcast room.

[0166] According to one or more embodiments of the present disclosure, [Example Eleven] provides a network response device, including: a video stream acquisition module, configured to acquire a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application; a network delay determination module, configured to acquire at least one video frame in the video stream during the live broadcast, and determine network delay information corresponding to the video frame based on the picture content of the video frame; a response status determination module, configured to determine a network response status corresponding to the first application based on the network delay information.

[0167] The above description is only a preferred embodiment of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0168] Moreover, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the foregoing discussion, these should not be construed as limitations on the scope of the present disclosure. Certain features that are described in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0169] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A network response method, characterized in that, it includes: Obtain a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application; During the live broadcast, obtain at least one video frame in the video stream, and determine network delay information corresponding to the video frame based on the picture content of the video frame; Determine a network response status corresponding to the first application based on the network delay information.

2. The network response method according to claim 1, characterized in that, The determining the network delay information corresponding to the video frame based on the picture content of the video frame includes: Perform character detection on the picture content of the video frame to obtain a delay correlation string, and determine the network delay information corresponding to the video frame based on the delay correlation string.

3. The network response method according to claim 2, characterized in that, The determining the network delay information corresponding to the video frame based on the delay correlation string includes: Process the delay correlation string to obtain a target correlation string, and determine the network delay information corresponding to the video frame based on the target correlation string.

4. The network response method according to claim 3, characterized in that, The processing the delay correlation string includes at least one of the following operations: Process the delay correlation characters based on the correlation between the delay correlation string and the original string, where the original string is the actual string corresponding to the delay correlation string in the video frame; In the case where multiple delay correlation strings are recognized in the video frame, delete the delay correlation strings corresponding to the video frame; In the case where the delay correlation string includes a network delay value and the network delay value is within a preset first value range, delete the delay correlation strings corresponding to the video frame.

5. The network response method according to claim 1, characterized in that, The determining the network response status corresponding to the first application based on the network delay information includes: For a single video frame, determine frame response information corresponding to the video frame based on the network delay information; Determine a network response status corresponding to the first application based on the frame response information corresponding to multiple video frames.

6. The network response method according to claim 1, characterized in that, The network response status includes a response delay status; after determining the network response status corresponding to the first application based on the network delay information, it further includes: In the case where the network response status is the response delay status, reduce the maximum push stream bit rate of the live broadcast room.

7. The network response method according to claim 6, characterized in that, The reducing the maximum push stream bit rate of the live broadcast room includes: Determine the video clarity corresponding to the live broadcast room, and determine the bit rate range corresponding to the video clarity, and reduce the maximum push stream bit rate of the live broadcast room within the bit rate range.

8. The network response method according to claim 7, characterized in that, After reducing the maximum push stream bitrate of the live broadcast room within the bitrate range, the following steps are further included: Re-determine the network response status corresponding to the first application; In the case where the network response status is still the response delay status, reduce the video clarity of the live broadcast room, and adjust the maximum push stream bitrate of the live broadcast room within the bitrate range corresponding to the reduced video clarity.

9. The network response method according to claim 1, wherein, The step of displaying the video stream in the live broadcast room includes: Determine the target encoding algorithm corresponding to the live broadcast room, so as to display the video stream in the live broadcast room based on the target encoding algorithm, wherein the target encoding algorithm is used to reduce the maximum push stream bitrate of the live broadcast room based on the target encoding algorithm while keeping the video clarity of the live broadcast room unchanged.

10. The network response method according to claim 1, wherein, Before displaying the video stream in the live broadcast room, the following steps are further included: Determine the video clarity matching the live broadcast room through network speed measurement.

11. A network response device, wherein, It includes: A video stream acquisition module, configured to acquire a video stream corresponding to a first application to display the video stream in a live broadcast room of a second application; A network delay determination module, configured to acquire at least one video frame in the video stream during the live broadcast, and determine network delay information corresponding to the video frame based on the picture content of the video frame; A response status determination module, configured to determine the network response status corresponding to the first application based on the network delay information.

12. An electronic device, wherein, The electronic device includes: One or more processors; A storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the network response method according to any one of claims 1-10.

13. A storage medium containing computer-executable instructions, wherein, The computer-executable instructions are used to execute the network response method according to any one of claims 1-10 when executed by a computer processor.

14. A computer program product, wherein, The computer program product includes a computer program, and the computer program implements the network response method according to any one of claims 1-10 when executed by a processor.

Images