A live playback processing method, apparatus and system

Abstract

The application discloses a live broadcast playback processing method, device and system, and the method comprises the following steps: in a live broadcast process, according to a received playback command, a predetermined time length is rolled back from a current time point to a starting time point of playback, wherein the predetermined time length is acquired in advance; and live broadcast content between the starting time point and the current time point is played back from the starting time point at a predetermined playback speed of the playback. The application solves the problem that the user's viewing demand cannot be met due to the fact that the live broadcast process cannot be reviewed at any time in the prior art, thereby providing the function of reviewing the live broadcast process at any time, meeting the user's review demand and improving the user's viewing experience.

Description

Technical Field

[0001] This application relates to the field of live streaming, and more specifically, to a live streaming replay processing method, apparatus, and system. Background Technology

[0002] With the development of multimedia communication technology, live streaming has become an increasingly popular way to deliver content. For example, sports events and e-sports are delivered to users through live streaming. During live streams, users want to replay (or watch) some exciting moments. For example, in sports events, there are exciting moments such as sprints crossing the finish line, athletes committing fouls, or goals in ball games; and in e-sports live streams, there are exciting moments such as players' actions.

[0003] Users want to be able to rewatch these highlights. In existing technology, the live stream is also recorded, and the recorded content is made available to users on demand after the live stream ends. Users can watch the live stream on demand, and when playing the program on demand, they can drag the progress bar to select the specific time point they want to see.

[0004] While this method allows for replay, it can only be done via on-demand after the live stream ends. Users cannot replay the content at any time during the live stream, which fails to meet user needs and reduces the user's viewing experience. Summary of the Invention

[0005] This application provides a live broadcast replay processing method, apparatus, and system to at least solve the problem in the prior art where the inability to replay live broadcasts at any time during the broadcast results in the inability to meet users' viewing needs.

[0006] According to one aspect of this application, a live broadcast replay processing method is provided, comprising: during a live broadcast, rewinding from the current time point to the starting time point for replay according to a received replay command for a predetermined duration, wherein the predetermined duration is obtained in advance; and replaying the live broadcast content between the starting time point and the current time point from the starting time point at a predetermined playback speed.

[0007] According to another aspect of this application, a live replay processing apparatus is also provided, comprising: a processing module, configured to, during a live broadcast, rewind from the current time point to the starting time point for replay based on a received replay command, wherein the predetermined time point is pre-acquired; and a replay module, configured to replay the live broadcast content between the starting time point and the current time point from the starting time point at a predetermined playback speed.

[0008] According to another aspect of this application, a live playback processing system is also provided, comprising: a live client and a server, wherein the server is configured to send a live video stream to the live client, and the live client is configured to receive and play the video stream, wherein the live client is further configured to perform the method described above.

[0009] According to another aspect of this application, an electronic device is also provided, including a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the above-described method steps.

[0010] According to another aspect of this application, a readable storage medium is also provided, on which computer instructions are stored, wherein the computer instructions, when executed by a processor, implement the above-described method steps.

[0011] In this embodiment, during a live stream, a replay command is received, and the stream is rewound from the current time point to the starting time point for replay by a predetermined duration. The predetermined duration is pre-obtained. The live stream content between the starting time point and the current time point is then replayed from the starting time point at a predetermined playback speed. This application solves the problem in the prior art where the inability to replay live streams at any time during the stream fails to meet user viewing needs. It provides a function that allows for replaying live streams at any time, satisfying user viewing requirements and improving the user's viewing experience. Attached Figure Description

[0012] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0013] Figure 1 This is a flowchart of the live replay process according to an embodiment of this application;

[0014] Figure 2 This is a schematic diagram of playback processing with configured playback parameters according to an embodiment of this application; and,

[0015] Figure 3 This is a schematic diagram of the playback interface according to an embodiment of this application. Detailed Implementation

[0016] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0017] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0018] Before describing the implementation methods of this application, the technical terms involved in the following implementation methods will be explained.

[0019] Live streaming refers to a program broadcasting method where the program is produced and broadcast simultaneously as an event occurs and develops, providing users with real-time updates on the progress of the event. With the development of network technology, live streaming can now also be conducted online. For example, the live streams described in the following embodiments can be from any field or of any type, such as sports events like football, basketball, badminton, swimming, and cycling, or other types of live streams such as singing, dancing, acrobatics, magic, skits, crosstalk, speeches, cooking, and parent-child games. The following embodiments do not impose specific limitations on this.

[0020] Video-on-demand (VOD) refers to a playback format where multimedia files are stored in online storage space, allowing users to play them whenever they need to. For example, after a live stream ends, the content can be converted into a video file and stored in online storage space, so users can watch the video file online whenever they need to.

[0021] Replay refers to the process of rebroadcasting content that has already been broadcast during a live stream.

[0022] The time-shift function allows users to pause, rewind, and fast-forward to the current moment of a live TV broadcast while watching the program.

[0023] "Bullet Time" is a feature. In the following implementation, this feature, which allows users to replay content during a live stream, is named "Bullet Time." The "Bullet Time" text can be displayed on the live stream interface, and the replay will be triggered when the user clicks on "Bullet Time."

[0024] In a live streaming system, a server and a live streaming client are configured. The server distributes video streams to the live streaming client, which can be installed on various user-used terminal devices (e.g., mobile devices, personal computers). The live streaming client plays the received video stream. Alternatively, the live streaming client can utilize existing software on the terminal device, such as a browser or media player, eliminating the need for a separate live streaming client installation. The live streaming client in the following embodiments can include the various forms described above. In the following embodiments, the live streaming client can cache the received video stream during the live stream and play it back from the cached video stream after the user triggers playback. Alternatively, the server can cache the video stream, and after the user triggers playback, the live streaming client requests the video for playback from the server and plays it back after receiving the video from the server. As another form of live streaming system, an administrator can be configured. This administrator can be an operations personnel. The live streaming client used by the operations personnel has different functions than the live streaming client used by the user. For example, the operations personnel can create a live streaming room through the live streaming client, which is stored on the server. All subsequent live streams performed by the operations personnel can be conducted in this live streaming room. Operators can also perform director-like operations through their live streaming client. For example, they can trigger a replay function. Unlike user-triggered replays, operator-triggered replays will allow all viewers to watch the live stream. Operators can also configure live stream and replay parameters, which will be explained in the following implementation details.

[0025] Live stream replays can be achieved through time-shift functionality. In live streaming systems that support time-shift, the broadcast content is recorded during the live stream and made available to users in real-time. Users can pause the stream and then drag the progress bar to select the desired playback point. This allows users to rewind to any point in the past. Therefore, time-shift is a technology combining live streaming and video-on-demand, and can be seen as a supplement to live streaming.

[0026] While users can pause and rewind live streams with time-shift functionality at any time, they need to manually navigate the playback progress bar to select the desired rewind point. Since highlights in live streams often last only a few seconds, manually dragging the progress bar is inconvenient. Furthermore, users not only want to return to a suitable point in the replay but also desire slow-motion playback to revisit details of exciting moments—features that time-shift functionality cannot fulfill.

[0027] To address this issue, the following embodiments provide a live broadcast replay processing method. In this method, if a user wishes to watch a replay, they only need to trigger a replay command to automatically replay the program content for a predetermined duration, and the replay is performed in slow motion. This processing method requires minimal user intervention to directly view the slow-motion replay of key moments. Figure 1 This is a flowchart of a live playback processing method according to an embodiment of this application, such as... Figure 1 As shown below, Figure 1 The steps involved in the Chinese method will be explained.

[0028] Step S102: During the live broadcast, according to the received replay command, the playback time is rewound from the current time point to the starting time point for replay by a predetermined duration, wherein the predetermined duration is obtained in advance;

[0029] In this step, when a user needs to watch the live stream replay, they simply trigger the replay command. This replay command instructs the live streaming client (or software) to start the replay. It should be noted that... Figure 1 The methods described above and the solutions involved in the following embodiments can be applied to various live streaming clients. For example, they can be embedded into a live streaming client as a live replay function. This live replay function can be configured to be enabled or disabled. If the live replay function is desired, it can be enabled; otherwise, it can be disabled. The enabling or disabling of the live replay function can be set by the user or by the operators based on the content of the live stream. If the operators enable or disable the live replay function, the live replay function will be enabled or disabled for all clients watching the live stream.

[0030] Step S104: Play back the live content between the starting time point and the current time point at the predetermined playback speed, starting from the starting time point.

[0031] The predetermined duration in step S102 and the predetermined playback speed in step S104 are both obtained in advance. Therefore, during playback, the user does not need to drag the progress bar. Instead, the user directly finds the starting point of the playback based on the predetermined duration and then plays back according to the predetermined playback speed. This reduces user operations and makes it very easy for the user to watch the playback. The main consideration for this approach is that during live broadcasts, users often want to watch the key few seconds in slow motion, such as the slow motion of the few seconds before a goal in a ball game. Therefore, the predetermined duration and predetermined playback speed are pre-configured, and playback can be performed according to the pre-configured settings. In a preferred implementation, considering that users mainly revisit exciting moments, the predetermined playback speed can be set to slow motion, and playback can be performed according to the predetermined slow motion speed. In the following implementations, the predetermined playback speed can also be the predetermined slow motion speed. The above steps not only solve the problem of not being able to replay live streams at any time, which fails to meet users' viewing needs, but also provide the function of replaying live streams at any time. Furthermore, the system can pre-determine the scheduled duration and playback speed based on different live streams, thus satisfying users' replay needs and improving their viewing experience.

[0032] To accommodate replays of various live stream types, the aforementioned scheduled duration and / or scheduled playback speed can be pre-configured.

[0033] In one alternative implementation, the predetermined duration and / or predetermined playback speed can be set by the user. For example, the user can configure the playback duration (i.e., predetermined duration) and / or predetermined playback speed according to their own preferences and the live stream content. This configuration can be performed during the live stream or before the live stream begins.

[0034] In another alternative implementation, the scheduled duration and / or scheduled playback speed can also be configured by the operators managing the live stream (e.g., the director or the administrator of the live stream room). For example, the operators can configure the scheduled duration and / or scheduled playback speed before the live stream starts. After the operators configure the parameters, all users watching the live stream can use the parameters configured by the operators to replay the content. This method reduces the configuration operations for users, and users can directly replay the content when they need to watch it.

[0035] In the two optional implementations described above, the live streaming software can receive a configuration command, wherein the configuration command carries the playback configuration information, and the configuration command comes from the user or the operator managing the live stream; then, based on the configuration information in the configuration command, the playback parameters of the live stream are determined, wherein the playback parameters include: the predetermined duration and / or the predetermined playback speed.

[0036] In another alternative implementation, both the operator and the user may have configured a scheduled duration and / or a scheduled playback speed. In this case, the user-configured scheduled duration and / or scheduled playback speed shall prevail. Alternatively, if the operator has configured a scheduled duration and / or scheduled playback speed, the function of allowing the user to configure this parameter shall be disabled, and the parameter configured by the operator shall prevail.

[0037] When providing replay functionality based on a pre-set duration, at least that pre-set duration of the program must be cached to enable replay. There are two caching methods: one is caching on the live streaming server, where all live streaming clients retrieve the cached content for replay; the other is caching locally on the live streaming client, where locally cached content is directly replayed when needed. As an optional implementation, caching can be performed simultaneously on both the live streaming server and the live streaming client, with the cached program duration being greater than or equal to the pre-set duration. If the operator has configured a pre-set duration, it is cached on the live streaming server according to that configuration. If the user has configured a pre-set duration, it is cached locally on the live streaming client according to that configuration (if the user has not configured a pre-set duration, it is also cached according to the operator's configuration). With this approach, when a user attempts to replay, they first retrieve the cached content locally and use the locally cached program for replay. If replaying with the locally cached content fails, then the cached program is retrieved from the live streaming server for replay. This optional implementation method can take into account both user configuration and operator configuration, and caches content both locally and on the live streaming server, improving the reliability of the replay function.

[0038] As another implementation, when the live streaming client replays a program, it continues to receive and cache the live program (or program stream) sent by the live streaming server. T0 is the start time of the live streaming client's replay, and T1 is the end time of the replay. While the live streaming client's playback module performs slow replay from T0 to T1, it simultaneously continues to receive and cache the program stream sent by the live streaming server. When the live streaming client finishes replaying, it determines whether to directly play synchronously. If the result is yes, it synchronously plays the program stream sent by the live streaming server. In this case, the user can synchronize with the program stream played by the live streaming server, but the user cannot see the program during the slow replay period. If the user chooses not to directly play synchronously, the live streaming client retrieves the program stream from the cache and plays it from time T0. This processing method ensures that the user does not miss any live content, but the playback time will lag compared to users who did not replay. In this optional implementation, when replaying from the starting time point to the current time point, the live stream continues from the current time point or the time point to which the live stream has already progressed; and / or, during the replay process, a recovery command issued by the user is obtained, wherein the recovery command is used to indicate the end of the replay and the resumption of the live stream; based on the recovery command, the system jumps to the current time point or the time point to which the live stream has already progressed, and continues the live stream. Which of the above methods is specifically adopted can be selected by the user or pre-configured.

[0039] Configuring the scheduled duration and / or playback speed, whether by users or operators, relies on personal preferences and experience. This approach increases the workload for users or operators and may result in mismatches between the configured scheduled duration and / or playback speed and the live content, potentially affecting the replay experience. Considering this, an alternative implementation can employ an automatic generation method for the scheduled duration and / or playback speed. In this alternative, when creating a live room or program, operators input a descriptive description of the live content, such as event information or participant information for sports live streams. This descriptive information, which typically reflects the characteristics of the live content, can be used to automatically determine the scheduled duration and / or playback speed. Specifically, this alternative may also include the following steps: obtaining the descriptive information of the live stream, wherein the descriptive information describes the live content; and determining the replay parameters for the live stream replay based on the descriptive information, including the scheduled duration and / or the scheduled playback speed. It should be noted that the steps of extracting description information and determining playback parameters based on the description information can be performed by the live streaming client or the server.

[0040] For example, a neural network-based machine learning model can be trained to specifically generate predetermined durations and / or playback speeds. In this example, the predetermined durations and playback speeds configured by operators for each live stream, as well as those configured by users when watching the live stream, can be collected. This description of the live stream content, along with the predetermined durations and playback speeds, can be used as a set of training data. Once the number of collected training data sets exceeds a predetermined number, this data can be used for further training. After training with a supervised machine learning model, a usable machine learning model is obtained. The input to this model is the description of the live stream content, and the output is the predetermined duration and / or playback speed.

[0041] In another alternative implementation, the optimal scheduled duration and / or scheduled playback speed for different live stream types can be collected. Then, the type of live stream is determined based on the description information; the scheduled duration and / or scheduled playback speed corresponding to the live stream type is determined based on the live stream type. For example, for a football match, the optimal scheduled duration is 30 seconds, and the optimal scheduled playback speed is 3x slow motion; for a basketball match, the optimal scheduled duration is 5 seconds, and the optimal scheduled playback speed is 4x slow motion; for an ice hockey match, the optimal scheduled duration is 10 seconds, and the optimal scheduled playback speed is 5x slow motion, etc. The optimal scheduled duration and / or scheduled playback speed for different live stream types are pre-calculated, and then the corresponding live stream type can be found based on the description information. There are many ways to find the live stream type using the description information. For example, keywords can be found by segmenting the description information into sentences, and then the live stream type corresponding to the description information can be determined based on the keywords. If multiple live stream types are determined based on the description information, the longest scheduled duration is selected as the scheduled duration corresponding to that description information, and the slowest scheduled playback speed is selected as the scheduled playback speed corresponding to that description information.

[0042] The above explains the automatic generation of the scheduled duration and / or scheduled playback speed based on the description information. This generated scheduled duration and / or scheduled playback speed can be used as the default configuration. That is, before each live stream begins, operators need to input description information (e.g., the live stream title and a description of the live stream content) during the live stream preview. Operators can input the description information through the live stream client when creating a live stream room or program, or through a dedicated interface provided by the server (e.g., the server can provide a webpage for inputting description information). Then, the default configured scheduled duration and / or scheduled playback speed will be generated based on the description information. If operators or users need to configure the scheduled duration and / or scheduled playback speed themselves, they can do so. The manually configured parameters will override the default configured scheduled duration and / or scheduled playback speed. If operators or users do not configure them themselves, the default configured scheduled duration and / or scheduled playback speed will be used.

[0043] After adopting the above-mentioned configuration method of predetermined duration and / or predetermined playback speed, users generally no longer need to configure it. When they want to watch the playback, they can directly trigger the playback command. There are many ways for users to trigger the playback command. In one optional implementation, obtaining the playback command triggered by the user's predetermined behavior may include the following steps: receiving the operation performed by the user in the software interface of the live broadcast, wherein the operation is an operation on the controls provided on the software interface, or the operation is a predetermined operation issued in the software interface by touching the screen; and triggering the playback command according to the operation.

[0044] In this alternative approach, users can trigger replay commands through the interface of the live streaming software. For example, a dedicated control (an element on the software interface that can receive user input is called a control) can be set up in the live streaming software (or live streaming software client). This control could be a button; when the user presses the button, the replay command is triggered, and the replay will proceed according to a predetermined duration and playback speed. This control can be placed in the control area of ​​the live streaming software, allowing users to trigger the replay function at any time. Alternatively, in another alternative implementation, the control can also appear in the live program playback interface. For example, when a dispute occurs or a goal is scored during a match, the operator can send a command to the live streaming software client to display the control in the live program playback interface. In this case, the control could be a prominent text prompt (such as "Click here for a highlight replay" or "Bullet Time"), prompting the user to replay the highlight moment. The replay begins after the user clicks the control, and the control disappears; or, if the control does not receive a user click within a certain period (such as 5 seconds) after appearing in the live program playback interface, the control disappears. This optional implementation also allows users to be reminded to watch the replay at exciting moments, enhancing the user's viewing experience and increasing user stickiness to the live streaming software.

[0045] In addition to providing controls on the interface, playback functionality can also be triggered via touchscreen. For example, live streaming software can monitor user actions on the touchscreen. If the user performs a predetermined action (e.g., swiping left twice consecutively), a playback command is triggered in response to that predetermined action. Using this method, the user can be prompted to input a predetermined action on the touchscreen before the live stream begins to initiate playback. In practical applications, providing controls and touchscreen input can be combined to offer users more options, making playback triggering easier and further improving the user experience.

[0046] With the development of speech recognition technology, in addition to triggering playback commands via controls and touch screens, playback commands can also be triggered by voice. In this optional implementation, obtaining a playback command triggered by a predetermined user action may include the following steps: receiving voice from the user and extracting keywords from the voice; if the extracted keywords match pre-configured keywords, triggering the playback command. This method allows for pre-configured keywords; for example, the keyword could be "playback," and the playback command is triggered after receiving a voice command from the user including that keyword.

[0047] It should be noted that the above implementation provides one replay mode, for example, a predetermined duration of 10 seconds and a predetermined playback speed of 2x slower. However, considering that various replay scenarios may occur during a live broadcast, another optional implementation can provide multiple replay modes, each corresponding to a different predetermined duration and playback speed. For example, the first replay mode has a predetermined duration of 10 seconds and a predetermined playback speed of 4x slower; the second replay mode has a predetermined duration of 10 seconds and a predetermined playback speed of 3x slower; and the third replay mode has a predetermined duration of 5 seconds and a predetermined playback speed of 3x slower. Users can trigger different replay modes using different operation methods. For example, clicking the control once will use the first replay mode, clicking the control twice will use the second replay mode, clicking the control three times will use the third replay mode, and so on. In this optional implementation, users can determine which method to use for replay and can choose the best replay method based on the live broadcast situation, thus improving the user's viewing experience. The configuration of the different playback modes mentioned above can also be done by users or operations personnel.

[0048] After the user triggers the replay command through the above implementation method, the live broadcast can continue after the replay ends, or the user can stop the replay at any time during the replay process, that is, when replaying from the starting time point to the current time point, the live broadcast can continue; or during the replay process, the user sends a recovery command, wherein the recovery command is used to indicate the end of the replay and the resumption of the live broadcast; the live broadcast can continue according to the recovery command. Figure 2 This is a schematic diagram of playback processing with configured playback parameters according to an embodiment of this application. Figure 2 An optional playback processing flow is presented in the document. Figure 2 The replay function is called "Bullet Time". Using "Bullet Time" as a name prompts users to replay the function, making it more eye-catching. Of course, other names can also be used to name the replay function.

[0049] exist Figure 2 The document demonstrates the process by which operations personnel configure playback parameters, including the aforementioned scheduled duration and scheduled playback speed. Figure 2 This replay parameter is also known as the "bullet time" parameter. For example... Figure 2 As shown, when creating a live stream, operators can configure whether to enable the replay function (i.e., whether to enable bullet time). If bullet time is enabled, operators can set the "bullet time" parameter according to the live stream content or type. Figure 2The bullet time function uses △t to represent the scheduled duration (also known as the rewind duration) and the slow-motion ratio x to represent the scheduled playback speed. Operators can choose to enable the bullet time function as needed and set the corresponding bullet time parameters: rewind duration △t and slow-motion ratio x. Operators can reasonably set the rewind parameters according to the live broadcast content. For example, for basketball games, the process from initiating an offensive action to jumping and shooting to scoring typically lasts about 3 seconds, so the rewind time parameter can be set to 5 seconds. To see the details of the action more clearly, the slow-motion ratio can be set to 4x.

[0050] Alternatively, the rewind duration Δt and slow-motion ratio x can be automatically generated by the live streaming software. In this optional method, the operator inputs descriptive information to describe the live stream content, and then determines the rewind duration Δt and slow-motion ratio x based on this description. For example, the live stream description might be: "The greatest World Cup final between Team A and Team B is about to begin." Segmenting this description reveals keywords such as "World Cup," "final," "Team A," and "Team B." These keywords determine the live stream type as a football match. The optimal scheduled duration and playback speed for a football match are then determined. After this search, the rewind duration Δt is configured to 30 seconds, and the slow-motion ratio x is configured to 3x. After automatically configuring the rewind parameters, they can be displayed to the operator. If the operator adjusts the rewind parameters, the adjusted parameters will prevail.

[0051] After the operations staff sets the "Bullet Time" parameters, the live stream is published and goes live. The Bullet Time parameter configuration will be distributed along with the live stream configuration, and a Bullet Time button will appear in the player.

[0052] During normal viewing of a live stream, users can click the "Bullet Time" button to replay key moments. After clicking, the stream will rewind using preset parameters. For example, if a user clicks the button at time T0, the live stream will rewind to T0-Δt and slow down by x times, allowing the user to easily review the exciting content. When the stream returns to time T0, it automatically resumes normal playback speed, ensuring the user doesn't miss any content during the bullet time. Users can also resume the current live stream at any time during the bullet time viewing.

[0053] In the above Figure 2 In the optional embodiment shown, by setting the bullet time, users can easily achieve slow-motion replay of exciting scenes with a single click.

[0054] During live stream replay, the interface used for replay can be the same as the live stream interface. This approach is relatively easy to implement in live streaming software; the program is displayed in the first area during normal live streaming, and the replay interface is also displayed in the same first area, eliminating the need for an additional area for the replay. However, if users wish to continue watching the live stream during replay, displaying both the live stream and replay in the same area of ​​the software cannot meet their needs. In an alternative implementation, a second area can be created within the first area displaying the live stream (e.g., in the upper left corner of the first area). During replay, the replay content is displayed in the second area, while the live stream continues to be displayed in the first area; alternatively, the live stream content can be displayed in the second area, while the replay content is displayed in the first area. After the replay content is displayed, the area used for displaying the replay is closed, and the first area is used to continue displaying the live stream content. This picture-in-picture approach allows users to see both the live stream and the replay content simultaneously. In another alternative implementation, the replay content can also be displayed using a floating interface that floats above the live stream interface. Users can adjust the position and size of the floating interface. After the replay ends, the floating interface will automatically close, or users can manually close it. While the floating interface is displayed, the live stream content is still displayed on the live stream interface. In this way, users can watch both the live stream and the replay content simultaneously, and the display position of the replay can be adjusted according to the user's needs, improving the user's experience of watching live streams and replays.

[0055] In another optional implementation, if a user replays the content during the live stream, the replay can be saved and displayed in the user's live stream room or the live streaming software they are using. This allows users to select and watch the replays after the live stream ends. This optional implementation generates on-demand videos of the highlights during the live stream and publishes them in the live stream room. Users can click on the video and use the speed-up / rewind function to play the highlights at different speeds. Alternatively, the live stream server records the replay times after each user replays. After the live stream ends, the server provides all the recorded content as on-demand videos. In addition to providing on-demand videos, the server can also select a predetermined number of segments that were replayed by multiple users during the live stream based on the replay times of different users, and provide these segments as on-demand content as well. This optional implementation not only provides on-demand videos after the live stream ends but also offers the most frequently replayed content as highlights, improving the user's on-demand video viewing experience.

[0056] In the playback function provided by the above embodiments, a pre-configured predetermined duration and playback speed are used. As another optional embodiment, besides this "bullet time" playback method, a more conventional playback method can also be provided. In this conventional playback method, the user needs to manually select the playback time and playback rate, requiring more user interaction. This conventional playback method and the playback method provided in the above embodiments can be provided to the user simultaneously as two different playback functions, thus giving the user more choices. The conventional playback method will be described below.

[0057] The playback interface is displayed during the live stream. Figure 3 This is a schematic diagram of the playback interface according to an embodiment of this application, such as... Figure 3 As shown, the playback interface includes a trigger interface for playback and provides playback parameter settings. The trigger can be a button or other formats, with no specific limitation. Playback parameters can include various settings such as playback duration, specified start time, and playback speed. These can be provided to the user in a menu format, allowing the user to customize the settings according to their preferences.

[0058] Retrieve the replay parameters set by the user; when the trigger interface is detected to have been activated by the user, replay the specified segment according to the replay attributes set by the user. The specific segment to be replayed can be any segment from the live stream, such as a highlight of the victory or a match point. The replay duration can be determined based on the user-set replay attributes, such as 10 seconds or 20 seconds.

[0059] The playback interface can also include forward and rewind buttons, and / or a slow-motion playback button. If the user clicks the forward button, the specified segment of the match will be played forward at a preset forward speed; if the user clicks the rewind button, the specified segment of the match will be played backward at a preset rewind speed; if the user clicks the slow-motion playback button, the specified segment of the match will be played at a preset slow-motion playback speed.

[0060] In this optional implementation, a replay parameter setting function is provided, and during the live broadcast, a specified segment of the live broadcast is replayed according to the replay parameters set by the user, which improves user participation and enhances user experience.

[0061] If users find configuring playback parameters manually cumbersome, they can use the pre-configured playback parameters described above to directly play back the live stream, reducing configuration steps.

[0062] In another embodiment, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the methods described above.

[0063] The aforementioned program can run on a processor or be stored in memory (or computer-readable medium). Computer-readable medium includes both permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable medium does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0064] These computer programs may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes can be implemented using different modules, and different steps can be implemented using different modules.

[0065] This embodiment provides such an apparatus or system. The apparatus is called a live broadcast replay processing apparatus, and includes: a processing module, used during a live broadcast to rewind from the current time point to the starting time point for replay based on a received replay command, wherein the predetermined time point is pre-acquired; and a replay module, used to replay the live broadcast content between the starting time point and the current time point from the starting time point at a predetermined playback speed.

[0066] The system or apparatus is used to implement the functions of the methods in the above embodiments. Each module in the system or apparatus corresponds to each step in the method, as has been described in the method and will not be repeated here.

[0067] Optionally, the device may further include: a playback module, configured to, when replaying from the starting time point to the current time point, continue the live stream from the current time point or the time point to which the live stream has already progressed; and / or, during the playback process, acquire a recovery command issued by the user, wherein the recovery command is used to indicate the end of playback and the resumption of the live stream; and, according to the recovery command, jump to the current time point or the time point to which the live stream has already progressed to continue the live stream.

[0068] Optionally, the device further includes: a configuration module, configured to receive a configuration command, wherein the configuration command carries configuration information for the playback, and the configuration command originates from a user or an operator managing the live stream; and to determine playback parameters for the live stream based on the configuration information in the configuration command, wherein the playback parameters include: the predetermined duration and / or the predetermined playback speed.

[0069] Optionally, the device may further include: a determining module, configured to acquire description information of the live stream, the description information being used to describe the live stream content; and to determine the predetermined duration and / or the predetermined playback speed for the live stream replay based on the description information.

[0070] Optionally, the determining module is configured to determine the type of the live stream based on the description information; and determine the predetermined duration and / or the predetermined playback speed corresponding to the type of the live stream.

[0071] Optionally, the device may further include: a trigger module, configured to receive an operation performed by a user in a software interface for live streaming, wherein the operation is an operation performed on controls provided on the software interface, or the operation is a predetermined operation issued in the software interface via a touch screen; trigger the playback command according to the operation; or, receive voice from the user and extract keywords from the voice; and trigger the playback command if the extracted keywords match pre-configured keywords.

[0072] Optionally, the playback module is used to divide a first area into a second area, wherein the first area is the area in the live streaming interface where the video is displayed; to play back the live streaming content between the start time point and the current time point in the second area, and to continue displaying the live streaming content in the first area; or, to play back the live streaming content between the start time point and the current time point in the first area, and to continue displaying the live streaming content in the second area; or, to set a floating interface in the first area; to play back the live streaming content between the start time point and the current time point in the floating interface, and to continue displaying the live streaming content in the first area.

[0073] Optionally, the device may further include a storage module for storing the live content between the revelation time point and the current time point, wherein the stored live content is available for users to watch on demand.

[0074] The above embodiments solve the problem in the prior art that the inability to replay live streams at any time during the live stream fails to meet the user's viewing needs, and thus provide the function of replaying live streams at any time, satisfying the user's replay needs and improving the user's viewing experience.

[0075] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for processing live stream replays, comprising: Obtain the description information of the live stream, which is used to describe the content of the live stream; The descriptive information refers to the relevant information about the live content of the live room or live program that the operator inputs when creating the live room or live program; The predetermined duration and predetermined playback speed for the live stream replay are determined based on the described information. During the live stream, the system can rewind the current time by a predetermined amount of time based on the received replay command, and return to the starting time of the replay. The live stream content between the starting time point and the current time point is replayed from the starting time point at the predetermined playback speed.

2. The method according to claim 1, wherein, Also includes: When rewinding from the starting time point to the current time point, the live stream continues from the current time point or the time point to which the live stream has already progressed. And / or, During playback, a recovery command issued by the user is obtained, wherein the recovery command is used to indicate the end of playback and the resumption of live streaming; based on the recovery command, the system jumps to the current time point or the time point to which the live stream has been conducted and continues the live stream.

3. The method according to claim 1, wherein, Determining the predetermined duration and predetermined playback speed for the live stream replay based on the described information includes: The type of the live stream is determined based on the description information; The predetermined duration and predetermined playback speed are determined based on the type of the live stream.

4. The method according to any one of claims 1 to 3, wherein, The method further includes rewinding the predetermined duration from the current time point to the start time point of playback based on the received playback command: The system receives user actions performed on the software interface during live streaming, wherein the actions are performed on controls provided on the software interface, or the actions are predetermined actions issued via touch screen on the software interface; and triggers the playback command based on the actions; or... The system receives voice messages from the user and extracts keywords from them; if the extracted keywords match pre-configured keywords, it triggers the playback command.

5. The method according to any one of claims 1 to 3, wherein, Playing back the live stream content between the starting time point and the current time point from the starting time point at the predetermined playback speed includes: A second area is defined within the first area, where the first area is the area where the video is displayed on the live streaming interface. The live streaming content between the start time and the current time is replayed within the second area, while the live streaming content continues to be displayed within the first area; or, the live streaming content between the start time and the current time is replayed within the first area, while the live streaming content continues to be displayed within the second area; or... A floating interface is set in the first area; the live broadcast content between the start time point and the current time point is replayed in the floating interface, and the live broadcast content continues to be displayed in the first area.

6. The method according to any one of claims 1 to 3, after replaying the live content between the starting time point and the current time point, the method further includes: The live stream content between the start time point and the current time point is saved, and the saved live stream content is available for users to watch on demand.

7. A live broadcast replay processing device, comprising: A determination module is used to obtain description information of the live stream, wherein the description information is used to describe the live stream content; The descriptive information refers to the relevant information about the live content of the live room or live program that the operator inputs when creating the live room or live program; The predetermined duration and predetermined playback speed for the live stream replay are determined based on the described information. The processing module is used to rewind from the current time to the starting time of the replay based on the received replay command during the live broadcast. The playback module is used to replay the live content between the starting time point and the current time point at a predetermined playback speed, starting from the starting time point.

8. A live broadcast replay processing system, comprising: A live streaming client and a server are defined, wherein the server sends a live video stream to the live streaming client, and the live streaming client receives and plays the video stream. The live replay processing system is used to perform the method according to any one of claims 1-6.

9. An electronic device comprising a memory and a processor; wherein, The memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the steps of the method according to any one of claims 1 to 6.

10. A readable storage medium having computer instructions stored thereon, wherein, When executed by a processor, the computer instructions implement the steps of the method described in any one of claims 1 to 6.

Images