Methods, apparatus, devices, and storage media for generating live streaming playback
By transmultiplying live stream content at intervals and replacing playback data during live streaming, the method addresses timeliness and speed issues in conventional schemes, enabling rapid and seamless access to selected playback data.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2023-12-13
- Publication Date
- 2026-04-21
AI Technical Summary
Conventional live streaming playback generation schemes face challenges in timeliness and speed, as they require transcoding the entire live stream video, which is time-consuming and does not allow immediate playback, especially when using adaptive bitrate streaming protocols like HLS, leading to slow loading and long buffer times.
The proposed solution involves generating playback data during live streaming by transmultiplying live stream content at predetermined intervals, allowing for the selection and generation of playback data based on user-defined or system-determined time constraints, and seamlessly replacing these data to provide quick access to users.
This method enables rapid generation and access to live streaming playback data, supporting user-defined content selection and ensuring seamless playback without interruptions, thereby improving user experience.
Smart Images

Figure 0007849516000001 
Figure 0007849516000002 
Figure 0007849516000003
Abstract
Description
Technical Field
[0005] ,
[0001] [Related Application] This application claims the priority of a Chinese patent application filed on December 30, 2022, with the title "Method, Apparatus, Device and Storage Medium for Generating Live Streaming Playback", and the application number 202211739061.0, the entire content of which is incorporated herein by reference.
[0002] [Technical Field] Embodiments of the present disclosure generally relate to the technical field of computers, and more specifically, to a method, apparatus, device and storage medium for generating live streaming playback.
Background Art
[0003] With the development of computer technology, various live streams can provide people with content in many aspects such as information, education, and entertainment. In a live stream room, various ongoing events can be played back in real time. When a user misses a real-time live stream or wants to review wonderful moments during a live stream, the user often obtains interesting content by watching the live stream playback video.
Summary of the Invention
[0004] In a first aspect of the present disclosure, a method for generating live streaming playback is provided. This method includes a first time in the live stream period that activates the generation of first playback data related to the live stream content from the live stream start time to the first time. In response to the completion of the generation of the first playback data, an access portal for the first playback data is provided. At a second time in the live stream period, the generation of second playback data related to the live stream content from the live stream start time to the second time is activated. In response to the completion of the generation of the second playback data, the second playback data is associated with the access portal to replace the first playback data.
[0005] A second aspect of this disclosure provides an apparatus for generating live streaming playback. The apparatus includes a first playback data generation initiation module configured to initiate the generation of first playback data relating to live streaming content from the start time of the live streaming to the first time at a first time during the live streaming period; an access portal providing module that provides an access portal to the first playback data in response to the completion of the generation of the first playback data; a second playback data generation initiation module configured to initiate the generation of second playback data relating to live streaming content from the start time of the live streaming to the second time at a second time during the live streaming period; and a playback data replacement module configured to replace the first playback data by associating the second playback data with the access portal in response to the completion of the generation of the second playback data.
[0006] A third aspect of the present disclosure provides an electronic device. The device includes at least one processing unit, at least one memory coupled to the at least one processing unit, and at least one memory for storing instructions to be executed by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device causes the device to perform the method of the first aspect.
[0007] A fourth aspect of this disclosure provides a computer-readable storage medium storing a computer program executable by a processor to implement the method of the first aspect.
[0008] It should be understood that the content described in the content portion of the present invention is not intended to limit the key or important features of the embodiments of this disclosure, nor is it used to limit the scope of this disclosure. Other features of this disclosure will be readily apparent from the following description. [Brief explanation of the drawing]
[0009] The above and other features, advantages and aspects of each embodiment of this disclosure will become more apparent upon further detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals indicate the same or similar elements. [Figure 1] The embodiments of this disclosure are schematic diagrams of possible environments. [Figure 2] This is a flowchart of the process for generating live streaming playback according to some embodiments of the present disclosure. [Figure 3] This is a flowchart of the process for associating playback data with an access portal after the end of a live stream, according to some embodiments of this disclosure. [Figure 4] This is a flowchart of a process for generating a playback video based on playback data, according to some embodiments of the present disclosure. [Figure 5] This is a block diagram of an apparatus for generating live streaming playback according to some embodiments of the present disclosure. [Figure 6] This is a block diagram of a device that can implement multiple embodiments of the present disclosure. [Modes for carrying out the invention]
[0010] It is understood that before using any of the technical solutions disclosed in each embodiment of this disclosure, the user must be notified in an appropriate manner in accordance with applicable laws and regulations regarding the types, scope, and scenarios of use of personal information related to this disclosure, and the user's permission must be obtained.
[0011] For example, in response to receiving a proactive request from a user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed requires the acquisition and use of the user's personal information. Thus, the user can autonomously choose, based on the information presented, whether to provide personal information to software or hardware such as electronic devices, applications, servers, or storage media that perform the operation of the proposed technology of this disclosure.
[0012] As an alternative and non-limiting embodiment, a method for sending information to a user in response to receiving a proactive request from the user may be, for example, a pop-up method that can present the information as text. The pop-up window may also include selection controls for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0013] The notification and user authentication process described above are merely illustrative and are not limited to the configuration of the embodiments of this disclosure. It should be understood that other methods for satisfying relevant laws and regulations can also be applied to the embodiments of this disclosure.
[0014] It is understood that the data according to the present invention (including, but not limited to, the data itself, or the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and related provisions.
[0015] The embodiments of this disclosure will be described in more detail below with reference to the drawings. While the drawings illustrate several embodiments of this disclosure, it should be understood that this disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but rather provided for a more complete understanding of this disclosure. It should be understood that the drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0016] It should be noted that the titles of any sections / subsections provided herein are not limiting. Various embodiments are described holistically within this specification, and any type of embodiment may be included in any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.
[0017] In describing embodiments of this disclosure, the term “includes” and similar terms should be understood as open inclusion, i.e., “includes but not limited to.” The term “based on” should be understood as “based at least in part.” The term “one embodiment” or “this embodiment” should be understood as “at least one embodiment.” The term “several embodiments” should be understood as “at least several embodiments.” Other explicit and implicit definitions may also be included below. Terms such as “first,” “second,” etc., may refer to different objects or the same object. Other explicit and implicit definitions may also be included below.
[0018] As used herein, the term “model” refers to a system that can learn the association between corresponding inputs and outputs from training data, thereby enabling it to produce a corresponding output for a given input after training is complete. Model generation can be based on machine learning techniques. Depth learning is a machine learning algorithm that uses multi-layer processing units to process inputs and provide corresponding outputs. In this specification, “model” may also be referred to as “machine learning model,” “machine learning network,” or “network,” as used interchangeably herein. A single model may also include different types of processing units or networks.
[0019] As used herein, a “unit,” “operational unit,” or “subunit” can consist of a machine learning model or network of any suitable structure. As used herein, a set of elements or similar expression can contain one or more such elements. For example, a “set of convolutional units” can contain one or more convolutional units.
[0020] As briefly described above, users often obtain content they are interested in by watching live streaming playback videos. In conventional live streaming playback generation schemes, usually when used after the live stream ends, the live stream video is transcoded by streaming. If transcoding of the entire live stream video is successful, the playback video is provided to the user for display. Such a conventional live streaming playback generation scheme takes time and has poor timeliness, and cannot meet the needs of users who want to watch the playback as soon as possible.
[0021] Currently, several schemes have been proposed to directly deliver the playback video according to the start time and end time using time-shift streaming. However, this scheme requires time-shift streaming using the adaptive bitrate streaming media transfer protocol (HLS) format based on the Hypertext Transfer Protocol (HTTP), and has high requirements for compatibility with the player. Also, due to HLS encoding, the loading speed of the playback video in this scheme is slow, the user side cannot open it quickly, and the buffer time to start playback is long. Therefore, this scheme cannot meet the needs of users who want to watch the playback quickly.
[0022] Currently, several live streaming playback generation schemes for transcoding while live streaming have been proposed. This scheme simultaneously split-transcodes the content played during the live stream and uploads the request after the live stream ends. However, there is still transcoding time in such split transcoding, and the transcoding time is determined by the slice length, and playback cannot be performed immediately after the live stream ends.
[0023] Embodiments of the present disclosure propose a solution for generating live broadcast playback. According to various embodiments of the present disclosure, at a target time (e.g., the first time) during the live broadcast period, generation of playback data for the live broadcast content from the start time of the live broadcast to the target time is started. If the generation of the playback data is completed and an access portal to the playback data is not provided, an access portal to the playback data is provided. If an access portal to the playback data is provided, the playback data is associated with the access portal to replace the previous playback data. If there is a next target time after the target time, generation of the playback data and subsequent replacement of the playback data can be started at the next target time. Thereby, playback data of different lengths can be generated at different times. After these playback data are generated, they can be associated with the access portal so that the user can see them, and the user can quickly view the online live broadcast playback.
[0024] Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings.
[0025] Example of the environment FIG. 1 shows a schematic diagram of an environmental example 100 in which embodiments of the present disclosure can be realized. In this environmental example 100, the electronic device 110 receives live broadcast data 102. The live broadcast data 102 may be real-time video live broadcast data in any format. As the live broadcast continues, the live broadcast data 102 is also updated.
[0026] Based on the received live broadcast data 102, the electronic device 110 generates a plurality of playback data such as playback data 120-1, playback data 120-2,..., playback data 120-N (N may be any natural number greater than 1). For ease of explanation, in this specification, the playback data 120-1, playback data 120-2,..., playback data 120-N can be collectively or separately referred to as "playback data 120".
[0027] As shown in Figure 1, the different playback data 120 generated by the electronic device 110 can have different time intervals. These playback data 120 can correspond to live streaming content from the start time of the live streaming to a certain time during the live streaming period. The electronic device 110 can provide the user with an access portal for the playback data 120. The user can view the playback data 120 of the live streaming data 102 via the access portal. The process of generating the playback data 120 will be described later in relation to Figure 2.
[0028] In some embodiments, the electronic device 110 may be any type of portable terminal, fixed terminal, or mobile terminal, including a mobile phone, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, media computer, multimedia tablet, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camera, positioning device, television receiver, radio receiver, e-book device, game device, or accessories and peripherals for these devices, or any combination thereof. In some embodiments, the terminal device 110 may also support any type of interface for the user, such as a "mountable" circuit.
[0029] In some embodiments, the electronic device 110 may be a server. For example, the electronic device 110 may be various types of computing systems / servers that can provide computing power, including, but are not limited to, mainframes, edge computing nodes, and computing devices in cloud environments.
[0030] The structure and function of each element within Environment 100 are described for illustrative purposes only and should not be interpreted as implying any limitations on the scope of this disclosure.
[0031] Example of a playback data generation process Figure 2 shows a flowchart of process 200 for generating live streaming playback data according to some embodiments of the present disclosure. Process 200 can be implemented in electronic device 110. Process 200 will now be described with reference to Figure 1.
[0032] In block 210, the electronic device 110 initiates the generation of playback data related to the live streaming content from the start time of the live streaming to the target time during the live streaming. In some embodiments, the target time may be one or more predetermined points in time. For example, the target time may be a first time at a predetermined time interval from the start time of the live streaming. The target time may also be the next target time at a predetermined time interval from the previous target time. Multiple target times can be set during the live streaming according to predetermined time intervals. At these target times, the electronic device 110 initiates the generation of playback data related to the live streaming content from the start time of the live streaming to the corresponding target time. That is, the electronic device 110 initiates the generation of corresponding playback data at each predetermined time interval.
[0033] In some embodiments, the predetermined time interval can be arbitrarily set by the electronic device 110 or by the user. For example, the predetermined time interval may be 1 minute, 5 minutes, 10 minutes, or other appropriate time intervals.
[0034] In some embodiments, playback data is generated based on transcoding of at least a portion of the corresponding live streaming content. The transcoding method may be arbitrary, such as HLS, MP4, or other suitable format transcoding.
[0035] In addition or alternatively, in some embodiments, playback data is generated based on transmultiplying at least a portion of the corresponding live streaming content. For example, transmultiplying can be performed using an HTTP-based dynamic adaptive flow (dash). For instance, electronic device 110 can transmultiply live streaming content, such as in HLS format, from the start time of the live stream to the corresponding target time, into playback data (also called vid) in dash format at the target time. Compared to transcoding, generating playback data using transmultiplying can speed up the playback data generation process and the playback data upframing process.
[0036] This method allows for the generation of playback data for live-streamed content corresponding to different time intervals at different times. In this way, transmultiplying can be performed without interruption during live streaming, and playback data for each transmultiplying can be generated. On the other hand, using the dash format ensures that the playback speed is lower than that of formats such as MP4 and HLS, and that the user's playback speed is not higher than that of typical on-demand video.
[0037] As mentioned earlier, conventional live streaming playback generation schemes typically transcode the live stream video using time-shifted streaming after the live stream has ended. In this scheme, playback is generated using the entire live stream video, making it impossible to select which video paragraphs to generate playback from and thus impossible to highlight key content. Similarly, conventional live streaming playback generation schemes that transcode while live streaming also make it impossible to select which video paragraphs to generate playback from and thus impossible to highlight key content.
[0038] Embodiments of this disclosure support the selection of a portion of content within live-streamed content and support the generation of playback data for the selected content. Specifically, in some embodiments, the electronic device 110 can determine time constraint information. The time constraint information indicates at least one period that needs to be processed from the period between the start time of the live stream and the target time. The electronic device 110 can generate playback data corresponding to at least one period.
[0039] If the target time is set to the first time, the time constraint information can indicate at least one period within the first period from the start time of the live stream to the first time that requires processing. The electronic device 110 can generate first playback data corresponding to at least one period.
[0040] In some embodiments, time constraint information may be provided by the user. For example, the user may manually set the start time and / or end time of at least one period within a first period that requires processing, as time constraint information. The electronic device 110 can generate corresponding playback data based on the start time and / or end time of the processing period manually set by the user. For example, if the user only manually sets the start time, the electronic device 110 can generate corresponding playback data based on the start time and the target time. Alternatively, if the user manually sets both the start time and the end time, the electronic device 110 can generate corresponding playback data based on the start time and the end time.
[0041] Additionally or alternatively, in some embodiments, time constraint information may be generated by the electronic device 110. For example, at the start and end of a live stream, there is typically a live stream segment without actual content for a certain period of time. The electronic device 110 can generate time constraint information to remove live stream fragments that do not have actual content.
[0042] By generating playback data based on time constraint information, unnecessary live streaming content can be removed. Furthermore, the system can select live streaming segments that need to be generated based on the user's manual settings, ensuring the generated playback data meets the user's needs. In this way, video trimming during live streaming can be supported. Users can trim live streaming content at any time during the live stream to remove unnecessary content when generating playback data.
[0043] In some embodiments, the electronic device 110 can associate trimmed playback data with the access portal. Additionally or alternatively, in some embodiments, the electronic device 110 can associate both untrimmed and trimmed playback data with the access portal to meet different live streaming playback generation requirements.
[0044] In block 220, the electronic device 110 determines whether the generation of playback data is complete. For example, the electronic device 110 can determine whether the generation of playback data initiated at a target time (e.g., a first time or another time) is complete.
[0045] In some embodiments, if the electronic device 110 determines in block 220 that the generation of playback data is complete, then in block 230, the electronic device 110 determines whether an access portal for playback data has been provided. If the electronic device 110 determines in block 230 that an access portal for playback data has not been provided, then in block 240, the electronic device 110 provides an access portal for playback data. For example, suppose the first time is the first time when playback data generation is initiated. That is, playback data has not been generated by the first time, and an access portal for playback data has not been provided. In this case, if the electronic device 110 generates first playback data corresponding to the first time, the electronic device 110 provides an access portal for the first playback data to block 240.
[0046] In block 250, the electronic device 110 changes the target time to the next target time. As mentioned above, the next target time may be a time at a predetermined time interval from the current target time. In some embodiments, the electronic device 110 can determine whether the live stream has stopped. If the live stream has stopped, the electronic device 110 can determine the next target time as the time the live stream stopped. If the live stream has not stopped, the electronic device 110 changes the target time to the next target time at a predetermined time interval from the current target time.
[0047] If the electronic device 110 changes the target time to the next target time in block 250, the electronic device 110 continues to generate the corresponding playback data in block 210. Taking the second time after the first time as an example, at the second time of the live streaming start time, the electronic device 110 in block 210 starts generating second playback data related to the live streaming content from the live streaming start time to the second time.
[0048] In some embodiments, the electronic device 110 can generate third playback data related to live streaming content from a first time to a second time. The electronic device 110 can generate second playback data based on the first and third playback data. In this way, the playback data generation process can be simplified.
[0049] Similar to the generation of the playback data described above, the second playback data may be generated based on the transmulding of at least a portion of the corresponding live streaming content. During the generation of the second playback data, the electronic device 110 may select at least one period within the second period from the start time of the live streaming to the second time that requires processing, based on time constraint information. The process for generating the second playback data will not be repeated here.
[0050] When the generation of the second playback data is completed, in block 220, the electronic device 110 determines that the generation of playback data is complete. Process 200 proceeds to block 230, where the electronic device 110 determines that an access portal for playback data has been provided. If the electronic device 110 determines that an access portal for playback data has been provided, in block 260, the electronic device 110 associates the playback data (e.g., the second playback data) with the access portal in order to replace the previous playback data (e.g., the first playback data). In this way, replacement of playback data during live streaming can be supported.
[0051] In some embodiments, after generating the second playback data, the electronic device 110 continues to change the target time to the next target in block 250. In this way, the electronic device 110 may repeat the playback data generation and replacement process described above until the live stream ends. By continuously replacing the previous playback data with longer playback data, the longest possible live stream content can be stored in the access portal's playback data. In this way, the publicly available playback content can be preserved as much as possible. On the other hand, this method can ensure that there is enough playback data at the end of the live stream to generate live stream playback. The live stream playback thus generated can be connected virtually seamlessly after the end of the live stream, improving the user experience.
[0052] In some embodiments, when live streaming is enabled, the electronic device 110 can automatically execute process 200 to generate playback data. Additionally or alternatively, in some embodiments, the electronic device 110 can determine whether to enable the automatic shelving function. Whether the automatic shelving function is enabled can be configured by the user. If the electronic device 110 determines that the automatic shelving function is enabled, the electronic device 110 executes process 200. Conversely, if the automatic shelving function is not enabled, the electronic device 110 does not need to execute process 200.
[0053] In some embodiments, embodiments of the present disclosure can also be applied to perform only a single transmultiling or transcoding process during live streaming, for example, so that playback data corresponding to live streaming content for a specified time period is generated accordingly.
[0054] In some embodiments, the electronic device 110 can generate a playback video based on the playback data after the live stream has finished. Next, the process of generating the playback video will be described with reference to Figures 3 and 4.
[0055] Example of a video playback generation process Figure 3 shows a flowchart of process 300 for associating playback data with an access portal after the end of a live stream, according to several embodiments of the present disclosure. Process 300 can be implemented by an electronic device 110. Process 300 will now be described with reference to Figure 1.
[0056] In block 310, the electronic device 110 can determine whether the live stream has ended. If the electronic device 110 determines in block 310 that the live stream has not ended, the electronic device 110 can continue the playback data generation process of process 200 until the live stream ends or until the user instructs it not to end playback generation.
[0057] In some embodiments, if the electronic device 110 determines in block 310 that the live stream has ended, the electronic device 110 changes the access permissions to the access portal in block 320. For example, the electronic device 110 can bring the access portal online on the video platform so that the access portal is changed from internally accessible to publicly accessible. Thus, at this point, the access portal is associated with the latest, completed playback data.
[0058] Alternatively, the electronic device 110 can also bring the access portal for live streaming online at an appropriate time so that the public can access it. This also allows for timely access to the generated playback data during the live stream.
[0059] In some embodiments, in block 330, the electronic device 110 determines whether the generation of target playback data related to the live streaming content from the start time to the end time of the live streaming has been completed. If the electronic device 110 determines in block 330 that the generation of target playback data has not been completed, the electronic device 110 continues the target playback data generation process until the generation of target playback data is completed.
[0060] In block 330, if the electronic device 110 determines that the generation of the target playback data is complete, in block 340, the electronic device 110 can associate the target playback data with the access portal. In this way, the playback data generated at the last target time can be replaced with the target playback data of the live streaming content corresponding to the entire live streaming process. In this way, it is possible to further ensure that there is no content loss in the playback video generated thereafter.
[0061] In some embodiments, when target playback data is associated with an access portal, the electronic device 110 can perform a process 400 for generating a playback video based on the target playback data. In this way, full-range bit transcoding can be performed using the finally generated target playback data after the live stream has ended, and after success, it can be replaced and set aside as the final video.
[0062] Figure 4 shows a flowchart of a process for generating playback video based on playback data, according to several embodiments of the present disclosure. Process 400 can be implemented in the electronic device 110. Process 400 will now be described with reference to Figure 1.
[0063] In block 410, the electronic device 110 can transcode the target playback data into a first playback video having a first resolution. For example, the target playback data may be a dash transmuling data stream having a first resolution (e.g., 1080 P). The electronic device 110 can transcode the target playback data into a first playback video in MP4 or another video format having a first resolution (e.g., 1080 P).
[0064] In block 420, the electronic device 110 can associate the first playback video with the access portal to replace the target playback data. In some embodiments, in block 430, the electronic device 110 generates a second playback video related to the live streaming content from the start time of the live streaming to the end time of the live streaming. The second playback video has a second resolution higher than the first resolution. For example, the second resolution may be 4K resolution. The electronic device 110 can generate the second playback video using currently known or future video conversion methods. The scope of this disclosure is not limited to this.
[0065] In block 440, the electronic device 110 can associate a second playback video with the access portal to replace the first playback video. In this way, a clearer playback video can be provided to the user.
[0066] In some embodiments, in block 450, the electronic device 110 can obtain a clipped version of the second playback video. The clipped version is generated based on the period retained during the live streaming period, from the start time of the live stream to the end time of the live stream. In this way, content can be trimmed at any time during the live stream to remove unwanted live streaming content from the playback video.
[0067] In some embodiments, in block 460, the electronic device 110 generates a set of playback videos corresponding to a set of resolutions based on the clip version. For example, the electronic device 110 can generate a set of playback videos having different resolutions. In another example, the electronic device 110 can generate multiple playback videos based on the clip of live streaming content. Each playback video may include key content or content of high user interest from the live stream. In block 470, the electronic device 110 can associate a set of playback videos with an access portal to replace a second playback video.
[0068] In this way, users can be provided with playback videos in different resolutions. Users can choose the resolution of the video they want to watch according to their actual needs, improving the user experience. On the other hand, by generating multiple playback videos with different content, users can selectively view live streaming content segments that interest them. These playback videos with different resolutions and different content can meet the needs of different users and improve the user experience.
[0069] Examples of devices and apparatus Figure 5 shows a schematic block diagram of a device 500 for generating live streaming playback according to one embodiment of the present disclosure. Device 500 may be implemented in or included in the electronic device 110. Each module / component within device 500 may be implemented in hardware, software, firmware, or any combination thereof.
[0070] As shown in the figure, the device 500 includes a first playback data generation activation module 510, which activates the generation of first playback data related to the live streaming content from the start time of the live streaming to the first time at a first time during the live streaming period. The device 500 further includes an access portal provision module 520, which provides an access portal to the first playback data in response to the completion of the generation of the first playback data. The device 500 further includes a second playback data generation activation module 530, which activates the generation of second playback data related to the live streaming content from the start time of the live streaming to the second time at a second time during the live streaming. The device 500 further includes a playback data replacement module 540, which replaces the first playback data by associating the second playback data with the access portal in response to the completion of the generation of the second playback data.
[0071] In some embodiments, a predetermined time interval is provided between the first time and the second time.
[0072] In some embodiments, the device 500 further includes a time constraint information determination module, which determines time constraint information. The time constraint information indicates at least one period within a first period from the start time of live streaming to a first time that requires processing. In some embodiments, the device 500 further includes a first playback data generation module, which generates first playback data corresponding to at least one period.
[0073] In some embodiments, the generation of the second playback data is at least partially based on time constraint information.
[0074] In some embodiments, the device 500 further includes a third playback data generation module, which generates third playback data relating to live streaming content from a first time to a second time. In some embodiments, the device 500 further includes a second playback data generation module, which generates second playback data based on the first and third playback data.
[0075] In some embodiments, the first playback data and / or the second playback data are generated based on the transmulding of at least a portion of the corresponding live streaming content.
[0076] In some embodiments, the device 500 further includes an access management module, which modifies access permissions for the access portal in response to the end of the live stream.
[0077] In addition or alternatively, in some embodiments, the device 500 further includes a playback data related module, which associates target playback data with the access portal in response to the completion of generating target playback data related to live streaming content from the start time of the live stream to the end time of the live stream.
[0078] In some embodiments, the device 500 further includes a first playback video generation module, which transcodes target playback data into a first playback video having a first resolution. The device 500 also includes a first playback video association module, which associates the first playback video with an access portal to replace the target playback data.
[0079] In some embodiments, the device 500 further includes a second playback video generation module, which generates a second playback video related to the live streaming content from the start time of the live streaming to the end time of the live streaming. The second playback video has a second resolution, which is higher than the first resolution. In some embodiments, the device 500 further includes a second playback video association module, which associates the second playback video with the access portal to replace the first playback video.
[0080] In some embodiments, device 500 further includes a clip version acquisition module, which acquires a clip version of a second playback video. The clip version is generated based on the duration retained during the live streaming period, from the start time of the live stream to the end time of the live stream.
[0081] In some embodiments, the device 500 further includes a third playback video generation module, which generates a set of playback videos corresponding to a set of resolutions based on the clip version. Furthermore, in some embodiments, the device 500 further includes a third playback video association module, which associates the set of playback videos with an access portal to replace the second playback video.
[0082] Figure 6 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 600 shown in Figure 6 is merely illustrative and should not constitute any limitation on the function and scope of the embodiments described herein. The electronic device 600 shown in Figure 6 can be used to implement the electronic device 110 of Figure 1.
[0083] As shown in Figure 6, the electronic device 600 is in the form of a general-purpose electronic device. The components of the electronic device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage devices 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 may be an actual or virtual processor and can perform various processes according to a program stored in memory 620. In a multiprocessor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 600.
[0084] The electronic device 600 typically includes multiple computer storage media. Such media may include, but are not limited to, volatile media, non-volatile media, removable media, and non-removable media, and may be any available media accessible to the electronic device 600. Memory 620 may be volatile memory such as registers, caches, and random access memory (RAM), non-volatile memory such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory, or any combination thereof. Storage device 630 may be removable or non-removable media and may include machine-readable media such as flash drive distributions, disks, or any other media that can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 600.
[0085] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 6, it may provide disk drives for reading from or writing to removable, non-volatile disks (e.g., “floppy disks”). In these cases, each driver may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625, which has one or more program modules and performs various methods or operations of various embodiments of the present disclosure.
[0086] The communication unit 640 enables communication with other electronic devices via a communication medium. Furthermore, the functions of the components of the electronic device 600 can be realized by a single computing cluster or multiple computer devices that can communicate via a communication connection. Therefore, the electronic device 600 can operate in a network environment using logical connections with one or more other servers, network personal computers (PCs), or other network nodes.
[0087] The input device 650 may be one or more input devices such as a mouse, keyboard, or trackball. The output device 660 may be one or more output devices such as a display, speaker, or printer. The electronic device 600 may also communicate with one or more external devices (not shown) via the communication unit 640, if necessary. The external devices may be storage devices, display devices, etc., and communicate with one or more devices configured for the user to interact with the electronic device 600, or with any device (e.g., a network card, modem, etc.) in which the electronic device 600 is configured to communicate with one or more other electronic devices. Such communication may be performed via an input / output (I / O) interface (not shown).
[0088] According to exemplary embodiments of the present disclosure, a computer-readable storage medium is provided which stores computer-executable instructions that are executed by a processor to accomplish the method described above. According to exemplary embodiments of the present disclosure, a computer program product is also provided which is tangibly stored on a non-transient computer-readable medium and includes computer-executable instructions that are executed by a processor to accomplish the method described above.
[0089] Here, various aspects of this disclosure are described with reference to flowcharts and / or block diagrams of methods, apparatus, devices, and computer program products implemented in accordance with this disclosure. It should be understood that each block in a flowchart and / or block diagram, and each combination of blocks in a flowchart and / or block diagram, can be implemented by computer-readable program instructions.
[0090] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a dedicated computer, or other programmable data processing device, and thus a machine can be manufactured that generates a device that, when executed by a computer or other programmable data processing device, implements a function / operation defined in one or more blocks of a flowchart and / or block diagram. These computer-readable program instructions may be stored in a computer-readable storage medium so that a computer, programmable data processing device, and / or other device operates in a particular way, and thus a computer-readable medium on which the instructions are stored includes a product containing instructions that implement various modes of function / operation defined in one or more blocks of a flowchart and / or block diagram.
[0091] Computer-readable program instructions can be loaded into a computer, other programmable data processing device, or other device, and a series of operational steps can be executed on the computer, other programmable data processing device, or other device to generate a computer-implemented process, so that the instructions executed on the computer, other programmable data processing device, or other device can implement a function / operation defined in one or more blocks of a flowchart and / or block diagram.
[0092] The flowcharts and block diagrams in the drawings illustrate the implementable architectures, functions, and operations of several implemented systems, methods, and computer program products in accordance with this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or part of an instruction containing one or more executable instructions for implementing a particular logical function. The functions shown in a block may occur in a different order than the order shown in the drawing, or they may be implemented as alternatives. For example, two consecutive blocks may actually be executed essentially in parallel, and they may also be executed in reverse order depending on the functions they relate to. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, may be implemented in a dedicated hardware-based system that performs a given function or operation, or in a combination of dedicated hardware and computer instructions.
[0093] While various realizations of this disclosure have been described above, these descriptions are illustrative, not exhaustive, and are not limited to the various realizations disclosed. Many modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of the realizations described. The choice of terms used herein is intended to best describe the principle, practical use, or improvements in the technology in the market of each realization, or to enable those skilled in the art to understand each realization disclosed herein.
Claims
1. A method for generating live streaming playback, wherein the method is performed by an electronic device. At the first time point during the live streaming period, the generation of first playback data related to the live streaming content from the start time of the live streaming to the aforementioned first time point is initiated, In response to the completion of the generation of the first playback data, an access portal to the first playback data is provided. At a second time during the live streaming period, the generation of second playback data related to the live streaming content from the start time of the live streaming to the second time is initiated. A method for generating live streaming playback, comprising: in response to the completion of generating the second playback data, associating the second playback data with the access portal and replacing the first playback data.
2. The method according to claim 1, wherein a predetermined time interval is provided between the first time and the second time.
3. Determining time constraint information that indicates at least one time period within the first period from the start time of the live stream to the first time, The method according to claim 1, further comprising generating the first playback data corresponding to at least one time period.
4. The method according to claim 3, wherein the generation of the second playback data is performed at least partially based on the time constraint information.
5. To generate third playback data related to the live streaming content from the first time to the second time, The second playback data is generated based on the first playback data and the third playback data. The method according to claim 1, further comprising:
6. The method according to claim 1, wherein the first playback data and / or the second playback data are generated based on transmulching of at least a portion of the corresponding live streaming content.
7. The method according to claim 1, further comprising changing the access permissions of the access portal in response to the end of the live stream.
8. The method according to claim 7, further comprising associating the target playback data with the access portal in response to the completion of generating target playback data related to the live streaming content from the start time of the live streaming to the end time of the live streaming.
9. Transcoding the aforementioned target playback data into a first playback video having a first resolution, Associating the first playback video with the access portal and replacing the target playback data, The method according to claim 8, further comprising
10. A second playback video is generated related to the live streaming content from the start time to the end time of the live streaming, and the second playback video has a second resolution, the second resolution being higher than the first resolution. The second playback video is associated with the access portal and replaced with the first playback video, The method according to claim 9, further comprising:
11. The clip version of the second playback video is obtained, and the clip version is generated based on the time period retained during the live stream from the start time to the end time of the live stream. Based on the aforementioned clip versions, generate a set of playback videos corresponding to a set of resolutions, Associating the aforementioned set of playback videos with the access portal, and replacing the aforementioned second playback video, The method according to claim 10, further comprising:
12. A first playback data generation activation module is configured to activate the generation of first playback data related to the live streaming content from the start time of the live streaming to the first time, at a first time during the live streaming period. An access portal providing module configured to provide an access portal to the first playback data in response to the completion of the generation of the first playback data, A second playback data generation activation module is configured to activate the generation of second playback data related to the live streaming content from the start time of the live streaming to the second time, at a second time during the live streaming period. A device for generating live streaming playback, comprising: a playback data replacement module configured to replace the first playback data by associating the second playback data with the access portal in response to the completion of the generation of the second playback data.
13. It is an electronic device, At least one processing unit, Includes at least one memory, The electronic device wherein the at least one memory is coupled to the at least one processing unit and stores instructions to be executed by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device causes the electronic device to perform the method according to any one of claims 1 to 11.
14. A computer-readable storage medium, A computer program is stored within it. A computer-readable storage medium in which the computer program is executable by a processor to realize the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Generation method and device of playback video file
CN106412677A
Display device and program
JP2017028388A