Live streaming video generation method and apparatus, device and storage medium
By detecting the explanation status of the live broadcast room objects, the live broadcast video clips and generating media content is solved, and the problem that viewers cannot obtain live broadcast content in real time is improved.
Patent Information
- Application Number
- PCT/CN2024/128150
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-30
- Filing Date
- 2024-10-29
- Publication Date
- 2025-08-21
AI Technical Summary
In traditional live broadcast platforms, viewers cannot obtain live broadcast content in real time without entering the live broadcast room, which affects the promotion effect of the live broadcast room.
By detecting the explanation status of the object in the live broadcast room, obtaining live video clips related to the object, and generating media content when the recommendation conditions are met, and automatically distributing them to the user.
It has improved the access effect of the live broadcast room, attracted interested users to join the live broadcast room, and enhanced the promotion of the live broadcast room.
Smart Images

Figure CN2024128150_21082025_PF_FP_ABST
Abstract
Description
Method, device, equipment and storage medium for generating live video
[0001] This application claims priority to the Chinese invention patent application entitled “Method, apparatus, device and storage medium for live video generation” filed on November 30, 2023, with application number 202311636186.5, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for generating live video. Background Art
[0003] Currently, an increasing number of platforms (e.g., applications, websites, etc.) are designed to provide various services to users. For example, users can publish, browse, and view various multimedia content (e.g., videos) on the platforms. Users can also broadcast or watch live broadcasts on the platforms. The live broadcast content may include content related to at least one object (e.g., explanations of at least one object).
[0004] Summary of the Invention
[0005] In a first aspect of the present disclosure, a method for generating a live video is provided. The method includes: if it is detected that the live broadcast explanation status of a first object corresponding to a live broadcast room is in the explanation state, obtaining a first live broadcast video segment from the live broadcast content of the live broadcast room, the first live broadcast video segment including content related to the first object in the live broadcast content; and if the first live broadcast video segment meets a recommendation condition, generating first media content, the first media content including at least the first live broadcast video segment.
[0006] In a second aspect of the present disclosure, a device for generating a live video is provided. The device includes: a video clip acquisition module configured to, upon detecting that the live explanation status of a first object corresponding to the live broadcast room is in the explanation-in-progress state, acquire a first live video clip from the live broadcast content of the live broadcast room, the first live video clip including content related to the first object in the live broadcast content; and a media content generation module configured to, upon the first live video clip meeting a recommendation condition, generate first media content, the first media content including at least the first live video clip.
[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.
[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0009] In a fifth aspect of the present disclosure, a computer program product is provided, comprising computer program instructions, which implement the image processing method described above when the computer program instructions are executed by a processor.
[0010] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0012] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;
[0013] 2A to 2D are schematic diagrams illustrating example pages for managing live video segments according to some embodiments of the present disclosure;
[0014] 3A to 3C are schematic diagrams illustrating example pages according to some embodiments of the present disclosure;
[0015] FIG4A shows a schematic diagram of an example of a content recommendation page according to some embodiments of the present disclosure;
[0016] FIG4B shows a schematic diagram of an example of a live broadcast page according to some embodiments of the present disclosure;
[0017] FIG5 illustrates a flow chart of an example process for live video generation according to some embodiments of the present disclosure;
[0018] FIG6 shows a schematic structural block diagram of an apparatus for generating live video according to some embodiments of the present disclosure; and
[0019] FIG7 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION
[0020] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0021] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.
[0022] Herein, unless explicitly stated otherwise, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.
[0023] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.
[0024] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0025] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to the electronic device, application, server or storage medium and other software or hardware that performs the operation of the technical solution of the present disclosure based on the prompt message.
[0026] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0027] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0028] FIG1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In environment 100, a user 110 can create and publish various multimedia content through an associated terminal device 120. User 110 can also establish a live broadcast room and provide live content through the associated terminal device 120. In some scenarios, user 110 is also referred to as, for example, the publisher of live content and / or the host, broadcaster, or manager of the live broadcast room.
[0029] One or more users 130-1, 130-2, ..., 130-N can view multimedia content posted by user 110 through their associated terminal devices 140-1, 140-2, ..., 140-N, or watch user 110's live broadcast and participate in the interaction in the live broadcast room. For ease of discussion, users 130-1, 130-2, ..., 130-N may be collectively or individually referred to as users 130, and terminal devices 140-1, 140-2, ..., 140-N may be collectively or individually referred to as terminal devices 140. In some scenarios, users 130 may also be referred to as viewers, listeners, viewers, or participants of multimedia content / live broadcast rooms.
[0030] It should be understood that although FIG1 only shows a single anchor user, in some embodiments, multiple anchor users may initiate live broadcasts in a certain live broadcast room.
[0031] In some embodiments, terminal devices 120 and 140 may each be installed with an application that provides multimedia services, or may be able to access a website that provides multimedia services. Multimedia services may include, for example, live broadcast services. User 110 and user 130 may operate terminal devices 120 and 140 to access the corresponding application or website.
[0032] Accordingly, the terminal device 120 and the terminal device 140 can present various corresponding pages, such as a content browsing page, a content recommendation page, a live broadcast page, etc. The live broadcast page can, for example, provide live broadcast content of a live broadcast room, such as live audio content or live video content.
[0033] In some embodiments, the terminal device 120 and the terminal device 140 can also communicate with the server 150 through the network 152 to realize the provision of multimedia services. The server 150 can provide functions such as management, configuration and maintenance of applications or websites. Note that the terminal device 120 can also present multimedia content posted by other users based on the operation of the user 110, or watch the live broadcasts of other users and participate in the interaction of the live broadcast room, etc., and the terminal device 140 can also publish various types of multimedia content based on the operation of the user 130, or establish a live broadcast room and provide live broadcast content, etc. In the following, the operations described with reference to the terminal device 120 can be similarly implemented on the terminal device 140, and the operations described with reference to the terminal device 140 can also be similarly implemented on the terminal device 120.
[0034] Terminal device 120 and terminal device 140 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phone, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, media computer, multimedia tablet, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camcorder, television receiver, radio broadcast receiver, e-book device, gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal devices 120, 140 can also support any type of interface for the user (such as "wearable" circuit, etc.). Server 150 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.
[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.
[0036] As briefly mentioned above, users can publish, browse, and view various multimedia content on the platform. For example, users can also watch live broadcasts or replays of live broadcast content on the platform. Traditionally, for audience users browsing live broadcasts, only when the user browses the live content in the live broadcast room, the terminal device can respond to the user's operation and present a live video clip for a certain object in the live content on the application page. In addition, when the audience user has not entered the live broadcast room, the terminal device can only present a preview of the live broadcast room on the audience user's content recommendation page, and cannot present the live content in the live broadcast room. This will affect the promotion of the live broadcast room.
[0037] According to an embodiment of the present disclosure, an improved scheme for generating live video is proposed. In this scheme, if the live broadcast explanation status of a first object corresponding to a live broadcast room is detected to be in the explanation state, a first live broadcast video clip is obtained from the live broadcast content of the live broadcast room. The first live broadcast video clip includes content related to the first object in the live broadcast content. If the first live broadcast video clip meets the recommendation conditions, first media content is generated. The first media content includes at least the first live broadcast video clip.
[0038] As a result, live video clips of the subject being explained can be automatically and in real time distributed to users during the live broadcast process, which can attract users who are interested in the live content to join the live broadcast room, helping to improve the access effect of the live broadcast room.
[0039] Example embodiments of the present disclosure are described below with reference to the accompanying drawings.
[0040] For ease of understanding, some examples will first be described with reference to the example pages of Figures 2A to 4B. It should be understood that the pages shown in the accompanying drawings are merely examples, and various page designs may actually exist. The various graphical elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also be present. The embodiments of the present disclosure are not limited in this respect. Example embodiments are described below with reference to the environment of Figure 1. The pages shown in Figures 2A to 4B may be presented by the terminal device 110.
[0041] It should be noted that, in this document, the operations performed by the terminal devices (e.g., terminal device 120 and / or terminal device 140) may be performed with the aid of locally installed related applications. In some embodiments, certain operations may require the support of a server (e.g., server 150) or other devices. For ease of understanding, the following description uses the example of the terminal device performing the operation itself.
[0042] For the anchor user (e.g., user 110), its corresponding terminal device (e.g., terminal device 120) can obtain a first live video clip from the live content of the live broadcast room. In an embodiment of the present disclosure, in response to detecting that the live explanation status of the first object corresponding to the live broadcast room is in the explanation state, the terminal device 120 obtains the first live video clip from the live content of the live broadcast room. The live explanation state may include, for example, a non-explanation state, an explanation-in-progress state, an explanation-ended state, and the like. The present disclosure does not limit the specific live explanation state. If it is detected that the live explanation status of the first object corresponding to the live broadcast room is in the explanation state, the terminal device 120 can determine that the first object is currently being explained in the live broadcast room.
[0043] The first live video clip includes content related to the first object in the live content. The first live video clip may include, for example, a video clip. In some embodiments, the first live video clip may include an explanation of the first object in the entire live content. In this document, the first object and the second object mentioned later refer to objects that are introduced, described, or have other related information provided on the application page. Objects can refer to physical objects, virtual objects, etc., including but not limited to physical goods, virtual goods, services, etc.
[0044] Regarding the specific method of obtaining the first live video segment, in some embodiments, the terminal device 120 may initiate the acquisition of the live content of the live broadcast room in response to detecting that the live broadcast explanation status of the first subject is in the explanation-in-progress state. The terminal device 120 may further determine the acquired live content as the first live video segment in response to detecting that the live broadcast explanation status of the first subject is in the explanation-completed state.
[0045] For example, while the live broadcast room is in the live broadcast state, the terminal device 120 can record a live video clip from the live broadcast content in response to detecting the start of the explanation for the first object (i.e., the live broadcast explanation state of the first object is the explanation-in-progress state), and obtain the recorded live video clip as the first live broadcast video clip in response to detecting the end of the explanation for the first object (i.e., the live broadcast explanation state of the first object is the explanation-ended state). In this case, in some embodiments, while the live broadcast room is in the live broadcast state, the terminal device 120 can, for example, present an explanation control associated with each object in the live broadcast room. The terminal device 120 can determine that the start of the explanation for the first object has been detected in response to detecting a trigger operation (including but not limited to a click operation, a long press operation, a double-click operation, a slide operation, etc.) of the first explanation control for the first object.
[0046] Exemplarily, the live explanation status of a certain object can also be determined by automatically analyzing the live content. In some embodiments, the terminal device 120 can, for example, determine that the explanation of the first object has ended (that is, the live explanation status of the first object is the explanation end state) and the explanation of other objects has begun in response to detecting a trigger operation on the explanation control corresponding to the second object in the live broadcast room. The terminal device 120 can also, for example, present an explanation end control during the explanation of the first object. The terminal device 120 can determine that the explanation of the first object has ended in response to receiving a trigger operation for the explanation end control. The present disclosure does not limit the specific method of detecting the start and end of the explanation.
[0047] In some embodiments, while the live broadcast room is in the live broadcast state, the terminal device 120 can record a live video segment from the live broadcast content in response to detecting that the explanation of the first object has begun (that is, the live broadcast explanation state of the first object is in the explanation state), and in response to detecting that the duration of the acquired live broadcast content has reached a preset duration, the recorded live video segment is obtained as the first live broadcast video segment. The preset duration here can be the duration pre-set by the anchor user of the live broadcast room (such as user 110), the duration pre-set by the backend staff of the application 120, or the duration automatically determined by the terminal device 120, etc. For example, if the preset duration is 1 minute, the terminal device 120 can obtain the recorded live video segment as the first live broadcast video segment in response to detecting that the duration of the acquired live broadcast content has reached 1 minute.
[0048] In some embodiments, before obtaining the first live video clip from the live content of the live broadcast room, the terminal device 120 may also determine whether permission to obtain live video clips from the live broadcast room is enabled. Permissions for live video clips may, for example, include permission to obtain and push live video clips from the live content. If permission to obtain live video clips from the live broadcast room is determined to be enabled, the terminal device 120 may obtain the first live video clip from the live content of the live broadcast room. For example, user 110 may set permissions for the live broadcast room before and / or during the live broadcast (a live broadcast room's permissions may include multiple permissions, including permissions for live video clips). For example, before the live broadcast begins, user 110 may set permissions for the live broadcast room by triggering a settings control on a page for object management (e.g., a product management page). During the live broadcast, user 110 may set permissions for the live broadcast room by triggering a settings control on a page for object presentation (e.g., a product list page). The terminal device 120 may determine permissions for the live broadcast room based on the user's settings.
[0049] As shown in Figures 2A to 2D , before the live broadcast begins, the terminal device 120 may present page 200 shown in Figure 2A . Page 200 may, for example, be a product management page. Page 200 includes a settings control 201. In response to receiving a trigger operation for settings control 201, the terminal device 120 may present page 200 shown in Figure 2B . Page 200 shown in Figure 2B includes a settings page 210. Settings page 210 includes multiple entries for setting permissions for the live broadcast room.
[0050] In response to receiving a trigger operation for setting permissions for a live video clip (e.g., entry 211), the terminal device 120 may present page 200 as shown in FIG2C . Page 200 shown in FIG2C includes page 220 for setting permissions for the live video clip. Permissions for the live video clip may also include multiple permissions (e.g., permission to record the live video clip, permission to publish the live video clip, permission to replay the live video clip, etc.). Page 220 may provide on / off controls for multiple permissions for the live video clip (e.g., including on / off controls 222 for setting permissions for recording and publishing the live video clip). For example, in response to receiving a trigger operation for on / off control 222, the terminal device 120 may determine whether permission to obtain live video clips from the live broadcast room is enabled. For example, in response to receiving an on operation for on / off control 222, the terminal device 120 may determine that permission to obtain live video clips from the live broadcast room is enabled. The terminal device 120 may then obtain a first live video clip from the live content of the live broadcast room.
[0051] For example, the terminal device 120 may also present a detail control in association with at least one of the multiple operation controls. In response to receiving a trigger operation on the detail control, the terminal device 120 may switch to a detail description page presenting the permission / operation control corresponding to the detail control. Exemplarily, as shown in FIG2C , the terminal device 120 may present a detail control 221 in association with the description information of the on / off control 222 (the description information of each on / off control may, for example, indicate its corresponding permission). In response to receiving a trigger operation on the detail control 221, the terminal device 120 may switch to presenting the page 200 shown in FIG2D . The page 200 shown in FIG2D includes a detail description page 230 for the on / off control 222. The detail description page 230 may, for example, present detailed description information of the on / off control 222 (e.g., detailed description information of its corresponding permission).
[0052] After obtaining the first live video clip corresponding to the first object from the live content, the terminal device 120 can determine whether the first live video clip meets the recommendation condition, and generate the first media content if the first live video clip meets the recommendation condition. The first media content includes at least the first live video clip. Any user browsing the first media content can access the live broadcast room of user 110 by triggering the viewing entrance. In some embodiments, the first media content may also include text content. The text content may be determined based on the content in the first live video clip and / or pre-set text content. In some embodiments, the pre-set text content may be pre-set by a relevant user (such as the anchor user of the live broadcast room, the backstage staff of the live broadcast application, etc.), or the terminal device 120 may automatically determine it based on historical data, etc. For example, the pre-set text content may include the name of the anchor user, the topic, etc. pre-set by the anchor user.
[0053] In some embodiments, the recommendation condition may include the relevance of the first live video clip to the first object meeting a preset relevance threshold. The preset relevance threshold may be pre-set by a relevant user (e.g., the host of a live broadcast room, a backend staff member of a live broadcast application, etc.), or automatically determined by the terminal device 120 based on historical data. For example, the terminal device 120 may determine the relevance of the first live video clip to the first object based on a predetermined rule or using a model. The terminal device 120 may then compare the determined relevance with a preset relevance threshold to determine whether the relevance of the first live video clip to the first object meets the preset relevance threshold. For example, in response to the relevance of the first live video clip to the first object being greater than the preset relevance threshold, the terminal device 120 may determine that the relevance of the first live video clip to the first object meets the preset relevance threshold. The terminal device 120 may then determine that the first live video clip meets the recommendation condition and generate first media content based at least on the first live video clip. In this way, media content can be generated based on a live video clip that is strongly related to the object being explained.
[0054] In some embodiments, the recommendation conditions may further include one or more of the following: the duration of the first live video segment meets a preset duration threshold, the content quality of the first live video segment meets a preset quality threshold, and the number of live video segments published in the live broadcast room related to the first object does not exceed a preset number threshold. Similarly, the preset duration threshold, preset quality threshold, preset number threshold, etc. herein may be pre-set by a relevant user (e.g., the host user of the live broadcast room, backend staff of the live broadcast application, etc.), or automatically determined by the terminal device 120 based on historical data, etc.
[0055] For example, terminal device 120 can also determine the content quality of the first live video segment based on predetermined rules or using a model. Terminal device 120 can then compare the determined content quality of the first live video segment with a preset quality threshold to determine whether the content quality of the first live video segment meets the preset quality threshold. For example, terminal device 120 can determine that the content quality of the first live video segment meets the preset quality threshold in response to the content quality of the first live video segment being greater than the preset quality threshold. In this way, media content can be generated based on live video segments with higher explanation quality or value.
[0056] The terminal device 120 can also directly obtain the duration of the first live video segment. For example, the terminal device 120 can compare the duration of the first live video segment with a preset duration threshold to determine whether the duration of the first live video segment meets the preset duration threshold. For example, in response to the duration of the first live video segment being greater than the preset duration threshold, the terminal device 120 can determine that the duration of the first live video segment meets the preset duration threshold. In this way, media content can be generated based on live video segments with appropriate explanation durations. In some embodiments, the preset duration threshold can also include a first threshold and a second threshold, where the first threshold indicates a lower limit for constraining the duration of the live video segment, and the second threshold indicates an upper limit for constraining the duration of the live video segment. In this case, the terminal device 120 can determine that the duration of the first live video segment meets the preset duration threshold in response to the duration of the first live video segment being between the first threshold and the second threshold (e.g., greater than the first threshold and less than the second threshold). In this way, media content can be generated based on video segments that are too long or too short, thereby avoiding affecting the content quality of the generated media content.
[0057] In some embodiments, the terminal device 120 can also directly determine the number of published live video clips related to the first object in the live broadcast room. For example, the recommendation condition can be configured so that for a specific live broadcast room, live video clips related to the same object are allowed to be pushed once or several times (a preset value). That is, one or several media contents are generated for the same object. In this way, if one or several live contents including live video clips of the first object have been generated previously, then the first media content may no longer be generated based on the currently acquired first live video clip. Of course, the preset number threshold for the same object here can be configured according to actual application needs, and the embodiments of the present disclosure do not limit this.
[0058] In some embodiments, while the live studio is in a live broadcast state (i.e., while the live studio is in a live broadcast state), terminal device 120 can further publish the first media content so as to display the first media content on a content recommendation page of at least one user. In some embodiments, the first media content is published as content associated with the host user of the live studio (e.g., user 110). For example, the first media content can be published as content created by user 110.
[0059] It should be noted that the first object described above is any one of the multiple objects corresponding to the live broadcast room. While the live broadcast room is live, the terminal device 120 can retrieve a live video clip associated with any object from the live broadcast room's content and publish media content including the live video clip and a viewing entry corresponding to the live broadcast room to at least one user's content recommendation page. In some embodiments, the corresponding media content is only published to the content recommendation page if it is determined that the live broadcast video clip meets corresponding recommendation criteria. For example, in some embodiments, the terminal device 120 can also retrieve a second live video clip from the live broadcast room's content, the second live video clip including content related to the second object within the live broadcast content. For example, in response to determining that the second live video clip meets the recommendation criteria, the terminal device 120 can generate second media content for the second live video clip. Furthermore, while the live broadcast room is live, the terminal device 120 can publish the second media content to the content recommendation page of at least one user. The second media content can also include a viewing entry corresponding to the live broadcast room to facilitate access to the live broadcast room. The at least one user to whom the second media content is published can be different from the at least one user to whom the first media content is published. That is, while the live broadcast room is in the live broadcast state, the terminal device 120 can obtain live video clips associated with any number of objects, and publish at least one of the obtained live video clips to the content recommendation pages of different users.
[0060] In some embodiments, in response to detecting that the live broadcast room is in the live broadcast end state (i.e., the live broadcast of the live broadcast room has ended), the terminal device 120 can stop publishing the first media content. In this case, the first media content including the first live broadcast video clip will not be displayed on the user's recommendation page. The publishing operation for the first live broadcast video clip (i.e., the publishing operation for the first media content) is performed while the live broadcast room is in the live broadcast state.
[0061] Regarding the specific method of judging whether the live broadcast room is in the live broadcast end state, in some embodiments, the terminal device 120 can determine that the live broadcast room is in the live broadcast end state in response to the live broadcast room being stopped. In some embodiments, the terminal device 120 can also judge whether the live broadcast room is in the live broadcast end state based on the attribute value of the first object. The attribute value of the first object here can be, for example, the price of the first object. The terminal device 120 can detect the price of the first object in real time, and determine that the live broadcast room is in the live broadcast end state when the current price of the first object is higher than the price of the first object in the first live video clip. It can be understood that the terminal device 120 can also use any appropriate strategy to judge whether the live broadcast room is in the live broadcast end state, and the present disclosure does not limit the specific judgment method.
[0062] In some embodiments, the terminal device 120 may also present the first media content including the first live video clip in the live content aggregation page of the user 110. As shown in Figures 3A and 3B, the terminal device 120 may also present the user homepage of the user 110 (e.g., page 300A). Page 300A may present an entry 301 of the live content aggregation page. In response to detecting a trigger operation for the entry 301, the terminal device 120 may present page 300B shown in Figure 3B. Page 300B is also the live content aggregation page of the user 110. Page 300B may present at least one media content (e.g., media content 310, media content 320, media content 330) of the user 110 and associated with the live broadcast room. Each of the at least one media content may include a live video clip associated with a certain object. For example, page 300B may present the first media content including the first live video clip. After the first media content is released, no matter whether the live broadcast room is in the live broadcast state or the live broadcast state is ended, the anchor user can always view the released media content from the live broadcast content aggregation page.
[0063] On the live content aggregation page, the terminal device 120 can, for example, switch to a browsing page presenting the media content in response to receiving a trigger operation from the user 110 for a certain media content related to the live content. For example, the terminal device 120 can switch to a browsing page 300C presenting the media content 310 shown in FIG3C in response to receiving a trigger operation for the media content 310. The browsing page 300C can present a viewing entry 340 for the object corresponding to the media content 310. For example, the terminal device 120 can switch to a details page presenting the object in response to detecting a trigger operation for the viewing entry 340.
[0064] The above describes the provision of live video clips on the host user side and related embodiments. Accordingly, in an embodiment of the present disclosure, for a viewer user (e.g., user 130), their corresponding terminal device (e.g., terminal device 140) obtains a first live video clip of the live content in the live studio while the live studio is in the live broadcast state. The first live video clip includes content related to a first object in the live content. For example, the first live video clip may include a video clip. In some embodiments, the first live video clip may include an explanation of the first object within the entire live content. This first live video clip may, for example, be sent to terminal device 140 by a server (e.g., server 150). After obtaining the first live video clip, terminal device 140 presents first media content, including the first live video clip, on user 130's content recommendation page. It should be understood that user 130 here refers to any of the at least one user to whom terminal device 120 publishes content. In some embodiments, the first media content is published as content associated with the host user (e.g., user 110) in the live studio. For example, the first media content may be published as content created by user 110.
[0065] The viewing entry included in the first media content can be any appropriate viewing entry related to the live broadcast room. The viewing entry corresponding to the live broadcast room can be used to access the page corresponding to the live broadcast room. For example, the viewing entry included in the first media content can be a specific operation control, an avatar of the anchor user (such as user 110), and so on. The present disclosure does not limit the specific viewing entry. For example, as shown in Figure 4A, the terminal device 140 can present page 400A to the user 130. Page 400A is the content recommendation page for user 130. Page 400A presents the first live video clip of the first object and a viewing entry 401. Page 400A also presents the anchor user's avatar 402 and at least one operation control for the first media content. The viewing entry 401 and avatar 402 here can both be regarded as viewing entries for the live broadcast room.
[0066] As described above, the host user's terminal device publishes the first live video clip to at least one user only while the live broadcast room is in the live broadcast state. Therefore, the terminal device (e.g., terminal device 140) of the audience user (e.g., user 130) can present the first media content on the content recommendation page (e.g., page 400A) of user 130 only while the live broadcast is in the live broadcast state. In this case, terminal device 140 can jump from the content recommendation page (i.e., page 400A) to the live broadcast page corresponding to the live broadcast room in response to detecting a trigger operation on the viewing entry (viewing entry 401 and / or avatar 402).
[0067] In some embodiments, the terminal device 140 can directly present the live page in response to the content related to the first object in the live broadcast room being broadcast live. In other embodiments, the terminal device 140 can also superimpose an object window and / or the details page of the first object on the live page in response to the content related to the first object in the live broadcast room not being broadcast live. The object window here can include details page entries for each of the multiple objects, and the multiple objects include at least the first object. For example, as shown in Figure 4B, the terminal device 140 can jump from the content recommendation page (i.e., page 400A) to the live page corresponding to the live broadcast room (i.e., page 400B) in response to the content related to the first object in the live broadcast room not being broadcast live. The terminal device 400B can have an object window 410 superimposed on it. The object window 410 includes details page entries for each of the multiple objects (e.g., entry 411-1, entry 411-2, entry 411-3, etc.). The multiple objects include the first object (e.g., the object corresponding to entry 411-1).
[0068] In some embodiments, the terminal device 140 may, in response to detecting a trigger operation for a viewing entry in the first media content, present the details page entry (i.e., entry 411-1) corresponding to the first object at the top of the object window of the live broadcast page. Alternatively or additionally, in some embodiments, if the live broadcast room is currently explaining any object other than the first object, the terminal device 140 may also present the details page entry corresponding to the currently explained object at the top of the object window of the live broadcast page, and present the details page entry corresponding to the first object below the details page entry. For example, if the live broadcast room is currently explaining any object other than the first object, the terminal device 140 may present the details page entry corresponding to the currently explained object in the first position of the object window, and present the details page entry corresponding to the first object in the second position of the object window.
[0069] In some embodiments, in order to allow the user 130 to know the first object quickly and easily, the terminal device 140 can also present a preset label (such as label 412) at the details page entrance of the first object (i.e., entrance 411-1) in the object window. Thus, the user can more easily notice the first object in the object window by specially marking the details page entrance of the first object. The label 412 here can always be presented at the details page entrance of the first object, or, in response to switching to the live broadcast page, the label 412 is presented at the entrance 411-1, and in response to the presentation time of the label 412 reaching the preset time, the presentation of the label 412 is cancelled.
[0070] In some embodiments, when jumping from the first media content on the content recommendation page to the live broadcast room, the object window 410 shown in Figure 4B may not be presented. Instead, the details page of the first object may be presented after switching to the live broadcast room. For example, at least a portion of the details page may be superimposed and presented in the live broadcast room page in a manner similar to the object window 410. In this way, the details of the first object that the user may be more interested in can be directly presented to the user. In some embodiments, alternatively, when accessing the live broadcast room from the first media content on the content recommendation page, only the live broadcast room page may be presented to facilitate the user to watch the current live broadcast content without superimposing the object-related information. The user can trigger corresponding interactions in the live broadcast room page as needed.
[0071] The above discussion discusses the presentation of the first media content including the first live video clip on the viewer user side. For the release of different live video clips in the same live broadcast room, they can all be presented on the viewer user side in a similar manner and have a similar interactive manner.
[0072] In summary, according to the embodiments of the present disclosure, live video clips corresponding to the explanation objects can be automatically generated during the live broadcast process. The generated live video clips can be automatically and real-timely distributed to users as needed, attracting users interested in the live content to join the live broadcast room, which helps to improve the accessibility of the live broadcast room.
[0073] FIG5 shows a flowchart of an example process 500 for generating live video according to some embodiments of the present disclosure. Process 500 may be implemented at a terminal device of a host user (e.g., terminal device 120). Process 500 is described below with reference to FIG1.
[0074] In block 510 , if it is detected that the live explanation state of the first object corresponding to the live broadcast room is in the explanation state, the terminal device obtains a first live video clip from the live content of the live broadcast room, where the first live video clip includes content related to the first object in the live content.
[0075] In block 520 , if the first live video segment meets the recommendation condition, the terminal device generates first media content, where the first media content includes at least the first live video segment.
[0076] In some embodiments, process 500 further includes: while the live broadcast room is in a live broadcast state, publishing the first media content so as to display the first media content on a content recommendation page of at least one user.
[0077] In some embodiments, the first media content further includes text content, and the text content is determined based on at least one of the following: content in the first live video segment, and pre-set text content.
[0078] In some embodiments, the recommendation condition includes that the relevance between the first live video segment and the first object meets a preset relevance threshold.
[0079] In some embodiments, the recommendation condition also includes at least one of the following: the duration of the first live video segment meets a preset duration threshold, the content quality of the first live video segment meets a preset quality threshold, and the number of published live video segments related to the first object in the live broadcast room does not exceed a preset number threshold.
[0080] In some embodiments, obtaining a first live video clip from the live content of the live broadcast room includes: if it is detected that the live explanation status of the first object is in the explanation state, starting to obtain the live content of the live broadcast room; and if it is detected that the live explanation status of the first object is in the explanation end state or it is detected that the duration of the obtained live content reaches a preset duration, determining the obtained live content as the first live video clip.
[0081] In some embodiments, obtaining the first live video clip from the live content of the live broadcast room includes: determining whether the permission to obtain the live video clip of the live broadcast room is enabled; and if it is determined that the permission to obtain the live video clip of the live broadcast room is enabled, obtaining the first live video clip from the live content of the live broadcast room.
[0082] In some embodiments, the first object is any one of the multiple objects corresponding to the live broadcast room.
[0083] In some embodiments, the process 500 further includes: if it is detected that the live broadcast room is in a live broadcast end state, stopping publishing the first media content.
[0084] In some embodiments, process 500 further includes: presenting the first media content in a live content aggregation page of the anchor user in the live broadcast room.
[0085] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG6 shows a schematic structural block diagram of an apparatus 600 for generating live video according to some embodiments of the present disclosure. Apparatus 600 can be implemented as or included in a terminal device (e.g., terminal device 120). Each module / component in apparatus 600 can be implemented by hardware, software, firmware, or any combination thereof.
[0086] As shown in FIG6 , apparatus 600 includes a video clip acquisition module 610 configured to, upon detecting that the live broadcast explanation status of a first subject corresponding to the live broadcast room is in the explanation-in-progress state, acquire a first live video clip from the live broadcast content of the live broadcast room, the first live video clip including content related to the first subject in the live broadcast content. Apparatus 600 also includes a media content generation module 620 configured to, upon detecting that the first live video clip meets a recommendation condition, generate first media content, the first media content including at least the first live video clip.
[0087] In some embodiments, the apparatus 600 further includes: a media content publishing module configured to publish the first media content while the live broadcast room is in a live broadcast state, so as to display the first media content in a content recommendation page of at least one user.
[0088] In some embodiments, the first media content further includes text content, and the text content is determined based on at least one of the following: content in the first live video segment, and pre-set text content.
[0089] In some embodiments, the recommendation condition includes that the relevance between the first live video segment and the first object meets a preset relevance threshold.
[0090] In some embodiments, the recommendation condition also includes at least one of the following: the duration of the first live video segment meets a preset duration threshold, the content quality of the first live video segment meets a preset quality threshold, and the number of published live video segments related to the first object in the live broadcast room does not exceed a preset number threshold.
[0091] In some embodiments, the video clip acquisition module 610 is further configured to: if it is detected that the live broadcast explanation status of the first object is in the explanation state, start acquiring the live content of the live broadcast room; and if it is detected that the live broadcast explanation status of the first object is in the explanation end state or it is detected that the duration of the acquired live content reaches a preset duration, determine the acquired live content as the first live video clip.
[0092] In some embodiments, the video clip acquisition module 610 is further configured to: determine whether the permission to obtain the live video clips of the live broadcast room is enabled; and if it is determined that the permission to obtain the live video clips of the live broadcast room is enabled, obtain the first live video clip from the live content of the live broadcast room.
[0093] In some embodiments, the first object is any one of the multiple objects corresponding to the live broadcast room.
[0094] In some embodiments, the apparatus 600 further includes: a publishing stop module configured to stop publishing the first media content if it is detected that the live broadcast room is in a live broadcast end state.
[0095] In some embodiments, the device 600 further includes: a content presentation module configured to present the first media content in a live content aggregation page of the anchor user in the live broadcast room.
[0096] The units and / or modules included in the device 600 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 600 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0097] FIG7 shows a block diagram of an electronic device 700 capable of implementing one or more embodiments of the present disclosure. It should be understood that the electronic device 700 shown in FIG7 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 700 shown in FIG7 can be used to implement the terminal device 120, terminal device 140, and / or server 150 of FIG1, or the apparatus 600 of FIG6.
[0098] As shown in FIG7 , electronic device 700 is a general-purpose electronic device. Components of electronic device 700 may include, but are not limited to, one or more processors or processing units 710, memory 720, storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. Processing unit 710 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 720. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 700.
[0099] The electronic device 700 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 720 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 730 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 700.
[0100] The electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 7 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 720 may include a computer program product 725 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
[0101] The communication unit 740 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 700 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 700 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0102] Input device 750 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 760 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 700 may also communicate with one or more external devices (not shown) via communication unit 740 as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with electronic device 700, or with any device that allows electronic device 700 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0103] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0104] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0105] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.
[0106] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0107] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0108] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A method for generating live video, comprising: If it is detected that the live broadcast explanation state of the first object corresponding to the live broadcast room is in the explanation state, obtaining a first live broadcast video clip from the live broadcast content of the live broadcast room, where the first live broadcast video clip includes content related to the first object in the live broadcast content; as well as If the first live video segment meets the recommendation condition, first media content is generated, and the first media content at least includes the first live video segment.
2. The method according to claim 1, further comprising: While the live broadcast room is in a live broadcast state, the first media content is published so as to be displayed on a content recommendation page of at least one user, wherein the first media content also includes a viewing entrance corresponding to the live broadcast room.
3. The method according to any one of claims 1 to 2, wherein the first media content further includes text content, and the text content is determined based on at least one of the following: content in the first live video segment, and pre-set text content.
4. The method according to any one of claims 1 to 3, wherein the recommendation condition includes that the relevance between the first live video clip and the first object meets a preset relevance threshold; The recommended conditions also include at least one of the following: The duration of the first live video segment meets a preset duration threshold, The content quality of the first live video segment meets a preset quality threshold, The number of published live video clips related to the first object in the live broadcast room does not exceed a preset number threshold.
5. The method according to any one of claims 1 to 4, wherein obtaining a first live video segment from the live content of the live broadcast room comprises: If it is detected that the live broadcast explanation state of the first object is in the explanation state, starting to obtain the live broadcast content of the live broadcast room; as well as If it is detected that the live explanation state of the first object is the explanation end state or it is detected that the duration of the acquired live content reaches a preset duration, the acquired live content is determined as the first live video clip.
6. The method according to any one of claims 1 to 5, wherein obtaining a first live video segment from the live content of the live broadcast room comprises: Determine whether the permission to obtain the live video clips of the live broadcast room is enabled; as well as If it is determined that the permission to obtain the live video clip of the live broadcast room is enabled, the first live video clip is obtained from the live content of the live broadcast room.
7. The method according to any one of claims 1 to 6, wherein the first object is any one of a plurality of objects corresponding to the live broadcast room; and / or The method further comprises: The first media content is presented on a live content aggregation page of the anchor user in the live broadcast room.
8. The method according to claim 2, further comprising: If it is detected that the live broadcast room is in the live broadcast end state, the first media content is stopped from being released.
9. A device for generating live video, comprising: A video clip acquisition module is configured to acquire a first live video clip from the live content of the live broadcast room if it is detected that the live broadcast explanation state of the first object corresponding to the live broadcast room is in the explanation state, wherein the first live video clip includes content related to the first object in the live broadcast content; as well as The media content generation module is configured to generate first media content if the first live video segment meets the recommendation condition, where the first media content at least includes the first live video segment.
10. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 8 when executed by the at least one processing unit.
11. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 8.
12. A computer program product comprising computer executable instructions, wherein the computer executable instructions are capable of implementing the method according to any one of claims 1 to 8 when executed by a processor.