Live-streaming interaction method and apparatus, and device and storage medium

Abstract

Provided in the embodiments of the present disclosure are a live-streaming interaction method and apparatus, and a device and a storage medium. The method comprises: determining first presentation information of live-streaming content at a streamer end for live streaming, wherein the first presentation information indicates at least one of the following: a display style and a display size; on the basis of the difference between the first presentation information and configuration information for the live-streaming content, generating prompt information, such that an audience end determines, on the basis of the prompt information, second presentation information for presenting the live-streaming content at the audience end; and providing the live-streaming content and the prompt information to a server for pushing to the audience end.

Description

Methods, devices, equipment and storage media for live interactive streaming

[0001] This application claims priority to Chinese Patent Application No. 202411556937.7, filed on November 1, 2024, entitled "Method, Apparatus, Device and Storage Medium for Live Interaction", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatus, devices, and storage media for live interactive communication. Background Technology

[0003] With the development of computer technology, the internet has become a crucial source of information for people. Live streaming technology, which utilizes the internet and streaming media for content dissemination, has developed rapidly. People can engage in various types of interaction and access a wide range of information through live streams. Improving the quality of live stream interaction is a crucial issue worthy of attention. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for live streaming interaction is provided, which can be implemented at the broadcaster's end. The method may include: determining first presentation information corresponding to the live streaming content at the broadcaster's end, the first presentation information indicating at least one of the following: display style or display size; generating prompt information based on the first presentation information, so that the viewer's end determines second presentation information for displaying the live streaming content on the viewer's end based on the prompt information; and providing the live streaming content and prompt information to a server for pushing to the viewer's end.

[0005] In a second aspect of this disclosure, a method for live streaming interaction is provided, which can be implemented at a viewer's end. The method may include: after a viewer participates in the live stream, receiving a data packet from a server, the data packet including at least the live stream content from the broadcaster's end. In response to detecting the data packet, a prompt message is also included, and based on the prompt message, second presentation information of the live stream content is determined, the second presentation information indicating at least one of the following: display style or display size. Based on the second presentation information, the live stream content is presented.

[0006] In a third aspect of this disclosure, a live streaming interactive apparatus is provided. Implemented at a broadcaster's end, the apparatus may include: a first presentation information determining module, configured to determine first presentation information corresponding to the live streaming content at the broadcaster's end, the first presentation information indicating at least one of the following: display style or display size; a prompt information generating module, configured to generate prompt information based on the first presentation information, so that a viewer's end determines second presentation information for presenting the live streaming content on the viewer's end based on the prompt information; and a push module, configured to provide the live streaming content and prompt information to a server for push to the viewer's end.

[0007] In a fourth aspect of this disclosure, a live streaming interactive apparatus is provided. The apparatus can be implemented at a viewer's end and includes: a data packet receiving module configured to receive live streaming data packets from a server after the viewer participates in the live stream, the data packets including at least the live streaming content from the broadcaster's end; a second presentation information determining module configured to determine second presentation information of the live streaming content based on a prompt message in response to detecting a data packet, the second presentation information indicating at least one of the following: display style or display size; and a live streaming content presentation module configured to present the live streaming content based on the second presentation information.

[0008] In a fifth aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.

[0009] In a sixth aspect of this disclosure, a computer-readable storage medium is provided. The medium stores computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0010] In a seventh aspect of this disclosure, a computer program product is provided. The computer program product includes computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0011] It should be understood that the description in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0012] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0013] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0014] Figures 2A to 2F show example diagrams of live streaming interactive interfaces according to some embodiments of the present disclosure;

[0015] Figure 3 shows a flowchart of a live interactive method according to some embodiments of the present disclosure;

[0016] Figure 4 illustrates an example diagram of the processing of live content at the broadcaster's end according to some embodiments of the present disclosure;

[0017] Figure 5 illustrates an example diagram of the process of generating prompt information at the broadcaster's end according to some embodiments of the present disclosure;

[0018] Figure 6 illustrates an example diagram of the processing procedure for adjusting the acquisition stream at the broadcaster's end according to some embodiments of the present disclosure;

[0019] Figure 7 shows a flowchart of a live interactive method according to some other embodiments of the present disclosure;

[0020] Figure 8 shows a flowchart of a live interactive method according to some embodiments of the present disclosure;

[0021] Figure 9 shows an example diagram of live content being presented on the viewer's end according to some embodiments of the present disclosure;

[0022] Figures 10A to 10C show example diagrams of live streaming interactive interfaces according to other embodiments of the present disclosure;

[0023] Figure 11 shows a schematic structural block diagram of a live interactive apparatus according to some embodiments of the present disclosure;

[0024] Figure 12 shows a schematic structural block diagram of a live interactive apparatus according to other embodiments of the present disclosure; and

[0025] Figure 13 shows a block diagram of an electronic device that can implement one or more embodiments of the present disclosure. Detailed Implementation

[0026] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0027] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0028] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0029] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0030] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0032] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window containing textual information. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0033] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0034] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In environment 100, user 120 can establish a live streaming room and provide live streaming content through an associated terminal device 110. In some scenarios, user 120 is also referred to as the host, streamer, or administrator of the live streaming room. Terminal device 110 can also be referred to as the host terminal of the live streaming room. Live streaming rooms are sometimes also called live streaming, live streaming sessions, etc.

[0035] One or more users 130-1, 130-2, ..., 130-N can watch the live stream and participate in interactive activities through their respective associated terminal devices 140-1, 140-2, ..., 140-N. For ease of discussion, users 130-1, 130-2, ..., 130-N can be collectively referred to as user 130 or individually, and terminal devices 140-1, 140-2, ..., 140-N can be collectively referred to as terminal device 140 or individually. In some scenarios, user 130 can also be referred to as the audience, listener, viewer, or participant in the live stream. Terminal device 140 can also be referred to as the client or viewer terminal of the live stream.

[0036] It should be understood that although only a single broadcaster user is shown in Figure 1, in some embodiments, multiple broadcasters may initiate a live broadcast in a single live broadcast room. In some embodiments, terminal devices 110 and 140 may each have applications capable of providing live broadcast services installed, or may have access to websites capable of providing live broadcast services. Users 120 and 130 may operate terminal devices 110 and 140 to access the corresponding applications or websites.

[0037] Accordingly, terminal devices 110 and 140 can present corresponding live streaming interfaces, which may provide (video) live streaming content, for example. In some embodiments, terminal devices 110 and 140 can also communicate with server 150 via network 152 to provide live streaming services. Server 150 can provide functions such as application or website management, configuration, and maintenance.

[0038] Terminal devices 110 and 140 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal devices 110 and 140 may also support any type of user-facing interface (such as "wearable" circuitry).

[0039] Server 150 can be any type of computing system / server capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc. Server 150 can, for example, provide backend services for applications providing live streaming services in terminal devices 110 and 140.

[0040] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0041] In live streaming interactive scenarios, there are three main key stages: First, the stream is pushed by the broadcaster. This involves the server using a Content Delivery Network (CND) to optimize and distribute the video content pushed by the broadcaster. Second, the stream is pulled by the viewer. To ensure the correct display during both pushing and pulling, the broadcaster typically needs to select the landscape or portrait resolution before the live stream begins. If the actual orientation of the stream deviates from the preset orientation, the viewer's screen display will be abnormal, affecting the viewing experience.

[0042] Figures 2A to 2F illustrate example interfaces 200A to 200F of some embodiments of this disclosure. Example interfaces 200A to 200C may correspond, for example, to the host and / or viewers in a live streaming room. It should be understood that the example interfaces 200A to 200F shown in Figures 2A to 2C are merely example interfaces, and various interface designs may actually exist. The various graphic elements in the interface may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also be present. The embodiments of this disclosure are not limited in this respect.

[0043] As shown in Figure 2A, for the broadcaster, the terminal device 110 can obtain the broadcaster's configuration information before the live stream begins. The configuration information can indicate a horizontal style (corresponding to the "horizontal" control in Figure 2A) or a vertical style (corresponding to the "vertical" control in Figure 2A). Based on the user's selection, the presentation style of the live stream content can be determined.

[0044] On the viewer's terminal device 140, the decoding and rendering of the live content are completed according to the parameters corresponding to the configuration information on the broadcaster's end. In the example shown in Figure 2B, the live content presentation style of the broadcaster's terminal device 110 on the user interface 210B is the same as the display style indicated by the configuration information, both being a portrait style. Therefore, on the viewer's terminal device 140, based on the parameters corresponding to the portrait style, the user interface 220B of the viewer's terminal device 140 can display the live content normally. Similarly, in the example shown in Figure 2C, the live content presentation style of the broadcaster's terminal device 110 on the user interface 210C is the same as the display style indicated by the configuration information, both being a landscape style. On the viewer's terminal device 140, based on the parameters corresponding to the landscape style, the user interface 220C of the viewer's terminal device 140 can also display the live content 230C normally.

[0045] In the example shown in Figure 2D, the configuration information for the live content on the broadcaster's terminal device 110 indicates a horizontal display style. However, during the actual live broadcast, the user interface 210D of the broadcaster's terminal device 110 presents the live content in a vertical format. This causes the viewer's terminal device 140 to still decode and render using the parameters corresponding to the horizontal format. The rendering result is a horizontal format, leading to an abnormal display of the live content 230D in the user interface 220D of the viewer's terminal device 140. Similarly, in the example shown in Figure 2E, the configuration information for the live content on the broadcaster's terminal device 110 indicates a vertical display style. However, during the actual live broadcast, the user interface 210E of the broadcaster's terminal device 110 presents the live content in a horizontal format. This causes the viewer's terminal device 140 to still decode and render using the parameters corresponding to the vertical format. Ultimately, the live content 220E on the viewer's terminal device 140 also displays abnormally.

[0046] When the presentation style of the live content on the broadcaster's terminal device 110 differs from the display style indicated by the configuration information, one improvement is to force a horizontal or vertical broadcast. The example shown in Figure 2F is a forced horizontal broadcast, where the user interface 210F of the broadcaster's terminal device 110 presents the live content in a vertical format. Consequently, the viewer's terminal device 140 still uses the parameters corresponding to the horizontal format for decoding and rendering. While this allows for normal display, it comes at the cost of reduced resolution, resulting in poor live interaction quality.

[0047] Based on the above example, when the presentation style of the live content on the broadcaster's terminal device 110 does not match the display style indicated by the configuration information (a difference of 90 degrees or 270 degrees), it will cause display abnormalities on the viewer's terminal device 140. Solutions could include: resetting the landscape / portrait parameters on the broadcaster's terminal device 110. However, this process can result in no live video during the streaming process. The server has the capability to transmit the same live content at different resolutions. However, this process is too costly for the server. The viewer's terminal device 140 can also reset its landscape / portrait parameters. However, this process can also result in no live video during the streaming process.

[0048] In embodiments of this disclosure, an improved live streaming interaction scheme is proposed. In this scheme, first presentation information corresponding to the live streaming content at the broadcaster's end is determined. The first presentation information indicates at least one of the following: display style or display size. Based on the first presentation information, a prompt message is generated to instruct viewers participating in the live stream to determine second presentation information of the live streaming content presented at their end. The live streaming content and the prompt message are provided to the server for push to the viewers.

[0049] Through the above process, the system automatically identifies the actual display style and size of the live stream on the broadcaster's end, and generates prompts on the broadcaster's end based on these display styles and sizes, allowing viewers to adjust their display styles and sizes on their own devices. Therefore, by automatically detecting and acquiring prompts from the live stream data, it ensures that viewers can adjust the presentation style of the live stream content in real time and accurately. This solves the problem of abnormal viewing experience caused by mismatches between portrait and landscape orientations or screen sizes during live streaming.

[0050] Figure 3 illustrates an example flow of a live streaming interaction method 300 according to some embodiments of the present disclosure. For ease of discussion, flow 300 will be described with reference to the environment of Figure 1. In environment 100, live streaming interaction can be performed by the terminal device 110 of the broadcaster.

[0051] In frame 301, terminal device 110 determines the first presentation information corresponding to the live broadcast content at the broadcaster's end. The first presentation information indicates at least one of the following: display style or display size. That is, the first presentation information can reflect the layout and page size of the current live broadcast screen. The layout can be a landscape or portrait style, depending on the current display orientation of terminal device 110. The page size can be determined by the device model and display settings parameters of terminal device 110.

[0052] For example, when terminal device 110 is in landscape mode, it determines that the live broadcast content is presented in a landscape style. When terminal device 110 is in portrait mode, it determines that it is presented in a portrait style. This determination process can be completed by identifying the screen orientation of terminal device 110 or obtaining the position information of the status bar in the display screen, thereby accurately capturing the actual display method of the live broadcast content. In addition, the first presentation information can also indicate the display size corresponding to the terminal device 110 on the broadcaster's end. The display size can be expressed in the form of resolution, such as 1280×1024, 1280×720, etc.

[0053] In frame 302, terminal device 110 generates a prompt message based on the first presentation information, so that the viewer terminal determines the second presentation information of the live broadcast content to be presented on the viewer terminal based on the prompt message. The prompt message is used to instruct the viewer terminal participating in the live broadcast to determine the second presentation information of the live broadcast content presented at the viewer terminal.

[0054] Based on the difference between the display style indicated by the first presentation information determined by the terminal device 110 and the display style indicated by the pre-set configuration information for the live content, the terminal device 110 can generate prompt information for the viewer. The prompt information can be embedded into the live content in the form of Supplemental Enhancement Information (SEI). The main function of SEI information is to carry metadata unrelated to the video stream content corresponding to the live content, but this data can provide live streaming assistance to the viewer.

[0055] When terminal device 110 determines that the display style indicated by the first presentation information of the live content is inconsistent with the display style indicated by the configuration information (there is a difference), it will generate corresponding prompt information based on the difference. For example, if the first presentation information indicates a landscape style, while the configuration information indicates a portrait style, the prompt information generated by terminal device 110 may instruct the viewer to rotate the live content (e.g., rotate it 90 degrees or 270 degrees clockwise). Conversely, if the first presentation information indicates a landscape style, and the configuration information also indicates a landscape style, the prompt information generated by terminal device 110 instructs the viewer not to rotate the live content.

[0056] In box 303, terminal device 110 provides the live broadcast content and prompt information to the server for push to the viewer. After determining the first presentation information of the live broadcast content and generating the corresponding prompt information, terminal device 110 sends this data to the server (e.g., server 150 shown in Figure 1).

[0057] For example, server 150's data processing may include originating, transcoding, and recording, etc. An originating site may be the data source for enabling server 150 as a content delivery network (CDN), storing and serving raw live or video-on-demand content. Transcoding may be the process of converting raw video files into different formats, resolutions, or bitrates to suit various terminal devices and network conditions. Recording may be the process of saving live content as video files in real time, typically used for archiving, playback, or video-on-demand services.

[0058] Figure 4 illustrates a schematic diagram 400 of live content transmission according to some embodiments of the present disclosure. In block 410, the terminal device 110 needs to configure live content encoding parameters. Exemplarily, encoding parameters may include the encoder type for performing audio / video encoding, resolution, frame keyframe interval, etc. Based on the live content encoding parameters, in block 411, the terminal device 110 can perform audio acquisition of the live content. In block 412, the terminal device 110 performs audio encoding on the acquired audio to generate a compressed audio stream suitable for network transmission.

[0059] In box 421, video capture of the live content can be performed based on the live content encoding parameters. In box 422, the terminal device 110 can determine the capture stream direction corresponding to the live content based on the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live broadcast. In box 423, the terminal device 110 uses an encoder to encode the video stream to generate a compressed video stream suitable for network transmission.

[0060] In box 431, terminal device 110 can detect the position of the status bar. Based on the position of the status bar, it can determine the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live broadcast. If the presentation style is selected between a landscape style and a portrait style, the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information can be 0 degrees or 90 degrees. Based on this difference, terminal device 110 can generate a prompt message in box 432. In box 441, terminal device 110 merges the compressed audio stream, the compressed video stream, and the prompt message to obtain the audio and video stream of the live broadcast content. In box 451, the synthesized audio and video stream is encapsulated into a specific file format or transmission protocol format and transmitted to server 150. Common encapsulation formats may include MP4, MKV, etc. Common transmission protocol formats include Real-Time Messaging Protocol (RTMP), Secure Reliable Transport (SRT), etc.

[0061] Through the above process, the entire live streaming process can seamlessly handle the differences in display styles between the broadcaster's and viewer's devices, enhancing the interactivity of the live stream and the viewing experience for viewers. The broadcaster doesn't need to worry about changes in device orientation affecting the viewer's experience. The viewer's device can automatically adjust its image, ensuring that the live content is displayed correctly on various devices, thus improving user satisfaction and technical reliability of the live streaming platform.

[0062] The following details the various processes involved in live streaming interaction. In some embodiments of this disclosure, the process of determining the first presentation information may include obtaining identification information from the live streaming content. Based on the position corresponding to the identification information, the first presentation information of the live streaming content is determined.

[0063] In live streaming content, specific identifying information, such as the position and orientation of the system status bar (e.g., battery level, signal strength) of terminal device 110, can be used to identify the initial presentation information of the live streaming content. This is because changes in the position of the identifying information are directly related to the landscape or portrait orientation of terminal device 110. Taking a smartphone as an example, when a smartphone is in portrait mode, the status bar is displayed on the shorter side of the smartphone; when it is in landscape mode, the status bar is displayed on the longer side. These characteristics can be used in live streaming interactions. For example, when the status bar is displayed on the longer side of terminal device 110, it indicates that the initial presentation information of the live streaming content indicates a landscape orientation. When the status bar is displayed on the shorter side of terminal device 110, it indicates that the initial presentation information of the live streaming content indicates a portrait orientation.

[0064] In some embodiments of this disclosure, providing live content and prompt information to the server may include: the terminal device 110 obtaining configuration information for the live stream, the configuration information indicating a display style configured for the live content, the display style including a landscape style or a portrait style. In response to a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information, the acquisition flow direction of the video capture device at the broadcaster's end when capturing the live content is determined based on the difference and the display style indicated by the configuration information. Prompt information is generated based at least on the acquisition flow direction.

[0065] Figure 5 illustrates a schematic diagram 500 of generating prompt information according to some embodiments of the present disclosure. In block 510, the terminal device 110 first obtains preset configuration information (i.e., the desired display style pre-configured for the live broadcast content before the live broadcast). In block 520, streaming can be initiated based on the configuration information. The reasoning corresponding to block 520 can be a selective action. That is, to improve streaming efficiency, streaming can be initiated in block 520. If to improve the adaptability of the presentation style, block 520 can be omitted and changes in the identification information can be detected directly in block 530. For example, the detection can be performed once at specified intervals, or the check can be performed based on parameter changes fed back by sensors such as gyroscopes inside the terminal device 110 exceeding parameter thresholds.

[0066] Based on the detection results, terminal device 110 can determine in frame 540 whether the display style indicated by the first presentation information of the live content is consistent with the display style indicated by the preset configuration information. If they are inconsistent, it means that the first presentation information and the configuration information indicate a horizontal style and a vertical style respectively (the difference is 90 degrees or 270 degrees). If they are consistent, it means that the first presentation information and the configuration information indicate either a horizontal style or both a vertical style (the difference is 0 degrees).

[0067] In box 550, if consistency is determined, terminal device 110 may not adjust the direction of the video capture stream. In box 560, if inconsistency is determined, terminal device 110 may instruct the video capture device to adjust the direction of the capture stream to conform to the configuration information. For example, if the configuration information indicates a landscape display style while the first presentation information indicates a portrait display style, terminal device 110 may instruct the video capture device to rotate 90 degrees clockwise to adjust the direction.

[0068] In box 570, based on the determined acquisition stream direction, terminal device 110 can generate prompt information. This information can include not only the correct direction of the video stream, but also guidance on how to handle potential inconsistencies in direction at the viewer's end.

[0069] Figure 6 illustrates a schematic diagram 600 of the process of adjusting a video capture device according to some embodiments of the present disclosure. The terminal device 110 determines the initial capture stream direction 610 of the video capture device based on the display style indicated by the configuration information. Figure 6 illustrates an example capture stream direction in landscape mode (e.g., resolution 720×1280). If the terminal device 110 detects that during live streaming, the first presentation information indicates a change in display style from landscape to portrait (a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information), it needs to adjust the capture stream direction to portrait mode (e.g., resolution 1280×720) based on the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information, resulting in adjustment result 620. After capturing the live content, before sending it to the encoder, the portrait-oriented capture stream is rotated 90 degrees to return to the landscape direction corresponding to the initial capture stream direction 630. The reason for this adjustment is that the encoder settings are fixed landscape parameters. Therefore, even if the actual captured content is in portrait orientation, the encoder can still process the video stream according to the set landscape format after rotation, ensuring that the image orientation is consistent with the configuration during streaming. Furthermore, before the live content is sent to the encoder, a prompt message is generated based on the rotation, and the rotation result is written to prompt message 640. The prompt message indicates the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live content, corresponding to a capture stream direction of portrait orientation but a landscape encoding process.

[0070] In some embodiments of this disclosure, the terminal device 110 provides live content and prompt information to the service provider by: determining a target video frame in the video frame sequence corresponding to the live content, wherein the target image contains complete screen information of the live content; generating updated live content by adding prompt information to the additional information of the target video frame; and providing the updated live content to the service provider.

[0071] Terminal device 110 automatically identifies keyframes as target video frames in the video frame sequence of the live broadcast content. A target video frame can be a frame containing complete image information, typically the first frame of each Group of Pictures (GOP) in the video frame sequence. Target video frames can be decoded independently, without relying on other video frames.

[0072] Through editing, terminal device 110 can embed the prompt information as additional information into the target video frame. The edited target video frame, along with the original live content, is then re-encoded into an edited video stream. This processed stream ensures that each target video frame contains complete prompt information. The edited live content is then sent to a given server 150. Server 150 is responsible for processing this data and distributing it to the terminal devices 140 at the viewer's end.

[0073] By inserting prompts only into keyframes, data transmission volume can be effectively reduced, saving bandwidth resources while ensuring comprehensive information delivery and timely updates. This strategy not only improves network transmission efficiency but also ensures that viewers receive necessary prompts whenever they participate in the live stream, thereby optimizing the user viewing experience and satisfaction. Furthermore, this method reduces the processing burden on server 150, improving the overall performance and reliability of the live streaming system.

[0074] In some embodiments of this disclosure, to ensure the quality of live streaming interaction, the broadcaster may determine the first presentation information multiple times. Determining the first presentation information may include determining the first presentation information of the live streaming content at the broadcaster's end in response to detecting at least one of the following triggering events: the broadcaster initiates the live stream; during the live stream, after a given time interval, the position corresponding to the identifier information in the live streaming content changes.

[0075] Terminal device 110 can detect a variety of possible triggering events that prompt a re-determination of the initial presentation information of the live stream content. These triggering events include, but are not limited to, the following: For example, at the very beginning of the live stream, terminal device 110 automatically determines the initial presentation information. Another example is that during the live stream, terminal device 110 can be set to automatically re-detect and update the initial presentation information at regular intervals (e.g., every few seconds or minutes) to ensure the accuracy of the presentation style throughout the live stream. Yet another example is that when terminal device 110 detects a change in identifier information (such as the orientation of the status bar) in the live stream content, it immediately re-determines the initial presentation information.

[0076] Each time the first presentation information is confirmed or reconfirmed, the terminal device 110 will generate or update the prompt information and send this information, along with the live broadcast content, to the server 150.

[0077] As previously mentioned, the prompt information can store additional information in the video stream that is not directly related to image quality or playback performance but helps with video playback and processing. Correspondingly, the prompt information can indicate at least one of the following: the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information of the live content, and the display style indicated by the configuration information. The resolution of the live content. Suggestions for adjusting the presentation style of the live content at the viewer's end.

[0078] Based on the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information of the live content, as well as the display style indicated by the configuration information, the terminal device 140 at the viewer's end can help identify whether the current video stream needs to be adjusted in direction.

[0079] The resolution of the live stream content indicates the current resolution of the live stream content on terminal device 110, including parameters such as width and height. Viewer-end terminal device 140 can automatically adjust the video's display ratio and clarity based on this information to ensure the best viewing experience.

[0080] The adjustment suggestions can provide guidance on how the viewer's terminal device 140 should adjust the presentation style of the live broadcast content. For example, if an directional difference is detected, the suggestions can indicate how the viewer's terminal device 140 should rotate or flip the screen to match the actual orientation of the broadcaster's device.

[0081] Figure 7 illustrates an example flow of a live streaming interaction method 700 according to some embodiments of the present disclosure. For ease of discussion, flow 700 will be described with reference to the environment of Figure 1. In environment 100, live streaming interaction can be performed by a terminal device 140 at the viewer's end.

[0082] In frame 701, after the terminal device 140 corresponding to the viewer participates in the live broadcast, it receives the live broadcast data packet from the server. The data packet includes at least the live broadcast content from the broadcaster's end.

[0083] After participating in the live stream, the terminal device 140 at the viewer's end receives a data packet from the server 150 containing the live stream content from the broadcaster's end. This data packet includes at least the real-time live video stream captured by the terminal device 110 at the broadcaster's end, and may also contain prompts indicating how to present the live stream content.

[0084] In box 702, in response to detecting a data packet, terminal device 140 also includes prompt information, and determines second presentation information of the live content based on the prompt information. The second presentation information indicates at least one of the following: display style or display size.

[0085] When terminal device 140 detects that a data packet contains prompt information, it determines the second presentation information of the live content based on the prompt information. The prompt information may contain metadata related to live broadcast orientation, resolution adjustment, rotation angle, etc., to guide terminal device 140 on how to correctly process and display the video content. Based on the prompt information, at least the display style (landscape or portrait) and display size (which can be expressed in resolution) corresponding to the terminal device 140 on the viewer's end can be determined.

[0086] In box 703, terminal device 140 presents live content based on the second presentation information. Terminal device 140 can make appropriate adjustments and presentations to the live content according to the determined second presentation information.

[0087] Through the above process, it is ensured that no matter how the broadcaster sets or changes the direction and format of the video stream, the viewer can obtain a consistent and optimal viewing experience.

[0088] Regarding the determination of the second presentation information, the terminal device 140 responds to a prompt indicating a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live broadcast. Based on the difference and the display style indicated by the configuration information, it determines the screen rotation angle of the live broadcast content on the server. Based on the screen rotation angle, it determines the second presentation information of the live broadcast content.

[0089] Figure 8 illustrates an example flow of a live streaming interaction method 800 according to some embodiments of the present disclosure. In block 810, terminal device 140 receives data packets from server 150. In block 820, terminal device 140 performs decoding of the data packets to obtain a live video stream. Furthermore, terminal device 140 needs to determine whether the decoding result contains any prompt information. If no prompt information is found, it typically indicates that the display style indicated by the first presentation information on the broadcaster's end is the same as the display style indicated by the preset configuration information, or that adjustments have already been made, thus eliminating the need for additional directional adjustments by the viewer's terminal device 140. Therefore, corresponding to block 870, no adjustment to the presentation style is required.

[0090] If the decoding result includes a prompt message, then in box 840, it can be further determined whether the display style indicated by the first presentation information is consistent with the display style indicated by the configuration information. If the determination result is inconsistent, then in box 860, the terminal device 140 adjusts the screen rotation angle based on the difference corresponding to the inconsistency and the display style indicated by the configuration information. For example, the terminal device 140 determines the required screen rotation angle based on the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information. For instance, if the present style of the broadcaster is portrait, while the display style indicated by the configuration information is landscape, the terminal device 140 will determine a clockwise or counterclockwise rotation angle (e.g., 90 degrees or 270 degrees) to adjust the screen orientation to match the display style indicated by the configuration information.

[0091] If the judgment result is consistent, then in box 850, terminal device 140 can adopt the default presentation style. That is, if the judgment result is consistent, it means that the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information is zero. Based on this, the second presentation information of the live content can be determined based on the display style indicated by the configuration information.

[0092] Figure 9 illustrates an example of a live streaming interaction process of a terminal device 140 according to some embodiments of the present disclosure. After receiving data packets from the server 150, in block 910, the terminal device 140 performs decapsulation processing based on the data packet encapsulation format and encapsulation protocol to extract audio and video stream data. In block 920, the terminal device 140 separates the audio and video streams to prepare for subsequent decoding and processing. In blocks 931 and 932, the separated video and audio streams are decoded respectively, converting them into playable audio and video data. In block 940, the terminal device 140 performs synchronization processing on the audio and video data to ensure that the playback time of the audio and video data is consistent.

[0093] In box 951, terminal device 140 performs post-processing on the synchronized calibrated audio data, including enhancement and optimization, such as noise cancellation and sound effect adjustment. In box 952, terminal device 140 renders the post-processed audio data, preparing it for playback. In box 953, terminal device 140 performs post-processing on the synchronized calibrated video data, including noise reduction, sharpening, and adjustments to brightness and contrast. In box 954, terminal device 140 renders the post-processed portrait-oriented data.

[0094] In box 961, terminal device 140 extracts prompt information from the decoded video data. In box 962, terminal device 140 determines the presentation style based on information recorded in the prompt information, such as the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information, the display style indicated by the configuration information, and the resolution. In box 970, based on the determined presentation style, terminal device 140 presents the complete live broadcast content.

[0095] If the prompt information includes the resolution of the live content, the determination of the second presentation information may also include determining the second presentation information of the live content based on the resolution and the presentation requirements of the viewer.

[0096] Figure 10A shows a schematic diagram 1000A of the user interface of a terminal device 140 according to some embodiments of the present disclosure. The live content 1120A-1 in Figure 10A may be the result of video rendering performed through frame 954, corresponding to the initial presentation style of the live content. This initial presentation style is a landscape style, which corresponds to the landscape style indicated by the configuration information of the live content at the broadcaster's end. If a prompt indicates a difference between the display style indicated by the first presentation information of the live content at the broadcaster's end and the display style indicated by the configuration information (a difference of 90 degrees or 270 degrees), then based on the prompt, the live content can be rotated to obtain the adjusted presentation style 1120A-2.

[0097] The presentation requirements of terminal device 140 may include the width and height requirements for the live content when displayed. For example, the resolution corresponding to the presentation style 1120A-2 adjusted based on the prompt information is 720×1280. To meet the presentation requirements, terminal device 140 can set the shorter side length of the user interface 1110A to w. Then, the width of the live content displayed on terminal device 140 will be set to the shorter side length w, and the height will be adjusted proportionally to w / 720×1280. In this way, the live content can be scaled and adjusted according to the presentation requirements, thereby generating the second presentation information 1120A-3. It should be noted that the above resolution is only an example; the resolution value in actual scenarios may depend on the specific requirements of the device.

[0098] Figure 10B illustrates a schematic diagram 1000B of the user interface of a terminal device 140 (i.e., the viewer's end of the live stream) according to some embodiments of the present disclosure. The live stream content 1020B-1 in Figure 10B may be the result of video rendering performed through frame 954, corresponding to the initial presentation style of the live stream content. This initial presentation style is a portrait style, which corresponds to the display style indicated by the configuration information of the live stream content at the broadcaster's end being a portrait style.

[0099] If the prompt message indicates a difference between the display style indicated by the first presentation information of the live content at the broadcaster's end and the display style indicated by the configuration information (a difference of 90 degrees or 270 degrees), the live content can be rotated and adjusted based on the prompt message to obtain the adjusted presentation style 1020B-2.

[0100] For example, the resolution corresponding to the adjusted presentation style 1020B-2 based on the prompt information is 1280×720. To meet the presentation requirements, the terminal device 140 can set the short side length of the user interface 1010A to w. Then, the width of the live content displayed on the terminal device 140 will be set to the short side length w, and the height will be adjusted proportionally to w / 1280×720. This allows for scaling adjustments of the live content based on presentation requirements, resulting in the display style 1020B-3 indicated by the second presentation information of the live content. Simultaneously, a virtual landscape rotation button 1030B can be provided in the user interface for the user to select.

[0101] Figure 10C illustrates a schematic diagram 1000C of the display effect of a terminal device 140 according to some embodiments of the present disclosure. If the viewer does not click the virtual landscape rotation button 1030B, the live content 1020C-3' can be displayed at a preset position in the user interface 1010A (e.g., the center position or the upper center position of the screen). If the viewer clicks the virtual landscape rotation button 1030B, the layout of the player view can be rotated, thereby displaying the live content 1020C-3' in full-screen mode.

[0102] Through the above process, adaptation can be achieved for display on the viewer's terminal device 140.

[0103] The detection and acquisition of prompt information by terminal device 140 may specifically include the following process: based on the identifiers of each video frame in the video frame sequence corresponding to the live broadcast content, a target video frame is determined in the video frame sequence, the target video frame containing complete screen information of the live broadcast content. In response to the additional information of the target video frame including prompt information, the detected data packet also includes prompt information.

[0104] Terminal device 140 extracts video frame sequences corresponding to the live broadcast content from the received live broadcast data packets. These video frame sequences consist of consecutive video frames, representing the live broadcast content pushed in real time by the broadcaster. Based on the identification information of each video frame in the sequence, terminal device 140 can determine the target video frame in these images. The target video frame is typically a keyframe because it contains complete image information and can be independently decoded and reconstructed from the video content. For example, keyframes typically carry unique identification information, such as specific fields, image size, etc.

[0105] Based on the target video frame, the terminal device 140 can further analyze additional information within the target video frame. When it detects that this additional information includes prompts (such as suggestions for direction, rotation angle, or resolution adjustment), it determines that the data packet also contains prompts. In this way, the terminal device 140 can promptly obtain important instructions on how to correctly display the live content and ensure that the image presentation during playback meets expectations.

[0106] Figure 11 shows a schematic structural block diagram of a live interactive device 1100 according to some embodiments of the present disclosure. The device 1100 may be implemented in or included in a terminal device 110, for example. The various modules / components in the device 1100 may be implemented by hardware, software, firmware, or any combination thereof.

[0107] As shown in the figure, the device 1100 includes a first presentation information determination module 1101, configured to determine the first presentation information corresponding to the live broadcast content at the broadcaster's end, wherein the first presentation information indicates at least one of the following: display style or display size; a prompt information generation module 1102, configured to generate prompt information based on the first presentation information, so that the viewer's end determines the second presentation information of the live broadcast content to be presented on the viewer's end based on the prompt information; and a push module 1103, configured to provide the live broadcast content and prompt information to the server for push to the viewer's end.

[0108] In some embodiments of this disclosure, the first presentation information determination module 1101 may be specifically configured to: acquire identification information in the live stream content; and determine the first presentation information of the live stream content based on the location corresponding to the identification information.

[0109] In some embodiments of this disclosure, the prompt information generation module 1102 may be configured to: acquire configuration information for the live broadcast, the configuration information indicating a display style configured for the live broadcast content, the display style including a landscape style or a portrait style. In response to a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information, the acquisition flow direction of the video capture device at the broadcaster's end when capturing the live broadcast content is determined based on the difference and the display style indicated by the configuration information. Prompt information is generated at least based on the acquisition flow direction.

[0110] In some embodiments of this disclosure, the push module 1103 may be specifically configured to: determine a target video frame in the video frame sequence corresponding to the live content, wherein the target image contains complete screen information of the live content; generate updated live content by adding prompt information to the additional information of the target video frame; and provide the updated live content to the service server.

[0111] In some embodiments of this disclosure, the first presentation information determination module 1101 may be specifically configured to: determine the first presentation information corresponding to the broadcaster in response to detecting at least one of the following triggering events: the broadcaster initiates a live broadcast, and during the live broadcast, after a given time interval, the position corresponding to the identification information in the live broadcast content changes.

[0112] In some embodiments of this disclosure, the prompt information indicates at least one of the following: the difference between the display style indicated by the first presentation information and the display style indicated by the configuration information of the live content, and the display style indicated by the configuration information, the display style including a landscape style or a portrait style; the resolution of the live content; and suggestions for adjusting the presentation style of the live content at the viewer's end.

[0113] Figure 12 shows a schematic structural block diagram of a live interactive device 1200 according to some embodiments of the present disclosure. The device 1200 may be implemented in or included in a terminal device 140, for example. The various modules / components in the device 1200 may be implemented by hardware, software, firmware, or any combination thereof.

[0114] As shown in the figure, the device 1200 includes a data packet receiving module 1201, configured to receive live streaming data packets from a server after a viewer participates in the live stream. The data packets at least include the live streaming content from the broadcaster's end. A second presentation information determining module 1202 is configured to, in response to detecting a data packet, also include a prompt message, and determine second presentation information of the live streaming content based on the prompt message. The second presentation information indicates at least one of the following: display style or display size. A live streaming content presentation module 1203 is configured to present the live streaming content based on the second presentation information.

[0115] In some embodiments of this disclosure, the second presentation information determination module 1202 may be configured to: in response to a prompt indicating a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live stream, determine the screen rotation angle of the live stream content on the server based on the difference and the display style indicated by the configuration information, wherein the display style includes a landscape style or a portrait style. Based on the screen rotation angle, determine the second presentation information of the live stream content.

[0116] In some embodiments of this disclosure, the prompt information includes the resolution of the live content, and based on this, the second presentation information determination module 1202 can also be configured to: determine the second presentation information of the live content based on the resolution and the presentation requirements of the viewer.

[0117] In some embodiments of this disclosure, the second presentation information determination module 1202 may further be configured to: determine a target video frame in the video frame sequence based on the identifier of each video frame in the video frame sequence corresponding to the live content, wherein the target video frame contains complete screen information of the live content. Additional information for the target video frame includes prompt information, and detecting a data packet also includes prompt information.

[0118] Figure 13 illustrates a block diagram of an electronic device 1300 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 1300 shown in Figure 13 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 1300 shown in Figure 13 may include or be implemented as the terminal device 110 or terminal device 140 of Figure 1, the device 1100 of Figure 11, or the device 1200 of Figure 12.

[0119] As shown in Figure 13, electronic device 1300 is in the form of a general-purpose electronic device. Components of electronic device 1300 may include, but are not limited to, one or more processors or processing units 1310, memory 1320, storage device 1330, one or more communication units 1340, one or more input devices 1350, and one or more output devices 1360. Processing unit 1310 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1320. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1300.

[0120] Electronic device 1300 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 1300, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1320 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1330 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 1300.

[0121] Electronic device 1300 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG13, disk drives for reading or writing from removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading or writing from removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 1320 may include computer program product 1325 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0122] The communication unit 1340 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1300 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1300 can operate in a networked environment using logical connections to one or more other servers, networked personal computers (PCs), or another network node.

[0123] Input device 1350 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1360 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1300 can also communicate with one or more external devices (not shown) via communication unit 1340 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1300, or with any device that enables electronic device 1300 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0124] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0125] According to an exemplary implementation of this disclosure, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative embodiments of FIG3 or FIG7, which will therefore not be described further herein.

[0126] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0127] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0128] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0130] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A live streaming interaction method, implemented at the broadcaster's end, comprising: Determine the first presentation information corresponding to the live broadcast content at the broadcaster's end, wherein the first presentation information indicates at least one of the following: display style or display size; Based on the first presentation information, a prompt message is generated so that the viewer can determine the second presentation information for presenting the live content on the viewer's end based on the prompt message; as well as The live stream content and the notification information are provided to the server for push to the viewers.

2. The method according to claim 1, wherein determining the first presentation information corresponding to the live broadcast content at the broadcaster's end includes: Obtain the identification information from the live stream content; as well as Based on the location corresponding to the identification information, the first presentation information of the live broadcast content is determined.

3. The method according to claim 1 or 2, wherein generating the prompt information based on the first presentation information includes: Obtain configuration information for the live stream, the configuration information indicating the display style configured for the live stream content, the display style including a horizontal style or a vertical style; In response to a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information, the acquisition flow direction of the video capture device at the broadcaster end when capturing the live content is determined based on the difference and the display style indicated by the configuration information. as well as The prompt message is generated based at least on the direction of the acquisition flow.

4. The method according to any one of claims 1 to 3, wherein providing the live broadcast content and the notification information to the service provider comprises: A target video frame is determined in the video frame sequence corresponding to the live content, and the target image contains complete screen information of the live content; The updated live stream content is generated by adding the prompt information to the additional information of the target video frame; as well as The updated live stream content is provided to the server.

5. The method according to any one of claims 1 to 4, wherein determining the first presentation information corresponding to the live broadcast content at the broadcaster's end includes: In response to detecting at least one of the following triggering events, the corresponding first presentation information at the broadcaster's end is determined: The live stream was initiated from the broadcaster's end. During the live broadcast, after a given time interval, The location of the identifier information in the live stream content has changed.

6. The method according to any one of claims 1 to 5, wherein the prompting information indicates at least one of the following: The difference between the display style indicated by the first presentation information and the display style indicated by the configuration information of the live content, and the display style indicated by the configuration information, wherein the display style includes a horizontal style or a vertical style; The resolution of the live stream content; Suggestions for adjusting the presentation style of the live broadcast content on the viewer's end.

7. A live streaming interaction method, implemented at the viewer's end, comprising: After the viewer participates in the live stream, the server receives the live stream data packet, which includes at least the live stream content from the broadcaster's end. In response to detecting the data packet, a prompt message is also included, and based on the prompt message, second presentation information of the live content is determined, the second presentation information indicating at least one of the following: display style or display size; as well as Based on the second presentation information, the live broadcast content is presented.

8. The method according to claim 7, wherein determining the second presentation information of the live content based on the prompt information includes: In response to the prompt indicating a difference between the display style indicated by the first presentation information and the display style indicated by the configuration information for the live stream, the screen rotation angle of the live stream content on the server is determined based on the difference and the display style indicated by the configuration information. The display style includes a horizontal style or a vertical style. as well as Based on the screen rotation angle, the second presentation information of the live broadcast content is determined.

9. The method according to claim 7 or 8, wherein the prompt information indicates the resolution of the live content, and determining the second presentation information of the live content based on the prompt information includes: Based on the resolution and the presentation requirements of the viewer, the second presentation information of the live broadcast content is determined.

10. The method according to any one of claims 7 to 9, wherein detecting the data packet includes prompting information comprising: Based on the identifiers of each video frame in the video frame sequence corresponding to the live stream content, a target video frame is determined in the video frame sequence, the target video frame containing complete screen information of the live stream content; and Additional information in response to the target video frame includes a prompt message, and detecting the data packet also includes a prompt message.

11. A live streaming interactive device, implemented at the broadcaster's end, comprising: The first presentation information determination module is configured to determine the first presentation information corresponding to the live broadcast content at the broadcaster's end, wherein the first presentation information indicates at least one of the following: display style or display size; The prompt information generation module is configured to generate prompt information based on the first presentation information, so that the viewer terminal determines the second presentation information for presenting live content on the viewer terminal based on the prompt information; as well as The push module is configured to provide the live broadcast content and the notification information to the server for pushing to the viewers.

12. A live interactive device, implemented at the viewer's end, comprising: The data packet receiving module is configured to receive data packets from the server after the viewer participates in the live broadcast, the data packets including at least the live broadcast content from the broadcaster's end; The second presentation information determination module is configured to, in response to detecting that the data packet further includes prompt information, determine second presentation information of the live content based on the prompt information, wherein the second presentation information indicates at least one of the following: display style or display size; as well as The live content presentation module is configured to present the live content based on the second presentation information.

13. An electronic device, comprising: At least one processor; as well as At least one memory, coupled to the at least one processor and storing instructions for execution by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 10.

14. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 10.

15. A computer program product comprising computer-executable instructions that, when executed by a processor, implement the method of any one of claims 1 to 10.

Images