Virtual live streaming processing method and apparatus, device and storage medium

Abstract

Embodiments of the present disclosure relate to a virtual live streaming processing method and apparatus, a device and a storage medium. The method comprises: receiving a display request for a target live streaming room; acquiring a live streaming data stream of the target live streaming room and display attribute information corresponding to the target live streaming room; creating a virtual live streaming screen on the basis of the display attribute information corresponding to the target live streaming room; and rendering the virtual live streaming screen on the basis of a first image frame in the live streaming data stream of the target live streaming room.

Description

Virtual live broadcast processing method, device, equipment and storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese invention patent application with application number 202310900314.6, entitled "Virtual live broadcast processing method, device, equipment and storage medium" and filing date July 20, 2023, and incorporates the entire application into this document by reference. Technical Field

[0003] The embodiments of the present disclosure relate to the field of computer technology, and in particular to a virtual live broadcast processing method, apparatus, device, and storage medium. Background Art

[0004] With the development of live broadcast technology and virtual reality technology, virtual live broadcast has begun to appear. By utilizing virtual live broadcast technology, realistic virtual effects can be created, bringing a more intuitive, vivid, real and immersive experience to the audience.

[0005] However, current virtual live broadcasts have the problem of slow display and lag of the first frame, which is noticeable to users. There is currently no effective solution to this problem.

[0006] Summary of the Invention

[0007] In order to solve the above technical problems or at least partially solve the above technical problems, the embodiments of the present disclosure provide a virtual live broadcast processing method, device, equipment and storage medium.

[0008] A first aspect of an embodiment of the present disclosure provides a virtual live broadcast processing method, the method comprising:

[0009] Receive a display request for a target live broadcast room;

[0010] Obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room;

[0011] Create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room;

[0012] Render a virtual live screen based on the first frame image in the live data stream of the target live room.

[0013] A second aspect of the embodiments of the present disclosure provides a virtual live broadcast processing device, the device comprising:

[0014] A first receiving module is configured to receive a display request for a target live broadcast room;

[0015] The first acquisition module is used to obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room;

[0016] A creation module, used to create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room;

[0017] The rendering module is used to render a virtual live screen based on the first frame image in the live data stream of the target live room.

[0018] A third aspect of an embodiment of the present disclosure provides an electronic device, which includes: a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method of the first aspect above.

[0019] A fourth aspect of an embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of the first aspect described above can be implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] FIG1 is a flow chart of a virtual live broadcast processing method provided by an embodiment of the present disclosure;

[0023] FIG2 is a schematic diagram of a display page provided by an embodiment of the present disclosure;

[0024] FIG3 is a schematic diagram of another display page provided by an embodiment of the present disclosure;

[0025] FIG4 is a flow chart of a virtual live broadcast process provided by an embodiment of the present disclosure;

[0026] FIG5 is a flow chart of another virtual live broadcast processing method provided by an embodiment of the present disclosure;

[0027] FIG6 is a flowchart of another virtual live broadcast processing process provided by an embodiment of the present disclosure;

[0028] FIG7 is a structural diagram of a virtual live broadcast processing device provided by an embodiment of the present disclosure;

[0029] FIG8 is a schematic structural diagram of an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0031] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0032] The virtual live broadcast processing process provided by the relevant technology is usually as follows: when the user clicks on the card corresponding to the target live broadcast room, a virtual live broadcast environment is created for the target live broadcast room; then, the stream address corresponding to the target live broadcast room is obtained and the live broadcast data stream is pulled according to the stream address, and a virtual live broadcast screen is created for the target live broadcast room in the stream pulling callback; thus, the virtual live broadcast screen is rendered based on the first frame image in the live broadcast data stream to display the first frame image. However, the applicant found through research that it takes a long time to pull the live broadcast data stream, resulting in the inability to immediately render the first frame image in the live broadcast data stream onto the virtual live broadcast screen after the virtual live broadcast screen is created. Instead, it has to wait for the first frame image. When the first frame image is parsed from the live broadcast data stream and then the virtual live broadcast screen is rendered based on the first frame image, the user will be perceptibly slow and stuck in the display of the first frame image.

[0033] In view of this, the present disclosure provides a virtual live broadcast processing method, apparatus, device and storage medium to improve the above-mentioned problems.

[0034] Figure 1 is a flowchart of a virtual live broadcast processing method provided by an embodiment of the present disclosure, which can be performed by an electronic device. In one embodiment of the present disclosure, the electronic device may only include a terminal, and the method is entirely performed by the terminal. The terminal can be understood as, for example, virtual reality (VR) glasses, VR helmets, VR all-in-one machines, and other VR devices with VR functions, but is not limited to this. In another embodiment of the present disclosure, the electronic device may include a terminal and a server, and the method can be performed by the terminal and the server. The server can be understood as, for example, a cloud server, an integrated server, and other servers with VR functions, but is not limited to this. The present disclosure does not limit this.

[0035] As shown in FIG1 , the method provided in this embodiment includes the following steps:

[0036] S110: Receive a display request for a target live broadcast room.

[0037] In the disclosed embodiment, if a user wants to enter a target live broadcast room, he or she may send a display request for the target live broadcast room to the electronic device. Upon receiving the display request for the target live broadcast room, the electronic device may obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room.

[0038] Specifically, the target live broadcast room may include a virtual live broadcast room, but is not limited thereto.

[0039] Specifically, the display request for the target live room can be any request that can trigger the electronic device to obtain the live data stream of the target live room and the display attribute information corresponding to the target live room. For example, the display request for the target live room may include a trigger operation for a card corresponding to the target live room.

[0040] S120: Obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room.

[0041] Specifically, the live broadcast data stream is a data stream generated by the live broadcast, which may include image data, audio data, etc., but is not limited thereto.

[0042] Specifically, the display attribute information is information relied upon for creating a virtual live screen, and may include size information corresponding to the live data stream, such as the width and height of the live data stream image, but is not limited thereto.

[0043] Specifically, the electronic device can pull the live broadcast data stream according to the stream pulling information corresponding to the target live broadcast room, and obtain the display attribute information in the stream pulling callback, but is not limited to this.

[0044] The stream pulling information is information relied upon for pulling the live data stream, and may include a stream address, etc., but is not limited thereto.

[0045] There are many specific ways to obtain the streaming information corresponding to the target live broadcast room. Typical examples are given below for explanation, but they do not constitute a limitation of this application.

[0046] In some embodiments, after S110, the stream pulling information corresponding to the target live broadcast room is obtained.

[0047] In other embodiments, before S110, the stream pulling information corresponding to the candidate live broadcast rooms is obtained in advance, so that after S110, the stream pulling information corresponding to the target live broadcast room is selected from the stream pulling information corresponding to the candidate live broadcast rooms.

[0048] S130: Create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room.

[0049] Specifically, when the display attribute information includes the width and height of the live data stream, the electronic device can create a virtual live screen that matches the width and height of the live data stream, but is not limited thereto.

[0050] Specifically, a virtual live screen (surface) is the carrier of images in the live data stream. By rendering the images in the live data stream onto the virtual live screen, users can view the live broadcast in a virtual 3D space. Virtual 3D space is a three-dimensional virtual space used for virtual display, giving users the feeling of being in a virtual environment.

[0051] S140: Rendering a virtual live broadcast screen based on the first frame image in the live broadcast data stream of the target live broadcast room.

[0052] In an embodiment of the present disclosure, after the electronic device parses the first frame image from the live data stream of the target live broadcast room and creates a virtual live screen, it can render the virtual live screen based on the first frame image, thereby realizing the display of the first frame image.

[0053] Specifically, the electronic device can determine the texture information corresponding to the virtual live screen, create a canvas according to the texture information corresponding to the virtual live screen, and render the canvas based on the first frame image, but is not limited to this.

[0054] The disclosed embodiment can receive a display request for a target live broadcast room; obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room; create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room; and render the virtual live broadcast screen based on the first frame image in the live broadcast data stream of the target live broadcast room. According to the disclosed embodiment, the live broadcast data stream of the target live broadcast room can be obtained in advance, reducing the probability of waiting for the first frame image in the target live broadcast data stream after the virtual live broadcast screen is created. In this way, after the virtual live broadcast screen is created, the virtual live broadcast screen can be rendered based on the first frame image as soon as possible, thereby improving the problem of slow display and jamming of the first frame image that can be perceived by the user, and improving the user experience.

[0055] In another embodiment of the present disclosure, before receiving a display request for a target live broadcast room, the method further includes: receiving a display request for a target page; obtaining the stream pulling information corresponding to the candidate live broadcast rooms within the target page, and displaying the target page. Accordingly, obtaining the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room includes: selecting the stream pulling information corresponding to the target live broadcast room from the stream pulling information corresponding to the candidate live broadcast rooms; and obtaining the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room based on the stream pulling information corresponding to the target live broadcast room.

[0056] Specifically, the request to display the target page can be any request that can trigger the electronic device to obtain the stream information corresponding to the candidate live broadcast room in the target page and display the target page. For example, the request to display the target page can include a trigger operation for a tag corresponding to the target page, an input operation for a URL corresponding to the target page, etc., but is not limited thereto.

[0057] In one example, receiving a display request for a target page includes: receiving a trigger operation for a tag corresponding to the target page; displaying the target page includes: responding to the trigger operation for the tag corresponding to the target page, obtaining card information corresponding to the candidate live broadcast room in the target page, and displaying the target page according to the card information, wherein the target page displays a live broadcast room introduction corresponding to the card information; wherein, receiving a display request for the target live broadcast room includes: receiving a trigger operation for the card corresponding to the target live broadcast room in the target page.

[0058] Specifically, multiple labels corresponding to candidate pages can be displayed in the virtual three-dimensional space. When the electronic device receives a trigger operation for a label corresponding to a target page among multiple candidate pages, it can obtain the card information and stream pulling information corresponding to the candidate live broadcast rooms in the target page, and display the target page in the virtual three-dimensional space according to the card information. The target page displays a card corresponding to the card information, that is, a card corresponding to the candidate live broadcast room. When the electronic device receives a trigger operation for a live broadcast room introduction corresponding to a target live broadcast room among the candidate live broadcast rooms in the target page, it can select the stream pulling information corresponding to the target live broadcast room from the stream pulling information corresponding to the candidate live broadcast rooms in the target page.

[0059] Specifically, the card information may include live broadcast room introduction information, recommendation information, etc. The introduction information and recommendation information may be presented in the form of text or images, but is not limited to this.

[0060] Figure 2 is a schematic diagram of a display page provided by an embodiment of the present disclosure. As shown in Figure 2, a "Recommendation" tag and a "Live" tag are displayed in a virtual three-dimensional space. In response to the triggering operation of the "Live" tag, Card 1, Card 2, Card 3, Card 4, Card 5 corresponding to the five candidate live broadcast rooms in the target page corresponding to the "Live" tag are obtained, as well as the five pull-stream information corresponding to the five candidate live broadcast rooms; the target page corresponding to the "Live" tag is displayed in the virtual three-dimensional space, and the five cards are displayed on the target page. In response to the triggering operation of "Card 1", the live data stream and display attribute information of the target live broadcast room are obtained according to the pull-stream information corresponding to the target live broadcast room corresponding to "Card 1".

[0061] It can be understood that by setting up to receive display requests for the target page and obtaining the stream pulling information corresponding to the candidate live broadcast rooms in the target page, when a display request corresponding to the target live broadcast room in the candidate live broadcast rooms is received, the stream pulling information corresponding to the target live broadcast room can be selected from the stream pulling information corresponding to the candidate live broadcast rooms as soon as possible, and then the live data stream of the target live broadcast room can be obtained according to the pre-acquired stream pulling information corresponding to the target live broadcast room, and then the live data stream can be obtained as early as possible, thereby improving the speed of displaying the first frame image and improving the user experience.

[0062] Optionally, the method further includes: when the target page meets a preset refresh condition, re-obtaining the stream pulling information corresponding to the new candidate live broadcast room in the target page.

[0063] Specifically, the preset refresh conditions may include, but are not limited to, the continuous display time of the card information corresponding to the currently displayed candidate live broadcast room being greater than a preset time threshold, receiving a trigger operation for the refresh control, etc.

[0064] Optionally, when the target page meets the preset refresh conditions, the card information and stream pulling information corresponding to the new candidate live broadcast rooms in the target page are retrieved; and the card information corresponding to multiple new candidate live broadcast rooms is refreshed and displayed in the virtual three-dimensional space.

[0065] Figure 3 is a schematic diagram of another display page provided by an embodiment of the present disclosure. As shown in Figure 3, when the continuous display time of Card 1, Card 2, Card 3, Card 4, and Card 5 is greater than the preset time threshold, Card 6, Card 7, Card 8, and Card 9 corresponding to the four new candidate live broadcast rooms in the target page corresponding to the "Live" label are re-acquired, and the four candidate stream pulling information corresponding to the four candidate live broadcast rooms are refreshed and displayed in the virtual three-dimensional space, and the target page includes the new four cards. In response to the triggering operation of "Card 7", the live data stream and display attribute information of the target live broadcast room are obtained according to the stream pulling information corresponding to the target live broadcast room corresponding to "Card 7".

[0066] It can be understood that by re-acquiring the pull-stream information corresponding to the new candidate live broadcast room in the target page when the preset refresh conditions are met, the pre-acquired pull-stream information can be updated as the candidate live broadcast room in the target page is updated, ensuring that when a display request for the target live broadcast room in the new candidate live broadcast room is received, the pull-stream information corresponding to the target live broadcast room is selected from the pull-stream information corresponding to the new candidate live broadcast room as soon as possible, and then the live data stream of the target live broadcast room is obtained as soon as possible, thereby improving the speed of displaying the first frame image and improving the user experience.

[0067] In another embodiment of the present disclosure, creating a virtual live broadcast screen based on display attribute information corresponding to the target live broadcast room includes: creating a virtual live broadcast environment corresponding to the target live broadcast room in a virtual three-dimensional space; and creating a virtual live broadcast screen in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0068] Specifically, the virtual live broadcast environment is the virtual environment where the virtual live broadcast screen is located. The virtual live broadcast environment may include, but is not limited to, a virtual live broadcast scene (e.g., a background wall, props for assisting the live broadcast, etc.), and virtual interactive components (e.g., a like component, a comment component, a gift sending component, etc.). After the virtual live broadcast environment is created in the virtual three-dimensional space, the user can see the virtual live broadcast environment in the virtual three-dimensional space.

[0069] Optionally, the live broadcast type corresponding to the target live broadcast room may be obtained, and a virtual live broadcast environment corresponding to the target live broadcast room may be created in a virtual three-dimensional space according to the live broadcast type, but the present invention is not limited thereto.

[0070] For example, when the live broadcast type corresponding to the target live broadcast room is a concert, a virtual live broadcast scene (for example, including a stage, a microphone, etc.) and virtual interactive components (for example, a comment component, etc.) that match the concert can be created; when the live broadcast type corresponding to the target live broadcast room is an event live broadcast, a virtual live broadcast scene (for example, including a competition area, etc.) and virtual interactive components (for example, including a like component, a comment component, etc.) that match the event live broadcast can be created.

[0071] For example, FIG4 is a flowchart of a virtual live broadcast process provided by an embodiment of the present disclosure. The virtual live broadcast process is executed by a terminal and a server, wherein the terminal includes a logic processing module and a virtual display module. As shown in FIG4, the virtual live broadcast process includes the following steps:

[0072] S401. The logic processing module receives a trigger operation of a card corresponding to a target live broadcast room displayed in a virtual three-dimensional space, obtains the live data stream of the target live broadcast room according to the pull stream information corresponding to the target live broadcast room, and sends a scene creation request to the virtual display module.

[0073] The scene creation request carries the live broadcast room information corresponding to the target live broadcast room, and the live broadcast room information includes the live broadcast type.

[0074] Specifically, obtaining the live data stream of the target live broadcast room according to the pull stream information corresponding to the target live broadcast room may include: the logic processing module sends a pull stream request to its corresponding first server, wherein the pull stream request carries the pull stream information corresponding to the target live broadcast room, and the pull stream request is used to enable the first server to feedback the live data stream of the target live broadcast room; the logic processing module receives the live data stream of the target live broadcast room.

[0075] S402. The virtual display module creates a virtual live scene corresponding to the target live room according to the live room information corresponding to the target live room in response to the scene creation request.

[0076] S403: After the virtual live broadcast scene is created, the virtual display module sends a scene creation completion notification to the logic processing module.

[0077] S404. After receiving the notification of scene creation completion, the logic processing module creates a virtual interactive component corresponding to the target live broadcast room.

[0078] S405: The logic processing module obtains display attribute information in the stream pull callback and sends a screen creation request to the virtual display module.

[0079] Specifically, the logic processing module obtains the display attribute information in the stream pull callback, including: the logic processing module sends a display attribute request to the second server corresponding to the virtual display module in the stream pull callback, the display attribute request is used to make the second server feedback the display attribute information; the logic processing module receives the display attribute information.

[0080] The screen creation request carries display attribute information.

[0081] S406: The virtual display module creates a virtual live screen according to the display attribute information in response to the screen creation request.

[0082] S407. After the virtual live screen is created, the virtual display module sends texture information corresponding to the virtual live screen to the logic processing module.

[0083] S408: The logic processing module creates a canvas according to the texture information.

[0084] S409: The logic processing module parses the live broadcast data stream of the target live broadcast room and obtains the first frame image.

[0085] S410: The logic processing module renders the canvas based on the first frame image.

[0086] It can be understood that by setting up a virtual live broadcast environment corresponding to the target live broadcast room in a virtual three-dimensional space, and creating a virtual live broadcast screen in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room, the virtual live broadcast environment can be used to give users an immersive feeling, thereby improving the user's sense of immersion in watching the live broadcast.

[0087] Figure 5 is a flow chart of another virtual live broadcast processing method provided by an embodiment of the present disclosure. The present disclosure embodiment is optimized based on the above embodiment, and the present disclosure embodiment can be combined with various optional solutions in one or more of the above embodiments.

[0088] As shown in FIG5 , the virtual live broadcast processing method may include the following steps.

[0089] S510: Receive a display request for a target live broadcast room.

[0090] Specifically, S510 is similar to S110 and will not be described again here.

[0091] Optionally, after S510, the method may further include: when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, setting the value of the preset flag to a first value.

[0092] Specifically, the preset flag is used to identify the valid state of the live data stream of the target live broadcast room. Therefore, according to the value of the preset flag, it can be determined whether the valid live data stream corresponding to the target live broadcast room has been pre-acquired.

[0093] S520: Obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room.

[0094] Specifically, S520 is similar to S120 and will not be described in detail here.

[0095] S530: Create a virtual live broadcast environment corresponding to the target live broadcast room in the virtual three-dimensional space.

[0096] Specifically, please refer to the previous text for the explanation of S530, which will not be repeated here.

[0097] S540: When the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, a virtual live broadcast screen is created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0098] Specifically, the live broadcast status includes the host being live and the host temporarily leaving. It should be noted that the host temporarily leaving means that the host temporarily leaves the live broadcast room, rather than ending the live broadcast.

[0099] Optionally, when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live and the value of the preset flag is a first value, a virtual live broadcast screen is created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0100] Specifically, when the value of the preset flag is the first value, it indicates that a valid live data stream corresponding to the target live broadcast room has been pre-acquired. In this way, there is no need to obtain the live data stream of the target live broadcast room, and a virtual live broadcast screen can be directly created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0101] It can be understood that by setting a preset flag to indicate whether the valid live data stream corresponding to the target live room has been pre-acquired, it is possible to quickly and conveniently determine whether it is necessary to re-acquire the live data stream of the target live room based on the value of the preset flag.

[0102] Optionally, when the live broadcast status of the target live broadcast room is that the anchor has temporarily left, the live broadcast data stream of the target live broadcast room obtained by S510 is invalid, the live broadcast data stream can be discarded, and the operation of "creating a virtual live broadcast screen in a virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room" and subsequent operations will no longer be performed.

[0103] Optionally, the method further includes: when the live broadcast status of the target live broadcast room is that the anchor has temporarily left, setting the value of the preset flag to a second value.

[0104] Specifically, when the value of the preset flag bit is the second value, it indicates that no valid target live data stream has been pre-acquired.

[0105] In this way, when the live broadcast status is switched from the host temporarily leaving to the host currently broadcasting live, the new live broadcast data stream and new display attribute information of the target live broadcast room can be re-obtained based on the value of the preset flag being the second value and the pull stream information corresponding to the target live broadcast room.

[0106] S550: Render a virtual live broadcast screen based on the first frame image in the live broadcast data stream of the target live broadcast room.

[0107] Specifically, S550 is similar to S140 and will not be described in detail here.

[0108] Optionally, the method also includes: when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, setting the audio playback status of the player in the target live broadcast room to a mute state; when rendering the first frame image to the virtual live broadcast screen, switching the audio playback status of the player in the target live broadcast room from a mute state to a play state to play the audio corresponding to the first frame image.

[0109] It is understandable that when the live data stream of the target live broadcast room is parsed to obtain the first frame image and the audio corresponding to the first frame image, if the player's working state is the play state, the audio corresponding to the first frame image can be played immediately. However, it takes time to render the virtual live screen based on the first frame image. Therefore, it may happen that the first frame image has not yet been displayed, but the audio corresponding to the first frame image has already started to play. However, in this application, by switching the working state of the player from the mute state to the play state when rendering the first frame image to the virtual live screen, and playing the audio corresponding to the first frame image, the user can feel the synchronization of sound and picture, thereby improving the user's viewing experience.

[0110] Optionally, after S550, when the live broadcast status is switched from the host being live broadcasting to the host temporarily leaving, the value of the preset flag is set to a second value.

[0111] In this way, when the live broadcast status is switched from the host temporarily leaving to the host currently broadcasting, the new live broadcast data stream and new display attribute information of the target live broadcast room can be obtained based on the value of the preset flag being the second value and the corresponding stream pulling information of the target live broadcast room.

[0112] Optionally, the method also includes: when the live broadcast status of the target live broadcast room is switched from the host temporarily leaving to the host currently broadcasting live, obtaining a preset flag; when the value of the preset flag is a second value, obtaining a new live broadcast data stream of the target live broadcast room and new display attribute information corresponding to the target live broadcast room; creating a new virtual live broadcast screen based on the new display attribute information corresponding to the target live broadcast room; rendering the new virtual live broadcast screen based on the first frame image in the new live broadcast data stream of the target live broadcast room.

[0113] In this way, when the live broadcast status switches from the host temporarily leaving to the host currently broadcasting, the new live broadcast data stream and new display attribute information of the target live broadcast room can be obtained as soon as possible according to the stream pulling information corresponding to the target live broadcast room, so as to create a new virtual live broadcast screen corresponding to the target live broadcast room as soon as possible according to the new display attribute information and render the new virtual live broadcast screen based on the image in the new live broadcast data stream, so that the live broadcast content can be presented to the user as soon as possible when the host returns to the live broadcast.

[0114] The disclosed embodiment can determine whether to create a virtual live screen in a virtual live environment based on the display attribute information according to the live status, so that the virtual live screen can be created in time when the live status is live broadcasting, and the virtual live screen will not be created when the live status is that the host has left to avoid wasting resources. In addition, by setting a preset flag, it is possible to quickly and conveniently determine whether a valid live data stream has been obtained, so that the live data stream will no longer be pulled when the preset flag is a first data value, and a new live data stream will be pulled again when the preset flag is a second data value to present the live content to the user as soon as possible. In addition, by setting the working state of the player to switch from a mute state to a play state to play the audio corresponding to the first frame image in the target live data stream, the sound and picture can be synchronized, thereby improving the user's viewing experience.

[0115] The following is a detailed description of the virtual live broadcast processing method provided by the embodiment of the present disclosure based on a specific example. FIG6 is a flowchart of another virtual live broadcast processing process provided by the embodiment of the present disclosure. As shown in FIG6, the virtual live broadcast processing process includes the following steps:

[0116] S601. Receive a trigger operation on a tag corresponding to a target page in a tag corresponding to a candidate page displayed in a virtual three-dimensional space, and obtain card information and stream pulling information corresponding to the candidate live broadcast room in the target page.

[0117] S602. Display a target page in a virtual three-dimensional space according to the card information, wherein the target page includes cards corresponding to the candidate live broadcast rooms.

[0118] S603. Receive a trigger operation for a card corresponding to a target live broadcast room among the cards corresponding to candidate live broadcast rooms displayed in a virtual three-dimensional space, select the stream pulling information corresponding to the target live broadcast room from the stream pulling information corresponding to the candidate live broadcast rooms, and obtain the live broadcast data stream and display attribute information of the target live broadcast room based on the stream pulling information corresponding to the target live broadcast room.

[0119] S604: When the live broadcast status is that the anchor is broadcasting live and the value of the preset flag is the first value, the value of the preset flag is set to the first value.

[0120] S605: Create a virtual live broadcast environment corresponding to the target live broadcast room in the virtual three-dimensional space.

[0121] S606: Obtain the live broadcast status of the target live broadcast room and obtain a preset flag.

[0122] S607: When the live broadcast status is that the anchor is broadcasting live and the value of the preset flag is the first value, a virtual live broadcast screen is created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0123] S608: When the live broadcast status indicates that the host has temporarily left, the value of the preset flag is set to a second value.

[0124] S609: When the live broadcast state is that the anchor is broadcasting live and the value of the preset flag is the first value, the working state of the player is set to a mute state.

[0125] S610. Render a virtual live screen based on the first frame image in the live data stream. When rendering the first frame image in the live data stream to the virtual live screen, switch the working state of the player from the mute state to the play state to play the audio corresponding to the first frame image in the live data stream.

[0126] S611. When the live broadcast status is switched from the host being live broadcasting to the host temporarily leaving, the value of the preset flag is set to a second value.

[0127] S612: When the live broadcast status is switched from the host temporarily leaving to the host currently broadcasting, obtain the value of the preset flag.

[0128] S613: When the value of the preset flag is the second value, obtain a new live data stream and new display attribute information according to the stream pulling information corresponding to the target live broadcast room.

[0129] S614: Create a new virtual live broadcast screen in the virtual live broadcast environment according to the new display attribute information.

[0130] S615: Render a new virtual live screen based on the image in the new live data stream.

[0131] FIG7 is a schematic diagram of the structure of a virtual live broadcast processing device provided by an embodiment of the present disclosure. The virtual live broadcast processing device can be understood as the above-mentioned electronic device or a part of the functional modules in the above-mentioned electronic device. As shown in FIG7 , the virtual live broadcast processing device 700 includes:

[0132] The first receiving module 710 is configured to receive a display request for a target live broadcast room;

[0133] The first acquisition module 720 is used to obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room;

[0134] A first creation module 730 is configured to create a virtual live broadcast screen based on display attribute information corresponding to the target live broadcast room;

[0135] The first rendering module 740 is used to render the virtual live screen based on the first frame image in the live data stream of the target live room.

[0136] In another embodiment of the present disclosure, the device further includes:

[0137] A second receiving module is configured to receive a display request for a target page before receiving the display request for the target live broadcast room;

[0138] The second acquisition module is used to obtain the stream pulling information corresponding to the candidate live broadcast room in the target page; the first display module is used to display the target page.

[0139] In another embodiment of the present disclosure, the first acquisition module 720 is specifically used to select the stream pulling information corresponding to the target live broadcast room from the stream pulling information corresponding to the candidate live broadcast room; and obtain the live data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room based on the stream pulling information corresponding to the target live broadcast room.

[0140] In another embodiment of the present disclosure, the device further comprises:

[0141] The refresh module is used to re-acquire the stream pulling information corresponding to the new candidate live broadcast room in the target page when the target page meets the preset refresh conditions.

[0142] In another embodiment of the present disclosure, the second receiving module is specifically configured to receive a triggering operation for a tag corresponding to the target page;

[0143] The first display module is specifically used to respond to the trigger operation of the tag corresponding to the target page, obtain the card information corresponding to the candidate live room in the target page, and display the target page according to the card information, wherein the card corresponding to the card information is displayed on the target page

[0144] Among them, the first receiving module 710 is specifically used to receive a trigger operation for the card corresponding to the target live broadcast room in the target page.

[0145] In another embodiment of the present disclosure, the first creation module 730 includes:

[0146] A first creation submodule is used to create a virtual live broadcast environment corresponding to the target live broadcast room in a virtual three-dimensional space;

[0147] The second creation submodule is used to create the virtual live broadcast screen in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

[0148] In another embodiment of the present disclosure, the second creation submodule is specifically used to create the virtual live broadcast screen in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live.

[0149] In another embodiment of the present disclosure, the device further comprises:

[0150] The audio playback status setting module is used to set the audio playback status of the player in the target live broadcast room to a mute state when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live; when the first frame image is rendered to the virtual live broadcast screen, the audio playback status of the player in the target live broadcast room is switched from a mute state to a play state to play the audio corresponding to the first frame image.

[0151] In another embodiment of the present disclosure, the device further comprises:

[0152] A preset flag setting module is used to, after obtaining the live data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room, set the value of the preset flag to a first value when the live broadcast status of the target live broadcast room is that the anchor is broadcasting live; and set the value of the preset flag to a second value when the live broadcast status of the target live broadcast room is that the anchor has temporarily left, or the live broadcast status is switched from the anchor being broadcasting live to the anchor temporarily leaving, wherein the preset flag is used to identify the valid status of the live data stream of the target live broadcast room.

[0153] In another embodiment of the present disclosure, the device further comprises:

[0154] A fourth acquisition module is used to obtain the preset flag when the live broadcast status of the target live broadcast room is switched from the anchor temporarily leaving to the anchor currently broadcasting;

[0155] A fifth acquisition module is configured to acquire, when the value of the preset flag is the second value, a new live data stream of the target live broadcast room and new display attribute information corresponding to the target live broadcast room;

[0156] A second creation module is configured to create a new virtual live broadcast screen based on the new display attribute information corresponding to the target live broadcast room;

[0157] The second rendering module is used to render the new virtual live screen based on the first frame image in the new live data stream of the target live room.

[0158] The device provided in this embodiment can execute the method of any of the above embodiments, and its execution method and beneficial effects are similar, which will not be repeated here.

[0159] An embodiment of the present disclosure further provides an electronic device, comprising: a memory storing a computer program; and a processor for executing the computer program. When the computer program is executed by the processor, the method of any of the above embodiments can be implemented.

[0160] For example, FIG8 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. With specific reference below to FIG8 , a schematic diagram of the structure of an electronic device 800 suitable for implementing an embodiment of the present disclosure is shown. The electronic device shown in FIG8 is merely an example and should not limit the functionality or scope of use of the embodiments of the present disclosure.

[0161] As shown in Figure 8, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 are also stored in the RAM 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0162] Typically, the following devices may be connected to the I / O interface 805: an input device 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although FIG8 shows the electronic device 800 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0163] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0164] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0165] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0166] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0167] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0168] Receive a display request for a target live broadcast room;

[0169] Obtain the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room;

[0170] Create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room;

[0171] Render a virtual live screen based on the first frame image in the live data stream of the target live room.

[0172] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0173] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0174] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0175] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0176] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0177] The embodiments of the present disclosure further provide a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0178] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0179] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. A virtual live broadcast processing method, wherein: include: Receive a display request for a target live broadcast room; Acquire the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room; Creating a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room; The virtual live broadcast screen is rendered based on the first frame image in the live broadcast data stream of the target live broadcast room.

2. The method according to claim 1, wherein: Before receiving the display request for the target live broadcast room, the method further includes: Receiving a display request for a target page; Obtain the streaming information corresponding to the candidate live broadcast room in the target page, and display the target page.

3. The method according to claim 2, wherein: The acquiring of the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room includes: Select the stream pulling information corresponding to the target live broadcast room from the stream pulling information corresponding to the candidate live broadcast room; Based on the stream pulling information corresponding to the target live broadcast room, the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room are obtained.

4. The method according to claim 2, wherein: Also includes: When the target page meets the preset refresh condition, the streaming information corresponding to the new candidate live broadcast room in the target page is re-acquired.

5. The method according to claim 2, wherein: The receiving a display request for the target page includes: receiving a trigger operation for a tag corresponding to the target page; The displaying of the target page includes: in response to a triggering operation on a tag corresponding to the target page, obtaining card information corresponding to the candidate live room in the target page, and displaying the target page according to the card information, wherein the target page is displayed A card corresponding to the card information is displayed; The receiving of a display request for a target live broadcast room includes: Receive a trigger operation for the card corresponding to the target live broadcast room in the target page.

6. The method according to claim 1, wherein: The creating a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room includes: Creating a virtual live broadcast environment corresponding to the target live broadcast room in a virtual three-dimensional space; The virtual live broadcast screen is created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

7. The method according to claim 6, wherein: The creating the virtual live broadcast screen in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room includes: When the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, the virtual live broadcast screen is created in the virtual live broadcast environment based on the display attribute information corresponding to the target live broadcast room.

8. The method according to claim 7, wherein: Also includes: When the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, setting the audio playback status of the player of the target live broadcast room to a mute state; When the first frame image is rendered to the virtual live broadcast screen, the audio playback state of the player in the target live broadcast room is switched from a mute state to a play state to play the audio corresponding to the first frame image.

9. The method according to claim 7 or 8, wherein: After acquiring the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room, the method further includes: When the live broadcast status of the target live broadcast room is that the anchor is broadcasting live, setting the value of the preset flag to a first value; When the live broadcast status of the target live broadcast room is that the anchor temporarily leaves, or the live broadcast status is switched from the anchor being live to the anchor temporarily leaving, the value of the preset flag is set to a second value, wherein the preset flag is used to identify the target live broadcast room. The valid status of the live data stream between 10. The method according to claim 9, wherein: Also includes: When the live broadcast status of the target live broadcast room is switched from the anchor temporarily leaving to the anchor currently broadcasting live, the preset flag is obtained; When the value of the preset flag is the second value, obtaining a new live data stream of the target live broadcast room and new display attribute information corresponding to the target live broadcast room; Creating a new virtual live broadcast screen in the virtual live broadcast environment based on new display attribute information corresponding to the target live broadcast room; The new virtual live screen is rendered based on the first frame image in the new live data stream of the target live room.

11. A virtual live broadcast processing device, wherein: include: A first receiving module, configured to receive a display request for a target live broadcast room; A first acquisition module is used to acquire the live broadcast data stream of the target live broadcast room and the display attribute information corresponding to the target live broadcast room; A creation module, used to create a virtual live broadcast screen based on the display attribute information corresponding to the target live broadcast room; A rendering module is used to render the virtual live screen based on the first frame image in the live data stream of the target live room.

12. An electronic device, wherein: include: A processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method according to any one of claims 1 to 10.

13. A computer-readable storage medium, wherein: The storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images