Interaction method and device for multi-type real-time channel live broadcast rooms

Abstract

The invention provides an interaction method and device for multi-type real-time channel live broadcasting rooms. According to the invention, when the type of the real-time channel of the interaction object is inconsistent with the type of the real-time channel of the application end, the application end creates the second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the real-time channel adopted by the interaction object; and the types of the real-time channels of the application end and the interaction object are kept consistent, so that a platform adopting multiple types of real-time channels realizes streaming media interaction between two interaction parties, and the purposes of smooth switching, effect preferential selection and disaster recovery backup are realized.

Description

Technical Field

[0001] The present disclosure relates to the field of streaming media processing, and more particularly, to an interaction method, apparatus, medium, and electronic device for a multi-type real-time channel live broadcast room. Background Art

[0002] With the rapid development of mobile communication technology, the social entertainment needs of humans have expanded from simple acquaintance social interactions to stranger social interactions and now to the pan-entertainment industry. Relying on good network transmission conditions, better hardware devices, and ultra-large-scale concurrent technology support, the pan-entertainment industry integrates streaming media technology into social platforms. Among them, the most important is real-time communication technology (abbreviated as RTC in English, Real-Time Communication). RTC refers to a technology or protocol that supports real-time audio, video, data, etc. communication. RTC is widely used in scenarios such as real-time audio and video calls, live interactive broadcasts, and online meetings. Due to the importance and high technical difficulty of RTC, many manufacturers providing RTC services have emerged.

[0003] Many interactive entertainment companies and online education institutions rely on the RTC services of many manufacturers to provide consumers with rich and colorful voice live broadcasts, video live broadcasts, short videos, and online education content. Due to the need for effect optimization and disaster tolerance backup, it is often necessary to integrate the RTC services of many manufacturers in their own platforms in order to achieve various forms of interaction.

[0004] However, currently, when switching from the RTC service of the first manufacturer to the RTC service of the second manufacturer, it is only possible to first destroy the RTC service engine of the first manufacturer and then create the RTC service engine of the second manufacturer. During the switching process, phenomena such as black screens, pauses, and lags often occur, resulting in a poor experience.

[0005] Therefore, the present disclosure provides an interaction method for a multi-type real-time channel live broadcast room to solve one of the above technical problems. Summary of the Invention

[0006] The purpose of the present disclosure is to provide an interaction method, apparatus, medium, and electronic device for a multi-type real-time channel live broadcast room, which can solve at least one of the above-mentioned technical problems. The specific solutions are as follows:

[0007] According to a specific embodiment of the present disclosure, in a first aspect, the present disclosure provides an interaction method for a multi-type real-time channel live broadcast room, including:

[0008] When pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, obtain the streaming media interaction request of the interaction object forwarded by the remote server;

[0009] After agreeing to the streaming media interaction request of the interaction object, obtain the streaming media interaction message sent by the remote server, where the streaming media interaction message includes the type feature identifier of the second type of real-time channel adopted by the interaction object;

[0010] When the type feature identifier of the second type of real-time channel does not match the type feature identifier of the first type of real-time channel, create a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second type of real-time channel;

[0011] Push the original streaming media to the interaction object through the second type of target real-time channel.

[0012] Optionally, the method further includes:

[0013] When pushing the original streaming media to the interaction object through the second type of target real-time channel, obtain the dual-channel push duration;

[0014] When the dual-channel push duration exceeds the preset delay duration threshold, prohibit the management service to which the first type of real-time channel belongs from resetting the first type of real-time channel in the streaming media session, and then destroy the first type of real-time channel.

[0015] Optionally, the method further includes:

[0016] When pushing the original streaming media to the interaction object through the second type of target real-time channel, pull the original streaming media pushed by the interaction object through the second type of target real-time channel;

[0017] Process the original streaming media pushed by the interaction object based on a preset scaling and rendering strategy to obtain a target streaming media;

[0018] Display the target streaming media.

[0019] Optionally, before destroying the first type of real-time channel, it further includes:

[0020] Save the display status information associated with the first type of real-time channel;

[0021] Correspondingly, the displaying the target streaming media includes:

[0022] When destroying the first type of real-time channel, display the target streaming media based on the display status information.

[0023] Optionally, before pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, it further includes:

[0024] Log in to the live broadcast room.

[0025] Optionally, the method further includes:

[0026] When performing streaming media interaction with the interaction object, monitor the interruption message and routing change message of the streaming media interaction, and save the device routing information in the streaming media session, where the interruption message includes a start interruption message and an end interruption message;

[0027] When the start interruption message is monitored, pause the acquisition of the original streaming media in the active acquisition mode;

[0028] When the end interruption message is monitored, resume the acquisition of the original streaming media in the active acquisition mode, and when the routing change message is monitored, restore the device routing information in the streaming media session based on the saved device routing information.

[0029] Optionally, the method further includes:

[0030] When performing streaming media interaction with the interaction object, when obtaining the abnormal information of the active acquisition mode, switch the active acquisition mode to the passive acquisition mode.

[0031] According to a specific embodiment of the present disclosure, in a second aspect, the present disclosure provides an interaction device for a multi-type real-time channel live broadcast room, including:

[0032] A request acquisition unit, configured to obtain a streaming media interaction request of an interaction object forwarded by a remote server when pushing the original streaming media obtained in the active acquisition mode through a first type of real-time channel;

[0033] A message acquisition unit, configured to obtain a streaming media interaction message sent by the remote server after agreeing to the streaming media interaction request of the interaction object, where the streaming media interaction message includes a type feature identifier of a second type of real-time channel adopted by the interaction object;

[0034] A channel creation unit, configured to create a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second type of real-time channel when the type feature identifier of the second type of real-time channel does not match the type feature identifier of the first type of real-time channel;

[0035] A push unit, configured to push the original streaming media to the interaction object through the second type of target real-time channel.

[0036] Optionally, the device further includes:

[0037] A duration acquisition unit, configured to obtain the dual-channel push duration when pushing the original streaming media to the interaction object through the second type of target real-time channel.

[0038] A destruction unit, configured to, when the dual-channel push duration exceeds a preset delay duration threshold, prohibit the management service to which the first type of real-time channel belongs from resetting the first type of real-time channel in the streaming media session, and then destroy the first type of real-time channel.

[0039] Optionally, the device further includes:

[0040] A pulling unit, configured to, when pushing the original streaming media to the interactive object through the second type of target real-time channel, pull the original streaming media pushed by the interactive object through the second type of target real-time channel;

[0041] A rendering unit, configured to process the original streaming media pushed by the interactive object based on a preset scaling and rendering strategy to obtain a target streaming media;

[0042] A display unit, configured to display the target streaming media.

[0043] Optionally, the device further includes:

[0044] A first saving unit, configured to save display status information associated with the first type of real-time channel before destroying the first type of real-time channel;

[0045] Correspondingly, the displaying the target streaming media includes:

[0046] When destroying the first type of real-time channel, displaying the target streaming media based on the display status information.

[0047] Optionally, the device further includes:

[0048] A login unit, configured to log in to the live broadcast room before pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel.

[0049] Optionally, the device further includes:

[0050] A second saving unit, configured to, when performing streaming media interaction with the interactive object, monitor interruption messages and routing change messages of the streaming media interaction, and save device routing information in the streaming media session, where the interruption messages include a start interruption message and an end interruption message;

[0051] A pause unit, configured to, when monitoring the start interruption message, pause the original streaming media obtained in the active acquisition mode;

[0052] A recovery unit, configured to, when the end interruption message is monitored, recover the original streaming media obtained in the active acquisition mode, and when the routing change message is monitored, recover the device routing information in the streaming media session based on the saved device routing information.

[0053] Optionally, the device further includes:

[0054] A switching unit, configured to, when performing streaming media interaction with the interaction object, and when abnormal information of the active acquisition mode is obtained, switch the active acquisition mode to a passive acquisition mode.

[0055] According to a specific embodiment of the present disclosure, in a third aspect, the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the interactive method of the multi-type real-time channel live broadcast room as described in any one of the above is implemented.

[0056] According to a specific embodiment of the present disclosure, in a fourth aspect, the present disclosure provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the interactive method of the multi-type real-time channel live broadcast room as described in any one of the above.

[0057] The above solution of the embodiment of the present disclosure has at least the following beneficial effects compared with the prior art:

[0058] The present disclosure provides an interactive method, device, medium and electronic device for a multi-type real-time channel live broadcast room. When the types of the real-time channels of the interaction object and the real-time channels of the present application end are inconsistent, the present application end creates a second-type target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the real-time channel adopted by the interaction object, so that the types of the real-time channels of the present application end and the interaction object are kept consistent, thereby enabling the platform adopting multi-type real-time channels to realize streaming media interaction between the two parties of the interaction, and achieving the purposes of smooth switching, effect optimization and disaster tolerance backup. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 Shows a flowchart of an interactive method for a multi-type real-time channel live broadcast room according to an embodiment of the present disclosure;

[0060] Figure 2 Shows a module schematic diagram of an interactive method for a multi-type real-time channel live broadcast room according to an embodiment of the present disclosure;

[0061] Figure 3 Shows a unit block diagram of an interactive device for a multi-type real-time channel live broadcast room according to an embodiment of the present disclosure;

[0062] Figure 4 Shows a schematic diagram of an electronic device connection structure provided according to an embodiment of the present disclosure. Detailed implementation manners

[0063] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0064] The terms used in the embodiments of the present disclosure are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure. The singular forms "a", "the" and "said" used in the embodiments of the present disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. "Plural" generally includes at least two.

[0065] It should be understood that the term "and / or" used herein is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " herein generally represents an "or" relationship between the front and rear associated objects.

[0066] It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present disclosure for description, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present disclosure, the first may also be referred to as the second, and similarly, the second may also be referred to as the first.

[0067] Depending on the context, the words "if", "when" as used herein may be interpreted as "when...", "when...", "in response to determining", or "in response to detecting". Similarly, depending on the context, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined", "in response to determining", "when detected (stated condition or event)", or "in response to detecting (stated condition or event)".

[0068] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a commodity or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or elements inherent to such commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the commodity or device comprising said element.

[0069] It should be particularly noted that symbols and / or numbers existing in the specification, if not marked in the accompanying drawing description, are not reference numerals.

[0070] The optional embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0071] Embodiment 1

[0072] This is an embodiment of the interactive method for a multi-type real-time channel live broadcast room provided by the present disclosure.

[0073] The following is combined with Figure 1 The embodiments of the present disclosure will be described in detail.

[0074] Step S101, when pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, obtain the streaming media interaction request of the interaction object forwarded by the remote server.

[0075] Currently, many manufacturers can provide RTC services. For the needs of effect optimization and disaster tolerance backup, the embodiments of the present disclosure integrate the RTC services of many manufacturers in its own platform, generate multiple types of real-time channels through multiple types of RTC services, and realize various forms of interaction. Among them, each type of real-time channel is generated by the RTC services provided by different manufacturers. The RTC service of each manufacturer is provided through the corresponding manufacturer's Software Development Kit (SDK for short). The SDK is a collection of development tools for creating application software for specific software packages, software frameworks, hardware platforms, operating systems, etc. It promotes the creation of application programs through compilers, debuggers, software frameworks, etc. It can provide application program interfaces for programming languages, but may also include complex hardware that can communicate with a certain embedded system. For example, the first type of real-time channel is a real-time communication channel generated by the SDK for RTC service provided by Manufacturer A.

[0076] The active acquisition mode is a streaming media acquisition method opposite to the passive acquisition mode. In the passive acquisition mode, the manufacturer providing the RTC service controls the streaming media for interaction. For example, in the passive acquisition mode, when the manufacturer providing the RTC service destroys the real-time channel, there will be an operation to reset the streaming media session (such as AudioSession). In the active acquisition mode, the platform completely controls the streaming media for interaction by itself, prohibiting the manufacturer's control. For example, in the active acquisition mode, the platform can prohibit the operation of resetting the streaming media session (i.e., AudioSession). In the active acquisition mode, the platform can control the streaming media for black screen, pause, freeze, and rendering.

[0077] Streaming media includes audio and / or video. Through streaming media technology, it is possible to achieve streaming transmission after compressing and segmenting the streaming media. Users can achieve playing while downloading, thereby greatly shortening the startup delay and reducing the demand for system cache capacity, and realizing live interaction. Streaming media technology is widely used in fields such as video conferencing, webcasting, Internet TV, Internet movies, online games, etc. For example, in webcasting, streaming media technology can transmit video and audio in real time, enabling users to watch and listen in real time; in Internet TV, streaming media technology can transmit the TV programs watched by users in real time.

[0078] Original streaming media, that is, streaming media without any processing.

[0079] The remote server provides interactive services for the application side. For example, as Figure 2 shown, the first application side (i.e., the interaction object) sends a streaming media interaction request to the remote server. The streaming media interaction request includes at least the identity identifier of the second application side. After the remote server obtains the identity identifier of the second application side in the streaming media interaction request, it forwards the streaming media interaction request to the second application side. When the remote server receives the consent information from the second application side, it establishes an interactive service for the first application side and the second application side.

[0080] The streaming media interaction request includes an audio interaction request and / or a video interaction request.

[0081] The interaction includes live broadcast or duet challenge.

[0082] In some specific embodiments, before pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, it further includes:

[0083] Step S100, log in to the live room.

[0084] In this specific embodiment, it is necessary to log in to the live room successfully to be able to interact.

[0085] Step S102: After agreeing to the streaming media interaction request of the interaction object, obtain the streaming media interaction message sent by the remote server.

[0086] Among them, the streaming media interaction message includes the type feature identifier of the second type of real-time channel adopted by the interaction object.

[0087] Agreeing to the streaming media interaction request of the interaction object can be understood as sending an approval message in response to the streaming media interaction request to the remote server. Based on this approval message, the remote server sends the streaming media interaction message to both parties of the interaction.

[0088] The type feature identifier is the unique information used to characterize the real-time channel type. For example, the type feature identifier represents the manufacturer code providing the RTC service. Through the manufacturer code, it is possible to know the type of real-time channel adopted by the interaction object, that is, the second type of real-time channel is created through the SDK associated with the manufacturer code.

[0089] Step S103: When the type feature identifier of the second type of real-time channel does not match the type feature identifier of the first type of real-time channel, create a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second type of real-time channel.

[0090] The type feature identifier of the second type of real-time channel not matching the type feature identifier of the first type of real-time channel can be understood as that the interaction object and the application end adopt different types of real-time channels. If both parties of the interaction participating in the live broadcast or the co-hosting challenge adopt different types of real-time channels, the live broadcast or the co-hosting challenge cannot be realized. For this reason, through the type feature identifier of the second type of real-time channel, the application end can clarify which type of SDK the interaction object uses to create the second type of real-time channel. Therefore, the application end creates a second type of target real-time channel of the same type as the interaction object.

[0091] Step S104: Push the original streaming media to the interaction object through the second type of target real-time channel.

[0092] Thus, a working mode of parallel operation of the first type of real-time channel and the second type of target real-time channel is generated.

[0093] In the embodiment of the present disclosure, when the real-time channels of the interaction object and the application end are of different types, the application end creates a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the real-time channel adopted by the interaction object, so that the types of the real-time channels of the application end and the interaction object are kept consistent, thereby enabling a platform adopting multiple types of real-time channels to realize streaming media interaction between both parties of the interaction, achieving the purposes of smooth switching, effect optimization and disaster tolerance backup.

[0094] In some specific embodiments, the method further includes:

[0095] Step S105a-1: When pushing the original streaming media to the interaction object through the second type of target real-time channel, obtain the dual-channel push duration.

[0096] Step S105a-2: When the dual-channel push duration exceeds the preset delay duration threshold, prohibit the management service to which the first type of real-time channel belongs from resetting the first type of real-time channel in the streaming media session, and then destroy the first type of real-time channel.

[0097] The preset delay duration threshold includes 4.5s to 5.5s.

[0098] In this specific embodiment, timing starts from the parallel operation of the dual channels to obtain the dual-channel push duration. When the dual-channel push duration exceeds the preset delay duration threshold, for the original streaming media pushed to the interaction object through the second type of target real-time channel, the Content Delivery Network (CDN for short) can sufficiently replace the original streaming media pushed through the first type of real-time channel. At this time, destroy the first type of real-time channel, and only the original streaming media pushed by the second type of target real-time channel is used, reducing the resource consumption of this application end, improving the interaction efficiency, thereby achieving smooth switching without the user at the browsing end noticing, avoiding phenomena such as black screens, pauses, and lags, and improving the user experience. Since the active acquisition mode is adopted, before destroying the first type of real-time channel, actively prohibit the management service to which the first type of real-time channel belongs from resetting the first type of real-time channel in the streaming media session, avoiding the SDK of the RTC service provider resetting the first type of real-time channel in the passive acquisition mode, and ensuring smooth switching.

[0099] In some specific embodiments, the method further includes:

[0100] Step S105b-1: When pushing the original streaming media to the interaction object through the second type of target real-time channel, pull the original streaming media pushed by the interaction object through the second type of target real-time channel.

[0101] Step S105b-2: Process the original streaming media pushed by the interaction object based on the preset scaling and rendering strategy to obtain the target streaming media.

[0102] Step S105b-3: Display the target streaming media.

[0103] Since the acquired is the original streaming media, it may not necessarily be suitable for the display on the application side. Therefore, it is necessary to process the original streaming media based on the preset scaling and rendering strategies. For example, the scaling, beauty filtering, and rendering of a video are coherent. If the acquisition resolution is inconsistent with the encoding resolution, scaling is required. In this specific embodiment, post-processing is adopted, that is, at the encoding stage, the original video is processed based on the preset scaling and rendering strategies, which can reduce the power consumption of the CPU for beauty filtering processing and avoid the phenomenon of CPU overheating. For example, the rendering framework uses the high-performance graphics rendering technology Metal for rendering. The basic steps include: 1. Before rendering, ensure that the environment configurations related to MTKView and Metal are correct, and the MetalShader.metal file is configured in the project directory; 2. Create a Metal rendering pipeline; 3. Convert the CVPixelBuffer after scaling and beauty filtering into a Metal texture; 4. Render the CVPixelBuffer in the draw method of the callback method of MTKView; 5. Obtain the render command buffer; 6. Create a render command encoder; 7. Submit the command buffer; 8. Whether to release the texture object when stopping the acquisition and rendering.

[0104] In some other specific embodiments, before destroying the first type of real-time channel, it further includes: saving the display status information associated with the first type of real-time channel;

[0105] Correspondingly, the displaying of the target streaming media includes:

[0106] Step S105b-3a, when destroying the first type of real-time channel, display the target streaming media based on the display status information.

[0107] In this specific embodiment, before destroying the first type of real-time channel, the display status information associated with the first type of real-time channel is saved. For example, the camera and microphone are in the on state, the sound playback is in the mute state, and the video is in the non-black frame state.

[0108] When destroying the first type of real-time channel, the displayed content still maintains the effect before destruction. For example, the camera and microphone are still in the on state, the sound playback is still in the mute state, and the video is still in the non-black frame state. Thus, smooth switching is achieved, and the phenomena of black screen, pause, and stutter are avoided.

[0109] In some specific embodiments, the application device of the present application may be temporarily interrupted. For example, the camera microphone may be interrupted during use. In particular, for the microphone, if the present application is set on a mobile terminal, when there is an incoming call on the mobile terminal, the microphone will be preempted, resulting in the interruption of the streaming media interaction. Due to the singleton nature of the streaming media session (such as AudioSession), it is possible to change the device routing information of the microphone to an inappropriate category (i.e., category), resulting in the inability to normally resume the use of the microphone in the interaction after the incoming call ends. Therefore, the method further includes:

[0110] Step S111, when performing streaming media interaction with the interaction object, listen for interruption messages and routing change messages of the streaming media interaction, and save the device routing information in the streaming media session.

[0111] Among them, the interruption message includes a start interruption message and an end interruption message.

[0112] When performing streaming media interaction, the device routing information associated with the streaming media interaction is saved in the streaming media session. If the device is preempted during the streaming media interaction, the device routing information in the media session may be changed. Therefore, this specific embodiment sets up a monitoring of the situation that causes the change and also saves the device routing information in the streaming media session, so as to ensure that the device can return to normal when resuming the streaming media interaction.

[0113] Step S112, when the start interruption message is monitored, pause the acquisition of the original streaming media in the active acquisition mode.

[0114] For example, when the start interruption message is monitored, call the pause to acquire the original streaming media in the active acquisition mode through a callback.

[0115] Callback calling is a programming technique that allows a function to be passed as a parameter to another function and be called when a specific condition is met. Callback functions are commonly used to implement event-driven programming and asynchronous programming, allowing the program to execute a specific code block when a specific event occurs. A callback function refers to a reference to executable code that is passed as a function parameter to other code. This design allows the underlying code to call the subroutine defined at a higher level. The core of the callback function lies in its flexibility, which can be called when a specific event or condition occurs without explicitly calling it.

[0116] Suspending the acquisition of the original streaming media in the active acquisition mode does not change the acquisition mode, but temporarily stops the acquisition of the original streaming media in the active acquisition mode, thereby reducing the resources of the application terminal occupied by the original streaming media and ensuring the execution quality of the interruption event. For example, if the application terminal is set on a mobile terminal, when there is an incoming call on the mobile terminal, the microphone will be preempted, causing the interruption of the streaming media interaction. At this time, suspending the acquisition of the original streaming media in the active acquisition mode can reduce the resources of the application terminal occupied by the original streaming media and ensure the power-on quality.

[0117] Step S113, when the end interruption message is monitored, resume acquiring the original streaming media in the active acquisition mode, and when the routing change message is monitored, restore the device routing information in the streaming media session based on the saved device routing information.

[0118] For example, when the end interruption message is monitored, resume acquiring the original streaming media in the active acquisition mode by callback.

[0119] In this specific embodiment, when the interruption event ends, resume acquiring the original streaming media in the active acquisition mode, thereby achieving seamless and smooth connection between the interruption event and the streaming media interaction.

[0120] In this specific embodiment, if the device routing information in the streaming media session changes after the interruption event occurs, then after the interruption event ends, restore the device routing information in the streaming media session based on the saved device routing information. For example, during the interruption event, the device routing information in the streaming media session before the interruption is playAndRecord, and the device routing information in the streaming media session after the interruption event occurs is changed to playback. Then, after the interruption event ends, restore the device routing information in the streaming media session to playAndRecord, thereby achieving seamless and smooth connection between the interruption event and the streaming media interaction.

[0121] In some specific embodiments, the method further includes:

[0122] When performing streaming media interaction with the interaction object, when obtaining the abnormal information of the active acquisition mode, switch the active acquisition mode to the passive acquisition mode.

[0123] Although the active acquisition mode can meet the requirement of seamless switching, to prevent accidents in the active acquisition mode and avoid abnormal execution of the streaming media interaction, this specific embodiment provides a backup measure. If the abnormal information of the active acquisition mode is detected, switch the active acquisition mode to the passive acquisition mode and hand over the acquisition right to the manufacturer's RTC service to ensure the normal progress of the streaming media interaction.

[0124] Example 2

[0125] The present disclosure also provides a device embodiment that follows the above embodiments, which is used to implement the method steps described in the above embodiments. The interpretation of the same name meaning is the same as that in the above embodiments, and it has the same technical effects as the above embodiments, so it will not be elaborated here.

[0126] As Figure 3 shown, the present disclosure provides an interactive device 300 for a multi-type real-time channel live broadcast room, including:

[0127] A request acquisition unit 301, configured to obtain a streaming media interaction request of an interaction object forwarded by a remote server when pushing the original streaming media obtained in the active acquisition mode through a first-type real-time channel;

[0128] A message acquisition unit 302, configured to obtain a streaming media interaction message sent by the remote server when agreeing to the streaming media interaction request of the interaction object, where the streaming media interaction message includes a type feature identifier of a second-type real-time channel adopted by the interaction object;

[0129] A channel creation unit 303, configured to create a second-type target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second-type real-time channel when the type feature identifier of the second-type real-time channel does not match the type feature identifier of the first-type real-time channel;

[0130] A push unit 304, configured to push the original streaming media to the interaction object through the second-type target real-time channel.

[0131] Optionally, the device further includes:

[0132] A duration acquisition unit, configured to obtain a dual-channel push duration when pushing the original streaming media to the interaction object through the second-type target real-time channel;

[0133] A destruction unit, configured to prohibit the management service to which the first-type real-time channel belongs from resetting the first-type real-time channel in the streaming media session and then destroy the first-type real-time channel when the dual-channel push duration exceeds a preset delay duration threshold.

[0134] Optionally, the device further includes:

[0135] A pull unit, configured to pull the original streaming media pushed by the interaction object through the second-type target real-time channel when pushing the original streaming media to the interaction object through the second-type target real-time channel;

[0136] A rendering unit, configured to process the original streaming media pushed by the interactive object based on a preset scaling and rendering strategy to obtain target streaming media;

[0137] A display unit, configured to display the target streaming media.

[0138] Optionally, the device further includes:

[0139] A first saving unit, configured to save the display status information associated with the first type of real-time channel before destroying the first type of real-time channel;

[0140] Correspondingly, the displaying of the target streaming media includes:

[0141] When destroying the first type of real-time channel, displaying the target streaming media based on the display status information.

[0142] Optionally, the device further includes:

[0143] A login unit, configured to log in to the live broadcast room before pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel.

[0144] Optionally, the device further includes:

[0145] A second saving unit, configured to, when performing streaming media interaction with the interactive object, listen for interruption messages and routing change messages of the streaming media interaction, and save the device routing information in the streaming media session, where the interruption messages include start interruption messages and end interruption messages;

[0146] A pause unit, configured to pause the original streaming media obtained in the active acquisition mode when the start interruption message is detected;

[0147] A resume unit, configured to resume the original streaming media obtained in the active acquisition mode when the end interruption message is detected, and when the routing change message is detected, resume the device routing information in the streaming media session based on the saved device routing information.

[0148] Optionally, the device further includes:

[0149] A switching unit, configured to, when performing streaming media interaction with the interactive object, switch the active acquisition mode to a passive acquisition mode when obtaining abnormal information of the active acquisition mode.

[0150] In an embodiment of the present disclosure, when the real-time channels of the interaction object and the present application end are of different types, the present application end creates a second-type target real-time channel for streaming media communication with the interaction object based on the type characteristic identifier of the real-time channel adopted by the interaction object, so that the types of the real-time channels of the present application end and the interaction object are kept consistent, thereby enabling a platform adopting multiple types of real-time channels to achieve streaming media interaction between the two parties of the interaction, and achieving the purposes of smooth switching, effect optimization, and disaster tolerance backup.

[0151] Embodiment 3

[0152] As Figure 4 shown, this embodiment provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method steps as described in the above embodiments.

[0153] Embodiment 4

[0154] The embodiment of the present disclosure provides a non-volatile computer storage medium, and the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the method steps as described in the above embodiments.

[0155] Embodiment 5

[0156] Next, refer to Figure 4 , which shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The electronic device shown is only an example and should not bring any limitation to the functions and usage scope of the embodiments of the present disclosure.

[0157] As Figure 4 shown, the electronic device may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0158] Typically, the following devices can be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 405 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 can allow the electronic device to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 4 an electronic device with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. More or fewer devices can be alternatively implemented or had.

[0159] Specifically, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0160] It should be noted that the computer-readable medium described above can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0161] The above computer-readable medium can be included in the above electronic device; or it can exist separately and not be assembled into the electronic device.

[0162] The computer program code for performing the operations of the present disclosure can be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0163] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in an order different from that noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0164] The units involved in the embodiments described in the present disclosure can be implemented in software or in hardware. Among them, the name of the unit does not constitute a limitation on the unit itself in some cases.

[0165] Finally, it should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts among the various embodiments can be referred to each other. For the systems or devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

[0166] The above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them; although the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present disclosure.

Claims

1. An interactive method for a multi-type real-time channel live broadcast room, characterized in that, Including: When pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, obtaining a streaming media interaction request of an interaction object forwarded by a remote server; After agreeing to the streaming media interaction request of the interaction object, obtaining a streaming media interaction message sent by the remote server, where the streaming media interaction message includes a type feature identifier of a second type of real-time channel adopted by the interaction object; When the type feature identifier of the second type of real-time channel does not match the type feature identifier of the first type of real-time channel, creating a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second type of real-time channel; Pushing the original streaming media to the interaction object through the second type of target real-time channel.

2. The method according to claim 1, wherein The method further includes: When pushing the original streaming media to the interaction object through the second type of target real-time channel, obtaining a dual-channel push duration; When the dual-channel push duration exceeds a preset delay duration threshold, prohibiting the management service to which the first type of real-time channel belongs from resetting the first type of real-time channel in the streaming media session, and then destroying the first type of real-time channel.

3. The method according to claim 2, characterized in that The method further includes: When pushing the original streaming media to the interaction object through the second type of target real-time channel, pulling the original streaming media pushed by the interaction object through the second type of target real-time channel; Processing the original streaming media pushed by the interaction object based on a preset scaling and rendering strategy to obtain a target streaming media; Displaying the target streaming media.

4. The method according to claim 3, characterized in that Before destroying the first type of real-time channel, it further includes: Saving display status information associated with the first type of real-time channel; Correspondingly, the displaying the target streaming media includes: When destroying the first type of real-time channel, displaying the target streaming media based on the display status information.

5. The method according to claim 1, characterized in that, Before pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel, it further includes: Logging in to the live broadcast room.

6. The method according to claim 1, wherein The method further includes: When performing streaming media interaction with the interaction object, listening for interruption messages and routing change messages of the streaming media interaction, and saving device routing information in the streaming media session, where the interruption messages include a start interruption message and an end interruption message; When the start interruption message is detected, pausing the original streaming media obtained in the active acquisition mode; When the end interruption message is detected, resuming the original streaming media obtained in the active acquisition mode, and when the routing change message is detected, restoring the device routing information in the streaming media session based on the saved device routing information.

7. The method according to claim 1, characterized in that The method further includes: When performing streaming media interaction with the interaction object, when obtaining abnormal information of the active acquisition mode, switching the active acquisition mode to a passive acquisition mode.

8. An interactive device for a multi-type real-time channel live broadcast room, characterized in that, Including: A request obtaining unit, configured to obtain a streaming media interaction request of an interaction object forwarded by a remote server when pushing the original streaming media obtained in the active acquisition mode through the first type of real-time channel; A message acquisition unit, configured to acquire a streaming media interaction message sent by the remote server after agreeing to the streaming media interaction request of the interaction object, wherein the streaming media interaction message includes a type feature identifier of a second type of real-time channel adopted by the interaction object; A channel creation unit, configured to create a second type of target real-time channel for streaming media communication with the interaction object based on the type feature identifier of the second type of real-time channel when the type feature identifier of the second type of real-time channel does not match the type feature identifier of the first type of real-time channel; A push unit, configured to push the original streaming media to the interaction object through the second type of target real-time channel.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that, Including: One or more processors; A storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

Images