Online conference data transmission method and device and online conference system

Abstract

The invention relates to an online conference data transmission method and device and an online conference system. The method in one aspect is applied to local terminal equipment, a local media stream server is deployed in the local terminal equipment, accessory equipment corresponding to the local terminal equipment participates in the local media stream server through a local area network, and the local terminal equipment participates in a target online conference in a cloud media stream server through a wide area network. The method comprises the steps of obtaining a media stream subscription request of accessory equipment, subscribing SVC stream data corresponding to a target cloud user identifier from a cloud media stream server under the condition that the media stream subscription request comprises the target cloud user identifier, obtaining target SVC stream data corresponding to the media stream subscription request, forwarding the target SVC stream data to a local media stream server, and sending the target SVC stream data to the accessory equipment. And the accessory device obtains the target SVC stream data from the local media stream server. By adopting the method, the performance consumption of the local terminal equipment can be reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of online conference, in particular to an online conference data transmission method, device and online conference system. BACKGROUND

[0002] When the local terminal device and the remote device conduct the online conference, the accessory device of the local terminal device, such as the extended display, the loudspeaker or other Internet of Things devices, cannot access the external network in the local area network, but needs to pull the media stream data in the online conference and present.

[0003] In the related art online conference data transmission method, the local terminal device obtains the scalable video coding (SVC) stream data required by the accessory device from the cloud media stream server, transcodes the SVC stream data into advanced video coding (AVC) stream data, sends the AVC stream data to the accessory device, and the accessory device receives the AVC stream data and presents.

[0004] However, the above online conference data transmission method causes large performance consumption of the local terminal device. SUMMARY

[0005] Therefore, it is necessary to provide an online conference data transmission method, device and online conference system capable of reducing the performance consumption of the local terminal device.

[0006] In a first aspect, the present application provides an online conference data transmission method, the method being applied to a local terminal device, a local media stream server being deployed in the local terminal device, an accessory device corresponding to the local terminal device being invited to the local media stream server through a local area network, and the local terminal device being invited to a target online conference in a cloud media stream server through a wide area network, the method comprising:

[0007] obtaining a media stream subscription request of the accessory device;

[0008] in a case where the media stream subscription request comprises a target cloud user identifier, subscribing to SVC stream data corresponding to the target cloud user identifier from the cloud media stream server to obtain target SVC stream data corresponding to the media stream subscription request; the target cloud user identifier being an identifier corresponding to any one cloud user in the target online conference;

[0009] forwarding the target SVC stream data to the local media stream server, so that the accessory device obtains the target SVC stream data from the local media stream server.

[0010] In one of the embodiments, the method further comprises:

[0011] In a case where the media stream subscription request comprises a local user identifier, obtaining target SVC stream data corresponding to the media stream subscription request according to the local SVC stream data, the local user identifier being an identifier corresponding to the local terminal device in the target online conference.

[0012] In one of the embodiments, the method further comprises:

[0013] querying a preset mapping relationship based on the target cloud user identifier, to obtain a target virtual user identifier, the mapping relationship comprising a corresponding relationship between a cloud user identifier and a virtual user identifier; the virtual user identifier being an identifier corresponding to the cloud user identifier in the local media stream server in the cloud media stream server;

[0014] sending the target virtual user identifier to the accessory device, so that the accessory device acquires the target SVC stream data from the local media stream server based on the target virtual user identifier;

[0015] subscribing to SVC stream data corresponding to the target cloud user identifier in the cloud media stream server, to obtain the target SVC stream data corresponding to the media stream subscription request, comprising:

[0016] subscribing to SVC stream data corresponding to the target cloud user identifier in the cloud media stream server, to obtain cloud SVC stream data;

[0017] replacing the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier, to obtain the target SVC stream data.

[0018] In one of the embodiments, before acquiring the media stream subscription request of the accessory device, the method further comprises:

[0019] acquiring cloud user identifiers corresponding to each cloud user in the target online conference;

[0020] sending the cloud user identifiers to the accessory device;

[0021] determining a corresponding virtual user identifier for each cloud user identifier, to obtain the mapping relationship.

[0022] In one of the embodiments, the method further comprises:

[0023] acquiring an initial key frame request sent by the accessory device through the local media stream server;

[0024] obtaining a target key frame based on the initial key frame request;

[0025] forwarding the target key frame to the local media stream server, so that the local media stream server sends the target key frame to the accessory device.

[0026] In one of the embodiments, the obtaining of the target key frame based on the initial key frame request comprises:

[0027] In a case where the initial key frame request corresponds to a cloud user, determining a target cloud user identifier based on the initial key frame request;

[0028] Generating a target key frame request based on the target cloud user identifier;

[0029] Sending the target key frame request to the cloud media stream server, so that the cloud media stream server acquires a target key frame from the target cloud user based on the target key frame request, and sends the target key frame to the local terminal device.

[0030] In a second aspect, the present application further provides an online conference data transmission method, the method is used for an accessory device, the accessory device and a local terminal device are connected through a local area network, the accessory device joins an online conference in a target cloud media stream server through a wide area network, and the method comprises the following steps:

[0031] Sending a media stream subscription request to the terminal device, so that the local terminal device requests SVC stream data corresponding to a target cloud user identifier from the cloud media stream server in a case where the media stream subscription request includes the target cloud user identifier, obtains target SVC stream data corresponding to the media stream subscription request, forwards the target SVC stream data to the local media stream server, and the target cloud user identifier is an identifier corresponding to any cloud user in the target online conference;

[0032] Obtaining the target SVC stream data from the local media stream server.

[0033] In a third aspect, the present application further provides a computer device, a local media stream server is deployed in the computer device, an accessory device corresponding to the computer device joins the local media stream server through a local area network, and the computer device joins a target online conference in a cloud media stream server through a wide area network, the computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps of the method of the first aspect when executing the computer program.

[0034] In a fourth aspect, the present application further provides an electronic device, the electronic device joins a local media stream server deployed in a local terminal device through a local area network, and the local terminal device joins a target online conference in a cloud media stream server through a wide area network, the electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps of the method of the second aspect when executing the computer program.

[0035] In a fifth aspect, the present application also provides an online conference system, comprising a local terminal device and an accessory device corresponding to the local terminal device, the local terminal device being connected to a target online conference in a cloud media stream server through a wide area network, and the accessory device being connected to a local media stream server through a local area network;

[0036] The accessory device is configured to send a media stream subscription request to the local terminal device.

[0037] The local terminal device is configured to, in a case where the media stream subscription request comprises a target cloud user identifier, subscribe to SVC stream data corresponding to the target cloud user identifier in the cloud media stream server, obtain target SVC stream data corresponding to the media stream subscription request, and forward the target SVC stream data to the local media stream server, the target cloud user identifier being an identifier corresponding to any cloud user in the target online conference.

[0038] The accessory device is configured to obtain the target SVC stream data from the local media stream server.

[0039] The online conference data transmission method, device and online conference system, wherein the online conference data transmission method in one aspect is used for the local terminal device, the media stream subscription request of the accessory device is obtained, in a case where the media stream subscription request comprises a target cloud user identifier, the SVC stream data corresponding to the target cloud user identifier is subscribed to in the cloud media stream server, the target SVC stream data corresponding to the media stream subscription request is obtained, the target cloud user identifier is an identifier corresponding to any cloud user in the target online conference, the target SVC stream data is forwarded to the local media stream server, and the target SVC stream data is obtained from the local media stream server by the accessory device; in this way, the accessory device is connected to the local media stream server, when the accessory device needs to present the media stream data corresponding to the cloud user in the target online conference, the SVC stream data corresponding to the target cloud user identifier is subscribed to in the cloud media stream server based on the media stream subscription request of the accessory device by the local terminal device, the target SVC stream data corresponding to the media stream subscription request is obtained, and the target SVC stream data is forwarded to the local media stream server, and the target SVC stream data is obtained from the local media stream server by the accessory device; the problem of large performance consumption of the local terminal device caused by the fact that the SVC stream data needed to be presented by the accessory device is first transcoded into AVC stream data and then forwarded to the accessory device in the related art is avoided, the target SVC stream data needed by the accessory device is directly injected into the local media stream data by the local terminal device by using the online conference data transmission method, the target SVC stream data is obtained from the local media stream server by the accessory device, and no transcoding is needed, thereby reducing the performance consumption of the local terminal device. BRIEF DESCRIPTION OF DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the following will briefly introduce the drawings needed to be used in the description of the embodiments of the present application or the related art. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0041] Figure 1 An application environment diagram of the online conference data transmission method in one embodiment;

[0042] Figure 2 A flowchart of the online conference data transmission method applied to the local terminal device in one embodiment;

[0043] Figure 3 A flowchart of the online conference data transmission method applied to the local terminal device in another embodiment;

[0044] Figure 4 A flowchart of the online conference data transmission method applied to the local terminal device in another embodiment;

[0045] Figure 5 A flowchart of the step of obtaining the target key frame in one embodiment;

[0046] Figure 6 A flowchart of the online conference data transmission method applied to the accessory device in one embodiment;

[0047] Figure 7 A flowchart of the step of obtaining the target SVC stream data from the local media stream server in one embodiment;

[0048] Figure 8 A flowchart of the online conference data transmission method applied to the accessory device in another embodiment;

[0049] Figure 9 A flowchart of the online conference data transmission method applied to the online conference system in one embodiment;

[0050] Figure 10 A structural block diagram of the online conference data transmission device applied to the local terminal device in one embodiment;

[0051] Figure 11 A structural block diagram of the online conference data transmission device applied to the accessory device in one embodiment. DETAILED DESCRIPTION

[0052] In order to make the purposes, technical solutions and advantages of the present application clearer, further detailed description will be made to the present application in combination with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and should not be used to limit the present application.

[0053] It should be noted that the terms "comprising" and "having" and any variations thereof used herein are intended to cover non-exclusive inclusion. The term "a plurality of" used herein refers to two or more. The term "and / or" used herein refers to one of the options or any combination of multiple options.

[0054] The online conference data transmission method provided by the embodiments of the present application can be applied in an application environment as shown in the accompanying drawings. Figure 1 In the online conference system, a local media stream server 121 is deployed in the local terminal device 120, and the accessory device 140 corresponding to the local terminal device 120 enters the local media stream server 121 through a local area network. The local terminal device 120 enters a target online conference in a cloud media stream server 160 through a wide area network. The cloud media stream server 160 is also connected with at least one remote device 180. The full name of the media stream server in English is Media Streaming Server, and the abbreviation in English is MSS.

[0055] For example, the local terminal device 120 can be, but is not limited to, various personal computers, notebook computers, smart phones and tablet computers. For another example, the local terminal device 120 can not include a display module, and the local terminal device 120 is a host device including a processor, a memory and a communication module. The local terminal device 120 displays the conference picture through the corresponding accessory device 140, and the local terminal device 120 does not display the conference picture.

[0056] The accessory device 140 that needs to obtain the SVC stream data and display in the online conference transmission method provided by the embodiments of the present application includes a projection device, an extended display screen, a loudspeaker and the like. The local terminal device 120 can display more online conference contents through the accessory device 140. In the technical field of online conference, the accessory device corresponding to the local terminal device 120 can also include a camera, a microphone and the like.

[0057] The target online conference refers to the online conference currently participated by the local terminal device. In some other embodiments, the online conference can also be referred to as a cloud conference, or an online conference. The local terminal device 120 enters the cloud media stream server through a wide area network. In some embodiments, the target online conference can also be referred to as a cloud conference. Figure 1The application environment shown also includes a cloud signaling server (not shown in the figure) for implementing conference control, conference establishment, identity verification, resource negotiation, and channel negotiation control functions. The local terminal device 120 and the remote device 180 are both in communication connection with the cloud signaling server. For example, the local terminal device 120 and the remote device 180 can establish a long connection with the cloud signaling server through a Google Remote Procedure Call (gRPC) protocol. In some other embodiments, the local terminal device 120 and the remote device 180 can also communicate with the cloud signaling server through a Session Initiation Protocol (SIP), a WebSocket Protocol (WebSocket), or the like to establish a persistent, full-duplex communication channel to transmit messages or signaling in real time. The cloud media stream server 160 is used for media stream processing functions such as audio and video data transmission, forwarding, coding and decoding, and recording. The local terminal device 120 and the remote device 180 are both in communication connection with the cloud media stream server. For example, the local terminal device 120 and the remote device 180 communicate based on a User Datagram Protocol (UDP).

[0058] The local media stream server 121 is used to implement local signaling and local MSS media services. For example, after the local terminal device 120 is powered on, the local media stream server 121 listens to the corresponding port, and the local terminal device 120 and the accessory device 140 join the local media stream server 121. For example, the port listened to by the local media stream server 121 is determined based on the transmission protocol used by the local media stream server 121. For example, the port listened to by the local media stream server 121 is the port "0.0.0.0: xxx" of the local terminal device 120. For example, the local signaling and the local MSS media services included in the local media stream server 121 can be implemented by a process, a service, or a container in the local terminal device. For another example, the local signaling and the local MSS media services can be implemented by two processes, two services, or two containers in the local terminal device 120.

[0059] In one exemplary embodiment, referring to Figure 2 , an online conference data transmission method is provided. The method is applied to Figure 1Taking the local terminal device 120 as an example, the local media stream server 121 is deployed in the local terminal device 120, and the accessory device 140 corresponding to the local terminal device 120 enters the local media stream server 121 through a local area network, and the local terminal device 120 enters a target online conference in the cloud media stream server 160 through a wide area network. As shown in FIG. 8, the method comprises the following steps 202 to 206. Wherein: Figure 2

[0060] Step 202, obtaining a media stream subscription request of the accessory device.

[0061] Wherein, the media stream subscription request comprises a user identifier of a user in the target online conference that needs to be presented by the accessory device.

[0062] In a possible implementation, the accessory device sends a media stream subscription request to the local terminal device when the accessory device needs to present a user picture or an auxiliary stream picture of a certain user in the target online conference for the first time.

[0063] For example, the accessory device generates a media stream subscription request corresponding to a certain user after receiving an instruction of displaying a user picture sent by the local terminal device, and sends the media stream subscription request to the local terminal device; for another example, when a new stream appears in the target online conference or the host changes, the accessory device receives a notification, judges whether to display the new stream, and if the new stream needs to be displayed, the accessory device sends a media stream subscription request to the local terminal device.

[0064] In a possible implementation, a gRPC (google Remote Procedure Call) long connection is established between the accessory device and the local terminal device, which is used to realize the functions of synchronizing related conference information of the target online conference and sending and receiving media stream subscription requests. For example, the local terminal device 120 synchronizes related information of a cloud user in the target online conference to the accessory device through the gRPC long connection after joining the target online conference, and the accessory device sends a media stream subscription request through the gRPC long connection.

[0065] Step 204, in the case that the media stream subscription request comprises a target cloud user identifier, subscribing to SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, and obtaining target SVC stream data corresponding to the media stream subscription request.

[0066] Wherein, the target cloud user identifier is an identifier corresponding to any cloud user in the target online conference. The cloud user corresponds to a remote device in the online conference relative to the local terminal device; the local terminal device is a local user in the online conference in this embodiment, and the identifier corresponding to the local user is a local user identifier.

[0067] ​In the online conference, the user identifier is bound to the SVC stream data through a stream identifier field in the SVC stream data. For example, the user identifier is a synchronization source identifier (SSRC) or an RTP stream identifier (RID) or a media identifier (MID) in the SVC stream data. In other examples, other stream identifier fields can be used as the user identifier in the online conference.

[0068] In the case where the media stream subscription request includes the target cloud user identifier, the SVC stream data required by the accessory device needs to be pushed by the cloud media stream server. The local terminal device subscribes to the target SVC stream data corresponding to the target cloud user identifier through the cloud media stream server, and obtains the target SVC stream data corresponding to the media stream subscription request.

[0069] In step 206, the target SVC stream data is forwarded to the local media stream server, so that the accessory device obtains the target SVC stream data from the local media stream server.

[0070] In the case where the media stream subscription request includes the target cloud user identifier, the SVC stream data required by the accessory device needs to be pushed by the cloud media stream server. The local terminal device subscribes to the target SVC stream data corresponding to the target cloud user identifier through the cloud media stream server, and obtains the target SVC stream data corresponding to the media stream subscription request.

[0071] In a possible implementation, a virtual conference is established in the local media stream server synchronously with the target online conference; the local terminal device and the accessory device join the virtual conference, and at the same time, each cloud user in the target online conference is provided with corresponding account information in the virtual conference, the local terminal device injects the target SVC stream data into the account corresponding to the target cloud user in the virtual conference, and the accessory device obtains the target SVC stream data from the virtual conference.

[0072] In the case where the media stream subscription request includes the target cloud user identifier, the SVC stream data required by the accessory device needs to be pushed by the cloud media stream server. The local terminal device subscribes to the target SVC stream data corresponding to the target cloud user identifier through the cloud media stream server, and obtains the target SVC stream data corresponding to the media stream subscription request.

[0073] In a possible implementation, the accessory device renders and displays the target SVC stream data. For example, the accessory device performs decapsulation processing on the target SVC stream data, extracts the encoded data packet and identifies the level, filters the required layer, obtains the selected layer data, decodes the selected layer data using a decoder supporting SVC, obtains the decoded frame data, renders the decoded frame data and outputs the presentation.

[0074] In a possible implementation, the accessory device transcodes the target SVC stream data into AVC stream data and outputs the presentation.

[0075] The online conference data transmission method provided by the above embodiment is applied to a local terminal device, a media stream subscription request of an accessory device is acquired, in a case where the media stream subscription request includes a target cloud user identifier, a target SVC stream data corresponding to the target cloud user identifier is subscribed from a cloud media stream server, target SVC stream data corresponding to the media stream subscription request is obtained, the target cloud user identifier is an identifier corresponding to any one cloud user in a target online conference, the target SVC stream data is forwarded to a local media stream server, and the target SVC stream data is acquired from the local media stream server by the accessory device. In this way, the accessory device is injected into the local media stream server, when the accessory device needs to present media stream data corresponding to a cloud user in the target online conference, the local terminal device subscribes to the target SVC stream data corresponding to the target cloud user identifier from the cloud media stream server based on the media stream subscription request of the accessory device, obtains the target SVC stream data corresponding to the media stream subscription request, and forwards the target SVC stream data to the local media stream server. The accessory device directly acquires the target SVC stream data from the local media stream server. In related technologies, the local terminal device needs to first transcode the SVC stream data that needs to be presented by the accessory device into AVC stream data and then forward the AVC stream data to the accessory device, which causes large performance consumption of the local terminal device. By using the online conference data transmission method provided in this embodiment, the local terminal device directly injects the target SVC stream data required by the accessory device into the local media stream data, so that the accessory device acquires the target SVC stream data from the local media stream server without transcoding, thereby reducing the performance consumption of the local terminal device.

[0076] In other application scenarios of the present application, the accessory device is not only located in the same local area network as the local terminal device, but also can be connected to a wide area network. In this scenario, the online conference data transmission method provided by the embodiment shown in Figure 2 The online conference data transmission method provided by the embodiment shown in Figure 2 The online conference data transmission method provided by the embodiment shown in

[0077] In a possible implementation, the plurality of accessory devices send media stream subscription requests to the local terminal device, and at least two media subscription stream requests include the same cloud user identifier, and the local terminal device no longer repeatedly subscribes to the cloud user identifier corresponding SVC stream data from the cloud media stream server after judging that the cloud media stream server has been subscribed to the cloud user identifier corresponding SVC stream data and forwarded to the local media stream server.

[0078] In an example embodiment, based on Figure 2 In the embodiment shown, the online conference data transmission method provided by the embodiment further includes: in the case that the media stream subscription request includes a local user identifier, obtaining target SVC stream data corresponding to the media stream subscription request according to the local SVC stream data. The local user identifier is an identifier corresponding to the local terminal device in the target online conference.

[0079] In the case that the local terminal device as a participant in the target online conference needs to obtain SVC stream data corresponding to the local terminal device, the media stream subscription request sent by the accessory device includes a local user identifier. It can be understood that the "local" in the local user identifier is in relation to the local terminal device. For the cloud media stream server, the local user identifier corresponding to the local terminal device and the cloud user identifier corresponding to the remote device are both identifiers of a participant terminal in the target online conference.

[0080] In the embodiment, in the case that the accessory device needs to present SVC stream data or auxiliary stream SVC stream data such as presentation pictures obtained by the local terminal device through a corresponding camera and / or microphone, the media stream subscription request sent by the accessory device includes a local user identifier. The local terminal device directly obtains target SVC stream data corresponding to the media stream subscription request according to the local SVC stream data and forwards the target SVC stream data to the local media stream server, so that the accessory device obtains the target SVC stream data from the local media stream server. This avoids the problem of large performance consumption of the local terminal device caused by transcoding the local SVC stream data into AVC stream data and then forwarding the AVC stream data to the accessory device in the related art.

[0081] In an example embodiment, based on Figure 2 In the embodiment shown, please refer to Figure 3 The online conference data transmission method provided by the embodiment further includes steps 302 and 304, in which:

[0082] Step 302: obtaining a target virtual user identifier based on the target cloud user identifier and a preset mapping relationship.

[0083] The mapping relationship includes the correspondence between cloud user identifiers and virtual user identifiers. The virtual user identifier is the identifier corresponding to the cloud user identifier in the cloud media streaming server in the ontology media streaming server.

[0084] Step 304: Send the target virtual user identifier to the accessory device so that the accessory device can obtain the target SVC stream data from the local media streaming server based on the target virtual user identifier.

[0085] In one possible implementation, upon receiving a target virtual user identifier sent by a local terminal device, the accessory device triggers a request to subscribe to the SVC stream data corresponding to the target virtual user identifier from the local media stream server, and obtains the target SVC stream data.

[0086] In this embodiment, the process of subscribing to the SVC stream data corresponding to the target cloud user identifier from the cloud media streaming server to obtain the target SVC stream data corresponding to the media stream subscription request includes steps A1 and A2, wherein:

[0087] Step A1: Subscribe to the SVC stream data corresponding to the target cloud user identifier from the cloud media streaming server to obtain the cloud SVC stream data.

[0088] Among them, the stream identifier field in the cloud SVC stream data is the target cloud user identifier.

[0089] Step A2: Replace the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier to obtain the target SVC stream data.

[0090] For example, the cloud SVC stream data is decapsulated to obtain decapsulated stream data, and then encapsulated based on the decapsulated stream data and the target virtual user identifier to obtain the target SVC stream data.

[0091] In the online conference data transmission method provided in this embodiment, the local terminal device maps the cloud user identifier to the virtual user identifier. After receiving the media stream subscription request sent by the accessory device, it queries the mapping relationship, returns the target virtual user identifier corresponding to the target cloud user identifier to the accessory device, and replaces the target cloud user identifier in the cloud SVC stream data subscribed from the cloud media stream server with the target virtual user identifier to obtain the target SVC stream data. This data is then forwarded to the local media stream server so that the accessory device can obtain the target SVC stream data from the local media stream server based on the target virtual user. This decouples the virtual conference in the local media stream server from the target online conference in the cloud media stream server, improving the reliability of the online conference data transmission method.

[0092] In a possible implementation, before the media stream subscription request of the accessory device is acquired, the provided online conference data transmission method further includes: acquiring cloud user identifiers corresponding to respective cloud users in the target online conference, and sending the respective cloud user identifiers to the accessory device; determining respective virtual user identifiers corresponding to the respective cloud user identifiers, to obtain a mapping relationship.

[0093] For example, the process of determining the respective virtual user identifiers corresponding to the respective cloud user identifiers, to obtain the mapping relationship, can include: generating the respective virtual user identifiers corresponding to the respective cloud user identifiers, to obtain the mapping relationship. In this example, the local terminal device generates the respective virtual user identifiers corresponding to the respective cloud users in the target online conference, as the virtual users in the virtual conference in the local media stream server, respectively.

[0094] In a possible implementation, the provided online conference data transmission method further includes: querying the preset mapping relationship based on the local user identifier, to obtain the target virtual user identifier. The mapping relationship further includes a correspondence between the local user identifier and the virtual user identifier. In this implementation, in the process of determining the respective virtual user identifiers corresponding to the respective cloud user identifiers, to obtain the mapping relationship, the process further includes: determining a virtual user identifier corresponding to the local user identifier, to obtain the mapping relationship. In this implementation, the mapping relationship includes the correspondence between the respective cloud user identifiers and the local user identifier and the respective virtual user identifiers. For the local media stream data, the local user identifier and the cloud user identifier correspond to virtual user identifiers of the same nature in the virtual conference.

[0095] In an example embodiment, the provided online conference data transmission method includes: Figure 2 In the provided online conference data transmission method, the virtual conference in the local media stream server directly uses the cloud user identifiers and the local user identifier in the target online conference as the participant identifiers in the virtual conference, as shown in the example embodiment. In this embodiment, in the case where the media stream subscription request includes the target cloud user identifier, the process of subscribing to the SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, to obtain the target SVC stream data corresponding to the media stream subscription request, and forwarding the target SVC stream data to the local media stream server includes: subscribing to the SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, to obtain cloud SVC stream data; and forwarding the cloud SVC stream data as the target SVC stream data to the local media stream server, so that the accessory device acquires the target SVC stream data from the local media stream server based on the target cloud user identifier.

[0096] In the embodiment, in the case that the media stream subscription request comprises the local user identifier, the process of forwarding the target SVC stream data corresponding to the media stream subscription request to the local media stream server according to the local SVC stream data comprises: forwarding the local SVC stream data as the target SVC stream data corresponding to the media stream subscription request to the local media stream server, so that the accessory device acquires the target SVC stream data from the local media stream server based on the local user identifier.

[0097] In one example embodiment, based on Figure 2 In the embodiment shown in FIG. 1, the online conference data transmission method provided by the application further comprises steps 402 to 406, wherein: Figure 4

[0098] Step 402: acquiring, by the local media stream server, an initial key frame request sent by the accessory device.

[0099] The key frame is a complete and independent video frame in the SVC stream data, which can be decoded and displayed without relying on any other frame, and can also be referred to as an I frame. In the SVC stream data, a key frame is usually inserted periodically, for example, a key frame is inserted every 2 seconds or every 30 frames as a reference frame for decoding P frames (predicted frames). In some cases, the accessory device needs to immediately acquire the key frame instead of waiting for the periodically inserted key frame in the SVC stream data.

[0100] For example, in the case of SVC stream data packet loss, SVC stream data decoding error, switching of a subscription target, switching of a resolution level, or active refreshing of an imaging picture by the accessory device, the accessory device generates an initial key frame request and sends it to the local media stream server.

[0101] Step 404: obtaining a target key frame based on the initial key frame request.

[0102] In one possible implementation, in the case that the initial key frame request corresponds to a cloud user, the process of obtaining the target key frame based on the initial key frame request comprises steps 502 to 506, wherein:

[0103] Step 502: determining a target cloud user identifier based on the initial key frame request.

[0104] In the implementation in which the accessory device acquires the target SVC stream data from the local media stream server based on the target virtual user identifier, the user identifier included in the initial key frame request sent by the accessory device is the target virtual user identifier, the local terminal device parses the initial key frame request to obtain the target virtual user identifier, and obtains the target cloud user identifier based on the target virtual user identifier and the mapping relationship.

[0105] ​In the implementation manner in which the accessory device obtains the target SVC stream data from the local media stream server based on the target cloud user identifier, the user identifier included in the initial key frame request sent by the accessory device is the target cloud user identifier, and the local terminal device parses the initial key frame request to obtain the target cloud user identifier.

[0106] At step 504, a target key frame request is generated based on the target cloud user identifier.

[0107] At step 506, the target key frame request is sent to the cloud media stream server, so that the cloud media stream server obtains a target key frame from the target cloud user based on the target key frame request and sends the target key frame to the local terminal device.

[0108] The cloud media stream server forwards the target key frame request to the target cloud user, the target cloud user generates a key frame as the target key frame and feeds back to the cloud media stream server, and the cloud media stream server sends the target key frame to the local terminal device.

[0109] In a possible implementation manner, in the case that the initial key frame request corresponds to the local user, the process of obtaining the target key frame based on the initial key frame request includes: obtaining the target key frame. In the case that the local terminal device parses the initial key frame request to obtain the local user identifier, the local terminal device generates a key frame as the target key frame.

[0110] In the implementation manner in which the accessory device obtains the target SVC stream data from the local media stream server based on the target virtual user identifier, the local terminal device parses the initial key frame request to obtain the target virtual user identifier and obtains the local user identifier based on the target virtual user identifier and the mapping relationship.

[0111] In the implementation manner in which the accessory device obtains the target SVC stream data from the local media stream server based on the local user identifier, the user identifier included in the initial key frame request sent by the accessory device is the local cloud user identifier, and the local terminal device parses the initial key frame request to obtain the local user identifier.

[0112] At step 406, the target key frame is forwarded to the local media stream server, so that the local media stream server sends the target key frame to the accessory device.

[0113] In an exemplary embodiment, an online conference data transmission method is provided, and the method is applied to Figure 1The method is described by taking the local terminal device 120 as an example. The local media stream server 121 is deployed in the local terminal device 120. The accessory device 140 corresponding to the local terminal device 120 enters the local media stream server 121 through a local area network. The local terminal device 120 enters a target online conference in the cloud media stream server 160 through a wide area network. The method includes the following steps B1 to B10. Wherein:

[0114] Step B1, obtaining the cloud user identifier corresponding to each cloud user in the target online conference and the local user identifier corresponding to the local terminal device.

[0115] Step B2, sending the cloud user identifier and the local user identifier to the accessory device.

[0116] Step B3, determining the virtual user identifier corresponding to each cloud user identifier and local user identifier respectively, and obtaining the mapping relationship.

[0117] Step B4, obtaining the media stream subscription request of the accessory device, wherein the media stream subscription request includes the target cloud user identifier or the local user identifier.

[0118] Step B5, querying the preset mapping relationship based on the target cloud user identifier or the local user identifier, and obtaining the target virtual user identifier.

[0119] Step B6, sending the target virtual user identifier to the accessory device.

[0120] In the case that the media stream subscription request includes the target cloud user identifier, step B7-1 is executed, then step B8 is executed, and step B7-2 is not executed; in the case that the media stream subscription request includes the local user identifier, step B7-2 is executed, then step B8 is executed, and step B7-1 is not executed.

[0121] Step B7-1, subscribing to the SVC stream data corresponding to the target cloud user identifier in the cloud media stream server, obtaining the cloud SVC stream data, replacing the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier, obtaining the target SVC stream data corresponding to the media stream subscription request, and providing the accessory device to obtain the target SVC stream data from the local media stream server.

[0122] Step B7-2, replacing the local user identifier in the local SVC stream data with the target virtual user identifier, obtaining the target SVC stream data corresponding to the media stream subscription request, and providing the accessory device to obtain the target SVC stream data from the local media stream server.

[0123] Optionally, in the case that the accessory device needs to obtain the key frame, the provided online conference data transmission method further includes steps B8 to B10, wherein:

[0124] Step B8, obtaining the initial key frame request sent by the accessory device through the local media stream server.

[0125] In the case that the initial key frame request corresponds to a cloud user, step B9-1 is performed, then step B10 is performed, and step B9-2 is not performed. In the case that the initial key frame request corresponds to a local terminal device, step B9-2 is performed, then step B10 is performed, and step B9-1 is not performed.

[0126] Step B9-1, determining a target cloud user identifier based on the initial key frame request; generating a target key frame request based on the target cloud user identifier; and sending the target key frame request to the cloud media stream server, so that the cloud media stream server obtains a target key frame from a target cloud user based on the target key frame request and sends the target key frame to the local terminal device.

[0127] Step B9-2, determining a local user identifier based on the initial key frame request, and obtaining a target key frame.

[0128] Step B10, forwarding the target key frame to the local media stream server, so that the local media stream server sends the target key frame to the accessory device.

[0129] In one exemplary embodiment, referring to Figure 6 , an online conference data transmission method is provided. Taking the accessory device 140 in Figure 1 as an example, the accessory device and the local terminal device are connected through a local area network. The accessory device joins the local media stream server deployed in the local terminal device, and the local terminal device joins the target online conference in the cloud media stream server through a wide area network. As shown in Figure 6 , the method includes the following steps 602 to 604. Among them:

[0130] Step 602, sending a media stream subscription request to the terminal device, so that the local terminal device requests SVC stream data corresponding to a target cloud user identifier in the case that the media stream subscription request includes the target cloud user identifier, obtains target SVC stream data corresponding to the media stream subscription request, and forwards the target SVC stream data to the local media stream server. The target cloud user identifier is an identifier corresponding to any cloud user in the target online conference.

[0131] In one possible implementation, the accessory device obtains the identifiers corresponding to each cloud user in the target online conference and the local user identifier corresponding to the local terminal device from the local terminal device.

[0132] Step 604, obtaining the target SVC stream data from the local media stream server.

[0133] The online meeting data transmission method provided in the above embodiments involves an accessory device joining a local media stream server. When the accessory device needs to present media stream data corresponding to a cloud user in the target online meeting, it sends a media stream subscription request to the local terminal device. This allows the local terminal device to subscribe to the SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, obtain the target SVC stream data corresponding to the media stream subscription request, and forward it to the local media stream server. The accessory device directly obtains the target SVC stream data from the local media stream server. This avoids the problem in related technologies where the local terminal device needs to transcode the SVC stream data to be presented by the accessory device into AVC stream data before forwarding it to the accessory device, resulting in significant performance consumption for the local terminal device. By adopting the online meeting data transmission method provided in this embodiment, after sending the media stream subscription request, the accessory device obtains the target SVC stream data subscribed and forwarded by the local terminal device from the local media stream server deployed on the local terminal device, eliminating the need for transcoding by the local terminal device and reducing performance consumption.

[0134] In one exemplary embodiment, based on Figure 6 In the embodiment shown, the media stream subscription request is also used to enable the local terminal device to determine the target SVC stream data corresponding to the media subscription request based on the local SVC stream data when the media stream subscription request includes a local user identifier. The local user identifier is the identifier corresponding to the local terminal device in the target online meeting.

[0135] In one exemplary embodiment, based on Figure 6 Please refer to the embodiments shown. Figure 7 The online meeting data transmission method provided involves the process of obtaining target SVC stream data from a local media streaming server. For example... Figure 7 As shown, the process includes steps 702 and 704, wherein:

[0136] Step 702: Receive the target virtual user identifier. The target virtual user identifier is obtained by the local terminal device from a preset mapping relationship based on the target cloud user identifier. The mapping relationship includes the correspondence between the cloud user identifier and the virtual user identifier. The virtual user identifier is the identifier corresponding to the cloud user identifier in the cloud media streaming server in the local media streaming server.

[0137] Step 704: Obtain target SVC stream data from the local media streaming server based on the target virtual user identifier; the target SVC stream data is obtained by the local terminal device subscribing to the SVC stream data corresponding to the target user identifier from the cloud media streaming server, obtaining cloud SVC stream data, and replacing the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier.

[0138] In one exemplary embodiment, based onFigure 6 As shown in the embodiments, please refer to Figure 8 The online conference data transmission method also includes the following steps:

[0139] In step 802, an initial key frame request is sent to a local media stream server, so that the local terminal device obtains the initial key frame request through the local media stream server, obtains a target key frame based on the initial key frame request, and forwards the target key frame to the local media stream server.

[0140] In step 804, the target key frame is obtained from the local media stream server.

[0141] In an exemplary embodiment, an online conference data transmission method is provided, which is used for Figure 1 As shown in the online conference system, please refer to Figure 9 The method includes the following steps:

[0142] In step 901, the local terminal device obtains cloud user identifiers corresponding to cloud users in a target online conference.

[0143] In step 902, the local terminal device sends the cloud user identifiers and a local user identifier to an accessory device.

[0144] In step 903, the local terminal device determines corresponding virtual user identifiers for the cloud user identifiers respectively, and obtains a mapping relationship.

[0145] In step 904, the accessory device sends a media stream subscription request to the terminal device, wherein the media stream subscription request includes the target cloud user identifier or the local user identifier.

[0146] In step 905, the local terminal device queries the mapping relationship based on the target cloud user identifier or the local user identifier, and obtains a target virtual user identifier.

[0147] In step 906, the local terminal device sends the target virtual user identifier to the accessory device.

[0148] In the case where the media stream subscription request includes the target cloud user identifier, steps 907 and 908 are executed, and then step 910 is executed, without executing step 909; in the case where the media stream subscription request includes the local user identifier, step 909 is executed, and then step 910 is executed, without executing steps 907 and 908.

[0149] In step 907, the local terminal device subscribes to SVC stream data corresponding to the target cloud user identifier from a cloud media stream server, and obtains cloud SVC stream data.

[0150] Step 908, the local terminal device replaces the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier to obtain target SVC stream data.

[0151] Step 909, the local terminal device replaces the local user identifier in the local SVC stream data with the target virtual user identifier to obtain target SVC stream data.

[0152] Step 910, the local terminal device forwards the target SVC stream data to the local media stream server.

[0153] Step 911, the accessory device acquires the target SVC stream data from the local media stream server based on the target virtual user identifier.

[0154] Optionally, in the case where the accessory device needs to acquire a key frame, the provided online conference data transmission method further includes steps 912 to 918, wherein:

[0155] Step 912, the accessory device sends an initial key frame request to the local media stream server.

[0156] Step 913, the local terminal device acquires the initial key frame request from the local media stream server.

[0157] In the case where the initial key frame request corresponds to a cloud user, steps 914 to 915 are executed, then step 917 is executed, and step 916 is not executed; in the case where the initial key frame request corresponds to the local terminal device, step 916 is executed, then step 917 is executed, and steps 914 to 915 are not executed.

[0158] Step 914, the local terminal device determines a target cloud user identifier based on the initial key frame request, and generates a target key frame request based on the target cloud user identifier.

[0159] Step 915, the local terminal device sends the target key frame request to the cloud media stream server, so that the cloud media stream server acquires a target key frame from the target cloud user based on the target key frame request, and sends the target key frame to the local terminal device.

[0160] Step 916, the local terminal device generates a target key frame based on the initial key frame request.

[0161] Step 917, the local terminal device forwards the target key frame to the local media stream server.

[0162] Step 918, the accessory device acquires the target key frame from the local media stream server.

[0163] It should be understood that steps 912 to 918 are also not necessarily steps that must be performed in the online conference data transmission process, and the related steps of steps 912 to 918 are performed only when the accessory device has a key frame request requirement.

[0164] It should be understood that although each step in the flowchart involved in the above embodiments is displayed in sequence according to the arrow, these steps are not necessarily executed in the order indicated by the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other orders. Moreover, at least part of the steps in the flowchart involved in the above embodiments can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be alternately executed with at least part of other steps or steps or stages in other steps. It can be understood that the steps in different embodiments can be freely combined as needed, and various non-contradictory schemes formed by the combination are within the scope of protection of the present application.

[0165] It can be understood that the term "based on" used in the present application is used to describe one or more factors that affect the determination, and does not exclude other factors that can affect the determination. For example, the phrase "determine A based on B" means that the determination of A can be based entirely or at least partially on factor B, that is, B is one factor that affects the determination of A, but does not exclude that the determination of A is also based on C.

[0166] Based on the same inventive concept, the embodiments of the present application also provide an online conference data transmission method for implementing the above Figure 2 The embodiments shown and the online conference data transmission method involved in the embodiments based on Figure 2 An online conference data transmission device for implementing the online conference data transmission method described above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more online conference data transmission device embodiments provided below can refer to the limitations of the online conference data transmission method described above, and will not be repeated here.

[0167] In one exemplary embodiment, as shown in Figure 10 An online conference data transmission device is provided. The online conference data transmission device is applied to a local terminal device, a local media stream server is deployed in the local terminal device, an accessory device corresponding to the local terminal device joins the local media stream server through a local area network, and the local terminal device joins a target online conference in a cloud media stream server through a wide area network. The online conference data transmission device includes a request acquisition module 1002, a first data acquisition module 1004, and a data forwarding module 1006, wherein:

[0168] The request obtaining module 1002 is configured to obtain a media stream subscription request of the accessory device.

[0169] The first data obtaining module 1004 is configured to, in a case where the media stream subscription request comprises a target cloud user identifier, subscribe to SVC stream data corresponding to the target cloud user identifier from a cloud media stream server, to obtain target SVC stream data corresponding to the media stream subscription request; the target cloud user identifier is an identifier corresponding to any one cloud user in a target online conference.

[0170] The data forwarding module 1006 is configured to forward the target SVC stream data to a local media stream server, so that the accessory device obtains the target SVC stream data from the local media stream server.

[0171] In an exemplary embodiment, the first data obtaining module 1004 is configured to, in a case where the media stream subscription request comprises a local user identifier, obtain target SVC stream data corresponding to the media stream subscription request according to the local SVC stream data; the local user identifier is an identifier corresponding to a local terminal device in the target online conference.

[0172] In an exemplary embodiment, the online conference data transmission apparatus further comprises a mapping module configured to query a preset mapping relationship based on the target cloud user identifier, to obtain a target virtual user identifier; the mapping relationship comprises a corresponding relationship between a cloud user identifier and a virtual user identifier; the virtual user identifier is an identifier corresponding to the cloud user identifier in the cloud media stream server in the local media stream server; the target virtual user identifier is sent to the accessory device, so that the accessory device obtains the target SVC stream data from the local media stream server based on the target virtual user identifier; in this embodiment, the first data obtaining module 1004 is configured to subscribe to SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, to obtain cloud SVC stream data; the target cloud user identifier in the cloud SVC stream data is replaced with the target virtual user identifier, to obtain the target SVC stream data.

[0173] In an exemplary embodiment, the mapping module is further configured to obtain cloud user identifiers corresponding to each cloud user in the target online conference; send the cloud user identifiers to the accessory device; determine a corresponding virtual user identifier for each cloud user identifier, to obtain the mapping relationship.

[0174] In an exemplary embodiment, the request obtaining module 1002 is configured to obtain an initial key frame request sent by the accessory device through the local media stream server; the first data obtaining module 1004 is configured to obtain a target key frame based on the initial key frame request; and the data forwarding module 1006 is configured to forward the target key frame to the local media stream server, so that the local media stream server sends the target key frame to the accessory device.

[0175] In an example embodiment, the first data acquisition module 1004 is configured to, in a case where the initial key frame request corresponds to a cloud user, determine a target cloud user identifier based on the initial key frame request; generate a target key frame request based on the target cloud user identifier; and send the target key frame request to a cloud media stream server, so that the cloud media stream server acquires a target key frame from the target cloud user based on the target key frame request and sends the target key frame to the local terminal device.

[0176] The above-mentioned modules of the online conference data transmission device can be implemented by software, hardware, or a combination thereof. The above-mentioned modules can be embedded in or independent of a processor in a computer device in hardware form, or can be stored in a memory in a computer device in software form, so as to be called and executed by a processor to perform the operations corresponding to the above-mentioned modules.

[0177] The online conference data transmission device and the local media stream server deployed in the local terminal device are independent of each other but are in communication connection.

[0178] Based on the same inventive concept, the embodiments of the present application also provide an online conference data transmission method for implementing the above-mentioned Figure 6 The online conference data transmission method is shown in the embodiments and the embodiments based on Figure 6 The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above-mentioned method, so the specific limitations in one or more online conference data transmission device embodiments provided below can refer to the limitations of the online conference data transmission method in the above, which will not be described here.

[0179] In an example embodiment, as shown in Figure 11 An online conference data transmission device is provided. The online conference data transmission device is applied to an accessory device, the accessory device and a local terminal device are connected through a local area network, the accessory device joins a local media stream server deployed in the local terminal device, and the local terminal device joins a target online conference in a cloud media stream server through a wide area network. The online conference data transmission device comprises a first request sending module 1002 and a second data acquisition module 1104, wherein:

[0180] The first request sending module 1102 is configured to send a media stream subscription request to the terminal device, so that the local terminal device requests SVC stream data corresponding to a target cloud user identifier from the cloud media stream server when the media stream subscription request comprises the target cloud user identifier, obtains target SVC stream data corresponding to the media stream subscription request, forwards the target SVC stream data to the local media stream server, and the target cloud user identifier is an identifier corresponding to any cloud user in the target online conference.

[0181] The second data obtaining module 1104 is configured to obtain the target SVC stream data from the local media stream server.

[0182] In an example embodiment, the online conference data transmission apparatus further comprises an identifier receiving module configured to receive a target virtual user identifier, the target virtual user identifier being obtained by the local terminal device based on a target cloud user identifier querying a preset mapping relationship, wherein the mapping relationship comprises a corresponding relationship between a cloud user identifier and a virtual user identifier, and the virtual user identifier is an identifier corresponding to the cloud user identifier in the cloud media stream server in the local media stream server. The second data obtaining module 1104 is configured to obtain the target SVC stream data from the local media stream server based on the target virtual user identifier, wherein the target SVC stream data is obtained by the local terminal device subscribing to SVC stream data corresponding to the target user identifier from the cloud media stream server, replacing the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier.

[0183] Optionally, the identifier receiving module is further configured to receive each cloud user identifier and local user identifier sent by the local terminal device.

[0184] In an example embodiment, the online conference data transmission apparatus further comprises a second request sending module configured to send an initial key frame request to the local media stream server, so that the local terminal device obtains the initial key frame request through the local media stream server, obtains a target key frame based on the initial key frame request, and forwards the target key frame to the local media stream server. The second data obtaining module 1104 is configured to obtain the target key frame from the local media stream server.

[0185] In an embodiment, a computer device is also provided, wherein a local media stream server is deployed in the computer device, a accessory device corresponding to the computer device enters an online conference in the local media stream server through a local area network, and the computer device enters a target online conference in a cloud media stream server through a wide area network. The computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps in the foregoing methods applied to the local terminal device when executing the computer program.

[0186] In one embodiment, an electronic device is also provided. The electronic device enters a local media stream server deployed in a local terminal device through a local area network, and the local terminal device enters a target online conference in a cloud media stream server through a wide area network. The electronic device includes a memory and a processor. The memory stores a computer program. The processor implements the steps in the foregoing method embodiments applied to the accessory device when executing the computer program.

[0187] In one exemplary embodiment, an online conference system is provided. As shown in Figure 1 The online conference system includes a local terminal device and an accessory device corresponding to the local terminal device. The local terminal device enters a target online conference in a cloud media stream server through a wide area network. The accessory device enters a local media stream server through a local area network.

[0188] The accessory device is configured to send a media stream subscription request to the local terminal device.

[0189] The local terminal device is configured to subscribe to SVC stream data corresponding to a target cloud user identifier in the cloud media stream server when the media stream subscription request includes the target cloud user identifier, obtain target SVC stream data corresponding to the media stream subscription request from the local media stream server, and forward the target SVC stream data to the local media stream server. The target cloud user identifier is an identifier corresponding to any cloud user in the target online conference.

[0190] The accessory device is configured to obtain the target SVC stream data from the local media stream server.

[0191] In one exemplary embodiment, the local terminal device is configured to obtain target SVC stream data corresponding to the media stream subscription request from the local SVC stream data when the media stream subscription request includes a local user identifier. The local user identifier is an identifier corresponding to the local terminal device in the target online conference.

[0192] In one exemplary embodiment, the local terminal device is configured to query a preset mapping relationship based on the target cloud user identifier, obtain a target virtual user identifier, and send the target virtual user identifier to the accessory device. The mapping relationship includes a corresponding relationship between a cloud user identifier and a virtual user identifier. The virtual user identifier is an identifier corresponding to the cloud user identifier in the cloud media stream server in the local media stream server. The local terminal device is also configured to subscribe to SVC stream data corresponding to the target cloud user identifier in the cloud media stream server, obtain cloud SVC stream data, replace the target cloud user identifier in the cloud SVC stream data with the target virtual user identifier, and obtain the target SVC stream data.

[0193] The accessory device is configured to obtain the target SVC stream data from the local media stream server based on the target virtual user identifier.

[0194] In an example embodiment, the local terminal device is configured to obtain cloud user identifiers corresponding to the cloud users in the target online conference, send the cloud user identifiers to the accessory device, determine a virtual user identifier corresponding to each cloud user identifier, and obtain a mapping relationship.

[0195] In an example embodiment, the accessory device is configured to send an initial key frame request to the local media stream server. The local terminal device is configured to obtain the initial key frame request from the local media stream server, and based on the initial key frame request, obtain a target key frame. The local terminal device forwards the target key frame to the local media stream server, so that the local media stream server sends the target key frame to the accessory device. The accessory device obtains the target key frame from the local media stream server.

[0196] In an example embodiment, the local terminal device is configured to, in the case that the initial key frame request corresponds to a cloud user, determine a target cloud user identifier based on the initial key frame request, generate a target key frame request based on the target cloud user identifier, and send the target key frame request to the cloud media stream server, so that the cloud media stream server obtains a target key frame from the target cloud user based on the target key frame request, and sends the target key frame to the local terminal device.

[0197] In an example embodiment, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the steps in the above method embodiments.

[0198] In an example embodiment, a computer program product is provided, and the computer program product includes a computer program. The computer program is executed by a processor to implement the steps in the above method embodiments.

[0199] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0200] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when executed, can include the processes of the above-mentioned embodiment methods. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. The non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. The volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration but not limitation, the RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., without being limited thereto.

[0201] The technical features of the above embodiments can be combined in any manner. To make the description concise, not all possible combinations of the technical features in the above embodiments are described, but as long as the combinations of the technical features do not exist contradictions, they should be considered as the scope of the present application.

[0202] The above-described embodiments are merely illustrative of several embodiments of the present application, which are described in more detail and in a specific manner, but should not be construed as limiting the scope of the patent of the present application. It should be noted that, for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A method for transmitting data in online meetings, characterized in that, The method is applied to a local terminal device, in which a local media streaming server is deployed. Accessory devices corresponding to the local terminal device join the local media streaming server via a local area network (LAN). The local terminal device joins a target online meeting on a cloud-based media streaming server via a wide area network (WAN). The method includes: Obtain the media stream subscription request of the accessory device; If the media stream subscription request includes a target cloud user identifier, the SVC stream data corresponding to the target cloud user identifier is subscribed to from the cloud media stream server to obtain the target SVC stream data corresponding to the media stream subscription request; the target cloud user identifier is the identifier corresponding to any cloud user in the target online meeting. The target SVC stream data is forwarded to the local media stream server, so that the accessory device can obtain the target SVC stream data from the local media stream server.

2. The method according to claim 1, characterized in that, The method further includes: If the media stream subscription request includes a local user identifier, the target SVC stream data corresponding to the media stream subscription request is obtained based on the local SVC stream data, wherein the local user identifier is the identifier corresponding to the local terminal device in the target online meeting.

3. The method according to claim 1, characterized in that, The method further includes: Based on the target cloud user identifier, a preset mapping relationship is queried to obtain the target virtual user identifier. The mapping relationship includes the correspondence between the cloud user identifier and the virtual user identifier. The virtual user identifier is the identifier corresponding to the cloud user identifier in the cloud media streaming server in the local media streaming server. The target virtual user identifier is sent to the accessory device so that the accessory device can obtain the target SVC stream data from the local media streaming server based on the target virtual user identifier; The step of subscribing to the SVC stream data corresponding to the target cloud user identifier from the cloud media streaming server to obtain the target SVC stream data corresponding to the media stream subscription request includes: Subscribe to the SVC stream data corresponding to the target cloud user identifier from the cloud media streaming server to obtain cloud SVC stream data; The target cloud user identifier in the cloud SVC stream data is replaced with the target virtual user identifier to obtain the target SVC stream data.

4. The method according to claim 3, characterized in that, Prior to obtaining the media stream subscription request for the accessory device, the method further includes: Obtain the cloud user identifier corresponding to each cloud user in the target online meeting; Send each of the cloud user identifiers to the accessory device; Each cloud user identifier is assigned a corresponding virtual user identifier to obtain the mapping relationship.

5. The method according to claim 1, characterized in that, The method further includes: The initial keyframe request sent by the accessory device is obtained through the local media streaming server; Based on the initial keyframe request, the target keyframe is obtained; The target keyframe is forwarded to the local media streaming server, so that the local media streaming server can send the target keyframe to the accessory device.

6. The method according to claim 5, characterized in that, The process of obtaining the target keyframe based on the initial keyframe request includes: In the case of a cloud user corresponding to the initial keyframe request, the target cloud user identifier is determined based on the initial keyframe request; Based on the target cloud user identifier, generate a target keyframe request; The target keyframe request is sent to the cloud media streaming server, so that the cloud media streaming server can obtain the target keyframe from the target cloud user based on the target keyframe request and send the target keyframe to the local terminal device.

7. A method for transmitting data in online meetings, characterized in that, The method is used for accessory devices, wherein the accessory devices and local terminal devices are connected via a local area network (LAN), the accessory devices join a local media streaming server deployed in the local terminal devices, and the local terminal devices join a target online meeting in a cloud media streaming server via a wide area network (WAN). The method includes: A media stream subscription request is sent to the local terminal device, so that if the media stream subscription request includes a target cloud user identifier, the local terminal device can request the SVC stream data corresponding to the target cloud user identifier from the cloud media stream server, obtain the target SVC stream data corresponding to the media stream subscription request, and forward the target SVC stream data to the local media stream server. The target cloud user identifier is the identifier corresponding to any cloud user in the target online meeting. The target SVC stream data is obtained from the local media streaming server.

8. A computer device, characterized in that, The computer device is equipped with a local media streaming server. Accessory devices corresponding to the computer device join the local media streaming server via a local area network. The computer device joins the target online conference in the cloud media streaming server via a wide area network. The computer device includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. An electronic device, characterized in that, The electronic device joins a local media streaming server deployed on a local terminal device via a local area network, and the local terminal device joins a target online meeting on a cloud media streaming server via a wide area network. The electronic device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps of the method described in claim 7.

10. An online conferencing system, characterized in that, The online conferencing system includes a local terminal device and corresponding accessory devices. The local terminal device joins the target online meeting in the cloud media streaming server via a wide area network, and the accessory devices join the local media streaming server via a local area network. The accessory device is used to send a media stream subscription request to the local terminal device; The local terminal device is used to subscribe to the SVC stream data corresponding to the target cloud user identifier from the cloud media stream server when the media stream subscription request includes the target cloud user identifier, obtain the target SVC stream data corresponding to the media stream subscription request, and forward the target SVC stream data to the local media stream server. The target cloud user identifier is the identifier corresponding to any cloud user in the target online meeting. The accessory device is used to obtain the target SVC stream data from the local media streaming server.

Images