Audio and video data transmission method and device, electronic equipment and storage medium

By receiving and forwarding sound video data on the first server, and selecting appropriate protocols according to the terminal attribute information, the transmission of sound and video data in existing technologies is limited to the same network. Video call.

CN119363914APending Publication Date: 2025-01-24VISIONVERA INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411374836.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-29
Publication Date
2025-01-24

AI Technical Summary

Technical Problem

The existing video calling technology is limited to the terminal equipment being in the same network, with a narrow adaptation range and cannot realize audio and video data transmission between different networks.

Method used

By implementing the audio and video data transmission method on the first server, using the first protocol interface to receive the audio and video data sent by the first terminal, and deciding to use the first protocol or the second protocol for data transmission based on the terminal attribute information of the second terminal, Ensure that audio and video data can be transmitted across different networks.

Benefits of technology

It realizes the cross-network transmission of audio and video data, making video calls between different terminal devices universal and suitable for a variety of terminal devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119363914A_ABST
    Figure CN119363914A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an audio and video data transmission method and device, electronic equipment and a storage medium, and the method comprises the steps that a first server receives first audio and video data transmitted by a second interface of a first protocol configured in a first terminal through a first interface of the first protocol, and sending the first audio and video data to the second terminal according to the terminal attribute information of the second terminal. Therefore, the first server can perform audio and video data transmission according to the terminal attribute information of the communication terminal, and the audio data transmission method can be suitable for different terminals, so that the video call between the terminals has universality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a method and device for audio and video data transmission, electronic equipment, and a storage medium. Background Art

[0002] With the development of network technology, people can communicate with each other without face-to-face communication. For example, with the current video call technology, users in different locations can make video calls through their respective terminals to achieve face-to-face communication over the network. However, the current video call technology is limited to the video call terminals being in the same network and has a narrow scope of application. Summary of the invention

[0003] In view of the above problems, an audio and video data transmission method and device, electronic device, and storage medium are proposed to overcome the above problems or at least partially solve the above problems, including:

[0004] A method for transmitting audio and video data, characterized in that it is applied to a first server, and the method comprises:

[0005] The first server receives, through a first interface of a first protocol, first audio and video data sent by a second interface of a first protocol configured in a first terminal, wherein the first audio and video data is data to be sent by the first terminal to a second terminal, and the first server is used to transmit audio and video data to the first terminal and the second terminal connected thereto;

[0006] The first server sends the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

[0007] Optionally, the sending the first audio and video data to the second terminal according to the terminal attribute information of the second terminal includes:

[0008] When the terminal attribute information of the second terminal is terminal attribute information supporting the first protocol, the first audio and video data is sent to the second terminal through the second interface.

[0009] Optionally, the first server is configured with a third interface of the second protocol, and the sending the first audio and video data to the second terminal according to the terminal attribute information of the second terminal includes:

[0010] When the terminal attribute information of the second terminal is terminal attribute information supporting the second protocol, the first audio and video data is sent to the second terminal through the third interface.

[0011] Optionally, the first server is connected to a second server in a second protocol, the second server is connected to the second terminal, and the sending of the first audio and video data to the second terminal through the third interface includes:

[0012] The first audio and video data is sent to the second server through the third interface, so that the second server forwards the first audio and video data to the second terminal.

[0013] Optionally, before the first server receives, through the first interface of the first protocol, the first audio and video data sent by the second interface of the first protocol configured in the first terminal, the method further includes:

[0014] In response to receiving, through the first interface, a video call signaling sent by the first terminal through the second interface, generating, according to terminal attribute information of the second terminal, a call request signaling corresponding to the video call signaling, the second terminal being the video call terminal specified by the first terminal through the video call signaling;

[0015] sending the call request signaling to the second terminal according to the terminal attribute information of the second terminal;

[0016] Receive the answer signaling returned by the second terminal, and forward the answer signaling to the first terminal through the first interface, so that the first terminal collects the first audio and video data and returns the first audio and video data to the first server.

[0017] Optionally, it also includes:

[0018] receiving second audio and video data sent by the second terminal according to the terminal attribute information of the second terminal;

[0019] The second audio and video data is sent to the second interface of the first terminal through the first interface.

[0020] Optionally, the first protocol is the H323 protocol, the second protocol is the visual networking protocol, and the first server is an XMCU server.

[0021] An audio and video data transmission device, applied to a first server, comprising:

[0022] A first audio data receiving module is used to receive, through a first interface of a first protocol, first audio and video data sent by a second interface of a first protocol configured in a first terminal, wherein the first audio and video data is data to be sent by the first terminal to a second terminal, and the first server is used to transmit audio and video data for the first terminal and the second terminal connected thereto;

[0023] The first audio data sending module is used to send the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

[0024] An electronic device comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the above-mentioned audio and video data transmission method when executed by the processor.

[0025] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the audio and video data transmission method described above is implemented.

[0026] The embodiments of the present invention have the following advantages:

[0027] In the embodiment of the present invention, the first server receives the first audio and video data sent by the second interface of the first protocol configured in the first terminal through the first interface of the first protocol, and then sends the first audio and video data to the second terminal according to the terminal attribute information of the second terminal. Thus, the first server can transmit audio and video data according to the terminal attribute information of the communication terminal, and the audio data transmission method can be applied to different terminals, so that the video call between the terminals has universal applicability. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0029] Figure 1 is a flowchart of a method for transmitting audio and video data provided by an embodiment of the present invention;

[0030] Figure 2 is a flowchart of another method for transmitting audio and video data provided by an embodiment of the present invention;

[0031] Figure 3 It is a structural diagram of audio and video data transmission based on an XMCU server provided by an embodiment of the present invention;

[0032] Figure 4 It is a structural diagram of an audio and video data transmission device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0033] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] Reference Figure 1 , shows a flowchart of the steps of an audio and video data transmission method provided by an embodiment of the present invention, which is applied to a first server, the first server is connected to a first terminal, and the first terminal is configured with a second interface of a first protocol, the first server is used for audio and video stream transmission between the first terminal and the second terminal, and the first server is configured with a first interface of the first protocol, and specifically may include the following steps:

[0035] Step S101: A first server receives, through a first interface of a first protocol, first audio and video data sent by a second interface of a first protocol configured in a first terminal.

[0036] The first audio and video data is data to be sent from the first terminal to the second terminal, and the first server is used to transmit the audio and video data to the connected first terminal and the second terminal.

[0037] Among them, the first terminal can be a soft terminal or a hard terminal. The soft terminal can be a communication terminal device implemented by software, running on a general computing platform (such as a personal computer, a smart phone, a tablet computer, etc.), rather than a traditional hardware terminal device (such as a dedicated video conferencing terminal). The soft terminal can realize communication functions such as audio, video calls, data sharing, etc. through software applications. The hard terminal can be a communication terminal implemented by a dedicated hardware device. The hard terminal can be used in specific communication application scenarios, such as video conferencing, telephone systems, etc. The hard terminal can have high performance, high reliability and specialized functions, and is suitable for environments that require high-quality communication experience and stability.

[0038] The first terminal may be a terminal applying the first protocol, and the first terminal may be configured with a second interface of the first protocol, and the first terminal may perform audio and video data transmission in the first protocol through the second interface.

[0039] The first server can serve as an intermediate station between the first terminal and the second terminal to realize the transmission of audio and video data between terminals with the same terminal attribute information or different terminal attribute information, wherein the terminal attribute information includes the protocol information supported by the terminal. A first interface of the first protocol can be set in the first server, and the first interface can be used for data transmission between the first server and the first terminal supporting the first protocol. Interfaces of other protocols can also be set in the first server, so that the first server can also transmit data with terminals supporting other protocols.

[0040] In an embodiment of the present invention, the first protocol may be an H323 protocol, the second protocol may be a visual networking protocol, and the first server may be an XMCU server. The H323 protocol is a standard audio and video transmission protocol, encoding, decoding and packaging of audio and video signals. The H.323 Audio video protocol is composed of a group of protocols, among which there are protocols responsible for encoding, decoding and packaging of audio and video signals, responsible for sending and receiving call signaling and control signaling, and responsible for capability exchange signaling. The visual networking protocol is a protocol used for data transmission in the visual networking.

[0041] In actual applications, when a first terminal initiates a video call to a second terminal, if the first terminal confirms that the second terminal agrees to the video call, the first terminal can collect first audio and video data through the audio and video collection device, and use the second interface to send the first audio and video data to the first server. The first server can receive the first audio and video data through the first interface, and the first audio and video data is transmitted between the first terminal and the first server in accordance with the first protocol.

[0042] Step S102: sending the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

[0043] When the first server receives the first audio and video data, it can determine the terminal attribute information of the destination address (ie, the second terminal) of the first audio and video data, and then send the first audio and video data to the second terminal according to the terminal attribute information.

[0044] The terminal attribute information may be divided according to the type of network protocol supported by the terminal. In an embodiment of the present invention, the terminal attribute information may be divided into terminal attribute information supporting a first protocol and terminal attribute information supporting a second protocol.

[0045] In an embodiment of the present invention, step 102 may specifically include: when the terminal attribute information of the second terminal is terminal attribute information supporting the first protocol, sending the first audio and video data to the second terminal through the second interface.

[0046] In actual applications, when the terminal attribute information of the second terminal is terminal attribute information supporting the first protocol, the first server and the second terminal can also transmit according to the first protocol, and the first server can send the received first audio and video data to the second terminal through the second interface.

[0047] In another embodiment of the present invention, the first server is further configured with a third interface of a second protocol, and the second protocol is a transmission protocol different from the first protocol, such as a visual networking protocol. Step 102 may specifically include: when the terminal attribute information of the second terminal is a terminal supporting the second protocol, sending the first audio and video data to the second terminal through the third interface.

[0048] In actual applications, data can be transmitted between the second terminal and the first server through the second protocol, and data can be transmitted between the first terminal and the first server through the first protocol.

[0049] Specifically, the first server is connected to the second server in the second protocol, the second server is connected to the second terminal, and the first audio and video data is sent to the second terminal through the third interface, including: sending the first audio and video data to the second server through the third interface, so that the second server forwards the first audio and video data to the second terminal.

[0050] For example, the first server is XMCU, which supports both H323 protocol and visual networking protocol. When the first terminal of the H323 protocol initiates a video call to the visual networking terminal, XUCU can use the H323 protocol interface to receive the first audio and video data of the first terminal, and use the visual networking protocol interface to send the first audio and video data to the visual networking server, and then the visual networking server sends it to the visual networking terminal.

[0051] In the embodiment of the present invention, the first server receives the first audio and video data sent by the second interface of the first protocol configured in the first terminal through the first interface of the first protocol, and then sends the first audio and video data to the second terminal according to the terminal attribute information of the second terminal. Thus, the first server can transmit audio and video data according to the terminal attribute information of the communication terminal, and the audio data transmission method can be applied to different terminals, so that the video call between the terminals has universal applicability.

[0052] Reference Figure 2 , shows a flowchart of another method for transmitting audio and video data according to an embodiment of the present invention, which may specifically include the following steps:

[0053] Step S201, in response to receiving a video call signaling sent by a first terminal through a second interface through a first interface, generating a call request signaling corresponding to the video call signaling according to terminal attribute information of a second terminal, the second terminal being a video call terminal specified by the first terminal through the video call signaling;

[0054] In actual application, when a user makes a video call on a first terminal and dials a second terminal, a video call signaling is generated, which may carry a service type (i.e., video call type) and a service object (i.e., the first terminal is the caller and the second terminal is the called party).

[0055] After generating the video call signaling, the first terminal can send the video call signaling to the first server. The first server parses the video call signaling, determines the service type and service object, and then determines the terminal attribute information of the second terminal, and then generates a call request signaling based on the terminal attribute information. The call request signaling can carry the service type and service object.

[0056] By generating a call request signaling corresponding to the video call signaling according to the terminal attribute information of the second terminal, the communication request signaling can be transmitted between the first server and the second terminal.

[0057] Among them, the terminal attribute information can be divided according to the type of network protocol supported by the terminal. In an embodiment of the present invention, the terminal attribute information can be divided into terminal attribute information supporting the first protocol and terminal attribute information supporting the second protocol. In one example, the first protocol can be the H323 protocol, the second protocol can be the visual networking protocol, and the first server can be the XMCU server. The H323 protocol is a standard audio and video transmission protocol, the encoding, decoding and packaging of audio and video signals, H.323 Audio video protocol, composed of a group of protocols, including those responsible for the encoding, decoding and packaging of audio and video signals, those responsible for call signaling reception and control signaling, and those responsible for capability exchange signaling. The visual networking protocol is a protocol used for data transmission in the visual networking.

[0058] Step S202, sending a call request signaling to the second terminal according to the terminal attribute information of the second terminal;

[0059] After generating the call request signaling, the first server may determine the transmission mode of the call request signaling according to the terminal attribute information of the second terminal, and then send the call request signaling to the second terminal according to the transmission mode.

[0060] The transmission method may include but is not limited to any one or more of the transmission interface used by the first server and the transmission link of the call request signaling.

[0061] Step S203: receiving the answer signaling returned by the second terminal, and forwarding the answer signaling to the first terminal through the first interface, so that the first terminal collects the first audio and video data, and returns the first audio and video data to the first server.

[0062] After the call request signaling is sent to the second terminal, if the second terminal confirms the call, the call signaling can be returned to the first server; if the second terminal refuses to answer the call, the call rejection signaling can be returned to the first server.

[0063] When the first server receives the answer signaling, it can use the first interface supporting the first protocol to forward the answer signaling to the first terminal. After the first terminal receives the answer signaling and confirms that the second terminal answers the video call, it can use the audio and video acquisition device to collect the first audio and video data and send the collected audio and video data to the first server.

[0064] When the first server receives the rejection signaling, the video call process ends.

[0065] Step S204: The first server receives, through the first interface of the first protocol, first audio and video data sent by the second interface of the first protocol configured in the first terminal.

[0066] The first audio and video data is data to be sent by the first terminal to the second terminal, and the first server is used to transmit the audio and video data to the connected first terminal and the second terminal;

[0067] Step S205: Send the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

[0068] Step S206, receiving the second audio and video data sent by the second terminal according to the terminal attribute information of the second terminal;

[0069] After receiving the first audio and video data, the second terminal plays the audio and video, and uses its own audio and video acquisition equipment to collect the second audio data, and sends the collected second audio and video data to the first server. The first server can receive the second audio and video data based on the second terminal attribute information of the second terminal.

[0070] For example, when the second terminal supports the terminal attribute information of the second protocol, the first server can use the third interface supporting the second protocol to communicate with the second terminal. When the second terminal supports the terminal attribute information of the first protocol, the first server can use the first interface supporting the first protocol to communicate with the second terminal.

[0071] Step S207: Send the second audio and video data to the first interface of the first terminal through the first interface.

[0072] After receiving the second audio and video data, the first server may forward the received second audio and video data to the first terminal. Specifically, the first server may send the second audio and video data to the first interface of the first terminal through the second interface.

[0073] In the embodiment of the present invention, the first terminal, the first server and the second terminal may communicate with each other through terminal attribute information, and the audio data transmission method may be applicable to different types of terminals, so that the video call between the terminals has universal applicability.

[0074] Reference Figure 3 , showing a schematic diagram of the structure of audio and video transmission based on the XMCU server in an embodiment of the present invention. A soft terminal supporting the H323 protocol can choose to make video calls to three accounts, that is, a video network account, a soft terminal account, and a client account supporting the H323 protocol can be selected as the called party. The specific data transmission process is as follows:

[0075] (I) One soft terminal is the calling party and the other soft terminal is the called party:

[0076] The soft terminal makes a video call to another soft terminal. The soft terminal inputs the called party's account and initiates a video call. The H323SDK on the soft terminal sends a video call signaling to the XMCU. After receiving the video call signaling, the XMCU parses the called party's account. The XMCU then sends a call request signaling to the called party. After receiving the call request signaling, the called soft terminal pops up a call prompt box. The user chooses to answer or reject the call. If the user chooses to answer, the user's soft terminal calls the h323 protocol answering interface to send an answering signaling to the XMCU. After receiving the answering signaling, the XMCU sends the answering signaling to the previous calling soft terminal. After receiving the answering signaling, the calling soft terminal starts to collect audio and video and calls the H323 protocol interface to send audio and video to the XMCU. The XMCU receives the calling party's audio and video and transfers the audio and video to the called soft terminal. The called party receives the audio and video forwarded by the XMCU, and also collects audio and video and calls the H323 protocol interface to send its own audio and video to the XMCU. The XMCU receives the called party's audio and video and then forwards it to the calling soft terminal, thus realizing a video call between the two soft terminals.

[0077] (II) The soft terminal is the calling party and the video network terminal is the called party:

[0078] The soft terminal makes a video call to the video network terminal. The soft terminal enters the called account and initiates a video call. The H323SDK on the soft terminal sends a video call signaling to the XMCU. After receiving the video call signaling, the XMCU parses the called user account. The XMCU then uses the V2V protocol to send a video call signaling to the video network server. The video network server obtains the signaling and forwards the video call signaling to the video network terminal. The called video network terminal receives the call request signaling and a pop-up call prompt box pops up. The user chooses to answer or reject the call. If the user chooses to answer, the video network terminal calls the V2V protocol to send an answer signaling to the video network server. The video network server then forwards the answer signaling to the XMCU server. The XMCU server receives the answer signaling and uses the H323 protocol SDK to send a call to the soft terminal. Send answer signaling. After receiving the answer signaling, the calling soft terminal starts to collect audio and video and calls the H323 protocol interface to send audio and video to XMCU. XMCU receives the calling audio and video and then uses the V2V protocol to transfer the audio and video to the visual network server. The visual network server then transfers the audio and video to the visual network terminal. The visual network terminal receives the audio and video and renders the video screen through the page and plays the sound through the speaker. At the same time, it collects audio and video and sends it to the visual network server through the V2V protocol. The visual network server then forwards the audio and video to XMCU. XMCU then parses the audio and video data and uses the H323 protocol SDK interface to send audio and video data packets to the soft terminal. The soft terminal receives the audio and video data packets and parses the audio and video through the H323 protocol SDK to realize the video call between the soft terminal and the visual network terminal.

[0079] (III) The soft terminal is the calling party and the client supporting the H323 protocol is the called party:

[0080] The soft terminal makes a video call to another third-party client that supports the H323 protocol. The soft terminal enters the called party's account and initiates a video call. The H323SDK on the soft terminal sends a video call signaling to the H323 protocol server. The H323 protocol server receives the video call signaling and parses the called user account. The H323 protocol server then sends a call request signaling to the called user. The called client receives the call request signaling and a call prompt box pops up. The user chooses to answer or reject the call. If the user chooses to answer, the user's client calls the h323 protocol answering interface to send an answering signaling to the H323 protocol server. The H323 protocol server The server receives the answer signaling and sends the answer signaling to the previous calling soft terminal. After receiving the answer signaling, the calling soft terminal starts to collect audio and video and calls the H323 protocol interface to send audio and video to the H323 protocol server. The H323 protocol server receives the calling audio and video and forwards the audio and video to the called client. The called end receives the audio and video forwarded by the H323 protocol server, and also collects audio and video and calls the H323 protocol interface to send its own audio and video to the H323 protocol server. The H323 protocol server receives the called audio and video and forwards it to the calling soft terminal, thereby realizing a video call between the soft terminal and the three-party client that supports the H323 protocol.

[0081] In the above embodiment, the soft terminal can integrate H323SDK, and XMCU can integrate H323SDK to realize video calls between the soft terminal and the three parties supporting H323 client, and realize H323 video calls between the soft terminal and the visual networking terminal through XMCU. The H323 protocol is used between the soft terminal and XMCU, and the V2V protocol is used between XMCU and the visual networking terminal.

[0082] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0083] Reference Figure 4 , shows a schematic diagram of the structure of an audio and video data transmission device provided by an embodiment of the present invention, which is applied to a first server, the first server is connected to a first terminal, and the first terminal is configured with a first interface of a first protocol, the first server is used for audio and video stream transmission between the first terminal and a second terminal, the first server is configured with a second interface of the first protocol, and specifically may include the following modules:

[0084] A first audio data receiving module 401 is used to receive, through the second interface, first audio and video data sent by the first terminal through the first interface, where the first audio and video data is data to be sent to the second terminal;

[0085] The first audio data sending module 402 is used to send the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

[0086] In an embodiment of the present invention, the first audio data sending module 402 may include:

[0087] The first protocol type submodule is used to send the first audio and video data to the second terminal through the second interface when the terminal attribute information of the second terminal is a terminal supporting the first protocol.

[0088] In an embodiment of the present invention, the first audio data sending module 402 may include:

[0089] The second protocol type submodule is used to send the first audio and video data to the second terminal through the third interface when the terminal attribute information of the second terminal is a terminal supporting the second protocol.

[0090] In one embodiment of the present invention, the first server is connected to the second server in the second protocol, the second server is connected to the second terminal, and the second protocol type submodule is used to send the first audio and video data to the second terminal through the third interface, specifically used to: send the first audio and video data to the second server through the third interface, so that the second server forwards the first audio and video data to the second terminal.

[0091] In one embodiment of the present invention, the device may further include:

[0092] a call request signaling generation module, configured to generate a call request signaling corresponding to the video call signaling in response to receiving the video call signaling sent by the first terminal through the first interface through the second interface according to the terminal attribute information of the second terminal, wherein the second terminal is the video call terminal specified by the first terminal through the video call signaling;

[0093] A call request signaling sending module, configured to send the call request signaling to the second terminal according to the terminal attribute information of the second terminal;

[0094] The answer signaling forwarding module is used to receive the answer signaling returned by the second terminal, and forward the answer signaling to the first terminal through the second interface, so that the first terminal collects the first audio and video data and returns the first audio and video data to the first server.

[0095] In one embodiment of the present invention, the device further comprises:

[0096] A second audio and video data receiving module, configured to receive second audio and video data sent by the second terminal according to the terminal attribute information of the second terminal;

[0097] The second audio and video data sending module is used to send the second audio data to the first interface of the first terminal through the second interface.

[0098] In one embodiment of the present invention, the first protocol is the H323 protocol, the second protocol is the visual networking protocol, and the first server is an XMCU server.

[0099] In the embodiment of the present invention, the first audio and video data sent by the first terminal through the first interface is received through the second interface, and the first audio and video data is data to be sent to the second terminal; the first audio and video data is sent to the second terminal according to the terminal attribute information of the second terminal. Thus, the first server can transmit audio and video data according to the type of communication terminal, and the audio data transmission method can be applied to different types of terminals, so that video calls between terminals have universal applicability.

[0100] An embodiment of the present invention further provides an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the above audio and video data transmission method is implemented.

[0101] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above audio and video data transmission method is implemented.

[0102] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0103] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0104] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0105] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0106] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0107] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0108] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0109] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0110] The above provides a detailed introduction to the provided audio and video data transmission method and device, electronic device, and storage medium. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for transmitting audio and video data, characterized in that: Applied to a first server, the method comprises: The first server receives, through a first interface of a first protocol, first audio and video data sent by a second interface of a first protocol configured in a first terminal, wherein the first audio and video data is data to be sent by the first terminal to a second terminal, and the first server is used to transmit audio and video data to the first terminal and the second terminal connected thereto; The first server sends the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

2. The method according to claim 1, characterized in that The sending the first audio and video data to the second terminal according to the terminal attribute information of the second terminal includes: When the terminal attribute information of the second terminal is terminal attribute information supporting the first protocol, the first audio and video data is sent to the second terminal through the second interface.

3. The method according to claim 1, characterized in that The first server is configured with a third interface of the second protocol, and the sending of the first audio and video data to the second terminal according to the terminal attribute information of the second terminal includes: When the terminal attribute information of the second terminal is terminal attribute information supporting the second protocol, the first audio and video data is sent to the second terminal through the third interface.

4. The method according to claim 3, characterized in that The first server is connected to a second server in a second protocol, the second server is connected to the second terminal, and the sending of the first audio and video data to the second terminal through the third interface includes: The first audio and video data is sent to the second server through the third interface, so that the second server forwards the first audio and video data to the second terminal.

5. The method according to any one of claims 1 to 4, characterized in that Before the first server receives, through the first interface of the first protocol, the first audio and video data sent by the second interface of the first protocol configured in the first terminal, the method further includes: In response to receiving, through the first interface, a video call signaling sent by the first terminal through the second interface, generating, according to terminal attribute information of the second terminal, a call request signaling corresponding to the video call signaling, the second terminal being the video call terminal specified by the first terminal through the video call signaling; sending the call request signaling to the second terminal according to the terminal attribute information of the second terminal; Receive the answer signaling returned by the second terminal, and forward the answer signaling to the first terminal through the first interface, so that the first terminal collects the first audio and video data and returns the first audio and video data to the first server.

6. The method according to any one of claims 1 to 4, characterized in that Also includes: receiving second audio and video data sent by the second terminal according to the terminal attribute information of the second terminal; The second audio and video data is sent to the second interface of the first terminal through the first interface.

7. The method according to any one of claims 1 to 4, characterized in that The first protocol is the H323 protocol, the second protocol is the visual networking protocol, and the first server is an XMCU server.

8. An audio and video data transmission device, characterized in that: Applied to a first server, the device comprises: A first audio data receiving module is used to receive, through a first interface of a first protocol, first audio and video data sent by a second interface of a first protocol configured in a first terminal, wherein the first audio and video data is data to be sent by the first terminal to a second terminal, and the first server is used to transmit audio and video data for the first terminal and the second terminal connected thereto; The first audio data sending module is used to send the first audio and video data to the second terminal according to the terminal attribute information of the second terminal.

9. An electronic device, characterized in that: The method comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the method for transmitting audio and video data as claimed in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for transmitting audio and video data as claimed in any one of claims 1 to 7 is implemented.