Audio and video call method and device based on signaling protocol, equipment, medium and product

Abstract

The invention discloses an audio and video call method and device based on a signaling protocol, equipment, a medium and a product, and relates to the technical field of communication, and the method comprises the following steps: a sending end packages application layer data by using the signaling protocol to obtain signaling data; and the receiving end analyzes the signaling parameter in the signaling data, triggers a preparation operation for establishing an audio and video call according to the signaling parameter, and establishes the audio and video call after completing interaction with the sending end. The application can break through the limitation of an audio and video call use scene.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to an audio and video call method based on a signaling protocol, an audio and video call device based on a signaling protocol, an audio and video call equipment based on a signaling protocol, a storage medium and a computer program product. Background Art

[0002] At present, the audio and video call function is developed through customized development of third-party SDK (Software Development Kit), or the audio and video call underlying protocol is secondary developed based on the open source framework to achieve the audio and video call function. Whether it is customized development through third-party SDK resulting in poor scalability of audio and video calls or secondary development of the underlying protocol based on the open source framework resulting in the inability to transmit large amounts of data, both limit the applicable scenarios of audio and video calls, and cannot achieve in-conference operations for thousands of people, and audio and video calls have great limitations.

[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of this application is to provide an audio and video call method based on a signaling protocol, an audio and video call device based on a signaling protocol, an audio and video call equipment based on a signaling protocol, a storage medium and a computer program product, aiming to solve the technical problem that the use scenarios of audio and video calls are limited.

[0005] To achieve the above object, the present application proposes an audio and video call method based on a signaling protocol, which is applied to a receiving end, and the method includes:

[0006] Receiving signaling data sent by a sending end, wherein the signaling data is encapsulated by the sending end based on a signaling protocol;

[0007] Parsing the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of a signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command;

[0008] Triggering a preparation operation for establishing an audio or video call according to the signaling parameter, and sending first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call;

[0009] After receiving the second confirmation data fed back by the sending end according to the first confirmation data, an audio and video call is established with the sending end.

[0010] In one embodiment, the signaling detailed data includes an outgoing user ID and an incoming user ID, wherein the outgoing user ID and the incoming user ID use existing user IDs in the audio and video call system that applies the signaling protocol.

[0011] In one embodiment, when it is identified that the triggering operation of the signaling command identifier is a data change, the change command content is obtained from the data change type field in the signaling detailed data;

[0012] The change command content triggers the execution of the change operation in the audio and video call.

[0013] In addition, to achieve the above purpose, the present application also proposes an audio and video call method based on a signaling protocol, which is applied to a sending end, and the method includes:

[0014] Get communication data of application layer;

[0015] Encapsulating the communication data based on a signaling protocol to obtain signaling data;

[0016] The signaling data is sent to a receiving end.

[0017] In one embodiment, the method further comprises:

[0018] After receiving the first confirmation data from the receiving end, second confirmation data is sent to the receiving end to indicate that the sending end is ready to establish an audio and video call.

[0019] In addition, to achieve the above-mentioned purpose, the present application also proposes an audio and video call device based on a signaling protocol, which is applied to a receiving end. The audio and video call device based on a signaling protocol includes:

[0020] A receiving module, used to receive signaling data sent by a sending end, wherein the signaling data is encapsulated by the sending end based on a signaling protocol;

[0021] A parsing module, used to parse the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of a signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command;

[0022] A confirmation module, used to trigger a preparation operation for establishing an audio or video call according to the signaling parameter, and send first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call;

[0023] An establishing module is used to establish an audio and video call with the sending end after receiving the second confirmation data fed back by the sending end according to the first confirmation data.

[0024] In addition, to achieve the above-mentioned purpose, the present application also proposes an audio and video call device based on a signaling protocol, which is applied to a transmitting end. The audio and video call device based on a signaling protocol includes:

[0025] An acquisition module, used to acquire communication data of the application layer;

[0026] An encapsulation module, used to encapsulate the communication data based on a signaling protocol to obtain signaling data;

[0027] The sending module is used to send the signaling data to the receiving end.

[0028] In addition, to achieve the above-mentioned purpose, the present application also proposes an audio and video call device based on a signaling protocol, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the audio and video call method based on the signaling protocol as described above.

[0029] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the audio and video call method based on the signaling protocol as described above are implemented.

[0030] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the audio and video call method based on the signaling protocol as described above.

[0031] The current customized development through third-party SDKs results in poor scalability of audio and video calls. Secondary development of the underlying protocol based on the open source framework results in the inability of audio and video calls to transmit large amounts of data, which limits the applicable scenarios of audio and video calls and makes it impossible to implement in-conference operations for thousands of people. There are technical problems with significant limitations.

[0032] The present application proposes a method for audio and video calls based on a signaling protocol, wherein a sending end encapsulates application layer data by using a signaling protocol to obtain signaling data; a receiving end parses signaling parameters in the signaling data, triggers a preparation operation for establishing an audio and video call according to the signaling parameters, and establishes an audio and video call after completing interaction with the sending end.

[0033] Compared with third-party SDK customized development, this application encapsulates application layer data through signaling protocol, and can dynamically adjust fields for expansion and add new functions during encapsulation, so as to realize in-meeting operations for thousands of people and meet diverse needs, thus avoiding the problem of poor scalability in SDK customized development; compared with secondary development based on open source framework, this application optimizes the encoding method in signaling protocol to realize more data transmission under the same bandwidth conditions, and solves the problem of limited data transmission due to limited field length; it not only breaks the scalability barrier of third-party SDK customized development, but also overcomes the field length limitation during secondary development of open source framework, opening up a broader space for the use scenarios of audio and video calls. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0036] Figure 1 A schematic diagram of the audio and video call method based on the signaling protocol provided by the present application;

[0037] Figure 2 A schematic diagram of the signaling protocol format provided for the audio and video call method based on the signaling protocol of this application;

[0038] Figure 3 A brief flowchart diagram of the first embodiment of the audio and video call method based on the signaling protocol of the present application is provided;

[0039] Figure 4 A brief flowchart diagram of the second embodiment of the audio and video call method based on the signaling protocol of the present application is provided;

[0040] Figure 5 A brief schematic diagram of the audio and video call method based on the signaling protocol provided by this application;

[0041] Figure 6 This is a schematic diagram of the module structure of the audio and video communication device based on the signaling protocol applied to the receiving end of the present application;

[0042] Figure 7 This is a schematic diagram of the module structure of the audio and video call device based on the signaling protocol applied to the sending end of the present application;

[0043] Figure 8This is a schematic diagram of the device structure of the hardware operating environment involved in the audio and video call method based on the signaling protocol of this application.

[0044] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0045] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0046] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0047] like Figure 1 As shown, Figure 1 The application layer protocol that is relied upon to implement audio and video calls for existing (customized development by third-party SDK, secondary development based on open source framework), among which the transmission of signaling data relies on SDP (Session Description Protocol, session description) protocol, SIP (Session Initiation Protocol, session initiation) protocol, H.323 protocol, RTSP (Real Time Streaming Protocol, real-time streaming) protocol; RSVP (Resource Reservation Protocol, resource reservation) protocol and RTCP (Real-time Transport Control Protocol, real-time transport control) protocol that affect the quality of audio and video call service; RTP (Real-time Transport Protocol, real-time transmission) protocol for implementing audio or video; similarly, the signaling protocol used in this application is a customized set of signaling protocols for audio and video calls using JSON (JavaScript Object Notation, lightweight data exchange format) string format on top of the application layer protocol.

[0048] like Figure 2 As shown, Figure 2This is a schematic diagram of the signaling protocol format for this application, which includes four parts: cmd_type (signaling type), cmd_id (signaling command identifier), version (signaling protocol version), cmd_data (signaling detailed data), among which cmd_type, cmd_id, and version are required items, and cmd_data is selected whether it is required based on the fields inside the detailed data, for example: caller_id (outgoing user ID), callee_id (incoming user ID), caller_name (outgoing user name), meeting_id (meeting id), and start_time (signaling sending time) are required.

[0049] The signaling types include video_chat (point-to-point call) and video_meeting (conference / multi-person call); the trigger operations corresponding to the signaling command identifier include invite (call), invite_cancel (cancel call), invite_ack (call-ring), reject (reject), accept (answer), call_param_change (data change), hangup (hang up); the signaling protocol version includes the version number indicating the signaling protocol, such as: 1.0, 2.0...; the signaling detailed data includes caller_id (outgoing user ID), callee_id (incoming user ID), ca ller_name (calling user name), meeting_id (meeting id), start_time (signaling time), supplier (third-party manufacturer), device_type (device type), meeting_name (meeting name), invalidate_time (expiration time), type (type), change_type (data change type), change_info (data change information), change_id (changer identifier), group_id (group identifier), invite_data (recording information), extra (String type, transparent transmission field).

[0050] It should be noted that the execution subject of this embodiment can be an audio and video call device based on a signaling protocol, or a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a server, etc. that can realize the above functions. The following takes an electronic device as an example to illustrate this embodiment and the following embodiments.

[0051] Based on this, the embodiment of the present application provides an audio and video call method based on a signaling protocol, referring to Figure 3 , Figure 3 This is a flow chart of the first embodiment of the audio and video call method based on the signaling protocol of the present application.

[0052] In this embodiment, the audio and video call method based on the signaling protocol is applied to the receiving end, and includes steps S10 to S40:

[0053] Step S10, receiving signaling data sent by the sending end, wherein the signaling data is encapsulated by the sending end based on the signaling protocol;

[0054] It should be noted that signaling data is information used for communication in audio and video calls. It encapsulates the necessary signaling parameters in the communication process based on the signaling protocol, which specifies the signaling data format, transmission rules and processing flow. The sender is the party that initiates the call in the audio and video call and is responsible for encoding and encapsulating the signaling data. When the sender sends signaling data, there can be one or more receivers, all of which accept the signaling data from the sender. Exemplarily, the receiver receives the signaling data sent by the sender through the instant messaging channel.

[0055] Step S20, parsing the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of the signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command;

[0056] It should be noted that since the signaling protocol is in JSON string format (key-value pairs), it is easy to read and write, and also easy to parse and generate. Therefore, by parsing the signaling data in JSON string format, the signaling parameters in the signaling data can be obtained. The signaling parameters are elements that define communication control behaviors, representing the intention and execution details; including: the signaling type identifies the number of receiving ends and clarifies the message distribution mode (unicast or multicast); the signaling command identifier identifies a specific signaling command and indicates the operation to be performed; the signaling protocol version defines the data format and decoding rules to ensure version compatibility; the signaling detailed data contains all the information required to execute the signaling command, such as operating parameters and execution conditions.

[0057] In one embodiment, after step S20, steps A10 to A20 are included:

[0058] Step A10, when it is identified that the triggering operation of the signaling command identifier is data change, the change command content is obtained from the data change type field in the signaling detailed data;

[0059] It should be noted that when the trigger operation of the signaling command identifier is identified as data change, that is, when cmd_id is call_param_change, it means that someone has initiated a data change in the meeting. At this time, the electronic device will obtain the change command content from the data change type field in the signaling detailed data, where the change command content includes: change_to_voice_invite (switch to voice), record_change_info (watermark information change), begin_record (start recording), stop_record (stop recording), begin_share (start sharing), stop_share (stop sharing), begin_TTS (start voice broadcast), stop_TTS (stop voice broadcast), begin_play (start cloud playback), stop_share (stop cloud playback), attendee_info (attendee information change).

[0060] Step A20, triggering the change operation in the audio or video call based on the change command content.

[0061] It should be noted that according to the content of the change command, the change operations in the audio and video call are triggered, such as starting and stopping recording, starting and stopping TTS voice broadcast, starting and stopping the cloud player, starting and stopping face verification, changing participant information, updating watermarks, etc., thereby supporting operations for thousands of people in the meeting.

[0062] In this embodiment, the data change operation triggered by the signaling command identifier is identified, and various variable situations occurring in the audio and video call can be responded to immediately, such as changing the participant information, updating the watermark, etc. By identifying and processing specific change types, refined audio and video call management can be achieved to meet personalized needs. The timely execution of the change command content ensures the timeliness of the operation response, reduces the waiting time, and effectively improves the service level of the audio and video call.

[0063] Step S30, triggering a preparation operation for establishing an audio or video call according to the signaling parameter, and sending first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call;

[0064] It should be noted that the preparatory operation for establishing an audio and video call is a prerequisite for starting the audio and video call, such as resource allocation. The first confirmation data is the confirmation information that the receiving end feeds back to the sending end that it has received and understood the signaling parameters, indicating that the receiving end is ready to enter the audio and video call state.

[0065] Step S40: after receiving the second confirmation data fed back by the sending end according to the first confirmation data, establish an audio and video call with the sending end.

[0066] It should be noted that the second confirmation data is a response from the sender after receiving the first confirmation data, confirming that both parties can continue to establish the audio and video call. After the audio and video call is established, the sender and the receiver trigger the corresponding in-conference command operation according to the signaling parameters carried in the confirmation data.

[0067] In this embodiment, the signaling data encapsulated by the sending end according to the signaling protocol is received, the signaling data is parsed, key signaling parameters are extracted from it, and the preparation for establishing an audio and video call is triggered. At the same time, the first confirmation data is fed back to the sending end, indicating that the receiving end is ready and the process of establishing the audio and video call can be started. When the receiving end successfully sends the first confirmation data and receives the second confirmation data from the sending end, both parties confirm that they are ready, and the audio and video call can be formally established at this time. By encapsulating in accordance with a unified signaling protocol, the standardization and compatibility of data transmission are ensured. By interpreting these signaling data, the receiving end can perform corresponding communication control actions, ensuring the accurate transmission and execution of communication control instructions; the two-way confirmation mechanism ensures that the preparation before the call is sufficient and the status of both parties is consistent, laying the foundation for high-quality audio and video calls, and reflecting the importance of synchronization and coordination in audio and video calls.

[0068] In another embodiment, the signaling detailed data includes an outgoing user ID and an incoming user ID, wherein the outgoing user ID and the incoming user ID use existing user IDs in the audio and video call system that applies the signaling protocol.

[0069] It should be noted that the outgoing user ID is the identity identification mark of the party that initiates the audio and video call request, and the incoming user ID is the identification mark of the party that receives the audio and video call request; compared with the prior art that requires the establishment of a mapping relationship between the first user ID of the audio and video call system and the second user ID of the developed audio and video call system, the outgoing user ID and the incoming user ID of this application are both identifiers in the audio and video call system that uses the signaling protocol, and can be used directly. For example, the user name and avatar of the company's internal address book can be directly displayed when the caller ID is displayed; there is no need to check the mapping table to know the specific user name.

[0070] In this embodiment, the signaling detailed data includes the outgoing user identification and the incoming user identification, and adopts the established user identification system in the audio and video call system under the signaling protocol. By reusing the existing user identification, it is possible to quickly and accurately match the two parties of the call, and promote the rapid establishment of the audio and video call, which not only improves the communication efficiency, but also enhances the interoperability of audio and video calls and the convenience of user management.

[0071] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the first embodiment can refer to the above introduction, and will not be repeated in the following. Figure 4, applied to the receiving end, the audio and video call method based on the signaling protocol includes steps D10 to D30:

[0072] Step D10, obtaining communication data of the application layer;

[0073] It should be noted that the application layer is the top layer of the communication protocol stack, which directly provides services to users and processes data generated by applications, such as audio and video. The information content of communication data transmitted in the application layer includes but is not limited to messages, requests, and responses.

[0074] Step D20, encapsulating the communication data based on the signaling protocol to obtain signaling data;

[0075] It should be noted that the application layer data is packaged according to the format of the signaling protocol, and necessary control information is added. The encapsulated communication data is accompanied by control information for knowing that the receiving end has established an audio or video call.

[0076] Step D30, sending the signaling data to the receiving end.

[0077] It should be noted that the signaling data is sent to the receiving end. Exemplarily, the sending end sends the signaling data to the receiving end through an instant messaging channel.

[0078] In this embodiment, the communication data of the application layer is obtained, the communication data is encapsulated based on the signaling protocol, and the signaling data is sent to the receiving end; the original application layer data is encapsulated according to the signaling protocol format, and the necessary control and identification information (i.e., signaling parameters) is added to ensure the orderly and efficient transmission of the control information, realize the actual flow of data, and connect the sending end and the receiving end in the audio and video call.

[0079] In one embodiment, the audio and video call method based on the signaling protocol includes:

[0080] After receiving the first confirmation data from the receiving end, second confirmation data is sent to the receiving end to indicate that the sending end is ready to establish an audio and video call.

[0081] It should be noted that the first confirmation data is the data sent back by the receiving end, indicating that it has received and processed the request from the sending end; the second confirmation data is the response sent by the sending end to the receiving end after receiving the first confirmation data, indicating that it is also ready to start the audio and video call.

[0082] In this embodiment, during an audio or video call, after the sending end receives the first confirmation data from the receiving end, it confirms that the other party is ready, and then sends the second confirmation data to clearly express that it is also ready to establish the audio or video call. This two-way confirmation mechanism ensures that both parties of the call are in a synchronized state, avoiding the situation where one party is ready while the other party is not ready, thereby ensuring the smooth start and efficient conduct of the call, and enhancing the security and reliability of communication. Through this series of confirmation operations, both parties can be sure of the other party's readiness, and then enter the call stage together, achieving a smoother and more coordinated audio and video call experience.

[0083] For example, in order to help understand the implementation process of the audio and video call method based on the signaling protocol obtained by combining this embodiment with the above-mentioned first embodiment, please refer to Figure 5 , Figure 5 A brief flow chart of an audio and video call method based on a signaling protocol is provided, specifically: when a sending end initiates a call, call signaling data is sent to a receiving end through an instant messaging channel, wherein the receiving end is one or more parties; the receiving end receives the call signaling data through the instant messaging channel, parses the signaling data, obtains signaling parameters, performs corresponding operations, and sends first confirmation data to the receiving end to indicate that the audio and video call is ready; after the sending end receives the first confirmation data, it is displayed that the other party has rung, and the receiving end is ready to answer the audio and video call; then, the receiving end sends answering signaling data to the sending end, and after the sending end receives the answering signaling data, the audio and video call is started; second confirmation data is sent to the receiving end, and after the receiving end receives the second confirmation data, the receiving end joins the audio and video call and successfully establishes an audio and video call with the sending end.

[0084] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the audio and video call method based on the signaling protocol of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0085] The present application also provides an audio and video call device based on a signaling protocol for use at a receiving end, please refer to Figure 6 , the audio and video call device based on the signaling protocol applied to the receiving end includes:

[0086] The receiving module 10 is used to receive signaling data sent by the sending end, wherein the signaling data is encapsulated by the sending end based on the signaling protocol;

[0087] A parsing module 20, configured to parse the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of a signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command;

[0088] A confirmation module 30, configured to trigger a preparation operation for establishing an audio or video call according to the signaling parameters, and to send first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call;

[0089] The establishing module 40 is used to establish an audio and video call with the sending end after receiving the second confirmation data fed back by the sending end according to the first confirmation data.

[0090] Optionally, the parsing module 20 is further configured to obtain the change command content from the data change type field in the signaling detailed data when identifying that the triggering operation of the signaling command identifier is a data change;

[0091] The change command content triggers the execution of the change operation in the audio and video call.

[0092] The audio and video call device based on the signaling protocol applied to the receiving end includes: the signaling detailed data includes an outgoing user identifier and an incoming user identifier, wherein the outgoing user identifier and the incoming user identifier use the existing user identifiers in the audio and video call system applying the signaling protocol.

[0093] The present application also provides an audio and video call device based on a signaling protocol for use at a transmitting end, please refer to Figure 7 , the audio and video call device based on the signaling protocol applied to the sending end includes:

[0094] An acquisition module 50, used to acquire communication data of the application layer;

[0095] The encapsulation module 60 is used to encapsulate the communication data based on the signaling protocol to obtain signaling data;

[0096] The sending module 70 is used to send the signaling data to the receiving end.

[0097] The signaling protocol-based audio and video call device applied to the sending end includes: after receiving the first confirmation data of the receiving end, sending the second confirmation data used to indicate that the sending end is ready to establish the audio and video call to the receiving end.

[0098] The audio and video call device based on the signaling protocol provided by the present application adopts the audio and video call method based on the signaling protocol in the above embodiment, which can solve the technical problem that the use scenarios of audio and video calls are limited. Compared with the prior art, the beneficial effects of the audio and video call device based on the signaling protocol provided by the present application are the same as the beneficial effects of the audio and video call method based on the signaling protocol provided by the above embodiment, and the other technical features of the audio and video call device based on the signaling protocol are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0099] The present application provides an audio and video call device based on a signaling protocol, and the audio and video call device based on a signaling protocol includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the audio and video call method based on the signaling protocol in the above-mentioned first embodiment.

[0100] Reference below Figure 8 , which shows a schematic diagram of the structure of an audio and video call device based on a signaling protocol suitable for implementing an embodiment of the present application. The audio and video call device based on a signaling protocol in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The audio and video call device based on the signaling protocol shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0101] like Figure 8As shown, the audio and video call device based on the signaling protocol may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM: Read Only Memory) 1002 or the program loaded from the storage device 1003 to the random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the audio and video call device based on the signaling protocol are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 can allow the audio and video call device based on the signaling protocol to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an audio and video call device based on the signaling protocol with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0102] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0103] The audio and video call device based on the signaling protocol provided by the present application adopts the audio and video call method based on the signaling protocol in the above embodiment, which can solve the technical problem that the use scenarios of audio and video calls are limited. Compared with the prior art, the beneficial effects of the audio and video call device based on the signaling protocol provided by the present application are the same as the beneficial effects of the audio and video call method based on the signaling protocol provided by the above embodiment, and the other technical features of the audio and video call device based on the signaling protocol are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0104] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0105] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0106] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the audio and video call method based on the signaling protocol in the above-mentioned embodiment.

[0107] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0108] The above-mentioned computer-readable storage medium may be included in the audio and video call device based on the signaling protocol; or it may exist independently without being assembled into the audio and video call device based on the signaling protocol.

[0109] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the audio and video call device based on the signaling protocol, the audio and video call device based on the signaling protocol: the receiving end receives the signaling data sent by the sending end, wherein the signaling data is encapsulated by the sending end based on the signaling protocol; parses the signaling data to obtain the signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying the triggering operation of the signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command; triggers the preparation operation for establishing an audio and video call according to the signaling parameters, and sends the first confirmation data to the sending end to indicate that the receiving end is ready to establish an audio and video call; after receiving the second confirmation data fed back by the sending end according to the first confirmation data, establishes an audio and video call with the sending end; the sending end obtains the communication data of the application layer; encapsulates the communication data based on the signaling protocol to obtain the signaling data; and sends the signaling data to the receiving end.

[0110] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0111] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0113] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned audio and video call method based on the signaling protocol, and can solve the technical problem that the use scenarios of audio and video calls are limited. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the audio and video call method based on the signaling protocol provided by the above-mentioned embodiment, and will not be repeated here.

[0114] The present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the above-mentioned audio and video call method based on the signaling protocol.

[0115] The computer program product provided by the present application can solve the technical problem that the use scenarios of audio and video calls are limited. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the audio and video call method based on the signaling protocol provided in the above embodiment, which will not be repeated here.

[0116] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. An audio and video call method based on a signaling protocol, characterized in that: Applied to the receiving end, the audio and video call method based on the signaling protocol includes: Receiving signaling data sent by a sending end, wherein the signaling data is encapsulated by the sending end based on a signaling protocol; Parsing the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of a signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command; Triggering a preparation operation for establishing an audio or video call according to the signaling parameter, and sending first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call; After receiving the second confirmation data fed back by the sending end according to the first confirmation data, an audio and video call is established with the sending end.

2. The audio and video call method based on the signaling protocol as claimed in claim 1, characterized in that: The signaling detailed data includes an outgoing user ID and an incoming user ID, wherein the outgoing user ID and the incoming user ID use the existing user IDs in the audio and video call system that applies the signaling protocol.

3. The audio and video call method based on the signaling protocol as claimed in claim 1, characterized in that: After the step of parsing the signaling data to obtain the signaling parameters in the signaling data, the method further comprises: When it is identified that the triggering operation of the signaling command identifier is a data change, the change command content is obtained from the data change type field in the signaling detailed data; The change command content triggers the execution of the change operation in the audio and video call.

4. An audio and video call method based on a signaling protocol, characterized in that: Applied to the sending end, the method includes: Get communication data of application layer; Encapsulating the communication data based on a signaling protocol to obtain signaling data; The signaling data is sent to a receiving end.

5. The audio and video call method based on the signaling protocol as claimed in claim 4, characterized in that: The method further comprises: After receiving the first confirmation data from the receiving end, second confirmation data is sent to the receiving end to indicate that the sending end is ready to establish an audio and video call.

6. An audio and video communication device based on a signaling protocol, characterized in that: Applied to the receiving end, the audio and video communication device based on the signaling protocol includes: A receiving module, used to receive signaling data sent by a sending end, wherein the signaling data is encapsulated by the sending end based on a signaling protocol; A parsing module, used to parse the signaling data to obtain signaling parameters in the signaling data, wherein the signaling parameters include a signaling type for identifying the number of receiving ends as one or more, a signaling command identifier for identifying a triggering operation of a signaling command, a signaling protocol version, and signaling detailed data required to execute the signaling command; A confirmation module, used to trigger a preparation operation for establishing an audio or video call according to the signaling parameter, and send first confirmation data to the sending end to indicate that the receiving end is ready to establish the audio or video call; An establishing module is used to establish an audio and video call with the sending end after receiving the second confirmation data fed back by the sending end according to the first confirmation data.

7. An audio and video communication device based on a signaling protocol, characterized in that: Applied to the transmitting end, the audio and video communication device based on the signaling protocol includes: An acquisition module, used to acquire communication data of the application layer; An encapsulation module, used to encapsulate the communication data based on a signaling protocol to obtain signaling data; The sending module is used to send the signaling data to the receiving end.

8. An audio and video call device based on a signaling protocol, characterized in that: The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio and video call method based on the signaling protocol as described in any one of claims 1 to 3, and / or claims 4 to 5.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the audio and video call method based on the signaling protocol as described in any one of claims 1 to 3 and / or claims 4 to 5 are implemented.

10. A computer program product, characterized in that The computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the audio and video call method based on the signaling protocol as described in any one of claims 1 to 3 and / or claims 4 to 5 are implemented.

Images