Conference control method, apparatus, device, and storage medium
Patent Information
- Application Number
- CN202310003608.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-01-03
- Publication Date
- 2026-11-03
- Estimated Expiration
- 2043-01-03
AI Technical Summary
Existing video conferencing systems offer a poor experience for rapid communication within and between homes, and multi-party video conferencing platforms on carrier networks consume significant resources, making large-scale commercial use impossible. Furthermore, internet vendors' systems cannot interoperate with carrier networks.
By encapsulating DTMF information into protocols, the target control protocol and control commands can be obtained, enabling control over target meeting members. This method is compatible with various mobile terminals and reduces server resource consumption.
It enables multi-party conferencing calls without compromising network performance, is compatible with various mobile terminals, ensures that multi-party video calls under the IMS core network can run on mobile devices, and reduces server resource consumption.
Smart Images

Figure CN116938617B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communication technology, and includes, but is not limited to, a conference control method, apparatus, device, and storage medium. Background Technology
[0002] With the development of internet information technology and the influence of the current environment, video conferencing has gradually become a new trend. Conferencing systems are an important tool for remote work and emotional communication. In practical applications, most people are using conferencing systems more frequently, and at the same time, their requirements for the performance and functionality of these systems are also increasing.
[0003] In related technologies, some internet companies have developed video conferencing systems based on proprietary protocols for meeting communication. Typically, users need to download a specific application to communicate or interact, which results in a poor experience for rapid communication between family members or between families. While current network operator solutions allow meetings to be initiated via mobile phones or other terminals without downloading an application, most meetings are audio-based, with only a portion being multi-party video conferences. These conferences utilize a platform MCU screen merging method, where participants push streams to the platform, which then merges the multi-party video feeds and pushes the merged meeting screen to each participant. Summary of the Invention
[0004] Based on the problems in related technologies, embodiments of this application provide a conference control method, apparatus, device, and storage medium.
[0005] The technical solution of this application embodiment is implemented as follows:
[0006] This application provides a conference control method, the method comprising:
[0007] In response to a conference control request sent by the terminal, a control protocol encapsulation request is triggered; the conference control request carries DTMF information; in response to the control protocol encapsulation request, protocol encapsulation is performed based on the DTMF information to obtain a target control protocol; target control information corresponding to the DTMF information is obtained, the target control information carrying target control instructions corresponding to the DTMF information; target conference member information is obtained based on the target control protocol; based on the functional requirements corresponding to the target control information, the target control instructions are executed on the target conference members corresponding to the target conference member information.
[0008] This application provides a conference control device, the device comprising:
[0009] The triggering module is used to respond to a conference control request sent by the terminal and trigger a control protocol encapsulation request; the conference control request carries DTMF information.
[0010] The encapsulation module is used to encapsulate the protocol based on the DTMF information in response to the control protocol encapsulation request, so as to obtain the target control protocol;
[0011] The acquisition module is used to acquire target control information corresponding to the DTMF information, wherein the target control information carries target control instructions corresponding to the DTMF information;
[0012] The determination module is used to determine the target meeting member information based on the target control protocol;
[0013] The execution module is used to execute the target control instructions on the target meeting members corresponding to the target meeting member information in the current meeting, based on the functional requirements corresponding to the target control information.
[0014] In some embodiments, the conference control request includes digital signals and DTMF commands;
[0015] The triggering module is further configured to perform signal stripping processing on the digital signals in the conference control request to obtain the DTMF instruction; parse the signaling field in the DTMF instruction to obtain the DTMF information; and trigger the control protocol encapsulation request based on the DTMF information.
[0016] In some embodiments, the control protocol encapsulation request includes a meeting member identifier;
[0017] The encapsulation module is further configured to parse the meeting member identifier in the control protocol encapsulation request to obtain a meeting ID; obtain the current operation sequence corresponding to the meeting ID; perform increment processing on the current operation sequence to obtain a target operation sequence; encrypt the target operation sequence, the DTMF information, and the meeting ID to obtain a verification field; and encapsulate the target operation sequence, the DTMF information, the meeting ID, and the verification field to obtain the target control protocol.
[0018] In some embodiments, the determining module is further configured to parse the target control protocol to obtain a verification field corresponding to the target control protocol; perform security verification on the verification field to obtain a verification result; and when the verification result is a successful verification, determine the target meeting member information based on the meeting ID.
[0019] In some embodiments, the apparatus further includes:
[0020] The comparison module is used to decrypt the verification field to obtain the target operation sequence corresponding to the meeting ID in the target control protocol; compare the target operation sequence with the current operation sequence to obtain the comparison result; when the comparison result meets the preset comparison conditions, the target control instruction is executed on the target meeting member corresponding to the target meeting member information in the current meeting based on the functional requirements corresponding to the target control information.
[0021] In some embodiments, the apparatus further includes:
[0022] The display module is used to receive the RTP packet corresponding to the execution result sent by the communication platform; in response to the RTP packet, the RTP packet is decoded and rendered sequentially to display the display effect corresponding to the conference control request.
[0023] In some embodiments, the apparatus further includes:
[0024] The access module is used to receive a meeting entry request initiated by an IMS user; the meeting entry request carries a meeting ID; and based on the meeting ID, the IMS user is connected to the current meeting.
[0025] This application provides a conference control device, including: a memory for storing executable instructions; and a processor for executing the executable instructions stored in the memory to implement the above-described conference control method.
[0026] This application provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implement the aforementioned conference control method.
[0027] The conference control method, apparatus, device, and storage medium provided in this application first respond to a conference control request sent by a terminal, triggering a control protocol encapsulation request. Then, in response to the control protocol encapsulation request, protocol encapsulation is performed based on the DTMF information in the conference control request to obtain a target control protocol. Next, target control information corresponding to the DTMF information is obtained, and the target control information carries target control instructions corresponding to the DTMF information. Target conference member information is obtained based on the target control protocol. Finally, based on the functional requirements corresponding to the target control information, target control instructions are executed on the target conference members corresponding to the target conference member information. Thus, this application embodiment encapsulates the target control protocol based on the DTMF information in the conference control request to obtain the target control protocol; based on the target control protocol, target conference member information and target control instructions are obtained; and then, based on the functional requirements corresponding to the target control information, target control instructions are executed on the target conference members corresponding to the target conference member information. This allows for compatibility with multiple mobile terminals without compromising the network performance of the current network operator, enabling multi-party conference calls and the function of controlling the video of participating parties through DTMF information. This ensures that multi-party video calls under the IMS core network can run on mobile devices, reducing server resource consumption. Attached Figure Description
[0028] Figure 1 This is a schematic diagram of the structure of the conference control system provided in the embodiments of this application;
[0029] Figure 2 This is a schematic flowchart of a meeting control method provided in an embodiment of this application;
[0030] Figure 3 This is another schematic flowchart of the meeting control method provided in the embodiments of this application;
[0031] Figure 4 This is a schematic diagram of the architecture of the conference control system provided in an embodiment of this application;
[0032] Figure 5 This is a flowchart illustrating the protocol transfer method provided in an embodiment of this application;
[0033] Figure 6 This is another schematic flowchart of the meeting control method provided in the embodiments of this application;
[0034] Figure 7 This is a schematic diagram of a conference video frame provided in an embodiment of this application;
[0035] Figure 8 This is a schematic diagram of a mobile phone dial pad provided in an embodiment of this application;
[0036] Figure 9This is a schematic diagram illustrating the display effect provided in the embodiments of this application;
[0037] Figure 10 A schematic diagram of the composition structure of the conference control device provided in the embodiments of this application;
[0038] Figure 11 This is a schematic diagram of the composition structure of the conference control device provided in the embodiments of this application. Detailed Implementation
[0039] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0040] In the following description, references to "some embodiments" refer to a subset of all possible embodiments. However, it is understood that "some embodiments" may be the same or different subsets of all possible embodiments and may be combined with each other without conflict. Unless otherwise defined, all technical and scientific terms used in the embodiments of this application have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiments of this application pertain. The terminology used in the embodiments of this application is for the purpose of describing the embodiments of this application only and is not intended to limit the application.
[0041] Here, we will first explain the technical terms involved in the embodiments of this application.
[0042] (1) IP Multimedia Subsystem (IMS): Composed of all functional entities capable of providing multimedia services, including a collection of functional entities related to signaling and bearer. IP multimedia services are implemented using packet-switched domains and multimedia bearers, based on session control capabilities defined by the Internet Engineering Task Force (IETF). The IP Multimedia Subsystem enables operators to provide their users with multimedia services based on Internet applications, services, and protocols.
[0043] (2) Dual Tone Multi Frequency (DTMF) is a type of user signaling between a telephone and an exchange in a telephone system, and is usually used to send the called number.
[0044] (3) The Multi Control Unit (MCU) is actually a multimedia information exchange used for multi-point calling and connection, realizing functions such as video broadcasting, video selection, audio mixing, and data broadcasting, and completing the aggregation and switching of signals from various terminals. The difference between the MCU and the existing switch is that the switch completes the point-to-point connection of signals, while the MCU completes the multi-point switching, aggregation, or broadcasting.
[0045] (4) Real-time Transport Protocol (RTP) is a network transport protocol that provides end-to-end data transmission services with real-time characteristics, such as interactive video and audio or analog data under multicast or unicast network services.
[0046] In related technologies, although the conferencing systems of Internet companies have good operability and interactivity, the entire conferencing platform is based on proprietary protocols, which often require downloading related conferencing applications, and they cannot communicate with each other.
[0047] However, the MCU-based screen merging method used in telecom operator conferencing systems consumes significant platform resources, and the conferencing control requires platform participation, resulting in complex interactions. The conferencing platform needs to understand user intent and render the screen during merging, leading to latency and hindering large-scale commercial deployment. For example, the common practice among operators is 4-way mixing, where four (480P resolution) user feeds are pushed to the platform, which then re-renders them into a single large image and compresses it to 480P before sending it to other terminal users. While some large internet companies' approaches can enable terminal live streaming or video streaming subscriptions, they cannot interoperate with telecom operator networks due to protocol limitations, preventing the widespread adoption of video conferencing functionality across telecom operator networks.
[0048] To address at least one of the aforementioned problems in related technologies, this application provides a conference control method. First, in response to a conference control request sent by a terminal, a control protocol encapsulation request is triggered. Then, in response to the control protocol encapsulation request, protocol encapsulation is performed based on the DTMF information in the conference control request to obtain a target control protocol. Next, target control information corresponding to the DTMF information is obtained, and the target control information carries target control instructions corresponding to the DTMF information. Target conference member information is obtained based on the target control protocol. Finally, based on the functional requirements corresponding to the target control information, target control instructions are executed on the target conference members corresponding to the target conference member information. Thus, this application embodiment encapsulates the target control protocol based on the DTMF information in the conference control request to obtain the target control protocol; based on the target control protocol, target conference member information and target control instructions are obtained; and then, based on the functional requirements corresponding to the target control information, target control instructions are executed on the target conference members corresponding to the target conference member information. This method can achieve compatibility with multiple mobile terminals without compromising the network performance of the current network operator, enabling multi-party conference calls and the function of controlling the video of participating parties through DTMF information. It ensures that multi-party video calls under the IMS core network can run on mobile devices, reducing server resource consumption.
[0049] The following describes exemplary applications of the conference control device according to embodiments of this application. The conference control device provided in this application can be implemented as a terminal or as a server. In one implementation, the conference control device provided in this application can be implemented as various types of terminals such as laptops, tablets, desktop computers, and mobile devices; in another implementation, the conference control device provided in this application can also be implemented as a server. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal and server can be directly or indirectly connected via wired or wireless communication, and this application does not impose any limitations. The following will describe exemplary applications when the conference control device is implemented as a server.
[0050] See Figure 1 , Figure 1This is a schematic diagram of the conference control system provided in an embodiment of this application. To achieve conference control over target conference members, this embodiment of the application can provide a conference control platform, which can be implemented as a conference control application. The conference control system 10 provided in this embodiment of the application includes a terminal 100, a network 200, and a server 300, wherein the server 300 is the server for the conference control application. The terminal 100 is connected to the server 300 through the network 200, which can be a wide area network (WAN), a local area network (LAN), or a combination of both.
[0051] In some embodiments, please refer to Figure 1 During conference control, terminal 100 initiates a conference control request, which is sent to server 300 via network 200. In response to the conference control request, server 300 triggers a control protocol encapsulation request, where the conference control request carries DTMF information. In response to the control protocol encapsulation request, it encapsulates the protocol based on the DTMF information to obtain the target control protocol. Then, it obtains the target control information corresponding to the DTMF information, which carries the target control instructions corresponding to the DTMF information. Next, it determines the target conference member information based on the target control protocol. Finally, based on the functional requirements corresponding to the target control information, it executes the target control instructions on the target conference members corresponding to the target conference member information in the current conference.
[0052] In some embodiments, after executing target control instructions on target meeting members, server 300 obtains the execution result of the target control instructions. Server 300 can then send the execution result to terminal 100 via network 200, thereby realizing control over the meeting.
[0053] This application provides a conference control method that can be executed by a server. See also... Figure 2 , Figure 2 This is a flowchart illustrating the meeting control method provided in the embodiments of this application, which will be combined with... Figure 2 The steps shown are explained.
[0054] Step S201: In response to the conference control request sent by the terminal, a control protocol encapsulation request is triggered.
[0055] Here, the conference control request carries DTMF information.
[0056] In some embodiments, the terminal may be any terminal with conferencing communication capabilities, such as a mobile device (e.g., mobile phone, satellite phone, portable music player, personal digital assistant, dedicated messaging device, portable gaming device), laptop computer, tablet computer, desktop computer, and smartwatch.
[0057] In some embodiments, during a multi-party conference, any member can perform conference control operations, i.e., control the current conference. In one embodiment, the DTMF information carried in the conference control request can be used to indicate operations such as muting all participants, prohibiting a user from speaking, or prohibiting a user from participating in the current conference.
[0058] In some embodiments, a meeting control request is used to request the server to perform meeting operations on the current meeting. For example, a meeting control request could be a request to zoom in on the meeting video of meeting member A; a meeting control request could be a request to mute the meeting call of meeting member B; a meeting control request could be a request to remove meeting member C from the current meeting. That is to say, a meeting control request can be any meeting control request, and this application embodiment does not specifically limit it.
[0059] In practical applications, it can be stipulated that during a multi-party conference, a participant can control the conference by pressing any key on the dial pad, thus triggering a control protocol encapsulation request. For example, pressing the "4" key could switch the video feed, and pressing the "6" key could mute the participants from the conference video feed.
[0060] Step S202: In response to the control protocol encapsulation request, the protocol is encapsulated based on the DTMF information to obtain the target control protocol.
[0061] In some embodiments, the control protocol encapsulation request is used to request the server to encapsulate DTMF information into a control protocol.
[0062] In this embodiment of the application, when the server receives a control protocol encapsulation request, the server responds to the control protocol encapsulation request, performs protocol encapsulation based on DTMF information, and obtains the target control protocol.
[0063] Step S203: Obtain target control information corresponding to the DTMF information, wherein the target control information carries target control instructions corresponding to the DTMF information.
[0064] In this embodiment of the application, after security verification, the server can directly obtain the target control information corresponding to the DTMF information according to the target control protocol, so as to obtain the target control instruction corresponding to the DTMF information.
[0065] Step S204: Determine the target meeting member information based on the target control protocol.
[0066] In some embodiments, the target meeting member information may include the number of target meeting members and the target meeting member number.
[0067] Step S205: Based on the functional requirements corresponding to the target control information, execute the target control instruction on the target meeting member corresponding to the target meeting member information in the current meeting.
[0068] The method of this application embodiment can be applied to at least the following scenarios: When IMS user A is in the current meeting and needs to switch the meeting screen for IMS user B, IMS user A can input a meeting control request about "switching screens" to the terminal through the IMS core network. The terminal sends the meeting control request about "switching screens" to the server. In response to the received meeting control request, the server triggers a control protocol encapsulation request. At this time, in response to the control protocol encapsulation request, the server encapsulates the protocol based on the DTMF information carried in the meeting control request to obtain the target control request. Then, it obtains the target control information corresponding to the DTMF information. Then, it determines the target meeting member information based on the target control protocol. Finally, based on the functional requirements corresponding to the target control information, it executes the target control instruction on the target meeting member corresponding to the target meeting member information in the current meeting.
[0069] Therefore, the conference control method provided in this application first responds to a conference control request sent by a terminal by triggering a control protocol encapsulation request; then, in response to the control protocol encapsulation request, it encapsulates the protocol based on the DTMF information in the conference control request to obtain a target control protocol; then, it obtains target control information corresponding to the DTMF information, which carries target control instructions corresponding to the DTMF information; it obtains target conference member information based on the target control protocol; and finally, based on the functional requirements corresponding to the target control information, it executes target control instructions on the target conference members corresponding to the target conference member information. Thus, this application embodiment encapsulates the protocol based on the DTMF information in the conference control request to obtain the target control protocol; based on the target control protocol, it obtains target conference member information and target control instructions; and then, based on the functional requirements corresponding to the target control information, it executes target control instructions on the target conference members corresponding to the target conference member information. This allows for compatibility with multiple mobile terminals without compromising the network performance of the current network operator, enabling multi-party conference calls and the function of controlling the video of participating parties through DTMF information. This ensures that multi-party video calls under the IMS core network can run on mobile devices and reduces server resource consumption.
[0070] In some embodiments, the server may also have cloud storage, where the encapsulated target control protocol can be stored.
[0071] In some embodiments, after step S205 is performed, the following may also be performed: First, receive the RTP packet corresponding to the execution result of the target control instruction. Then, in response to the RTP packet, decode and render the RTP packet sequentially to display the display effect corresponding to the conference control request.
[0072] In some embodiments, a control protocol encapsulation request can be triggered based on DTMF information. Based on the foregoing embodiments, this application provides a conference control method that can be applied to a conference control system, which may include: an instruction parsing platform, a conference control platform, a service platform, and a communication platform. Figure 3 This is another flowchart illustrating the meeting control method provided in the embodiments of this application, such as... Figure 3 As shown, the meeting control method includes the following steps:
[0073] Step S301: The communication platform receives a membership request initiated by an IMS user.
[0074] Here, the meeting ID is included in the membership request.
[0075] In some embodiments, an IMS user can initiate a meeting request when the current meeting is not in session, so that the IMS user can join the current meeting based on the meeting ID carried in the meeting request.
[0076] In step S302, the communication platform connects the IMS user to the current meeting based on the meeting ID.
[0077] Step S303: The communication platform receives a conference control request sent by the terminal.
[0078] Here, the conference control request includes digital signals and DTMF commands.
[0079] In some embodiments, an IMS user can initiate a meeting control request while the current meeting is in progress. Here, meeting control could include switching the current meeting screen, muting IMS user A, zooming in on IMS user B's meeting screen, or removing IMS user C from the current meeting. Of course, meeting control can be any control operation, and this application embodiment does not specifically limit it.
[0080] In step S304, the communication platform responds to the conference control request by performing signal stripping processing on the digital signals in the conference control request to obtain DTMF instructions.
[0081] In some embodiments, signal stripping refers to stripping the key presses carried in the digital signal to obtain the DTMF command corresponding to the digital signal. Here, the digital signal is transmitted from the terminal to the communication platform through the IMS core network.
[0082] In step S305, the communication platform sends the DTMF command to the command parsing platform.
[0083] Step S306: The instruction parsing platform parses the signaling fields in the DTMF instruction to obtain DTMF information.
[0084] In step S307, the instruction parsing platform triggers a control protocol encapsulation request based on DTMF information.
[0085] In step S308, the instruction parsing platform parses the meeting member identifier in the control protocol encapsulation request to obtain the meeting ID.
[0086] Here, the control protocol encapsulation request includes the meeting member identifier.
[0087] Step S309: The instruction parsing platform obtains the current operation sequence corresponding to the meeting ID.
[0088] In some embodiments, the instruction parsing platform can obtain the current operation sequence corresponding to the current meeting ID from the instruction parsing platform's memory.
[0089] In step S310, the instruction parsing platform performs value-added processing on the current operation sequence to obtain the target operation sequence.
[0090] In some embodiments, incrementing the value refers to adding a preset value to the value corresponding to the current operation sequence. Here, the preset value is 1, meaning that the instruction parsing platform increments the value corresponding to the acquired current operation sequence by 1 to obtain the target operation sequence, and then stores the target operation sequence in the instruction parsing platform's memory.
[0091] In step S311, the instruction parsing platform encrypts the target operation sequence, DTMF information, and meeting ID to obtain the verification field.
[0092] In some embodiments, encryption processing refers to using an encryption algorithm to encrypt the currently transmitted data during data transmission, thereby encrypting the currently transmitted data into encrypted data to improve the security of data transmission.
[0093] In some embodiments, the encryption algorithm may be the SM9 algorithm, AES algorithm, RSA algorithm, and Twofish algorithm. The preset encryption algorithm may also be any combination of the SM9 algorithm, AES algorithm, RSA algorithm, and Twofish algorithm.
[0094] In step S312, the instruction parsing platform encapsulates the target operation sequence, DTMF information, meeting ID, and verification field into a protocol to obtain the target control protocol.
[0095] In step S313, the instruction parsing platform sends the target control protocol to the conference control platform.
[0096] In step S314, the conference control platform responds to the target control protocol by parsing the target control protocol to obtain the verification field corresponding to the target control protocol.
[0097] In step S315, the conference control platform performs security verification on the verification field and obtains the verification result.
[0098] Step S316: When the verification result is successful, the meeting control platform determines the target meeting member information based on the meeting ID.
[0099] In step S317, the conference control platform decrypts the verification field to obtain the target operation sequence corresponding to the conference ID in the target control protocol.
[0100] In step S318, the conference control platform compares the target operation sequence with the current operation sequence to obtain the comparison result.
[0101] Step S319: When the comparison result meets the preset comparison conditions, the conference control platform executes the target control instruction on the target conference member corresponding to the target conference member information in the current conference based on the functional requirements corresponding to the target control information.
[0102] In some embodiments, the preset comparison condition is that the value corresponding to the target operation sequence and the value corresponding to the current operation sequence are adjacent values, and the value corresponding to the target operation sequence is greater than the value corresponding to the current operation sequence.
[0103] In other words, the meeting control platform can compare the target operation sequence corresponding to the current meeting ID with the current operation sequence to obtain the comparison result. Specifically, the meeting control platform determines that the comparison result meets the preset comparison conditions if the value corresponding to the target operation sequence and the value corresponding to the current operation sequence are adjacent values, and the value corresponding to the target operation sequence is greater than the value corresponding to the current operation sequence.
[0104] Therefore, the conference control method provided in this application first responds to a conference control request sent by a terminal by triggering a control protocol encapsulation request; then, in response to the control protocol encapsulation request, it encapsulates the protocol based on the DTMF information in the conference control request to obtain a target control protocol; then, it obtains target control information corresponding to the DTMF information, which carries target control instructions corresponding to the DTMF information; it obtains target conference member information based on the target control protocol; and finally, based on the functional requirements corresponding to the target control information, it executes target control instructions on the target conference members corresponding to the target conference member information. Thus, this application embodiment encapsulates the protocol based on the DTMF information in the conference control request to obtain the target control protocol; based on the target control protocol, it obtains target conference member information and target control instructions; and then, based on the functional requirements corresponding to the target control information, it executes target control instructions on the target conference members corresponding to the target conference member information. This allows for compatibility with multiple mobile terminals without compromising the network performance of the current network operator, enabling multi-party conference calls and the function of controlling the video of participating parties through DTMF information. This ensures that multi-party video calls under the IMS core network can run on mobile devices and reduces server resource consumption.
[0105] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.
[0106] This application provides a conference control method that, without compromising the performance of current operator networks, is compatible with currently available mobile phones, enables multi-party video calls, controls the current conference, and can interoperate with VoLTE networks and IMS core networks.
[0107] This application provides a conference control system architecture. Figure 4 This is a schematic diagram of the architecture of the conference control system according to an embodiment of this application, as shown below. Figure 4 As shown in the figure, the meeting terminal 410 based on the IMS network, the meeting terminal 420 based on the OTT network, the IMS core network 430, and the meeting control system 440 are shown respectively. The meeting control system 440 includes at least: a communication platform 450 (communication platform access terminal 451 and communication platform output terminal 452), a service platform 460, an instruction parsing platform 470, and a meeting control platform 480.
[0108] In some embodiments, a command parsing platform and a conference control platform can be added to a traditional operator's IMS network to form a conference control system architecture. The command parsing platform is used to parse the DTMF commands carried in the SIP protocol, convert the DTMF commands into digital signals, and encapsulate them into a custom control protocol (i.e., the target control protocol in the above embodiments). After encapsulation, the custom control protocol is sent to the conference control platform. At this time, the conference control platform can execute the corresponding target control commands according to the protocol content in the custom control protocol.
[0109] In practical applications, the SIP signaling packets transmitted in the traditional SIP protocol are too large. If they also carry a large amount of data, it can easily reduce the efficiency of conference control. This is because, firstly, there is a lot of invalid information, and secondly, SIP signaling requires a high bandwidth during transmission. Therefore, the embodiments of this application can provide an efficient control protocol that can bridge DTMF signals in operator-specific IMS networks with OTT network signals from Internet providers, and can achieve orderly and secure transmission of all signals.
[0110] In some embodiments, the target control protocol can consist of four protocol strings, as shown in Table 1, which is an example table of target control protocols. These four protocol strings are: header string, verification field string, numeric string, and conference ID string. Here, the header string stores the target operation sequence; this part is an auto-incrementing field used to indicate the order of DTMF signal reception. The verification field string is: a concatenation of a number, conference ID, and header string, then encrypted using MD5. The encrypted verification field is stored for data integrity verification. The numeric string represents the corresponding numeric keypad after DTMF information conversion, used to indicate the corresponding conference control operation. The conference ID string is used to control the corresponding conference to prevent conference control operation failure.
[0111] Table 1. Example Table of Target Control Protocols
[0112] Table Header Validation fields number Meeting ID
[0113] This application provides a protocol transfer method. Figure 5 This is a flowchart illustrating a protocol transfer method according to an embodiment of this application. The protocol transfer method is applied to a conference control system, which includes at least: a communication platform, an instruction parsing platform, and a conference control platform, such as... Figure 5 As shown, the protocol transfer method includes the following steps:
[0114] Step S501: The terminal receives the digital signal initiated by the user.
[0115] In step S502, the terminal responds to the digital signal and sends the digital signal to the communication platform through the IMS core network.
[0116] In step S503, the communication platform responds to the digital signal by performing signal stripping processing on the digital signal to obtain the DTMF command.
[0117] In step S504, the communication platform sends the DTMF instruction to the instruction parsing platform.
[0118] In step S505, the instruction parsing platform responds to the DTMF instruction by parsing the signaling fields in the DTMF instruction to obtain DTMF information.
[0119] In step S506, the instruction parsing platform performs protocol encapsulation requests based on DTMF information to obtain the target control protocol.
[0120] In some embodiments, step S506 can be implemented in the following ways:
[0121] First, the instruction parsing platform parses the meeting member identifier in the control protocol encapsulation request to obtain the meeting ID. For example, the meeting ID could be 10000081. Then, the instruction parsing platform obtains the current operation sequence corresponding to the meeting ID. Next, the instruction parsing platform increments the current operation sequence to obtain the target operation sequence. For example, the target operation sequence could be #89. Then, the instruction parsing platform encrypts the target operation sequence, DTMF information, and meeting ID to obtain a verification field. For example, the verification field could be 54f66ffce0c771. Finally, the instruction parsing platform encapsulates the target operation sequence, DTMF information, meeting ID, and verification field to obtain the target control protocol. For example, the target control protocol could be 89; 54f66ffce0c771; 4; 10000081.
[0122] In step S507, the instruction parsing platform sends the target control protocol to the conference control platform.
[0123] Step S508: The conference control platform determines the target conference member information based on the target control protocol.
[0124] Step S509: Based on the functional requirements corresponding to the target control information, the meeting control platform executes target control instructions on the target meeting members corresponding to the target meeting member information in the current meeting.
[0125] In some embodiments, before performing step S509 above, the following may also be performed:
[0126] First, the conference control platform decrypts the verification field in the target control protocol to obtain the target operation sequence corresponding to the conference ID in the target control protocol. Then, the conference control platform compares the target operation sequence with the current operation sequence to obtain the comparison result. Finally, when the comparison result meets the preset comparison conditions, step S509 is executed.
[0127] At this point, the protocol flow process is complete, thus realizing the flow of the target control protocol.
[0128] In some embodiments, after performing step S509 above, the following may also be performed:
[0129] First, the communication platform receives the RTP packet corresponding to the execution result of the target control command. Then, in response to the RTP packet, the communication platform decodes and renders the RTP packet sequentially to display the effect corresponding to the conference control request.
[0130] This application provides a meeting entry method, which can be implemented as follows: First, the IMS user initiates a video conference by calling the conference number via video. For example, the conference number could be 01056680000. Then, in response to the video conference initiated by the IMS user, the conference number is determined through the IMS network, and the call is transferred to the communication platform. Here, the communication platform is generally responsible for functions such as session management and media management. Finally, after the communication platform automatically connects the call, it pushes a robot screen to the IMS user and asks for the conference ID via voice. The IMS user enters the conference ID through the dial pad to join the current conference; for example, the conference ID could be 1111.
[0131] In some embodiments, if a meeting password is set for the current meeting, the communication platform can display an interface for entering the meeting password, where IMS users can enter the password via the dial pad. DTMF information currently uses the IMS core network, commonly employing the SIP in-band mode defined in RFC2833. The communication platform obtains the meeting password through the DTMF information, compares it with a preset password, and allows the IMS user to join the current meeting if the password matches; otherwise, it disallows the IMS user from joining the current meeting.
[0132] In some embodiments, after an IMS user successfully joins the meeting, the communication platform can query the meeting host through the service platform and push the host's video feed to the IMS user, at which point the IMS user can participate in the current meeting. Of course, other IMS users, VoLTE users, and users with various terminal types can also join the current meeting using the above method to achieve multi-party video conferencing interaction.
[0133] This application provides a meeting control method. Figure 6 Another schematic flowchart of the meeting control method provided in the embodiments of this application is shown below. Figure 6 As shown, the meeting control method includes the following steps:
[0134] In step S601, after an IMS user joins the meeting, the communication platform mixes the voices from multiple parties using the MCU and then pushes them to the participants.
[0135] Here, by default, the meeting host's screen will be pushed to other meeting members. The meeting host can see the screen of the first meeting member, such as... Figure 7 As shown, Figure 7 This is a schematic diagram of a conference video frame provided in an embodiment of this application.
[0136] Step S602: The terminal receives a conference control operation initiated by the IMS user.
[0137] Here, digital signals are carried out during conference control operations.
[0138] In step S603, the terminal responds to the conference control operation by encapsulating the digital signals in the conference control operation into a corresponding conference control request.
[0139] In this embodiment of the application, IMS users can input the number "4" or the number "6" via the dial pad of their mobile phone, such as... Figure 8 As shown, Figure 8 This is a schematic diagram of a mobile phone dial pad provided in an embodiment of this application. The mobile phone's call module encapsulates the DTMF information of the number "4" or "6" into a corresponding RTP packet and sets the protocol field (such as PayloadType) in the Session Initiation Protocol (SIP). It then sends the packet to the IMS core network through the audio transmission channel.
[0140] In step S604, the terminal sends a conference control request to the communication platform based on the IMS core network.
[0141] In step S605, the communication platform responds to the conference control request by triggering a control protocol encapsulation request.
[0142] In step S606, the communication platform responds to the control protocol encapsulation request by encapsulating the protocol based on DTMF information to obtain the target control protocol.
[0143] In some embodiments, step 606 above can be implemented in the following ways:
[0144] First, the command parsing platform parses the meeting member identifiers in the control protocol encapsulation request to obtain the meeting ID. Then, the platform retrieves the current operation sequence corresponding to the meeting ID. Next, it increments the value of the current operation sequence to obtain the target operation sequence. Then, it encrypts the target operation sequence, DTMF information, and meeting ID to obtain a verification field. Finally, the platform encapsulates the target operation sequence, DTMF information, meeting ID, and verification field to obtain the target control protocol.
[0145] In some embodiments, the protocol gateway service of the communication platform needs to encapsulate ordinary digital signals (i.e., DTMF information in the above embodiments) into a target control protocol to prevent the protocol from being monitored by the network or other reasons during the transmission process. The target control protocol is then sent to the conference control platform.
[0146] In step S607, the instruction parsing platform sends the target control protocol to the conference control platform.
[0147] Step S608: The conference control platform determines the target conference member information based on the target control protocol.
[0148] Step S609: Based on the functional requirements corresponding to the target control information, the meeting control platform executes target control instructions on the target meeting members corresponding to the target meeting member information in the current meeting.
[0149] In some embodiments, the media forwarding service of the communication platform can switch the conference screen of the IMS user according to the functional requirements corresponding to the target control information, and forward the corresponding video stream (i.e., the RTP packet in the above embodiments) to the IMS core network through the IMS user's call video channel. The IMS core network then forwards the video stream to the IMS user's mobile phone, and decodes and renders the video stream to display the display effect corresponding to the conference control request, such as... Figure 9 As shown, Figure 9 This is a schematic diagram illustrating the display effect provided in an embodiment of this application. Due to the limitations of the video frame, the communication platform also needs to supplement the key frames of the video frame to prevent the terminal from going black.
[0150] At this point, the meeting control process is complete, enabling control of the current meeting.
[0151] Therefore, this application embodiment encapsulates the DTMF information in the conference control request to obtain the target control protocol; based on the target control protocol, the target conference member information and target control instructions are obtained; then, based on the functional requirements corresponding to the target control information, the target control instructions are executed on the target conference members corresponding to the target conference member information. This can achieve multi-party conference calls without compromising the network performance of the current network operator, and can also meet the functional requirements of controlling the video of the participants through DTMF information. This ensures that multi-party video calls under the IMS core network can run on mobile devices and reduce the resource consumption of the server.
[0152] The conference control method provided in this application supports existing devices, covering mobile devices that support both 4G and 5G signals. It eliminates the need for new specifications requiring mobile device manufacturers to implement client-side streaming and subscription for displaying multi-party conference video feeds. This application allows direct control of video conferences via dial-up on mobile devices. Simultaneously, it reduces server resource usage and improves server performance. The conference platform does not need to consider MCU screen fusion performance, enabling the streaming of all video streams. Furthermore, it allows control capabilities from OTT networks to be overlaid into the IMS network, providing more control possibilities for IMS video conferencing scenarios.
[0153] Figure 10 This is a schematic diagram of the composition structure of the conference control device provided in the embodiments of this application, as shown below. Figure 10 As shown, the conference control device 1000 includes: a triggering module 1001, used to trigger a control protocol encapsulation request in response to a conference control request sent by a terminal; the conference control request carries DTMF information; an encapsulation module 1002, used to encapsulate a protocol based on the DTMF information in response to the control protocol encapsulation request to obtain a target control protocol; an acquisition module 1003, used to acquire target control information corresponding to the DTMF information, the target control information carrying a target control instruction corresponding to the DTMF information; a determination module 1004, used to determine target conference member information based on the target control protocol; and an execution module 1005, used to execute the target control instruction on the target conference member corresponding to the target conference member information in the current conference based on the functional requirements corresponding to the target control information.
[0154] In some embodiments, the conference control request includes digital signals and DTMF commands;
[0155] The triggering module is further configured to perform signal stripping processing on the digital signals in the conference control request to obtain the DTMF instruction; parse the signaling field in the DTMF instruction to obtain the DTMF information; and trigger the control protocol encapsulation request based on the DTMF information.
[0156] In some embodiments, the control protocol encapsulation request includes a meeting member identifier;
[0157] The encapsulation module is further configured to parse the meeting member identifier in the control protocol encapsulation request to obtain a meeting ID; obtain the current operation sequence corresponding to the meeting ID; perform increment processing on the operation sequence to obtain a target operation sequence; encrypt the target operation sequence, the DTMF information, and the meeting ID to obtain a verification field; and encapsulate the target operation sequence, the DTMF information, the meeting ID, and the verification field to obtain the target control protocol.
[0158] In some embodiments, the determining module is further configured to parse the target control protocol to obtain a verification field corresponding to the target control protocol; perform security verification on the verification field to obtain a verification result; and when the verification result is a successful verification, determine the target meeting member information based on the meeting ID.
[0159] In some embodiments, the apparatus further includes:
[0160] The comparison module is used to decrypt the verification field to obtain the target operation sequence corresponding to the meeting ID in the target control protocol; compare the target operation sequence with the current operation sequence to obtain the comparison result; when the comparison result meets the preset comparison conditions, the target control instruction is executed on the target meeting member corresponding to the target meeting member information in the current meeting based on the functional requirements corresponding to the target control information.
[0161] In some embodiments, the apparatus further includes:
[0162] The display module is used to receive the RTP packet corresponding to the execution result sent by the communication platform; in response to the RTP packet, the RTP packet is decoded and rendered sequentially to display the display effect corresponding to the conference control request.
[0163] In some embodiments, the apparatus further includes:
[0164] The access module is used to receive a meeting entry request initiated by an IMS user; the meeting entry request carries a meeting ID; and based on the meeting ID, the IMS user is connected to the current meeting.
[0165] It should be noted that the description of the apparatus in this application embodiment is similar to the description of the method embodiment described above, and has similar beneficial effects as the method embodiment; therefore, it will not be repeated. For technical details not disclosed in this apparatus embodiment, please refer to the description of the method embodiment of this application for understanding.
[0166] It should be noted that, in the embodiments of this application, if the above-described conference control method is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a terminal to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.
[0167] Correspondingly, this application provides a conference control device. Figure 11 This is a schematic diagram of the composition structure of the conference control device provided in the embodiments of this application, as shown below. Figure 11 As shown, the conference control device 1100 includes at least a processor 1101 and a computer-readable storage medium 1102 configured to store executable instructions, wherein the processor 1101 generally controls the overall operation of the conference control device. The computer-readable storage medium 1102 is configured to store instructions and applications executable by the processor 1101, and may also cache data to be processed or processed by various modules in the processor 1101 and the conference control device 1100, which can be implemented using flash memory or random access memory (RAM).
[0168] This application provides a storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to perform the method provided in this application, for example... Figure 2 The method shown.
[0169] In some embodiments, the storage medium may be a computer-readable storage medium, such as a ferromagnetic random access memory (FRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic surface memory, optical disc, or a compact disk-read-only memory (CD-ROM); or it may be a device that includes one or any combination of the above-mentioned memories.
[0170] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
[0171] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file containing other programs or data, for example, in one or more scripts within a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple co-located files (e.g., files storing one or more modules, subroutines, or code sections). As an example, executable instructions may be deployed to execute on a single electronic device, or on multiple electronic devices located in one location, or on multiple electronic devices distributed across multiple locations and interconnected via a communication network.
[0172] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.
[0173] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0174] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components may be combined, or integrated into another system, or some features may be ignored or not performed.
[0175] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A meeting control method, characterized in that, The method includes: In response to a conference control request sent by the terminal, a control protocol encapsulation request is triggered; the conference control request carries DTMF information. The meeting member identifier in the control protocol encapsulation request is parsed to obtain the meeting ID; Obtain the current operation sequence corresponding to the meeting ID; The current operation sequence is incremented to obtain the target operation sequence; the incrementing process refers to adding a preset value to the value corresponding to the current operation sequence. The target operation sequence, the DTMF information, and the meeting ID are encrypted to obtain a verification field; The target operation sequence, the DTMF information, the meeting ID, and the verification field are encapsulated into a protocol to obtain the target control protocol; Obtain target control information corresponding to the DTMF information, wherein the target control information carries target control instructions corresponding to the DTMF information; The target meeting member information is determined based on the target control protocol; Based on the functional requirements corresponding to the target control information, the target control instructions are executed on the target meeting members corresponding to the target meeting member information in the current meeting.
2. The method according to claim 1, characterized in that, The conference control request includes digital signals and DTMF commands; The response to the conference control request sent by the terminal, triggering a control protocol encapsulation request, includes: The digital signal in the conference control request is stripped to obtain the DTMF instruction. The signaling fields in the DTMF instruction are parsed to obtain the DTMF information; Based on the DTMF information, the control protocol encapsulation request is triggered.
3. The method according to claim 1, characterized in that, The determination of target meeting member information based on the target control protocol includes: The target control protocol is parsed to obtain the verification field corresponding to the target control protocol; Perform a security check on the verification field to obtain the verification result; When the verification result is successful, the target meeting member information is determined based on the meeting ID.
4. The method according to claim 3, characterized in that, Before executing the target control instruction on the target meeting member corresponding to the target meeting member information in the current meeting based on the functional requirements corresponding to the target control information, the method further includes: The verification field is decrypted to obtain the target operation sequence corresponding to the conference ID in the target control protocol; The target operation sequence and the current operation sequence are compared to obtain the comparison result; When the comparison result meets the preset comparison conditions, the target control instruction is executed on the target meeting member corresponding to the target meeting member information in the current meeting, based on the functional requirements corresponding to the target control information.
5. The method according to claim 4, characterized in that, After executing the target control command on the target meeting member corresponding to the target meeting member information, the method further includes: Receive the RTP packet corresponding to the execution result of the target control command; In response to the RTP packet, the RTP packet is decoded and rendered sequentially to display the effect corresponding to the conference control request.
6. The method according to claim 1, characterized in that, The method further includes: Receive a meeting request initiated by an IMS user; the meeting request carries a meeting ID; Based on the meeting ID, the IMS user is connected to the current meeting.
7. A conference control device, characterized in that, The device includes: The triggering module is used to respond to a conference control request sent by the terminal and trigger a control protocol encapsulation request; the conference control request carries DTMF information. The encapsulation module is used to parse the meeting member identifier in the control protocol encapsulation request to obtain the meeting ID; obtain the current operation sequence corresponding to the meeting ID; perform increment processing on the current operation sequence to obtain the target operation sequence; the increment processing refers to adding a preset value to the value corresponding to the current operation sequence; encrypt the target operation sequence, the DTMF information, and the meeting ID to obtain a verification field; and encapsulate the target operation sequence, the DTMF information, the meeting ID, and the verification field to obtain the target control protocol. The acquisition module is used to acquire target control information corresponding to the DTMF information, wherein the target control information carries target control instructions corresponding to the DTMF information; The determination module is used to determine the target meeting member information based on the target control protocol; The execution module is used to execute the target control instructions on the target meeting members corresponding to the target meeting member information in the current meeting, based on the functional requirements corresponding to the target control information.
8. A conference control device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the conference control method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The device stores executable instructions for causing a processor to execute the executable instructions to implement the conference control method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Sound recording method and equipment for conference call
CN101616222A
Signaling transmission method and system
CN106921613A
Video conference control method and device and electronic equipment
CN113225521A
