Intelligent commanding and dispatching method and system based on open source FreeSwitch soft switch communication

Abstract

The invention relates to the technical field of communication, in particular to an intelligent commanding and dispatching method and system based on open source FreeSwitch soft switch communication, and the method comprises the steps: traversing a hardware terminal of a resource layer in a FreeSwitch soft switch platform, adjusting the connection between the hardware terminal and an access layer, and converting the monitoring data of the resource layer into a data code stream; analyzing the data code stream in an application layer, and generating a multimedia sub-data set; an authentication key connected with the access layer is distributed to the communication terminal of the resource layer, the communication terminal is switched to the scheduling service terminal of the application layer according to the task execution requirement of the communication terminal, and an online conference is established; and according to the communication state of the online conference, calling the sub-data from the sub-data set for online conference sharing and command scheduling. According to the invention, the requirements of information real-time sharing and terminal work coordination in an emergency monitoring scene can be met, and cross-terminal and cross-network communication scheduling is realized.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to an intelligent command and dispatch method and system based on open source FreeSwitch soft switch communication. Background Art

[0002] FreeSwitch is an open-source software switching platform with diverse voice, video, and data communication capabilities, facilitating the construction of communication networks. Additionally, FreeSwitch supports multiple communication protocols, including SIP and H.323, as well as various audio and video codecs. Its scalability and flexibility make it easy to add various monitoring and communication terminals. FreeSwitch is widely used in office buildings, power equipment, public transportation, and other applications, enabling real-time and efficient monitoring of diverse environments.

[0003] The FreeSwitch soft switch platform can provide efficient and high-quality telecommunications services for multiple users. For example, invention patent CN107959761A discloses a dual-link transmit and receive implementation method and device based on FreeSWITCH. The ESL receive chain and the ESL transmit chain are established through FreeSWITCH configuration information, which are used for sending voice events and voice control instructions respectively, thereby achieving transmit and receive separation. However, the above invention patent only uses the FreeSwitch soft switch platform to control the communication lines of the call center, and does not involve the common online communication and command and dispatch of multiple communication terminals, and cannot perform integrated scheduling in multi-terminal communication scenarios. Therefore, how to use the FreeSwitch soft switch platform to coordinate communications and command and dispatch multiple terminals in emergency monitoring scenarios is of great significance for ensuring real-time information sharing and work coordination in emergency monitoring scenarios. Summary of the Invention

[0004] Most existing technologies use the FreeSwitch soft switch platform to control the sending and receiving of messages in telephone call systems, but do not involve communication coordination and command and dispatch in multi-terminal scenarios. They cannot meet the needs of real-time information sharing and terminal work coordination in emergency monitoring scenarios, and cannot achieve cross-terminal and cross-network communication dispatch. The present invention provides an intelligent command and dispatch method based on open source FreeSwitch soft switch communication, which includes the following steps:

[0005] S100: traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform, adjust the connection between the hardware terminals and the access layer in the soft switch platform; convert the monitoring data of the monitoring terminals of the resource layer to obtain a data stream;

[0006] S200: Analyzing the data stream at the application layer of the softswitch platform to generate multimedia data; distinguishing and calibrating the multimedia data to generate a multimedia sub-data set;

[0007] S300: Distributing authentication keys for connecting to the access layer based on requests from communication terminals at the resource layer; obtaining task execution requirements from all communication terminals connected to the access layer, and transferring the communication terminals to the scheduling server at the application layer to establish an online meeting;

[0008] S400: Retrieving sub-data from the multimedia sub-data set according to the communication status of the online conference and scheduling the sharing and command in the online conference.

[0009] Preferably, in S100, the hardware terminals of the resource layer in the FreeSwitch soft switch platform are traversed, and the connection between the hardware terminals and the access layer in the soft switch platform is adjusted; the monitoring data of the monitoring terminal of the resource layer is converted to obtain a data stream, specifically:

[0010] traversing and querying the gateway addresses and operating bandwidth requirements of the monitoring terminal and the communication terminal in the resource layer of the FreeSwitch soft switch platform; determining, based on the gateway addresses and the operating bandwidth requirements, interfaces in the access layer of the soft switch platform that match the monitoring terminal and the communication terminal, thereby adjusting the connections between the monitoring terminal and the communication terminal and the access layer;

[0011] According to the operation log of the monitoring terminal of the resource layer, the time when the operation abnormality of the monitoring terminal occurs is determined; according to the time when the operation abnormality occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

[0012] Preferably, in S200, the data code stream is analyzed at the application layer of the soft switch platform to generate multimedia data; the multimedia data is distinguished and calibrated to generate a multimedia sub-data set, specifically:

[0013] monitoring the upload progress of the data code stream to the application layer of the soft switch platform, and performing integrity calibration on the data code stream received by the application layer; extracting audio components, image components, and text components from the complete data code stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data;

[0014] The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

[0015] Preferably, in S300, according to the request of the communication terminal of the resource layer, the authentication key for connecting to the access layer is distributed; the execution task requirements of all communication terminals connected to the access layer are obtained, and the communication terminals are transferred to the scheduling server of the application layer to form an online meeting, specifically:

[0016] extracting service type information from respective requests of all communication terminals at the resource layer, determining a port location of each communication terminal at the access layer based on the service type information; and distributing an authentication key for connecting to the access layer to each communication terminal based on the port location;

[0017] All communication terminals connected to the access layer are monitored for operation to obtain the task execution requirements of each communication terminal; wherein, the task execution requirements include the task attributes that each communication terminal needs to perform; according to the task execution requirements and the busy and idle status of all scheduling servers in the application layer, the communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting.

[0018] Preferably, in S400, according to the communication status of the online conference, matching sub-data are retrieved from the multimedia sub-data set for sharing and command scheduling in the online conference, specifically:

[0019] The real-time communication records and actual communication bandwidth of the online meeting are obtained, the real-time communication records are parsed and identified, and the data type currently required for the online meeting is determined; based on the data type and the actual communication bandwidth, sub-data are retrieved from the multimedia sub-data set and compressed and converted before being shared and commanded in the online meeting.

[0020] On the other hand, the present invention provides an intelligent command and dispatch system based on open source FreeSwitch soft switch communication, the system comprising the following modules:

[0021] The terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform;

[0022] A data conversion module, configured to convert the monitoring data of the monitoring terminal of the resource layer to obtain a data code stream;

[0023] A multimedia data generation module is configured to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set;

[0024] A key distribution module, configured to distribute an authentication key for connecting to the access layer according to a request of a communication terminal of the resource layer;

[0025] An online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference;

[0026] The sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set and share and command the sub-data in the online conference according to the communication status of the online conference.

[0027] Preferably, the terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform, specifically:

[0028] traversing and querying the gateway addresses and operating bandwidth requirements of the monitoring terminal and the communication terminal in the resource layer of the FreeSwitch soft switch platform; determining, based on the gateway addresses and the operating bandwidth requirements, interfaces in the access layer of the soft switch platform that match the monitoring terminal and the communication terminal, thereby adjusting the connections between the monitoring terminal and the communication terminal and the access layer;

[0029] The data conversion module is used to convert the monitoring data of the monitoring terminal of the resource layer to obtain a data code stream, specifically:

[0030] According to the operation log of the monitoring terminal of the resource layer, the time when the operation abnormality of the monitoring terminal occurs is determined; according to the time when the operation abnormality occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

[0031] Preferably, the multimedia data generation module is used to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set, specifically:

[0032] monitoring the upload progress of the data code stream to the application layer of the soft switch platform, and performing integrity calibration on the data code stream received by the application layer; extracting audio components, image components, and text components from the complete data code stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data;

[0033] The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

[0034] Preferably, the key distribution module is used to distribute the authentication key for connecting to the access layer according to the request of the communication terminal of the resource layer, specifically:

[0035] extracting service type information from respective requests of all communication terminals at the resource layer, determining a port location of each communication terminal at the access layer based on the service type information; and distributing an authentication key for connecting to the access layer to each communication terminal based on the port location;

[0036] The online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference. Specifically:

[0037] All communication terminals connected to the access layer are monitored for operation to obtain the task execution requirements of each communication terminal; wherein, the task execution requirements include the task attributes that each communication terminal needs to perform; according to the task execution requirements and the busy and idle status of all scheduling servers in the application layer, the communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting.

[0038] Preferably, the sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set and share and command the sub-data in the online conference according to the communication status of the online conference, specifically:

[0039] The real-time communication records and actual communication bandwidth of the online meeting are obtained, the real-time communication records are parsed and identified, and the data type currently required for the online meeting is determined; based on the data type and the actual communication bandwidth, sub-data are retrieved from the multimedia sub-data set and compressed and converted before being shared and commanded in the online meeting.

[0040] Compared with the prior art, the present invention has the following beneficial effects:

[0041] The system traverses the hardware terminals in the resource layer of the FreeSwitch softswitch platform and adjusts their connections with the access layer of the softswitch platform. It also converts the monitoring data from the monitoring terminals in the resource layer to obtain a data stream. By determining the matching relationship between each monitoring terminal and each communication terminal and the gateway interface, it adjusts the connection between each monitoring terminal and each communication terminal and the gateway interface in the access layer, ensuring a reliable and stable connection between the monitoring and communication terminals and the softswitch platform. Furthermore, the conversion of monitoring data into a data stream ensures the reliability of the monitoring data, providing an accurate basis for subsequent online meetings and unified command and dispatch of communication terminals.

[0042] The application layer of the softswitch platform analyzes the data stream to generate multimedia data; this multimedia data is then differentiated and calibrated to generate multimedia sub-data sets. This process verifies the integrity of the data stream received by the application layer and distinguishes its data type, enabling data classification and improving the efficiency of subsequent data processing and upload.

[0043] Based on requests from communication terminals at the resource layer, authentication keys for connecting to the access layer are distributed. Task execution requirements are obtained from all communication terminals connected to the access layer, and these terminals are transferred to the scheduling server at the application layer to establish an online meeting. This process ensures that communication terminals can securely connect to the access layer using the authentication keys, ensuring the reliability of subsequent communication terminals on the softswitch communication platform. Furthermore, online meetings are established on the same scheduling server, enabling instant online communication between multiple communication terminals on the same scheduling server.

[0044] Based on the online meeting's communication status, sub-data is retrieved from the multimedia sub-data set for online meeting sharing and command scheduling. This process ensures that multimedia sub-data can be uploaded to the online meeting quickly and efficiently, improving the immediacy of online meeting communications. Furthermore, command scheduling is performed on communication terminals that have accessed the multimedia sub-data, enabling command scheduling for all communication terminals participating in the online meeting. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without inventive efforts. Among them:

[0046] Figure 1 The present invention provides a flow chart of an intelligent command and dispatch method based on open source FreeSwitch soft switch communication.

[0047] Figure 2 This is the structural block diagram of the FreeSwitch soft switch platform.

[0048] Figure 3 It is the working interface of the FreeSwitch soft switch platform.

[0049] Figure 4 It is a list of multimedia sub-data sets.

[0050] Figure 5 It is the interface for online meetings.

[0051] Figure 6This is a structural diagram of an intelligent command and dispatch system based on open source FreeSwitch soft switch communication provided by the present invention. DETAILED DESCRIPTION

[0052] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. It will be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0053] The terms "comprise," "comprising," and "having," and any variations thereof, as used herein, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0054] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] See also Figure 1 As shown, the present invention provides an intelligent command and dispatch method based on open source FreeSwitch soft switch communication, the method comprising the following steps:

[0056] S100: traverses the hardware terminals of the resource layer in the FreeSwitch soft switch platform, adjusts the connection between the hardware terminals and the access layer in the soft switch platform; converts the monitoring data of the monitoring terminals of the resource layer to obtain a data stream.

[0057] Furthermore, in S100, the hardware terminals of the resource layer in the FreeSwitch soft switch platform are traversed, and the connection between the hardware terminals and the access layer in the soft switch platform is adjusted; the monitoring data of the monitoring terminal of the resource layer is converted to obtain a data stream, specifically:

[0058] The system queries the gateway addresses and bandwidth requirements of the monitoring and communication terminals in the resource layer of the FreeSwitch softswitch platform. Based on the gateway addresses and bandwidth requirements, it determines the interfaces in the access layer of the softswitch platform that match the monitoring and communication terminals, thereby adjusting the connections between the monitoring and communication terminals and the access layer.

[0059] According to the operation log of the monitoring terminal at the resource layer, the time when the operation abnormality of the monitoring terminal occurs is determined; according to the time when the operation abnormality occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

[0060] See also Figure 2 The FreeSwitch softswitch platform primarily consists of a resource layer, an access layer, and an application layer. The resource layer includes several monitoring terminals and several communication terminals. Monitoring terminals may include, but are not limited to, video surveillance cameras or surveillance cameras, while communication terminals may include, but are not limited to, smartphones. Monitoring terminals monitor the on-site environment and generate audio, video, and text monitoring data. Communication terminals are mobile devices used by on-site personnel. Both monitoring terminals and communication terminals can access the FreeSwitch softswitch platform, enabling monitoring data analysis and processing, interaction between different communication terminals, and simultaneous online conferencing and real-time information sharing across multiple communication terminals. The access layer, as the communication implementation layer of the softswitch platform, preferably supports the SIP protocol. In practice, the access layer can support multiple communication protocols and multiple audio and video codec formats to meet the data transmission and interaction needs of different types of monitoring and communication terminals. The application layer includes several independent scheduling servers, each of which provides virtual space and computing resources for organizing online meetings. Scheduling servers can be, but are not limited to, servers.

[0061] Generally speaking, the monitoring terminals and communication terminals in the resource layer are in specific operating modes, and the monitoring terminals and communication terminals will have different network connection requirements due to the differences in the operating modes. In addition, the access layer of the soft switch platform contains multiple gateway interfaces, each of which can support the same or different communication protocols, and the communication bandwidth that each gateway interface can provide is also different. In order to achieve the optimal and reasonable configuration of the network communication resources within the soft switch platform, the gateway addresses and operating bandwidth requirements of all monitoring terminals and all communication terminals in the resource layer are first traversed and queried, where the operating bandwidth requirement can be but is not limited to the bandwidth required for the monitoring terminal or the communication terminal itself to communicate on the network in the current operating mode. Based on the gateway address and operating bandwidth requirement of each monitoring terminal and each communication terminal, a list of access configuration information about all monitoring terminals and all communication terminals is constructed. The above-mentioned access configuration information list includes the mapping relationship between the terminal identity of each monitoring terminal and each communication terminal and the gateway address and operating bandwidth requirement. Compare the above access configuration information list with the bandwidth provided by all gateway interfaces in the access layer of the soft switch platform, determine the matching correspondence between each monitoring terminal and each communication terminal and the gateway interface, and adjust the connection between each monitoring terminal and each communication terminal to the gateway interface in the access layer to ensure a reliable and stable connection between the monitoring terminal and the communication terminal and the soft switch platform.

[0062] Monitoring terminals are used to monitor the on-site environment and generate monitoring data in the form of audio, video, and / or text. During monitoring operations, monitoring terminals are inevitably subject to interference, which can cause monitoring disturbances and generate significant noise in the generated monitoring data, leading to data distortion. To prevent interference and distortion from affecting the reliability of subsequent online meetings and command and dispatch, the duration of interference (such as vibration or electromagnetic interference) experienced by the monitoring terminal during operation is extracted from the operation log of each monitoring terminal in the resource layer. This duration is used as the time of the abnormal operation of the monitoring terminal. The monitoring data generated by the monitoring terminal at the time of the abnormal operation is then extracted and its credibility is evaluated to determine whether its credibility is below a preset credibility threshold. If so, the extracted monitoring data is filtered to remove interference and noise, and all monitoring data is converted to a data stream. If not, all monitoring data is directly converted to a data stream. This processing of monitoring data ensures its reliability and provides accurate information for subsequent online meetings and unified command and dispatch communication terminals.

[0063] S200: Analyze the data code stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set.

[0064] Furthermore, in S200, the data code stream is analyzed at the application layer of the soft switch platform to generate multimedia data; the multimedia data is distinguished and calibrated to generate a multimedia sub-data set, specifically:

[0065] Monitor the upload progress of the data stream to the application layer of the soft switch platform and perform integrity calibration on the data stream received by the application layer; extract the audio component, image component, and text component of the complete data stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data;

[0066] The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

[0067] See also Figure 3 When the monitoring terminal and the communication terminal are connected to the FreeSwitch soft switch platform through the access layer, the soft switch platform can implement management and control of all monitoring terminals and all communication terminals, and the working interface can be viewed in real time through the visualization terminal of the soft switch platform; Figure 3 The privacy information such as the numbers of all monitoring terminals and all communication terminals is hidden in Figure 3 (black part in the middle). Figure 3The softswitch platform's work interface displays operation menus for all monitoring terminals and all communication terminals, enabling centralized control of all terminals. The data stream generated by the monitoring terminal after connecting to the access layer is uploaded to the softswitch platform's application layer. Considering that the data stream is converted from monitoring data, the data stream corresponds one-to-one with the monitoring data, and the data stream contains multiple relatively independent data segments, each of which fully represents the corresponding monitoring information. To avoid consuming a long time and requiring more computing resources for processing the entire data stream, different forms of data extraction can be performed on the data stream based on the data segments contained within the data stream. Specifically, the upload progress of the data stream to the application layer is monitored, and the timestamp information of the data stream uploaded to the application layer is obtained. Based on the timestamp information, the integrity of the data stream received by the application layer is calibrated. For example, based on the timestamp information, the application layer determines whether the duration of the data stream received by the application layer reaches a preset time length threshold. If so, the data stream received during this period is considered a complete data stream; if not, the data stream received during this period is not considered a complete data stream. Then, the complete data code stream received from the application layer is extracted to extract the audio component, image component, and text component, thereby generating multimedia data containing audio data, image data, and text data. The multimedia data is then time-sequenced to generate a multimedia sub-data set including multiple audio sub-data, multiple image sub-data, and multiple text sub-data that are continuous in the time domain, thereby achieving classification of the monitoring data at the type and time domain levels. Figure 4 , a list of multimedia sub-data sets matching the monitoring data generated by monitoring terminals installed in different field environments, so as to facilitate accurate viewing of the required multimedia data; wherein, Figure 4 All privacy information such as address information corresponding to multimedia data is hidden in Figure 4 black part in the middle).

[0068] S300: Distribute authentication keys for connecting to the access layer based on requests from communication terminals at the resource layer; obtain task execution requirements from all communication terminals connected to the access layer, and transfer the communication terminals to the scheduling server at the application layer to establish an online meeting.

[0069] Furthermore, in S300, based on the request of the communication terminal at the resource layer, the authentication key for connecting to the access layer is distributed; the execution task requirements of all communication terminals connected to the access layer are obtained, and the communication terminals are transferred to the scheduling server at the application layer to establish an online meeting. Specifically,

[0070] Extracting service type information from the requests of all communication terminals at the resource layer, determining the port location of each communication terminal at the access layer based on the service type information; distributing an authentication key for connecting to the access layer to each communication terminal based on the port location;

[0071] Monitor the operation of all communication terminals connected to the access layer and obtain the task execution requirements of each communication terminal; the task execution requirements include the task attributes that each communication terminal needs to perform; according to the task execution requirements and the busy and idle status of all scheduling servers in the application layer, the communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting. Figure 5 As shown, Figure 5 The live scene images shared in the online meeting are hidden (corresponding to Figure 5 black part in the middle).

[0072] The FreeSwitch softswitch platform aims to enable data exchange and communication between multiple monitoring terminals and multiple communication terminals. Specifically, different communication terminals can communicate through the softswitch platform's application layer and access multimedia sub-data sets corresponding to the monitoring data generated by the monitoring terminals. The application layer includes multiple scheduling servers, each of which operates as an independent server and supports online instant messaging for different communication terminals. To ensure the security and exclusivity of online instant messaging provided by the scheduling server to different communication terminals, each communication terminal is authenticated. Specifically, service type information is first extracted from requests initiated by all communication terminals within the resource layer. This service type information may include, but is not limited to, the type of communication service initiated by the communication app currently activated by each communication terminal (such as text communication, voice communication, or video communication). Based on this service type information, port tracing is performed on the access layer to determine the corresponding communication terminal's port location at the access layer. This information is then used to assign and send authentication keys to the communication terminals for connecting to the access layer. This authentication key allows the communication terminal to securely connect to the access layer, ensuring the reliability of subsequent communication on the softswitch communication platform.

[0073] In addition, after the communication terminal is connected to the access layer, the operation status of the communication terminal is monitored to obtain the attributes of the task that the communication terminal needs to perform. The above-mentioned task attributes may include but are not limited to the identities of other communication terminals corresponding to the communication interaction task that the communication terminal needs to perform and the amount of interaction information corresponding to the communication interaction task that needs to be performed. Then, based on the above-mentioned task execution requirements and the busy and idle status of all scheduling servers in the application layer (that is, the remaining available computing power resources and storage resources of all scheduling servers), communication terminals with the same task execution requirements are transferred to the same scheduling server with appropriate remaining available computing power resources and storage resources, so as to form an online meeting on the same scheduling server and realize instant online communication between multiple communication terminals on the same scheduling server. Please refer to Figure 5 , each communication terminal participating in the online meeting will present the corresponding online meeting interface, thereby meeting the instant communication needs of holders of different communication terminals during the command and dispatch process.

[0074] S400: According to the communication status of the online conference, sub-data are retrieved from the multimedia sub-data set for online conference sharing and command scheduling.

[0075] In S400, according to the communication status of the online conference, matching sub-data is retrieved from the multimedia sub-data set for online conference sharing and command scheduling, specifically:

[0076] Obtain the real-time communication records and actual communication bandwidth of the online meeting, parse and identify the real-time communication records, and determine the data type currently required for the online meeting; based on the data type and actual communication bandwidth, retrieve the sub-data from the multimedia sub-data set, compress and convert it, and then share it in the online meeting and dispatch commands.

[0077] Online conferencing uses a scheduling server within the application layer to provide multiple communication terminals with the computing power, storage resources, and communication bandwidth resources necessary for real-time online communication. In particular, considering that participating communication terminals may need to browse different types of multimedia sub-data, such as audio, video, or text, which can be quite large, if the scheduling server provides too little communication bandwidth for the online conference, this can lead to issues such as excessive upload times or upload failures, seriously impacting the immediacy of online communication. To this end, the real-time communication records of the online conference are first acquired and parsed, and semantic recognition is performed on these records to determine the types of multimedia sub-data that the online conference needs to view during the current real-time communication process. Then, based on these multimedia sub-data types and the remaining available actual communication bandwidth of the scheduling server corresponding to the online conference, sub-data is retrieved from the multimedia sub-data set and compressed and converted. This reduces the sub-data size to match the remaining available actual communication bandwidth, thereby improving the efficiency of multimedia sub-data sharing in the online conference. At the same time, when the multimedia sub-data is shared and uploaded to the online meeting, the online meeting will conduct targeted command and dispatch for the communication terminals that have viewed the above multimedia sub-data, that is, send command and dispatch with corresponding content to the above communication terminals, so as to realize command and dispatch of all communication terminals participating in the online meeting.

[0078] See also Figure 6 As shown, the present invention provides an intelligent command and dispatch system based on open source FreeSwitch soft switch communication, which includes the following modules:

[0079] The terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform;

[0080] The data conversion module is used to convert the monitoring data of the monitoring terminal of the resource layer to obtain a data code stream;

[0081] The multimedia data generation module is used to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set;

[0082] A key distribution module, configured to distribute authentication keys for connecting to the access layer based on requests from communication terminals at the resource layer;

[0083] The online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference;

[0084] The sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set for online conference sharing and command scheduling according to the communication status of the online conference.

[0085] Furthermore, the terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform, specifically:

[0086] The system queries the gateway addresses and bandwidth requirements of the monitoring and communication terminals in the resource layer of the FreeSwitch softswitch platform. Based on the gateway addresses and bandwidth requirements, it determines the interfaces in the access layer of the softswitch platform that match the monitoring and communication terminals, thereby adjusting the connections between the monitoring and communication terminals and the access layer.

[0087] The data conversion module is used to convert the monitoring data of the monitoring terminal of the resource layer to obtain the data code stream, specifically:

[0088] According to the operation log of the monitoring terminal at the resource layer, the time when the operation abnormality of the monitoring terminal occurs is determined; according to the time when the operation abnormality occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

[0089] Furthermore, the multimedia data generation module is used to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set, specifically:

[0090] Monitor the upload progress of the data stream to the application layer of the soft switch platform and perform integrity calibration on the data stream received by the application layer; extract the audio component, image component, and text component of the complete data stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data;

[0091] The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

[0092] Furthermore, the key distribution module is used to distribute the authentication key for connecting to the access layer according to the request of the communication terminal of the resource layer, specifically:

[0093] Extracting service type information from the requests of all communication terminals at the resource layer, determining the port location of each communication terminal at the access layer based on the service type information; distributing an authentication key for connecting to the access layer to each communication terminal based on the port location;

[0094] The online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference. Specifically:

[0095] All communication terminals connected to the access layer are monitored to obtain the task execution requirements of each communication terminal. The task execution requirements include the attributes of the tasks that each communication terminal needs to perform. Based on the task execution requirements and the busy and idle status of all scheduling servers in the application layer, communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting.

[0096] Furthermore, the sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set for online conference sharing and command scheduling according to the communication status of the online conference, specifically:

[0097] Obtain the real-time communication records and actual communication bandwidth of the online meeting, parse and identify the real-time communication records, and determine the data type currently required for the online meeting; based on the data type and actual communication bandwidth, retrieve the sub-data from the multimedia sub-data set, compress and convert it, and then share it in the online meeting and dispatch commands.

[0098] The operation and effects of the intelligent command and dispatch system based on open source FreeSwitch soft switch communication of the present invention are corresponding to and consistent with the above-mentioned intelligent command and dispatch method based on open source FreeSwitch soft switch communication. The intelligent command and dispatch system based on open source FreeSwitch soft switch communication will not be repeated here.

[0099] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding the necessary general-purpose hardware platform, or of course, by combining hardware and software. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a computer product. The present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0100] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it, and other embodiments may also be used. Although the present invention has been described in detail with reference to the aforementioned embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. An intelligent command and dispatch method based on open source FreeSwitch soft switch communication, characterized in that: The method comprises the following steps: S100: traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform, adjust the connection between the hardware terminals and the access layer in the soft switch platform; convert the monitoring data of the monitoring terminals of the resource layer to obtain a data stream; S200: Analyzing the data stream at the application layer of the softswitch platform to generate multimedia data; distinguishing and calibrating the multimedia data to generate a multimedia sub-data set; S300: Distributing authentication keys for connecting to the access layer based on requests from communication terminals at the resource layer; obtaining task execution requirements from all communication terminals connected to the access layer, and transferring the communication terminals to the scheduling server at the application layer to establish an online meeting; S400: Retrieving sub-data from the multimedia sub-data set according to the communication status of the online conference and scheduling the sharing and command in the online conference.

2. The method according to claim 1, characterized in that In S100, the hardware terminals of the resource layer in the FreeSwitch soft switch platform are traversed, and the connection between the hardware terminals and the access layer in the soft switch platform is adjusted; the monitoring data of the monitoring terminal of the resource layer is converted to obtain a data stream, specifically: traversing and querying the gateway addresses and operating bandwidth requirements of the monitoring terminal and the communication terminal in the resource layer of the FreeSwitch soft switch platform; determining, based on the gateway addresses and the operating bandwidth requirements, interfaces in the access layer of the soft switch platform that match the monitoring terminal and the communication terminal, thereby adjusting the connections between the monitoring terminal and the communication terminal and the access layer; Determining the time when the abnormal operation of the monitoring terminal occurs according to the operation log of the monitoring terminal of the resource layer; According to the time when the abnormal operation occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

3. The method according to claim 1, characterized in that In S200, the data code stream is analyzed at the application layer of the soft switch platform to generate multimedia data; the multimedia data is distinguished and calibrated to generate a multimedia sub-data set, specifically: monitoring the upload progress of the data code stream to the application layer of the soft switch platform, and performing integrity calibration on the data code stream received by the application layer; extracting audio components, image components, and text components from the complete data code stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data; The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

4. The method according to claim 1, wherein In S300, based on the request of the communication terminal of the resource layer, the authentication key for connecting to the access layer is distributed; the execution task requirements of all communication terminals connected to the access layer are obtained, and the communication terminals are transferred to the scheduling server of the application layer to establish an online meeting, specifically: extracting service type information from respective requests of all communication terminals at the resource layer, determining a port location of each communication terminal at the access layer based on the service type information; and distributing an authentication key for connecting to the access layer to each communication terminal based on the port location; All communication terminals connected to the access layer are monitored for operation to obtain the task execution requirements of each communication terminal; wherein, the task execution requirements include the task attributes that each communication terminal needs to perform; according to the task execution requirements and the busy and idle status of all scheduling servers in the application layer, the communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting.

5. The method according to claim 1, characterized in that In S400, according to the communication status of the online conference, matching sub-data is retrieved from the multimedia sub-data set and shared and commanded in the online conference, specifically: The real-time communication records and actual communication bandwidth of the online meeting are obtained, the real-time communication records are parsed and identified, and the data type currently required for the online meeting is determined; based on the data type and the actual communication bandwidth, sub-data are retrieved from the multimedia sub-data set and compressed and converted before being shared and commanded in the online meeting.

6. An intelligent command and dispatch system based on open source FreeSwitch soft switch communication, characterized in that: The system includes the following modules: The terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform; A data conversion module, configured to convert the monitoring data of the monitoring terminal of the resource layer to obtain a data code stream; A multimedia data generation module, configured to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; Distinguishing and calibrating the multimedia data to generate a multimedia sub-data set; A key distribution module, configured to distribute an authentication key for connecting to the access layer according to a request of a communication terminal of the resource layer; An online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference; The sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set and share and command the sub-data in the online conference according to the communication status of the online conference.

7. The system according to claim 6, characterized in that The terminal traversal and access module is used to traverse the hardware terminals of the resource layer in the FreeSwitch soft switch platform and adjust the connection between the hardware terminals and the access layer in the soft switch platform, specifically: traversing and querying the gateway addresses and operating bandwidth requirements of the monitoring terminal and the communication terminal in the resource layer of the FreeSwitch soft switch platform; determining, based on the gateway addresses and the operating bandwidth requirements, interfaces in the access layer of the soft switch platform that match the monitoring terminal and the communication terminal, thereby adjusting the connections between the monitoring terminal and the communication terminal and the access layer; The data conversion module is used to convert the monitoring data of the monitoring terminal of the resource layer to obtain a data code stream, specifically: Determining the time when the abnormal operation of the monitoring terminal occurs according to the operation log of the monitoring terminal of the resource layer; According to the time when the abnormal operation occurs, the monitoring data of the monitoring terminal is subjected to credibility verification screening, interference elimination and code stream conversion to obtain a data code stream.

8. The system according to claim 6, wherein: The multimedia data generation module is used to analyze the data stream at the application layer of the soft switch platform to generate multimedia data; distinguish and mark the multimedia data to generate a multimedia sub-data set, specifically: monitoring the upload progress of the data code stream to the application layer of the soft switch platform, and performing integrity calibration on the data code stream received by the application layer; extracting audio components, image components, and text components from the complete data code stream at the application layer to generate multimedia data; wherein the multimedia data includes audio data, image data, and text data; The multimedia data is time-sequenced to generate a multimedia sub-data set; wherein the multimedia sub-data set includes a plurality of audio sub-data, a plurality of image sub-data, and a plurality of text sub-data that are continuous in time domain.

9. The system according to claim 6, wherein: The key distribution module is used to distribute the authentication key for connecting to the access layer according to the request of the communication terminal of the resource layer, specifically: extracting service type information from respective requests of all communication terminals at the resource layer, determining a port location of each communication terminal at the access layer based on the service type information; and distributing an authentication key for connecting to the access layer to each communication terminal based on the port location; The online conference formation module is used to obtain the execution task requirements of all communication terminals connected to the access layer and transfer the communication terminals to the scheduling server of the application layer to form an online conference. Specifically: All communication terminals connected to the access layer are monitored for operation to obtain the task execution requirements of each communication terminal; wherein, the task execution requirements include the task attributes that each communication terminal needs to perform; according to the task execution requirements and the busy and idle status of all scheduling servers in the application layer, the communication terminals with the same task execution requirements are transferred to the corresponding scheduling server to form an online meeting.

10. The system according to claim 6, wherein: The sharing and scheduling module is used to retrieve sub-data from the multimedia sub-data set and share and command scheduling in the online conference according to the communication status of the online conference, specifically: The real-time communication records and actual communication bandwidth of the online meeting are obtained, the real-time communication records are parsed and identified, and the data type currently required for the online meeting is determined; based on the data type and the actual communication bandwidth, sub-data are retrieved from the multimedia sub-data set and compressed and converted before being shared and commanded in the online meeting.

Images