Converged communication method and system, storage medium and computer equipment

Abstract

The invention discloses a converged communication method and system, a storage medium and computer equipment. The method comprises the following steps: in response to a session request initiated by a first communication terminal, establishing a session channel between the first communication terminal and a second communication terminal, configuring the first communication terminal to be in a right grabbing state, and configuring the second communication terminal to be in a right releasing state; in response to switching of the first communication terminal from the right grabbing state to the right releasing state, notifying the second communication terminal to select to switch from the right releasing state to the right grabbing state; wherein one of the first communication terminal and the second communication terminal is full-duplex, the other one is half-duplex, and the communication terminal in the right grabbing state sends audio data to the communication terminal in the right releasing state. By means of the method, half-duplex communication can be simulated through full duplex, interoperation between terminal devices of different communication types is achieved, the right grabbing state and the right releasing state are dynamically switched according to session requirements, and the applicability and compatibility of various communication scenes are met.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a converged communication method, system, storage medium and computer device. Background Art

[0002] With the rapid development of communication technology, converged communication systems that integrate communication equipment of various network standards have emerged. These converged communication systems can integrate diverse communication technologies and systems to achieve unified communication management and coordination.

[0003] However, the progress of converged communications has also brought new challenges to the coexistence of full-duplex communication terminals and half-duplex communication terminals. Full-duplex communication allows both parties to transmit two-way data at the same time. This mode significantly improves communication efficiency and convenience in many occasions. At the same time, although half-duplex communication also supports two-way data transmission, it limits data to only one party at a time. Even so, in specific areas such as public safety and emergency response, half-duplex communication still has its unique advantages. For example, in the field of public safety, the cluster intercom system, as a system that allows multiple users to conduct instant voice communication on the same channel, usually adopts a half-duplex communication mode. This mode effectively prevents the confusion caused by multiple people speaking at the same time, ensuring clear and orderly communication in emergency situations. In addition, half-duplex communication shows better communication quality in harsh environments, can use spectrum resources more efficiently, and is easier to operate in some application scenarios. Therefore, both full-duplex communication and half-duplex communication are often indispensable in converged communication systems.

[0004] However, due to the different communication interaction methods, the interoperability between the two communication systems is extremely poor, and problems such as information loss and decreased communication quality often occur, making it difficult to achieve a smooth and coordinated workflow, and the applicability and compatibility for various communication scenarios are poor. Summary of the invention

[0005] The present application mainly provides a converged communication method, system, storage medium and computer device, aiming to solve the technical problem of poor interoperability of existing converged communication systems.

[0006] To solve the above technical problems, the technical solution adopted in the present application is: to provide a converged communication method. The converged communication method includes: in response to a session request initiated by a first communication terminal, establishing a session channel between the first communication terminal and the second communication terminal, and configuring the first communication terminal to be in a grabbing state and configuring the second communication terminal to be in a releasing state; in response to the first communication terminal switching from the grabbing state to the releasing state, notifying the second communication terminal that it can choose to switch from the releasing state to the grabbing state; wherein the first communication terminal is one of a full-duplex communication terminal and a half-duplex communication terminal, and the second communication terminal is the other of a full-duplex communication terminal and a half-duplex communication terminal; when the first communication terminal is in the grabbing state and the second communication terminal is in the releasing state, allowing the first communication terminal to send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data; when the second communication terminal is in the grabbing state and the first communication terminal is in the releasing state, allowing the second communication terminal to send audio data to the first communication terminal through the session channel, and the first communication terminal receives the audio data.

[0007] In some embodiments, after configuring the first communication terminal to be in a grabbing state and configuring the second communication terminal to be in a releasing state, the method further includes: detecting the interaction state of the first communication terminal; in response to determining that the interaction state is a stop state, notifying the first communication terminal that it can choose to switch from the grabbing state to the releasing state.

[0008] In some embodiments, detecting the interaction state of the first communication terminal includes: detecting voice activity information and mute information of the first communication terminal; in response to the voice activity information satisfying a preset voice activity stop condition, and the mute information satisfying a preset mute condition, confirming that the interaction state is the stop state; wherein the preset voice activity stop condition indicates that the first communication terminal is not performing voice activity, and the preset mute condition indicates that the first communication terminal is in a mute segment for a long time.

[0009] In some embodiments, in response to a session request initiated by a first communication terminal, establishing a session channel between the first communication terminal and the second communication terminal, configuring the first communication terminal to be in a grabbing state, and configuring the second communication terminal to be in a releasing state, includes: in response to a session request initiated by the first communication terminal, creating a session, and configuring the first communication terminal to be in a grabbing state; forwarding the session request to the second communication terminal to allow the second communication terminal to join the session, and configuring the second communication terminal to be in a releasing state; connecting the session with the first communication terminal based on a first communication protocol, and connecting the session with the second communication terminal based on a second communication protocol; establishing a protocol conversion between the first communication protocol and the second communication protocol to establish the session channel between the first communication terminal and the second communication terminal.

[0010] In some embodiments, in response to the first communication terminal switching from the grabbing state to the releasing state, after notifying the second communication terminal that it can choose to switch from the releasing state to the grabbing state, the method further includes: in response to receiving a grabbing request from the second communication terminal, configuring the second communication terminal to the grabbing state; in response to receiving a session end request from the first communication terminal, issuing a session end notification to the second communication terminal, and clearing the resource information and status information of the session.

[0011] In some embodiments, the converged communication method further includes: buffering and storing the audio data in the session channel so that all the audio data of the first communication terminal or the second communication terminal in the grabbing state is sent to the opposite end.

[0012] In some embodiments, the converged communication method also includes: storing the corresponding right-grabbing status or right-releasing status of the first communication terminal and the second communication terminal, so as to open the right to send audio data to the first communication terminal or the second communication terminal in the right-grabbing status, close the sending of audio data to the first communication terminal or the second communication terminal in the right-releasing status, and perform mute processing.

[0013] In order to solve the above technical problems, another technical solution adopted by the present application is: to provide a converged communication system, which includes: a core subsystem and a first communication terminal and a second communication terminal connected to the core subsystem for communication; the core subsystem responds to a session request initiated by the first communication terminal, establishes a session channel between the first communication terminal and the second communication terminal, and configures the first communication terminal to a power grabbing state and the second communication terminal to a power releasing state; the core subsystem responds to the first communication terminal switching from the power grabbing state to the power releasing state, notifying the second communication terminal that it can choose to switch from the power releasing state to the power grabbing state; wherein, The first communication terminal is one of a full-duplex communication terminal and a half-duplex communication terminal, and the second communication terminal is the other of the full-duplex communication terminal and the half-duplex communication terminal; when the first communication terminal is in a grabbing state and the second communication terminal is in a releasing state, the first communication terminal is allowed to send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data; when the second communication terminal is in a grabbing state and the first communication terminal is in a releasing state, the second communication terminal is allowed to send audio data to the first communication terminal through the session channel, and the first communication terminal receives the audio data.

[0014] In order to solve the above technical problems, another technical solution adopted by the present application is: providing a storage medium, on which program data is stored, characterized in that when the program data is executed by a processor, the steps of the above-mentioned fusion communication method are implemented.

[0015] To solve the above technical problems, another technical solution adopted in the present application is: to provide a computer device, which includes a processor and a memory connected to each other, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the above-mentioned fusion communication method are implemented.

[0016] The beneficial effects of the present application are as follows: Different from the prior art, the present application discloses a fusion communication method, system, storage medium and computer device. The present application controls the communication mode between the full-duplex communication terminal and the half-duplex communication terminal through the grabbing state and the releasing state, so that the full-duplex device can simulate the half-duplex communication mode, and can achieve seamless connection between the full-duplex communication terminal and the half-duplex communication terminal, improve the interoperability between different communication systems, and create a session channel based on the session request issued based on the real-time communication demand, and realize the dynamic switching of the communication mode in the session, so as to adapt to different communication scenarios. The simulation of the half-duplex communication mode also reduces unnecessary data transmission in the full-duplex communication mode, optimizes the use of spectrum and network resources, effectively prevents the confusion caused by multiple people speaking at the same time, ensures the clarity and order of communication, and makes the full-duplex device and the half-duplex device show better communication quality in harsh environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work, among which:

[0018] Figure 1 It is a flowchart of an embodiment of a fusion communication method provided by the present application;

[0019] Figure 2 yes Figure 1 A schematic flow chart of an embodiment of step 10 in the embodiment;

[0020] Figure 3 yes Figure 1 A schematic diagram of a flow chart of an embodiment after step 10 in the embodiment;

[0021] Figure 4 yes Figure 3 A schematic diagram of a flow chart of an embodiment of step 11 in the embodiment;

[0022] Figure 5 yes Figure 1 A schematic diagram of a flow chart of an embodiment after step 20 in the embodiment;

[0023] Figure 6 It is a structural diagram of an embodiment of a converged communication system 30 provided by the present application;

[0024] Figure 7 yes Figure 6 A schematic diagram of the structure of an embodiment of the core subsystem 31 in the embodiment;

[0025] Figure 8 Is applied to Figure 7 A schematic diagram of an interactive process of a converged communication method according to an embodiment;

[0026] Fig. 9 It is a structural schematic diagram of an embodiment of a storage medium provided by the present application;

[0027] Fig.10 It is a structural diagram of an embodiment of a computer device provided by the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0029] The terms "first", "second", "third" in the embodiments of the present application are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the feature defined as "first", "second", "third" can expressly or implicitly include at least one of the features. In the description of the present application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically limited. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices.

[0030] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0031] This application provides a fusion communication method, see Figure 1 , Figure 1 1 is a flow chart of an embodiment of a fusion communication method provided by the present application, the fusion communication method comprising:

[0032] Step 10: In response to a session request initiated by the first communication terminal, a session channel is established between the first communication terminal and the second communication terminal, and the first communication terminal is configured to be in a grabbing state and the second communication terminal is configured to be in a releasing state.

[0033] Step 20: In response to the first communication terminal switching from the grabbing state to the releasing state, the second communication terminal is notified that it can choose to switch from the releasing state to the grabbing state.

[0034] Among them, the first communication terminal is one of the full-duplex communication terminal and the half-duplex communication terminal, and the second communication terminal is the other of the full-duplex communication terminal and the half-duplex communication terminal; when the first communication terminal is in a grabbing state and the second communication terminal is in a releasing state, the first communication terminal is allowed to send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data; when the second communication terminal is in a grabbing state and the first communication terminal is in a releasing state, the second communication terminal is allowed to send audio data to the first communication terminal through the session channel, and the first communication terminal receives the audio data.

[0035] In this embodiment, the session request refers to a request sent by the first communication terminal for establishing a communication connection with the second communication terminal, and the session request covers instructions for the entire process from call initiation to connection establishment. The content of the session request usually includes a variety of information, such as the identity information of the requester, the requested communication type, the requested communication parameters, the requested peer, etc. After responding to the session request, the communication requirements corresponding to the session request can be analyzed, and a corresponding session channel can be established according to the communication parameters of the first communication terminal and the second communication terminal.

[0036] In this embodiment, a full-duplex communication terminal is a terminal device with a full-duplex communication mode, which can be a VoIP (Voice over Internet Protocol, voice transmission based on Internet protocol) device supporting full-duplex communication, a network card device supporting full-duplex communication, a communication device based on full-duplex communication protocols such as serial peripheral interface protocol and universal asynchronous receiver and transmitter protocol, etc. These devices can achieve high-quality voice communication on the Internet protocol network and achieve real-time and efficient two-way communication. A half-duplex communication terminal is a terminal device with a half-duplex communication mode, which can be a device in a cluster intercom system supporting half-duplex communication, a half-duplex intercom device, a communication device supporting half-duplex communication protocols such as integrated circuit bus protocol and controller area network bus protocol, etc.

[0037] In this embodiment, since the communication mode of the same standard between full-duplex communication terminals and half-duplex communication terminals is more common, this application focuses on explaining the communication between devices of two communication standards that are difficult to interoperate, that is, the first communication terminal is one of the full-duplex communication terminal and the half-duplex communication terminal, and the second communication terminal is the other of the full-duplex communication terminal and the half-duplex communication terminal. For example, the first communication terminal is a VoIP device for full-duplex communication, and the second communication terminal is one or more cluster intercom devices for half-duplex communication. For another example, the first communication terminal is a cluster intercom device for half-duplex communication, and the second communication terminal is one or more VoIP devices for full-duplex communication. Because the initiator of the request is usually determined by preset rules such as the initiation order or priority, the first communication terminal is usually one, and the second communication terminal can be one or more of the communication standards different from the first communication terminal, to achieve one-to-one point calls or one-to-many group calls, etc., to adapt to different, complex and diverse communication scenarios.

[0038] In this embodiment, grabbing and releasing are basic control mechanisms in half-duplex conversational communication. A communication terminal in the grabbing state will obtain the right to speak, allowing it to send audio data to other communication terminals, while preventing other users from speaking. A communication terminal in the releasing state will give up the right to speak, release channel resources, and stop sending audio data, while allowing other communication terminals to grab the right and receive audio data sent from the communication terminal in the grabbing state.

[0039] In this embodiment, by responding to a session request initiated by the first communication terminal, a session channel between the first communication terminal and the second communication terminal is established, and the first communication terminal is configured to be in a grabbing state, and the second communication terminal is configured to be in a releasing state, the communication mode of the full-duplex device can be effectively simulated as half-duplex communication by controlling the grabbing and releasing states, so as to realize communication between the full-duplex device and the half-duplex device, ensure effective communication between communication terminals of different communication formats, and improve the flexibility and adaptability of communication. The control of the grabbing and releasing states also optimizes the use of channel resources, reduces communication conflicts, improves communication efficiency, meets diversified communication needs, enables the system to handle more complex communication scenarios, improves the compatibility and scalability of the system, and enhances the compatibility and interoperability of communication between communication terminals.

[0040] In this embodiment, the state switching of the communication terminal can be achieved through a monitoring mechanism, or determined according to the signaling interaction during the switching process, or can be completed through a preset switching rule. For example, when the first communication terminal completes the transmission of audio data, the system can automatically switch its state from grabbing power to releasing power, and notify the second communication terminal to switch the state. Such a mechanism ensures the smoothness and real-time nature of communication, while avoiding communication conflicts and waste of resources. In addition, after a certain communication terminal switches its state, the notified opposite end can choose to switch the state. For example, after the communication terminal switches from the grabbing power state to the releasing power state, the notified opposite end can grab power, and after the communication terminal switches from the releasing power state to the grabbing power state, the opposite end can be notified to receive audio data. The corresponding notification method can be based on the signaling of the session channel, or based on the feedback mechanism of the state, and this application does not make specific limitations on this.

[0041] In this embodiment, after establishing a session channel between the first communication terminal and the second communication terminal, and configuring the first communication terminal to be in the grabbing state and the second communication terminal to be in the releasing state, the first communication terminal can send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data. Accordingly, when the first communication terminal switches from the grabbing state to the releasing state, the second communication terminal can be notified that it can choose to switch from the releasing state to the grabbing state. After switching to the grabbing state, the second communication terminal can also send audio data to the first communication terminal, and the first communication terminal receives the audio data.

[0042] This embodiment realizes effective communication between terminal devices of two different communication standards through the above-mentioned switching method of grabbing and releasing rights, ensures the continuity and stability of communication, and can dynamically adjust communication parameters according to the type and status of the communication terminal to adapt to different communication environments and needs, thereby further improving the flexibility and reliability of the communication system.

[0043] Optionally, see Figure 2 In one embodiment, in response to a session request initiated by the first communication terminal, a session channel between the first communication terminal and the second communication terminal is established, and the first communication terminal is configured to be in a grabbing state and the second communication terminal is configured to be in a releasing state, which can be performed according to the following steps:

[0044] Step 101: In response to a session request initiated by a first communication terminal, a session is created, and the first communication terminal is configured to be in a grabbing state.

[0045] Step 102: forwarding the session request to the second communication terminal to allow the second communication terminal to join the session, and configuring the second communication terminal to be in a release state.

[0046] Step 103: docking the session with the first communication terminal based on the first communication protocol, and docking the session with the second communication terminal based on the second communication protocol.

[0047] Step 104: Establish a protocol conversion between the first communication protocol and the second communication protocol to establish a session channel between the first communication terminal and the second communication terminal.

[0048] This optional embodiment specifies the process used to establish a session based on protocol conversion. When the first communication terminal initiates a session request, the corresponding peer and communication requirements of the session can be determined according to the session request, and then a new session instance is created for communication between the two communication terminals. The first communication terminal that explicitly initiates the session request is configured to be in a grabbing state, so that the first communication terminal has the right to send data at the beginning of the session. Thereafter, the session request is forwarded to the second communication terminal so that the second communication terminal understands the initiator of the session and the related communication requirements in order to join the session. After it joins the session, it is configured to be in a releasing state, so that the second communication terminal receives the data sent by the first communication terminal.

[0049] In this optional embodiment, the first communication protocol and the second communication protocol are the communication protocols used in the first communication terminal and the second communication terminal respectively, and they may be the same or different. For example, if the first communication terminal and the second communication terminal are both terminal devices based on the SIP protocol (Session Initiation Protocol), then the first communication protocol and the second communication protocol are both SIP protocols, and the first communication terminal and the second communication terminal may directly establish a session channel based on the SIP protocol. When the communication protocols used by the two are different, for example, if the first communication terminal uses the SIP protocol and the second communication terminal uses the H.323 protocol, it is necessary to establish a protocol conversion between the two, so that the input and output of the second communication terminal based on the H.323 protocol are converted to the SIP protocol, or the input and output of the first communication terminal based on the SIP protocol are converted to the H.323 protocol, so as to ensure that the two can communicate smoothly.

[0050] This optional embodiment can achieve effective communication between terminals of different communication protocols by processing the communication protocol. This conversion mechanism allows the system to flexibly handle the communication requirements of different protocols, further improving the compatibility and scalability of converged communications.

[0051] Optionally, see Figure 3 In one embodiment, after configuring the first communication terminal to be in a grabbing state and configuring the second communication terminal to be in a releasing state, the method further includes:

[0052] Step 11: Detect the interaction status of the first communication terminal.

[0053] Step 12: In response to determining that the interaction state is the stop state, the first communication terminal is notified that it can choose to switch from the grabbing state to the releasing state.

[0054] In this optional embodiment, the interactive state is a state used to characterize interactive activities between communication terminals. When the first communication terminal stops sending audio data in the grabbing state, the system detects this state change and sends a notification to the first communication terminal, prompting it to switch to the releasing state. Such a design allows the system to manage communication resources more intelligently, ensuring that during the communication process, when one party no longer needs to speak, channel resources can be released in time for other communication terminals to use, thereby improving overall communication efficiency. In addition, this mechanism can also reduce the waste of resources caused by communication terminals occupying channel resources for a long time without effective communication, further optimizing the performance of the communication system.

[0055] Optionally, see Figure 4 In one embodiment, detecting the interaction state of the first communication terminal includes:

[0056] Step 111: Detect voice activity information and mute information of the first communication terminal.

[0057] Step 112: In response to the voice activity information satisfying a preset voice activity stop condition and the mute information satisfying a preset mute condition, confirming that the interaction state is a stop state.

[0058] The preset voice activity stop condition indicates that the first communication terminal has not performed any voice activity, and the preset silence condition indicates that the first communication terminal is in a silence segment for a long time.

[0059] In this optional embodiment, the interaction state of the first communication terminal is specifically determined by voice activity information and mute information, wherein the voice activity information may include parameters such as the strength, frequency and duration of the voice signal, and the mute information involves the length and continuity of the mute segment. By analyzing these parameters, the system can accurately determine whether the first communication terminal is still conducting effective voice communication. For example, if the voice activity information shows that the voice signal strength of the first communication terminal is lower than a certain threshold and has lasted for a period of time, and the mute information indicates that the first communication terminal has been continuously silent for more than a preset time length, then the system can confirm that the interaction state is a stopped state.

[0060] In this optional embodiment, the voice activity information can be specifically realized by voice activity detection (VAD) technology. The voice activity detection technology is a technology that determines whether there is voice activity and distinguishes voice signals from various background noises by analyzing the energy, spectrum and other characteristics of the audio signal. It can be specifically realized by threshold discrimination methods based on parameters such as short-time energy detection and short-time zero-crossing rate, and model matching methods based on technologies such as Gaussian mixture models, vector machines, and deep neural networks. This application does not make specific restrictions on this. As long as it can effectively detect and obtain voice activity information, and can determine the state of voice activity stopping or voice activity in progress based on the obtained voice activity information. The silence information can be determined based on the characteristics of the silence segment in the audio signal, such as the length and continuity of the silence segment. This application does not make specific restrictions on this, as long as it can effectively detect the silence information and can determine whether the communication terminal is in a silence segment for a long time based on the obtained silence information.

[0061] In this optional embodiment, the preset voice activity stop condition and the preset mute condition can be set and adjusted according to the actual communication environment and needs. For example, the preset voice activity stop condition can be set to a voice signal strength of less than 50 decibels for more than 3 seconds, and the preset mute condition can be set to a mute segment length of more than 5 seconds. Such a setting allows the system administrator to flexibly adjust the system's judgment criteria for the interaction state according to different communication scenarios and user habits, so as to better adapt to various communication needs. This application also does not make specific limitations on this, as long as these conditions need to be able to correspondingly characterize the situation of voice activity cessation and mute conditions.

[0062] The detection mechanism of this optional embodiment helps the system to accurately evaluate the interactive state of the communication terminal, thereby making corresponding state switching decisions and optimizing the use of communication resources. It ensures that the system can dynamically adjust the state of the communication terminal according to the actual communication situation, thereby further improving the efficiency of communication resource use and the overall performance of communication interaction.

[0063] Optionally, in one embodiment, the converged communication method also includes: after the first communication terminal or the second communication terminal switches from a release state to a grab state, allowing the corresponding second communication terminal or the first communication terminal to trigger a release switch; after the first communication terminal or the second communication terminal switches from a grab state to a release state, allowing the corresponding second communication terminal or the first communication terminal to trigger a grab switch, and when it is determined that there are other first communication terminals or second communication terminals in a grab state, closing the permission for the grab switch.

[0064] In this optional embodiment, after the session is established and the right to speak is confirmed, the first communication terminal and the second communication terminal can be actively switched to adapt to the real-time changes in the speaking needs during the session. For example, when a communication terminal needs to speak in a meeting, it can actively switch to the right-grabbing state to obtain the right to speak, and when the terminal has finished speaking or no longer needs to speak, it can switch back to the right-releasing state and release the right to speak to other terminals that need to speak. Such a design not only improves the flexibility of communication, but also ensures the efficient conduct of the meeting. In addition, the system can also dynamically adjust the authority to grab and release rights according to the request of the communication terminal and the current communication status to prevent the chaos caused by multiple terminals grabbing rights at the same time and ensure the orderliness of the communication process. In this way, the converged communication system can better serve the complex communication environment of multiple terminals and multiple protocols and meet the diverse needs of modern communications.

[0065] In this optional embodiment, the release switching and the grabbing switching are actively initiated by the communication terminal, which can be implemented by setting a corresponding switching control at the communication terminal, receiving a command issued by the communication terminal, or detecting a user input of the communication terminal. For example, the grabbing switching can be implemented by PTT (Push-to-Talk) technology, and the communication terminal can be equipped with a button or an icon on the touch screen, and the user expresses the intention to switch the state by operating these controls. In addition, the system can also identify the user's switching request by parsing the specific instructions sent by the communication terminal. In some cases, the system can also automatically predict and trigger the state switching by analyzing the usage mode or behavior habits of the communication terminal, thereby further simplifying the user's operation process. Through these methods, the system can flexibly respond to the needs of the communication terminal and realize more intelligent and humanized communication management.

[0066] Optionally, see Figure 5 , after notifying the second communication terminal that it can choose to switch from the right-releasing state to the right-seizing state in response to the first communication terminal switching from the right-seizing state to the right-releasing state, further comprising:

[0067] Step 21: In response to receiving a right grabbing request from the second communication terminal, the second communication terminal is configured to be in a right grabbing state.

[0068] Step 22: In response to receiving the session termination request from the first communication terminal, sending a session termination notification to the second communication terminal, and clearing the resource information and status information of the session.

[0069] In this optional embodiment, the preemption request is a signal for requesting communication control rights, which is usually sent by the communication terminal when it needs to speak or send data. When the second communication terminal requests preemption, the system will immediately respond and allow it to switch to the preemption state, which can ensure the continuity and smoothness of communication. When the first communication terminal makes a request to end the session, it will send a session end notification to the second communication terminal accordingly, and clear the resource information and status information related to the session to release system resources and prepare for a new communication session.

[0070] This embodiment can effectively manage the life cycle of communication sessions by quickly responding to the right-grabbing request and cleaning up the session at the end, ensuring the efficiency and order of the communication process. By real-time monitoring of the state changes of the communication terminal and timely responding to various requests, unnecessary occupation of communication resources and potential communication conflicts are avoided. By cleaning up session resources, the system can provide a clean environment for subsequent communication activities, avoiding the problems of data residue and state confusion, and further enhancing the stability and reliability of the communication system.

[0071] Optionally, in one embodiment, the converged communication method further includes: buffering and storing audio data in the session channel, so that all audio data of the first communication terminal or the second communication terminal in the grabbing state is sent to the opposite end.

[0072] In this optional embodiment, buffer storage refers to the process of temporarily storing audio data, which allows the audio data sent by the communication terminal in the grabbing state to be buffered during the transmission process, ensuring that the data will not be lost due to network delays or packet loss. This mechanism is particularly suitable for communication environments with unstable network conditions or high delays, and can effectively reduce communication interruptions and incomplete data. After confirming that the buffered audio data has been sent successfully, the system will automatically clear the storage space to avoid occupying too many storage resources. In addition, when the communication terminal switches modes, the audio data that has not been fully transmitted can also be sent through buffering to ensure the integrity and fluency of the session.

[0073] Optionally, in one embodiment, the converged communication method further includes: storing the corresponding right-grabbing status or right-releasing status of the first communication terminal and the second communication terminal, so as to open the right to send audio data to the first communication terminal or the second communication terminal in the right-grabbing status, close the sending of audio data to the first communication terminal or the second communication terminal in the right-releasing status, and perform mute processing.

[0074] In this optional embodiment, state storage refers to the process of recording and saving the communication terminal's grabbing state or releasing state information. The system can ensure that the sending authority of audio data can be accurately controlled at any time by updating and maintaining these state information in real time. When the communication terminal is in the grabbing state, the system will open the corresponding sending authority, allowing the terminal to send audio data to the other end, and when the terminal is in the releasing state, it will close the sending authority and perform mute processing to prevent unnecessary audio interference. This state storage mechanism not only improves the efficiency of managing the interactive state communication of multiple communication terminals, but also enhances the controllability and flexibility of the system, and can ensure that in a multi-terminal communication environment, each terminal can communicate effectively at the appropriate time, while avoiding conflicts and confusion of audio data.

[0075] In this optional embodiment, the state storage can be stored through a memory hash table or NoSQL (Not Only Structured Query Language) and other storage methods. The implementation method of the state storage can be flexibly selected to adapt to different system architectures and performance requirements to ensure the scalability and maintainability of converged communications.

[0076] In this optional embodiment, in addition to storing the communication status of grabbing and releasing the right, the state storage can also store the identifier of the communication terminal, the communication type of the communication terminal full-duplex or half-duplex, and the identification information of the current session. By managing the storage of this information, the system can quickly retrieve and update the state of the communication terminal, thereby achieving efficient and accurate communication control. Through this state storage mechanism, the communication system can respond to the state changes of the communication terminal in real time and adjust the sending authority of the audio data in time, thereby ensuring the smoothness and efficiency of the communication process.

[0077] See also Figure 6 , Figure 6 It is a structural diagram of an embodiment of a converged communication system 30 provided in the present application.

[0078] The converged communication system 30 includes: a core subsystem 31 and a first communication terminal 32 and a second communication terminal 33 that are communicatively connected to the core subsystem 31; the core subsystem 31 responds to a session request initiated by the first communication terminal 32, establishes a session channel between the first communication terminal 32 and the second communication terminal 33, and configures the first communication terminal 32 to be in a power grabbing state and the second communication terminal 33 to be in a power releasing state; the core subsystem 31 responds to the first communication terminal 32 switching from the power grabbing state to the power releasing state, notifying the second communication terminal 33 that it can choose to switch from the power releasing state to the power grabbing state; wherein, the first communication terminal 32 is one of the full-duplex communication terminal and the half-duplex communication terminal, and the second communication terminal 33 is the other of the full-duplex communication terminal and the half-duplex communication terminal; when the first communication terminal 32 is in a grabbing state and the second communication terminal 33 is in a releasing state, the first communication terminal 32 is allowed to send audio data to the second communication terminal 33 through the session channel, and the second communication terminal 33 receives the audio data; when the second communication terminal 33 is in a grabbing state and the first communication terminal 32 is in a releasing state, the second communication terminal 33 is allowed to send audio data to the first communication terminal 32 through the session channel, and the first communication terminal 32 receives the audio data.

[0079] See also Figure 7 , Figure 7 yes Figure 6 A schematic diagram of the structure of an embodiment of the core subsystem 31 in the embodiment.

[0080] Optionally, the core subsystem 31 includes a core module 311, which specifically adopts the core module 311 in the core subsystem 31 to respond to a session request initiated by the first communication terminal 32, establish a session channel between the first communication terminal 32 and the second communication terminal 33, and configure the first communication terminal 32 to a power-grabbing state and the second communication terminal 33 to a power-releasing state; and adopts the core module 311 to respond to the first communication terminal 32 switching from the power-grabbing state to the power-releasing state, to notify the second communication terminal 33 that it can choose to switch from the power-releasing state to the power-grabbing state.

[0081] Optionally, the core subsystem 31 also includes a detection module 312 and a communication mode switching module 313, wherein the detection module 312 is used to detect the interaction state of the first communication terminal 32, and the communication mode switching module 313 is used to notify the first communication terminal 32 that it can choose to switch from the right-grabbing state to the right-releasing state in response to determining that the interaction state is a stop state.

[0082] Optionally, the detection module 312 includes a voice activity detection module 312a and a silence detection module 312b, wherein the voice activity detection module 312a is used to detect the voice activity information of the first communication terminal 32; the silence detection module 312b is used to detect the silence information of the first communication terminal 32; the core module 311 is also used to confirm that the interaction state is a stop state in response to the voice activity information satisfying a preset voice activity stop condition and the silence information satisfying a preset silence condition. The preset voice activity stop condition indicates that the first communication terminal 32 has not performed any voice activity, and the preset silence condition indicates that the first communication terminal 32 is in a silence segment for a long time.

[0083] Optionally, the core module 311 is also used to allow the corresponding second communication terminal 33 or first communication terminal 32 to trigger the power release switch after the first communication terminal 32 or the second communication terminal 33 switches from the power release state to the power grabbing state; after the first communication terminal 32 or the second communication terminal 33 switches from the power grabbing state to the power release state, allow the corresponding second communication terminal 33 or first communication terminal 32 to trigger the power grabbing switch, and when it is determined that there are other first communication terminals 32 or second communication terminals 33 in the power grabbing state, turn off the permission for the power grabbing switch.

[0084] Optionally, the core subsystem 31 also includes a protocol conversion module 314, and the core module 311 is also used to: create a session in response to a session request initiated by the first communication terminal 32, and configure the first communication terminal 32 to a power-grabbing state; forward the session request to the second communication terminal 33 to allow the second communication terminal 33 to join the session, and configure the second communication terminal 33 to a power-releasing state; dock the session with the first communication terminal 32 based on the first communication protocol, and dock the session with the second communication terminal 33 based on the second communication protocol; establish a protocol conversion between the first communication protocol and the second communication protocol based on the protocol conversion module 314 to establish a session channel between the first communication terminal 32 and the second communication terminal 33.

[0085] Optionally, the core subsystem 31 also includes a status storage area module 315, and the core module 311 is also used to: in response to receiving a rights grabbing request from the second communication terminal 33, configure the second communication terminal 33 to a rights grabbing state; in response to receiving a session end request from the first communication terminal 32, send a session end notification to the second communication terminal 33, and clean up the resource information and status information of the session in the status storage area module 315.

[0086] Optionally, the core subsystem 31 further includes a buffer management module 316, which is used to buffer and store audio data in the session channel so that all audio data of the first communication terminal 32 or the second communication terminal 33 in the grabbing state is sent to the other end.

[0087] Optionally, the status storage area module 315 is used to store the status of the corresponding right-grabbing status or right-releasing status of the first communication terminal 32 and the second communication terminal 33. The core module 311 is also used to open the audio data sending permission for the first communication terminal 32 or the second communication terminal 33 in the right-grabbing state based on the status storage in the status storage area module 315, and close the audio data sending for the first communication terminal 32 or the second communication terminal 33 in the right-releasing state, and perform mute processing.

[0088] Since the embodiments of the system part correspond to the embodiments of the above method, please refer to the above method embodiments for the introduction of the fusion communication system 30 provided in the embodiments of the present invention. The embodiments of the present invention will not be repeated here, and it has the same beneficial effects as the above fusion communication method.

[0089] See also Figure 8 , Figure 8 The interactive flow diagram of a fusion communication method is a diagram of an interactive flow diagram of a communication interaction between a full-duplex first communication terminal 32 and a half-duplex second communication terminal 33. The fusion communication method is applied to Figure 7 In the described core subsystem 31, the core subsystem 31 is connected to the first communication terminal 32 and the second communication terminal 33 outside the subsystem respectively, and the core module 311 is used as the logical body. The stages of the fusion communication method include:

[0090] Phase 1: Initialization phase:

[0091] (1.1) The core module 311 receives a session request from the first communication terminal 32;

[0092] (1.2) The core module 311 creates a session, configures the first communication terminal 32 to be in a preemptive state, and stores the state of the session and the preemptive state of the first communication terminal 32 in the state storage area module 315;

[0093] (1.3) The core module 311 forwards the session request to the second communication terminal 33;

[0094] (1.4) The core module 311 configures the second communication terminal 33 to be in a release state, and stores the release state of the second communication terminal 33 in the state storage area module 315; and allows the first communication terminal 32 to perform a release switch, and stores the release switch state of the first communication terminal 32 in the state storage area module 315;

[0095] (1.5) The core module 311 connects to the first communication terminal 32 based on the first communication protocol to obtain a first channel;

[0096] (1.6) The core module 311 connects to the second communication terminal 33 based on the second communication protocol to obtain a second channel;

[0097] (1.7) The core module 311 establishes a protocol conversion between the first channel and the second channel through the protocol conversion module 314 to determine the session channel;

[0098] Phase 2: Cycle Phase:

[0099] (2.1) The core receives audio data from the first communication terminal 32;

[0100] (2.2) The core module 311 detects the interaction status of the first communication terminal 32 through the detection module 312;

[0101] (2.3) In response to detecting that the interaction state of the first communication terminal 32 is not in the stop state, the core module 311 forwards the audio data to the second communication terminal 33;

[0102] (2.4) In response to detecting that the interaction state of the first communication terminal 32 is in the stopped state, the core module 311 prompts the first communication terminal 32 to allow the release of the switching based on the communication mode switching module 313;

[0103] (2.5) The core module 311 receives the release switch triggered by the first communication terminal 32;

[0104] (2.6) The core module 311 stores the release status of the first communication terminal 32 in the status storage area module 315;

[0105] (2.7) The core module 311 performs authority control on the first communication terminal 32;

[0106] (2.8) The core module 311 sends a notification to the second communication terminal 33 to allow the second communication terminal 33 to perform the preemptive switching;

[0107] (2.9) The core module 311 monitors the right grabbing request of the second communication terminal 33;

[0108] (2.10) In response to receiving the right grabbing request from the second communication terminal 33, the core module 311 configures the second communication terminal 33 to be in the right grabbing state, allows the second communication terminal 33 to perform the right release switching, and stores the right releasable switching state of the second communication terminal 33 in the state storage area module 315;

[0109] (2.11) The core module 311 notifies the first communication terminal 32 to receive the audio data of the second communication terminal 33;

[0110] (2.12) The core module 311 receives the audio data sent by the second communication terminal 33;

[0111] (2.13) The core module 311 forwards the audio data sent by the second communication terminal 33 to the first communication terminal 32;

[0112] Phase 3: Ending phase:

[0113] (3.1) The core module 311 receives a call end request sent by the first communication terminal 32;

[0114] (3.2) The core module 311 sends a call end notification to the second communication terminal 33;

[0115] (3.3) The core module 311 instructs the state storage area module 315 to clean up the resources and state information of the session.

[0116] Since some embodiments of the method are based on the embodiments of the above-mentioned system and correspond to the embodiments of the previous method, please refer to the introduction of the above-mentioned method embodiments and system embodiments for the introduction of the interactive process method provided in the embodiments of the present invention. This embodiment will not be repeated here, and it has the same beneficial effects as the above-mentioned integrated communication method and system.

[0117] In this embodiment, it should be noted that the protocol conversion module 314 is used to establish a session channel in the initialization phase and continuously maintains operation in the cyclic communication phase to ensure the progress of the session. Figure 8 The communication mode switching module 313 is used to determine the rules for switching between the grabbing state and the releasing state of the first communication terminal 32 and the second communication terminal 33 according to the result of the detection module 312. It is applied for a long time in the cycle stage. Figure 8 The buffer management module 316 is used for data buffering during the transmission of audio data, and can also be used for buffering processing during the transmission of other signaling, which is also a long-term process. Figure 8 The illustration is simplified and not shown, and the relevant details can be referred to the description of the aforementioned method embodiment.

[0118] In this embodiment, the initial stage and the end stage are both marked by the start of a specific request from the first communication terminal 32, and the loop stage between the two stages can be repeated multiple times. Different audio data transmission methods are used according to the communication modes of grabbing and releasing power of the first communication terminal 32 and the second communication terminal 33, so as to realize the simulation of half-duplex communication by full-duplex communication, ensure the seamless connection between full-duplex communication terminals and half-duplex communication terminals, improve the interoperability between different communication systems, effectively reduce unnecessary data transmission in full-duplex communication mode, optimize the use of spectrum and network resources, effectively prevent confusion caused by multiple people speaking at the same time, ensure the clarity and order of communication, and enable full-duplex equipment and half-duplex equipment to exhibit better communication quality and interoperability performance in harsh environments.

[0119] See also Fig. 9 , Fig. 9 It is a structural diagram of an embodiment of the storage medium provided by the present application.

[0120] The storage medium 40 stores program data 41. When the program data 41 is executed by the processor, the following is achieved: Figures 1 to 5 The described converged communication method.

[0121] The program data 41 is stored in a storage medium 40, and includes a number of instructions for enabling a network device (such as a router, a personal computer, a server, or other network device) or a processor to execute all or part of the steps of the methods of the various embodiments of the present application.

[0122] Optionally, the storage medium 40 may be a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, or other medium that can store the program data 41 .

[0123] See also Fig.10 , Fig.10 It is a structural schematic diagram of an embodiment of a computer device provided by the present application.

[0124] The computer device 50 includes a processor 52 and a memory 51 connected to each other. The memory 51 stores a computer program. When the processor 52 executes the computer program, the following is achieved: Figures 1 to 5 The described converged communication method. The memory 51 may include the storage medium 40, or may be other independently developed memory.

[0125] Different from the prior art, the present application discloses a converged communication method, system, storage medium and computer device. The communication mode between the full-duplex communication terminal and the half-duplex communication terminal is controlled through the grabbing state and the releasing state, so that the full-duplex device can simulate the half-duplex communication mode, and can achieve seamless connection between the full-duplex communication terminal and the half-duplex communication terminal, improve the interoperability between different communication systems, and create a session channel based on the session request issued based on the real-time communication demand, and realize the dynamic switching of the communication mode in the session, so as to adapt to different communication scenarios. The simulation of the half-duplex communication mode also reduces unnecessary data transmission in the full-duplex communication mode, optimizes the use of spectrum and network resources, effectively prevents the confusion caused by multiple people speaking at the same time, ensures the clarity and order of communication, and enables full-duplex devices and half-duplex devices to show better communication quality in harsh environments.

[0126] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, storage medium embodiment and computer embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0127] The present application can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc.

[0128] In the several embodiments provided in this application, it should be understood that the disclosed methods, systems, storage media, and computer devices can be implemented in other ways. For example, the system implementation described above is only illustrative, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0129] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0130] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0131] The above descriptions are merely embodiments of the present application and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A fusion communication method, characterized in that: include: In response to a session request initiated by a first communication terminal, establish a session channel between the first communication terminal and a second communication terminal, and configure the first communication terminal to be in a grabbing state and the second communication terminal to be in a releasing state; In response to the first communication terminal switching from the grabbing state to the releasing state, notifying the second communication terminal that it can choose to switch from the releasing state to the grabbing state; The first communication terminal is one of a full-duplex communication terminal and a half-duplex communication terminal, and the second communication terminal is the other of the full-duplex communication terminal and the half-duplex communication terminal; when the first communication terminal is in a grabbing state and the second communication terminal is in a releasing state, the first communication terminal is allowed to send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data; When the second communication terminal is in a power grabbing state and the first communication terminal is in a power releasing state, the second communication terminal is allowed to send audio data to the first communication terminal through the session channel, and the first communication terminal receives the audio data.

2. The fusion communication method according to claim 1, characterized in that: After configuring the first communication terminal to be in a power grabbing state and configuring the second communication terminal to be in a power releasing state, the method further includes: detecting an interaction state of the first communication terminal; In response to determining that the interaction state is a stop state, the first communication terminal is notified that it can choose to switch from a grabbing right state to a releasing right state.

3. The fusion communication method according to claim 2, characterized in that: The detecting the interaction state of the first communication terminal includes: detecting voice activity information and mute information of the first communication terminal; In response to the voice activity information satisfying a preset voice activity stop condition and the mute information satisfying a preset mute condition, confirming that the interaction state is the stop state; The preset voice activity stop condition indicates that the first communication terminal has not performed any voice activity, and the preset silence condition indicates that the first communication terminal is in a silence segment for a long time.

4. The fusion communication method according to claim 1, characterized in that: The step of establishing a session channel between the first communication terminal and the second communication terminal in response to a session request initiated by the first communication terminal, configuring the first communication terminal to be in a grabbing state, and configuring the second communication terminal to be in a releasing state, comprises: In response to a session request initiated by the first communication terminal, create a session and configure the first communication terminal to be in a grabbing state; forwarding the session request to the second communication terminal to allow the second communication terminal to join the session, and configuring the second communication terminal to be in a release state; connecting the session to the first communication terminal based on a first communication protocol, and connecting the session to the second communication terminal based on a second communication protocol; A protocol conversion is established between the first communication protocol and the second communication protocol to establish the session channel between the first communication terminal and the second communication terminal.

5. The fusion communication method according to claim 1, characterized in that: After the first communication terminal is in response to switching from the grabbing state to the releasing state, notifying the second communication terminal that it can choose to switch from the releasing state to the grabbing state, the method further includes: In response to receiving the right grabbing request from the second communication terminal, configuring the second communication terminal to be in a right grabbing state; In response to receiving the session termination request from the first communication terminal, sending a session termination notification to the second communication terminal, and clearing resource information and state information of the session.

6. The fusion communication method according to claim 1, characterized in that: The fusion communication method further includes: The audio data in the session channel is buffered and stored, so that all the audio data of the first communication terminal or the second communication terminal in the grabbing state is sent to the opposite end.

7. The fusion communication method according to claim 1, characterized in that: The fusion communication method further includes: The corresponding right-grabbing state or right-releasing state of the first communication terminal and the second communication terminal is stored in status, so as to open the permission to send audio data to the first communication terminal or the second communication terminal in the right-grabbing state, close the sending of audio data to the first communication terminal or the second communication terminal in the right-releasing state, and perform mute processing.

8. A converged communication system, characterized in that: include: A core subsystem and a first communication terminal and a second communication terminal communicatively connected to the core subsystem; The core subsystem establishes a session channel between the first communication terminal and the second communication terminal in response to a session request initiated by the first communication terminal, and configures the first communication terminal to be in a grabbing state and the second communication terminal to be in a releasing state; In response to the first communication terminal switching from the grabbing state to the releasing state, the core subsystem notifies the second communication terminal that it can choose to switch from the releasing state to the grabbing state; The first communication terminal is one of a full-duplex communication terminal and a half-duplex communication terminal, and the second communication terminal is the other of the full-duplex communication terminal and the half-duplex communication terminal; when the first communication terminal is in a grabbing state and the second communication terminal is in a releasing state, the first communication terminal is allowed to send audio data to the second communication terminal through the session channel, and the second communication terminal receives the audio data; When the second communication terminal is in a power grabbing state and the first communication terminal is in a power releasing state, the second communication terminal is allowed to send audio data to the first communication terminal through the session channel, and the first communication terminal receives the audio data.

9. A storage medium having program data stored thereon, characterized in that: When the program data is executed by a processor, the steps of the converged communication method according to any one of claims 1 to 7 are implemented.

10. A computer device, characterized in that: The method comprises a processor and a memory connected to each other, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the converged communication method according to any one of claims 1 to 7 are implemented.

Images