A method for handling abnormal video network connection
Through the time series encoding detection and policy selection of the signaling server, the problems of network exception determination and processing are solved, and the continuity of video call service and the improvement of customer experience are achieved.
Patent Information
- Application Number
- CN202210978477.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-16
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-08-16
AI Technical Summary
When multiple clients and multiple agents are connected at the same time, in the case of network abnormality, the existing technology is difficult to accurately judge the degree of network abnormality, resulting in frequent interruptions of video calls or reconnection of original service scenarios, which is extremely poor in customer experience .
Through the signaling server, the video network status of the client or agent is detected in real time according to the time series encoding, the number of heartbeats, error coefficient and time-consuming ratio are calculated, the network abnormality confidence value is calculated, the degree of network abnormality is determined, and the corresponding strategy is selected according to different situations Conduct responses, including handling of disconnection between clients, agents or both parties at the same time.
Accurately determine the degree of network abnormalities, avoid frequent and heavy connections caused by misjudgment, ensure the continuity of video call services, and improve the fluency and experience of customer service services.
Smart Images

Figure CN115567417B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of network communication technology, and in particular to a method for handling abnormal video network connection. Background Art
[0002] The remote virtual counter terminal is a point-to-point video call service terminal based on WebRTC (web real-time communication). Its basic logic is that customers use the terminal to conduct one-to-one audio and video calls with remote agents using WebRTC technology to seek business processing and consultation, and register relevant business information. Usually under the WebRTC framework, both the client and the agent need to negotiate and exchange network information with each other through the signaling server and the stun server to establish a point-to-point connection. After the connection is successful, audio and video calls can be made.
[0003] When multiple clients and multiple agents are connected at the same time, the signaling server needs to schedule through signaling, that is, when the client calls, the signaling server needs to find a suitable idle agent to answer, so that it can exchange information and connect with the client. Network anomalies include network disconnection and abnormal network fluctuations. Currently, there is a lack of an accurate and reliable means to measure the degree of network anomalies. As a result, when network anomalies occur, the network connection server will try to connect frequently through the backup network address in the network information exchanged by the two parties before. After all addresses have failed, the point-to-point connection between the two parties (agents, customers) will be disconnected; generally, the signaling server only serves as a signaling relay and cannot intervene in the communication between the two parties in time. If reconnection is required, the client needs to re-initiate the call. At this time, the signaling server will reallocate the service agent, causing the original service scene to change, the original business handling process will be interrupted, and the relevant business information registered by the agent will also be lost, resulting in a very poor customer experience. Summary of the invention
[0004] The purpose of the present invention is to address the problem in the prior art that video calls are frequently interrupted due to video network anomalies, or that the original video service scene changes after reconnection, resulting in poor customer experience. A method for handling video network connection anomalies is proposed, which can judge the degree of network anomalies according to the network connection status, and select corresponding response strategies according to the degree of network anomalies and abnormal situations, thereby improving the fluency and experience of video inquiries for customer service business.
[0005] A technical solution provided in an embodiment of the present invention is a method for handling abnormal video network connection, comprising the following steps:
[0006] The signaling server detects the video network status information of the client or / and the agent in real time according to the time series coding;
[0007] If it is detected that the video network connection of the client or / and the agent is abnormal; determine the situation of abnormal video network connection;
[0008] Select the corresponding strategy to deal with the abnormal video network connection situation.
[0009] In this solution, after the client and the agent end establish network connection, the signaling server monitors the network status in real time according to the time series coding. When an abnormality in the video network connection is detected, it further determines which end of the network has an abnormality. According to different network abnormalities, the corresponding network connection strategy is selected, thereby improving the fluency and experience of customer service video inquiries.
[0010] Preferably, the time series code includes a first detection time period and a second detection time period, and the first detection time period and the second detection time period are alternately woven to form the time series code;
[0011] The signaling server records the video network status information of the client and / or the agent in real time according to the time series coding.
[0012] Preferably, the determining whether the video network connection is abnormal comprises the following steps:
[0013] Calculate the number of heartbeats received during the first detection time period;
[0014] Calculate the maximum error value of the heartbeat frequency received during the second detection time period;
[0015] Calculate the duration ratio of the effective network traffic received in the first detection time period and the second detection time period;
[0016] The network anomaly confidence value X is calculated by integrating the number of heartbeats, error coefficient and duration ratio. If the network anomaly confidence value X is in the network anomaly confidence interval [X1, X2], the network is judged to be abnormal; where X1 is the lower limit confidence value of the network anomaly, and X2 is the upper limit confidence value of the network anomaly.
[0017] As a preferred method, the network anomaly confidence value X is calculated by integrating the number of heartbeats, the error coefficient, and the duration ratio. The formula is as follows:
[0018]
[0019] Wherein, λ1 is the normalization coefficient of the number of heartbeats, λ2 is the normalization coefficient of the heartbeat frequency, λ3 is the normalization coefficient of the network effective flow, a is the number of heartbeats recorded in the first detection time period; A is the number of heartbeats set in the first detection time period; b0 is the heartbeat frequency setting value in the second detection time period; b max is the maximum value of the heart rate recorded in the second detection time period; bmin is the minimum value of the heart rate frequency record within the second detection time period; T c is the duration value of the effective network traffic received within the first detection time period and the second detection time period. T1 is the duration value of the first detection time period, and T2 is the duration value of the second detection time period.
[0020] Preferably, according to the situation of abnormal video network connection, select the corresponding strategy to deal with it, including the following steps: The situation of abnormal video network connection includes client disconnection event, agent disconnection event, and client and agent disconnection event at the same time;
[0021] If a client disconnection event occurs, adopt Strategy 1 for handling;
[0022] If an agent disconnection event occurs, adopt Strategy 2 for handling;
[0023] If a client and agent disconnection event occurs at the same time, adopt Strategy 3 for handling.
[0024] Preferably, Strategy 1:
[0025] The signaling server sends a signaling message to the agent to inform it that a disconnection event has occurred;
[0026] The agent resets the network connection service and waits for the next signaling;
[0027] When T_max > T_current, the client network recovers and reconnects to the signaling server. The signaling server then sends a signaling to the client to inform it to resend the network negotiation signaling and connect to the current agent to complete the connection;
[0028] When T_max < T_current, that is, the client cannot reconnect for a long time, the signaling server sends a signaling message to the current agent to inform it to save the current business data and progress and exit, reset the network connection service, and the signaling server also saves this abnormal event for subsequent business processing, where T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
[0029] Preferably, Strategy 2:
[0030] The signaling server sends a signaling message to the client to inform it that a disconnection event has occurred;
[0031] The client resets the network connection service and waits for the next signaling;
[0032] When T_max > T_current, the network at the agent end is restored, and it accesses the signaling server. The signaling server then sends a signal to the client to inform it that it should re-initiate the network negotiation signal to connect to the current agent end and complete the connection.
[0033] When T_max < T_current, that is, when the agent end cannot reconnect for a long time, the signaling server sends a signaling message to the client, exits and resets the network connection service, and prompts the client that the network is abnormal. The signaling server saves this abnormal event for subsequent business processing. Here, T_max represents the maximum network connection waiting time; T_current represents the actual network connection waiting time.
[0034] Preferably, Strategy Three:
[0035] The signaling server saves the unique identification address TClientID of the current client and the unique identification address TServerID of the agent end. When T_max > T_current, when either the client or the agent end goes online, the signaling server sends a signal to inform it to wait for reconnection. After both are online, the signaling server then informs the client corresponding to the unique identification address TClientID to re-initiate the network negotiation signal to connect to the agent end with the current unique identification address TServerI and complete the connection.
[0036] When T_max < T_current, that is, when both the client and the agent end cannot reconnect for a long time, the signaling server saves this abnormal event for subsequent business processing. Here, T_max represents the maximum network connection waiting time; T_current represents the actual network connection waiting time.
[0037] The beneficial effects of the present invention: The present invention proposes a method for disposing of video network connection anomalies, which can judge the degree of network anomalies according to the network connection status. Specifically, the network anomaly confidence value X is calculated by fusing three dimensions: the number of heartbeats, the error coefficient, and the duration ratio. According to the position of the network anomaly confidence value X in the network anomaly confidence interval [X1, X2], the degree of network anomaly can be accurately determined, avoiding the situation of frequent network reconnection caused by misjudgment; further, when it is determined that the network has an abnormal situation and the corresponding coping strategy is selected according to the network abnormal situation, after the business terminal for online video processing, it can continue to enter the original service scenario to handle business, ensuring the continuity of the service, and further improving the fluency and experience of the video inquiry of the customer service business.
[0038] The above invention content is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Other features, objects and advantages of the present invention will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings. The drawings are only for the purpose of illustrating preferred embodiments and are not to be considered as limiting the present invention. Also, the same reference symbols are used throughout the drawings to represent the same parts.
[0040] Figure 1 The present invention is a flowchart of a method for handling abnormal video network connection.
[0041] Figure 2 A schematic diagram of a process flow of strategy 1 adopted in an embodiment of the present invention.
[0042] Figure 3 This is a flow chart of Strategy 2 adopted in an embodiment of the present invention.
[0043] Figure 4 This is a schematic diagram of the strategy three process adopted in the embodiment of the present invention. DETAILED DESCRIPTION
[0044] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific implementation method described herein is only an optimal embodiment of the present invention, which is only used to explain the present invention and does not limit the scope of protection of the present invention. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.
[0045] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the operations (or steps) as sequential processes, many of the operations (or steps) therein can be implemented in parallel, concurrently, or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the drawings; the process can correspond to a method, function, procedure, subroutine, subprogram, etc.
[0046] Example: Figure 1 As shown, a method for handling abnormal video network connection includes the following steps:
[0047] S1. The signaling server detects the video network status information of the client or / and the agent in real time according to the time series coding;
[0048] S2. If it is detected that the video network connection of the client or / and the agent is abnormal, determine the situation of abnormal video network connection;
[0049] S3. Select a corresponding strategy to deal with the abnormal video network connection.
[0050] In this embodiment, after the client and the agent end establish network connection, the signaling server monitors the network status in real time according to the time series coding. When an abnormal video network connection is detected, it further determines which end of the network has an abnormal situation. According to different network abnormal situations, the corresponding network connection strategy is selected, thereby improving the fluency and experience of customer service video inquiries.
[0051] The time series code includes a first detection time period and a second detection time period, and the first detection time period and the second detection time period are alternately woven to form the time series code;
[0052] The signaling server records the video network status information of the client and / or the agent in real time according to the time series coding.
[0053] As an example, if the heartbeat period of a normal network connection is 0.2s, the duration of the first detection time period can be set to 5s, and the duration of the second detection time period can be set to 2s, so the detection period of the time series coding is 7s.
[0054] The method of determining that the video network connection is abnormal comprises the following steps:
[0055] Calculate the number of heartbeats received during the first detection time period;
[0056] Calculate the maximum error value of the heartbeat frequency received during the second detection time period;
[0057] Calculate the duration ratio of the effective network traffic received in the first detection time period and the second detection time period;
[0058] The network anomaly confidence value X is calculated by integrating the number of heartbeats, error coefficient and duration ratio. If the network anomaly confidence value X is in the network anomaly confidence interval [X1, X2], the network is judged to be abnormal; where X1 is the lower limit confidence value of the network anomaly, and X2 is the upper limit confidence value of the network anomaly.
[0059] As a preferred method, the network anomaly confidence value X is calculated by integrating the number of heartbeats, the error coefficient, and the duration ratio. The formula is as follows:
[0060]
[0061] Wherein, λ1 is the normalization coefficient of the number of heartbeats, λ2 is the normalization coefficient of the heartbeat frequency, λ3 is the normalization coefficient of the network effective flow, a is the number of heartbeats recorded in the first detection time period; A is the number of heartbeats set in the first detection time period; b0 is the heartbeat frequency setting value in the second detection time period; b max is the maximum value of the heart rate recorded in the second detection time period; b min is the minimum value of the heart rate recorded in the second detection time period; T c is the duration of the effective network traffic received in the first detection time period and the second detection time period, T1 is the duration of the first detection time period, and T2 is the duration of the second detection time period.
[0062] In this embodiment, λ1+λ2+λ3=1, wherein the proportions of abnormal heartbeat number, abnormal frequency and abnormal network effective flow are manually set. For example, among the factors of network connectivity quality, the influence of abnormal network effective flow is the highest, and the corresponding normalization coefficient is the largest; the influence of abnormal frequency is the smallest, and the corresponding normalization coefficient is the smallest; the corresponding normalization coefficient is the largest, for example: λ3 is set to 0.5; λ2 is 0.1, and λ1 is 0.4, and the network anomaly confidence value X is obtained by comprehensive calculation; setting the network anomaly confidence interval [0.8, 1] indicates that the network connection is abnormal, and the phenomenon reflected by the network connection abnormality is that the quality of the video call has caused the customer's business to be unable to be handled normally.
[0063] Preferably, according to the situation of abnormal video network connection, a corresponding strategy is selected to deal with it, including the following steps: the situation of abnormal video network connection includes a client disconnection event, an agent disconnection event, and a client and agent disconnection event at the same time;
[0064] If a client disconnection event occurs, strategy 1 is used for handling;
[0065] If the agent disconnects, Strategy 2 is used to handle the situation.
[0066] If both the client and the agent are disconnected at the same time, strategy three will be used to handle it.
[0067] Among them, strategy one:
[0068] The signaling server sends a signaling message to the agent to inform it of the disconnection event;
[0069] The agent resets the network connection service and waits for the next signaling;
[0070] When T_max > T_current, the client network recovers and reconnects to the signaling server. The signaling server then sends a signaling message to the client to inform it to resend the network negotiation signaling to connect to the current agent side and complete the connection.
[0071] When T_max < T_current, that is, when the client cannot reconnect for a long time, the signaling server sends a signaling message to the current agent side to inform it to save the current service data and progress and then exit, and reset the network connection service. The signaling server also saves this exception event for subsequent service processing. Here, T_max represents the maximum network connection waiting time; T_current represents the actual network connection waiting time.
[0072] Specifically, as shown in Figure 2 If a disconnection event occurs at TClient (client), the signaling server sends a signaling message sigling_wait_and_reset to TServer (agent side) to inform it of the disconnection event. TServer resets the webrtc connection to the initial state (invokes the interfaces for resource release and connection disconnection in the webrtc api to release audio and video hardware resources and related network resources) and waits for the next signaling. When T_max > T_current, the TClient network recovers and connects to the signaling server. The signaling server then sends a signaling sigling_reconnect to the TClient to inform it that it should resend the network negotiation signaling to connect to the current TServer and complete the connection, and then the connection is restored. When T_max < T_current, that is, when the TClient cannot reconnect for a long time, the signaling server sends a signaling message sigling_quit_and_reset to the TServer to inform it to save the current service data and progress and then exit and reset the webrtc connection (invokes the interfaces for resource release and connection disconnection in the webrtc api to release audio and video hardware resources and related network resources). The signaling server also saves this exception event for subsequent service processing.
[0073] Among them, Policy 2:
[0074] The signaling server sends a signaling message to the client to inform it of the disconnection event.
[0075] The client resets the network connection service and waits for the next signaling.
[0076] When T_max > T_current, the agent side network recovers and connects to the signaling server. The signaling server then sends a signaling message to the client to inform it that it should resend the network negotiation signaling to connect to the current agent side and complete the connection.
[0077] When T_max < T_current, that is, when the agent end cannot reconnect for a long time, the signaling server sends a signaling message to the client, exits and resets the network connection service, prompts the client that the network is abnormal, and the signaling server saves this abnormal event for subsequent business processing; where T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
[0078] Specifically, see Figure 3 As shown, if a disconnection event occurs on TServer, the signaling server sends a signaling message sigling_wait_and_reset to TClient, informing it that the disconnection event has occurred. TClient resets the webrtc connection to the initial state and waits to receive the next signaling. When T_max > T_current, the TServer network recovers and accesses the signaling server. The signaling server then sends a signaling sigling_reconnect to TClient, informing it that it should re-initiate the network negotiation signaling to connect with the current TServer. After the connection is completed, the connection is restored. When T_max < T_current, that is, when the TServer cannot reconnect for a long time, the signaling server sends a signaling message sigling_quit_and_reset to TClient, resets the webrtc connection, prompts the client that the network is abnormal, and the signaling server saves this abnormal event for subsequent business processing.
[0079] Among them, Policy Three:
[0080] The signaling server saves the unique identification address TClientID of the current client and the unique identification address TServerID of the agent end. When T_max > T_current, when either the client or the agent end goes online, the signaling server sends a signaling to inform it to wait for reconnection. After both are online, the signaling server then informs the client corresponding to the unique identification address TClientID to re-initiate the network negotiation signaling to connect with the agent end of the current unique identification address TServerI. After the connection is completed;
[0081] When T_max < T_current, that is, when both the client and the agent end cannot reconnect for a long time, the signaling server saves this abnormal event for subsequent business processing; where T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
[0082] Specifically, see Figure 4As shown in the figure, if disconnection events occur simultaneously for both TClient and TServer, the signaling server saves the unique identifiers TClientID and TServerID of the current TClient and TServer. When T_max > T_current, if either TClient or TServer goes online, the signaling server sends a signaling sigling_reconnect_waiting to inform it to wait for reconnection. After both parties are online, the signaling server then informs the TClient with TClientID to initiate a network negotiation signaling sigling_reconnect again to connect to the TServer with the current TServerID, and the connection is restored. When T_max < T_current, that is, when TServer and TClient cannot be reconnected for a long time, the signaling server saves this abnormal event for subsequent business processing.
[0083] The specific implementation manners described above are the preferred implementation manners of a method for handling video network connection anomalies according to the present invention, and do not limit the specific scope of the present invention. The scope of the present invention includes but is not limited to this specific implementation manner. Any equivalent changes made according to the shape and structure of the present invention are within the protection scope of the present invention.
Claims
1. A method for handling abnormal video network connection, characterized in that: The steps include: The signaling server detects the video network status information of the client or / and the agent in real time according to the time series coding; If an abnormality is detected in the video network connection between the client and / or the agent; Determine if the video network connection is abnormal; Select corresponding strategies to deal with abnormal video network connection situations; The time series code includes a first detection time period and a second detection time period, and the first detection time period and the second detection time period are alternately woven to form the time series code; The signaling server records the video network status information of the client and / or the agent in real time according to the time series coding; The determination of abnormal video network connection includes the following steps: Calculate the number of heartbeats received during the first detection time period; Calculate the maximum error value of the heartbeat frequency received during the second detection time period; Calculate the duration ratio of the effective network traffic received in the first detection time period and the second detection time period; The network anomaly confidence value is calculated by integrating the number of heartbeats, error coefficient, and duration ratio. X , if the network abnormal confidence value X Located in the network anomaly confidence interval [ X1 , X2 ], the network is judged to be abnormal; among them, X1 is the lower confidence value of network anomaly. X2 The upper confidence limit of network anomalies; The network anomaly confidence value is calculated by integrating the number of heartbeats, error coefficient, and duration ratio. X , the formula is as follows: ; in, is the normalization coefficient of the number of heartbeats, is the heart rate normalization coefficient, is the normalization coefficient of the network effective traffic, is the number of heartbeats recorded during the first detection period; The number of heartbeats set for the first detection time period; Setting a value for the heart rate during the second detection period; is the maximum value of the heart rate recorded in the second detection time period; is the minimum value of the heart rate recorded in the second detection time period; is the duration of the effective network traffic received in the first detection time period and the second detection time period, is the duration of the first detection time period, is the duration of the second detection time period.
2. A method for handling abnormal video network connection according to claim 1, characterized in that: According to the abnormal video network connection situation, select the corresponding strategy to deal with it, including the following steps: The abnormal video network connection situations include client disconnection events, agent disconnection events, and simultaneous disconnection events of the client and agent ends; If a client disconnection event occurs, strategy 1 is used for handling; If the agent disconnects, Strategy 2 is used to handle the situation. If both the client and the agent are disconnected at the same time, strategy three will be used to handle it.
3. A method for handling abnormal video network connection according to claim 2, characterized in that: Strategy 1: The signaling server sends a signaling message to the agent to inform it of the disconnection event; The agent resets the network connection service and waits for the next signaling; When T_max > T_current, the client network is restored and reconnects to the signaling server. The signaling server sends a signal to the client to inform it to re-initiate network negotiation signaling and connect to the current agent to complete the connection. When T_max < T_current, the client cannot reconnect for a long time, and the signaling server sends a signaling message to the current agent to inform it to save the current business information and progress and exit, and reset the network connection service. The signaling server also saves the abnormal event for subsequent business processing. Among them, T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
4. A method for handling abnormal video network connection according to claim 2, characterized in that: Strategy 2: The signaling server sends a signaling message to the client to inform it of the disconnection event; The client resets the network connection service and waits for the next signaling; When T_max > T_current, the agent's network is restored and connected to the signaling server. The signaling server sends a signal to the client to inform it that it should re-initiate network negotiation signaling and connect to the current agent to complete the connection. When T_max < T_current, the agent cannot reconnect for a long time, and the signaling server sends a signaling message to the client, exits and resets the network connection service, and prompts the client that the network is abnormal. The signaling server saves the abnormal event for subsequent business processing; T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
5. A method for handling abnormal video network connection according to claim 2, characterized in that: Strategy 3: The signaling server saves the unique identification address TClientID of the current client and the unique identification address TServerID of the agent end; When T_max > T_current, either the client or the agent goes online, and the signaling server sends a signal to inform it to wait for reconnection. After both parties are online, the signaling server informs the client corresponding to the unique identification address TClientID to re-initiate network negotiation signaling, and connect to the agent end of the current unique identification address TServerID to complete the connection; When T_max < T_current, both the client and the agent cannot reconnect for a long time, and the signaling server saves the abnormal event for subsequent business processing; T_max represents the longest network connection waiting time; T_current represents the actual network connection waiting time.
Citation Information
Patent Citations
Adaptive method and adaptive device of heartbeat cycle
CN102843250A
Method and system for detecting abnormality of video communication conversation
CN105516640A
Client connection state detection method and system
CN107360239A
A method and system for monitoring abnormal network connection
CN110875859A
Efficiently detecting abnormal client termination
US20070112954A1
