Transmission session flow restoration method and system in IP network flow, and intelligent terminal

Abstract

The invention relates to a transmission session flow reduction method and system in IP network flow and an intelligent terminal, and relates to the field of network technologies, and the method comprises the steps: obtaining data sending response information of to-be-sent data; judging whether the data sending response information is consistent with the reference response information or not; on the basis that the data sending response information is inconsistent with the reference response information, the computer is controlled to send the data again through a data retransmission method; acquiring equipment network state information based on the consistency of the data sending response information and the reference response information; analyzing and determining a network influence type according to the equipment network state information, wherein the network influence type comprises bandwidth occupation and network interruption; based on the bandwidth occupation, processing the bandwidth by a bandwidth processing method so as to send the data; and on the basis of the network interruption, reconnecting the network by using an off-network reconnection method so as to continuously send the data. The method and the device have the effect that the to-be-sent data can still be normally sent to the receiver after being influenced by the local equipment.

Description

Technical Field

[0001] The present invention relates to the field of network technology, and in particular to a method, system and intelligent terminal for restoring a transmission session flow in IP network traffic. Background Art

[0002] In an IP network, a transport session flow refers to a data transmission channel established between two or more communication endpoints to achieve reliable or unreliable data transmission. This channel can be established based on transport layer protocols such as TCP (Transmission Control Protocol) or UDP (User Datagram Protocol).

[0003] There is a possibility of packet loss when the transmission session stream is transmitted between communication endpoints. The transmission session stream may also be lost when the sender is sending it due to the influence of local equipment. In the case of loss due to the influence of local equipment, if the sender does not notice that the data was not sent successfully after sending the data, the data to be sent may be lost or delayed, which needs to be solved. Summary of the invention

[0004] In order to ensure that the data to be sent can still be normally sent to the receiver after being affected by the local device, the present invention provides a method, system and intelligent terminal for restoring the transmission session flow in IP network traffic.

[0005] In a first aspect, the present invention provides a method for restoring a transmission session flow in IP network traffic, which adopts the following technical solution: A method for restoring a transmission session flow in IP network traffic, comprising: Get data sending response information of the data to be sent; Determine whether the data sending response information is consistent with the preset reference response information; Based on the inconsistency between the data transmission response information and the reference response information, controlling the computer to resend the data using a preset data resending method; Based on the consistency between the data transmission response information and the reference response information, the network status information of the device is obtained; Determine the network impact type based on the device network status information analysis, which includes bandwidth usage and network interruption; Based on bandwidth occupancy, the bandwidth is processed using a preset bandwidth processing method to send data; Based on network interruption, the network is reconnected using a preset network disconnection reconnection method to continue sending data.

[0006] By adopting the above technical solution, the system determines whether the computer's peripherals can be used normally to send data normally by determining the data sending response information of the data to be sent, and the system obtains the computer's device network status information to determine whether the computer's network status will affect the normal sending of data; by processing the above factors that affect data sending, the data to be sent can be sent normally.

[0007] Optionally, the data resending method includes: Get device input image; Determine whether a preset data sending button is pressed according to a device input image and a preset key button pressing action; Based on the data sending key not being pressed, determining the pressed key feature according to the device input image; Determine the deviation distance according to the characteristics of the pressed key and the data sending key; Based on the deviation distance being no greater than the preset single-key distance, it is defined as an erroneous press, and the preset pressing device is controlled to press the preset undo key to cancel the erroneous press process, and press the data sending key to resend the data.

[0008] Optionally, also include: Based on the data sending button being pressed, determining the button pressing depth and the button center position according to the device input image before and after the button is pressed and the data sending button; Match the pressing force according to the button pressing depth; Determine the corrective force based on the downward pressure and the preset force increment; Controlling the pressing device to press the center position of the data sending button again according to the correction force, and obtaining the data sending response information of the data to be sent again; Based on the inconsistency between the data sending response information and the reference response information, it is defined as key failure, and a hot key combination scheme is determined according to the data sending key and a preset hot key database; Control the computer settings to form a combination hot key according to the hot key combination scheme, the function of the combination hot key is the same as the function of the data sending key; The pressing device is controlled to press the combination hot key according to the correction force to resend the data.

[0009] Optionally, if there is a foreign object at the bottom of the data sending button, it may also cause the button to malfunction. The method for removing the foreign object includes: Controlling the pressing device to press the data sending key with a corrected force, and determining the actual pressing depth according to the device input image before and after the key is pressed; Based on the inconsistency between the actual pressing depth and the preset reference pressing depth, it is defined as a foreign body obstruction, and the image information of the key area is obtained; Determine whether the foreign body feature is completely blocked by the data sending button according to the button area image information and the preset reference area image information; If the feature of the foreign body is completely blocked by the data sending button, the pressing device is controlled to press the button center position of the data sending button, and the button tilt direction is determined according to the button area image information and the data sending button; Determine the blowing position according to the tilt direction of the key; Controlling a preset blowing device to blow air to a blowing position to blow the foreign body feature out from the bottom of the data sending button; If the foreign body feature is not completely blocked by the data sending button, the foreign body feature position is determined based on the button area image information and the foreign body feature; Determine the maximum gap position where the distance between adjacent keys is the largest according to the key area image information; A moving path is formed according to the characteristic position of the foreign body and the maximum gap position; The preset clamping device is controlled to clamp the foreign body feature at the foreign body feature position, and the foreign body feature is taken out from the maximum gap position through a moving path.

[0010] Optionally, the bandwidth processing method includes: Determine the average network speed based on the device network status information; Based on the average network speed being no greater than a preset benchmark good network speed, the data content of the data to be sent is obtained; Determine the sending priority level according to the data content of the data to be sent; Based on the fact that the sending priority is greater than the preset base priority, the average network speed of all computer devices in the same local area network is determined according to the device network status information; Screening the average network speeds of all computer devices to determine device users whose average network speeds exceed a preset abnormal network speed, and obtaining screen image information of the device users; Determine the device user operation type according to the screen image information and the preset streaming video features, where the device user operation type includes watching streaming video and downloading data; Based on data download, the device network status information of the device user is controlled at a preset limited network speed to give up the network bandwidth; Based on watching streaming media videos, the device network status information of the device user is controlled at a preset network outage time and a preset network outage critical network speed so that the data to be sent can be sent during the network outage time.

[0011] Optional methods for reconnecting after network disconnection include: Get real-time network latency information; Analyze the real-time network delay information to determine the network change type, which includes delay increment and delay fluctuation; Based on the delay fluctuation, the maximum fluctuation is determined according to the real-time network delay information; Based on the maximum fluctuation exceeding the preset applicable fluctuation range, the data to be sent is stored in a preset data buffer area, and when the maximum fluctuation falls into the applicable fluctuation range, the data to be sent in the data buffer area is controlled to be sent; Based on the delay increment, obtain the operation status of the backup network; Based on the fact that the operating state of the backup network is consistent with the preset stable operating state, the local network of the computer device is switched to the preset backup network.

[0012] Optionally, also include: Based on the inconsistency between the operation state of the standby network and the stable operation state, obtaining the sending ratio of the data to be sent; Determine the unsent ratio based on the sent ratio; Control the local network of the computer device to reconnect and send the unsent proportion of the waiting data; Merging the data to be sent of the sent proportion and the data to be sent of the unsent proportion to obtain merged data, and determining whether the merged data is consistent with the data to be sent; Based on the inconsistency between the combined data and the data to be sent, the computer device is controlled to resend the complete data to be sent.

[0013] Optionally, if a device is powered off during the process of sending data to be sent, data transmission will be affected. The device power off processing method includes: When the data is triggered to send a response message, the control computer backs up the data to be sent to form backup data and stores it in a preset backup buffer area; Control the computer device to switch to a preset backup power supply for power supply, and obtain the sent content information sent to a preset sending buffer area; Retrieving the backup data from the backup buffer area, and matching and analyzing the backup data with the sent content information to obtain the unsent content information; The unsent content information is sent to the data buffer area, the unsent content information is combined with the sent content information to form complete data to be sent, and the complete data to be sent is resent.

[0014] In a second aspect, the present application provides a transmission session flow restoration system in IP network traffic, which adopts the following technical solution: A system for restoring a transmission session flow in IP network traffic, comprising: An acquisition module, used to acquire data transmission response information of data to be sent, device network status information, device input image, key area image information, data content of data to be sent, screen image information of device user, real-time network delay information, operation status of standby network and transmission ratio of data to be sent; A memory for storing a program of a method for restoring a transmission session flow in IP network traffic; The program in the memory can be loaded and executed by the processor and implements a method for restoring a transmission session flow in IP network traffic.

[0015] In a third aspect, the present application provides a smart terminal, which adopts the following technical solution: An intelligent terminal comprises a memory and a processor. The memory stores a computer program which can be loaded by the processor and executes a method for restoring a transmission session flow in IP network traffic.

[0016] In summary, the present application includes at least one of the following beneficial technical effects: 1. The system determines whether the computer's peripherals can be used normally to send data by determining the data sending response information of the data to be sent. The system also obtains the computer's device network status information to determine whether the computer's network status will affect the normal sending of data. By processing the above factors affecting data sending, the data to be sent can be sent normally. 2. The system can detect the situation of the user pressing the data sending button, so as to determine whether the data sending button is pressed normally and whether the data sending button is normal; when the data sending button is not pressed normally, the system can cancel the wrongly pressed key position and automatically control the pressing device to press the data sending button; when the data sending button fails, the system can reset the combination hot key to imitate the function of the data sending button; and when the system finds that the bottom of the data sending button is affected by the characteristics of foreign matter and cannot be pressed normally, the system can deal with the foreign matter in a targeted manner according to the position of the foreign matter to ensure that the data sending button can be pressed normally; 3. When the data to be sent is affected by the computer network, the system can monitor the usage status of other device users in the local area network and suspend the network for the device user who is watching the video so that the data to be sent can be sent normally during the suspension time. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a method flow chart of a method for restoring a transmission session flow in IP network traffic according to an embodiment of the present invention; Figure 2 The method flow of the data retransmission method according to the embodiment of the present invention is Figure 1 ; Figure 3 The method flow of the data retransmission method according to the embodiment of the present invention is Figure 2 ; Figure 4 It is a method flow chart of the foreign matter removing method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0019] An embodiment of the present application discloses a method for restoring a transmission session flow in IP network traffic.

[0020] Reference Figure 1 , a method for restoring a transmission session flow in IP network traffic comprises the following steps: Step S100: Obtain data sending response information of the data to be sent.

[0021] Data sending response information refers to the keyboard or mouse pressing triggering status obtained by the computer when data is sent by pressing the keyboard or mouse. The computer detects the keyboard or mouse pressing status in real time. When the keyboard or mouse is pressed, the system will obtain the data sending response information of the data to be sent regardless of whether it is a normal press. When the keyboard or mouse is pressed normally, the computer can directly obtain the data sending response information of the data to be sent from the system.

[0022] Step S101: determining whether the data transmission response information is consistent with the preset reference response information.

[0023] The reference response information refers to the response information triggered when the keyboard or mouse is pressed normally, which will not be described in detail here.

[0024] By comparing the data sending response information with the reference response information and judging whether the two are consistent, it can be determined whether the keyboard or mouse is normally pressed when preparing to send data.

[0025] Step S1011: Based on the inconsistency between the data transmission response information and the reference response information, control the computer to resend the data using a preset data resending method.

[0026] If the data transmission response information is inconsistent with the reference response information, it means that the keyboard or mouse is not pressed normally. At this time, there may be situations such as wrong key pressing, key failure, and key pressing obstruction, which leads to incomplete data reception. For the above situation, the system resends the data through the data resending method so that the data can be completely sent to the recipient. The data resending method is not described here in detail and will be described in detail in the subsequent embodiments.

[0027] Step S1012: Based on the consistency between the data transmission response information and the reference response information, the device network status information is obtained.

[0028] If the data sending response information is consistent with the reference response information, it means that the keyboard or mouse has been pressed normally. The possible reason for incomplete data reception may be that the data sending process is affected by the network.

[0029] The device network status information refers to the network status of the device at the time when the data transmission response information is triggered. The device network status information can be directly obtained by detecting the network status of the system.

[0030] Step S10121: Analyze and determine the network impact type based on the device network status information. The network impact type includes bandwidth occupation and network interruption.

[0031] The network impact type refers to the type of impact that the network has on data transmission, including bandwidth usage and network interruption. The network impact type can be directly analyzed from the device network status information. Bandwidth usage may cause high network latency, resulting in packet loss and incomplete data. Network interruption will directly lead to data transmission failure.

[0032] Step S10122: Based on the bandwidth occupancy, the bandwidth is processed using a preset bandwidth processing method to send the data.

[0033] In the case of bandwidth occupancy, the system will process the network bandwidth so that data can be sent normally without being affected by the network bandwidth. The bandwidth processing method is not described here in detail and will be described in detail in subsequent embodiments.

[0034] Step S10123: based on the network interruption, reconnect the network using a preset network disconnection reconnection method to continue sending data.

[0035] In the event of a network interruption, the system will process the network so that data can continue to be sent. The method for reconnecting after a network interruption is not described in detail here and will be described in detail in subsequent embodiments.

[0036] Reference Figure 2 , the data resending method comprises the following steps: Step S200: Obtain device input image.

[0037] The device input image refers to the image photo formed by the operator taking a photo of the keyboard and mouse when operating the computer. The computer is integrated with a camera, and the device input image is obtained through the camera.

[0038] Step S201: determining whether a preset data sending key is pressed according to a device input image and a preset key key pressing action.

[0039] The key button pressing action is the hand action of the operator pressing the data sending button that is stored in advance in the database by the technician, and will not be described in detail here.

[0040] By comparing the device input image with the key button pressing action, if the key button pressing action appears in the device input image, it means that the data sending key is pressed. The data sending key refers to the key position that needs to be pressed to send data.

[0041] Step S2011: Based on the fact that the data sending button is not pressed, determine the characteristics of the pressed button according to the device input image.

[0042] When the operator presses the wrong key, the image recognition will also show that the data sending key is not pressed. At this time, by determining the positional relationship between the pressed key and the data sending key, it can be determined whether it is an unintentional mistake. The pressed key feature refers to the position of the key actually pressed by the operator.

[0043] Step S20111: Determine the deviation distance based on the characteristics of the pressed key and the data sending key.

[0044] The deviation distance refers to the distance between the pressed key feature and the data sending key.

[0045] Step S20112: Based on the deviation distance not being greater than the preset single-key distance, it is defined as an erroneous press, and the preset pressing device is controlled to press the preset undo key to cancel the erroneous press process, and press the data sending key to resend the data.

[0046] The single key distance refers to the distance between two adjacent keys set by the technicians, which will not be elaborated here.

[0047] If the deviation distance is greater than the single key distance, it means that the pressed key feature and the data sending key are not adjacent keys. At this time, if the pressed key feature is pressed, other data operations may be performed, which is a normal operation.

[0048] If the deviation distance is not greater than the single key distance, it means that the pressed key feature and the data sending key are adjacent keys. At this time, it may be an incorrect press. You want to press the data sending button, but you press the pressed key feature instead, causing the data not to be sent normally.

[0049] The pressing device is arranged at one side of the computer and can identify the keyboard and the mouse and assist in pressing.

[0050] The cancel button is a button preset by the computer for canceling the function of a button that has been pressed.

[0051] When it is determined that the operator's pressing action is identified as an erroneous pressing, the system will control the pressing device to assist in pressing the undo button, and return to the previous state after completing the pressing. At this time, the pressing device will press the data sending button again to re-send the data.

[0052] Reference Figure 3 The data resending method further comprises the following steps: Step S2012: Based on the data sending key being pressed, determine the key depression depth and key center position according to the device input image before and after the key is pressed and the data sending key.

[0053] If the data sending button is pressed, but the data is not sent to the receiver normally, there may be a problem with the data sending button.

[0054] The button depression depth refers to the distance the data sending button moves downward when the operator presses the data sending button. The button depression depth can be determined by obtaining the device input image before the operator presses the data sending button and the device input image after the operator presses the data sending button, and performing image recognition analysis on the two device input images.

[0055] The button center position is the top center position of the data sending button. The button center position can be determined by performing image recognition analysis on the device input image.

[0056] Step S20121: Match the pressing force according to the button pressing depth.

[0057] The pressure force refers to the force required to apply force to the data send button to make it move downward. The key pressing depth corresponds to the pressure force. The greater the key pressing depth, the greater the pressure force. The pressure force here refers to the force required to press the data send button down to the key pressing depth, which is the pressure applied by the operator to the key position.

[0058] Step S20122: Determine the correction force according to the downward pressure and the preset force increment.

[0059] The force increment is the correction amount set by the technicians to correct the downforce, which will not be elaborated here.

[0060] The correction force is the parameter value after the downward pressure is corrected. The correction force here is the pressure applied by the pressing device to assist in pressing the data sending key. When pressing with the correction force, it is determined that the key position can be fully pressed normally.

[0061] Step S20123: Control the pressing device to press the center position of the data sending button again according to the correction force, and obtain the data sending response information of the data to be sent again.

[0062] After determining the correction force and the center position of the key, the system uses the pressing device to assist in pressing the data sending key again and obtains the data sending response information of the data to be sent to determine whether the key position has not been successfully sent because the operator pressed the key too lightly.

[0063] Step S20124: Based on the inconsistency between the data sending response information and the reference response information, it is defined as a key failure, and a hot key combination scheme is determined according to the data sending key and a preset hot key database.

[0064] If the data sending response information is consistent with the reference response information at this time, it means that the key is indeed pressed too lightly. At this time, the data can be resent during the process of verifying the cause.

[0065] If the data sending response information is inconsistent with the reference response information, it means that even if the key is fully pressed, no effect can be produced, that is, the key is malfunctioning.

[0066] The hotkey database is a database set by technicians, which contains data on various existing hotkeys on the computer and will not be described in detail here.

[0067] The hotkey combination scheme refers to a scheme that combines keys so that the combination keys can achieve the same function as the data sending key. The system identifies the function of the data sending key and compares it with the hotkey database. It can determine the hotkey combination scheme while avoiding the hotkeys already in the hotkey database.

[0068] Step S20125: Control the computer settings to form a combination hotkey according to the hotkey combination scheme, and the function of the combination hotkey is the same as that of the data sending key.

[0069] A combination hotkey refers to a key position on a keyboard that is used in combination to achieve the same function as a data sending key. When a hotkey combination scheme is determined, the system sets the keyboard key functions according to the hotkey combination scheme to form a combination hotkey.

[0070] Step S20126: Control the pressing device to press the combination hot key according to the correction force to resend the data.

[0071] When the data sending key fails, the system uses the pressing device to assist in pressing the combination hot key, so that the data can be resent.

[0072] Reference Figure 4 If there is a foreign object at the bottom of the data sending button, it will also cause the button to malfunction. The method for removing the foreign object includes the following steps: Step S300: Control the pressing device to press the data sending key with the corrected force, and determine the actual pressing depth according to the device input image before and after the key is pressed; The system controls the pressing device to press the data sending key with a correct force. Under normal circumstances, the key position can be fully pressed.

[0073] The actual pressing depth is the distance that the data sending key is actually pressed when it is pressed by the pressing device. Similar to step S2012, the actual pressing depth can be determined by image recognition of the two device input images before and after the key is pressed.

[0074] Step S301: based on the inconsistency between the actual pressing depth and the preset reference pressing depth, it is defined as a foreign body obstruction, and the key area image information is obtained; The reference depression depth is the distance the key moves downward when the key is fully pressed, which is set by a technician and will not be described in detail here.

[0075] When the actual depression depth is inconsistent with the preset reference depression depth, it means that the key is obstructed when being pressed, and the data sending key determines that there are foreign body features at the bottom that prevent it from moving downward.

[0076] The button area image information refers to the image obtained by taking a picture of the data sending button and its surrounding area with a camera. By taking a picture of the data sending button and its surrounding area, the specific location of the foreign body features at the data sending button can be determined to facilitate subsequent removal.

[0077] Step S302: determining whether the foreign body feature is completely blocked by the data sending button according to the button area image information and the preset reference area image information; The reference area image information refers to an image when there is no foreign body feature at the key position, which is an image taken in advance by a technician.

[0078] By comparing and analyzing the key area image information and the reference area image information, it is possible to determine whether the foreign body feature is completely blocked by the data sending key. If the key area image information is the same as the reference area image information, it means that the foreign body feature cannot be identified from the key area image information. If the key area image information is different from the reference area image information, it means that the foreign body feature can be identified.

[0079] Depending on whether the features of the foreign object can be directly identified, the system uses different processing methods.

[0080] Step S3021: if the foreign body feature is completely blocked by the data sending button, control the pressing device to press the button center position of the data sending button, and determine the button tilt direction according to the button area image information and the data sending button; If the foreign body feature is completely blocked by the data sending button, the system is not sure about the specific position of the foreign body feature at the bottom of the data sending button. At this time, the pressing device is used to press the center of the data sending button. Since there is a foreign body at the bottom of the data sending button, when the key is pressed, the key can tilt to the side without the foreign body feature. The tilt direction of the key when pressed is the key tilt direction. The key tilt direction can be obtained by performing image recognition analysis on the data sending button in the key area image information.

[0081] Step S30211: determining the blowing position according to the tilt direction of the key; The blowing position refers to the blowing position where the foreign matter is blown out from the bottom of the data sending key by blowing air to the bottom of the data sending key through the blowing device. The blowing position is located on the side of the data sending key that is tilted downward, so the blowing position can be determined by the tilt direction of the key.

[0082] Step S30212: controlling a preset blowing device to blow air at the blowing position to blow the foreign body features out from the bottom of the data sending button; The system controls the blowing device to blow air at the blowing position, which can blow the foreign matter out from the bottom of the data sending button, so that the data sending button cannot completely cover the foreign matter features.

[0083] When the foreign body feature comes out from the bottom of the data sending button, the subsequent processing method of the foreign body feature is the same as the foreign body feature that is not completely blocked by the data sending button, which will not be described here and will be described in detail in the subsequent embodiments.

[0084] Step S3022: if the foreign body feature is not completely blocked by the data sending button, determine the foreign body feature position according to the button area image information and the foreign body feature; When the foreign body feature is not completely blocked by the data sending button, the foreign body feature can be identified from the button area image information, so the system can determine the foreign body feature position by performing image recognition analysis on the foreign body feature from the button area image information. The ectopic feature position refers to the actual position of the foreign body feature at the data sending button.

[0085] Step S30221: determining the maximum gap position where the distance between adjacent keys is the largest according to the key area image information; The maximum gap position refers to the position of the maximum gap between adjacent keys around the data transmission key. The maximum gap position is determined by performing image recognition analysis on the key area image information and analyzing the distance between each adjacent key position.

[0086] Step S30222: forming a moving path according to the characteristic position of the foreign object and the maximum gap position; The moving path refers to the path that the foreign body feature moves when it is moved out from the bottom of the data sending button. The foreign body feature needs to move from the foreign body feature position to the maximum gap position, so the system can form a moving path based on the determined foreign body feature position and the maximum gap position.

[0087] Step S30223: Control the preset clamping device to clamp the foreign body feature at the foreign body feature position, and remove the foreign body feature from the maximum gap position through a moving path.

[0088] In this embodiment, when the foreign body feature can be identified and the position has been determined, the system can control the clamping device to clamp the foreign body feature at the foreign body feature position and move it along the moving path, thereby removing the foreign body feature from the maximum gap position.

[0089] The bandwidth processing method includes the following steps: Step S400: Determine the average network speed according to the device network status information.

[0090] The average network speed refers to the current network speed of the computer device when the data to be sent is sent. The network average can be directly analyzed from the device network status information. By analyzing the network average, it can be determined whether the current network is good.

[0091] Step S401: based on the average network speed being no greater than a preset benchmark good network speed, the data content of the data to be sent is obtained.

[0092] A baseline good network is one that performs well and has low latency.

[0093] If the average network speed is greater than the benchmark good network speed, it means that the current network status of the computer device is good, and sending data at this time will not affect the data.

[0094] If the average network speed is not greater than the benchmark good network speed, it means that the current network status is poor and the current network needs to be processed so that data can be sent normally.

[0095] The data content of the data to be sent refers to the text content of the data that the current computer device needs to send. The system can read and identify the content of the data to be sent to obtain the data content.

[0096] Step S402: Determine the sending priority level according to the data content of the data to be sent.

[0097] In this embodiment, the system reads the content of the data to be sent and classifies the importance of the content of the data to be sent, thereby determining the sending priority. The higher the sending priority, the more important the data to be sent is, and it needs to be sent with priority.

[0098] Step S403: Based on the fact that the sending priority is greater than the preset reference priority, the average network speed of all computer devices in the same local area network is determined according to the device network status information.

[0099] The base priority is the priority of the data that needs to be arranged first, which is set by the technicians. It will not be described here. When the sending priority is not greater than the base priority, it means that the data to be sent is less important. At this time, even if the network condition is poor, it will wait until the network condition improves before sending. When the sending priority is greater than the base priority, it means that the data to be sent is more important and needs to be arranged for sending first.

[0100] In this embodiment, the factors that affect the network situation may be other computer devices in the same local area network, so it is necessary to determine the average network speed of all computer devices in the same local area network.

[0101] Step S404: Screen the average network speeds of all computer devices to determine device users whose average network speeds exceed a preset extraordinary network speed, and obtain screen image information of the device users.

[0102] Extraordinary Internet speed is a standard set by technicians to measure whether the average Internet speed of computer equipment occupies a large bandwidth. It will not be elaborated here.

[0103] The system monitors the device users whose average network speed exceeds the abnormal network speed and obtains the screen image information of the device users. The screen image information refers to the screen image of the computer screen, and the screen image information of the device users is obtained through the camera.

[0104] The device user in this embodiment is an enterprise user, and the device used by the user is an internal device of the enterprise LAN. The operation of the device is completely supervised by the enterprise and used within the enterprise. The screen image information of the internal device user of the enterprise can be directly obtained without the user's authorization.

[0105] If used outside the enterprise, obtaining the device user's screen image information requires user authorization. Once the user authorizes, the screen image information can be obtained. If not authorized, the screen image information is deemed to contain streaming video images.

[0106] When the average network speed exceeds the abnormal network speed, it means that the device user may be using an application that consumes high bandwidth. At this time, the system identifies it and handles it at the source.

[0107] Step S405: determining the device user operation type according to the screen image information and the preset streaming video features, where the device user operation type includes watching streaming video and downloading data.

[0108] The device user operation type refers to the type of operation application currently being used by the device user. By analyzing the device user through the screen image information, it can be determined that the device user is currently watching a video or downloading data resources. The system adopts different processing methods for different situations.

[0109] Step S4061: Based on data download, the device network status information of the device user is controlled at a preset limited network speed to give up the network bandwidth.

[0110] If the device user is downloading data, if the device user is disconnected from the Internet, the data download may fail, and if the data is important, it may cause serious consequences. Therefore, only the network speed of the device user is limited, so that the bandwidth occupied by the device user is reduced. The limited network speed is set by the technician to maintain the network speed that can only maintain normal data download, which will not be elaborated here.

[0111] Step S4062: Based on watching the streaming media video, the device network status information of the device user is controlled within the preset network downtime at the preset network downtime critical network speed so that the data to be sent can be sent within the network downtime.

[0112] If the device user is watching streaming video, the system will disconnect the device user from the Internet for a period of time. The network speed increased before the network disconnection period is the critical network speed. During the network disconnection time, since the device user is not watching videos, the data to be sent can be sent normally. The network disconnection time is the length of time set by the technician to disconnect the device user who is watching the video, which is not described here. The critical network speed is the maximum network speed set by the technician to increase the network speed when the device user who is watching the video is disconnected, which is not described here.

[0113] The disconnection and reconnection method includes the following steps: Step S500: Acquire real-time network delay information.

[0114] The real-time network delay information refers to the network delay in the process of sending the data to be sent, and the real-time network delay information can be directly obtained from the computer system.

[0115] Step S501: Analyze the real-time network delay information to determine the network change type, which includes delay increase and delay fluctuation.

[0116] There are two situations of network delay information. One is that the network delay continues to increase. When the network delay reaches the maximum, it means that the network is disconnected. The second is that the network delay fluctuates up and down. At this time, it only means that the network status is poor, but there is no network disconnection.

[0117] The network change type can be analyzed and determined based on the real-time network delay information over a period of time.

[0118] Step S5021: Based on the delay fluctuation, determine the maximum fluctuation according to the real-time network delay information.

[0119] The maximum fluctuation refers to the maximum fluctuation of the delay when the computer network has delay fluctuations. When the maximum fluctuation exceeds a certain amount, the network status is poor and not suitable for sending data. The maximum fluctuation can identify and determine the real-time network delay information.

[0120] Step S50211: based on the maximum fluctuation exceeding the preset applicable fluctuation range, the data to be sent is stored in a preset data buffer area, and when the maximum fluctuation falls into the applicable fluctuation range, the data to be sent in the data buffer area is controlled to be sent.

[0121] The applicable fluctuation range refers to the delay fluctuation range set by the technical staff that is suitable for data transmission, which will not be elaborated here.

[0122] When the maximum fluctuation falls within the applicable fluctuation range, data transmission will not be affected.

[0123] When the maximum fluctuation exceeds the applicable fluctuation range, it will affect the normal transmission of data. In this embodiment, for the above situation, the system first stores the data to be sent in the data cache area, and then sends the data to be sent in the data cache area after the maximum fluctuation of the delay fluctuation falls into the applicable fluctuation range.

[0124] Step S5022: Based on the delay increment, the operation status of the backup network is obtained.

[0125] In this embodiment, if the delay increases and the network is disconnected, the system will switch the local network to the backup network. Before this, the system needs to determine the operating status of the backup network, and the operating status of the backup network can be directly obtained from the system.

[0126] Step S50221: based on the fact that the operating state of the backup network is consistent with the preset stable operating state, the local network of the computer device is switched to the preset backup network.

[0127] The stable operation state is the state of normal operation of the backup network set by the technical personnel, which will not be described in detail here.

[0128] If the operating state of the backup network is inconsistent with the stable operating state, it means that there is an abnormality in the backup network and the local network cannot be switched to the backup network. At this time, the system will take other measures, which will not be described here and will be described in detail in subsequent embodiments.

[0129] If the operating status of the backup network is consistent with the stable operating status, it means that the backup network is in good operating status and the local network can be switched to the backup network at any time. When switching networks, data transmission will not be affected and network delay will be reduced.

[0130] The network disconnection and reconnection method also includes the following steps: Step S600: based on the inconsistency between the operating state of the standby network and the stable operating state, obtaining the transmission ratio of the data to be transmitted.

[0131] If the operation status of the backup network is inconsistent with the stable operation status, the backup network cannot be switched to at this time, and the computer network will be disconnected. When the network is disconnected, part of the data being sent may have been sent successfully, and part of it has not been sent. The sending ratio of the data to be sent refers to the percentage of the data that has been successfully sent to the complete data. The sending ratio of the data to be sent can be analyzed and obtained from the data to be sent.

[0132] Step S601: Determine the unsent ratio according to the sent ratio.

[0133] The unsent ratio refers to the ratio of data that has not been sent. The sum of the sent ratio and the unsent ratio is 100%, so the unsent ratio can be determined based on the sent ratio.

[0134] Step S602: Control the local network of the computer device to reconnect, and send the unsent proportion of the to-be-sent data.

[0135] After the local network is restored, the system sends the data to be sent according to the unsent ratio. At this time, the unsent ratio may overlap with the sent ratio, and the combination of the two cannot form complete data.

[0136] Step S603: merging the to-be-sent data of the sent proportion and the to-be-sent data of the unsent proportion to obtain merged data, and determining whether the merged data is consistent with the to-be-sent data.

[0137] The combined data is the data obtained by combining the data sent before the network is disconnected and the unsent data to be sent after the network is restored. By comparing the combined data with the data to be sent, it can be determined whether the two are consistent, thereby determining whether the data has been sent completely.

[0138] Step S604: Based on the inconsistency between the combined data and the data to be sent, the computer device is controlled to resend the complete data to be sent.

[0139] If the merged data is consistent with the data to be sent, it means that the data has been sent completely. If the merged data is inconsistent with the data to be sent, it means that the merged data is not the complete data to be sent, and the system needs to resend the data to be sent.

[0140] Sending the unsent data in proportion can reduce the amount of data sent, improve the sending efficiency, and avoid the situation where data is lost again when the complete data is sent again.

[0141] If the device is powered off during the transmission of data to be transmitted, data transmission will be affected. The device power off processing method includes the following steps: Step S700: When triggering the data transmission response information, the control computer backs up the data to be transmitted to form backup data and stores the backup data in a preset backup buffer area.

[0142] In this embodiment, when the mouse or keyboard presses the key for data transmission, the computer will synchronously back up the data to be sent and store it in the backup buffer area to prevent data loss due to power failure of the device. The backup buffer area is an area in the computer set by the technician to store backup data.

[0143] Step S701: Control the computer device to switch to a preset backup power supply for power supply, and obtain the sent content information sent to the preset sending buffer area.

[0144] In this embodiment, when the computer sends data, the data is first sent to the sending buffer area, and then sent from the sending buffer area to the recipient.

[0145] When the computer is powered off, part of the data to be sent will be sent to the sending buffer in advance, and the other part of the data that has not been sent will be lost due to the power outage.

[0146] When the computer is powered off, the system will switch the current power supply to the backup power supply, and the computer can be used normally again. When the computer is restored, the system will first extract the sent content information in the send buffer.

[0147] Step S702: Retrieve the backup data from the backup buffer area, and perform matching analysis on the backup data and the sent content information to obtain the unsent content information.

[0148] Since the unsent content information is lost when the power is off, it is necessary to retrieve the backup data from the backup buffer area, analyze the backup data and the sent content information, and obtain the unsent content information again.

[0149] Step S703: Send the unsent content information to the data buffer area, merge the unsent content information with the sent content information to form complete data to be sent, and resend the complete data to be sent.

[0150] When the unsent content information is obtained again, the unsent content information is continued to be sent to the sending buffer area, and the unsent content information and the sent content information are merged in the sending buffer area to obtain complete data to be sent. At this time, the complete data to be sent is located in the sending buffer area and will not be affected by the network disconnection and can be sent normally.

[0151] The method for determining the hotkey combination scheme includes the following steps: Step S800: Acquire keyboard image information.

[0152] The keyboard image information refers to an image of the keyboard obtained by photographing the keyboard with a camera.

[0153] Step S801: Determine whether there is a numeric keypad area on the keyboard according to the keyboard image information.

[0154] By analyzing the keyboard image information, the type of keyboard can be determined. Some keyboards have 108 keys and a numeric keypad area, which contains keys with the same function as the data sending key. Some keyboards have 68 keys and do not have a numeric keypad area. Therefore, different hot keys can be used to replace different types of keyboards.

[0155] Step S8021: If the keyboard has a numeric keypad area, the preset replacement key positions are output as a hotkey combination scheme.

[0156] For a keyboard with a numeric keypad area, when the data sending key fails, the data sending key can be replaced by a replacement key position in the numeric keypad area, and the same function as the data sending key can be achieved by pressing the replacement key position through the pressing device UI.

[0157] In this embodiment, if the replacement key position also fails, it is necessary to redefine the hot key combination scheme from the large keyboard area, which will not be described here and will be described in detail in subsequent embodiments.

[0158] Step S8022: If there is no small keyboard area, determine the general function key position and the matching key position according to the keyboard image information, control the computer device to set the general function key position and the matching key position combination to a combination key position with the same function as the data sending press, control the pressing device to press the combination key position, and obtain the data sending response information.

[0159] By analyzing the keyboard image information, first determine the general function key positions in the function area, which include Ctrl, Alt, Win, Fn and other keys, and then determine the matching key positions in the letter keys and number keys, which refer to the keys that are used in combination with the general function key positions and pressed at the same time. When selecting the above scheme, it is necessary to match it with the used hotkey schemes in the hotkey database to avoid duplication.

[0160] When selecting the general function key and the matching key, it is necessary to determine whether there is a malfunctioning key in the currently selected combination hotkey, so it is necessary to detect it. The system first sets the function of the combination key to the key with the same function as the data sending press, and then presses it through the pressing device, and determines whether there is a malfunction through the data sending response information.

[0161] Step S80221: When the data sending response information is inconsistent with the preset reference response information, the matching key positions or the general function key positions are replaced in sequence until the data sending response information is consistent with the reference response information, and a hot key combination scheme is output.

[0162] If the data sending response information is consistent with the reference response information, it means that the currently selected key combination is functional and can be used as a combination hotkey solution.

[0163] If the data sending response information is inconsistent with the benchmark response information, it means that at least one of the general function key and the matching key has a malfunction. At this time, the system will reselect the general function key from the alternative key position in the function area or reselect the matching key from the numeric keys and letter keys, and test again until the data sending response information is consistent with the benchmark response information.

[0164] When the data sending response information is consistent with the reference response information, the finally selected common function key positions and matching key positions are used as the final hotkey combination solution.

[0165] In this embodiment, the pressing device is in the form of a gantry, on which a plurality of optional pressing heads that can press the keyboard keys slide, and the pressing device can move horizontally, and after identifying the keyboard position, it moves from one side of the keyboard to the top of the keyboard and moves along the length direction of the keyboard, and the pressing head presses the keyboard keys during the movement. The method for pressing the combination hot key by the pressing device includes the following steps: Step S900: Determine the short side position and keyboard model of the keyboard according to the device input image and preset keyboard features.

[0166] The short side position of the keyboard refers to the end face position of the keyboard in the width direction. The short side position of the keyboard can be obtained by performing image recognition analysis on keyboard features in the device input image.

[0167] Different types of keyboards have different size specifications. If you need to press the keyboard through a pressing device, you need to first determine the keyboard model to adapt to the pressing device. The keyboard model can be obtained by identifying keyboard features from the device input image.

[0168] Step S901: Determine the keyboard length, width, height information and key position pressing information according to the keyboard model and a preset keyboard database.

[0169] The keyboard database is a database set by technicians, which includes parameter information of all types of keyboards and will not be described in detail here.

[0170] The keyboard length, width and height information refers to the length, width and height of the keyboard. The key press information refers to the force required to press a key on the keyboard. The key press information of different keyboard models is different.

[0171] Inputting the keyboard model into the keyboard database can match the keyboard length, width, height information and key press information.

[0172] Step S902: Matching the door opening size information of the pressing device according to the length, width and height information of the keyboard.

[0173] The door opening size information refers to the existence of a door opening on the pressing device for the keyboard to pass through, mainly the door opening length value and the door opening height value. The door opening length value needs to be adapted to the width of the keyboard, and the door opening height value needs to be adapted to the height value of the keyboard. Therefore, it can be obtained based on a one-to-one correspondence between the keyboard length, width and height information and the door opening size information.

[0174] Step S903: matching the auxiliary pressing force of the pressing head according to the key pressing information.

[0175] The auxiliary pressing force is the pressing force of the pressing head of the pressing device on the keyboard key. The auxiliary pressing force is consistent with the key pressing information.

[0176] Step S904: Determine the combination hot key position according to the keyboard model and the combination hot key.

[0177] The combination hotkey position refers to the actual position of the combination hotkey on the keyboard. The same combination hotkey may have different positions on keyboards of different models. Therefore, when the keyboard model is determined, the combination hotkey position can be determined based on the keyboard model.

[0178] Step S905: Adjust the size of the pressing device according to the door opening size information so that the keyboard can be equipped with the pressing device, control the pressing device to move to the short side of the keyboard and move along the length direction of the keyboard, and during the movement, control the pressing head of the pressing device to press the combination hot key according to the combination hot key position and the auxiliary pressing force.

[0179] When it is necessary to assist in pressing the keyboard through a pressing device, the pressing device can automatically identify the placement of the keyboard and adjust its own size according to the keyboard model, and then move to the top of the keyboard and press the combination hot key during the movement, so that when the personnel fail to send data normally and are not on site, the pressing device can assist in completing the data sending task.

[0180] Step S906: After the pressing is completed, the unfolding distance of the accordion cover preset on the pressing device is determined according to the length, width and height information of the keyboard, and the accordion cover is controlled to unfold and cover the keyboard according to the unfolding distance.

[0181] In this embodiment, the pressing device is integrated with an expandable accordion cover, and the expansion distance of the accordion cover can be automatically matched and set according to the length value of the keyboard. When the pressing device completes pressing the combination hot key, the pressing device can control the accordion cover to cover the keyboard, so that other people are not likely to accidentally touch the keys of the keyboard.

[0182] Based on the same inventive concept, an embodiment of the present invention provides a transmission session flow restoration system in IP network traffic, including: The acquisition module is used to obtain data sending response information of the data to be sent, device network status information, device input image, key area image information, data content of the data to be sent, screen image information of the device user, real-time network delay information, operating status of the backup network and sending ratio of the data to be sent.

[0183] A memory for storing a program of a method for restoring a transmission session flow in IP network traffic.

[0184] The program in the memory can be loaded and executed by the processor and implements a method for restoring a transmission session flow in IP network traffic.

[0185] Based on the same inventive concept, an embodiment of the present invention provides an intelligent terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes a method for restoring a transmission session flow in IP network traffic.

[0186] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A method for restoring a transmission session flow in IP network traffic, characterized in that: include: Get data sending response information of the data to be sent; Determine whether the data sending response information is consistent with the preset reference response information; Based on the inconsistency between the data transmission response information and the reference response information, controlling the computer to resend the data using a preset data resending method; Based on the consistency between the data transmission response information and the reference response information, the network status information of the device is obtained; Determine the network impact type based on the device network status information analysis, which includes bandwidth usage and network interruption; Based on bandwidth occupancy, the bandwidth is processed using a preset bandwidth processing method to send data; Based on network interruption, the network is reconnected using a preset network disconnection reconnection method to continue sending data.

2. The method for restoring a transmission session flow in IP network traffic according to claim 1, characterized in that: The data resending method includes: Get device input image; Determine whether a preset data sending button is pressed according to a device input image and a preset key button pressing action; Based on the data sending key not being pressed, determining the pressed key feature according to the device input image; Determine the deviation distance according to the characteristics of the pressed key and the data sending key; Based on the deviation distance being no greater than the preset single-key distance, it is defined as an erroneous press, and the preset pressing device is controlled to press the preset undo key to cancel the erroneous press process, and press the data sending key to resend the data.

3. The method for restoring a transmission session flow in IP network traffic according to claim 2, characterized in that: Also includes: Based on the data sending button being pressed, determining the button pressing depth and the button center position according to the device input image before and after the button is pressed and the data sending button; Match the pressing force according to the button pressing depth; Determine the corrective force based on the downward pressure and the preset force increment; Controlling the pressing device to press the center position of the data sending button again according to the correction force, and obtaining the data sending response information of the data to be sent again; Based on the inconsistency between the data sending response information and the reference response information, it is defined as key failure, and a hot key combination scheme is determined according to the data sending key and a preset hot key database; Control the computer settings to form a combination hot key according to the hot key combination scheme, the function of the combination hot key is the same as the function of the data sending key; The pressing device is controlled to press the combination hot key according to the correction force to resend the data.

4. The method for restoring a transmission session flow in IP network traffic according to claim 3, characterized in that: If there is a foreign object at the bottom of the data sending button, it may also cause the button to malfunction. The methods for removing the foreign object include: Controlling the pressing device to press the data sending key with a corrected force, and determining the actual pressing depth according to the device input image before and after the key is pressed; Based on the inconsistency between the actual pressing depth and the preset reference pressing depth, it is defined as a foreign body obstruction, and the image information of the key area is obtained; Determine whether the foreign body feature is completely blocked by the data sending button according to the button area image information and the preset reference area image information; If the feature of the foreign body is completely blocked by the data sending button, the pressing device is controlled to press the button center position of the data sending button, and the button tilt direction is determined according to the button area image information and the data sending button; Determine the blowing position according to the tilt direction of the key; Controlling a preset blowing device to blow air to a blowing position to blow the foreign body feature out from the bottom of the data sending button; If the foreign body feature is not completely blocked by the data sending button, the foreign body feature position is determined based on the button area image information and the foreign body feature; Determine the maximum gap position where the distance between adjacent keys is the largest according to the key area image information; A moving path is formed according to the characteristic position of the foreign body and the maximum gap position; The preset clamping device is controlled to clamp the foreign body feature at the foreign body feature position, and the foreign body feature is taken out from the maximum gap position through a moving path.

5. The method for restoring a transmission session flow in IP network traffic according to claim 1, characterized in that: Bandwidth handling methods include: Determine the average network speed based on the device network status information; Based on the average network speed being no greater than a preset benchmark good network speed, the data content of the data to be sent is obtained; Determine the sending priority level according to the data content of the data to be sent; Based on the fact that the sending priority is greater than the preset base priority, the average network speed of all computer devices in the same local area network is determined according to the device network status information; Screening the average network speeds of all computer devices to determine device users whose average network speeds exceed a preset abnormal network speed, and obtaining screen image information of the device users; Determine the device user operation type according to the screen image information and the preset streaming video features, where the device user operation type includes watching streaming video and downloading data; Based on data download, the device network status information of the device user is controlled at a preset limited network speed to give up the network bandwidth; Based on watching streaming media videos, the device network status information of the device user is controlled at a preset network outage time and a preset network outage critical network speed so that the data to be sent can be sent during the network outage time.

6. The method for restoring a transmission session flow in IP network traffic according to claim 1, characterized in that: Disconnection and reconnection methods include: Get real-time network latency information; Analyze the real-time network delay information to determine the network change type, which includes delay increment and delay fluctuation; Based on the delay fluctuation, the maximum fluctuation is determined according to the real-time network delay information; Based on the maximum fluctuation exceeding the preset applicable fluctuation range, the data to be sent is stored in a preset data buffer area, and when the maximum fluctuation falls into the applicable fluctuation range, the data to be sent in the data buffer area is controlled to be sent; Based on the delay increment, obtain the operation status of the backup network; Based on the fact that the operating state of the backup network is consistent with the preset stable operating state, the local network of the computer device is switched to the preset backup network.

7. The method for restoring a transmission session flow in IP network traffic according to claim 6, characterized in that: Also includes: Based on the inconsistency between the operation state of the standby network and the stable operation state, obtaining the sending ratio of the data to be sent; Determine the unsent ratio based on the sent ratio; Control the local network of the computer device to reconnect and send the unsent proportion of the waiting data; Merging the data to be sent of the sent proportion and the data to be sent of the unsent proportion to obtain merged data, and determining whether the merged data is consistent with the data to be sent; Based on the inconsistency between the combined data and the data to be sent, the computer device is controlled to resend the complete data to be sent.

8. The method for restoring a transmission session flow in IP network traffic according to claim 1, characterized in that: If the device is powered off during the transmission of data to be sent, data transmission will be affected. The device power-off processing methods include: When the data is triggered to send a response message, the control computer backs up the data to be sent to form backup data and stores it in a preset backup buffer area; Control the computer device to switch to a preset backup power supply for power supply, and obtain the sent content information sent to a preset sending buffer area; Retrieving the backup data from the backup buffer area, and matching and analyzing the backup data with the sent content information to obtain the unsent content information; The unsent content information is sent to the data buffer area, the unsent content information is combined with the sent content information to form complete data to be sent, and the complete data to be sent is resent.

9. A system for restoring a transmission session flow in IP network traffic, characterized in that: include: An acquisition module, used to acquire data transmission response information of data to be sent, device network status information, device input image, key area image information, data content of data to be sent, screen image information of device user, real-time network delay information, operation status of standby network and transmission ratio of data to be sent; A memory for storing a program of a method for restoring a transmission session flow in IP network traffic according to any one of claims 1 to 8; The program in the memory can be loaded and executed by the processor and implements a method for restoring a transmission session flow in IP network traffic.

10. An intelligent terminal, characterized in that: The invention comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes the method for restoring a transmission session flow in IP network traffic as claimed in any one of claims 1 to 8.

Images