A communication data management system and method based on data analysis
Through a communication data management system based on data analysis, the communication data flow is monitored and optimized, and the problem of low channel management efficiency in the existing technology is solved, and efficient communication resource utilization and communication quality improvement are achieved.
Patent Information
- Application Number
- CN202411119698.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-08-15
AI Technical Summary
Existing communication management technologies are prone to high signal-to-noise ratio, high latency and complex demodulation problems under high equipment communication data volume and environmental noise, and cannot effectively manage data flow, resulting in channel blockage and link crashes, and reducing communication efficiency.
Adopt a communication data management system based on data analysis, including independent unpacking module, channel adjustment module, superimposed verification module, physical link module and timing proxy module, and perform normalization by monitoring data flow, calculating weighted information entropy, allocating channels, and performing normalization. Fit and verify, use short-distance communication technology to establish solid-state links, adjust channel capacity and allocate communication timing in real time to optimize the utilization of communication resources.
It improves communication efficiency, reduces channel resource waste, improves the overall efficiency and quality of the communication system, enhances network capacity and load-bearing capacity, and reduces data transmission error rate and packet loss rate.
Smart Images

Figure CN118631662B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of communication management, and in particular to a communication data management system and method based on data analysis. Background Art
[0002] Data flow management technology refers to the technology for effectively managing and optimizing the transmission of real-time audio and video streams, large-scale data packets, and control information, so as to achieve the purpose of data flow congestion control and data flow scheduling. The commonly used communication management method is to enable each device to communicate with the outside world through optical fiber or signal towers through routing switching. When allocating independent channels, the sideband signals of each device interfere with each other, which can easily cause communication congestion problems.
[0003] Existing technologies usually use multiple access technology to allocate available channels. However, as the amount of communication data of devices increases, in the presence of large environmental noise, the use of multiple access technology is prone to defects such as high signal-to-noise ratio, high latency and complex demodulation. It cannot divide channels well according to the communication characteristics of different devices, which reduces the communication efficiency to a certain extent.
[0004] In addition, the communication between devices and the network often propagates signals in the form of data streams. The existing channel adjustment method can only perform feedback adjustment after the communication is completed, and cannot achieve real-time and stable management of the data stream. When the communication data volume of the device fluctuates greatly, it cannot adapt to the communication environment well, resulting in consequences such as channel congestion and link collapse, resulting in a loss of user communication experience. Summary of the invention
[0005] The object of the present invention is to provide a communication data management system and method based on data analysis to solve the problems raised in the above background technology.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: a communication data management system based on data analysis, comprising: an independent unpacking module, a channel adjustment module, a superposition check module, a physical link module and a timing agent module;
[0007] The independent unpacking module is composed of a data capture port, an unpacking port and an embedded computing device, and is used to monitor the upstream data flow at the communication port, assign weights to different machine codes after the data flow is unpacked, calculate the weighted information entropy of the data flow of each device, obtain a function of the change of the weighted information entropy over time, recorded as the first function, and calculate the independence between the first functions of each device;
[0008] The channel adjustment module is used to calculate the sideband communication capacity according to the independence of the first function of each device, allocate channels to the data streams of each device based on the principle of maximum sideband communication capacity, and generate a fusion channel according to the size of the sideband communication capacity, and the fusion channel is used to transmit the sideband superposition signal;
[0009] The superposition verification module is composed of a signal generator, a verification interface and a data coupling device, and is used to perform normal fitting on data streams from different devices in the fusion channel, and the obtained fitting function is recorded as the second function, and the parameter information of the second function is output, and the residuals of the first function and the second function at different sampling points are calculated. The verification interface generates a verification sequence according to the residual sequence and the parameter information of the second function;
[0010] The physical link module is used to load the communication data stream and the check sequence into the same frequency baseband and send them to the network node. The network node detects the data stream in the fusion channel, separates the detection results by using the check sequence, and establishes a solid-state link between devices by using short-distance communication technology, and obtains the historical communication records of each device by the solid-state link.
[0011] The timing agent module is used to calculate the device priority when the information transmission rate is the highest based on the historical communication records of the device, allocate communication timing and channel frequency to each device according to the priority, and calculate the current signal-to-noise ratio. Data that exceeds the signal-to-noise ratio threshold is handed over to the agent node for processing.
[0012] Further, the independent unpacking module includes: a port monitoring unit, an entropy management unit and an independent comparison unit;
[0013] The port monitoring unit is used to detect uplink data at the communication port of the device router and output a symbol sequence of the uplink data;
[0014] The entropy management unit is used to assign weights to different code elements in the sequence according to the code element sequence detected within a preset period, and calculate the weighted information entropy of the data stream;
[0015] The independent comparison unit is used to generate a weighted information entropy function and calculate the correlation of the weighted information entropy functions in each device.
[0016] Further, the channel adjustment module includes: a fusion channel unit and a sideband allocation unit;
[0017] The fusion channel unit is used to divide a dedicated fusion channel for transmitting a sideband signal according to the size of the sideband communication capacity;
[0018] The sideband allocation unit is used to allocate channels for the communication data streams of each device according to the correlation of the weighted information entropy functions of the devices, so as to maximize the total communication capacity.
[0019] Further, the stacking verification module includes: a normal fitting unit and a verification coupling unit;
[0020] The normal fitting unit is used to fit the code element sequence of each sideband data using a normal distribution function, generate a mean and a variance, and perform signal superposition on the sideband data from different sources;
[0021] The check coupling unit is used to calculate the residual between the fitting signal and the sideband signal, generate a check sequence, and couple the check sequence into the sideband signal and send it to the communication node.
[0022] Further, the physical link module includes: a node detection unit, a short-distance chip unit and a routing analysis unit;
[0023] The node detection unit is used to construct a protocol of a communication node, so that the communication node detects the sideband signal, and uses a check sequence to correct the detection result to obtain the original sideband signal;
[0024] The short-range chip unit is used to install short-range communication chips in communication devices, including: Bluetooth, Zigbee and NFC, to establish a solid-state communication connection between devices;
[0025] The routing analysis unit is used to summarize the historical communication records of each device, and the historical communication records include: data volume, signal spectrum density, mutual independence and environmental noise.
[0026] Further, the timing agent module includes: a narrowband time-sharing unit and an agent node unit;
[0027] The narrowband time-sharing unit is used to calculate the priority of device communication according to the historical communication records of each device when the fusion channel is congested, and allocate the communication order of the devices according to the priority order;
[0028] The proxy node unit is used to calculate the current signal-to-noise ratio according to the environmental noise and the capacity of the fusion channel, and forward the fusion signal through the proxy node when the signal-to-noise ratio is higher than the signal-to-noise ratio threshold.
[0029] A communication data management method based on data analysis comprises the following steps:
[0030] Step S1. Use a sliding window to detect uplink data at the communication port of the device router, output a symbol sequence of the uplink data, assign weights to consecutive symbols in the sequence, and calculate a first function of the weighted information entropy of the data stream as the data stream changes;
[0031] Step S2. Group the devices in pairs, calculate the correlation of the first function of each group of devices, separate the segments whose correlation is greater than an environmental threshold, where the environmental threshold is determined by the channel noise, and output all the obtained segments as sideband signals;
[0032] Step S3. Calculate the ratio of the sideband signal data volume to the total data volume, multiply it by the total transmission bandwidth of the link, obtain the frequency band requirement of the sideband signal, and divide the fusion channel of the corresponding bandwidth in the total link;
[0033] Step S4. Perform normal fitting on the sideband signals from different devices, record the fitting function as the second function, superimpose the sideband signals, calculate the total residual of the first function and the second function, generate a check sequence, load the check sequence and the sideband signal into the same frequency baseband and send them to the network node. The node uses the check sequence to separate the detection result to obtain the original data stream;
[0034] Step S5. Allocate communication timing according to the amount of information of the devices in the same cycle. After all devices have completed communication, go to step S1, re-measure the environmental noise, and adjust the environmental threshold.
[0035] Further, step S1 includes:
[0036] Step S11. Capture the uplink data stream at the communication port of the device, preset the sliding window width Y, and obtain the code element sequence [W T+1 ,W T+2 ,…,W T+Y ], where T represents the number of slides, W T+Y represents the T+Yth code element in the uplink data stream, and both Y and T are positive integers;
[0037] Step S12. In the symbol sequence, if the preamble signal and the postamble signal have the same data representation, the preamble signal is regarded as a continuous signal; if the preamble signal and the postamble signal have different data representations or there is no postamble signal, the preamble signal is regarded as an independent signal;
[0038] Assign weight r1 to continuous signals and weight r2 to independent signals, and satisfy r1<1, r2<1 and r1≠r2, then the weighted information entropy in the codeword sequence satisfies: H T =C1·r1 / 2+(Y-C1)·r2 / 2, where H T represents the weighted information entropy in the codeword sequence at the Tth slide, and C1 represents the number of continuous signals;
[0039] Step S13: When the device completes uplink data stream transmission, it outputs a weighted information entropy sequence [H1, H2, ..., H n ], where n represents the total number of sliding windows, H n Represents the weighted information entropy in the codeword sequence during the nth slide. According to the time required for each slide, the weighted information entropy sequence is represented by a function to obtain a first function F(T), where F(T) is a discrete function.
[0040] Further, step S2 includes:
[0041] Step S21: Pair the devices in pairs, record them as device 1 and device 2 respectively, and calculate the correlation of the first function according to the following formula:
[0042]
[0043] Where F1(T) is the first function of device 1, F2(T) is the first function of device 2, k and L represent the lower and upper bounds of the fragment respectively, and D (k,L) [F1(T)||F2(T)] represents the correlation of the first functions of two devices in the segment (k, L), i is the counting number;
[0044] Step S22. Preset the environmental threshold D0 according to the power of the channel noise, adjust the values of k and L so that the correlation of the first function of the two devices is greater than the environmental threshold, output all fragments (k, L), and output the kth to Lth data in the data streams of the two devices as sideband signals.
[0045] Further, step S3 includes:
[0046] Step S31. Subtract the upper bound and the lower bound of the output segment to obtain the data volume of the segment, and add the data volumes of all the output segments in step S22 to obtain the data volume of the sideband signal;
[0047] Step S32. Calculate the bandwidth B of the sideband signal according to the total bandwidth of the communication link, where B=B0·y1 / y2, where B0 represents the total bandwidth of the communication link, y1 represents the data volume of the sideband signal, and y2 represents the data volume of the entire signal;
[0048] Step S33. A dedicated channel with a bandwidth of B is divided from the total bandwidth, which is recorded as a fused channel. The sideband signal is separated from the baseband signal. The baseband signal is transmitted through a non-fused channel, and the sideband signal is transmitted through a fused channel.
[0049] Further, step S4 includes:
[0050] Step S41. For each device, the sideband signal is fitted using a normal distribution function:
[0051]
[0052] Where m represents the total number of code elements corresponding to the sideband signals, x1, x2, …, xm represent the order of the code elements corresponding to the 1st, 2nd, …, mth sideband signals in the code element sequence, a and b represent the mean and standard deviation of the fitted distribution, respectively, and F(x) represents the first function of the device. Substituting all values of x into the function generates the best fitting results of a and b.
[0053] Step S42. A normal distribution function with a mean of a and a standard deviation of b is used as the second function of the device, the first functions of device 1 and device 2 are added to obtain a total first function, the second functions are added to obtain a total second function, and the total first function is subtracted from the total second function to obtain a residual sequence [d1, d2, …, dm], where d1, d2, …, dm represent the code element positions corresponding to the 1st, 2nd, …, mth sideband signals, respectively, and the difference between the total first function and the total second function;
[0054] Step S43. Generate a check sequence according to the residual sequence of device 1 and device 2 and the parameters in the second function, superimpose the sideband signals of device 1 and device 2, load the check sequence and the sideband signal into the same frequency baseband, and send them to the network node through the fusion channel;
[0055] Step S44: After the node obtains the check sequence, it detects the superimposed sideband signal, separates the detection result according to the check sequence, obtains the sideband signals of device 1 and device 2, and restores the data stream signal with the baseband signal in the non-fused channel.
[0056] Further, step S5 includes:
[0057] Step S51. Add all elements in the device weighted information entropy sequence to obtain the communication data volume of the device, and assign the communication priority of each group of devices in descending order according to the sum of the communication data volume of each group of devices;
[0058] Step S52. After all groups of devices have completed communication, go to step S1 and re-measure the environmental noise, and adjust the environmental threshold to D1, where D1=D0·lg(P1 / P2), where P1 and P2 represent the last measured environmental noise power and the currently measured environmental noise power, respectively.
[0059] Compared with the prior art, the beneficial effects achieved by the present invention are:
[0060] 1. The present invention can monitor the uploaded data stream at the communication port, calculate the weighted information entropy of the data stream of each device, allocate a fusion channel to the data stream according to the independence of the function of the change of the weighted information entropy over time in the current cycle, and adjust the fusion channel capacity in real time, so as to make the communication between different users or devices more efficient, reduce the waste of channel resources, and improve the overall efficiency of the communication system.
[0061] 2. The present invention can perform normal fitting on data streams from different sources, generate a check sequence from the residual and distribution parameters of the fitting function and the weighted information entropy function, load the communication data stream and the check sequence into the same frequency baseband, and use the check sequence to separate the detection results, thereby realizing the combined transmission of sideband signals, making better use of limited network resources, and improving the capacity and carrying capacity of the network.
[0062] 3. The present invention can establish a link through a gateway using short-distance communication technology, and allocate communication timing and channel frequency to each device according to the historical communication data volume, signal spectrum density, mutual independence and environmental noise of the device, so as to maximize the information transmission rate and reduce the error rate and packet loss rate of data transmission, thereby improving communication quality and stability. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0064] Figure 1 It is a structural schematic diagram of a communication data management system based on data analysis of the present invention;
[0065] Figure 2 It is a schematic diagram of the steps of a communication data management method based on data analysis of the present invention. DETAILED DESCRIPTION
[0066] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0067] See also Figure 1 ,The present invention provides a technical solution: a communication data management system based on data analysis, comprising: an independent unpacking module, a channel adjustment module, a superposition verification module, a physical link module and a timing agent module;
[0068] The independent unpacking module is composed of a data capture port, an unpacking port and an embedded computing device, and is used to monitor the upstream data flow at the communication port, assign weights to different machine codes after the data flow is unpacked, calculate the weighted information entropy of the data flow of each device, obtain a function of the change of the weighted information entropy over time, recorded as the first function, and calculate the independence between the first functions of each device;
[0069] The independent unpacking module includes: a port monitoring unit, an entropy management unit and an independent comparison unit;
[0070] The port monitoring unit is used to detect uplink data at the communication port of the device router and output a symbol sequence of the uplink data;
[0071] The entropy management unit is used to assign weights to different code elements in the sequence according to the code element sequence detected within a preset period, and calculate the weighted information entropy of the data stream;
[0072] The independent comparison unit is used to generate a weighted information entropy function and calculate the correlation of the weighted information entropy functions in each device.
[0073] The channel adjustment module is used to calculate the sideband communication capacity according to the independence of the first function of each device, allocate channels to the data streams of each device based on the principle of maximum sideband communication capacity, and generate a fusion channel according to the size of the sideband communication capacity, and the fusion channel is used to transmit the sideband superposition signal;
[0074] The channel adjustment module includes: a fusion channel unit and a sideband allocation unit;
[0075] The fusion channel unit is used to divide a dedicated fusion channel for transmitting a sideband signal according to the size of the sideband communication capacity;
[0076] The sideband allocation unit is used to allocate channels for the communication data streams of each device according to the correlation of the weighted information entropy functions of the devices, so as to maximize the total communication capacity.
[0077] The superposition verification module is composed of a signal generator, a verification interface and a data coupling device, and is used to perform normal fitting on data streams from different devices in the fusion channel, and the obtained fitting function is recorded as the second function, and the parameter information of the second function is output, and the residuals of the first function and the second function at different sampling points are calculated. The verification interface generates a verification sequence according to the residual sequence and the parameter information of the second function;
[0078] The stacking verification module includes: a normal fitting unit and a verification coupling unit;
[0079] The normal fitting unit is used to fit the code element sequence of each sideband data using a normal distribution function, generate a mean and a variance, and perform signal superposition on the sideband data from different sources;
[0080] The check coupling unit is used to calculate the residual between the fitting signal and the sideband signal, generate a check sequence, and couple the check sequence into the sideband signal and send it to the communication node.
[0081] The physical link module is used to load the communication data stream and the check sequence into the same frequency baseband and send them to the network node. The network node detects the data stream in the fusion channel, separates the detection results by using the check sequence, and establishes a solid-state link between devices by using short-distance communication technology, and obtains the historical communication records of each device by the solid-state link.
[0082] The physical link module includes: a node detection unit, a short-distance chip unit and a routing analysis unit;
[0083] The node detection unit is used to construct a protocol of a communication node, so that the communication node detects the sideband signal, and uses a check sequence to correct the detection result to obtain the original sideband signal;
[0084] The short-range chip unit is used to install short-range communication chips in communication devices, including: Bluetooth, Zigbee and NFC, to establish a solid-state communication connection between devices;
[0085] The routing analysis unit is used to summarize the historical communication records of each device, and the historical communication records include: data volume, signal spectrum density, mutual independence and environmental noise.
[0086] The timing agent module is used to calculate the device priority when the information transmission rate is the highest based on the historical communication records of the device, allocate communication timing and channel frequency to each device according to the priority, and calculate the current signal-to-noise ratio. Data that exceeds the signal-to-noise ratio threshold is handed over to the agent node for processing.
[0087] The timing agent module includes: a narrowband time-sharing unit and an agent node unit;
[0088] The narrowband time-sharing unit is used to calculate the priority of device communication according to the historical communication records of each device when the fusion channel is congested, and allocate the communication order of the devices according to the priority order;
[0089] The proxy node unit is used to calculate the current signal-to-noise ratio according to the environmental noise and the capacity of the fusion channel, and forward the fusion signal through the proxy node when the signal-to-noise ratio is higher than the signal-to-noise ratio threshold.
[0090] like Figure 2 As shown, a communication data management method based on data analysis includes the following steps:
[0091] Step S1. Use a sliding window to detect uplink data at the communication port of the device router, output a symbol sequence of the uplink data, assign weights to consecutive symbols in the sequence, and calculate a first function of the weighted information entropy of the data stream as the data stream changes;
[0092] Step S1 includes:
[0093] Step S11. Capture the uplink data stream at the communication port of the device, preset the sliding window width Y, and obtain the code element sequence [W T+1 ,W T+2 ,…,W T+Y ], where T represents the number of slides, W T+Y represents the T+Yth code element in the uplink data stream, and both Y and T are positive integers;
[0094] Step S12. In the symbol sequence, if the preamble signal and the postamble signal have the same data representation, the preamble signal is regarded as a continuous signal; if the preamble signal and the postamble signal have different data representations or there is no postamble signal, the preamble signal is regarded as an independent signal;
[0095] Assign weight r1 to continuous signals and weight r2 to independent signals, and satisfy r1<1, r2<1 and r1≠r2, then the weighted information entropy in the codeword sequence satisfies: H T =C1·r1 / 2+(Y-C1)·r2 / 2, where H T represents the weighted information entropy in the codeword sequence at the Tth slide, and C1 represents the number of continuous signals;
[0096] Step S13: When the device completes uplink data stream transmission, it outputs a weighted information entropy sequence [H1, H2, ..., H n ], where n represents the total number of sliding windows, H n Represents the weighted information entropy in the codeword sequence during the nth slide. According to the time required for each slide, the weighted information entropy sequence is represented by a function to obtain a first function F(T), where F(T) is a discrete function.
[0097] Step S2. Calculate the correlation of the first function of each device, separate the segments whose correlation is greater than an environmental threshold, the environmental threshold is determined by the channel noise, and output all the obtained segments as sideband signals;
[0098] Step S2 includes:
[0099] Step S21: Pair the devices in pairs, record them as device 1 and device 2 respectively, and calculate the correlation of the first function according to the following formula:
[0100]
[0101] Where F1(T) is the first function of device 1, F2(T) is the first function of device 2, k and L represent the lower and upper bounds of the fragment respectively, and D (k,L) [F1(T)||F2(T)] represents the correlation of the first functions of two devices in the segment (k, L), i is the counting number;
[0102] Step S22. Preset the environmental threshold D0 according to the power of the channel noise, adjust the values of k and L so that the correlation of the first function of the two devices is greater than the environmental threshold, output all fragments (k, L), and output the kth to Lth data in the data streams of the two devices as sideband signals.
[0103] Step S3. Calculate the ratio of the sideband signal data volume to the total data volume, multiply it by the total transmission bandwidth of the link, obtain the frequency band requirement of the sideband signal, and divide the fusion channel of the corresponding bandwidth in the total link;
[0104] Step S3 includes:
[0105] Step S31. Subtract the upper bound and the lower bound of the output segment to obtain the data volume of the segment, and add the data volumes of all the output segments in step S22 to obtain the data volume of the sideband signal;
[0106] Step S32. Calculate the bandwidth B of the sideband signal according to the total bandwidth of the communication link, where B=B0·y1 / y2, where B0 represents the total bandwidth of the communication link, y1 represents the data volume of the sideband signal, and y2 represents the data volume of the entire signal;
[0107] Step S33. A dedicated channel with a bandwidth of B is divided from the total bandwidth, which is recorded as a fused channel. The sideband signal is separated from the baseband signal. The baseband signal is transmitted through a non-fused channel, and the sideband signal is transmitted through a fused channel.
[0108] Step S4. Perform normal fitting on the sideband signals from different devices, record the fitting function as the second function, superimpose the sideband signals, calculate the total residual of the first function and the second function, generate a check sequence, load the check sequence and the sideband signal into the same frequency baseband and send them to the network node. The node uses the check sequence to separate the detection result to obtain the original data stream;
[0109] Step S4 includes:
[0110] Step S41. For each device, the sideband signal is fitted using a normal distribution function:
[0111]
[0112] Where m represents the total number of code elements corresponding to the sideband signals, x1, x2, …, xm represent the order of the code elements corresponding to the 1st, 2nd, …, mth sideband signals in the code element sequence, a and b represent the mean and standard deviation of the fitted distribution, respectively, and F(x) represents the first function of the device. Substituting all values of x into the function generates the best fitting results of a and b.
[0113] Step S42. A normal distribution function with a mean of a and a standard deviation of b is used as the second function of the device, the first functions of device 1 and device 2 are added to obtain a total first function, the second functions are added to obtain a total second function, and the total first function is subtracted from the total second function to obtain a residual sequence [d1, d2, …, dm], where d1, d2, …, dm represent the code element positions corresponding to the 1st, 2nd, …, mth sideband signals, respectively, and the difference between the total first function and the total second function;
[0114] Step S43. Generate a check sequence according to the residual sequence of device 1 and device 2 and the parameters in the second function, superimpose the sideband signals of device 1 and device 2, load the check sequence and the sideband signal into the same frequency baseband, and send them to the network node through the fusion channel;
[0115] Step S44: After the node obtains the check sequence, it detects the superimposed sideband signal, separates the detection result according to the check sequence, obtains the sideband signals of device 1 and device 2, and restores the data stream signal with the baseband signal in the non-fused channel.
[0116] Step S5. Allocate communication timing according to the amount of information of the devices in the same cycle. After all devices have completed communication, go to step S1, re-measure the environmental noise, and adjust the environmental threshold.
[0117] Step S5 includes:
[0118] Step S51. Add all elements in the device weighted information entropy sequence to obtain the communication data volume of the device, and assign the communication priority of each group of devices in descending order according to the sum of the communication data volume of each group of devices;
[0119] Step S52. After all groups of devices have completed communication, go to step S1 and re-measure the environmental noise, and adjust the environmental threshold to D1, where D1=D0·lg(P1 / P2), where P1 and P2 represent the last measured environmental noise power and the currently measured environmental noise power, respectively.
[0120] Embodiment: There are 4 devices transmitting data streams, the signal transmitted by device 1 is [10110110], the sliding window width is 5, the continuous signal is assigned a weight of 0.4, and the independent signal is assigned a weight of 0.6, then the weighted information entropy sequence is [2.6, 2.4, 2.6], the correlation between device 1 and device 2 in segments (2,4) and (7,8) is greater than the environmental threshold, then
[011] and
[10] in device 1 are output as sideband signals, the total communication bandwidth of device 1 is 80M, then 50M of it is allocated as a fusion channel to transmit the sideband signal.
[0121] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0122] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A communication data management method based on data analysis, characterized in that: The method comprises the following steps: Step S1. Use a sliding window to detect uplink data at the communication port of the device router, output a symbol sequence of the uplink data, assign weights to consecutive symbols in the sequence, and calculate a first function of the weighted information entropy of the data stream as the data stream changes; Step S2. Group the devices in pairs, calculate the correlation of the first function of each group of devices, separate the segments whose correlation is greater than an environmental threshold, where the environmental threshold is determined by the channel noise, and output all the obtained segments as sideband signals; Step S3. Calculate the ratio of the sideband signal data volume to the total data volume, multiply it by the total transmission bandwidth of the link, obtain the frequency band requirement of the sideband signal, and divide the fusion channel of the corresponding bandwidth in the total link; Step S4. Perform normal fitting on the sideband signals from different devices, record the fitting function as the second function, superimpose the sideband signals, calculate the total residual of the first function and the second function, generate a check sequence, load the check sequence and the sideband signal into the same frequency baseband and send them to the network node. The node uses the check sequence to separate the detection result to obtain the original data stream; Step S5. Allocate communication timing according to the amount of information of the devices in the same cycle. After all devices have completed communication, go to step S1, re-measure the environmental noise, and adjust the environmental threshold; Step S1 includes: Step S11. Capture the uplink data stream at the communication port of the device, preset the sliding window width Y, and obtain the code element sequence [W T+1 ,W T+2 ,…,W T+Y ], where T represents the number of slides, W T+Y represents the T+Yth code element in the uplink data stream, and both Y and T are positive integers; Step S12. In the symbol sequence, if the preamble signal and the postamble signal have the same data representation, the preamble signal is regarded as a continuous signal; if the preamble signal and the postamble signal have different data representations or there is no postamble signal, the preamble signal is regarded as an independent signal; Assign weight r1 to continuous signals and weight r2 to independent signals, and satisfy r1<1, r2<1 and r1≠r2, then the weighted information entropy in the codeword sequence satisfies: H T =C1·r1 / 2+(Y-C1)·r2 / 2, where H T represents the weighted information entropy in the codeword sequence at the Tth slide, and C1 represents the number of continuous signals; Step S13: When the device completes uplink data stream transmission, it outputs a weighted information entropy sequence [H1, H2, ..., H n ], where n represents the total number of sliding windows, H n represents the weighted information entropy in the codeword sequence at the nth slide, and the weighted information entropy sequence is expressed as a function according to the time required for each slide to obtain a first function F(T), where F(T) is a discrete function; Step S2 includes: Step S21: Pair the devices in pairs, record them as device 1 and device 2 respectively, and calculate the correlation of the first function according to the following formula: Where F1(T) is the first function of device 1, F2(T) is the first function of device 2, k and L represent the lower and upper bounds of the fragment respectively, and D (k,L) [F1(T)||F2(T)] represents the correlation of the first functions of two devices in the segment (k, L), i is the counting number; Step S22. Preset the environmental threshold D0 according to the power of the channel noise, adjust the values of k and L so that the correlation of the first function of the two devices is greater than the environmental threshold, output all segments (k, L), and output the kth to Lth data in the data streams of the two devices as sideband signals; Step S4 includes: Step S41. For each device, the sideband signal is fitted using a normal distribution function: Where m represents the total number of code elements corresponding to the sideband signals, x1, x2, …, xm represent the order of the code elements corresponding to the 1st, 2nd, …, mth sideband signals in the code element sequence, a and b represent the mean and standard deviation of the fitted distribution, respectively, and F(x) represents the first function of the device. Substituting all values of x into the function generates the best fitting results of a and b. Step S42. A normal distribution function with a mean of a and a standard deviation of b is used as the second function of the device, the first functions of device 1 and device 2 are added to obtain a total first function, the second functions are added to obtain a total second function, and the total first function is subtracted from the total second function to obtain a residual sequence [d1, d2, …, dm], where d1, d2, …, dm represent the code element positions corresponding to the 1st, 2nd, …, mth sideband signals, respectively, and the difference between the total first function and the total second function; Step S43. Generate a check sequence according to the residual sequence of device 1 and device 2 and the parameters in the second function, superimpose the sideband signals of device 1 and device 2, load the check sequence and the sideband signal into the same frequency baseband, and send them to the network node through the fusion channel; Step S44. After the node obtains the check sequence, it detects the superimposed sideband signal, separates the detection result according to the check sequence, obtains the sideband signals of device 1 and device 2, and restores the data stream signal with the baseband signal in the non-fused channel; Step S5 includes: Step S51. Add all elements in the device weighted information entropy sequence to obtain the communication data volume of the device, and assign the communication priority of each group of devices in descending order according to the sum of the communication data volume of each group of devices; Step S52. After all groups of devices have completed communication, go to step S1 and re-measure the environmental noise, and adjust the environmental threshold to D1, where D1=D0·lg(P1 / P2), where P1 and P2 represent the last measured environmental noise power and the currently measured environmental noise power, respectively.
2. A communication data management method based on data analysis according to claim 1, characterized in that: Step S3 includes: Step S31. Subtract the upper bound and the lower bound of the output segment to obtain the data volume of the segment, and add the data volumes of all the output segments in step S22 to obtain the data volume of the sideband signal; Step S32. Calculate the bandwidth B of the sideband signal according to the total bandwidth of the communication link, where B=B0·y1 / y2, where B0 represents the total bandwidth of the communication link, y1 represents the data volume of the sideband signal, and y2 represents the data volume of the entire signal; Step S33. A dedicated channel with a bandwidth of B is divided from the total bandwidth, which is recorded as a fused channel. The sideband signal is separated from the baseband signal. The baseband signal is transmitted through a non-fused channel, and the sideband signal is transmitted through a fused channel.
3. A communication data management system based on data analysis, the system executing the communication data management method based on data analysis as claimed in claim 1, characterized in that: The system includes the following modules: an independent unpacking module, a channel adjustment module, a superposition verification module, a physical link module and a timing agent module; The independent unpacking module is composed of a data capture port, an unpacking port and an embedded computing device, and is used to monitor the upstream data flow at the communication port, assign weights to different machine codes after the data flow is unpacked, calculate the weighted information entropy of the data flow of each device, obtain the function of the weighted information entropy changing with the data flow, recorded as the first function, and calculate the correlation between the first functions of each device; The channel adjustment module is used to output the data volume of the sideband signal according to the correlation of the first function of each device, allocate channels to the data streams of each device based on the principle of maximum communication capacity of the sideband signal, and generate a fusion channel according to the size of the sideband signal communication capacity, and the fusion channel is used to transmit the sideband superposition signal; The superposition verification module is composed of a signal generator, a verification interface and a data coupling device, and is used to perform normal fitting on the sideband signals from different devices in the fusion channel, record the obtained fitting function as the second function, output the parameter information of the second function, calculate the total residual of the first function and the second function, and the verification interface generates a verification sequence according to the residual sequence and the parameter information of the second function; The physical link module is used to load the communication data stream and the check sequence into the same frequency baseband and send them to the network node. The network node detects the data stream in the fusion channel, separates the detection result by using the check sequence, obtains the original data stream, and establishes a solid-state link between devices by using the short-distance communication technology, and obtains the historical communication records of each device by the solid-state link. The timing agent module is used to calculate the device priority when the information transmission rate is the highest based on the historical communication records of the device, allocate communication timing and channel frequency to each device according to the priority, and calculate the current signal-to-noise ratio. Data that exceeds the signal-to-noise ratio threshold is handed over to the agent node for processing.
4. A communication data management system based on data analysis according to claim 3, characterized in that: The independent unpacking module includes: a port monitoring unit, an entropy management unit and an independent comparison unit; The port monitoring unit is used to detect uplink data at the communication port of the device router and output a symbol sequence of the uplink data; The entropy management unit is used to assign weights to different code elements in the sequence according to the code element sequence detected within a preset period, and calculate the weighted information entropy of the data stream; The independent comparison unit is used to generate a weighted information entropy function and calculate the correlation of the weighted information entropy functions in each device.
5. A communication data management system based on data analysis according to claim 4, characterized in that: The channel adjustment module includes: a fusion channel unit and a sideband allocation unit; The fusion channel unit is used to divide a dedicated fusion channel for transmitting a sideband signal according to the size of the sideband communication capacity; The sideband allocation unit is used to allocate channels for communication data streams of each device according to the correlation of the device weighted information entropy function to maximize the total communication capacity; The stacking verification module includes: a normal fitting unit and a verification coupling unit; The normal fitting unit is used to fit the code element sequence of each sideband data using a normal distribution function, generate a mean and a variance, and perform signal superposition on the sideband data from different sources; The check coupling unit is used to calculate the residual between the fitting signal and the sideband signal, generate a check sequence, and couple the check sequence into the sideband signal and send it to the communication node.
6. A communication data management system based on data analysis according to claim 5, characterized in that: The physical link module includes: a node detection unit, a short-distance chip unit and a routing analysis unit; The node detection unit is used to construct a protocol of a communication node, so that the communication node detects the sideband signal, and uses a check sequence to correct the detection result to obtain the original sideband signal; The short-range chip unit is used to install short-range communication chips in communication devices, including: Bluetooth, Zigbee and NFC, to establish a solid-state communication connection between devices; The routing analysis unit is used to summarize the historical communication records of each device, and the historical communication records include: data volume, signal spectrum density, mutual independence and environmental noise.
7. A communication data management system based on data analysis according to claim 6, characterized in that: The timing agent module includes: a narrowband time-sharing unit and an agent node unit; The narrowband time-sharing unit is used to calculate the priority of device communication according to the historical communication records of each device when the fusion channel is congested, and allocate the communication order of the devices according to the priority order; The proxy node unit is used to calculate the current signal-to-noise ratio according to the environmental noise and the capacity of the fusion channel, and forward the fusion signal through the proxy node when the signal-to-noise ratio is higher than the signal-to-noise ratio threshold.
Citation Information
Patent Citations
Underwater wireless sensor network information transmission method based on chaotic compressed sensing encryption
CN108495314A
Automated burst signal detection method
CN114584227A
Informatization machine room monitoring and management system
CN118400314A
UWB transmission using DPSK
EP1475935A2
Accessing CP channels with LP terminals via wavefront multiplexing
US20150263821A1
