Data fusion transmission method, device, electronic device and storage medium

Abstract

The present invention relates to the field of data fusion transmission technology, and in particular to a data fusion transmission method, device, electronic device and storage medium. The method of the present invention first obtains multiple data streams; then cuts the multiple data streams, performs data overlap processing on the multiple arrays obtained by cutting, obtains preprocessing coefficients and multiple first arrays; then uses the multiple first arrays to adjust multiple parameters of the first data fusion model pair to obtain a second data fusion model pair; finally, the multiple first arrays are input into the second coding model to obtain multiple second arrays, and multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays are transmitted. The present invention performs data overlap processing, uses the data overlap to build a fusion model, and the fusion model uses short coding to represent data with high overlap. The length of the fused data becomes shorter, the total amount of data transmission obtained by fusion is smaller, and the data transmission efficiency is higher.

Description

Technical Field

[0001] The present invention relates to the technical field of data fusion transmission, and in particular to a data fusion transmission method, device, electronic equipment and storage medium. Background Art

[0002] Power inspection devices are mainly used for the survey, maintenance and inspection of power lines. Power inspection devices are multi-purpose and have diverse working scenarios, which requires them to collect a variety of data including images and various sensor data during operation.

[0003] At the same time, the power inspection device needs to follow the command of the rear platform during operation, and the large amount of collected data needs to be transmitted to the rear command platform. The transmission of large amounts of data limits the reliability and timeliness of data transmission.

[0004] One solution is to classify the transmitted data into multiple priorities and transmit the data according to the priority. However, this solution does not substantially improve the efficiency of data transmission.

[0005] Based on this, it is necessary to develop and design a data fusion transmission method. Summary of the Invention

[0006] The embodiments of the present invention provide a data fusion transmission method, device, electronic device and storage medium, which are used to solve the problem of low data transmission efficiency in the prior art.

[0007] In a first aspect, an embodiment of the present invention provides a data fusion transmission method, comprising:

[0008] Get multiple data streams;

[0009] Cutting the multiple data streams, performing data overlap processing on the multiple arrays obtained by cutting, and obtaining multiple preprocessing coefficients and multiple first arrays;

[0010] Adjusting multiple parameters of the first data fusion model pair using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model;

[0011] The multiple first arrays are input into the second encoding model to obtain multiple second arrays, and multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays are transmitted, wherein the target model parameters are parameters of the second decoding model.

[0012] In one possible implementation, the clipping of the multiple data streams and the data overlap processing of the multiple arrays obtained by clipping to obtain multiple preprocessing coefficients and multiple first arrays include:

[0013] Get the mapping interval;

[0014] Cut the multiple data streams according to the first data length to obtain multiple intermediate arrays;

[0015] Counting the number of values ​​appearing in the plurality of intermediate arrays respectively to obtain a plurality of first statistical numbers, wherein each first statistical number corresponds to an intermediate array, and the first statistical number represents the number of values ​​appearing in the intermediate array;

[0016] If the maximum value among the multiple first statistical numbers is greater than the mapping interval, reducing the first data length, and jumping to the step of trimming the multiple data streams according to the first data length to obtain multiple intermediate arrays;

[0017] Otherwise, the plurality of intermediate arrays are adjusted according to the mapping interval and the lower limit of the mapping interval to obtain the plurality of preprocessing coefficients and the plurality of first arrays.

[0018] In one possible implementation, adjusting the multiple intermediate arrays according to the mapping interval and the lower limit of the mapping interval to obtain the preprocessing coefficients and the multiple first arrays includes:

[0019] For each intermediate array, extracting the maximum data and the minimum data as two preprocessing coefficients of the intermediate array, thereby obtaining a plurality of preprocessing coefficients;

[0020] The plurality of intermediate arrays are adjusted according to a first formula, the mapping interval, and a lower limit of the mapping interval to obtain the plurality of first arrays, wherein the first formula:

[0021]

[0022] Where, is the mapping interval, is the lower limit of the mapping interval, The middle array data, is the maximum data of the middle array, is the minimum data of the middle array, The first array data, is the rounding function.

[0023] In one possible implementation, the first data fusion model pair includes a first encoding model and a first decoding model, and adjusting multiple parameters of the first data fusion model pair using the multiple first arrays to obtain the second data fusion model pair includes:

[0024] Obtaining a mapping interval, a first encoding model, and a first decoding model;

[0025] Arrange the data appearing in the plurality of first arrays according to their frequencies of appearance in the plurality of first arrays to obtain a sample queue;

[0026] Constructing a second data queue arranged in order of size and filling the mapping interval, wherein the data in the second data queue are integers;

[0027] constructing the second data queue as a label queue of the sample queue, wherein the label value of the sample queue data is negatively correlated with the occurrence frequency of the sample queue data in the plurality of first arrays;

[0028] Multiple parameters of the first encoding model and multiple parameters of the first decoding model are adjusted according to the sample queue and the label queue, and the adjusted first encoding model and the adjusted first decoding model are used as a first data fusion model pair.

[0029] In one possible implementation, adjusting multiple parameters of the first encoding model and multiple parameters of the first decoding model according to the sample queue and the label queue, and using the adjusted first encoding model and the adjusted first decoding model as a first data fusion model pair, includes:

[0030] Randomly inputting a plurality of data of the sample queue into the first coding model;

[0031] If the deviation between the output of the first coding model and the target label is greater than a first threshold, adjusting multiple parameters of the first coding model according to the deviation between the output of the first coding model and the target label, and jumping to the step of randomly inputting multiple data in the sample queue into the first coding model, wherein the target label is the label corresponding to the data input to the first coding model;

[0032] Randomly inputting multiple labels of the label queue into the first decoding model;

[0033] If the deviation between the output of the first decoding model and the target data is greater than a second threshold, adjusting multiple parameters of the first decoding model according to the deviation between the output of the first decoding model and the target data, and jumping to the step of randomly inputting multiple labels of the label queue into the first decoding model, wherein the target data is data of the sample queue identified by the label input to the first decoding model;

[0034] The adjusted first encoding model and the adjusted first decoding model are used as the second encoding model and the second decoding model respectively.

[0035] In one possible implementation, the first coding model is:

[0036]

[0037] Where, is the output of the first coding model, For the Rank Output of the intermediate function, is the node meta-function, is the first bias parameter, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, For the The output of the input node, For the The weight parameters of the input nodes, For the Input data, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters;

[0038] The first decoding model is:

[0039]

[0040] Where, is the output of the second model, For the Rank Output of the intermediate function, is the second bias constant, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, is the output of the input node, is the weight parameter of the input node, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters.

[0041] In one possible implementation, the node meta-function is:

[0042]

[0043] Where, is the input quantity, is a natural constant.

[0044] In a second aspect, an embodiment of the present invention provides a data fusion transmission device for implementing the data fusion transmission method described in the first aspect or any possible implementation of the first aspect, the data fusion transmission device comprising:

[0045] A data stream acquisition module, used to acquire multiple data streams;

[0046] A data adjustment module, configured to trim the plurality of data streams, perform data overlap processing on the plurality of arrays obtained by trimming, and obtain preprocessing coefficients and a plurality of first arrays;

[0047] a fusion model construction module, configured to adjust multiple parameters of the first data fusion model pair using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model;

[0048] as well as,

[0049] A data transmission module is used to input the multiple first arrays into the second coding model to obtain multiple second arrays, and to transmit multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays, wherein the target model parameters are the parameters of the second decoding model.

[0050] In a third aspect, an embodiment of the present invention provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, it implements the steps of the method described in the first aspect or any possible implementation of the first aspect.

[0051] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the method described in the first aspect or any possible implementation of the first aspect.

[0052] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0053] The data fusion transmission method implementation method of the present invention first obtains multiple data streams; then cuts the multiple data streams, performs data overlap processing on the multiple arrays obtained by cutting, and obtains preprocessing coefficients and multiple first arrays; then uses the multiple first arrays to adjust multiple parameters of the first data fusion model pair to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model; finally, the multiple first arrays are input into the second encoding model to obtain multiple second arrays, and multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays are transmitted, wherein the target model parameters are parameters of the second decoding model. The implementation method of the present invention performs data overlap processing and constructs a fusion model using the degree of data overlap. The fusion model uses short coding to represent data with high overlap, and the length of the fused data becomes shorter, the total amount of data transmission obtained by fusion is smaller, and the efficiency of data transmission is higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0055] Figure 1 is a flow chart of a data fusion transmission method provided by an embodiment of the present invention;

[0056] Figure 2 This is a schematic diagram of the data stream cutting process provided by an embodiment of the present invention;

[0057] Figure 3 This is a diagram showing the principle of numerical statistics of array occurrences provided by an embodiment of the present invention;

[0058] Figure 4 This is a functional block diagram of a data fusion transmission device provided by an embodiment of the present invention;

[0059] Figure 5 This is a functional block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0060] In the following description, specific details such as particular system structures and techniques are provided for purposes of illustration, not limitation, to facilitate a thorough understanding of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced in alternative embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0061] In order to make the objectives, technical solutions and advantages of the present invention more clear, the following will be described through specific implementation methods in conjunction with the accompanying drawings.

[0062] The following is a detailed description of an embodiment of the present invention. This example is implemented based on the technical solution of the present invention, and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to the following embodiment.

[0063] Figure 1 This is a flow chart of the data fusion transmission method provided in an embodiment of the present invention.

[0064] like Figure 1 As shown, it shows a flow chart of the implementation of the data fusion transmission method provided by an embodiment of the present invention, which is detailed as follows:

[0065] In step 101, multiple data streams are obtained.

[0066] In step 102, the plurality of data streams are cropped, and a data overlap process is performed on the plurality of arrays obtained by the cropping to obtain a plurality of preprocessing coefficients and a plurality of first arrays.

[0067] In some implementations, step 102 includes: obtaining a mapping interval;

[0068] Cut the multiple data streams according to the first data length to obtain multiple intermediate arrays;

[0069] Counting the number of values ​​appearing in the plurality of intermediate arrays respectively to obtain a plurality of first statistical numbers, wherein each first statistical number corresponds to an intermediate array, and the first statistical number represents the number of values ​​appearing in the intermediate array;

[0070] If the maximum value among the multiple first statistical numbers is greater than the mapping interval, reducing the first data length, and jumping to the step of trimming the multiple data streams according to the first data length to obtain multiple intermediate arrays;

[0071] Otherwise, the plurality of intermediate arrays are adjusted according to the mapping interval and the lower limit of the mapping interval to obtain the plurality of preprocessing coefficients and the plurality of first arrays.

[0072] In some implementations, adjusting the plurality of intermediate arrays according to the mapping interval and the lower limit of the mapping interval to obtain the preprocessing coefficients and the plurality of first arrays includes:

[0073] For each intermediate array, extracting the maximum data and the minimum data as two preprocessing coefficients of the intermediate array, thereby obtaining a plurality of preprocessing coefficients;

[0074] The plurality of intermediate arrays are adjusted according to a first formula, the mapping interval, and a lower limit of the mapping interval to obtain the plurality of first arrays, wherein the first formula:

[0075]

[0076] Where, is the mapping interval, is the lower limit of the mapping interval, The middle array data, is the maximum data of the middle array, is the minimum data of the middle array, The first array data, is the rounding function.

[0077] Exemplarily, an embodiment of the present invention first obtains multiple data streams, which may correspond to multiple data collection points, such as temperature data, humidity data, position data, image data, and the like. Transmitting these data after fusion can reduce the total amount of data transmission and improve the efficiency of data transmission. In an embodiment of the present invention, multiple data streams are cut according to a preset length to obtain multiple arrays, and the multiple arrays are overlapped. Then, the frequency of occurrence of the overlapped data is counted, and the frequency of occurrence is used as a label for the data. A fusion model is established using these overlapped data. Finally, the overlapped data is generated by the fusion model to generate fused data, and the fused data is transmitted. Since the fused data is based on the frequency of occurrence of the data, and the higher the frequency of occurrence of the data, the shorter the length of the fused data, the total amount of data transmission obtained by fusion is smaller and the efficiency of data transmission is higher.

[0078] To achieve this, the present invention first performs a trimming and re-alignment process on multiple data streams. After trimming, multiple intermediate arrays are obtained. The number of values ​​appearing in each intermediate array is then counted. If the number of values ​​in any of these intermediate arrays exceeds the number of mapped intervals, the trimming length is reduced and trimming is repeated. If the number of values ​​in any of these intermediate arrays is less than the number of mapped intervals, the intermediate arrays are mapped uniformly to the mapped intervals.

[0079] For example, after trimming the data stream, a total of N arrays are obtained, from the 1st to the Nth. The number of types of values ​​appearing in the Mth array is at most 1352 (for example, each array contains 2500 data items, and repeated values ​​are considered to be one value). However, the mapping interval range is 1000 (0-999). This indicates that the trimming length is too long and needs to be shortened before trimming again.

[0080] In terms of performing the overlap processing, the implementation method is to first extract the maximum value and the minimum value in the array of each intermediate number as the preprocessing coefficient, thereby obtaining the preprocessing coefficient of twice the number of the numbers, and then perform the overlap processing on the intermediate array according to the first formula, the first formula is:

[0081]

[0082] Where, is the mapping interval, is the lower limit of the mapping interval, The middle array data, is the maximum data of the middle array, is the minimum data of the middle array, The first array data, is the rounding function.

[0083] Figure 2 The diagram shows a process of cutting multiple data streams 201 according to a preset data length 202 to obtain multiple intermediate arrays. Figure 3 The process of counting the number of values ​​302 that appear based on the intermediate array 301 is shown. In the figure, the same value is classified into one class, and the number of classes is the number of values ​​that appear in the intermediate array.

[0084] In step 103, multiple parameters of the first data fusion model pair are adjusted using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model.

[0085] In some embodiments, step 103 includes:

[0086] Obtaining a mapping interval, a first encoding model, and a first decoding model;

[0087] Arrange the data appearing in the plurality of first arrays according to their frequencies of appearance in the plurality of first arrays to obtain a sample queue;

[0088] Constructing a second data queue arranged in order of size and filling the mapping interval, wherein the data in the second data queue are integers;

[0089] constructing the second data queue as a label queue of the sample queue, wherein the label value of the sample queue data is negatively correlated with the occurrence frequency of the sample queue data in the plurality of first arrays;

[0090] Multiple parameters of the first encoding model and multiple parameters of the first decoding model are adjusted according to the sample queue and the label queue, and the adjusted first encoding model and the adjusted first decoding model are used as a first data fusion model pair.

[0091] In some embodiments, adjusting multiple parameters of the first encoding model and multiple parameters of the first decoding model according to the sample queue and the label queue, and using the adjusted first encoding model and the adjusted first decoding model as a first data fusion model pair, includes:

[0092] Randomly inputting a plurality of data of the sample queue into the first coding model;

[0093] If the deviation between the output of the first coding model and the target label is greater than a first threshold, adjusting multiple parameters of the first coding model according to the deviation between the output of the first coding model and the target label, and jumping to the step of randomly inputting multiple data in the sample queue into the first coding model, wherein the target label is the label corresponding to the data input to the first coding model;

[0094] Randomly inputting multiple labels of the label queue into the first decoding model;

[0095] If the deviation between the output of the first decoding model and the target data is greater than a second threshold, adjusting multiple parameters of the first decoding model according to the deviation between the output of the first decoding model and the target data, and jumping to the step of randomly inputting multiple labels of the label queue into the first decoding model, wherein the target data is data of the sample queue identified by the label input to the first decoding model;

[0096] The adjusted first encoding model and the adjusted first decoding model are used as the second encoding model and the second decoding model respectively.

[0097] In some embodiments, the first coding model is:

[0098]

[0099] Where, is the output of the first coding model, For the Rank Output of the intermediate function, is the node meta-function, is the first bias parameter, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, For the The output of the input node, For the The weight parameters of the input nodes, For the Input data, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters;

[0100] The first decoding model is:

[0101]

[0102] Where, is the output of the second model, For the Rank Output of the intermediate function, is the second bias constant, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, is the output of the input node, is the weight parameter of the input node, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters.

[0103] In some embodiments, the node meta-function is:

[0104]

[0105] Where, is the input quantity, is a natural constant.

[0106] For example, in an embodiment of the present invention, the first array obtained in the aforementioned steps is used to adjust multiple parameters of the first data fusion model pair, thereby enabling the first data fusion model pair to encode the first array obtained in the aforementioned steps and decode the encoded data. In practice, the first data fusion model pair includes two models: a first encoding model and a first set code model.

[0107] The first coding model is:

[0108]

[0109] Where, is the output of the first coding model, For the Rank Output of the intermediate function, is the node meta-function, is the first bias parameter, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, For the The output of the input node, For the The weight parameters of the input nodes, For the Input data, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters;

[0110] The first decoding model is:

[0111]

[0112] Where, is the output of the second model, For the Rank Output of the intermediate function, is the second bias constant, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, is the output of the input node, is the weight parameter of the input node, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters.

[0113] The node meta-function in the above formula is:

[0114]

[0115] Where, is the input quantity, is a natural constant.

[0116] Before using multiple first arrays to adjust multiple parameters of the model queue, first arrange the data in the multiple first arrays according to the frequency of occurrence to obtain a sample queue, and then fill it with integer corresponding number intervals to obtain a second data queue, and then construct the second data queue as a label queue of the sample queue. It should be emphasized here that the frequency of occurrence of the data in the sample queue is negatively correlated with the value of the label data.

[0117] For example, multiple first arrays are arranged in descending order according to the frequency of occurrence of numerical values, namely N1, N2, ... N999. At this time, a sample queue is obtained. The data filling the mapping interval is arranged in ascending order to construct a second data queue, 1, 2, ... 999. A mapping is established between the two queues, and the corresponding position is its label.

[0118] After labeling the sample queue, data is extracted from the sample queue and input into the first encoding model. According to the deviation between the output value of the encoding model and the label of the input data, the parameters of the first encoding model are adjusted (for example, using the gradient descent method). The above steps are repeatedly performed until the first encoding model can accurately fit the relationship between the data and the label in the sample queue. At this time, the first encoding model is used as the second encoding model.

[0119] At the same time, data is extracted from the second data queue (label queue) and input into the first decoding model. According to the deviation between the output value of the decoding model and the data identified by the input data, the parameters of the first decoding model are adjusted. The above steps are repeated until the first decoding model can accurately fit the relationship between the data and the label in the sample queue. At this time, the first decoding model is used as the second decoding model.

[0120] In step 104, the multiple first arrays are input into the second encoding model to obtain multiple second arrays, and multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays are transmitted, wherein the target model parameters are parameters of the second decoding model.

[0121] For example, after the encoding and decoding model is constructed, the data in multiple first arrays can be input into the second encoding model for encoding, and the obtained arrays are used as multiple second arrays to transmit the parameters of the second decoding model, multiple preprocessing coefficients and multiple second arrays.

[0122] After receiving the data at the receiving end, a decoding model is constructed based on the parameters of the second decoding model, and then multiple second arrays are input into this decoding model to obtain multiple third arrays. In fact, the third data is the restoration of the first array. The data is then de-coincided based on the first array and multiple preprocessing coefficients, and the data is restored.

[0123] The data fusion transmission method implementation method of the present invention first obtains multiple data streams; then cuts the multiple data streams, performs data overlap processing on the multiple arrays obtained by cutting, and obtains preprocessing coefficients and multiple first arrays; then uses the multiple first arrays to adjust multiple parameters of the first data fusion model pair to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model; finally, the multiple first arrays are input into the second encoding model to obtain multiple second arrays, and multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays are transmitted, wherein the target model parameters are parameters of the second decoding model. The implementation method of the present invention performs data overlap processing and constructs a fusion model using the degree of data overlap. The fusion model uses short coding to represent data with high overlap, and the length of the fused data becomes shorter, the total amount of data transmission obtained by fusion is smaller, and the efficiency of data transmission is higher.

[0124] It should be understood that the size of the serial numbers of each step in the above embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0125] The following is an embodiment of the device of the present invention. For details not described in detail, please refer to the corresponding method embodiment described above.

[0126] Figure 4 This is a functional block diagram of the data fusion transmission device provided by the embodiment of the present invention, referring to Figure 4 The data fusion transmission device includes: a data stream acquisition module 401, a data adjustment module 402, a fusion model construction module 403 and a data transmission module 404, wherein:

[0127] The data stream acquisition module 401 is used to acquire multiple data streams;

[0128] A data adjustment module 402 is configured to trim the plurality of data streams, perform data overlap processing on the plurality of arrays obtained by trimming, and obtain preprocessing coefficients and a plurality of first arrays;

[0129] A fusion model construction module 403 is configured to adjust multiple parameters of the first data fusion model pair using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model;

[0130] The data transmission module 404 is used to input the multiple first arrays into the second coding model to obtain multiple second arrays, and transmit multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays, wherein the target model parameters are the parameters of the second decoding model.

[0131] Figure 5 : is a functional block diagram of an electronic device provided by an embodiment of the present invention. Figure 5 As shown, the electronic device 5 of this embodiment includes: a processor 500 and a memory 501, wherein the memory 501 stores a computer program 502 that can be run on the processor 500. When the processor 500 executes the computer program 502, the steps in the above-mentioned data fusion transmission method and embodiment are implemented, such as Figure 1 Steps 101 to 104 are shown.

[0132] Illustratively, the computer program 502 may be divided into one or more modules / units, and the one or more modules / units are stored in the memory 501 and executed by the processor 500 to implement the present invention.

[0133] The electronic device 5 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The electronic device 5 may include, but is not limited to, a processor 500 and a memory 501. Those skilled in the art will understand that Figure 5 It is only an example of the electronic device 5 and does not constitute a limitation of the electronic device 5. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device 5 may also include input and output devices, network access devices, buses, etc.

[0134] The processor 500 may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0135] The memory 501 can be an internal storage unit of the electronic device 5, such as a hard drive or memory of the electronic device 5. The memory 501 can also be an external storage device of the electronic device 5, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. equipped on the electronic device 5. Furthermore, the memory 501 can include both an internal storage unit of the electronic device 5 and an external storage device. The memory 501 is used to store the computer program 502 and other programs and data required by the electronic device 5. The memory 501 can also be used to temporarily store data that has been output or is about to be output.

[0136] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the implementation method can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method implementation method, and will not be repeated here.

[0137] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0138] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0139] In the embodiments provided by the present invention, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0140] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of this embodiment.

[0141] In addition, the functional units in various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0142] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention can also implement all or part of the processes in the above-mentioned method embodiments by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by a processor, the computer program can implement the steps of the above-mentioned method and device embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium.

[0143] The above-described embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. A data fusion transmission method, characterized in that: include: Get multiple data streams; Cutting the multiple data streams, performing data overlap processing on the multiple arrays obtained by cutting, and obtaining multiple preprocessing coefficients and multiple first arrays; Adjusting multiple parameters of the first data fusion model pair using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model; Inputting the plurality of first arrays into the second coding model to obtain a plurality of second arrays, and transmitting a plurality of target model parameters, the plurality of preprocessing coefficients, and the plurality of second arrays, wherein the target model parameters are parameters of the second decoding model; The step of trimming the plurality of data streams and performing data overlap processing on the plurality of arrays obtained by trimming to obtain a plurality of preprocessing coefficients and a plurality of first arrays includes: Get the mapping interval; Cut the multiple data streams according to the first data length to obtain multiple intermediate arrays; Counting the number of values ​​appearing in the plurality of intermediate arrays respectively to obtain a plurality of first statistical numbers, wherein each first statistical number corresponds to an intermediate array, and the first statistical number represents the number of values ​​appearing in the intermediate array; If the maximum value among the multiple first statistical numbers is greater than the mapping interval, reducing the first data length, and jumping to the step of trimming the multiple data streams according to the first data length to obtain multiple intermediate arrays; otherwise, adjusting the plurality of intermediate arrays according to the mapping interval and the lower limit of the mapping interval to obtain the plurality of preprocessing coefficients and the plurality of first arrays; The first data fusion model pair includes a first encoding model and a first decoding model, and the adjusting multiple parameters of the first data fusion model pair using the multiple first arrays to obtain the second data fusion model pair includes: Obtaining a mapping interval, a first encoding model, and a first decoding model; Arrange the data appearing in the plurality of first arrays according to their frequencies of appearance in the plurality of first arrays to obtain a sample queue; Constructing a second data queue arranged in order of size and filling the mapping interval, wherein the data in the second data queue are integers; constructing the second data queue as a label queue of the sample queue, wherein the label value of the sample queue data is negatively correlated with the occurrence frequency of the sample queue data in the plurality of first arrays; Multiple parameters of the first encoding model and multiple parameters of the first decoding model are adjusted according to the sample queue and the label queue, and the adjusted first encoding model and the adjusted first decoding model are used as a first data fusion model pair.

2. The data fusion transmission method according to claim 1, characterized in that: The adjusting the plurality of intermediate arrays according to the mapping interval and the lower limit of the mapping interval to obtain the preprocessing coefficients and the plurality of first arrays includes: For each intermediate array, extracting the maximum data and the minimum data as two preprocessing coefficients of the intermediate array, thereby obtaining a plurality of preprocessing coefficients; The multiple intermediate arrays are adjusted according to the mapping interval and the lower limit of the mapping interval to obtain the multiple first arrays.

3. The data fusion transmission method according to claim 1, characterized in that: The adjusting the multiple parameters of the first encoding model and the multiple parameters of the first decoding model according to the sample queue and the label queue, and using the adjusted first encoding model and the adjusted first decoding model as a first data fusion model pair, includes: Randomly inputting a plurality of data of the sample queue into the first coding model; If the deviation between the output of the first coding model and the target label is greater than a first threshold, adjusting multiple parameters of the first coding model according to the deviation between the output of the first coding model and the target label, and jumping to the step of randomly inputting multiple data in the sample queue into the first coding model, wherein the target label is the label corresponding to the data input to the first coding model; Randomly inputting multiple labels of the label queue into the first decoding model; If the deviation between the output of the first decoding model and the target data is greater than a second threshold, adjusting multiple parameters of the first decoding model according to the deviation between the output of the first decoding model and the target data, and jumping to the step of randomly inputting multiple labels of the label queue into the first decoding model, wherein the target data is data of the sample queue identified by the label input to the first decoding model; The adjusted first encoding model and the adjusted first decoding model are used as the second encoding model and the second decoding model respectively.

4. The data fusion transmission method according to claim 3, characterized in that: The first coding model is: Where, is the output of the first coding model, For the Rank Output of the intermediate function, is the node meta-function, is the first bias parameter, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, For the The output of the input node, For the The weight parameters of the input nodes, For the Input data, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters; The first decoding model is: Where, is the output of the second model, For the Rank Output of the intermediate function, is the second bias constant, The output function weights, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters, is the output of the input node, is the weight parameter of the input node, For the Rank Output of the intermediate function, For the Rank The middle function of the column weight parameters.

5. The data fusion transmission method according to claim 4, characterized in that: The node meta-function is: Where, is the input quantity, is a natural constant.

6. A data fusion transmission device, characterized in that: For implementing the data fusion transmission method according to any one of claims 1 to 5, the data fusion transmission device comprises: A data stream acquisition module, used to acquire multiple data streams; A data adjustment module, configured to trim the plurality of data streams, perform data overlap processing on the plurality of arrays obtained by trimming, and obtain preprocessing coefficients and a plurality of first arrays; a fusion model construction module, configured to adjust multiple parameters of the first data fusion model pair using the multiple first arrays to obtain a second data fusion model pair, wherein the second data fusion model pair includes a second encoding model and a second decoding model; as well as, A data transmission module is used to input the multiple first arrays into the second coding model to obtain multiple second arrays, and to transmit multiple target model parameters, the multiple preprocessing coefficients and the multiple second arrays, wherein the target model parameters are the parameters of the second decoding model.

7. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images