140 results about "Data reorganization" patented technology

The invention provides an electronic information data association method and system based on the Internet of Things. The method comprises the steps that a parallel processing architecture is adopted to execute rapid protocol conversion on a high-priority data packet, data recombination is directly carried out through a pre-compiled conversion rule template, a complex format verification link is skipped, and the integrity and format correctness of the converted data packet are determined; response time and error rate statistical information in the data transmission process are obtained, protocol conversion rules and scheduling strategies are optimized through a feedback mechanism, and if the success rate of certain protocol conversion is lower than a standard value, corresponding mapping rules and verification algorithms are updated; and carrying out standardized packaging on all converted data by adopting a unified data exchange standard, adding an equipment identifier, a timestamp and a data type label, establishing a cross-protocol general data format, and carrying out final distribution after judging whether a data packet meets a standard format requirement.

The invention relates to the technical field of data processing, and discloses an ecological degradation restoration evaluation system and method based on multi-source data fusion, and the system comprises a heterogeneous data recombination module, a space-time reference adaptation module, an anti-noise dimension fusion module, a degradation feature coupling module, a restoration scheme mapping module and a restoration feedback evaluation module. Performing dynamic heterogeneous recombination on the target area remote sensing image, ground monitoring and historical ecological parameters to form an original data matrix; obtaining a space-time reference adaptive matrix through adaptive space-time reference conversion; a multi-source anti-noise data cube is formed through anti-interference dimension fusion; performing degradation characteristic multi-source coupling on the cube to generate a degradation characteristic topological set; performing spatial feature association mapping on the topology set and a repair case library to output a repair scheme optimization sequence; based on the historical restoration feedback flow, the sequence is dynamically fed back and recombined to generate an ecological restoration evaluation report; according to the invention, the accuracy of reference information generation can be improved.

The invention relates to the field of semiconductors, in particular to an answer generation method and device based on a semiconductor knowledge base and a medium. The method comprises the steps of performing data association on structured knowledge according to a semiconductor domain knowledge structure to construct a class of knowledge bases; performing data recombination on the unstructured knowledge according to the layout so as to construct a second-class knowledge base; a query question is received, retrieval is executed in the first-class knowledge base and the second-class knowledge base based on a preset retrieval model, and a plurality of related knowledge fragments are obtained; determining a first fusion weight between the knowledge fragments of the same knowledge type based on the relevancy between each knowledge fragment and the query question and the update time of each knowledge fragment; determining an optimal knowledge type according to the group feature information, and determining a second fusion weight between different knowledge types according to the optimal knowledge type; and based on the first fusion weight and the second fusion weight, obtaining a reference answer according to the plurality of knowledge fragments. And the requirements of the semiconductor field on information comprehensiveness and answer accuracy are considered.

The embodiment of the invention provides an order book data construction method and system based on an FPGA, and the order book data construction method based on the FPGA is applied to a programmable logic component, and comprises the steps: obtaining transaction quotation data, and decoding the transaction quotation data; performing data recombination on the decoded transaction market data according to a preset format to obtain market information; and synchronously sending the market information to a target memory and a target cache, and constructing order book data in the target cache based on the market information.

The invention discloses a method and equipment for compressing multi-dimensional data based on column storage and self-adaption, and the method comprises the steps: recombining original multi-dimensional data into a column data set structure, and organizing data block storage for the column data set structure according to a hierarchical structure; each data block stores observation grid data of a single variable of multi-dimensional data at a certain moment so as to support column type storage and self-adaptive compression; and carrying out real-time statistical analysis on characteristics or parameters of variables in the data blocks, and dynamically selecting and configuring a filter and parameters thereof to compress the multi-dimensional data. The data of the same variable are stored together through column storage, so that the data access efficiency is greatly improved, especially during variable-level analysis. Meanwhile, the self-adaptive compression technology can dynamically select a compression mode according to the distribution characteristics of the data, so that the compression rate of the data is effectively improved, and the occupied storage space is reduced. The processing speed of the meteorological grid point data can be obviously improved, and the storage cost is reduced.

The invention relates to the technical field of data processing, and provides a cloud data archiving method and system, and the method comprises the steps: obtaining a source data set of to-be-archived data, carrying out the grade division, obtaining a data grade label, dividing the source data set into a plurality of data blocks, carrying out the data encryption of different grades, obtaining a plurality of encrypted data blocks, and storing the encrypted data blocks in a database; analyzing and coding to obtain a multi-dimensional data storage structure, uploading the multi-dimensional data storage structure to a preset cloud storage node, and generating a storage index information set based on multiple data blocks in the uploading process; and when a data recovery request is received, acquiring the data block from the cloud storage node according to the storage index information set, and performing decryption and data recombination. Through the scheme, classification, hierarchical encryption and structured archiving of the source data set are realized, the security and management efficiency of the data in a cloud storage process are improved, and the problem that the encryption level cannot be dynamically adjusted by data sensitivity or content features when a large-scale heterogeneous data source is used is solved.

The invention discloses a data processing method and device, electronic equipment and a computer storage medium, and relates to the technical field of data acquisition, the method comprises the following steps: acquiring an acquisition data packet sent by each data acquisition module, and analyzing according to the acquisition data packet to obtain successfully analyzed data, the successfully analyzed data at least comprising an acquisition node identifier; determining a memory address identifier of the successfully analyzed data according to the acquisition node identifier and a preset Hash mapping table, and after the successfully analyzed data is stored in a memory buffer area mapped by the memory address identifier, performing data quality verification according to the successfully analyzed data to obtain a quality verification result; after the data quality verification is completed, data reorganization is carried out according to the successfully analyzed data to obtain reorganized data, data restoration is carried out on the reorganized data according to the quality verification result to obtain final output data, and the method and device aim at improving the processing capacity of large-scale data collection so as to ensure the accuracy and timeliness of data collection.

The invention relates to the field of cloud computing big data secure storage, in particular to a cloud computing-based big data secure storage method and system. The method comprises the following steps: performing encryption and fragmentation processing on an original data stream to generate a fragmentation sequence with an index; generating a dynamic key sequence and a verification key group based on the fragment information; constructing a secure transmission channel through a quantum key distribution mechanism in combination with a geographic position weight and a load balancing strategy, and realizing encapsulation and transmission of a secure fragment packet; node state monitoring and redundancy management are implemented, and an update mapping table is generated; and finally, a complete data stream is recovered through fragment positioning retrieval, data recombination and dynamic decryption. According to the invention, the security and reliability of data storage and the overall load balancing capability of the system are improved.

The invention provides a memory access system oriented to vector and matrix calculation, the system comprises a vector memory access unit, a matrix memory access unit, a vector register group and a matrix register group, the vector memory access unit is connected with a memory interface and the vector register group, reads elements of a one-dimensional data structure or a two-dimensional data structure from a memory, and stores the elements of the one-dimensional data structure or the two-dimensional data structure; vector data are generated through data reorganization operation, a matrix access unit is connected with a memory interface and a matrix register set, matrix block data of a two-dimensional data structure are read from a memory together with the matrix access unit, matrix data are generated after data reorganization, and the matrix data are broadcasted to one or more computing units according to rows or columns. And performing calculation on the matrix data and the vector data. In the memory access system, the vector memory access unit and the matrix memory access unit can load data in parallel, and the utilization rate is improved through a plurality of computing units, so that the problems of low memory access efficiency and low memory bandwidth utilization rate are solved.

The invention relates to the technical field of automatic scheduling, in particular to a method for realizing automatic gas scheduling based on a gas prediction model. The method comprises the following steps: acquiring furnace area sensing data, and performing data reorganization processing to obtain furnace area structured data; analyzing the temperature change amplitude and the pressure distribution condition of each furnace area according to the structured data of the furnace areas; identifying the furnace temperature jump point of each furnace area by using the temperature change amplitude of each furnace area; the working moment proportion of the furnace temperature jump point of each furnace area is counted, and a high-proportion furnace body is identified; according to the temperature change amplitude and the pressure distribution condition of the high-proportion furnace body, a furnace body gas flow velocity vector field is recovered, an instantaneous pressure loss sudden change path is calibrated, and a gas main network physical anomaly path is obtained; calculating a gas scheduling capability state according to the pressure distribution condition of the furnace area to obtain an actual scheduling structure of the gas main network; and screening a feasible gas distribution scheme for the physical abnormal path of the gas main network. According to the invention, the operation efficiency and adaptability of the gas main network can be improved.

The invention discloses a transformer substation work ticket knowledge graph construction method based on a large language model, and belongs to the field of energy power and artificial intelligence. The method comprises the following steps: based on standardized electrical drawing annotation data, generating an independent knowledge graph through data recombination preprocessing, rough knowledge graph construction and attribute supplementary reasoning; all the independent knowledge maps are divided into a framework layer map and a detail layer map according to voltage grades, and full map fusion is completed by adopting a hierarchical fusion strategy; carrying out breakpoint detection by using an isolated point detection algorithm based on degree centrality, carrying out connectivity analysis through depth-first search, and re-fusing multiple non-connected sub-graphs; and screening abnormal nodes based on an electrical connection rule, inputting the abnormal nodes into a large language model to automatically supplement Agents to generate correction suggestions, and completing map optimization. Through cooperation of the large model Agent and multiple algorithms, the electrical data structuring efficiency and accuracy are improved, and knowledge network support is provided for automatic operation and fault diagnosis of the transformer substation.

The invention discloses a multi-channel data transmission control method and system. The method comprises the following steps: acquiring current to-be-transmitted data and an idle channel set; judging the relationship between the number of channels and the data volume, and when the channels are sufficient and the data volume is large, splitting the data into reference data and corresponding split data by adopting an intelligent data division strategy; establishing a matching relationship between the data set and the channel; inputting the reference data and the split data into corresponding channels for transmission in a cross arrangement mode; and performing data fusion based on the same data field at a receiving end. Through dynamic channel matching, intelligent data splitting and optimization recombination mechanisms, the channel utilization rate and the transmission efficiency are effectively improved, the data recombination complexity is reduced, the method is particularly suitable for high-concurrency and low-delay data transmission scenes, and compared with a traditional method, the transmission performance can be remarkably improved.

The invention relates to a big data intelligent analysis processing system and method based on a distributed architecture, and the system comprises a data collection module, a hybrid processing module, an intelligent data distribution module, a data recombination module and a data analysis module which are connected in sequence. The method comprises the steps that real-time big data and batch big data are obtained from a multi-source heterogeneous data source through an increment extraction channel and a batch extraction channel respectively, the real-time big data are submitted into a message queue in two stages through the CDC technology, and the batch big data are stored in a distributed library in an increment mode according to timestamps / self-increment IDs; during hybrid processing, the intelligent resource scheduler makes a decision by means of a resource allocation function and cluster state evaluation, and the task dispatcher decomposes tasks and dynamically distributes the tasks in a weighted manner; high-frequency data and low-frequency data are divided according to rules and information entropies through intelligent shunting; according to the method, the time mapping weight fusion is established through data recombination, and finally the recombination data is analyzed, so that efficient resource scheduling, accurate data distribution and deep analysis can be realized, the real-time performance and the reliability are considered, and the data processing efficiency and the analysis precision are improved.

The invention relates to a space-time big data dynamic index construction method and device and a storage medium. The method comprises the following steps: inputting a spatio-temporal data stream into a distributed system to carry out fragmentation processing and index tree structure construction to obtain an initial index structure, and carrying out parallel feature extraction on the spatio-temporal data stream to obtain a spatio-temporal distribution feature vector; calculating a space-time overlapping degree, a data density similarity and a query frequency correlation degree of adjacent nodes based on the space-time distribution feature vectors to obtain a combined evaluation score of the node pair; performing multi-objective optimization based on the merging evaluation score to generate an optimal merging threshold value; and according to the optimal merging threshold, performing incremental merging operation on the node pairs, and performing data recombination and range boundary updating to obtain an optimized index tree structure. According to the method, smooth adjustment of the index structure is realized, the influence of structure adjustment on online query service is minimized, and the index structure can be continuously optimized and kept in an efficient state.

The invention discloses an operation and maintenance method and device of a service system, a storage medium and electronic equipment, the method is applied to the field of artificial intelligence, and the method comprises the following steps: collecting original time sequence data of the service system, and carrying out data noise reduction processing on the original time sequence data to obtain noise-reduced time sequence data; performing data preprocessing and data recombination operation on the time sequence data after noise reduction to obtain target time sequence data; combining the target time sequence data and the user intention of the target user to obtain reference information of the user intention; and inputting the reference information of the user intention into the large language model, generating an operation and maintenance result of the service system, and playing the operation and maintenance result to a target user, so that the target user performs operation and maintenance operation on the service system based on the operation and maintenance result. Through the operation and maintenance method and device, the problem that operation and maintenance personnel of the service system need to perform operation and maintenance operation on the service system based on the operation and maintenance report after complex analysis in the related technology, so that the real-time performance of the operation and maintenance operation of the service system is poor is solved.

The present invention discloses a method, device, electronic device, and computer-readable storage medium for processing inertial navigation communication data. The method comprises: receiving packet data, intercepting the minimum and maximum packet sequence numbers, and all packet sequence numbers and corresponding status bytes between the minimum and maximum packet sequence numbers, and filtering out incoherent packet sequence numbers; sequentially treating the numbers 0-N as a data block, with each L number representing N being the number of valid bytes in the packet sequence number and L being the length of the complete parsed byte; and for each data item in the incoherent packet sequence number array, determining which data block the data item is located in, determining and deleting the packet sequence number subarray and status byte subarray corresponding to the data block, replacing the deleted packet sequence number subarray with the data block, and replacing the deleted status byte subarray with L zeros in the status byte array. The present invention can achieve dynamic compensation for packet loss and data reassembly, improving system performance and reliability in complex communication scenarios.

The application discloses a file unshelling method and electronic equipment, and relates to the technical field of computer security, and comprises the following steps: inserting a probe at a target system call of a kernel, and injecting the probe into a target program; identifying a suspiciously shelled process through the target program; monitoring a memory permission change behavior performed by the suspiciously shelled process through the target program, and counting a permission change frequency of a memory region, an entropy value of the memory region and a call chain depth; when it is confirmed that the suspiciously shelled process is in an unshelling stage according to the permission change frequency, the entropy value and the call chain depth, writing data decrypted by the suspiciously shelled process into a target buffer through the target program; reading the data from the target buffer in a user mode, and recombining the data into a memory image according to a base address and a dirty page bitmap and writing the memory image back to a file. The method can avoid I / O bottlenecks caused by full memory dumping, reduce invalid data in the user mode, and reduce CPU occupation and memory bandwidth.

The invention discloses a communication method and device, a storage medium, communication equipment and a chip, and relates to the technical field of communication processing, and the method comprises the steps: firstly, obtaining a plurality of protocol data units (PDU) submitted to a radio link control (RLC) layer; determining a first PDU to be processed at present in the RLC layer from the plurality of PDUs; and if the first PDU is fragmented data, storing the first PDU in a preset queue to wait for RLC layer data recombination, and determining to start performing RLC layer processing on a next to-be-processed second PDU corresponding to the first PDU. According to the data processing method and device, the fragmented data and the complete data can be processed in parallel in the data processing process of the RLC layer, the data processing time delay of the RLC layer is reduced, and the data processing efficiency of the RLC layer is improved.

The present application provides a kind of data distribution device, data distribution system and data distribution program.Data distribution device (2) has: update data acquisition unit (9a), obtains the multiple update data corresponding to multiple write object electronic control device;Reorganization information acquisition unit (9b), obtains the reorganization information for by main device parallel execution to multiple write object electronic control device transfer update data transfer processing;Data packet generation unit (9c), multiple update data are segmented based on reorganization information to generate segmented data, and the segmented data of multiple update data generated are packed to generate multiple data packets;And distribution control unit (9e), multiple data packets are distributed to main device.

The invention relates to the technical field of film and television media. The 8K video real-time editing cooperation method and system for the 10-gigabit hybrid network are provided, and the method comprises the steps: carrying out the incremental analysis processing of an editing behavior based on operation event monitoring, and generating an incremental data unit; performing versioning management processing on the incremental data units through distributed storage nodes, and constructing a storage system with a version chain; according to the recovery instruction, target data recombination processing is carried out based on the storage system with the version chain, and the engineering environment is reconstructed; and performing merging processing based on the conflict characteristics in the engineering environment to generate a repaired engineering version, thereby achieving the technical effects of reducing the network transmission load, improving the conflict resolution efficiency and enhancing the version management reliability.

The application discloses a kind of mask protection circuit, device, chip and electronic equipment, it is related to information security technical field, in the circuit: timing control module is used to generate timing control signal based on the input system clock signal, and timing control signal is transmitted to routing encoding module;Data buffer module is used to receive the first bit width external input data, and after converting external input data into the second bit width intermediate input data, intermediate input data is transmitted to routing encoding module;Routing encoding module is used to recombine intermediate input data, generate the third bit width target input data, and according to timing control signal, target input data is distributed to compression accumulation tree module;Compression accumulation tree module includes multiple compression accumulation tree units, each compression accumulation tree unit is used to operate target input data based on double-track logic, and outputs the fourth bit width share pair operation result.This application can effectively reduce circuit area and reduce calculation delay.

The present invention relates to an intelligent monitoring method for anaerobic wastewater treatment based on an automatic optimization algorithm and deep learning, including: S100, selecting historical detection data of the anaerobic treatment unit of a sewage treatment plant, where the historical detection data includes input variables and output variables, and reorganizing the historical detection data into a data set; S200, using the tree-structured Parzen estimation method to automatically optimize the hyperparameters of the bidirectional gated recurrent unit model, and then using the optimal hyperparameters to input into the bidirectional gated recurrent unit model for training to obtain an optimal model; S300, inputting the test data set into the trained bidirectional gated recurrent unit model to obtain a point prediction result of the output variable; S400, inputting the point prediction result of the output variable into the trained Gaussian process regression GPR model. The device therein includes a memory and a processor, and the processor implements the method when executing instructions stored in the memory.

The invention provides an intrusion detection device and method, electronic equipment and a storage medium, and belongs to the technical field of network security, and the method comprises the steps that a data collection module obtains a data frame of a network interface through multiple buffer areas, and sends the data frame to a protocol analysis module; the multiple buffer areas are a plurality of data buffer areas working alternately; the protocol analysis module carries out data recombination processing on the data frame, generates a to-be-detected data packet, and sends the to-be-detected data packet to the anomaly detection module; the anomaly detection module performs anomaly feature matching on the to-be-detected data packet based on the executable detection object to generate an intrusion detection result; the executable detection object is obtained by analyzing the rule description file based on the rule loading module; according to the method and the device, data acquisition is performed by adopting a plurality of alternately working data buffer areas, parallelization and buffering of data read-write operation are realized, and a data recombination and rule pre-analysis technology is combined, so that the problem of packet loss when the network flow is relatively large can be effectively solved, and the security of the system is improved.

The invention relates to the technical field of communication network data security, and provides a communication network data leakage prevention method, which comprises the following steps of: generating a random key by using a quantum mechanics principle, and processing the random key in a data transmission process; the method comprises the following steps: dividing transmission data into N data segments, and encrypting each data segment through a zero-knowledge proof algorithm; the data segments are written into the distributed account book, recombination is carried out according to the sequence of writing the data segments into the distributed account book, and communication network data transmission is completed. The communication network data transmission security is improved, data leakage is effectively prevented, transparency and traceability of data transmission are achieved, the risk that a secret key is cracked is reduced, and the security of communication network data transmission is improved. The accuracy of data recombination is guaranteed, the data security, the transmission efficiency and the system flexibility of a communication network are improved, and the method is suitable for a complex and changeable network environment.

The invention discloses a radiotherapy information management system based on multiple data sources and a construction method thereof, and relates to the technical field of medical information, and the system comprises a multi-source data obtaining module which is used for obtaining discrete data of each heterogeneous system; the multi-source data intelligent aggregation engine is used for recombining discrete data into format data and developing a dynamic form generator; the decision support rule base is internally provided with verification rules and is used for carrying out real-time verification and abnormal intervention on the format data; and the three-screen linkage workbench is used for integrating visual linkage browsing of patient information, image data and dose planning. According to the invention, full-link automatic integration and multi-system collaborative optimization of patient data are realized, so that the accuracy, efficiency and expandability of a radiotherapy process are improved.

The application discloses a substation work ticket knowledge graph construction method based on a large language model, and belongs to the field of energy power and artificial intelligence. The method comprises the following steps: based on standardized electrical drawing annotation data, independent knowledge graphs are generated through data reorganization preprocessing, rough knowledge graph construction and attribute supplement reasoning; all independent knowledge graphs are divided into framework layer graphs and detail layer graphs according to voltage levels, and hierarchical fusion strategies are adopted to complete full graph fusion; breakpoint detection is carried out by using an isolated point detection algorithm based on degree centrality, connectivity analysis is carried out through depth-first search, and non-connected subgraphs are re-fused; abnormal nodes are screened based on electrical connection rules, a large language model is input to automatically fill in Agent to generate correction suggestions, and graph optimization is completed. Through the cooperation of the large model Agent and multiple algorithms, the application improves the efficiency and accuracy of electrical data structuring, and provides knowledge network support for substation automation operation and fault diagnosis.

This invention relates to the field of communications, and in particular to a method, apparatus, and system for encrypted transmission of game data. The method achieves semantic changes in data packets by swapping characters across data packets in a data packet group. Thus, even if the sub-data is intercepted by a thief, the data packet reassembled by the thief according to the number is a scrambled data packet with changed semantics, which misleads the thief and prevents them from knowing the true data content, thereby ensuring data security.

The present application relates to a file acquisition method, apparatus, computer device, and storage medium. The method includes: receiving a file call request, obtaining the file code and project identifier of the file to be extracted carried by the file call request, obtaining the category to which the file code belongs, and obtaining the file scheduling time mapped to the category to which the file code belongs; obtaining a target template set based on the file call request, selecting a template identifier from the template set according to the file call request, combining the template fields corresponding to the selected template identifier to form a target template; filling the target template with the file scheduling time, project identifier, and file code to obtain file management information; at the file scheduling time, following the corresponding relationship, obtaining the corresponding file to be extracted according to the project. By adopting this method, the file code data required by each project is reorganized, the scattered files can be obtained more efficiently, the number of times of obtaining duplicate files is reduced, and efficient and refined management is achieved.

The invention relates to the technical field of fault monitoring, and discloses a fault recording system and method.In the system, a ZYNQ main controller comprises a PL end and a PS end, the PL end and the PS end are connected with an SDRAM, and recording data interaction is conducted between the PL end and the PS end through the SDRAM; the PL end is connected with the data acquisition module and is used for receiving recording data in real time, refreshing and writing an SDRAM (Synchronous Dynamic Random Access Memory) and detecting recording trigger conditions; the PS end is used for recording data processing including data recombination, format conversion, compression storage, regular clearing and recording file transmission analysis; the SD card is used for storing the compressed recording file; the GPS time synchronization module is used for time service; and the ZYNQ main controller is in wired or wireless communication connection with the user terminal. The system is low in cost and small in size, can convert collected recording data, improves data readability, facilitates data analysis, has the functions of compression storage and regular clearing, and improves the space utilization rate of a storage medium.

The present invention discloses a method, device, and system for file access in a distributed NAS storage system, specifically relating to the field of file access. By real-time monitoring of storage node topology changes, event codes are generated to drive key lifecycle management and distributed key operations, thereby dynamically adjusting data redundancy and distributing storage shards according to the topological state. At the same time, when a node is permanently offline, the reconstruction and destruction of related keys are triggered. A method, device, and system for file access in a distributed NAS storage system eliminate encryption blind spots caused by inconsistent timing by dynamically adapting key lifecycles to topology change events; by constructing an encryption parameter matrix of storage node physical topology and cryptographic parameters, the binding of keys to storage node coordinates is achieved, strengthening the correlation between dynamic keys and topological structures; and by adding a triple verification mechanism for multiple nodes, the risk of a man-in-the-middle attack by intercepting metadata shards and carrying out data reorganization attacks is prevented.