Patents
Literature
12results about How to "Optimize storage structure" patented technology
Efficacy Topic
Property
Owner
Technical Advancement
Application Domain
Technology Topic
Technology Field Word
Patent Country/Region
Patent Type
Patent Status
Application Year
Inventor
Data acquisition method and device of industrial Internet of Things, and storage medium
ActiveCN119622221Aaccurate collectionIntegrity guaranteedInput/output to record carriersResource allocationIndustrial equipmentData acquisition
The invention relates to the field of technical data acquisition, and particularly discloses a data acquisition method and device for an industrial Internet of Things and a storage medium, and the method comprises the following steps: S1, constructing a dynamic sensor network, and collecting the operation data of industrial equipment in real time through a multi-modal sensor; s2, dynamically adjusting a data acquisition frequency # imgabs2 # based on an environment noise coefficient # imgabs0 # and an equipment health index # imgabs1 #; s3, performing hierarchical compression and encryption on the acquired data, and allocating a compression rate # imgabs4 # and encryption strength # imgabs5 # according to data type importance # imgabs3 #; s4, executing load balancing through an edge computing node, and distributing a computing task to an optimal node; and S5, storing the processed data into a distributed database according to spatial-temporal correlation, and generating a multi-copy disaster recovery index. Through dynamic acquisition, intelligent processing, optimized storage and adaptive strategy adjustment, accurate and efficient data acquisition is realized, data security and processing performance are flexibly guaranteed, storage query efficiency and disaster tolerance capability are improved, and storage resources are utilized to the maximum extent.
Owner:CHENYANG CHENGSHUO ELECTRONIC TECHNOLOGY CO LTD
Power plant data management method and system based on SIS system
PendingCN119537358AImprove management efficiencyimprove accuracyData processing applicationsDatabase management systemsData integrityAnalysis data
The invention discloses a power plant data management method and system based on an SIS system, and relates to the technical field of data management, and the method comprises the steps: obtaining power plant operation data, and carrying out the unified formatting processing of the power plant operation data; preprocessing the formatted data, and removing noise and invalid data; performing quality verification on the preprocessed data, and checking data integrity and consistency; classifying, marking and storing the data subjected to quality verification into a database; and extracting and analyzing data from the database according to operation requirements of the power plant, and generating a decision report. According to the power plant data management method based on the SIS system, through unified formatting and time alignment processing, data format difference and time disorder between different devices are eliminated, and consistency and accuracy of data are ensured. And noise elimination, interpolation processing and anomaly detection are adopted, so that the data quality is guaranteed, and the reliability of an analysis result is improved. And aiming at data with different access frequencies.
Owner:HUANENG JINGTAI THERMAL POWER CO LTD
Archive management method and system based on big data analysis
PendingCN119669326Aeasy to integrateimprove relevanceDatabase management systemsBiological modelsText categorizationData access
The embodiment of the invention provides an archive management method and system based on big data analysis, and belongs to the technical field of data processing. The method comprises the steps of obtaining initial text data and initial image data corresponding to an initial user; performing deduplication processing on the initial text data to obtain target text data, and performing deduplication processing on the initial image data to obtain target image data; performing association relationship analysis on the target text data and the target image data to obtain a target relationship corresponding to the target text data and the target image data; performing text classification on the target text data to obtain a target type corresponding to the target text data; and performing data storage on the target text data and the target image data according to the target type and the target relationship to obtain a target storage result. The problems that in the prior art, the occupied storage space is increased and the data access and retrieval efficiency is reduced due to the fact that texts and images are often used as independent information units to be processed and an effective integration mechanism is lacked are solved.
Owner:HUAIAN YIDOU TECHNOLOGY CO LTD
Real-time storage optimization method based on block data
PendingCN121958403ASolve floodingOptimize storage structureResource allocationDatabase management systemsMemory footprintParallel computing
The invention discloses a real-time storage optimization method based on block data, which relates to the technical field of big data processing and distributed storage, introduces a block data concept, realizes block-by-block writing, in-block ordering, block-level ordering and an intelligent flush trigger mechanism, and realizes real-time writing with high throughput, low delay and low memory occupation. The method specifically comprises the steps that block data is introduced into a data memory model to serve as a basic processing unit, multiple rows of data are aggregated into a block according to an aggregation key CKValue, row data in the block are sequenced according to a primary key PK, and write-in, namely aggregation is achieved; writing data, aggregating according to blocks, and uniformly sorting in the blocks; one block, namely multiple rows of data, generates an FRC file, and small files are reduced; exception processing: supporting block-level recovery to skip a failed block; the core problems of too high memory occupation, large CPU consumption, high writing delay and the like in a high-concurrency and high-throughput real-time writing scene can be solved, and the method is widely applied to scenes with extremely high requirements on data real-time performance and system stability.
Owner:XIAN FIBERHOME SOFTWARE TECH CO LTD
Vector matrix multiplication acceleration method, unit, acceleration unit and system on chip
ActiveCN114398593BOptimize storage structureeasy to handleDigital data processing detailsComplex mathematical operationsComputer hardwareComputational science
Embodiments of the present application provide a vector matrix multiplication acceleration method, unit, acceleration unit and system on chip, the method is applied to a fifth generation reduced instruction set processor, the method comprises the following steps: obtaining the number N of elements of a first matrix stored in a vector register according to the data length of the elements of the first matrix and the length of the vector register, N is a positive integer; performing rearrangement processing on the first matrix according to the number N to obtain a third matrix which can process N data in parallel; and performing multiplication calculation on the vector and the third matrix by using a single instruction multiple data stream instruction. The present scheme can improve the operation speed of vector matrix multiplication.
Owner:C SKY MICROSYST CO LTD
Wardrobe convenient to move
ActiveCN224112320USolve the inconvenience of movingReduce risk of damageWardrobesFeetStructural engineeringMechanical engineering
Owner:罗宝
A data management method and system for multimodal database
ActiveCN119149783BOptimize storage structureImprove generalization abilityBiological modelsOther databases indexingAnalytic modelEngineering
The present invention discloses a data management method and system for a multimodal database, and relates to the technical field of data management. A data management system for a multimodal database includes: a multimodal data analysis module, a multimodal data storage module, and a multimodal data update module. The present invention improves the accuracy and depth of data recognition by extracting deep-level features using a multimodal data feature analysis model; optimizes the data storage structure and improves query efficiency by performing database storage allocation using feature matching technology; introduces a feature adaptive threshold factor Z and a CNN model improvement based on a knowledge graph to enhance the generalization ability and adaptability of the model; and realizes dynamic updates of database partitions through a multimodal database management update model, responds to changes in user operations, maintains the timeliness and relevance of the database, and enhances user experience.
Owner:HANGZHOU HUABAI COMPUTER CO LTD
A method for storing big data databases in an energy management system
ActiveCN115658691Bcapacity controltimely depositError detection/correctionEnergy efficient computingData classEnergy management system
This invention provides a method for storing big data databases in an energy management system. The database storage process is as follows: S1, create a heap table according to the data type; S2, store the data obtained from the terminal into the heap table of the corresponding data type; S3, determine if it is time for the execution of the scheduled task on the next natural day, and if so, proceed to step S4; S4, convert the heap table generated on the previous natural day into an index-organized table and store it in the database; S5, complete the storage conversion process; S6, perform a backup operation. The beneficial effects of this invention are: a method for storing big data databases in an energy management system can effectively control the storage capacity of a single database table within an ideal range.
Owner:TIANJIN KEYVIA ELECTRIC CO LTD
Method and system for dynamically determining copy position of HDFS (Hadoop Distributed File System) based on node historical state
PendingCN119513061Aload balancingimprove accuracyDigital data information retrievalEnergy efficient computingDistributed File SystemDistributed computing
The invention provides a method and system for dynamically determining a copy position of an HDFS (Hadoop Distributed File System) based on a node historical state, and the method comprises the steps: constructing a node load evaluation index, recording the current load of a node at regular time, carrying out the training through an LSTM neural network, and constructing a node load prediction model for predicting the future load of a cluster node, determining a copy creation position of the file in the cluster according to the predicted value; when a file copy is written, the load of each node at the next moment is predicted, and nodes with relatively low loads in the future are written preferentially. According to the method, the write-in positions of the file copies in the HDFS cluster are dynamically set, so that load balancing in a heterogeneous environment can be realized. Compared with an existing fixed copy strategy, the method is more flexible, and the availability of the system is enhanced. Compared with an existing replica placement strategy based on the current node state, burst state interference is eliminated, the balance is higher, meanwhile, the prediction accuracy is higher through the neural network, and the overall performance of the system can be better improved.
Owner:CHINA TELECOM CLOUD TECH CO LTD
Event content verification method, apparatus and storage medium based on large model
This invention discloses a method, apparatus, and storage medium for event content verification based on a large model, belonging to the field of data processing technology. The method includes: identifying events in target text using a large model, rewriting the events in the target text according to target rewriting rules to obtain reference events; the target text is standard data that has been reviewed; storing the reference events in an event knowledge base; retrieving target reference events associated with the event to be verified from the event knowledge base based on the event to be verified; and comparing the event to be verified and the target reference events using the large model to obtain a comparison result characterizing whether the event to be verified is correct. This application utilizes the powerful semantic understanding capability of the large model to accurately identify events in standard data and rewrite the events to form structurally unified and semantically clear reference events, thereby constructing a high-quality event knowledge base and improving the accuracy of event content verification.
Owner:BEIJING TOPWALK INFORMATION TECH CO LTD +1
A data storage method and system based on large model
The present invention relates to the technical field of large-scale data management, specifically to a data storage method and system based on a large model, comprising the following steps: collecting multiple data in a large model data set, recording the number of occurrences of each data, calculating the entropy value of each data, determining the volatility and diversity of the data, and generating an entropy value calculation result. In the present invention, by sorting and classifying the data according to the entropy value, high entropy value data is located in a high-density storage area, while low entropy value data is stored in a low-density area, optimizing the utilization of storage space, reducing unnecessary storage costs, simulating stratigraphic superposition according to the hierarchical storage of data and sorting by time tags, not only optimizing the storage structure, but also facilitating the rapid positioning and access of new data, data compression and storage parameter adjustment simulate the compaction process of geological layers, effectively managing storage capacity, enhancing the energy efficiency of data centers, and enhancing the responsiveness to complex data environments.
Owner:BEIJING SHENZHOU BANGBANG TECH SERVICE CO LTD