Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

5results about How to "Optimize storage structure" patented technology

Real-time storage optimization method based on block data

The invention discloses a real-time storage optimization method based on block data, which relates to the technical field of big data processing and distributed storage, introduces a block data concept, realizes block-by-block writing, in-block ordering, block-level ordering and an intelligent flush trigger mechanism, and realizes real-time writing with high throughput, low delay and low memory occupation. The method specifically comprises the steps that block data is introduced into a data memory model to serve as a basic processing unit, multiple rows of data are aggregated into a block according to an aggregation key CKValue, row data in the block are sequenced according to a primary key PK, and write-in, namely aggregation is achieved; writing data, aggregating according to blocks, and uniformly sorting in the blocks; one block, namely multiple rows of data, generates an FRC file, and small files are reduced; exception processing: supporting block-level recovery to skip a failed block; the core problems of too high memory occupation, large CPU consumption, high writing delay and the like in a high-concurrency and high-throughput real-time writing scene can be solved, and the method is widely applied to scenes with extremely high requirements on data real-time performance and system stability.
Owner:XIAN FIBERHOME SOFTWARE TECH CO LTD

Vector matrix multiplication acceleration method, unit, acceleration unit and system on chip

Embodiments of the present application provide a vector matrix multiplication acceleration method, unit, acceleration unit and system on chip, the method is applied to a fifth generation reduced instruction set processor, the method comprises the following steps: obtaining the number N of elements of a first matrix stored in a vector register according to the data length of the elements of the first matrix and the length of the vector register, N is a positive integer; performing rearrangement processing on the first matrix according to the number N to obtain a third matrix which can process N data in parallel; and performing multiplication calculation on the vector and the third matrix by using a single instruction multiple data stream instruction. The present scheme can improve the operation speed of vector matrix multiplication.
Owner:C SKY MICROSYST CO LTD

A method for storing big data databases in an energy management system

This invention provides a method for storing big data databases in an energy management system. The database storage process is as follows: S1, create a heap table according to the data type; S2, store the data obtained from the terminal into the heap table of the corresponding data type; S3, determine if it is time for the execution of the scheduled task on the next natural day, and if so, proceed to step S4; S4, convert the heap table generated on the previous natural day into an index-organized table and store it in the database; S5, complete the storage conversion process; S6, perform a backup operation. The beneficial effects of this invention are: a method for storing big data databases in an energy management system can effectively control the storage capacity of a single database table within an ideal range.
Owner:TIANJIN KEYVIA ELECTRIC CO LTD

Event content verification method, apparatus and storage medium based on large model

ActiveCN120145075BReduce the problem of extraction biasimprove accuracy
This invention discloses a method, apparatus, and storage medium for event content verification based on a large model, belonging to the field of data processing technology. The method includes: identifying events in target text using a large model, rewriting the events in the target text according to target rewriting rules to obtain reference events; the target text is standard data that has been reviewed; storing the reference events in an event knowledge base; retrieving target reference events associated with the event to be verified from the event knowledge base based on the event to be verified; and comparing the event to be verified and the target reference events using the large model to obtain a comparison result characterizing whether the event to be verified is correct. This application utilizes the powerful semantic understanding capability of the large model to accurately identify events in standard data and rewrite the events to form structurally unified and semantically clear reference events, thereby constructing a high-quality event knowledge base and improving the accuracy of event content verification.
Owner:BEIJING TOPWALK INFORMATION TECH CO LTD +1