Unlock instant, AI-driven research and patent intelligence for your innovation.

Implementation method, system and electronic device for short-term data writing library

An implementation method and data writing technology, which is applied in the field of power system information, can solve problems such as blocking and slow writing, achieve the effects of improving performance, avoiding synchronous blocking problems, and improving data processing and data writing performance

Active Publication Date: 2022-07-01
JIANGSU FRONTIER ELECTRIC TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the development trend of multi-service and efficient billing, the past application programs have the problem of slow writing and blocking when processing large data. Based on this problem, this invention proposes a short-term data writing library based on the flow control working method The implementation method adopts an asynchronous and non-blocking working method, and the assembly between business models and models, tables and tables avoids the synchronous blocking scheme between write-back collections

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Implementation method, system and electronic device for short-term data writing library
  • Implementation method, system and electronic device for short-term data writing library
  • Implementation method, system and electronic device for short-term data writing library

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Embodiment 1: The present invention proposes a method for implementing short-term data writing library, comprising the following steps:

[0046] Step 1: The process of set assembly according to the business demand plan calculation model is as follows:

[0047] S11, a virtual slot is established based on a foreign key field value of a business unit corresponding to a KEY, and the FNV (FowlerNolVo) algorithm is used to hash the field value. The FNV-1 algorithm can hash a large amount of data while maintaining a small conflict rate. The calculation process is,

[0048] initialization: hash=2166136261;

[0049] Enter the loop and determine the number of loops according to the length of the input data bytes. The hash result is a 32-bit unsigned integer, so it is necessary to discard the high bits and keep the low 32 bits: hash=(2166136261*16777619) mod 2 32 = 0x050c5d1f;

[0050] To perform XOR operation, first convert 0x56 to 32-bit value 0x00000056, and then perform XOR...

Embodiment 2

[0079] Embodiment 2: The present invention also proposes an implementation system for short-term data writing library, including:

[0080] The set assembly module is used to execute: according to the business demand plan, the billing model is assembled and assembled, and the billing result set is generated;

[0081] A parsing module for executing: parsing the billing result set and putting it into a memory queue;

[0082] A queue pulling module for executing: spin-pulling queue data from the memory queue;

[0083] A token access module for executing: creating an access token to connect to the database according to the queue data;

[0084] The archiving module is used to perform: batch archiving of multi-data sources of calculation collection;

[0085] The task judgment module is used to execute: judgment task return token;

[0086] The exception collection module is used to execute: establish a collection container for abnormal tasks of volume fee.

Embodiment 3

[0087] Embodiment 3: The present invention also proposes an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that the processor implements the method when executing the program. step.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method, a system and an electronic device for implementing short-term data writing library. The method includes the following steps: Step SS1: assembling and assembling a billing model according to a business demand plan, and generating a billing result set; Step SS2: parsing the The billing result set is put into the memory queue; Step SS3: Spin and pull queue data from the memory queue; Step SS4: Create an access token to connect to the database according to the queue data; Step SS5: Set multiple data for billing The source batch is archived; Step SS6: Judging the task return token; Step SS7: Establishing a collection container for abnormal amount and charge tasks. The present invention adopts an asynchronous and non-blocking working mode based on the flow control write-back mechanism, which avoids the problem of synchronous blocking between write-back sets, and the flexible batch write-back mechanism effectively improves the data processing and data writing of volume cost calculation. library performance.

Description

technical field [0001] The invention relates to a method, system and electronic equipment for realizing short-term data writing library, and belongs to the technical field of electric power system information. Background technique [0002] In the development trend of multi-service and efficient billing, the previous applications have problems of slow writing and blocking when dealing with big data. Based on this problem, this invention proposes a short-term data writing library based on the flow control working method. The implementation method adopts asynchronous and non-blocking working methods, and the assembly between business models and models, tables and tables avoids the synchronous blocking scheme between write-back collections. SUMMARY OF THE INVENTION [0003] The purpose of the present invention is to overcome the technical defects existing in the prior art, to solve the above-mentioned technical problems, and to propose a method and system for implementing a sh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/23G06F16/22
CPCG06F16/27G06F16/2358G06F16/2255
Inventor 马吉科郑海雁尹飞许杰雄陈佐郑飞季聪王松陆嘉玮厉文婕李平曾望志葛崇慧武梦阳孙权帅率王江辉
Owner JIANGSU FRONTIER ELECTRIC TECH