Unlock instant, AI-driven research and patent intelligence for your innovation.

A short-time data library writing implementation method and system and electronic equipment

An implementation method and data writing technology, which is applied in the field of power system information, can solve problems such as slow writing and blocking, and achieve the effects of improving performance, avoiding synchronous blocking problems, and flexible batch write-back mechanism

Active Publication Date: 2021-07-30
JIANGSU FRONTIER ELECTRIC TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the development trend of multi-service and efficient billing, the past application programs have the problem of slow writing and blocking when processing large data. Based on this problem, this invention proposes a short-term data writing library based on the flow control working method The implementation method adopts an asynchronous and non-blocking working method, and the assembly between business models and models, tables and tables avoids the synchronous blocking scheme between write-back collections

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A short-time data library writing implementation method and system and electronic equipment
  • A short-time data library writing implementation method and system and electronic equipment
  • A short-time data library writing implementation method and system and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Embodiment 1: The present invention proposes a method for implementing short-term data writing to the database, including the following steps:

[0046] Step 1: The process of assembly and assembly according to the business demand planning fee model is as follows:

[0047] S11. Create a virtual slot based on the foreign key field value of a business unit corresponding to a KEY, and use the FNV (FowlerNolVo) algorithm to hash the field value. The FNV-1 algorithm can hash a large amount of data while maintaining a small conflict rate. The calculation process is,

[0048] Initialization: hash=2166136261;

[0049] Enter the loop, and determine the number of loops according to the length of the input data bytes. The hash result is a 32-bit unsigned integer, so it is necessary to discard the high bits and keep the low 32 bits: hash=(2166136261*16777619)mod 2 32 = 0x050c5d1f;

[0050] To perform an XOR operation, first convert 0x56 into a 32-bit value 0x00000056, and then pe...

Embodiment 2

[0079] Embodiment 2: the present invention also proposes the implementation system of short-term data writing database, including:

[0080] The collection and assembly module is used to execute: perform collection and assembly according to the business demand planning and charging model, and generate a collection of charging results;

[0081] A parsing module, configured to execute: parsing the billing result set and putting it into a memory queue;

[0082] The queue pulling module is configured to perform: spin pulling queue data from the memory queue;

[0083] The token access module is used to execute: create an access token to connect to the database according to the queue data;

[0084] The archiving module is used to execute: batch archiving of multi-data sources for calculation and fee collection;

[0085] The task judging module is used to execute: judging the task to return the token;

[0086] The exception collection module is used to execute: establish a containe...

Embodiment 3

[0087] Embodiment 3: The present invention also proposes an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the method is implemented when the processor executes the program step.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a short-time data library writing implementation method and system and electronic equipment, and the method comprises the following steps: SS1, carrying out the set assembly according to a business demand plan fee calculation model, and generating a charging result set; step SS2, analyzing the charging result set, and putting the charging result set into a memory queue; step SS3, pulling queue data from the memory queue in a spinning manner; step SS4: according to the queue data, creating an access token to connect a database; step SS5, performing batch archiving on multiple data sources of the fee calculation set; step SS6, judging a task return token; and step SS7, establishing an amount and cost abnormal task collection container. According to the flow control-based write-back mechanism, an asynchronous non-blocking working mode is adopted, the problem of synchronous blocking between write-back sets is avoided, and the data processing and data library writing performance of quantity cost calculation is effectively improved through a flexible batch write-back mechanism.

Description

technical field [0001] The invention relates to a method, system and electronic equipment for realizing short-term data writing to a database, and belongs to the technical field of electric power system information. Background technique [0002] In the development trend of multi-service and efficient billing, the past application programs have the problem of slow writing and blocking when processing large data. Based on this problem, this invention proposes a short-term data writing library based on the flow control working method The implementation method adopts an asynchronous and non-blocking working method, and the assembly between business models and models, tables and tables avoids the synchronous blocking scheme between write-back collections. Contents of the invention [0003] The purpose of the present invention is to overcome the technical defects in the prior art, solve the above technical problems, and propose a method and system for implementing short-term dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/23G06F16/22
CPCG06F16/27G06F16/2358G06F16/2255
Inventor 马吉科郑海雁尹飞许杰雄陈佐郑飞季聪王松陆嘉玮厉文婕李平曾望志葛崇慧武梦阳孙权帅率王江辉
Owner JIANGSU FRONTIER ELECTRIC TECH