Batch data processing method, device and equipment and storage medium

A technology of batch data and processing methods, applied in the field of data processing, can solve the problems of slow parsing, overwhelmed servers, affecting business use, etc., to achieve the effect of alleviating processing pressure

Pending Publication Date: 2019-10-25
PING AN TECH (SHENZHEN) CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

According to the traditional Excel form, due to the complex format, the parsing is slow, which makes the server overwhelmed and seriously affects the daily business use, thereby reducing the processing efficiency of the server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch data processing method, device and equipment and storage medium
  • Batch data processing method, device and equipment and storage medium
  • Batch data processing method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0046] Reference figure 1 , figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0047] Such as figure 1 As shown, the device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and input units such as keys. The optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a batch data processing method, device and equipment based on big data processing and a storage medium, and the method comprises the steps: obtaining to-be-processed business data when the to-be-processed business data is written into a database, and enabling the to-be-processed business data to be compliant data in an Excel format of a spreadsheet; calling a preset conversion tool in a preset area, and converting the compliance data in the Excel format through the preset conversion tool to generate lightweight warehousing data in a preset format; searching an analysismode corresponding to the preset format in a preset relationship mapping table, and analyzing the storage data through the analysis mode to obtain analyzed storage data; and writing the analyzed storage data into the database in batches. According to the method, a traditional Excel file format file is converted into a lightweight format file to be written into the database in batches, and the processing pressure caused when big data is written into the database in batches is relieved.

Description

Technical field [0001] The invention relates to the field of data processing, and in particular to a method, device, equipment and storage medium for processing batch data. Background technique [0002] At present, there is often a large amount of data in the compliance system business that needs to be stored externally. According to the traditional Excel format, due to the complexity of the format, the analysis is slow, which makes the server overwhelmed and seriously affects the daily business use, thereby reducing the processing efficiency of the server. Summary of the invention [0003] The main purpose of the present invention is to propose a batch data processing method, device, equipment and storage medium, aiming to improve the processing efficiency of the server. [0004] In order to achieve the above-mentioned object, the present invention provides a method for processing batch data. The method for processing batch data includes the following steps: [0005] When the busin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F17/22
CPCG06F16/258G06F16/25G06F40/126
Inventor 高梁梁童希望
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap