32 results about "Batch extraction" patented technology

The invention provides a data direct-connection writing method and system and electronic equipment, and belongs to the technical field of data processing, and the method comprises the following steps: writing to-be-written data into a buffer channel of a streaming acquisition framework; extracting the to-be-written data from the buffer channel according to a preset batch size to form a data batch, and determining a target database table according to information contained in the data batch; according to the target database table, constructing the data batch into a write-in request conforming to a target database batch write-in interface specification; and sending the write-in request to the target database table through the connection pool of the preset transmission protocol. Through data batch extraction based on the buffer channel and dynamic determination of the target database table, the batch writing requests are constructed and are directly connected and transmitted through the connection pool, so that the real-time performance and stability of data writing are improved in a large-scale real-time data writing scene.

The invention relates to the technical field of water quality detection, in particular to a batch extraction detection device for domestic drinking water detection, which comprises a transmission system, a support frame, a double-track sliding mechanism, a ship body, a turnover mechanism, a sampling height adjusting mechanism and a detection mechanism, the support frame is arranged in the middle of the upper end of the ship body, and the transmission system is arranged in the middle of the rear end of the support frame; the double-track sliding mechanism is arranged on the upper side of the front end of the supporting frame, the turnover mechanism is arranged on the front side of the middle of the upper end of the double-track sliding mechanism, the sampling height adjusting mechanism is arranged in the middle of the front end of the turnover mechanism, and the multiple detection mechanisms distributed at intervals are arranged on the two sides of the middle end of the sampling height adjusting mechanism. The sampling height adjusting mechanism is arranged, a telescopic mode of extruding double shear shank through pneumatic transmission is adopted, the distance between the adjacent detection mechanisms can be adjusted and changed in real time according to the depth of a sampled water source, and therefore water sources with different depths can be sampled and detected at the same time.

This invention provides a method and system for metal extraction from mixed solutions, relating to the field of metal extraction and separation technology. The method includes: acquiring initial component state information of the multi-metal mixture to be separated; calculating the coordination bond dissociation energy between each metal ion and the extractant based on the initial component state information, and constructing competitive extraction response characteristics; establishing the extraction rate evolution trajectory of each metal ion during pH changes, and constructing a separation window by identifying the intersection points of the evolution trajectories; determining the pH control target value and addition sequence for each extraction batch according to the separation window; determining the main extractant and its dosage based on the ligand field stabilization energy calculation principle; and performing batch extraction operations sequentially according to the addition sequence. This invention, by constructing competitive extraction response characteristics and separation windows, achieves precise pH control and extractant selection, improving the efficiency and purity of metal separation from multi-metal mixtures.

The invention belongs to the related technical field of computer storage, and particularly relates to a large-scale file set batch migration method which comprises the following steps: directly loading and reading metadata information of a source end file set from source end equipment, and extracting metadata information of each file of a target file set in batches; according to metadata information of each effective file, obtaining a mapping relation from all file logic blocks of the effective file to corresponding logic block addresses, uniformly storing the mapping relation into a data structure for global data block indexing, performing ascending sorting and merging operation on all the logic block addresses in the data structure to obtain a new logic block address sequence, and storing the new logic block address sequence into a database; each logic block address is correspondingly marked as a continuous read area; performing n times of disk reading in batches through n direct I / Os, and correspondingly obtaining data of n continuous reading areas; and sending all disk reading data, metadata information of all valid files and the data structure to a target end, and executing reconstruction. The problem of frequent random I / O can be avoided.

The application provides a rose petal essential oil extraction device, which comprises a main box, an extraction cup, a clamping device, a liquid inlet pipeline and a liquid outlet pipeline are arranged in the main box, an extraction cavity is formed in the extraction cup, a liquid inlet is arranged at the top of the extraction cavity, and a liquid outlet is arranged at the bottom of the extraction cavity; the clamping device is used for clamping the extraction cup and comprises lower clamping blocks for clamping the bottom surface of the extraction cup and upper clamping blocks for clamping the top surface of the extraction cup; the liquid inlet pipeline comprises a liquid inlet pipe for being in communication with the liquid inlet, a high-pressure pump and a pressure gauge are arranged on the liquid inlet pipeline, and the liquid inlet end of the liquid inlet pipeline is connected with a solvent tank; the liquid outlet pipeline comprises a liquid outlet pipe for being in communication with the liquid outlet, and a liquid storage tank is arranged at the end of the liquid outlet pipeline. The rose petal essential oil extraction device has a compact structure, can realize automatic access and extraction of the extraction cup, has high extraction efficiency and good effect, and is suitable for batch extraction experiments.

The invention discloses a continuous washing method of a pesticide intermediate, which comprises the following steps: S1, mixing and dissolving the pesticide intermediate and an organic solvent to obtain an intermediate solution; s2, feeding an intermediate solution, carrying out three-stage continuous series extraction, and enabling a lower-layer heavy phase obtained after extraction separation to enter an extraction water phase tank; and S3, continuously performing centrifugal extraction on the extracted and separated upper-layer light phase, performing reverse acid pickling on the acid solution and the upper-layer light phase, and performing two-stage acid pickling to realize separation of the light phase and the heavy phase. After kettle type intermittent extraction layering is changed into continuous extraction, program control can be achieved, workers only need to itinerate regularly, and the workload of the workers is reduced. And meanwhile, subjective misjudgment caused by layering judgment by naked eyes of personnel is avoided. The method reduces the production loss, reduces the COD value of the wastewater, avoids the use of dichloromethane or trichloromethane in the traditional process, and is green and environment-friendly in process.

The application relates to a real-time flow retention and batch extraction method, which adopts a brand-new design logic and is designed in a unified logic scheduling relationship for the retention and extraction of network data flow. For the retention, a cache relay and a file system writing are introduced to obtain the storage of each to-be-analyzed network data flow in each file in the file system, and each aggregation key corresponding to each time mark information corresponding to each to-be-analyzed network data flow divided according to a preset network data flow aggregation rule is combined to form each to-be-analyzed key, and each to-be-analyzed value formed by the storage address of each to-be-analyzed network data flow in the file system corresponding to each to-be-analyzed key. Based on this, for a target extraction request, the target aggregation key and the target time period are compared with each to-be-analyzed key and the corresponding to-be-analyzed value, so that the target extraction request is responded, the storage speed of real-time flow is improved, and the efficiency of batch extraction during subsequent use is improved. The application has important significance for the rapid extraction and analysis of retained flow.

The invention relates to the technical field of hydrological data processing, in particular to a small watershed design flood calculation parameter batch extraction method based on GIS and Python. DEM data of a to-be-processed watershed range are collected, and a vector surface map layer of the to-be-processed watershed range is obtained through analysis from the DEM data; calculating the river length and the gradient of the to-be-processed drainage basin range in batches based on the vector surface map layer; multi-time-span rainfall and Cv values of the to-be-processed drainage basin range are calculated in batches, cut and output; and performing batch calculation to obtain partition results of the rainstorm partition, the runoff production partition and the confluence partition of the to-be-processed drainage basin range. According to the method, the preprocessing step of the DEM data can be further optimized, so that the data processing efficiency is improved, the self-adaptive extraction function for different rainfall periods is added, different hydrological conditions are adapted, the parameters needed by small-watershed design flood calculation are extracted in batches, the working efficiency is remarkably improved, and the error rate of manual operation is reduced.

The present invention discloses a method for analyzing the composition of population oil inclusions in calcite minerals, which includes washing oil from calcite particles; randomly dividing the oil-washed calcite particles into two parts, and subjecting the first part of the calcite particles to microscopic detection; grinding the second part of the calcite particles to release the organic components in the microcracks of the calcite particles; adding dilute hydrochloric acid to the calcite powder for acidolysis to release the organic components in the oil inclusions of the calcite powder. The beneficial effects of the present invention are as follows: Based on the microscopic observation of the morphological characteristics of intermediate cracks and oil inclusions in mineral particles, first, the components of oil inclusions in calcite microcracks are released by "mechanical crushing + extraction", and then the components of oil inclusions in the mineral matrix are released by "acid dissolution + extraction", realizing the batch extraction of different types of population oil inclusions in mineral microcracks and the mineral matrix, and improving the method for studying the properties of charged crude oil and the stages of hydrocarbon accumulation using population oil inclusions.

The invention discloses a steel member neutral axis position batch calculation method based on dynamic monitoring and parallel calculation. The method comprises an early-stage manual configuration stage and a subsequent automatic operation stage, and specifically comprises the following steps: step 1, determining a whole-process task list, compiling a whole-process automatic control code, and establishing a standardized input data source and an automatic control system; 2, intelligently detecting computer hardware computing resources, and determining the maximum number of tasks which can run in parallel in each stage; 3, dynamically scheduling computing resources, and sequentially realizing batch modeling, batch computing operation, batch data extraction, batch data processing and batch drawing of graph lines; 4, the task progress in the previous stages is monitored in real time, progress information is stored, breakpoint continuous calculation capacity is achieved, operation can be recovered according to the stored progress state after abnormal interruption, and the completed task is automatically skipped.

The utility model provides a batch filtering device for liquid chromatogram samples. Comprising a supporting seat, a first mounting plate, a second mounting plate, a third mounting plate, a first adjusting assembly and a second adjusting assembly, wherein the first mounting plate is mounted at the lower part of the supporting seat; the second mounting plate and the third mounting plate are mounted at the upper part of the supporting seat; the first mounting plate is mounted on the supporting seat, the second mounting plate is mounted on the supporting seat, the fourth mounting plate is mounted in the middle of the supporting seat, the fifth mounting plate is mounted on the lower portion of the supporting seat, the sample storage bottles are mounted on the first mounting plate, the injectors are mounted on the second mounting plate, the needle filters are mounted on the fourth mounting plate, and the liquid-phase small bottles are mounted on the fifth mounting plate. The first adjusting assembly and the second adjusting assembly can synchronously drive the plurality of injectors to move, and the plurality of injectors can be operated at the same time for batch extraction and batch filtration of samples at a time, so that the operation is simplified, the workload is greatly simplified, the repeated operation of experimenters is reduced, and the detection efficiency is improved.

This paper discloses a method for batch extracting reference depth control points from LiDAR. This method first uses high-resolution remote sensing imagery to rapidly extract shallow-water characteristic photons. It then applies the DBSCAN algorithm to detect underwater photon signals, eliminating some outliers. Finally, it rapidly obtains ICESat-2 shallow-water reference depth control point data. This method can rapidly extract photon signals from shallow-water bottom topography detected by ICESat-2 photons, improving the efficiency of LiDAR echo detection of bottom topography.

The utility model discloses a waste extraction and separation device which comprises a heating tank and a heating device, a heating cavity is arranged in the heating tank, a plurality of positioning holes are formed in the top of the heating tank, and extraction bottles are inserted into the positioning holes; the top end of the extraction bottle is coaxially linked with an adjusting column, the adjusting column is coaxially linked with an adjusting gear, a driving gear is coaxially arranged in the center of the top of the heating tank, the heating tank is provided with a driving motor capable of driving the driving gear to perform fixed-axis rotation, all the adjusting gears are arranged on the peripheral side of the driving gear at equal intervals in the circumferential direction, and the driving gear is in meshing transmission with the adjusting gears; a heat insulation box is arranged in the center of the top of the heating cavity, the driving motor is detachably arranged in the heat insulation box, and the driving gear is coaxially linked to an output shaft of the driving motor. According to the waste extraction and separation device, batch centralized treatment of a plurality of extraction bottles can be realized, so that the labor intensity of workers is reduced, the treatment efficiency is improved, the treatment consistency of the same batch of extraction bottles is ensured, and the batch extraction treatment effect of corresponding waste samples is optimized.

The utility model provides a batch and quantitative transferring and taking device for liquid reagents, and belongs to the field of liquid quantification. A liquid reagent batch and quantitative moving and taking device comprises a shell, a storage shell is fixedly installed in the shell, two first electric push rods are fixedly installed on the storage shell, a fixing frame is fixedly installed at the output ends of the two first electric push rods, and a plurality of sliding shells in sliding fit with the storage shell are fixedly installed on the fixing frame; second electric push rods are fixedly installed on the lower sides of the multiple sliding shells, and sliding frames are fixedly installed at the output ends of the second electric push rods. Through the arrangement of the first electric push rod, the sliding shell can be driven to slide, so that the space between the sliding shell and the storage shell after sliding can be changed, and due to the fact that the space between the storage shell and the sliding shell can be changed, the device can extract reagents with different volumes in batches.

The present invention provides a method for batch extracting small reservoirs based on high-precision remote sensing imagery. The method comprises collecting multiple years of high-resolution land classification data, and further comprises the following steps: fusing the high-resolution land classification data; utilizing multi-source data to remove polygons representing areas without reservoirs from water body polygons; capturing and annotating images from high-definition remote sensing imagery using water body polygons; and constructing and training a machine learning image classification model to classify the images. The method proposed in the present invention batch extracts small reservoirs based on high-precision remote sensing imagery. The method integrates multiple years of high-resolution land use data, utilizes environmental data such as water surface frequency and land use, vegetation, and population distribution to exclude water body data such as lakes and rivers, and utilizes a machine learning image recognition algorithm to extract small reservoirs from a large number of water surfaces.

The application discloses a clinical research information batch extraction system and method, belongs to the field of clinical research literature data processing, and solves the technical problems of low efficiency and poor accuracy of the existing extraction method, and lack of field logic constraints and no checking mechanism of the existing tool. The system comprises sequentially coordinated preprocessing, data acquisition, a core processing engine of a double-layer semantic checking architecture, and a summary output module. The method comprises four steps of identifier analysis and cleaning, metadata concurrent retrieval, double-layer semantic parallel extraction, and structured summary output. Identifier standardization is realized through adaptive regular analysis, data is preliminarily screened based on a PICO element semantic constraint template, logical checking and correction are completed by using a medical logic mutual exclusion rule library, and finally, a structured data set with a standard table header is generated and CSV / Excel export is supported. The application greatly reduces the data extraction error rate, shortens the processing period to the minute level, and enables the extracted data to be directly used for statistical analysis without secondary cleaning, thereby meeting the scientific research needs of evidence-based medical research.

The invention discloses a pin information batch extraction method and system, a computer and a storage medium, and the method comprises the following steps: configuring a pin information extraction function of APD software in an automatic script, and configuring a storage path of pin information; loading the automatic script in the skill environment of the APD software; in response to a frame selection command in the automatic script, frame selection is carried out on a pin of which information needs to be extracted; and the APD software extracts and exports the pin information of the selected pin according to a pin information extraction command in the automatic script. The method can be used for improving the problems that when software processes coordinate checking and exporting of a large number of pins, efficiency is low, information is tedious, and only original relative coordinates can be exported.

The invention provides an intelligent multi-language batch translation system and method based on a large language model, relates to the technical field of natural language processing, and effectively solves the problems that an existing translation scheme is lack of batch processing capacity, insufficient in language coverage, poor in quality stability and tedious in operation experience. The system comprises a user configuration and file preprocessing module, a dynamic column and language recognition module, an original text batch extraction module, a structured translation and error processing module, a result write-back and storage module and a report and log generation module. According to the method, JSON Schema is dynamically generated, double-level cue words are constructed, a large language model is called to output an API in a structured mode, and a multi-level retry mechanism is combined, so that efficient, stable and easy-to-use multi-language batch translation in the Excel document is achieved. According to the method, the translation efficiency and format stability are greatly improved, multi-language dynamic adaptation and field customization are supported, the non-technical user operation threshold is lowered, and the method is suitable for various multi-language document translation scenes in the globalized process of an enterprise.

This invention discloses a system for batch mass spectrometry detection. The system includes: a mass spectrometer body, a sample introduction device located on the side of the mass spectrometer body, and at least one capillary tube. In the assembled state: the sample introduction device includes a fixing plate, a placement plate, and a connecting mechanism; the connecting mechanism is installed on the side wall of the mass spectrometer body; the placement plate is installed on the connecting mechanism and has at least one placement hole for placing a sample container; the fixing plate is installed on the connecting mechanism and has at least one sampling block; one end of the at least one capillary tube is connected to the mass spectrometer body, and the other end passes through the sampling block and extends into the sample container to extract the sample to be tested from the sample container and introduce it into the mass spectrometer body, realizing batch extraction of the sample to be tested and batch mass spectrometry detection of the sample to be tested, improving the efficiency of sample introduction and thus improving the efficiency of mass spectrometry detection.

The present invention relates to the technical field of lithium extraction from lithium ores, and specifically discloses a method for separating lithium from zinnwaldite. The method for separating lithium from zinnwaldite provided by the present invention includes: mixing zinnwaldite powder with an acid solution and adding the mixture into a high-pressure reaction kettle for oxidative leaching reaction to obtain a lithium-containing leaching solution; adding a calcium salt to the lithium-containing leaching solution until the pH of the system is neutral or alkaline, filtering to obtain a filtrate; adding a carbonate solution to the filtrate to remove the excess calcium ions, filtering, concentrating the filtrate, adding a saturated carbonate solution to the concentrated solution for precipitation reaction, filtering, and drying to obtain battery-grade lithium carbonate. Through the method for separating lithium from zinnwaldite provided by the present invention, battery-grade lithium carbonate can be obtained, and the lithium recovery rate is high, the operation is simple, the energy consumption is low, the consumption of acids and alkalis is small, and the amount of waste liquid generated is small. It is suitable for industrial batch extraction of lithium from lithium ores, has high practical value, and is of great significance for the sustainable development of the lithium battery field.

The present invention discloses a pneumatic device for batch extraction of liquid from a collection bag and a control method thereof. The device comprises a syringe, a lower card plate, an integrated silicone cavity plate, an upper card plate, and a collection bag with a flexible connector connected to the end thereof; the integrated silicone cavity plate is sandwiched between the lower card plate and the upper card plate, and a plurality of syringes are mounted on the bottom of the lower card plate in an array manner. The upper end of the integrated silicone cavity plate passes through the lower card plate and extends into the integrated silicone cavity plate. The collection bag is suspended via a flexible connector, and the collection bag passes through the upper card plate and is loaded into the integrated silicone cavity plate. The syringe punctures the collection bag in the integrated silicone cavity plate. The present invention utilizes pneumatics to achieve batch extrusion and extraction of liquid from a collection bag without a mechanical transmission mechanism, greatly shortening the time for extracting saliva samples in animal husbandry quarantine. The device is simple to operate, easy to install, low in production cost, and environmentally friendly.

The present invention relates to a batch extraction device for cryopreservation boxes, which includes a fixed disk, a fixed rod, a moving device, a storage device, a telescopic rod, a clamping device and a fixing device. The storage device is installed on the left part of the moving device, the top surface of the right part is connected to the fixed disk through the fixed rod, and the bottom surface of the right part is connected to the clamping device through the telescopic rod. The clamping device is connected to the fixing device. The present invention can extract several cryopreservation boxes from the cryopreservation rack at one time as needed, which can greatly improve the operation efficiency of batch extraction of cryopreservation boxes. First, the device is moved to a position as close as possible to the cryopreservation rack through the fixed disk and the fixed rod, and then several cryopreservation boxes clamped from the cryopreservation rack are placed on the storage device one by one through the clamping device and the fixing device. After all the required number of cryopreservation boxes are transferred to the storage device, the device is moved to a position convenient for taking out the cryopreservation boxes again through the fixed disk and the fixed rod, and several cryopreservation boxes are taken out from the storage device manually.

The utility model discloses a low-temperature ultrasonic counter-current extraction device for houttuynia cordata, which comprises an ultrasonic generator, a feeding unit, a low-temperature control unit, a counter-current extraction unit, a solvent circulating unit, a collecting unit and a control system, the feeding unit, the low-temperature control unit, the solvent circulating unit and the collecting unit are respectively connected with the counter-current extraction unit, and the control system is respectively and electrically connected with the ultrasonic generator, the feeding unit, the low-temperature control unit, the counter-current extraction unit, the solvent circulating unit and the collecting unit. By adopting a low-temperature ultrasonic countercurrent mode, the extraction device disclosed by the utility model not only can effectively prevent loss of heat-sensitive components, but also can reduce dissolution of ineffective components and realize high-efficiency and continuous countercurrent extraction operation, so that the extraction efficiency is improved, the production cost is reduced, batch extraction can be realized, and the extraction device is simple in overall structure, reasonable in design and low in cost. The popularization and use are worthy.

This invention relates to a method for rapidly and batch-extracting government procurement contract PDF documents, belonging to the field of information extraction from PDF documents. By improving the pdfplumber library in Python to increase extraction efficiency, and incorporating regular expression matching, a fully automatic extraction and parsing model is implemented to address the issues of large amounts of spaces and disorganized extracted content. This method achieves precise matching and allows for rapid, accurate, and batch extraction of the specific content of government procurement contract PDF documents.

The invention discloses a leached substance extraction device of a drug delivery system, and belongs to the technical field of medical instrument inspection. Through the physical winding unit and the conduit placement unit, automatic winding and placement of a conduit into an extraction bottle are achieved, the extraction bottle is conveyed to the shaking timing device and the temperature control device through the conveying device to be automatically shaken, overall control is more accurate compared with manual control, and the automation degree is high. The automation degree is high, automatic control over the whole process from guide pipe winding, transferring to an extraction bottle and constant-temperature shaking is achieved, and personal errors are reduced; the precision is high, the pollution risk is low, the sample can be prevented from being polluted by the external environment through the structural design of the device, and the test accuracy is improved; the adaptability is high, the clamp and the winding structure can be adjusted according to drug delivery catheters of different sizes, and the universality is high; the temperature control is stable. The temperature control module and the shaking module work cooperatively, so that the extraction temperature consistency is ensured, and the data repeatability is better; manpower is saved, the efficiency is improved, and batch extraction and synchronous detection of multiple samples are realized.

The utility model relates to the technical field of serum separation, in particular to a batch extraction serum separation device which comprises a reciprocating type shaking table body, a supporting plate is installed on one side wall of the reciprocating type shaking table body, and two clamping mechanisms are symmetrically installed on the two sides of the top end of the supporting plate. The support plate is mounted on one side wall of the reciprocating type shaking table body, and the two clamping mechanisms composed of the sliding grooves, the two-way lead screws, the clamping blocks and the motors are symmetrically mounted on the two side walls of the support plate; an extraction mechanism consisting of an electromagnetic valve, an air extraction main pipe, a negative pressure pump, an air extraction branch pipe, a storage bottle and a telescopic suction pipe is mounted between the top end of the supporting plate and the clamping mechanism, so that the serum separation device can be used for simultaneously and respectively extracting separated serum in four animal blood samples when being used; according to the device, the complicated operation of manual repeated extraction is omitted, the labor intensity of workers is reduced, the extraction efficiency of separated serum in animal blood samples is effectively improved, and efficient preparation of serum products is facilitated.

The application relates to a circuit analysis method and device, electronic equipment and a storage medium. The circuit analysis device comprises an information module configured to acquire a plurality of layout units; an environment configuration module configured to set a corresponding layout parasitic parameter extraction environment based on the type and / or parameters of the layout units; and a batch processing module configured to batch extract a parasitic parameter netlist of the plurality of layout units in the layout parasitic parameter extraction environment.

The invention discloses a method for realizing batch extraction of human anatomical feature parameters, and relates to the technical field of human anatomical feature parameter extraction. According to the method, anatomical feature parameters are recognized and quantified through the feature recognition module, key anatomical structures are automatically detected to generate a standardized feature data set, and a large-scale image data set is processed through parallel computing to achieve high-speed batch processing; a batch processing module is used for performing automatic parallel processing on a plurality of anatomical image data sets, efficient task scheduling and resource allocation are realized through a distributed computing framework, and the batch processing module supports large-scale data processing tasks and can be expanded to process thousands of concurrent data sets to ensure that high throughput and low delay are maintained in a high-load scene; and finally, a batch of comprehensive parameter reports are generated, the reports automatically integrate time sequence prediction results and abnormal classification output, and are optimized into a structured format, so that the reports can be directly imported into a clinical database or a decision support system.

The invention discloses a data batch processing method and device and a storage medium, and the method comprises the steps: calculating the amount of data accumulated in a message queue of each data processing task, and obtaining the task accumulation amount corresponding to each data processing task; based on the task accumulation amount corresponding to each data processing task, allocating allocable total computing resources to each data processing task to obtain a computing resource amount corresponding to each data processing task; wherein the task accumulation amount and the calculation resource amount are in positive correlation; on the basis of the calculation resource quantity corresponding to each data processing task, the data quantity extracted in batches by the processing thread of each data processing task each time is set, and the batch processing size is obtained; and based on the batch processing size corresponding to each processing thread, controlling each processing thread to extract data from the message queue for processing. The data volume processed at the same time can be increased under limited computing resources, and the resource utilization rate and the data processing efficiency are improved.

The invention belongs to the field of data processing, and particularly relates to a batch processing-based multi-table universal efficient data processing method, which comprises the following steps of S1, data acquisition and distribution; s2, data preprocessing and insertion data construction; s3, extracting and processing batch data; and S4, batch data insertion and log recording. According to the method, four dimensions of visual configuration, full-process automation, data processing refinement and batch high efficiency are concentrated, through systematic process design and technical optimization, the manual intervention cost and dependence on bottom layer coding are greatly reduced, and synchronous upgrading of performance, stability and operation and maintenance efficiency is achieved in a large-scale data processing scene; in the aspect of a configuration mode, the scheme breaks through the limitation that traditional data processing depends on coding, and a visual operation interface is provided; on the level of flow operation, a full-closed-loop automatic system of data distribution, preprocessing, batch extraction and insertion landing is constructed in the scheme.