Unlock instant, AI-driven research and patent intelligence for your innovation.

Collection task adjustment method and device based on database annotation

An adjustment method and data collection technology, applied in the field of big data processing, can solve the problems of incomplete data information, unreasonable design of data fields, and increase the implementation steps of managers, and achieve the effect of improving efficiency.

Active Publication Date: 2022-06-07
CITY CLOUD TECH HANGZHOU CO LTD
View PDF13 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the early stage of data collection work, relevant data implementers will establish relevant collection tasks based on the data information that needs to be collected. However, due to the problems of incomplete data information and unreasonable data field design in the early stage, it will lead to problems in the later operation process. It is necessary to re-adjust the collection method of metadata and data tables in the database. However, after the metadata is adjusted in the database, the administrator needs to manually adjust the relevant collection tasks.
[0003] That is to say, when a collection task occurs at present, the modification of the collection task that occurs is independent, and can only be manually modified by the management personnel on the platform, increasing the implementation steps of the management personnel

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Collection task adjustment method and device based on database annotation
  • Collection task adjustment method and device based on database annotation
  • Collection task adjustment method and device based on database annotation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] The embodiment of the present application provides a method for adjusting an aggregation task based on database annotations. Specifically, refer to figure 1 , the method includes:

[0027] Establish at least one collection task for different collection data on the data collection platform, wherein the configuration information of each collection task at least includes collection data source, collection data target and task information;

[0028] Modify the metadata of the imputation data and / or add imputation annotation information based on the adjustment of the imputation task of the imputation data in the database, wherein the metadata record corresponds to the interpretation data for interpreting the imputation data, and the imputation The annotation information records task adjustment information corresponding to the collection data, and the task adjustment information is used to adjust the task information of the collection task;

[0029] The data collection platfo...

Embodiment 2

[0080] Based on the same idea, refer to Figure 4 , the application also proposes a database annotation-based aggregation task adjustment device, including:

[0081] A task establishment unit 301 is used to establish at least one collection task for different collection data on the data collection platform, wherein the configuration information of each collection task includes at least collection data source, collection data target and task information;

[0082] Annotation filling unit 302, for modifying the metadata of the collection data and / or adding collection annotation information based on the adjustment of the collection task of the collection data in the database, wherein the metadata record corresponds to explaining the collection Data interpretation, the collection annotation information records task adjustment information corresponding to the collection data, and the task adjustment information is used to adjust the task information of the collection task;

[0083...

Embodiment 3

[0085] This embodiment also provides an electronic device, refer to Figure 5 , which includes a memory 404 and a processor 402, where a computer program is stored in the memory 404, and the processor 402 is configured to run the computer program to execute the steps in any of the above-mentioned embodiments of the method for adjusting the collection task based on database annotations.

[0086] Specifically, the above-mentioned processor 402 may include a central processing unit (CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC for short), or may be configured as one or more integrated circuits implementing the embodiments of the present application.

[0087] Among others, memory 404 may include mass storage 404 for data or instructions. By way of example and not limitation, the memory 404 may include a hard disk drive (Hard Disk Drive, abbreviated as HDD), a floppy disk drive, a solid state drive (Solid State Drive, abbreviated as SSD), fl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a database annotation-based collection task adjustment method and device, and the method comprises the following steps: building at least one collection task for different collection data on a data collection platform, modifying the metadata of the collection data and / or adding collection annotation information in a database based on the collection task adjustment condition of the collection data, wherein the metadata records interpretation data for correspondingly interpreting the collection data, and the collection annotation information records task adjustment information corresponding to the collection data; the data collection platform synchronously obtains collection data and corresponding metadata and / or collection annotation information, if it is detected that the metadata changes or contains the collection annotation information, a collection task corresponding to the collection data is associated, the collection task is adjusted based on the metadata and / or the collection annotation information, and the collection task is stored in the data collection platform. The collection task adjustment condition of the collection data can be quickly obtained according to the metadata and / or the collection annotation information, and the efficiency of data collection task adjustment is improved.

Description

technical field [0001] The present application relates to the field of big data processing, and in particular, to a method and device for adjusting an aggregation task based on database annotations. Background technique [0002] Data collection refers to the collection and integration of data from different sources into the same database. In the early stage of data collection work, the relevant data implementers will establish relevant collection tasks according to the data information to be collected. However, due to the problems of incomplete data information and unreasonable design of data fields in the early stage, the operation process in the later stage is caused. In the database, it is necessary to re-adjust the collection method of metadata and data tables in the database. However, after the metadata is adjusted in the database, the administrator needs to manually adjust the relevant collection tasks. [0003] That is to say, when a collection task currently occurs,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/2457
CPCG06F16/27G06F16/24573Y02D10/00
Inventor 沈瑶任通毛云青叶海涛齐韬
Owner CITY CLOUD TECH HANGZHOU CO LTD