Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for collecting metadata

A collection method and metadata technology, which can be applied in digital data processing, still image data indexing, digital data information retrieval, etc., which can solve the problem of how to ensure data consistency when inputting abnormality, and achieve the effect of ensuring consistency.

Active Publication Date: 2021-06-01
BEIJING MININGLAMP SOFTWARE SYST CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a method and device for collecting metadata, so as to at least solve the problem of how to ensure data consistency in case of abnormal entry in the metadata collection process in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for collecting metadata
  • Method and device for collecting metadata
  • Method and device for collecting metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, figure 1It is a hardware structural block diagram of a mobile terminal of a metadata collection method in an embodiment of the present invention, as figure 1 As shown, the mobile terminal 10 may include one or more ( figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data. Optionally, the above-mentioned mobile terminal also A transmission device 106 for communication functions as well as input and output devices 108 may be included. Those of ordinary skill in the art can understand that, figure 1 The shown structure is only for illustration, and does not limit the structure of the above...

Embodiment 2

[0088]The embodiment of the present invention also provides a metadata collection device, which is used to implement the above-mentioned embodiments and preferred implementation manners, and those that have already been described will not be repeated. As used below, the term "module" may be a combination of software and / or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

[0089] image 3 is a block diagram of a metadata collection device according to an embodiment of the present invention, such as image 3 shown, including:

[0090] Establishment module 32, is used for establishing root directory, and creates subdirectory for described data source according to the unique identification of data source under described root directory;

[0091] A generating module 34, confi...

Embodiment 3

[0110] An embodiment of the present invention also provides a storage medium, in which a computer program is stored, wherein the computer program is set to execute the steps in any one of the above method embodiments when running.

[0111] Optionally, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for performing the following steps:

[0112] S11. Establish a root directory, and create a subdirectory for the data source under the root directory according to the unique identifier of the data source;

[0113] S12. Generate a lock file for the subdirectory, wherein the lock file at least includes the status of the lock file and the time stamp of the current task of collecting metadata;

[0114] S13. When it is detected through the subdirectory that the first file for collecting the metadata of the data source is entered, add an exclusive lock to the lock file;

[0115] S14. After the entry of the first file is completed, the e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a metadata collection method and device, wherein the method includes: establishing a root directory, and creating a subdirectory for the data source under the root directory according to the unique identifier of the data source; creating a subdirectory for the subdirectory Generate a lock file, wherein the lock file includes at least the status of the lock file and the timestamp of the current task of collecting metadata; when the first file entry of collecting the metadata of the data source is detected through the subdirectory, An exclusive lock is added to the lock file; after the first file is entered, the exclusive lock is released, and the first file is transferred to the graph database for storage. The present invention can solve the problem of how to ensure data consistency in case of abnormal entry in the metadata collection process in the related art, and carry out metadata collection based on file locks to ensure data consistency.

Description

technical field [0001] The present invention relates to the monitoring field, in particular to a metadata collection method and device. Background technique [0002] For the metadata system based on outputting the metadata of the data source into a file in a specific format, and then parsing the file and entering it into the graph database, the conventional collection and entry control method is roughly based on the task scheduling system inside the system. The implementation of the system is multi-threaded scheduling, and the implementation details are to abstract the business logic, and implement concurrent scheduling through various locking mechanisms and concurrent programming. Although this method can meet business requirements, it also has many disadvantages, such as the scheduling method of the extended system is not flexible enough , and every time the function is expanded, the complexity of the system will be greatly increased, and the increase in complexity will br...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/176G06F16/172G06F16/51
CPCG06F16/172G06F16/1774G06F16/51
Inventor 于阳张毅然
Owner BEIJING MININGLAMP SOFTWARE SYST CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More