Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

273 results about "Directory structure" patented technology

In computing, a directory structure is the way an operating system's file system and its files are displayed to the user. Files are typically displayed in a hierarchical tree structure.

Text block dynamic segmentation method and system based on RAG

The invention provides an RAG-based text block dynamic segmentation method and system, and the method comprises the steps: analyzing a multi-level directory structure of a document, and segmenting a text block by taking a directory node as a reference; for a document without a directory or with an incomplete directory, a mixed segmentation mode of rules and semantics is switched; performing potential Dirichlet distribution topic modeling on the continuous text stream, and calculating a topic distribution vector of each text segment in real time; performing adaptive segmentation on the detected topic boundary, inserting a hard segmentation mark at a topic mutation point, and performing soft segmentation on a gradual change topic area; the initial window size of the sliding window is set according to the document type, and the semantic density in the window is monitored in real time; and layering, blocking and recombining. The system comprises a segmentation mode module, a mark confirmation module and a block recombination module. According to the method, the RAG retrieval accuracy is improved, the memory occupation is reduced, and meanwhile, the streaming throughput is supported.
Owner:北京三维天地科技股份有限公司

Domain intelligent question-answering method and system based on multi-modal knowledge graph and RAG

The invention relates to the technical field of intelligent questioning and answering, in particular to a domain intelligent questioning and answering method and system based on a multi-modal knowledge graph and RAG, and the method comprises the steps: constructing a concept layer knowledge graph based on a directory structure of a domain multi-modal document, and constructing an instance layer knowledge graph based on document content; obtaining a user question, pruning and positioning the user question in combination with the concept layer knowledge graph and the thinking chain, and determining a target chapter; splitting the question into sub-questions through intention analysis, and performing semantic retrieval in the instance layer knowledge graph corresponding to the target chapter to obtain a graph retrieval result; optimizing the original problem based on the atlas retrieval result, and executing semantic retrieval in a vector database to obtain a vector retrieval result; and fusing the atlas retrieval result and the vector retrieval result to generate a preliminary answer, and performing iterative optimization until a final answer is generated. According to the method, the semantic coverage, the expression accuracy and the response efficiency of the vertical domain question-answering system are remarkably improved by constructing the multi-modal knowledge graph and optimizing the retrieval process.
Owner:HENAN UNIVERSITY

Knowledge text retrieval method and device, storage medium and computer equipment

According to the knowledge text retrieval method and device, the storage medium and the computer equipment, when knowledge text retrieval is carried out, the retrieval statement and the target knowledge document corresponding to the retrieval statement are obtained firstly, the document structure tree of the target knowledge document is determined, the document structure tree is of a tree structure constructed by utilizing the directory structure of the target knowledge document, and the retrieval statement is stored in the document structure tree; according to the method, a target knowledge document is taken as a component of the target knowledge document, an index structure between each index node in the component of the target knowledge document and the target knowledge document is recorded, and leaf nodes in the index nodes are connected through pointers to form a linked list structure. The corresponding index node can be dynamically retrieved based on the association relationship between the index structure and the linked list structure of the tree structure, and the context content corresponding to the retrieval statement in the target knowledge document is intercepted by adopting different modes based on the type of the index node. And omission of unrelated contents of other chapters and key contents of the same chapter is avoided, so that the retrieval precision and quality are improved.
Owner:GUANGZHOU QUWAN NETWORK TECH CO LTD

Attachment packaging and unpackaging method, system and equipment based on compression algorithm and medium

The invention provides an attachment packing and unpacking method, system and device based on a compression algorithm and a medium, and belongs to the technical field of file compression. The method comprises the steps that all attachment files needing to be packaged are obtained by traversing a specified directory, screening and filtering are conducted according to file attributes, and a renamed file list and a path mapping table are generated; according to the renamed file list, using a Brotli algorithm to compress each attachment file based on a preset compression level, and packaging the compressed data into a packaged file containing metadata, compressed data and verification information; when the packed file needs to be unpacked, the legality of the packed file is confirmed through magic number verification and index analysis, file data are recovered through Brotli streaming decompression, and the original directory structure of the file is restored. According to the method, efficient compression and streaming decompression are achieved through the Brotli algorithm, and the attachment storage efficiency, the transmission speed and the data integrity are remarkably improved in combination with the intelligent screening and directory structure reduction technology.
Owner:INSPUR GENERSOFT CO LTD

Knowledge base construction method and device, computer equipment and storage medium

The invention relates to a knowledge base construction method and device, computer equipment and a storage medium. The method comprises the following steps: performing directory structure extraction on a target document to obtain a directory structure tree; based on the directory structure tree, splitting the target document to obtain a plurality of knowledge blocks; when the label data does not exist in the target document, generating the label data corresponding to the target document based on a preset large language model and the abstract text of the target document; based on the label data of the at least one target document and the plurality of knowledge blocks, constructing a target knowledge base; the target knowledge base comprises a document tree composed of label data of the target document. By adopting the method, the retrieval efficiency and accuracy of the knowledge base can be improved.
Owner:ZHEJIANG DAHUA TECH CO LTD

Management of access control in a storage system

ActiveUS12229291B1File systemData file
An illustrative method includes an access control list (ACL) management system generating an ACL file containing an ACL that describes one or more access permissions in a file system, storing the ACL file within an ACL directory structure, the ACL file uniquely representing the ACL in the ACL directory structure, generating an ACL identifier for the ACL file, and mapping, using the ACL identifier, the ACL file to one or more data files in the file system to apply the ACL in the ACL file to the one or more data files.
Owner:PURE STORAGE INC

Railway engineering implementation construction organization generation method and related assembly

The invention discloses a railway engineering implementation construction organization generation method and related components, and the method comprises the steps: building a railway engineering knowledge base which comprises a railway engineering implementation construction specification file and a historical railway engineering implementation construction organization, and carrying out the extraction of key elements through a key element extraction agent; the method comprises the steps that a directory structure is generated through a directory generation agent, and then a directory text generation agent calls related texts from a railway engineering knowledge base based on keywords in the directories to conduct text filling on all the directories in the directory structure. Related contents are extracted from a railway engineering knowledge base by calling a key element extraction agent, a directory generation agent and a directory text generation agent to perform directory generation and text filling of the railway engineering implementation construction organization, so that the compiling efficiency of the railway engineering implementation construction organization is improved; and the accuracy of semantic understanding of the large language model is relatively high, so that the accuracy of the content of the implementation construction organization of the railway engineering is ensured.
Owner:CHINA RAILWAY CLOUD NETWORK INFORMATION TECH CO LTD +2

Directory perception-based long document knowledge base construction method and program product

The invention discloses a long document knowledge base construction method based on directory perception and a program product, and belongs to the field of artificial intelligence and natural language processing. According to the scheme, an original long document is sequentially subjected to preprocessing, directory structure analysis, mixed blocking, double-tag generation, tag intelligent optimization, vectorization and meta-information mounting, and finally automatic construction and high-quality retrieval enhancement generation of a knowledge base are achieved. According to the method, the semantic integrity is guaranteed by fully utilizing the perceptual ability of the directory structure, the label quality and the retrieval efficiency are improved by combining a double-label system and intelligent optimization circulation, and the construction efficiency, the retrieval accuracy and the result traceability of the knowledge base are remarkably improved; the method is suitable for intelligent processing and application of long complex structure documents such as academic specialities, technical documents, policies and regulations and the like.
Owner:SOUTHEAST UNIV

Three-area three-line database automatic quality inspection evaluation method based on deep learning

The invention discloses a three-area three-line database automatic quality inspection evaluation method based on deep learning. The method comprises the following steps of S1, obtaining three-area three-line database data and performing preprocessing; s2, checking a directory structure and a file name of the original data set; s3, extracting spatial layer data from the hierarchical data set; s4, performing segmentation and attribute information extraction on various pattern spots in the layer data after spatial verification; s5, inputting the pattern spot relation characteristic data into an artificial fish swarm algorithm; s6, automatically comparing the pattern spot area and distribution data with a quality inspection standard preset in a three-area three-line database; and S7, performing parallel processing on an automatic comparison result through a multi-thread thread pool. According to the method, an artificial fish swarm algorithm, a relational attention network and a task allocation and thread pool management technology are combined, and three-area three-line database automatic quality inspection evaluation based on deep learning is realized.
Owner:HEILONGJIANG PROVINCIAL LAND & SPACE PLANNING RES INST

Validation of container images

A computing device receives a container image from a container registry, the container image comprising a plurality of layers. The computing device extracts, from the container image, a plurality of files into a filesystem of the computing device, each file of the plurality of files corresponding to one of the layers of the plurality of layers. The computing device generates a metadata file that describes a directory structure of the plurality of files in the filesystem. The computing device mounts the metadata file to a location in the filesystem, wherein mounting the metadata file causes a digest of the metadata file to be generated and the metadata file and the plurality of files in the filesystem to be read-only.
Owner:RED HAT INC

Data space data directory transmission control method based on digital contract

The invention discloses a data space data directory transmission control method based on a digital contract, and the method comprises the steps: carrying out the abstract processing of a data directory in a data space into a standardized metadata model, and forming a tree directory structure; in response to the data directory transmission request, generating a digital contract instance based on an intelligent contract engine, and performing block chain anchoring binding on a digital contract and a target data directory node; analyzing a control strategy set in the digital contract through a contract interpreter; executing at least one of the following control situations in real time in the data transmission process: directory visibility control based on timeliness constraint, directory access chain control based on data blood relationship, directory content desensitization control based on sensitivity level and directory routing control based on transmission path credibility; and after directory transmission is completed, triggering verification logic in the digital contract, comparing the integrity hash value and the authority change record of the data directory before and after transmission, generating a verifiable auditing report, and storing the verifiable auditing report in the distributed account book.
Owner:GAOSONG DIGITAL (XIAMEN) INTELLIGENT TECHNOLOGY CO LTD

Knowledge base document association search method and system based on knowledge graph and storage

The invention relates to a knowledge base document association search method and system based on a knowledge graph and storage, and the method comprises the steps: building association relationships between documents and between chapters and paragraphs in the documents by combining a directory tree of a knowledge base, chapter structures of the documents, internal directory structures of the documents, document labels and the like; and constructing a knowledge base network based on a knowledge base, and carrying out association search. Compared with a traditional search mode, the method has the advantages that the query intention of the user can be better understood, and the knowledge retrieval efficiency can be better improved.
Owner:DATAGRAND TECH INC

Software component analysis method oriented to C / C + + source code

The invention provides a software component analysis method oriented to C / C + + source codes, relates to the technical field of software component analysis, and provides a flexible and efficient data collection mechanism, comprehensively constructs a TPL feature library to improve the quality of the feature library, preliminarily filters non-specific TPL functions in combination with a directory structure, reduces noise interference and improves the software component analysis efficiency. The method comprises the following steps: firstly, classifying similar TPLs into the same family by using a clustering algorithm, sharing a certain number of common functions in each family, and meanwhile, including a unique marker function of each TPL, further analyzing a multiplexing relationship between the TPLs sharing the common functions, and removing the common functions which do not belong to a specific TPL range, thereby overcoming the defects related to the birth time of the functions; according to the method, the multiplexing proportion of the target code at the function level and the file level is further comprehensively analyzed, the TPL multiplexing situation of the code is accurately judged, the target code is divided into TPL modules, the dependency relationship between the modules is analyzed through include and extran statements, and therefore more accurate component recognition and dependency analysis are achieved.
Owner:NORTHEASTERN UNIV CHINA

Vocational college big data center platform architecture system, method and equipment

The invention relates to the technical field of data management, in particular to a vocational college big data center platform architecture system, method and equipment. The system comprises a data storage module used for obtaining to-be-integrated data and storing the to-be-integrated data to a tree directory structure to obtain stored hierarchical data, and each node in the tree directory structure corresponds to a directory; the data archiving module is used for acquiring to-be-archived data, comparing the to-be-archived data with the hierarchical data, determining a matched target directory of the to-be-archived data in the tree directory structure, and storing the to-be-archived data to the target directory; the data analysis module is used for analyzing the hierarchical data to obtain a data analysis result under each directory, and the data analysis result comprises a historical development condition and a future improvement direction; and the system management module is used for acquiring access data of the hierarchical data and dynamically adjusting the access authority of the hierarchical data based on the access data. According to the invention, the college data can be accurately and efficiently managed.
Owner:SHANXI HUAXING KERUAN CO LTD

Document retrieval enhancement method, device and equipment for large language model

The invention provides a document retrieval enhancement method, device and equipment for a large language model. The method comprises the steps that for each original text, the starting position of the original text serves as a starting point, a text segmentation symbol is searched for according to the text sequence of the text, text segmentation is conducted on the basis of a preset heuristic rule and a sliding window according to the starting point and the text segmentation symbol, and a plurality of text blocks meeting the text length range are obtained; obtaining all word sizes in the original text, and generating a document directory structure corresponding to the original text; storing the document directory structure corresponding to the original text and the vectorized text fragments of the corresponding text blocks into a vector database; recalling topK recalled text fragments most related to user input; and for each recalled text fragment, according to the corresponding document directory structure, obtaining a vectorized text fragment corresponding to the same level or higher level of the recalled text fragment, and obtaining a recalled long text meeting the length range of the recalled text.
Owner:BEIJING KEDONG ELECTRIC POWER CONTROL SYST CO LTD

Standardized electronic medical record shared document automatic generation method and system

The invention belongs to the technical field of medical information, and provides a standardized electronic medical record shared document automatic generation method and system, and the method comprises the steps: obtaining related specifications, constructing a document directory structure, and generating directory data; the method comprises the following steps: loading a pre-constructed standard data element dictionary and a local business system database structure, respectively analyzing the pre-constructed standard data element dictionary and the local business system database structure to obtain standard data elements and local fields, and establishing a mapping relationship between the standard data elements and the local fields through an intelligent matching algorithm to obtain a field mapping table; acquiring configuration information including node names, data types, whether the user must be filled or not and value ranges, and binding the configuration information with local fields to generate complete node configuration data; and generating a document template according to the node configuration data, generating a shared document file based on the basic information of the patient, the doctor-seeing record and the selected document template, and performing verification. According to the method, the full-process automation of the shared document from directory definition to content generation is realized, and the method has high efficiency, standard performance and intelligence.
Owner:DAREWAY SOFTWARE

Intelligent generation method and system of land disaster prevention and control report based on indoor and outdoor work integration

The invention relates to the technical field of ground disaster prevention and control report generation, in particular to an intelligent ground disaster prevention and control report generation method and system based on indoor and outdoor work integration. Retrieving geological information of the associated area, and determining the type of a hidden danger point; matching a target template; generating a target template directory structure; calling a workflow agent module according to a directory structure sequence to generate a first draft text; inserting chart data into the first draft text to obtain a complete report; and performing compliance examination and optimization on the complete report, and outputting a final report. The generation system comprises a data acquisition module, an intelligent retrieval engine, a template management unit, a workflow scheduling center and an examination optimization module. The data acquisition module, the intelligent retrieval engine, the template management unit, the workflow scheduling center and the review optimization module are connected in sequence and realize data transmission; synchronous real-time updating of indoor and outdoor data is met, data dispersion and information omission are avoided, and the generation efficiency and accuracy of a ground disaster prevention and control report are improved.
Owner:YUNNAN NON-FERROUS GEOLOGY NO 308 TEAM

Virtual file management method, system and equipment and storage medium

The embodiment of the invention discloses a virtual file management method, system and device and a storage medium. According to the technical scheme provided by the embodiment of the invention, under the condition that the file request is received, the virtual path contained in the file request is extracted, the virtual path is created when the target file is generated, path classification is performed according to the module identifier of the associated target service module, and the target file is stored in the system path mapped by the virtual path. The system path is generated by mapping based on the virtual path and a pre-constructed mapping rule; mapping the virtual path into a corresponding system path based on a mapping rule; and accessing the target file based on the system path to execute a file operation corresponding to the file request. By means of the technical means, the situation that file directory structures of different service modules are disordered can be avoided, unified file management of the different service modules in the application is achieved, the file management efficiency of the different service modules is improved, the application service effect is improved, and therefore the user experience is improved.
Owner:GUANGZHOU NETSTAR INFORMATION TECH CO LTD

Image mounting method, apparatus, device, and machine-readable storage medium

Disclosed are an image mounting method, apparatus, electronic device, and machine-readable storage medium. The method includes: traversing directory structure information of a target folder, generating descriptive information based on the directory structure information, traversing file data information of the target folder, generating a mapping table based on the file data information; generating, in the data cache area, image format information based on the descriptive information, and mapping file data of the target folder to image data based on the mapping table; mounting the target folder to be mounted in the specified image format based on image header information and the image data. With the present disclosure, based on the specified image format as well as the directory structure and file data of the target folder, the image format information and image data corresponding to the image format are generated and mapped.
Owner:NEW H3C TECH CO LTD

Theme skin changing method and system for automatically compiling LESS design variables into CSS design variables

The invention provides a theme skin changing method and system for automatically compiling an LESS design variable into a CSS design variable, and the method comprises the steps: 1, configuring a directory structure of an LESS file, and setting a variable recognition rule; 2, analyzing the content of the LESS file into an abstract syntax tree; 3, traversing the abstract syntax tree, and marking nodes meeting a variable recognition rule as design variable nodes; 4, calculating a final value of an LESS design variable represented by the design variable node, establishing a mapping relation table, and modifying the content of the design variable node to obtain a modified abstract syntax tree; 5, adding a global CSS variable statement to the modified abstract syntax tree to obtain the abstract syntax tree added with the global statement; and 6, converting the abstract syntax tree added with the global declaration into a CSS code, and outputting the CSS code. The method supports dynamic theme switching, can be seamlessly integrated into an existing Web development process, and can realize rapid and stable theme skin changing without modifying an existing LESS code.
Owner:SHANGHAI BAOSIGHT SOFTWARE CO LTD

Log file storage and reading method and device

The invention relates to a log file storage and reading method and device. The method comprises the following steps: acquiring daily operation data of a system to generate log data; combining the log data according to a preset format to generate a log file; storing the log file in a cache according to a preset directory structure; generating a log statistical information file, and storing an intraday memory statistical information file in the log statistical information file in a memory in real time; and when a preset condition is met, storing the log file in the cache into a hard disk so as to facilitate reading. According to the log file storage and reading method and device, an efficient log storage and reading mechanism suitable for an embedded system with limited resources is provided, hard disk writing is optimized through memory cache, rapid access of massive logs is achieved, hardware equipment is protected, and the real-time performance and reliability of data are ensured.
Owner:HANGZHOU DPTECH TECH

Method for single-thread operation automation in digital IC verification environment

The invention discloses a single-thread operation automation method in a digital IC verification environment. The method comprises the following steps: S1, establishing a directory structure; s2, setting an automatic script, and establishing a simulation environment to start simulation; s3, running the automatic script to read the three files, and starting to verify and compile; and S4, reading the compiled file and the simulation file, and carrying out anomaly detection. According to the method, when a plurality of verification platforms run on one server at the same time, the verification platforms are submitted to the server cluster by adopting the bsub command, so that resources of the server cluster are fully utilized, and the probability of jamming is reduced; meanwhile, the verification process is refined by utilizing various parameters of UVM printing priority, coverage rate and test cases, so that the accuracy and comprehensiveness of verification are improved; in addition, the operation process of verification personnel is reduced, and the automation degree of verification is improved.
Owner:JIANGSU HUACHUANG MICROSYSTEM CO LTD

Multi-system ai repository controller

Systems and methods are provided for creating a machine learning (ML) model staging repository, where ML models are stored as an open container image (OCI). The OCI comprises layers or portions of the complete ML model, so that the model can be stored separately and as a smaller files. The ML models may be pre-packaged for automated downloads and integration at the customer site. In some examples, the OCI can identify / store the model in a directory structure that defines the model and its profile. The OCI can comprise a combination of layers and profiles that allows the AI platform to optimize the storage and simplify the process of downloading or updating the given user namespace instead of downloading a single large file for the model.
Owner:HEWLETT PACKARD ENTERPRISE DEV LP

Large language model driven report generation agent method, system, equipment and medium

The invention discloses a report generation agent method, system and device driven by a large language model and a medium, and the method comprises the steps: constructing an agent execution framework independent of a native interface, outputting a decision through a cue word constraint model in a JSON structure, and scheduling a local tool function; analyzing the reference data and constructing a local vector knowledge base supporting semantic retrieval; the intelligent agent autonomously plans and generates a report directory structure based on a local vector knowledge base, stores the report directory structure as a structured intermediate file as a persistent intermediate representation, generates chapter content in parallel by utilizing a concurrent flow control and exponential backoff retry mechanism and combining a mixed retrieval strategy, and serializes and updates the chapter content to the intermediate file in real time; and finally, converting the intermediate file into a target format report according to a mapping rule. The system, the equipment and the medium are used for implementing the method. According to the method, the efficiency and the accuracy of complex report generation are remarkably improved through agent whole-process autonomous driving and combination of persistent intermediate representation, retrieval enhancement and concurrency control technologies.
Owner:XIDIAN UNIV

Seismic exploration project data online migration system, method, equipment and medium

The present invention belongs to the field of seismic exploration technology and discloses a system, method, device, and medium for online migration of seismic exploration project data. The system comprises a data file server and a seismic data migration client. The data file server is configured to respond to requests from the seismic data migration client for data directory structure information, database data, and disk file data, convert the data into corresponding byte streams, and transmit them to the seismic data migration client. The seismic data migration client is configured to receive the corresponding byte streams sent by the data file server and complete data migration for the seismic exploration project. The present invention is applicable to migrating data for seismic exploration projects and solves the problem of data non-interoperability and migration difficulties among multiple projects during seismic exploration.
Owner:BGP INC CHINA NAT PETROLEUM CORP +2

Picture resource identification method and related device

The invention discloses a picture resource identification method and a related device, and relates to the technical field of picture identification, and the method comprises the following steps: responding to a picture resource identification trigger instruction, and identifying a picture resource from a resource file name under a directory structure of an iOS project; screening out all first picture resource file names meeting a preset picture resource file extension name requirement to obtain a first array, determining second picture resource file names having a reference relationship with the code files from the code files under the directory structure of the iOS project to obtain a second array, and comparing the first array with the second array to obtain a first picture resource file name and a second picture resource file name; and searching the target picture resource file names which exist in the first array and do not exist in the second array, and determining the picture resources corresponding to all the target picture resource file names as the identified useless picture resources. According to the method and the device, the useless picture resources in the iOS project are automatically identified, the consumed time is short, the efficiency is high, and the useless picture resources can be accurately identified.
Owner:FLYING FOX INFORMATION TECH TIANJIN CO LTD

Incremental upgrade package construction method and device, electronic equipment and storage medium

The invention discloses a construction method and device of an incremental upgrade patch, electronic equipment and a storage medium, and relates to the technical field of computers, a file list and a change type are extracted from a code submission record, difference comparison is performed on files of an original version and a target version based on the information to generate code difference data, and the code difference data are sent to a server; therefore, the problem that the upgrade package contains a large number of redundant codes or key change contents are omitted and the upgrade accuracy and reliability are affected due to the fact that only a file name or a directory structure is used as a change judgment basis in an existing incremental upgrade method can be solved; the technical effects of improving the accuracy and reliability of incremental upgrading and reducing upgrading package redundancy are achieved.
Owner:JINAN INSPUR DATA TECH CO LTD

File transmission method, system and device based on wireless module communication and medium

The invention provides a file transmission method, system and device based on wireless module communication and a medium, and belongs to the technical field of file transmission, and the method specifically comprises the steps that a handheld terminal broadcasts a device searching instruction after being started, and a nearby host end is searched; after receiving an equipment searching instruction of the handheld terminal, the host end returns related information; the handheld terminal lists all connectable devices for a user to select, and after the user selects a target host end, the handheld terminal requests a file list from the target host end; the host end returns a directory structure or a filename list of the host end to the handheld terminal, and a file transmission stage is entered; after receiving the file transmission request, the host side sends selected file fragments; and the handheld terminal stores the file after receiving the file. The system effectively overcomes the defects of traditional wired transmission and wireless transmission in the aspects of operation complexity, equipment pairing efficiency, transmission reliability and the like, and is suitable for industrial or commercial scene interaction requirements of queuing machines, handheld terminals and the like.
Owner:INSPUR FINANCIAL INFORMATION TECHNOLOGY CO LTD

Database pre-synchronization implementation method and device, equipment, medium and product

The invention relates to the technical field of databases, and discloses a database pre-synchronization implementation method and device, equipment, a medium and a product. The method comprises the steps of obtaining synchronization task configuration after a pre-synchronization process is started, and obtaining metadata corresponding to each to-be-synchronized table according to the synchronization task configuration; generating a file path corresponding to each to-be-synchronized table according to the metadata and a preset directory structure rule, and performing directional reading according to the file path to obtain a global event data file corresponding to each to-be-synchronized table; and according to the global event data file, obtaining a system change number corresponding to each to-be-synchronized table to complete database pre-synchronization. The accurate path positioning based on the metadata is adopted to replace full disk traversal, so that the disk input / output performance bottleneck can be avoided, the pre-synchronization efficiency can be improved, the pre-synchronization time consumption can be remarkably reduced, the normal operation of a database cluster can be prevented from being interfered, and the system stability can be improved.
Owner:TIANJIN NANKAI UNIV GENERAL DATA TECH

Server cluster monitoring data processing method and device and medium

The invention discloses a server cluster monitoring data processing method and device and a medium, and the method comprises the steps: scanning a target directory structure to analyze a directory name, and dynamically recognizing a server node address based on a predefined rule to generate server node list data; executing the data acquisition script on each server node to obtain original monitoring index data, and converting the original monitoring index data into a standardized monitoring data file; based on the historical processing record data and the characteristic value of the monitoring data file, whether the monitoring data file is a to-be-transmitted incremental file is judged through an incremental recognition algorithm, and if yes, the incremental file is transmitted to a central processing node based on a pre-constructed secure connection channel to execute transmission integrity verification, and transmission state data is generated; and performing standardization processing on the transmission state data, importing the processed to-be-imported data file into a target database, and comparing the number of records before and after importing to generate a data integrity report.
Owner:浪潮(山东)农业互联网有限公司 +1