1050 results about "Directory" patented technology

The invention provides a data weaving platform-oriented self-service data preparation method, which comprises the following steps of: accessing original data and associated structured metadata of a target data source into a data weaving platform to generate standardized accessed original data and associated structured metadata; based on a semantic model of the data weaving platform, performing classified semantic annotation on the associated structured metadata, and positioning a transfer node of the associated structured metadata to generate a data blood relationship record; performing bidirectional quality verification on the data consanguinity record according to semantics and path continuity, and matching with a federated governance rule of a data weaving platform to generate a metadata governance list; and generating a unified metadata directory based on the metadata governance list, so that a user of the data knitting platform can obtain key segments containing complete data consanguinity records. According to the method, the problem of insufficient accuracy and efficiency in self-service data preparation can be effectively relieved, and the efficient preparation requirement of a data weaving platform for multi-source data is met.

The invention discloses a method and device for automatically generating a Java method unit test case based on AI, and the method comprises the steps: building a structured annotation specification, carrying out the automatic traversal and intelligent analysis of a Java project, extracting a method signature, a parameter type and a parameter constraint condition, constructing a test data generation model, and carrying out the automatic generation of the test case. The model is transmitted to an AI service to analyze business logic and boundary conditions, test case codes are generated, test cases are optimized and integrated to a project test directory, finally, code areas with insufficient coverage are identified through coverage rate analysis, a test completion strategy is generated, and iterative perfection of the test cases is completed. The technical problems that in the prior art, project-level automatic test case generation cannot be achieved, the generated test case cannot fully cover business logic and boundary conditions, and context relation understanding is lacked are solved, full-automatic project-level test generation is achieved, and the test efficiency and quality are improved.

The invention discloses a row-level data recovery method and device for a damaged file of a GoldenDB database, and the method comprises the following steps: S1, scanning a to-be-recovered GoldenDB data file, and recognizing and caching all data pages; s2, on the basis of metadata of the data pages, cluster index leaf node pages containing user data are screened out from the cached data pages; s3, for each screened leaf node page, analyzing an internal record organization structure of the leaf node page, and performing row-level data recovery; the row-level data recovery comprises the steps of traversing user records according to a virtual record pointer, and performing cross check and recovery on a traversal path in combination with a page directory slot so as to extract and mark the user records one by one; and S4, outputting all the recovered row-level data.

The invention discloses a Linux container-based Android and open source gap dual-system collaborative operation method, relates to the technical field of operation system collaboration, and aims to reduce resource occupation and improve collaboration and switching coherence, and the method comprises the following steps: step 1, by taking an Android as a host, creating a container isolation running domain, starting a namespace and managing resources by a control group; the method comprises the following steps: presetting a binder virtualization and three-state template; 2, deploying an open source gap in a container, mounting a shared directory in a directory binding manner, configuring bridging or address translation, and establishing copy-on-write and snapshot identifiers; and step 3, establishing a cross-system binder channel, and setting a service registration agent in a service manager and completing mapping of a handle and an authority domain by combining a shared memory and a local socket. And step 4, executing system switching without restarting, enabling one foreground and the other background through a foreground interface and continuous quota assignment, freezing a background session, limiting the speed of background heartbeat, and returning according to a snapshot when an exception occurs.

The invention relates to the technical field of hard disks, in particular to a data protection method of a solid state disk and the solid state disk, the method comprises the steps that a flash memory medium is divided into a data block area, a log block area and a metadata area, and the metadata area comprises a mapping directory, a mapping block and a check point block; a block mapping table and a log page mapping table are established in a volatile memory, and dbMSN and lbMSN are stored. Adding write-in data to a log block page, updating a log page mapping table, and generating check points according to full writing of a log area. When no free page exists, the damaged log blocks are selected in a rotating mode to be combined, new data block migration pages are distributed, mapping is updated, the MSN is progressively increased, changes are written into the mapping blocks, and the mapping catalogue is updated when the mapping blocks are addressed. After restarting, positioning a mapping block by a mapping directory to recover block mapping, reading check points in a reverse order, and traversing an uncovered log area to reconstruct log page mapping; and comparing the dbMSN with the lbMSN, setting inconsistent log pages to be invalid, establishing consistent access and shielding invalid pages. According to the method and the device, the problems of data consistency and availability caused by metadata loss, uncertain merging state and low recovery efficiency of the hybrid mapping FTL in a crash scene can be solved.

The invention discloses a cache maintenance system of a heterogeneous computing system and electronic equipment, and relates to the technical field of data processing, a first directory controller manages the consistency state of a host end, and a second directory controller manages the consistency state of an equipment end. The consistency maintenance operation is firstly efficiently processed by the corresponding directory controller in the storage domain, cross-device frequent coordination communication is reduced, and when cross-domain data access occurs, the two directory controllers cooperate through an established communication coupling mechanism and execute global consistency maintenance as required. The method not only can adapt to a high-burst and high-parallel access mode of a device end, but also can avoid direct conflicts with a cache management mechanism of a host end, and realizes global consistency through distributed collaboration. The technical problem of performance bottleneck of cache consistency in the heterogeneous system is solved, and the technical effect that the overall data access efficiency of the heterogeneous system is improved while the correctness is maintained is achieved.

A change tracking and delta generation (CTDG) system servicing multiple clients is disclosed for enabling the delta generation during replication to be proportional to the number of changes between two snapshots instead of the size of the snapshots. In some embodiments, CTDG can track changes to a file system, where change-tracking can be dynamically switched between two sub-CT modes, file level or directory level. Change-tracking (CT) keys may be generated accordingly and stored in a data structure to be used for delta generation during replications for clients. In some embodiments, change-tracking may be enabled or disabled for different clients. CTDG can coordinate the CT enablement / disablement to ensure replications can use the information in CT keys properly.

Performing charge / showback operations in a large-scale data system by scanning multiple data sources to identify data objects for processing as a unitary group with respect to common characteristics that have an impact on finances within the system. Metadata of the identified data objects are stored in a dynamic dataset that defines a single data access unit for the referenced data objects. The system processes a user query regarding cost allocations, cost forecasts, and resource usage of respective groups within an organization. The query initiates a charge-back or show-back operation that allocates costs associated with each respective usage of resources by a department or cost center, and accesses the referenced data objects through the dataset as a single unit based on data content rather than data location in a file directory of the system.

The invention discloses an IO optimization method and device based on distributed storage, equipment and a storage medium, and relates to the technical field of distributed storage. Comprising the following steps: constructing a distributed metadata index layer between a client and a metadata server, and maintaining a dynamic mapping relationship between a path prefix and the metadata server, so that when the client initiates a file access request, a target metadata server can be directly positioned based on the mapping relationship; and whether the request is routed to the temporary metadata server for load balancing or not is dynamically determined according to the real-time load information of the temporary metadata server. Therefore, the problems of metadata request amplification caused by step-by-step analysis of a tree directory and non-uniform load of a metadata server caused by static directory binding in related technologies are solved; the technical effects that the metadata interaction delay is remarkably reduced, the throughput of the system in massive small file and burst IO scenes is improved, and a single metadata server is prevented from becoming a performance bottleneck are achieved.

The invention relates to the technical field of meteorological and ocean numerical forecasting, and aims to solve the problems of strong manual dependence, poor timeliness, high error risk and low resource utilization rate in coupling operation of a WRF atmosphere model and an ROMS ocean model. The method comprises the following steps of: storing an initial file into a date catalogue which is dynamically generated according to a YYYMMDD format after the initial file is subjected to integrity verification; the timed task checks nc.lock / nc.tone files every X minutes, a lock starting model is created when no lock exists and an initial file exists, and an ROMS needs to confirm nc.tone of a WRF result directory first; automatic exception processing is carried out when the model is overtime, and after completion of the automatic exception processing, a Done is created, a lock is deleted, resources are released, and computational nodes are dynamically allocated. According to the method, automatic scheduling is achieved through double-file marking, manual operation is shortened to be within one minute, model connection delay is shortened to be within five minutes, the failure rate is reduced, the resource utilization rate is improved, and a reliable scheme is provided for model business operation.

The invention relates to the technical field of distributed computing, in particular to a multivariate computing power intelligent scheduling management method and system. The multivariate computing power intelligent scheduling management method comprises the following steps: collecting original performance indexes of hardware, and uniformly abstracting the original performance indexes into a computing unit CU; maintaining a real-time directory of global resources, and realizing second-level weak consistent synchronization of resource views among the nodes; dynamically calculating a node health degree score; matching the task service labels with the static labels and the dynamic labels of the nodes to generate a candidate resource node set, and scheduling priority weights; calculating a comprehensive score of each candidate node, and performing redundant task deployment; and predicting a resource demand, and performing judgment by applying a scaling decision tree to realize resource allocation and scaling. According to the multivariate computing power intelligent scheduling management method and system, unified abstraction and management of heterogeneous computing power are realized, the intelligence and precision of resource scheduling decision are improved, the elastic expansion and fault-tolerant capability of the system is enhanced, and the maximization of the global resource utilization rate and energy efficiency is realized.

The invention discloses an intelligent computer archive classifying and filing method. The method relates to the technical field of archive digital management, and comprises the following steps: step 1, acquiring an image of an archive to be archived, and preprocessing the image of the archive; 2, identifying the preprocessed archive image based on OCR image identification software to obtain an initial identification result of archive characters; 3, constructing a semantic analysis model, carrying out semantic analysis on the file character initial recognition result, and outputting a high-precision character recognition result, and 4, based on the high-precision character recognition result, searching a preset target identification character, and carrying out matching classification; step 5, generating hierarchical directory information based on a matching classification result; and step 6, completing archiving storage in combination with a matching classification result and directory information. According to the method, character context semantic association and global sequence logic can be effectively captured, file semantic accurate analysis is realized, and low-confidence character and terminology errors in OCR initial recognition are greatly corrected.

The invention relates to a distributed file system recycle bin performance optimization method, which comprises the following steps: in the execution process of an unlink interface of a Linux file system, sequentially completing recycle bin function starting judgment, file deletability verification and recycle bin storage suitability judgment, and obtaining metadata of a target deleted file parent directory from a server; when a file system is created, a global unified root recycle bin directory is synchronously generated, and when a file is deleted, a corresponding recycle bin subdirectory is created in a target MDS based on a parent directory inode number; an atomic operation is executed through a Linux standard rename interface, the file is moved to a corresponding recycle bin subdirectory, and the operation is limited to the interior of a single MDS; when the file is recovered, extracting an inode number of a parent directory, and iteratively querying metadata to restore an original complete path; and during batch recovery, if the original catalogue does not exist or needs to be recovered to a new catalogue, directly and integrally moving the catalogue corresponding to the recycle bin, otherwise, executing recovery operation one by one. The file deletion and recovery performance is remarkably improved, the resource overhead is reduced, and the data consistency is guaranteed.

The invention relates to the technical field of database structures, in particular to a semi-cut mountain modeling database construction method and system based on multi-dimensional parameters, and the method comprises the following steps: extracting slope elevation and cutting angle fields, arranging the sequence of related fields and unifying formats, calculating a text relationship and generating numbers, dividing blocks, and writing the blocks into a structural text. And forming a database structure construction atlas. According to the method, a regularized field cluster is formed by constructing a field value set and a structure sequence, a field jump path is established, the sequence direction is identified, clear expression of a field combination mode and continuing logic is achieved, content blocks are divided in combination with node information, the pairing relation is adjusted, and a unified format is set to enhance field normalization; the method comprises the following steps: binding elevation and strength sections through attribute injection, completing classified undertaking and structure reconstruction of text records, realizing field system output in cooperation with directory naming and path registration, enhancing the ordered organization and linkage ability among fields, and improving the expression efficiency and expansion adaptability of structure construction.

The invention provides a file data migration method and device, equipment, a storage medium and a program. The method comprises the following steps: receiving object storage access information, wherein the object storage access information is used for requesting migration of target file data; according to the object storage access information, constructing mapping information between a file local directory of the file storage system and an object storage bucket of an object storage cluster; according to the file path under the local directory of the file, generating a target object identifier in the object storage cluster, the target object identifier being generated by converting a hierarchical structure of the file path; and migrating the target file data from the file storage system to an object storage cluster based on the mapping information and the target object identifier. According to the method, the file storage flexibility can be improved.

The invention discloses a debugging environment building method and device based on local development and a storage medium, and the method comprises the steps: building a debugging tool directory at a preset storage position independent of a project project according to a debugging environment building demand of the project project; newly establishing a soft link between the catalog of the project project and the debugging tool catalog, and virtually integrating the debugging tool catalog to a path of the project project through the soft link; in response to a starting operation of the project engineering, loading a debugging code of the debugging tool directory through the soft link; and executing the debugging code so as to modify the project operation configuration data of the project project to realize the debugging of the project project. According to the method, the independent debugging catalog is established, soft link integration is utilized, the debugging codes are automatically loaded and executed to modify running configuration when the project is started, and the technical effects of efficient construction, flexible debugging and mistaken submission prevention of the debugging environment are achieved.

The present application provides a system and a method for detecting an Apache HTTP Server path traversal vulnerability. The method comprises: inputting a target IP address list into a scanning module, and probing the network reachability of each IP address in the target IP address list; if there is a network-reachable IP address, probing all ports of the IP address, and recording open port numbers; identifying services running on the open ports and performing service classification; if a service is classified as an Apache service, initiating a Curl request command to an icons directory path of the Apache service; if the Curl request succeeds and an / etc / passwd file is read, parsing the / etc / passwd file and extracting users of a host under test; performing detection on the users of the host to obtain an Apache HTTP Server path traversal vulnerability; and generating a detection report for the host on the basis of the Apache HTTP Server path traversal vulnerability.

The invention relates to a container design technology of embedded gateway equipment, discloses a gateway-based multi-container stacking method, and solves the problems of high repeated space occupation and long container creation time when multiple containers are created by adopting a traditional LXC technology in gateway equipment. According to the scheme, the method comprises the steps that S1, a base container file system mirror image is manufactured, specifically, a minimum LXC container suitable for gateway equipment is created, a rootfs catalogue of the container is extracted and packaged, and a squashfs read-only file system format is adopted to construct the base container mirror image; s2, integration and mounting of a base container file system: splitting a framework partition from an existing partition of gateway equipment firmware, and writing a base container mirror image into a specified offset address of the partition; after the gateway system is started, mounting the framework partition to a preset directory, so that the rootfs directory of the base container can be accessed; and S3, creating an application container based on a stacking technology: starting an OverlayFS function of a Linux kernel of the gateway, rewriting container creation logic of the LXC, and configuring a hierarchical storage path of the OverlayFS when the application container is created.

The invention provides a heterogeneous database query method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out security verification processing on a plurality of SQL execution requests sent by a user side, and carrying out SPI mechanism scanning processing on a plurality of database plug-ins in a heterogeneous database plug-in directory based on a high-performance database connection pool after the security verification processing is passed, determining a target database plug-in package corresponding to each SQL execution request; and performing metadata query processing on the SQL execution request in the target data source based on a database operation client interface and a metadata service interface under the target database plug-in package, and determining a structured tree result. According to the method, an extensible and dynamically integrated heterogeneous database plug-in mechanism is realized, unified access of various databases is supported, the platform maintenance cost is remarkably reduced, hierarchical metadata of any type of databases is obtained through a consistent metadata service interface, and the user experience and the cross-database query efficiency are improved.

Techniques are described through which groups of individuals and / or other entities may interface with a data cloud blockchain network and / or cloud-based platform to collectively share data in a secure, controlled manner. Decentralized groups that are connected to the data cloud network may be registered and listed in a searchable directory. Entities that are interested in accessing data associated with a group may browse the directory, execute smart contracts within a blockchain, and track online content interactions of a group in a manner that does not compromise the anonymity of individual group members. Data usage and performance metrics may be tracked on the blockchain network using data cloud services, and the metrics may be written to distributed ledgers within the blockchain network. Smart contracts and chaincode within the network may initiate blockchain transactions based on performance metrics and / or other aspects associated with accessing information about a group.

The invention relates to the technical field of virtualization frameworks, in particular to a data persistence storage method and electronic equipment. The data persistence storage method is applied to an Android system, and comprises the following steps: starting a client application in the Android system, and creating a mapping file under an application sandbox directory of the client application; the method comprises the following steps: reading a system image in which a MicroAndroid is stored through a client application; adding the mapping file to the system mapping, and setting a block device corresponding to the mapping file; the method comprises the following steps: starting a virtual machine in an Android system, and loading a system image in the virtual machine to start MicroAndroid; the method comprises the following steps of: reading a preset key on the MicroAndroid, and performing encryption processing on block equipment by using the preset key to obtain encrypted block equipment; and on the MicroAndroid, based on the encryption block device and a preset key, creating a decryption block device, and mounting the decryption block device to the target directory. According to the method, when the virtual machine code is updated, the data stored in the mapping file is not influenced and can be persistently stored, and meanwhile, the data read-write security is ensured.

The invention discloses an Internet of Things cross-domain trusted data sharing method based on a block chain. The method comprises the following steps: registering a providing domain and a using domain, and verifying the identity of a main body and the identity of equipment; only the data fingerprint, the time stamp, the unified identifier and the directory index are written into an alliance chain; an authorization contract is deployed on the chain, an improved GraphRAG strategy channel is started, a directory index is retrieved, and clause sub-graphs are aligned; submitting a request containing a unified identifier and a directory index by using a domain, matching through a decision channel, automatically deciding by a contract, and generating a one-time token or recording a rejection reason hash; performing off-chain encryption transmission according to the token, checking integrity and freshness according to the on-chain fingerprint and the time mark, and uploading a result; settlement and reconciliation are completed based on chain metering, and arbitration tracing is carried out when dispute occurs. According to the method, high-credibility sharing of no domain leaving, automatic compliance, and end-to-end verifiable and auditable settlement of the original text is realized.

The invention provides an auxiliary filing method based on offshore wind power data, which depends on a digital filing auxiliary platform of a B / S (Browser / Server) architecture, and realizes structured storage of offshore wind power industry specifications and associated logic by constructing a dual-core knowledge base; adopting metadata capture to complete batch processing of multi-format documents; through intelligent identification and classification, automatic paper composition and association relation solidification, an archiving catalog and a unique archive number which accord with industry specifications are generated; and automatically generating multi-dimensional indexes such as technical process, equipment full life cycle, hierarchical classification and the like, and finally outputting a standardized data packet imported by an adaptive offline archiving and digital system in combination with a man-machine interaction verification optimization result. According to the method, the archiving efficiency and normalization are greatly improved, accurate retrieval of data is realized, dependence on professional experience is reduced, and meanwhile, high-quality data support is provided for digital delivery and intelligent operation and maintenance of offshore wind power projects.

The invention provides a metadata federation management system and method under a unified namespace. The system comprises a data storage unit, a data directory unit, a metadata federation unit and a data gateway unit. The data storage unit comprises a plurality of heterogeneous storage systems, and the types of the heterogeneous storage systems are different. The data directory unit is used for managing business metadata of each heterogeneous storage system; the business metadata is used for describing the data content, the data source and the data association relationship. The metadata federation unit is used for managing technical metadata of each heterogeneous storage system, and the technical metadata is used for describing logic-to-physical mapping information, access protocol and endpoint information and authentication and authorization information of data. The data gateway unit is used for providing protocol conversion and is responsible for data routing to read and cache data. Through unified management of the metadata by the metadata federation unit, the problem of data islands in a heterogeneous storage environment can be avoided.

The invention discloses a document processing method and a related device, and relates to the technical field of data processing. Comprising the following steps: analyzing an original document to obtain a text sequence corresponding to the original document; processing the text sequence through a large language model to generate a directory list corresponding to the text sequence; segmenting the text sequence to obtain a plurality of text blocks; based on the plurality of text blocks, a preset fusion rule and a large language model, determining a plurality of target semantic text segments and titles, starting point positions and ending point positions of the target semantic text segments; constructing a hierarchical knowledge structure based on the target list, the plurality of target semantic text segments, and titles, starting point positions and ending point positions of the target semantic text segments; the hierarchical knowledge structure has the characteristics of structuralization, traceability and semantic coherence, and the knowledge retrieval accuracy and efficiency can be improved by storing the hierarchical knowledge structure into a knowledge base.

The invention discloses a self-adaptive file monitoring and data processing method and system based on a multi-process architecture. According to the method, a plurality of working processes are created through a process manager to monitor a specified directory in parallel; an environment detection algorithm is adopted to dynamically select a real-time monitoring or polling mode, and strategy switching and abnormal degradation during operation are supported; realizing incremental file identification and duplicate removal processing based on an MD5 file fingerprint technology; file analysis, data cleaning, quality verification and batch storage are completed through a modular data cleaning assembly line; and the process manager continuously monitors the health state of each working process and automatically restarts the abnormal process. Uniform configuration management is realized, and multi-environment deployment and hot update are supported. According to the method, the problems of single-process performance bottleneck, poor monitoring strategy adaptability, imperfect process management, insufficient increment processing capability and the like are effectively solved, multi-core CPU resources are fully utilized, and the efficiency, reliability and environmental adaptability of large-scale file monitoring and processing are remarkably improved.

The invention discloses a document processing method and related equipment, and belongs to the technical field of data processing.The method comprises the steps that in response to a document input instruction, a to-be-processed target document is obtained; performing structure analysis on a to-be-processed target document to generate a directory tree of the target document; calling a dynamic recursive slicing algorithm, traversing and analyzing the directory tree of the target document, and generating a plurality of text slices with dynamic lengths; and vectorizing the plurality of text slices with the dynamic lengths, and uploading and storing the vectorized text slices to a database of a retrieval enhancement generation system. By constructing the directory tree and traversing the directory tree by adopting the dynamic recursive slicing algorithm, the document structure can be more accurately understood, the semantic integrity of the document slices is improved, and the retrieval accuracy and the answer generation quality of the retrieval enhancement generation system are further effectively improved.

A safe and environmentally friendly data management system and method are disclosed, relating to the field of big data governance. The system includes: a server node; a front-end interactive interface, including access points and business directories for multiple ledger modules; a back-end storage architecture, including ledger documents and storage directories; a dynamic indexing engine for establishing a mapping relationship between the front-end interactive interface and the back-end storage architecture; and a heterogeneous integration unit for embedding internal hyperlinks and external URLs pointing to the regulatory platform within the ledger modules. By adopting this solution, multi-format independent ledger units are integrated flatly on the main interface, allowing direct navigation with a click, conforming to the habits of paper-based browsing. It is adaptable to multiple terminals, supports low-threshold deployment and smooth upgrades, and combines compliance management, intelligent retrieval, and cross-departmental collaboration functions. It overcomes the shortcomings of traditional compliance systems, such as cumbersome processes and inefficiency, enabling low-cost implementation, improving data management efficiency and compliance risk control levels, and adapting to the needs of enterprises of different sizes.

The invention discloses a full-life-cycle data asset processing method, which belongs to the technical field of data asset management, and comprises the following steps: collecting multi-source data and standardizing the multi-source data into data assets; cleaning and desensitizing the data assets, generating a unique identifier and signing to obtain a credible data object; verifying the legality of the data source, and judging the ownership, the use right and the processing right in combination with contracts and authorization rules; generating a data fingerprint and writing the data fingerprint into a block chain storage certificate; performing quality scoring, and constructing a data asset directory; and screening asset objects, submitting the screened asset objects to a financial service platform for application, and generating an estimation report, thereby solving the technical problem of improving the security and management efficiency of the data assets through data standardization and credible evidence storage, remarkably improving the normalization and manageability of the data assets, effectively improving the security and credibility of the data assets, and improving the management efficiency of the data assets. The whole process from generation to application of data assets is in a controllable and traceable state, and data is promoted to be converted from a resource form to an asset form.

This invention relates to the field of automated file transfer processing technology, and discloses an automated SFTP task processing method, apparatus, and computer-readable storage medium. The method includes: acquiring directory change data and objectifying the directory change data to generate candidate file objects and determine file objects to be preprocessed; preprocessing the file objects to be preprocessed based on file feature data and preprocessing rule data corresponding to the file objects to be preprocessed, to generate preprocessing result objects; generating structured transfer tasks based on the preprocessing result objects, and determining group keys based on the target SFTP server IP and target directory, grouping structured transfer tasks with the same group key into the same group of tasks; establishing a group-level execution context based on the group tasks, and executing the structured transfer tasks within the group in the group-level execution context to obtain task execution results; and updating the task status and / or generating result records of the structured transfer tasks based on the task execution results.