870results about "File system functions" patented technology

The invention relates to the technical field of intelligent manufacturing, discloses a papermaking equipment fault tracing method and system based on a process knowledge graph, and discloses the papermaking equipment fault tracing method and system based on the process knowledge graph. The method and the system comprise data acquisition and preprocessing, papermaking process knowledge graph construction, fault event detection and matching, fault tracing and propagation path reasoning, and maintenance scheme recommendation and optimization. The method overcomes the limitation that the traditional method is difficult to capture the cross-equipment, cross-process and cross-time sequence deep causal association and fault propagation path of the papermaking equipment. By constructing a comprehensive papermaking process knowledge graph, equipment operation state data, process parameter data, production quality data, equipment structure principle, process flow knowledge, fault mode knowledge, maintenance experience and other heterogeneous knowledge are subjected to deep fusion and semantic association, so that the system can exceed the correlation of the data surface; and an internal mechanism and a propagation chain of the fault are deeply excavated.

The invention discloses a log template post-processing method and system based on semantic screening and similarity clustering. The method comprises the steps that log information is input into LLM to generate a log template; inputting the new log template and the cache log template into a semantic model, and respectively generating semantic embedding vectors; calculating a similarity distance between the new log template and the cache log template, and screening to obtain a candidate template; according to the generation confidence score, calculating the weighted structure similarity between the new log template and each candidate template, and clustering and combining the candidate templates exceeding a threshold value to generate a final template; and updating and replacing the final template into the cache structure. According to the technical scheme, the semantic similar templates can be recognized and combined more reasonably, efficiently and accurately, a semantic enhanced, controllable and stable template post-processing mechanism can be constructed on the premise that LLM calling burden is not increased, and automatic cache cleaning, template number control and structural consistency maintenance are achieved.

The invention discloses an unstructured storage hierarchical strategy optimization method based on machine learning, and relates to the technical field of data storage management, and the method comprises the steps: monitoring a file access event in real time, generating an access log, and extracting a multi-dimensional feature data set; utilizing the trained multi-dimensional decision tree model to distribute a corresponding storage hierarchy for the storage object to obtain a storage hierarchy decision; according to a storage level decision, distributing the storage objects to different storage layers, and carrying out resource configuration and storage operation; monitoring the access condition of the storage object in the new storage hierarchy in real time, and collecting file access performance, storage cost and response time to obtain feedback data; by monitoring the file access event in real time and extracting the multi-dimensional feature data set containing the basic attribute, the access behavior and the context information, efficient response of hotspot data and reasonable utilization of resources are ensured, and the overall performance utilization rate and the cost effectiveness of storage are remarkably improved.

The invention discloses a one-time plot rule mining method and device for a process event log, and belongs to the field of plot mining. The distance between two events is limited by adopting a time interval constraint, and repeated use of the events is avoided by adopting a one-time condition so as to avoid mining excessive meaningless plots. Moreover, when a strong one-time plot rule (i.e., a one-time plot rule with confidence greater than or equal to a minimum confidence threshold) is mined, a triple mechanism of candidate plot generation, support degree calculation and rule generation is provided. In a candidate plot generation stage, eliminating redundant candidate plot extension by adopting a plot connection strategy; in the support degree calculation stage, the support degree is calculated based on the position index; in a rule generation stage, firstly, all frequent one-time plots are mined, and then strong one-time plot rules are screened according to a minimum support degree threshold value and a minimum confidence coefficient threshold value. The technical effect of efficiently and accurately mining the strong one-time plot rule is achieved.

The invention discloses a file integrity monitoring method, electronic equipment and a storage medium. The method comprises the steps of sending a verification request to a scheduling node through a user node when a file integrity verification condition is triggered; determining an edge node group through the scheduling node according to the edge node load condition, and distributing an audit task corresponding to the verification request to each edge node in the edge node group; searching corresponding integrity evidence according to the auditing task through the edge node, and sending the integrity evidence to the scheduling node; consistency verification is carried out through the scheduling node according to the integrity evidence fed back by each edge node, and if the consistency verification is passed, the integrity evidence is sent to the user node; and performing local verification through the user node according to the integrity evidence, and determining a corresponding file verification result. By means of the method, the safety, traceability and credibility of file integrity monitoring in the domestic terminal environment are effectively improved, resource occupation is low, and compatibility is high.

The invention discloses a database traffic auditing method, device and equipment and a storage medium, and relates to the field of databases, and the method comprises the following steps: deploying a target extension program in a kernel layer of an operating system, and capturing a target data packet by using a target probe in the target extension program; performing protocol analysis on the target data packet to extract target data, determining execution time of a target SQL statement based on the target data, and performing semantic analysis on the target SQL statement by using a target analyzer and a way of performing analysis based on syntax imported based on a bypass to obtain a corresponding semantic analysis result; the target data comprises a target SQL statement and target metadata; and storing the target data, the execution time and the semantic analysis result to a target log database, so as to audit the flow of the target database based on the data in the target log database by using a pre-configured target audit strategy. According to the method and the device, efficient, safe and real-time auditing of database traffic is realized.

The invention discloses an intelligent medical big data information management system, and the system comprises a data collection layer which serves as a sensing neural network, employs an Internet of Things gateway to be compatible with a medical equipment protocol, and deploys an edge calculation node for physiological signal preprocessing; the intelligent preprocessing layer is used for cleaning and standardizing the original data transmitted by the data acquisition layer; the informatization service layer is used for realizing fine-grained authority control based on an RBAC (Role Based Access Control) model, realizing inspection process automation by integrating an LIS (Line Information System) interface through a Hyperdger Fabric block chain evidence storage key operation hash, and constructing a zero-footprint DICOM (Digital Imaging and Communications in Medicine) viewer; the intelligent analysis layer is used for carrying out data life cycle management by adopting a mixed storage architecture, carrying out feature engineering on data, carrying out label matching and classified storage by using efficient neighbor search and similarity / distance measurement, quantifying contribution of each feature or feature combination to a single prediction result through an SHAP value, generating an interpretation result, and outputting the interpretation result; and presenting an interpretation result to a clinician or related personnel through a query interface.

The invention relates to the technical field of system application, and discloses an online document processing method and system based on structured storage, and the method comprises the steps: splitting content elements of an online document into blocks, and carrying out structured storage as independent objects; querying basic information of the document, loading data according to a document block pageBlockId list, creating a component according to the loaded data, constructing a component tree, and performing document rendering by using a lazy loading technology; the method comprises the following steps: abstracting documents and document blocks as objects, synchronizing the objects to a graphic database, modeling a relationship between the documents and the document blocks as an edge in the graphic database, and converting the relationship between the documents into a graphic data structure; when the document content changes, the storage interface is called to store the changed document block, and the online document is automatically stored, the document content is structurally stored in the block form, dynamic updating of the online document is achieved, the reference relation between the documents is stored and managed, and the relation between the documents is visually and clearly displayed.

The invention discloses a distributed file management system and method, and belongs to the technical field of computer software, the system adopts a tree hierarchical structure to organize files, and the system comprises an application layer used for receiving file operation requests from a plurality of independent clients, and each request carries a unique application identifier; the file system layer comprises a configuration module, an operation module, a metadata management module, a day module, a timed task module and a gateway module, and the request is routed to a corresponding logic storage partition in the data layer according to an application identifier; the data layer comprises a database cluster and an object storage cluster, and performs persistent storage and management of logic isolation on metadata and file data according to application identifiers; and the infrastructure layer provides an extensible server and network resources. Based on a distributed architecture, load balancing and efficient access are realized through data storage partitioning, a metadata management and index technology and a client load balancing technology, and the expandability, fault tolerance and performance of the system are improved.

The invention relates to the technical field of file storage management, and discloses a Lustre architecture-based high-performance file storage and processing method and system, the method comprises the following steps: obtaining spatio-temporal characteristics of file access; predicting a popularity value of the file based on the spatial-temporal characteristics; determining a storage strategy of the file based on the popularity value of the file; carrying out distributed storage on the file based on the storage strategy, and continuously detecting a node state; if it is detected that the node load is unstable, adaptive data migration is carried out on the node with the unstable load; if the node is detected to have a fault, generating a data recovery path based on the three-dimensional topological coordinates of the node, and migrating a file stored in the node having the fault based on the data recovery path; according to the method, the storage strategy is determined through the file popularity value, and the abnormal condition of the node is efficiently processed, so that the file storage and processing performance and efficiency are comprehensively improved.

The invention provides a log monitoring method which can be applied to the technical field of artificial intelligence and the technical field of distribution. The method comprises the following steps: based on a stream processing architecture, processing log data acquired in real time in a distributed manner through micro-service; wherein the micro-service comprises a preprocessing micro-service, a feature extraction micro-service and a real-time monitoring micro-service. Standardizing the log data through the preprocessing micro-service to obtain standard semantic data; processing the standard semantic data based on a deep semantic extraction model through a feature extraction micro-service to obtain deep semantic feature data; wherein the deep semantic extraction model is constructed based on an attention mechanism model, an auto-encoder and a graph neural network; and monitoring the dynamic change of the log data in real time based on an online learning mechanism by monitoring the micro-service in real time, and positioning the abnormal log based on the deep semantic feature data. The invention further provides a log monitoring device and equipment, a storage medium and a program product.

The invention provides a local knowledge base automatic construction system based on multi-source acquisition and distributed computing, and relates to the technical field of computer systems. The system comprises a multi-source data collector and a distributed data processing and analyzing module, wherein the multi-source data collector realizes access, data collection, data transmission and incremental updating of multi-source data, and generates an incremental change record; and the distributed data processing and analyzing module comprises a plurality of distributed nodes and is used for carrying out distributed processing and analysis on data files according to incremental change records on the data collected by the multi-source data collector and establishing a local knowledge base. According to the system, automatic construction of the local knowledge base can be realized, the knowledge base construction efficiency is improved, the knowledge base construction period is shortened, the knowledge data freshness is ensured, and the data quality is improved.

The present application provides a storage space allocation method and a server. The method is applied to a server. Upon reception of a configuration request, the server registers the external storage of a server cluster into the storage space of the server cluster on the basis of the configuration request to obtain a target storage space, thereby realizing capacity expansion of the storage space of the server cluster by using the external storage of the server cluster. Upon reception of a storage space allocation request, the server uses the target storage space to provide a corresponding storage space, so as to store a temporary file generated in the process of realizing a service function. In the method provided by the present application, the external storage of a server cluster is used to realize expansion of storage resources of the server cluster, and the internal storage and external storage of the server cluster can be invoked to provide a storage space for a computing node, thereby effectively supporting the realization of a service function, improving the success rate of task execution, and avoiding task execution failure due to insufficient storage resources.

A data input sub-system of a parallelized database system includes processing core resources operable to obtain divisions of data slabs of a dataset and compress the divisions of data slabs using a null elimination compression scheme to produce divisions of compressed data slabs, A first data slab of a first division of data slabs of the divisions of data slabs is compressed using the null elimination compression scheme to produce a first compressed data slab. The first compressed data slab includes first compressed data and first compression information. The processing core resources are further operable to store a respective division of compressed data slabs of the divisions of compressed data slabs.

The invention relates to the technical field of distributed file management, and discloses a college cross-campus distributed file collaborative management system. The system comprises a file operation sensing module, a collaborative strategy decision module and a distributed execution engine module. The file operation sensing module is deployed at each campus file server node, captures user editing operation and converts the user editing operation into an operation feature vector set with a timestamp; the collaborative strategy decision-making module generates a conflict probability matrix by analyzing the operation feature vector, and generates a transmission path scheme and a real-time synchronization instruction in combination with a network state and load data; and the distributed execution engine module is responsible for analyzing the instruction, adjusting transmission parameters, processing conflicts and generating a global audit tracking report. According to the system, refined perception, conflict pre-judgment, intelligent transmission, dynamic synchronization and comprehensive auditing of cross-campus file operation are realized, the efficiency and reliability of college cross-campus file collaborative management are improved, and the system is suitable for a multi-campus college file collaborative management scene.

The invention provides a voucher file processing method and device, electronic equipment and a readable storage medium, and the voucher file processing method relates to the field of data processing, and can be applied to the financial and medical fields, such as payment and settlement scenes in the financial or medical field. The voucher file processing method comprises the following steps: receiving service configuration information sent by a service system, and generating a target voucher file according to the service configuration information; sending the target voucher file to an intermediate storage system, and obtaining a file identifier fed back by the intermediate storage system; obtaining a verification token from the target system, generating a notification message according to the file identifier and the verification token, and sending the notification message to the target system, so that the target system obtains and processes the target certificate file from the target system based on the notification message; receiving a response file fed back by the target system, wherein the response file comprises a verification result and a storage state of the target voucher file by the target system; and updating the file state of the target voucher file according to the response file.

In one embodiment, a system for managing a virtualization environment comprises a plurality of host machines, one or more virtual disks comprising a plurality of storage devices, a virtualized file server (VFS) comprising a plurality of file server virtual machines (FSVMs), wherein each of the FSVMs is running on one of the host machines and conducts I / O transactions with the one or more virtual disks, and a virtualized file server self-healing system configured to identify one or more corrupt units of stored data at one or more levels of a storage hierarchy associated with the storage devices, wherein the levels comprise one or more of file level, filesystem level, and storage level, and when data corruption is detected, cause each FSVM on which at least a portion of the unit of stored data is located to recover the unit of stored data.

To provide an information processing method, a program, and an information processing system for efficiently obtaining a desired processing result.SOLUTION: An information processing system includes a server which serves as an information processing apparatus, and a user terminal which serves as an information processing apparatus, which are connected over a network to communicate with each other. An information processing method which is executed by the server 12 includes: an input information acquisition step of acquiring input information to be input to a trained model, and tag information in the input information, from an information acquisition unit; and a storing step of storing the input information and the tag information in a repository configured with a prompt DB 224, a processing result DB 228 and an information processing unit 244 which are associated with each other.SELECTED DRAWING: Figure 3

The invention provides a complex construction site construction equipment control system and method, and the system constructs a basic state semantic model of each type of equipment, and covers all perception and control instruction data; the comprehensive management and control platform dynamically extracts and issues one or more data packet formats from the basic model according to construction scenes, areas and equipment types, and fine adjustment of sensing information and instruction formats is achieved; the edge computing device is deployed at an equipment end or a cluster end and is responsible for dynamic mapping analysis, redundancy removal, priority screening and unified protocol packaging of a multi-heterogeneous protocol; the equipment end reports a null instruction sensing data packet, the comprehensive management and control platform generates an optimal control instruction, compresses recent sensing data and then issues the compressed recent sensing data in the same data packet format; the equipment end decides whether to execute the instruction or not, if not, problem expression is fed back, and a safe closed loop is formed; in a cluster scene, gathering fusion and instruction distribution of multi-level edge computing devices are supported, and efficient collaboration of heterogeneous clusters is achieved.

Techniques can include: recording, in a log, log entries for write operations writing data pages to logical addresses; and flushing the log entries from the log, wherein flushing includes performing deduplication of the data pages. Flushing can include: partitioning the data pages into i) a first portion of the data pages that are determined to be duplicates of existing data pages, and ii) a second portion of the data pages determined to be unique data pages; atomically incrementing reference counts each corresponding to one of the existing data pages determined as identical to a data page of the first portion; and atomically binding the logical addresses to the data pages, including: binding the first portion of data pages to a corresponding third portion of the logical addresses; and binding the second portion of data pages to a corresponding fourth portion of the logical addresses.

The invention relates to an electric power cold and hot data judgment optimization method and system based on multi-dimensional data elements, and the method comprises the following steps: S1, building an automatic baseline of data assets and business attributes, and constructing a unified data asset portrait table and an access portrait table; s2, based on the unified data asset portrait table and the access portrait table, constructing multi-dimensional element features required by cold and hot judgment; s3, constructing a cold and hot judgment model, outputting a cold and hot temperature score for each data object according to the multi-dimensional element features, and performing grading according to the score; s4, according to the grading list obtained in the step S3, under the constraint of the SLA, by taking the minimum total cost and the optimal performance as targets, generating an executable layering and migration plan; and S5, based on the layering and migration plan, layering and migration are executed, and an operation log and an audit record are recorded. According to the invention, strong-adaptability cold and hot data management in a complex power business big data scene is realized.

The present disclosure relates to a log processing method and apparatus, an electronic device and a readable storage medium. An airport device and a background system can be unified by means of trace log identifiers, log data generated by the system is aggregated on the basis of the trace log identifiers to obtain call chain data of each trace, and an explicit chain diagram is drawn for interface call relationships between applications in a departure control system, so that maintenance personnel can clearly know a call chain where the generated log data is located, and full-chain traceability of log data from an airport front-end device to the background system is realized. The maintenance personnel can conveniently and quickly locate a call chain where problematic log data is located, and automated testing of service calling can be assisted while the problem location difficulty is reduced.

The invention provides a process information monitoring method and device, equipment, a medium and a product, and relates to the technical field of information security. The method comprises the steps that historical static process information of a plurality of processes is taken, and a static process fingerprint database is generated according to the historical static process information; taking historical dynamic process information of the plurality of processes, and generating a dynamic process fingerprint database according to the historical dynamic process information; taking real-time static process information and real-time dynamic process information of the target process, judging whether the real-time static process information is in the static process fingerprint database or not, and if the real-time static process information is in the static process fingerprint database, conditionally releasing the target process; and judging whether the real-time dynamic process information exists in the dynamic process fingerprint database or not, and if yes, completely releasing the target process. A double-fingerprint database verification mechanism is adopted, after an abnormal behavior is injected into a target process, the target process is released through matching of a static process fingerprint database, but a dynamic process fingerprint database detects that the target process deviates from a normal behavior during operation, so that data is intercepted, and the security of the data is remarkably improved.

The invention discloses a data general survey method and device for a multi-source heterogeneous data source, and the method comprises the steps: S1, data source initialization and metadata maintenance: accessing the multi-source heterogeneous data source, and building a data source information table containing basic information, metadata and state identification; s2, a dynamic scheduling strategy is generated, wherein an initial scheduling plan is generated according to the data source priority, the updating frequency and the data size; s3, increment identification and statistics: performing timestamp comparison or transaction log analysis on the structured data source, performing file hash or block verification on the unstructured data source, and outputting an increment statistics log; and S4, multi-source data integration and output, visual display and interface output are carried out. The method has the technical effects that through three innovations of the dynamic scheduling engine, the increment recognition rule engine and the unified adaptation framework, the resource utilization rate is improved, the processing efficiency is leap, and the expansibility is remarkably enhanced.

The invention provides a database audit log analysis method, electronic equipment, a computer readable medium and a product, and the analysis method comprises the steps: carrying out the pre-filtering of an original audit log set based on a preset operation type, and obtaining a to-be-analyzed log set; performing rule screening on the to-be-analyzed log set according to a preset safety threshold to obtain a high-risk log set; performing semantic understanding and risk mode recognition on database operation in the high-risk log set by combining a safety threshold through the fine-tuned database semantic risk analysis model, and generating a structured risk judgment result containing risk types, confidence coefficients and key features; and when the confidence reaches an early warning threshold value, taking the corresponding log as a clue, carrying out multi-dimensional association traceability in the original audit log set, and generating a visual audit risk report fusing an association operation behavior chain, an access resource set and session information. According to the invention, the closed loop of real-time identification, active alarm and rapid traceability is realized, and the response efficiency of database audit is improved.

Methods, systems, and devices for data management are described. A data system may capture a first snapshot of a target computing system at a first time, and a second snapshot at a second time that is later than the first time. The system may compare the second snapshot with the first snapshot to identify whether a set of deleted files includes a quantity of deleted files that satisfies a file deletion threshold. Using metadata associated with the target computing system, the system may identify a subset of the set of deleted files as corresponding to one or more system files. The DMS may then determine whether a ratio between a first value of a deletion metric and a second value of the deletion metric satisfies a threshold ratio. In some examples, the system may refrain from generating an alert based on the ratios satisfying the threshold ratio.

The invention relates to a method and a device for collecting log round-robin files of a linux system. The method comprises the following steps: configuring a file path of a log rotation file to be collected in a linux system; when a log collection program is started, obtaining a target log file and / or a target directory based on the file path; generating and storing file state information of the target log file; adding event monitoring to a target directory corresponding to each file path and a parent directory of the target directory; and when the log file meets a log rotation condition, performing log rotation file collection through the event monitoring and the file state information. According to the method and the device for collecting the log rotation file of the linux system, a create mode and a copyruncate mode which are commonly used by a log tool can be supported at the same time, the log file after rotation is accurately recognized, and repeated collection or missing collection caused by a configuration problem is avoided.

The invention discloses a defragmentation method and device, electronic equipment, a storage medium and a program product. According to the implementation scheme, the method comprises the steps of determining a defragmentation transaction, and a to-be-defragmented table and a to-be-defragmented B + tree corresponding to the defragmentation transaction; blocking the to-be-sorted table, and creating a temporary table corresponding to the to-be-sorted table; executing degradation processing on blocking of the to-be-sorted table, and inserting the to-be-sorted data into the temporary table to generate an inserted temporary table; operation corresponding to the logic log is redone on the inserted temporary table, and a redone temporary table and a redone temporary B + tree are obtained; and exchanging the to-be-sorted B + tree corresponding to the to-be-sorted table into the remade temporary B + tree to obtain a fragment sorting table. When the defragmentation transaction is executed, exclusive blocking does not need to be executed on the to-be-sorted table in the whole process, the to-be-sorted table is made to be in the available state, defragmentation of the to-be-sorted table is completed, and the concurrency and availability of a database system are improved.

A method for managing log files for recording operations on data stored in a database is provided, wherein a set of log files having an allocated first portion of storage is updated, the allocated first portion of storage is monitored, and a second portion of storage is allocated in dependence on a determination that an available portion of storage is below a predetermined size. A method for generating a snapshot is provided, wherein data entries are included in the snapshot in dependence on a determined relative order of log records in a set of log files. A method of replicating a binary large object is provided, wherein the binary large object is sent to a second database in response to identifying a log record comprising data indicating the binary large object. A method for deleting one or more binary large objects is provided, wherein the data indicating one or more binary large objects that have been logically deleted are stored in a snapshot and the one or more binary large objects are deleted using the data indicating the one or more binary large objects after a previous snapshot is deleted.

The application relates to a trajectory data compression and decompression method, device, equipment and medium, and is applied to the field of maps. The method comprises the following steps: acquiring a trajectory point representing an object trajectory; matching the trajectory point to a road network of an electronic map to obtain at least one object trajectory section; the object trajectory section is a section passed by the object in the road network; performing thinning processing on the at least one object trajectory section according to section characteristic information corresponding to each object trajectory section to obtain a key trajectory section; the key trajectory section is a part of the object trajectory section and is used for restoring the object trajectory; and the key trajectory section is compressed and stored to obtain trajectory compression data. The method can save storage resources.