1039 results about "Logfile" patented technology

The invention relates to a network attack tracing method, system and device based on a user portrait, and a medium. The attack tracing method comprises the following steps: collecting interactive behavior data of a user in a Web page; performing compression and serialization processing on the interaction behavior data to generate a structured interaction log file; collecting fingerprint data of the user terminal and performing standardization processing to generate a fingerprint feature vector; based on the structured interaction log file and the fingerprint feature vector, generating a user unique identifier containing a risk level tag; performing clustering analysis on the interaction behavior data according to the unique identifier of the user, identifying an abnormal behavior mode of the abnormal user and marking an attack type; acquiring a public network IP address of an abnormal user, and positioning a geographic position in combination with an IP database; and constructing an attack traceability report based on the user unique identifier of the abnormal user, the abnormal behavior mode, the public network IP address and the geographic position. According to the invention, the user portrait can be accurately constructed, and the network attack behavior can be effectively identified and traced.

The invention discloses a storage resource management method and system and a storage medium, and relates to the technical field of storage resource management, and the method comprises the steps: calculating the access popularity and popularity threshold of data according to a historical log file, and carrying out the popularity layering of the data in the historical log file according to the two; the data distribution mapping table is generated based on the historical log file and the access popularity, and finally multiple storage resources are allocated based on the layered data and the data distribution mapping table, so that the problems that application scenes of related technologies are limited, and the performance of a storage system is difficult to flexibly deal with complex and changeable business environments are solved; the technical problem that smooth expansion and rapid iteration of a storage system cannot be achieved is solved, and the technical effects of dynamic allocation, efficient utilization, flexible configuration and safety protection of storage resources and capability of leisurely coping with various complex application scenes are achieved.

Disclosed in the present invention is a fully automated log analysis and fault handling system and method based on an NLP large model. The method comprises: collecting a service state, an operating environment, and log files; extracting and generating log summaries from the log files, extracting key information from the log summaries to obtain state information of a service process; if an error is fed back, the NLP large model performing fault analysis on the error by using the service state and the operating environment as prior knowledge, and recording upstream and downstream key information involved in the error; on the basis of the upstream and downstream key information involved in the error, finding a fault cause and providing a fault handling action; and then executing a plan on the basis of the fault handling action. Log collection of the present invention is not limited to a prescribed format, and an NLP large model using a service state and an operating environment as prior knowledge is introduced for fault analysis.

The invention discloses a performance pressure test system and method applied to a large model streaming interface, belongs to the technical field of artificial intelligence, and aims to solve the technical problem of how to comprehensively evaluate the performance of the large model streaming interface in a high-concurrency scene. Comprising a test data management module used for constructing a test data set; the concurrent access simulation module is used for dynamically configuring concurrent access parameters and simulating and generating a concurrent access scene of a plurality of users; the performance monitoring module is used for monitoring and recording the large-model streaming interface in the concurrent access scene; the fault-tolerant processing module is used for analyzing and processing the abnormal condition of the large model interface in the concurrent access scene based on a predefined abnormal processing strategy and forming an error log file; the post-processing module is used for calculating a performance index based on the monitoring data; and the result output module is used for constructing a test result file based on the error log file and the performance index and outputting the test result file.

A multi-node, multi-container cluster system that generates, aggregates, and manages log files from services and components to be used for audit logs and to debug and perform other serviceability tasks provided by a vendor of the cluster system. Logs are collected from all components of the system and aggregated into a consistent format for user analysis and debugging. Embodiments provide a comprehensive way to parse and index vast numbers of log files that can then be packaged and displayed to a user in a way that facilitates analysis and debugging and / or efficient input to appropriate debugging programs.

A method for identifying a log file for resolution of a fault of a medical imaging device, is provided. The method includes: obtaining log file browsing data describing one or more log files of the medical imaging device already viewed by a user to resolve the fault of the medical imaging device; obtaining problem data describing the fault of the medical imaging device; inputting the problem data and the log file browsing data to a machine learning algorithm, the machine learning algorithm being trained to predict, for each of a plurality of log files of the medical imaging device, and based on the browsing data, a resolution probability indicating a likelihood that the log file will assist in resolution of the fault of the medical imaging device; obtaining a prediction result from the machine learning algorithm in response to the inputting, the prediction result comprising a resolution probability for one or more of the plurality of log files of the medical imaging device; and identifying a log file for resolution of the fault of the medical imaging device based on the obtained prediction result.

A method for operating a first computer system is provided. The method includes: building a database comprising entries, each entry indicating a failure in one or more second computer systems and an action pattern to remedy the failure, the action pattern indicating log files to be accessed to remedy the failure. In response to detecting a failure in the first computer system, one or more entries of the database that match the detected failure may be identified. The one or more action patterns associated with the identified one or more entries may be used for extracting debugging data representing the detected failure. At least part of the debugging data may be sent to an external system. In response to the sending, instructions to remedy the detected failure may be received from the external system.

Systems and processes disclosed herein perform an automatic remediation process. The automatic remediation process may be a log-based remediation process. Systems disclosed herein may obtain log files from an information management system and determine the occurrence of errors at the information management system based on error codes included in the logs. Further, the systems may access a knowledgebase to determine whether solutions for the errors have been previously generated. The solutions may include patches or hotfixes that can be applied to the information management system without removing user-access or stopping execution of the information management system. The systems may automatically update the information management system to address the errors. Alternatively, or in addition, the systems may alert a user, such as an administrator, of the existence of a solution to the error, and whether the solution may be applied without interrupting service or access to the information management system.

Techniques for fast database recovery in a multi-volume database environment via transactional awareness are described. In the event of a failure associated with a first volume storing database page data, the first volume can be restored to a point in time and transactional metadata from a second volume storing logical change data can be obtained for a limited number of transactions occurring at / after that point in time, as opposed to analyzing extremely large change log files. These transactions can be checked to ensure that they have all been persisted, and if not, change data for those transactions can be obtained from the second volume and used to replay these transactions on the restored first volume.

The invention discloses a dynamic log collection method and system and a server. According to the method, a flexible strategy configuration management system is introduced, user-defined configuration is supported, a plurality of target servers, different log files and different collection frequencies can be configured in one log collection strategy, and flexible collection strategies can be configured for different collection objects; in addition, in the method, strategies are automatically distributed, and the complexity of deployment and management is simplified; after the change of the file is monitored, the log file in the appointed path with the change is automatically collected, the automatic log collection and storage process reduces the requirement of manual operation, reduces the possibility of error occurrence, and improves the integrity and reliability of log data; in addition, the method supports the simultaneous storage of the logs in a plurality of target storage systems, such as a local file system, a cloud storage, a database and the like, so that the flexible configuration of log storage is realized.

The invention relates to the technical field of data processing, and provides a BMC fault recording method and device, computer equipment and a storage medium, and the method comprises the steps: responding to a kernel fault of a target operating system of a target BMC, and printing fault log information; obtaining a pre-configured memory technology device partition; transmitting the fault log information to an annular fault cache region to form cache log data; storing the cached log data in a memory technical equipment partition, and generating a fault log file; and in response to a user reading instruction, reading and outputting the fault log file of the memory technical equipment partition. According to the technical scheme provided by one or more embodiments of the invention, the fault log can be effectively recorded, maintenance personnel can timely and accurately know the fault position and the fault reason, and BMC fault diagnosis and repair can be efficiently completed.

A multi-sequence transformer predict N tokens, in parallel, for log files in industrial machines. Token patterns derived from N log file token sequences logged by N respective loggers may be input into N respective intra sequence multi-head self-attention layers identifying patterns among tokens within the same log file token sequence generated by the same logger. Token patterns derived from a combination of the N log file token sequences may be input into a same inter sequence multi-head self-attention layer identifying patterns among tokens across multiple different sequences generated by multiple different loggers. N softmax layers may be generated of N distinct probability distributions that each candidate tokens is a next token in each of the N respective log file token sequences. A plurality of N next tokens may be predicted, in parallel, to co-occur in the plurality of N respective sequences of log file tokens.

The invention belongs to the technical field of log monitoring, and particularly relates to a real-time log monitoring alarm method, system and equipment based on event driving, and the method comprises the steps: dynamically obtaining a log file path needing to be monitored, monitoring a log file on a server, and sending incremental log data to a specified Topic of Kafka in real time; through an event-driven architecture, using a Kafka consumer group to consume log data in Kafka in real time, and using a kset data type of Redis to temporarily store the log data; performing real-time processing on the log data in the Redis; comparing the statistical result with a preset threshold value, and if the statistical result reaches the preset threshold value, sending alarm information according to a configured notification mode and a notifier; and storing the monitoring result in a relational database, and displaying the monitoring big disk through a visual page. And an event-driven architecture is adopted, so that the data processing flow is more efficient, and the overall performance and expandability of the system are improved.

The invention relates to the technical field of network security, and discloses a security vulnerability AI positioning method and system based on log files. The method comprises the following steps: firstly, analyzing user feedback describing open source component security vulnerabilities to extract fault key entity information, screening related log entries based on the fault key entity information, and constructing a vulnerability propagation graph; identifying a vulnerability triggering initial point set by using a graph traversal algorithm and a graph neural network, calling a component vulnerability case library to deduce a vulnerability utilization propagation chain and calculating a matching degree with a known open source component vulnerability utilization chain feature, and obtaining a maximum probability vulnerability utilization propagation chain and an associated vulnerability triggering initial point set; and generating a root cause positioning report, and updating the knowledge base or model training data according to a user verification result. According to the method, the initial vulnerability point and the complete vulnerability propagation chain of the security vulnerability of the open source component can be accurately and efficiently positioned, and the positioning accuracy and timeliness are improved.

Systems and methods are provided for generating metadata for an improved data structure that enables improvements to generative AI and LLM processing and use of the data. A system may receive a log file generated by an entity associated with a device and generate metadata of the log file that comprises origination data associated with the entity and location of the device. The system may store the metadata and content of the log file as a document object. A data structure may be generated using various data objects. For example, the system can generate a vector embedding object enriched with a temporal embedding, a positional embedding, or a hierarchy of the metadata. The system may initiate an action based on the vector embedding object.

The embodiment of the invention provides a log processing method, computing equipment, a storage medium and a program product. The method comprises the following steps: under the condition that a target transaction of a database is detected to meet a target condition, storing a temporary file generated by the target transaction to a storage node; the temporary file stores a binary log for the database; and in response to a transaction submission operation of the target transaction, processing the temporary file in the storage node to generate a binary log file. According to the technical scheme provided by the embodiment of the invention, the transaction submission efficiency is improved.

The techniques disclosed herein provide a system for condensing large log files to enable interoperability with transformer-based large language models in automated failure analysis. In various contexts such as enterprise cloud services, log files can be large oftentimes containing millions of lexical units that can incur significant processing time and resource consumption. As such, the disclosed techniques provide a system for producing a directional knowledge graph representing a condensed form of a log file for automated failure analysis. Firstly, the log file is preprocessed to filter information that is irrelevant to the failure that previously occurred. The filtered lexical units are then used to generate a directional knowledge graph comprising a plurality of vertices which correspond to individual lexical units, and which are connected by edges representing the semantic connection between the lexical units. In this way, the directional knowledge graph significantly reduces processing times and improves resource consumption.

A data processing service uses minor compactions for committing transactions to a data table. The service may receive requests to commit transactions to a data table and write metadata for the transactions to log files, and generate a checkpoint file aggregating the transactions described in the log files to compute a data table state at a first time. The service may receive requests to commit a set of transactions and write metadata for the set of transactions to a set of log files. The service may determine that a number of log files in the set of log files reaches a threshold commit number, generate a minor compaction file aggregating the set of transactions, and generate a second checkpoint file aggregating the data table state at the first time with information from the minor compaction file to compute the data table state at a second time.

In some implementations, a health system may receive a documentation file associated with a software platform and may apply natural language processing to the documentation file to generate a first health indicator. The health system may receive a set of property indications associated with the software platform and may provide the set of property indications to a clustering model to receive a second health indicator. The health system may receive a log file associated with the software platform and may provide the log file to a machine learning model to receive a third health indicator. The health system may receive a set of notifications associated with failed builds, manual changes, and / or software incidents and may apply rules to the set of notifications to generate a suggested change to the software platform. The health system may output instructions for a user interface that includes the health indicators and the suggested change.

The invention relates to a server disk RAID state monitoring method and device and a readable storage medium. The method comprises the steps that the health state of a battery backup unit is judged according to RAID hardware information; obtaining SMART attribute information to judge the health state of a server disk; obtaining the state of a server disk RAID array, reconstruction progress information and availability information of a hot spare disk so as to judge the performance of the server disk; when the RAID array has the degradation state, a fault disk corresponding to the degradation state in the RAID array is determined, reconstruction of the RAID array is automatically triggered, replacement operation of the fault disk is executed, and alarm information is sent to an upper computer; the RAID hardware information, the SMART attribute information, the state of the RAID array, the reconstruction progress information, the availability information of the hot spare disk and the position information of the fault disk are uploaded to a log file; and encrypting the log file by using an AES algorithm. The accuracy of the method for monitoring the RAID state of the server disk and the safety and reliability of the log file are improved.

In the DevOps process, testing teams use automated testcases to test a product in a regression testing running daily, which generate thousands of log files per run, in various distributed environment with different formats. Solutions to errors depend on SMEs and the impact of solution leads to rework of defect / errors and high degree of heterogeneity. This leads to huge bottleneck in automation of DevOps process leading to loss of productivity and agility. Present disclosure addresses the challenges by providing systems and methods that auto capture the log files of different formats efficiently in a scalable, extendible, and plug-able way. The system then mines and parses the log files based on given identifiers to standardize and de-duplicate to create unique error records with detail description including cause, position, module, timestamp, etc. The system predicts the solutions leveraging the database containing solutions and errors by using a modified Smooth Inverse Frequency technique.

The invention relates to the technical field of artificial intelligence and data engineering, in particular to an intelligent data development treatment system and method based on a large model, the system is composed of a data access layer, a large model treatment engine, an intelligent feature factory, a compliance control layer and an application interface layer, and all the modules cooperate to achieve intelligent transformation of the whole data development process; the method has the beneficial effects that the potential mode of the multi-source heterogeneous data can be automatically identified, for example, transaction records, user behavior data and system monitoring information are distinguished from mixed log files, and manual rule pre-definition is not needed. And dynamically adjusting the protection intensity according to the data use scene.

The invention relates to a method for actively collecting a micro-service error log, which comprises the following steps: collecting a micro-service log according to pre-configured task information, the pre-configured task information comprising a micro-service name and a log path, and the micro-service log comprising log content, a link tracking ID and log context information; filtering the micro-service log according to the filtering rule to obtain a key error log, wherein the key error log is used for representing generated important error information; filling the abnormal type, the log context and the link tracking ID analyzed based on the key error log into a structure template to generate a structured log file; and sending the structured log file to the target receiving end according to the configuration information. According to the method, a rear-end collection mode is adopted, the micro-service logs are automatically collected, developers do not need to manually log in a server or query log files, and time and energy are saved.

Embodiments of the present disclosure provide a log storage method, a database system, a server, and a storage medium. In the log storage method, any database node in a distributed database can use a storage engine component to acquire a transaction log of a target transaction, and write the transaction log into a target online log file. The database node can use the storage engine to persistently store the transaction log in the target online log file into a corresponding target block device, and perform a transaction-level persistent storage operation on metadata information of the target online log file. In the implementation, on the basis of the online log file supporting a write operation at any location, the database node can directly store the transaction log in a block storage mode on the basis of the storage engine assembly of the database node without depending on a file system, thereby reducing resource overhead caused by incorporating the file system and a file storage mode.

A multi-node, multi-container cluster system that generates, aggregates, and manages log files from services and components includes a serviceability suite of functions for the system as it performs its tasks of supporting applications for a user. A logging function records events and states of nodes as the applications are run, an audit log processing function processes and compiles the logs for audit purposes, and the relevant log data for is provided in the form of uniform core files. Failure processing functions and debugging tools are provided to help analyze, debug, and correct issues that may be encountered. A support bundle processing function is provided to generate and process the log, debugging, failure, and other information for transfer to vendors or other third parties tasked with supporting the cluster network.

The invention discloses a debugging method and device for a network-on-chip, electronic equipment and a readable storage medium, and relates to the technical field of the network-on-chip, and the method comprises the steps: automatically carrying out the function verification and performance debugging of the network-on-chip through a log file and a signal waveform file, finding out the reasons of function errors and performance substandard, and carrying out the debugging of the performance of the network-on-chip. Therefore, a user can be helped to quickly and efficiently complete the function debugging and performance analysis of the network-on-chip, so that the verification efficiency of verifying the network-on-chip can be improved, and the verification period can be shortened; therefore, the problem of low efficiency of function debugging and performance analysis of the network-on-chip in the prior art is solved.

The invention relates to the technical field of data processing and the technical field of financial science and technology, and discloses an incremental data lake entering method based on Flink, incremental data are obtained from data sources through an Flink task, and the data sources comprise a real-time streaming data source and a static batch processing data source; performing stream processing or batch processing on the incremental data, and writing the incremental data into an incremental log file of the MOR table; in the stream processing process, regularly carrying out state storage operation and storing a data processing state; storing a final processing state when the batch processing task is completed; fragmenting the incremental log file, and generating an optimized incremental log file through distributed node or multi-thread parallel processing and merging operation; and asynchronously executing a merging operation, and merging the incremental log file with the base table file to generate a new base table file. According to the method, the incremental log file and the base table file are combined, and the resource-intensive combination operation is set in the background in an asynchronous execution mode, so that the blockage and the performance influence of the combination process on the system are avoided.

The invention relates to the technical field of block chains, and discloses a transaction monitoring method and a related device, which are used for improving the transaction efficiency and reducing the transaction security risk, and the method comprises the steps: after a main node in an alliance chain obtains the transaction information of a target transaction, carrying out the transaction processing of the transaction information, and obtaining a transaction result, the method comprises the following steps that: firstly, a node identifier of a node, transaction information and a transaction result are associated and recorded in a log file, and then, a main node broadcasts the transaction information and the transaction result to other nodes in a block chain for transaction verification, and respectively receives transaction verification results returned by the other nodes; the method comprises the following steps: acquiring the node identification of each other node, recording the other node identification of each other node and the corresponding transaction verification result in a log file in an associated manner, and finally, sending the log file to a server, so that the server analyzes the transaction condition of the target transaction based on the node identification, the transaction information, the transaction result, each other node identification and the corresponding transaction verification result.

The invention discloses a log processing method and device, electronic equipment and a computer program product. Relates to the field of financial science and technology, and comprises the following steps: receiving a log query request, and extracting log generation time and a log tag of a target log file from the log query request, the log tag being used for indicating a file type of the target log file; generating a query condition according to the log generation time and the log tag, and obtaining a storage path of the target log file from a query index associated with the object storage system according to the query condition to obtain a target storage path; and extracting a target log file from the object storage system based on the target storage path, and sending the target log file to the client. Through the method and the device, the technical problem that the query efficiency is low when the target log file is acquired from the computing cluster in related technologies is solved.

A distributed operation and maintenance data management method based on a multi-modal log aggregation framework relates to the field of electrical digital data processing, and comprises the following steps: calculating a node load state index; determining node acquisition parameters including an acquisition period and an acquisition trigger condition; when the log file change amount of the target node is larger than the collection triggering condition, event collection is executed, and event collection data flow is obtained; when the log file change amount is smaller than or equal to the collection triggering condition, polling collection is executed according to the collection period, and a periodic collection data stream is obtained; generating a data compensation instruction and executing incremental acquisition to obtain a compensation data stream; merging to generate complete log data, and carrying out type distinguishing to generate a multi-modal data packet; and allocating the data to corresponding storage engines to obtain multi-modal log aggregation data. By implementing the method, the integrity of log data acquisition in a large-scale distributed system can be improved.