2341 results about "Object file" patented technology

The invention provides an unstructured file parallel synchronization method and system, and relates to the technical field of file synchronization, and the method comprises the steps: carrying out the intelligent partitioning of a target file through a pre-training file partitioning model, and generating a double-layer cascade index number and a data hash value; and then, according to the data transmission priority model, transmitting the data sub-blocks to a target end database through a self-adaptive parallel transmission channel, and performing asynchronous verification. And finally, recombining the data sub-blocks based on the double-layer cascade index number and the data block association graph by utilizing a pre-training file recombining model, generating a synchronous target file, and submitting confirmation information to the block chain network. According to the method, the unstructured file synchronization efficiency can be improved, the data integrity and security are guaranteed, and the network transmission pressure and the storage cost are reduced.

The invention provides a multi-knowledge-granularity text retrieval method and device for RAG, and the method comprises the steps: sorting an original text into a JSON file, carrying out the recursive character and semantic dicing processing, generating a target JSON file, and storing the target JSON file in a BM25 database and a vector database; when a user queries, preprocessing to generate a keyword list and a query embedded vector; searching for a target text in the BM25 database, and calculating a score of correlation with the keyword to determine a first to-be-selected text; determining a second to-be-selected text according to the query embedding vector; and performing duplicate removal processing on all the first to-be-selected texts and the second to-be-selected texts, and determining and outputting a final recommended text by utilizing a sorting model. By considering the problem of different search granularities, the keyword granularity is solved by adopting a BM25 algorithm. According to the semantic retrieval strategy combining sentence granularity and segment granularity, challenges of different text information lengths and different retrieval purposes are effectively handled, and therefore the advantages of traditional retrieval and semantic retrieval are fully utilized.

The present invention relates to the technical field of computers, and provides a log processing method and system, a log management platform, and an electronic device. The method comprises: acquiring real-time log data of each service system, and storing the log data in a message queue; according to a preset time window, writing the log data in the message queue into a target file of a specified storage directory; and in response to completion of data writing of a current time window, on the basis of the storage directory of the target file, calling a log analysis interface of a log analysis service to perform log analysis on the target file. The log processing method in the present invention reduces the risk incident rate of service systems, and improves the localization accuracy of an anomaly condition of a service log.

Techniques are described for enabling concurrent cross-region replications and garbage collection while maintaining consistency and data integrity among file systems. In some embodiments, techniques for garbage collection fencing utilize a system-level garbage fencing key (GC fencing key) and one or more job-level GC fencing keys in a source file system that perform one or more cross-region replications with one or more target file systems, one replication and one job-level GC fencing key per target file system. In some embodiments, one job-level GC fencing key in a source file system and one job-level GC fencing key in a source file system together provide garbage fencing for a cross-region replication. In certain embodiments, the metadata information in a GC fencing key can inform, instruct, or be used to configure garbage collectors to skip garbage collection for a range of snapshots in a file system.

The invention relates to an LLM-based industrial control programming ladder diagram generation method, which is based on a ladder diagram in a text graph form generated by processing a natural language target programming demand through a large language model, generates a large language model by applying a pre-training base, generates a corresponding target XML file, converts the file into a corresponding target JSON file, and finally analyzes the file by applying a GOJS graphic component. Generating a graph componentized target programming ladder diagram; compared with the prior art, the generation rate and accuracy of the graphic componentization programming ladder diagram are greatly improved, the natural language serves as input, the technical threshold and difficulty of ladder diagram programming are reduced, the readability of the generated programming ladder diagram is high, and the corresponding XML file and JSON file can be directly imported into an industrial control programming platform to be compiled and debugged.

The invention discloses a file transmission protection method, system and device based on multiple encryption algorithms, and relates to the technical field of information, and the method comprises the steps: selecting a target file needing to be transmitted, carrying out the preprocessing, and generating file fragments; analyzing the sensitivity of each file fragment, and performing hierarchical encryption processing to obtain an encrypted fragment set; selecting a steganography carrier file, and embedding the encrypted fragments into the carrier file to generate a steganography index table; generating a dynamic session key based on the confusion key pool, encrypting the steganographic file transmission layer and embedding a dynamic key generation parameter; the receiving end generates a session key according to the transmission message header, decrypts the transmission layer data, extracts the steganographic file and decrypts the steganographic file; recombining the decrypted and recovered fragmented data into a complete file according to an identifier sequence; by dynamically matching the steganography carrier file, the efficient embedding of the fragmented data and the generation of the steganography index table are realized, and the concealment and the adaptability in the transmission process are ensured.

Systems, methods, and computer-readable storage media to model objects. One method includes receiving, from an application of a user device, a content dataset of an object and capture event parameters of a capture event of the object, generating a three-dimensional (3D) object file based on the content dataset, wherein the 3D object file is a digital twin of the object, corresponding with one or more characteristics of the object, storing the 3D object file and the capture event parameters in a data repository, generating a token including a metadata object based on broadcasting the 3D object file, the content dataset, and the capture event parameters to a distributed ledger, wherein the metadata objects embeds, into the token, the metadata of the object, a pointer to the capture event parameters, and a pointer to the 3D object file, and storing the token at a digital wallet address of a wallet storage.

Techniques are described for enabling concurrent and non-blocking replication object deletion during cross-region replications. In some embodiments, in a target file system, a target replication pipeline as part of a cross-region replication, and a deletion pipeline operate in parallel. The deletion pipeline deletes processed objects reaching the last pipeline stage of the target replication pipeline after each checkpoint in the target replication pipeline. In some embodiments, after a non-recoverable failure during the cross-region replication, the cross-region replication can be restarted from the beginning (i.e., fresh restart) without waiting for its unused objects in the Object Store to be deleted by utilizing a generation number associated with each object to delete the unused objects in a background process while allowing deleting processed objects as normal for the freshly restarted cross-region replication.

The invention provides a data synchronization method which can be applied to the technical field of computer communication. The data synchronization method comprises the steps that a synchronization request initiated by a local server is responded, a virtual disk mirror image generated by converting a target file through the local server is received through a preset transmission channel, and the synchronization request carries an editing mode identifier of the target file; mounting the virtual disk mirror image to a serial bus control port of a remote server, so that the virtual disk mirror image can be identified as a removable storage device; if the editing mode identifier represents that the target file is in an editable state, acquiring change information generated by modifying the target file by a local server and / or a remote server by monitoring a file change event on the removable storage device in real time; and dynamically updating the virtual disk mirror image based on the change information to complete modification synchronization of the target file. The invention further provides a mirror image mounting method and device and a storage medium.

The invention discloses a file retrieval method and device, equipment and a storage medium, and relates to the technical field of data retrieval, and the method comprises the steps that a user mode space responds to a file retrieval instruction received at the current moment, a target retrieval strategy corresponding to the file retrieval instruction is determined, and an event filtering strategy is updated to a kernel mode space; the kernel mode space obtains a target file operation event from all file operation events captured at the current moment based on the updated event filtering strategy; and the user mode space determines metadata information of a target file corresponding to the target file operation event, updates the mixed index database based on the metadata information, and then retrieves in the updated mixed index database based on the target retrieval strategy and the file retrieval instruction to obtain a file retrieval result. According to the method, the purposes of real-time updating of the metadata information of the file system and efficient retrieval of multiple retrieval dimensions are achieved, the efficient file retrieval requirement is met, and the file retrieval efficiency is improved.

The invention discloses a method and equipment for downloading a large file of a browser, belongs to the technical field of front-end Web, and is used for solving the problems that a large file downloading scheme in a traditional browser environment is low in memory use efficiency and data storage efficiency, insufficient in network interruption processing capability and lack of effective integration of a browser underlying technology, and the network interruption processing capability is poor. And offline caching and high-efficiency recovery are difficult to realize. The method comprises the steps of fragmenting a target file in a file downloading task according to a preset fragmentation rule, and creating a fragmentation downloading task for each fragmentation; dynamically distributing fragmented downloading tasks through a parallel task pool; after each fragment downloading task is completed, the downloaded fragment data and metadata thereof are stored through an IndexedDB database, and integrity verification of the fragment data is carried out; according to a fragment integrity verification result, re-downloading the current fragment; and after all fragment downloading tasks are executed, reading all fragment data according to a fragment sequence and splicing the fragment data into a complete file.

The invention provides a WebGPU-based three-dimensional model loading method and system, and relates to the technical field of three-dimensional model processing, and the method comprises the steps: obtaining a to-be-loaded three-dimensional model file, obtaining a path of the file, reading a target file through the path by using a loader constructed by a WebGPU technology, and analyzing the read target file by using the loader, extracting vertex data and index data from an analysis result, converting formats of the vertex data and the index data into a target data format, creating a first buffer area, storing the vertex data and the index data subjected to format conversion in the first buffer area, binding the first buffer area to a rendering pipeline of the GPU, and storing the rendering pipeline of the GPU in the second buffer area. According to the method and the device, the three-dimensional model file can be directly loaded into the Web environment.

Ransomware detection accuracy is improved by analyzing patterns of changes in filename extension counts, relative to each other, that occur in a file system over time. The disclosed approach is malware-agnostic and does not rely on recognizing malware extensions or on real-time monitoring of the target file system. Instead, during each successive backup job of the target file system, the disclosed technology counts different types of filename extensions and compares the counts to each other and to corresponding counts taken in earlier backup jobs. Preferably, the anomaly detection analysis uses machine learning to discern a behavior pattern of the file system, which indicates how filename extensions are distributed and how much they change between backup jobs over time.

The invention relates to the technical field of computers, and provides a distributed AI large model warehouse downloading acceleration method, which comprises the following steps that: a newly added node completes synchronization of networking and a file mapping relation table between the newly added node and nodes of the whole network based on a gossip protocol; each node constructs a Hash ring through a consistent Hash algorithm based on the node identifier, determines a target Key according to the deployment identifier, and clockwise selects a next node of the target Key as a main node in the Hash ring; when a local intranet node receives a downloading request, firstly searching a target file in a local file list; if the target file is not found locally, initiating an intranet back-to-source request to a target node recorded in the file mapping relation table to obtain the target file; and if the intranet is not hit, a public network back-to-source request is initiated to the main node to obtain the target file, a decentralized networking mechanism based on the gossip protocol and a file mapping relation sharing mechanism are adopted, so that repeated downloading among the nodes is effectively avoided, bandwidth waste is reduced, and public network bandwidth occupation is remarkably reduced.

The present disclosure provides a method, an apparatus, an electronic device, and a storage medium of remote attestation. The method is applied to a first trusted execution environment, and includes: obtaining a first file for a first application, the first file being used to deploy the first application in the first trusted execution environment, and the first file including a read-only target file system; obtaining a first metric value for the target file system; loading the first file, and writing the first metric value into a command line for booting a kernel, and booting a kernel in the first file based on the command line, to deploy the first application in the first trusted execution environment; and measuring the kernel and other components to obtain a second metric value, and performing remote attestation on the first application based on the second metric value.

The invention relates to a software efficient dynamic loading method based on an embedded platform, and belongs to the field of embedded operating systems. The method comprises the following steps: analyzing a target file of embedded software to obtain respective symbol table information; confirming a dynamic symbol in the application target file; repositioning symbols in the application target file, and converting a dynamic address into a static address relative to the system target file; and combining the system target file symbol table with all the loaded application target file symbol tables, and creating a linked list structure in the upper computer for storage. According to the method, the dynamic loading work performed on the lower computer with limited performance resources is reduced, and the processing time and performance occupation of dynamic loading of the program in the lower computer are shortened.

The invention discloses a heterogeneous event processing method and device, electronic equipment and a storage medium. The method comprises the steps that under the condition that a polling thread polls a to-be-processed event, the polling thread stores an event reference of the to-be-processed event in a cache; the polling thread executes write-in operation on the target file based on a preset file descriptor of the target file, so that the state of the target file is converted into a readable state; and under the condition that the business main thread monitors the readable state of the target file, determining an event reference corresponding to the target file based on the file descriptor, acquiring event information of the to-be-processed event based on the event reference, and processing the to-be-processed event based on the event information. In the technical scheme of the invention, the polling thread only needs to cache the reference of the current event information and wait for further processing of the service main thread, the event message does not need to be copied and cached, the message queue lock does not need to be synchronously operated, and the memory occupation and the performance overhead are reduced.

This disclosure describes embodiments of systems, methods, and non-transitory computer readable storage media that can display icons for target digital content items and candidate destination folders within different sections of a multi-section graphical user interface (GUI) and adjust a corresponding file storage structure to reflect organization changes indicated by user interactions that move digital-content-items icons into folder icons. For example, the disclosed system can (i) display, within a first section of a multi-section GUI, icons representing digital content items and (ii) display, within a second section of the multi-section GUI, icons representing folders as candidate destination folders. Then, the disclosed systems can detect user interactions that move digital-content-item icons to folder icons and adjust an underlying file storage structure to reflect the organization indicated by the user interaction.

Techniques are described for performing different types of restart operations for a file storage replication between a source file system and a target file system in different cloud infrastructure regions. In certain embodiments, the disclosed techniques perform a restart operation to terminate a current cross-region replication by synchronizing resource cleanup operations in the source file system and the target file system, respectively. In other embodiments, disclosed techniques perform a restart operation to allow a customer to reuse the source file system by identifying a restartable base snapshot in the source file system without dependency on the target file system.

The invention provides a distributed compiling method and device, electronic equipment and a storage medium, and belongs to the technical field of data processing.The method comprises the steps that a source code file is sent to a server side to be compiled and assembled, a compiling result returned by the server side is obtained, and the compiling result comprises information of a compiled target file; based on the compiling result, a corresponding pseudo file is created, and the pseudo file comprises a rebuilding method of the compiling result file; after pseudo files corresponding to all the compiling results are obtained, a link command is sent to a server side, and the link command indicates the server side to conduct file link operation on all the target files; and receiving the executable file returned by the server. According to the method and the device, the intermediate file is prevented from being copied for multiple times between the client and the server, so that the network load required by file transmission is reduced, and the distributed compiling efficiency is improved.

The invention belongs to the field of big data, and relates to a file storage method which comprises the steps that access frequency information of a target file in a historical time period is acquired, and the target file is stored in a mechanical hard disk of an object storage system; judging whether the target file is a high-frequency access file or not according to the access frequency information and an access threshold value; if the target file is the high-frequency access file, obtaining file attribute information of the target file, and judging a to-be-stored type of the target file based on the cache strategy and the file attribute information; if the to-be-stored type of the target file is a memory storage type, storing the target file into a memory cache; and if the to-be-stored type of the target file is the standard storage type, storing the target file into a solid state disk cache. The invention further provides a device, equipment and a medium. In addition, the invention also relates to a block chain technology, and the access frequency information and the target file can be stored in a block chain. The method can improve the utilization rate of storage resources.

The embodiment of the invention provides a data caching method, system and device and a storage medium, and the method comprises the steps: obtaining a target file in a target conversation of instant messaging software, and enabling the instant messaging software to be installed in target equipment; determining a target object of the target dialogue; determining a target task based on the target object and the target file; based on the target object, the target file and the target task, determining the storage popularity of the target file; wherein the storage heat is used for measuring the importance degree of the target file to the target object and the target task; and determining a storage strategy of the target file based on the storage popularity.

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention provides a file observation method, electronic equipment, a chip and a program product, in the method, path information of a file is recorded in an expanded BPF map in advance at a creation point of an index node inode of a target file, and when the target file needs to be observed, the path information of the file is recorded in the BPF map in advance. The corresponding path information can be obtained from the BPF map by using the identification information of the target file, so that the file is observed according to the path information, and important data support is provided for system tuning.

The invention relates to the technical field of cloud computing, and particularly provides a data cache prefetching method and device, a storage medium and a program product. According to the method, file access characteristics representing file access preferences of a user are obtained based on historical access data of the user, a target file meeting a cache prefetching strategy is determined based on the file access characteristics, and the target file is cached and prefetched. By dynamically analyzing the historical access data of the user, the system can adjust the cache content in real time, actively load the data possibly required by the user and ensure that the high-frequency access data is always available, and the mechanism not only improves the data access speed, but also remarkably reduces the influence caused by network delay.

The invention discloses a cloud storage acceleration method and system based on edge computing, and relates to the field of electrical digital data process.The method comprises the steps that a file access track ring is constructed; extracting historical access files as a first associated file set; calculating the access time difference of each historical access file; determining a plurality of association clusters and two association file sets according to the access time difference; performing cyclic displacement in the second associated file set to obtain a displacement associated cluster; extracting a third associated file set; determining a prefetching file; setting an annular cache queue, and determining a prefetching position according to the position information; when the space of the annular cache queue is smaller than a preset value, the prefetched file corresponding to the prefetched position in the preset interval of the annular cache queue is reserved, and a final prefetched file is obtained; and when it is detected that the user accesses the target file, loading the final prefetched file from the cloud storage server to the edge server. The method and device are used for solving the problem that the cache hit rate of the associated files is reduced, and the cloud storage acceleration speed is increased.

The invention relates to a file outgoing control method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: monitoring a running state of a target process of an application program; under the condition that it is monitored that the target process starts to run, a preset dynamic link library is injected into the target process; loading the dynamic link library to call a hook function, monitoring file out-of-issue in the target process, and intercepting a file path corresponding to the file out-of-issue; obtaining a target file from the file path; inputting the target file into a Bi-LSTM-Attention detection model to identify whether the target file contains preset sensitive information or not; and when the target file contains the preset sensitive information, blocking outgoing of the target file by the target process. By adopting the method, the risk that the application program is stuck or crashed due to file outgoing management and control can be reduced.

The invention discloses a cross-network file ferrying system, and relates to the technical field of file transmission, a user side end is set to obtain a target file selected and uploaded by a target user, a cross-network file transmission module is set to execute a pre-processing operation on the target file to obtain a pre-processed file, and then a grouping operation is executed on the pre-processed file; after the grouping operation is completed, executing an addition operation of a binary algorithm on two adjacent groups of block arrays, recording carry bits in the execution of the addition operation, and determining the execution carry type of each block array according to the characteristic whether the numerical value of the carry bits is continuous or not and whether the carry bits exist or not; according to the method and the device, the block array is selected, then the carry state sequence and the reverse array of the block array are determined according to the execution carry type, and the target file is encrypted in this way, so that on one hand, encryption and decryption of data obtained after encryption depend on data characteristics of the file and get rid of key dependence, and the risk of key loss is avoided; and safer cross-network file transmission is realized.

The embodiment of the invention provides a method and device for obtaining metadata in a file system, equipment and a storage medium, and the method comprises the steps: constructing a metadata index node corresponding to the file system according to file paths of a plurality of files in the file system; analyzing a file path of the target file to obtain a target path section with a hierarchical structure; the target path segment comprises a termination path segment located at the last level; according to the hierarchical structure, traversing the index node corresponding to the target path segment in the metadata index nodes, and determining the index node corresponding to the termination path segment as a target node; and extracting metadata corresponding to the target file from the target node. According to the embodiment of the invention, the metadata can be quickly positioned by constructing the metadata index node, and the metadata index node enables the metadata storage structure of the file system to be convenient for subsequent query and management; moreover, the metadata is acquired based on the metadata index node, so that the time complexity of acquiring the metadata is reduced, and the overall performance of the file system is improved.