1351 results about "File storage" patented technology

Techniques are described for efficient replication and maintaining snapshot data consistency during file storage replication between file systems in different cloud infrastructure regions. In certain embodiments, provenance IDs are used to efficiently identify a starting point (e.g., a base snapshot) for a cross-region replication process, conserve cloud resources while reducing network and IO traffic.

Techniques are described for efficient replication and maintaining snapshot data consistency during file storage replication between file systems in different cloud infrastructure regions. In certain embodiments, snapshot creation and deletion requests that occur during cross-region replications may be temporarily withheld until appropriate times to execute such requests safely, depending on the timing relationship between such requests and cross-region replication cycles.

The invention discloses a memory combination screening method, device and equipment and a medium, and relates to the technical field of computers, and the method comprises the following steps: generating all memory files of a system-on-chip according to a preset memory naming rule; storing each memory file to a target memory library, obtaining all memory names based on the register transfer level code and a preset memory naming rule, and generating a memory list based on each memory name; acquiring corresponding physical parameter information from a target memory library based on each memory name in the memory list, and determining target physical parameter information of each memory split combination corresponding to each memory according to the physical parameter information; and screening the memory split combination based on a preset physical information threshold and the target physical parameter information to obtain a screened memory combination. According to the method and the device, the memory list can be quickly and accurately generated, and all combinations meeting constraints are screened out.

The invention provides a private deployment-oriented multi-modal AI knowledge base construction system. The private deployment-oriented multi-modal AI knowledge base construction system comprises a knowledge storage module, an intelligent document loading module, a document partitioning engine module, a data enhancement engine module, a multi-language semantic vector alignment module and a private deployment module, the knowledge storage module comprises a knowledge authority management sub-module and a knowledge source management sub-module, the knowledge authority management sub-module is used for managing and storing knowledge from different sources, and the knowledge source management sub-module is used for managing electronic documents and multimedia documents; according to the method, intelligent identification, partitioning, vectorization and source file storage can be carried out on different types of electronic files, knowledge graph construction is carried out for specific fields, semantic relevance between texts and topics and key entities is fully considered, the method has wider applicability, higher robustness and controllability, the data leakage risk is effectively reduced, and the method is suitable for popularization and application. The method is suitable for enterprise sensitive data protection and personal user elastic computing power requirements.

A system for data collection related to a fluid conveyance environment includes a data acquisition circuit comprising inputs and outputs; input sensors to provide sensor data values, coupled to a component in the fluid conveyance environment; and a processor comprising the data acquisition circuit. The processor is configured to determine a data storage profile; responsive to the data storage profile, configure the data acquisition circuit to selectively couple at least one of the inputs to at least one of the outputs; interpret the at least one of the sensor data values; store at least a portion of the at least one of the sensor data values in response to the data storage profile; analyze a set of the sensor data values and determine a data quality parameter; and adjust at least one of the data storage profile and a data collection routine in response to the data quality parameter.

In an example embodiment, a language server connected to an integrated Development Environment (IDE) is used to identify, from a given input code, various code artifacts, such as functions, variables, etc., and then to search a repository of code files for declarations, definitions, and references related to those identified code artifacts. The declarations, definitions, and references can then be passed as context into an LLM.

The invention provides an information processing method and system applied to all-flash file storage, and the method comprises the steps: firstly obtaining storage request information received by a target storage node, including a to-be-processed data block set and an expected storage attribute set, thereby describing the configuration requirements of storage capacity distribution, access path optimization and data compression level; extracting multi-dimensional features of a to-be-processed data block set to generate a data block feature vector, encoding attributes of an expected storage attribute set to generate a storage attribute feature vector, inputting the data block feature vector and the storage attribute feature vector into a pre-trained storage strategy generation model for dynamic weight fusion, and outputting a target storage strategy parameter set meeting configuration requirement constraint conditions; finally, relevant parameters are generated, the all-flash storage system is driven to execute distributed storage operation on the data block set, and efficient and intelligent all-flash storage information processing is achieved.

The techniques disclosed herein enable systems to manage remote file storage systems while bolstering information security through file encryption on download and permissions labels. To achieve this, a site owner configures permissions for a network site that stores files and that enables encryption on download. Various users with file access via the permissions may then interact with the site. When a user downloads a file from the site, they receive an encrypted copy that includes a permissions label that synchronizes with the network site permissions. When a user attempts to interact with an encrypted file the permissions label is used by the system to determine whether the user is authorized to access the file. In addition, permissions that are changed at the network site can be propagated to downloaded encrypted copies. In this way, permissions can be enforced for all site files even when copies leave the network site.

To provide a mechanism capable of easily searching for information indicating a file storage location without being restricted by circumstances under which the file has been stored on a network.SOLUTION: A user terminal 101, which can be connected via a network 105 to a large language model server 103 in which a large language model searches for URLs being information indicating file storage locations on the basis of similarity of language vectors of natural language, comprises a CPU 201 that transmits, in natural language, a query sentence for inquiring about a file storage location to the large language model, and receives, from the large language model, a response sentence that conveys a URL being information indicating the file storage location searched by the large language model using a language vector of the natural language of the query sentence.SELECTED DRAWING: Figure 1

The invention relates to the field of financial science and technology, and particularly discloses a cross-platform financial data integration and real-time analysis system and method. The system is characterized in that a distributed heterogeneous data acquisition module accesses multi-source data in parallel through a pluggable protocol adapter; the streaming data cleaning engine realizes field-level normalization based on a dynamic template and semantic mapping; the hybrid storage architecture forms a three-level system by a memory database, a time sequence database and distributed file storage; the stream processing core engine adopts an elastic sliding window to execute CEP complex event processing; and the dynamic analysis decision module integrates online machine learning to generate a real-time transaction signal. The method comprises the steps of multi-source concurrent acquisition and microsecond-level timestamp injection, context sensing data standardization, dual-channel data storage, event time window aggregation, dynamic risk calculation and block chain audit evidence storage. The defects of low data fusion efficiency, high real-time analysis delay and the like in the prior art are overcome, and cross-platform data processing timeliness and decision accuracy are remarkably improved.

The invention provides a star catalogue file generation method and device, a celestial body data query method and device, computer equipment and a storage medium. The star catalogue file generation method comprises the steps of obtaining star catalogue data; dividing the celestial sphere surface area corresponding to the plurality of celestial bodies into a plurality of local areas, and determining an identifier of each local area; determining an identifier matched with each celestial body data according to the right ascension and declination included in the celestial body data and the identifier of each local area in the celestial sphere surface area; sorting the celestial body data of the plurality of celestial bodies based on the identifiers corresponding to the celestial body data; and writing the sequenced celestial body data of the plurality of celestial bodies into an initial column storage file matched with the identifier to obtain a target file stored with the celestial body data, and generating file index information corresponding to the target file. The celestial body data is stored by utilizing the column type storage file, so that the problems of high maintenance cost and high use threshold caused by utilizing a database to store data are relieved while the data query efficiency is guaranteed.

The invention discloses an archive arrangement system and method capable of achieving multilingual conversion, and relates to the technical field of archive arrangement. The system comprises a multilingual archive database, a semantic analysis module, a retrieval matching module and a user interaction interface; according to the method, a multi-language association retrieval system based on semantic understanding is constructed, a semantic deep mining algorithm, a cross-language semantic association algorithm and a semantic association degree algorithm are applied, the effect of accurately matching semantic similar contents in files of different languages is achieved, and automatic index updating and incremental updating algorithms are designed for a multi-language file database, so that the accuracy of the multi-language file database is improved. According to the method, the effect of efficient file storage and query is achieved, complexity and resource waste of index updating during new file input or information change are avoided, the effect of extracting semantic features more accurately is achieved by customizing preprocessing processes for different language texts and combining a word vector generation algorithm based on semantic context, and the efficiency of file storage and query is improved. And the accuracy and efficiency of multi-language archive arrangement are improved.

Systems and methods are provided for implementing deep search functionality using large language models (“LLMs”). In various examples, a computing system uses at least one LLM to generate intents based on a user query, to generate alternative queries based on a selected or identified primary intent, and to generate a relevance score for each search result that is obtained from a search utility (e.g., an Internet search engine, a file storage search utility, an email search utility, or a document storage search utility) in response to a primary query (corresponding to the primary intent) and the generated alternative queries being entered into the search utility. The search results from the search utility are sorted based on the corresponding generated relevance scores, and the sorted search results are caused to be displayed to the user as a deep search response to the user query.

This disclosure describes embodiments of systems, methods, and non-transitory computer readable storage media that can display icons for target digital content items and candidate destination folders within different sections of a multi-section graphical user interface (GUI) and adjust a corresponding file storage structure to reflect organization changes indicated by user interactions that move digital-content-items icons into folder icons. For example, the disclosed system can (i) display, within a first section of a multi-section GUI, icons representing digital content items and (ii) display, within a second section of the multi-section GUI, icons representing folders as candidate destination folders. Then, the disclosed systems can detect user interactions that move digital-content-item icons to folder icons and adjust an underlying file storage structure to reflect the organization indicated by the user interaction.

Techniques are described for performing different types of restart operations for a file storage replication between a source file system and a target file system in different cloud infrastructure regions. In certain embodiments, the disclosed techniques perform a restart operation to terminate a current cross-region replication by synchronizing resource cleanup operations in the source file system and the target file system, respectively. In other embodiments, disclosed techniques perform a restart operation to allow a customer to reuse the source file system by identifying a restartable base snapshot in the source file system without dependency on the target file system.

The invention relates to the technical field of computational fluid mechanics data post-processing, and particularly discloses an OpenFOAM unsteady state simulation result-oriented boundary surface physical quantity calculation method, which comprises the following steps of: setting a working root directory, reading a grid file and establishing an example grid; accessing a time control function, and reading simulation time information of each time folder; establishing a global blank file to store boundary surface physical quantity results, first line writing time and physical quantity variable names at all moments; sequentially reading field quantity data required by calculation in the time folder; appointing and searching the name of a concerned boundary surface, creating a scalar field magSf of the boundary surface, and calculating and storing the area of a grid surface element; defining and initializing physical quantities and intermediate quantities of boundary surfaces, calculating physical quantities and intermediate variables of surface elements of each grid, and traversing the grids; and writing a result from the second line of the global file according to a time sequence, and traversing all times. By the adoption of the method, key data at all moments can be accurately extracted, errors and complexity caused by manual processing are avoided, and the calculation efficiency is greatly improved.

The invention discloses a load balancing optimization method and device, electronic equipment and a storage medium, and relates to the technical field of load balancing optimization, and the method comprises the steps: carrying out the differentiation processing of a data migration task according to a file storage threshold value, and combining a migration performance index and server resource occupation information collected in real time, the task allocation strategy is adjusted through the dynamic task allocation algorithm, so that the reasonable allocation of the files with different sizes and the dynamic load optimization in the migration process are realized. The technical problems that in the prior art, server overload and resource idling coexist due to a single migration server or a static task allocation strategy, high delay and data inconsistency risks are generated due to network congestion and uneven task allocation in the migration process, and the overall performance and reliability of a system are affected can be solved. The technical effects of optimizing the load balance degree, reducing overload and idle conditions of the server, reducing migration delay, ensuring data consistency and improving the overall performance and reliability of the system are achieved.

The invention relates to the technical field of network information security, in particular to a digital space full-flow encryption transmission system and method, and the system comprises an entrance authentication module, a structure closing module, an identity binding module, an authority verification module and a path trace module. According to the method, the access list is generated through joint identification of operator identity information, access environment identification and terminal network attribution, a multi-dimensional credible judgment basis of an access source is constructed, and structured identification and positioning of an access target are realized by combining path hierarchy extraction and file storage state classification; identity fields and path mapping relations are subjected to cross matching to form unique binding identifiers, a clear data access index system is established, authority control is based on bidirectional matching of access levels and attribution groups, authority verification precision and boundary definition are improved, access behaviors generate sequences through path, time and file operations, and identities are bound. And a verifiable and traceable data flow structure with closed-loop control capability is formed.

In one embodiment, a computer implemented method includes storing objects in a first bucket and storing files in a second bucket of a first storage cluster of the distributed storage system, synchronously replicating data of the objects into a third mirrored bucket of a second storage cluster of the distributed storage system, synchronously replicating OSP configuration data from the first storage cluster to the second storage cluster during the synchronous replication, and providing non-disruptive operations with zero recovery time objective (RTO), and ensuring consistency between the objects in the first bucket and the objects in the third bucket for a software application that is accessing one or more objects and files using the OSP. The objects and files are accessible through an object storage protocol (OSP).

Embodiments of the present disclosure provide a log storage method, a database system, a server, and a storage medium. In the log storage method, any database node in a distributed database can use a storage engine component to acquire a transaction log of a target transaction, and write the transaction log into a target online log file. The database node can use the storage engine to persistently store the transaction log in the target online log file into a corresponding target block device, and perform a transaction-level persistent storage operation on metadata information of the target online log file. In the implementation, on the basis of the online log file supporting a write operation at any location, the database node can directly store the transaction log in a block storage mode on the basis of the storage engine assembly of the database node without depending on a file system, thereby reducing resource overhead caused by incorporating the file system and a file storage mode.

Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.

The embodiment of the invention provides a chip verification method, device, system and equipment, a medium and a program.The verification method comprises the steps that a chip is simulated, the chip comprises a program running module and a memory storage module, the program running module is used for running a software program, and a program file of the software program is stored in the memory storage module; executing the simulation case to enable the program running module to call the program file for processing; in the process that the program running module calls the program file, a read-write event of a memory storage module is monitored so as to track the variable change condition of the software program, and the memory storage module is provided with a memory area distributed for variables of the software program; the variable change condition is synchronized and displayed to reflect the running state of the software program, and the running state is used for judging whether the processing of the program running module on the software program reaches the design expectation or not. According to the verification method provided by the embodiment of the invention, software and hardware joint simulation verification of the chip is realized.

The invention provides a lightweight large model operation method based on end-side deployment. The lightweight large model operation method comprises the following steps: acquiring equipment operation data and storing a model file in a mixed precision format according to quantization precision supported by terminal equipment; determining a mixing precision quantification strategy and carrying out strategy analysis on the equipment operation data; a Key-Value cache file obtained through model reasoning in the historical dialogue is reserved; calculating a semantic embedding vector of the second user request, calculating a cosine similarity between the semantic embedding vector and the first V vector, and judging whether the second user request has a similar intention or not according to a calculation result; and if yes, performing incremental reasoning on the second user request by multiplexing the Key-Value cache file. By monitoring the state of the terminal equipment in real time, dynamically adjusting the quantization level, multiplexing the cache data of the semantic related requests and merging batch request reasoning, the effects of balancing the energy consumption and performance of the terminal equipment, reducing repeated calculation and improving the service time of the equipment and the user experience are achieved.

The invention provides a Web-based intelligent image creation system and an implementation method thereof. The system comprises a Web application service module, an image creation module and an image creation module, the model service cluster comprises a Docker container deployment text-to-image generation model based on Kubernetes management, an image-to-image conversion model and a low-rank adaptive model LoRA; the distributed file storage system is used for storing a user-defined model, a training data set and a generated work and supporting multi-copy redundant backup; the integrated LoRA training module provides data set labeling, trigger word binding and training parameter optimization functions; the multi-modal image processing module has the functions of local redrawing, intelligent image expansion, super-resolution repair and style migration; and the dual-channel content security auditing module adopts BERT text filtering and YOLOv5 image recognition technologies. The technical defect that an existing AI generation tool cannot support a user-defined model and a dynamic extension service is overcome, and the whole-process closed-loop operation of a user from data labeling to model deployment is supported.

The embodiment of the invention discloses a virtual file management method, system and device and a storage medium. According to the technical scheme provided by the embodiment of the invention, under the condition that the file request is received, the virtual path contained in the file request is extracted, the virtual path is created when the target file is generated, path classification is performed according to the module identifier of the associated target service module, and the target file is stored in the system path mapped by the virtual path. The system path is generated by mapping based on the virtual path and a pre-constructed mapping rule; mapping the virtual path into a corresponding system path based on a mapping rule; and accessing the target file based on the system path to execute a file operation corresponding to the file request. By means of the technical means, the situation that file directory structures of different service modules are disordered can be avoided, unified file management of the different service modules in the application is achieved, the file management efficiency of the different service modules is improved, the application service effect is improved, and therefore the user experience is improved.

The invention discloses a file hiding method and system based on an ext4 file system, and the method comprises the steps: obtaining a target file and metadata information of a directory where the target file is located according to a target file path needing to be hidden, and distributing a new mapping item in an internal mapping table of the ext4 file system for recording; creating a new hard link in a directory where the target file is located, and associating the new hard link with an inode node for storing metadata information of the target file; reopening the ext4 file system, and deleting the directory entry of the target file, so that the target file cannot be found in the ext4 file system; and re-mounting the ext4 file system, refreshing the Linux kernel cache, and recording the new hard link, the original name of the target file, the inode node number of the target file and the file type into a new mapping item. According to the invention, data security can be ensured, and efficient hidden storage of files is realized.

The invention discloses a distributed cloud native storage-oriented small file merging optimization method, which comprises the following steps of: converting data into a structure suitable for analysis by analyzing an HDFS (Hadoop Distributed File System) access log, and proposing a relevance analysis algorithm based on a user access mode. And discovering association rules from the file access records by using an FP-Growth algorithm: compressing transaction data and determining a frequent item set by constructing an FP tree, and generating the association rules conforming to the support degree and the confidence coefficient from the frequent item set. Respectively processing the small files with different relevance according to the generated rule; searching the small files with strong relevance, and merging the files by adopting a small file merging strategy based on a Huffman tree; small files with weak relevance are continuously added into a waiting queue, and when the queue meets the HDFS data node storage size condition, merging storage is carried out. According to the method, the file storage space of the HDFS is optimized, and the access efficiency of massive small files is improved. The method belongs to the field of correlation analysis and small file storage.

The invention relates to the technical field of file storage management, and discloses a Lustre architecture-based high-performance file storage and processing method and system, the method comprises the following steps: obtaining spatio-temporal characteristics of file access; predicting a popularity value of the file based on the spatial-temporal characteristics; determining a storage strategy of the file based on the popularity value of the file; carrying out distributed storage on the file based on the storage strategy, and continuously detecting a node state; if it is detected that the node load is unstable, adaptive data migration is carried out on the node with the unstable load; if the node is detected to have a fault, generating a data recovery path based on the three-dimensional topological coordinates of the node, and migrating a file stored in the node having the fault based on the data recovery path; according to the method, the storage strategy is determined through the file popularity value, and the abnormal condition of the node is efficiently processed, so that the file storage and processing performance and efficiency are comprehensively improved.

The invention discloses a resource usage amount statistical method and system oriented to an application mirror image, and belongs to the technical field of cloud computing and containerization. The method comprises the steps that duplicate removal and calculation are conducted on files of all mirror image layers according to the identification result of the files, and the file storage amount is obtained; collecting resource use state data of the application mirror image and inputting the data into the resource competition game model, so that the resource competition game model outputs the calling weight of each process in each mirror image layer and determines a resource occupation ratio by solving a Nash equilibrium strategy; dividing the current system resource usage data to each current process based on the corresponding relationship between each current process and each current mirror image layer, and determining the resource usage amount of each current mirror image layer according to each resource occupation proportion; and summarizing the resource usage amount and the file storage amount of each layer to obtain the total resource usage amount of the current application mirror image, so that accurate statistics of the resource usage amount can be realized.

The present application provides a message index processing method, a device, and a storage medium. The method comprises: acquiring a first index file from a local disk, wherein the first index file comprises a plurality of index slots and a plurality of index entries used for storing index information of different messages, index information corresponding to each of at least two messages mapped to a first index slot is stored in at least two index entries at non-contiguous addresses, and the first index slot stores address information of an index entry among the at least two index entries, said index entry storing index information of a message last mapped to the first index slot; performing format conversion on the first index file to obtain a second index file; and storing the second index file in an external distributed storage system.