99 results about "Indexed file" patented technology

The invention discloses an electronic archive management method for a business document generation layout file, and belongs to the technical field of electronic archive management. Comprising the following steps: constructing a multi-dimensional feature vector by collecting business document scene features, screening candidate templates from a template pool by adopting a multi-level similarity matching algorithm, and adjusting and determining a target template in combination with a dynamic structure; the basic metadata and the associated system data are integrated, and qualified metadata is output through multi-level rule verification and abnormal data correction; based on the target template, executing data filling typesetting and format resource preprocessing by adopting a double-thread asynchronous processing mechanism, and generating a layout file conforming to PDF / OFD double standards through an adaptive algorithm; calculating a hash value of the layout file and writing the hash value into a block chain to realize tamper-proof evidence storage, and realizing secure storage and quick retrieval by adopting a distributed architecture in which a main file is separated from an index file. According to the method, the problems of low template matching precision, incomplete data verification, low processing efficiency, insufficient file safety guarantee and the like in the prior art are solved.

The invention discloses a firmware upgrading method and device, electronic equipment and a storage medium, and relates to the technical field of servers, the method comprises the following steps: receiving a confirmation request from a substrate management controller; when it is determined that firmware upgrading is supported based on the confirmation request, confirmation information is sent; receiving each piece of original version information of a plurality of original firmware mirror images sent by the substrate management controller based on the confirmation information; searching the highest version information on which each piece of original version information depends in a preset mapping relation library; determining at least one original firmware mirror image to be upgraded according to the dependent highest version information; obtaining a storage path of mirror image identification information and a target firmware mirror image corresponding to each piece of original firmware to be upgraded; and generating an index file according to the mirror image identification information and the storage path, and sending the index file to the substrate management controller. According to the method and the device, the problems of long firmware upgrading time consumption and low upgrading efficiency caused by large volume of a full package for firmware upgrading are solved.

The application discloses a kind of high-performance distributed mass vector similarity search system and method, including Faiss Driver, several Faiss Worker and Etcd system;Faiss Driver is used to receive the query request of user end, and the query request is forwarded to the selected Faiss Worker by proxy, and is configured to perform loading configuration Etcd monitoring, exit pre-processing, service discovery and master-slave election task;Faiss Worker is the unit for executing query calculation in search system, and is configured to perform configuration management, shutdown processing, timing task, load index and query calculation task, for calculating similar vector retrieval and updating online or offline index file;Etcd system is used to save Faiss Worker list, master-slave state of Faiss Worker, health status of Faiss Worker, external storage module address of index file and index file list.The application introduces proxy forwarding service mechanism and master-slave node registration mechanism, and can efficiently process vector query calculation request.

This invention relates to a method for checking the consistency of row-level data files and index files based on the OpenGauss database. This method can be used to check the consistency of the physical files of the main table, the physical files of the index table, and the logical consistency of the physical files of the main table and the index table. This consistency checking method overcomes the shortcomings of traditional data file consistency verification methods, such as delayed startup and the possibility of business failures or even database instance anomalies due to check failures. Through this method, DBAs can periodically and proactively perform full consistency checks on the physical files of specified tables during daily operations and maintenance. It can also check the consistency relationship between the physical files of the b-tree indexes related to the main table and the physical files of the main table, thereby enabling timely detection of data file consistency issues in the database and taking corresponding remedial and mitigation measures to minimize potential impact and losses.

The invention relates to a log processing method based on dynamic triggering and index driving, and relates to the technical field of computer software, and the method comprises the following steps: coding log entries through a dictionary coding rule, generating coded log entries, and writing the coded log entries into a plaintext log file; monitoring a file state of the plaintext log file, and when the file state meets a preset dynamic triggering condition, compressing the plaintext log file to generate a compressed log file; generating an index file associated with the compressed log file, wherein the index file comprises metadata; and in response to a user query request, positioning and compressing a target data block in the log file based on the metadata, decompressing and reversely decoding the target data block, and filtering decoded log contents according to the query mode to output a log query result. By means of the scheme, development complexity is reduced, efficient real-time compression is achieved, full scanning is avoided, consumed time in the index positioning stage is reduced from the minute level to the millisecond level, and query efficiency is improved.

The present application relates to the technical field of database, in particular to an index updating method, product, medium and equipment. The index updating method comprises: triggering index page inspection by using a preset hybrid scheduling strategy, and identifying a to-be-merged page in an index file; judging whether a target page matching the to-be-merged page exists in the index file; if yes, acquiring a page lock of the to-be-merged page and the target page; merging the to-be-merged page and the target page, and releasing the page lock. The present application locks and releases by page granularity before and after page merging, ensures the atomicity and concurrent safety of the merging operation, avoids locking the whole table or the whole index, effectively suppresses the index file expansion without blocking normal read-write business, and improves the system availability.

The embodiment of the invention discloses a webpage picture loading method and device. The specific implementation mode of the method comprises the steps that a client side responds to a received request for loading a webpage picture, loads a Sprite map from a content distribution network and obtains an index file, and the Sprite map comprises a thumbnail of the webpage picture; querying the coordinate position of the thumbnail in the Sprite map in the index file according to the address of the webpage picture; and obtaining the thumbnail from the Sprite map according to the inquired coordinate position, and rendering the thumbnail. The server is used for generating a thumbnail based on the original picture in the picture resource library; based on the thumbnail, constructing a Sprite map, and generating an index file, the index file comprising an address of the Sprite map and a coordinate position of the thumbnail in the Sprite map; and publishing the Sprite map, the original map and the index file to a content distribution network. According to the embodiment, the abnormal problems of lagging and even unavailability caused by simultaneous display of massive pictures on a webpage are solved based on a Sprite map technology.

This application provides a data storage management method, apparatus, device, and storage medium, relating to the field of database technology. In this method, the database system's index file, log file, and multiple data files are all stored in non-volatile memory. Thus, when an operation instruction for an original data record in the database is received, the original data record is directly located from the multiple data files using the index file, and an operation transaction is executed on the located original data record. Upon successful execution of the operation transaction, the transaction number is added to the log file. Since updates to the index file, data file, and log file in non-volatile memory can be immediately persisted without needing to be flushed to disk, the additional time and resource overhead of migrating data between different storage media is avoided. This also improves data write and read speeds, meeting the real-time data read and write requirements of various application scenarios.

This application provides a rapid migration method and system based on customized data packages, as well as a readable storage medium. The rapid migration method based on customized data packages includes: extracting metadata from oil and gas exploration data using a general data acquisition module, employing the system's native API and file parsing algorithms; based on the metadata and the target operating system, formulating a migration strategy and monitoring the migration process through a control module, and generating a task execution list; dynamically adjusting the execution plan of the task execution list through a scheduling module, and generating a task execution priority list; and according to the task execution priority list, encapsulating and transmitting the data to the target system through a migration module, and unpacking the data according to the mapping index file and the unpacking priority list. Through the technical solution of this application, seamless data synchronization across operating systems can be achieved through customized data packaging and index mapping strategies, ensuring that the migrated data is immediately available and improving the execution efficiency of seismic exploration projects in multi-platform collaborative scenarios.

A system for customizable video playback includes: a customizable video playback server including a video database and a playback manager; and a plurality of customizable video playback devices, each including a dynamic index file and a playback controller, wherein the customizable video playback device enables a user to select a source video from the video database, and select a list of variable length video chunks from the source video, such that the variable length video chunks are sequenced by the dynamic index file, according to sequencing input from the user, to produce a customized video. Also disclosed is a method for customizable video playback, including selecting a source video, selecting variable-length video chunks, sequencing the customized video using a dynamic index file, and playing the customized video.

The invention discloses an HLS streaming media load balancing-based forwarding synchronization method, which comprises the following steps of: writing into a node in a server cluster through a scheduling algorithm on the basis of an RTMP (Real Time Messaging Protocol) stream pushing access address, and obtaining a live broadcast data stream through a client on the basis of an HTTP-FLV (Hyper Text Transfer Protocol-Flash Virtualization) address; based on the real-time code stream data, driving and starting a slicer process by starting an hls instruction; obtaining first slice fragment data by waiting for a preset key frame interval based on the real-time code stream data, obtaining a slice file through a packaging module based on the first slice fragment data, and storing the slice file in a disk; a slice file storage disk successfully drives a closing file descriptor and generates a completion signal file, and the completion signal file is written into an index file of an HLS protocol in real time through a sliding window; copying the slice file and the index file to other nodes in the server cluster through a tool based on the completion signal file; and driving a deletion completion signal file based on the copy success signal, and deleting the historical slice file and the index record in real time to realize storage of the latest time sequence file in the disk.

The application relates to a file processing control method, device, equipment, storage medium and program product. The method comprises the following steps: acquiring a file processing plan; acquiring a corresponding target index file from an upstream system according to the file processing plan; determining a target data file to be processed from the upstream system according to the file processing plan; when the index file corresponding to the target data file is successfully acquired, acquiring the target data file from the upstream system and processing the target data file; and when the index file corresponding to the target data file is not successfully acquired, returning to the step of acquiring the corresponding index file from the upstream system according to the file processing plan. The method can automatically perform business processing and reduce manual intervention.

The railway dispatch centralized data storage method and system, retrieval system and electronic device disclosed in the application, compared with the prior art, the storage method comprises the following steps: constructing a full-station information table of a current station site; acquiring real-time train operation data; combining the full-station information table, analyzing and identifying the change data in the real-time train operation data; updating the full-station information table in combination with the change data; storing the latest full-station information table in the form of a data file; calculating the position information and time label of the change data in the data file; the time label is combined with the position information to generate an index file in a fixed length and format; and the index file is stored. The technical scheme disclosed in the application can reduce the amount of stored data and improve the efficiency of data retrieval.

Methods, systems, and devices for data management are described. A data management system (DMS) may support backup and recovery of a filesystem. The DMS may, as part of the backup, obtain a snapshot of the filesystem. The DMS may mount the snapshot within a user space of a node of the DMS. The user space may be isolated from other processes that execute on the node of the DMS. The DMS may generate, within the user space based on the mounted snapshot, index files that index the filesystem. In response to a subsequent request to access one or more files, the DMS may retrieve the one or more files from the snapshot mounted in the user space based on the index files.

The invention relates to a media distribution method and device, computer equipment, a readable storage medium and a program product. The method comprises the steps of detecting a network type of a terminal in response to a media acquisition request sent by the terminal for a target media; according to whether the network type of the terminal is a preset network type, sending the first index file or the second index file to the terminal; wherein the first index file is used for obtaining fragment links corresponding to all first media fragments of the target media, and the second index file is used for obtaining fragment links corresponding to all second media fragments of the target media; the duration of the first media fragment is less than that of the second media fragment. By adopting the method, the timeliness of code rate switching in the streaming media transmission process can be improved, and the phenomenon of media playing lagging under the condition of large network fluctuation is reduced.

The invention discloses a decoupling type recording and broadcasting method and system based on a key frame index and difference additional recording, and the method comprises the steps: firstly continuously collecting multiple paths of audio and video streams, segmenting the audio and video streams into video fragment files, meanwhile, carrying out the parallel real-time detection of a board key event, and generating a key frame index file in which an event type and a millisecond timestamp are recorded; after class, according to the effective starting and ending time of the actual course and the index file, precisely extracting videos of corresponding time periods from the stored fragments; if fragment missing is found, fragments of other machine positions in the same time period are searched based on indexes, patch video fragments are generated through frame-level difference encoding, finally, the patch video fragments and normal video fragments are spliced to form a complete classroom record, and through a decoupling architecture of full-amount recording, event indexing, post-event accurate extraction and additional difference recording, the complete classroom record is obtained. According to the invention, the problem of missed recording and wrong recording caused by equipment delay, class schedule change or recording interruption in the prior art is solved, and the integrity of recorded content, the time alignment precision and the system fault-tolerant capability are remarkably improved.

The invention provides a data storage method, which comprises the following steps of: for a storage position in a storage unit, processing each piece of signaling data stored in the storage position in a historical time period to obtain a target file; the target file comprises a data file and an index file thereof, and the index file is used for describing the position of each piece of signaling data in the data file in the storage position; and storing the target file in the storage position. The invention further provides a data storage method, electronic equipment, a computer readable medium and a computer program product.

A cloud-based (CRM) data storage system with query support is provided. The system includes a memory storing processor-executable routines and a processor configured to execute routines to initiate a data backup operation for customers of the system. The processor is configured to receive source data having at least one of data schema, records / CRM data, and blob data and to transform the source data into a columnar storage format to generate converted source data and corresponding index files. Further, versioning data for the source data, converted source data and corresponding index files for each customer are stored. The processor is configured to receive a data query having query parameters from customers and to identify index files and / or data files to be scanned from the converted source data, and to scan the identified index files and / or data files to generate data query results.

The application discloses a meta-universe data processing method and device, relates to the technical field of meta-universe and artificial intelligence, and comprises the following steps: collecting a plurality of meta-universe data for a plurality of meta-universe data; based on the correlation between the pre-created meta-universe data types and data feature extraction methods, extracting and classifying the data features of each meta-universe data collected; according to the classification result, performing distributed storage on each meta-universe data and the corresponding data features in a parallel processing mode, and establishing an index file representing the meta-universe data, the corresponding data features and the corresponding storage location; based on a terminal meta-universe access request, calling the target meta-universe data and the corresponding data features corresponding to the request according to the index file; and performing real-time calculation and rendering display on the called data in an edge computing mode. The application is used to improve the processing efficiency, accuracy and timeliness of meta-universe data.

A data management system (DMS) may receive entries corresponding to files and directories of a storage system that changed within a time period. The received entries may include metadata associated with the changed files and directories. The DMS may identify one or more directories that were renamed or deleted within the time period by analyzing the metadata from the received entries. The DMS may identify descendent directories and descendent files corresponding to the one or more renamed or deleted directories. The DMS may update path identifiers associated with the descendent directories and the descendent files based on the metadata from the received entries. The DMS may generate an updated index file based on updating the path identifiers for the descendent directories and the descendent files. The described techniques may enable the DMS to identify renames and deletions with greater efficiency, among other benefits.

The invention discloses a data writing method, a data query method, electronic equipment and a storage medium, and the method comprises the steps: generating a target data file based on to-be-written data, and storing the target data file to a target storage system to obtain a first storage path; generating at least one target index file corresponding to the target data file, and storing each target index file to a target storage system to obtain a second storage path; wherein the target data file and the corresponding target index file are separately stored in the target storage system; generating a target metadata file by using the first storage path and the second storage path; and carrying out atomic submission on the target metadata file so as to switch the target metadata file into a current metadata file of the Iceberg table. In this way, the data query efficiency can be improved.

This invention discloses an approximate nearest neighbor connection optimization method for encrypted databases based on PM# trees, belonging to the field of approximate nearest neighbor connection optimization technology for encrypted databases. It solves the problems of low retrieval efficiency and insecure retrieval processes in existing technologies. The method includes: projecting a high-dimensional dataset into a low-dimensional space using hash projection to obtain a low-dimensional dataset; encrypting the high-dimensional dataset to obtain an encrypted high-dimensional dataset; deleting redundant nodes generated during node splitting in the PM# tree to obtain a PM# tree, and using the PM# tree to build an index on the high-dimensional dataset to obtain an index file; encrypting the index file to obtain an encrypted index; and performing an approximate nearest neighbor connection query on the high-dimensional dataset based on the encrypted index, the low-dimensional dataset, and the encrypted high-dimensional dataset to obtain the query results. This achieves encryption of the high-dimensional dataset while reducing computational load, thus accelerating retrieval speed and improving retrieval quality.

Methods, systems, and devices for data management are described. A data management system (DMS) may access a snapshot of a target client object to perform a block-order traversal of a set of files included in the snapshot. The DMS may generate an index file for the set of files based on a metadata associated with the snapshot, the index file including a mapping between a file path for each file and one or more properties of each file. The DMS may then read the set of files included in the snapshot using a sliding window in accordance with the mapping between the file path for each file and the one or more properties of each file, and may determine whether to generate an alert based on reading the set of files included in the snapshot.

The invention provides a log file searching method and device, equipment and a storage medium, and the method comprises the steps: obtaining a log query condition in response to a log query operation, traversing log files in a log management platform, and for each traversed log file, reading an index file corresponding to the log file; wherein the index file comprises a plurality of pieces of second flag bit information generated by encrypting the file content of the log file by using a Bloom filter, and under the condition that the log query condition comprises the index information, encrypting the index information through the Bloom filter to generate first flag bit information, and if at least one piece of second flag bit information matched with the first flag bit information exists in the index file, reading a log file corresponding to the index file. According to the embodiment of the invention, the search efficiency of the log file can be improved.

The application discloses an application reinforcement method, device, equipment and medium, and the method comprises the following steps: receiving an input reinforcement instruction, decompressing a to-be-reinforced application corresponding to the reinforcement instruction to obtain a decompressed file; extracting corresponding target reinforcement information from the decompressed file according to an extraction rule; extracting corresponding index information from the target reinforcement information; generating a binary file corresponding to the target reinforcement information according to a preset reinforcement strategy and the index information; and replacing the content of the decompressed file according to a replacement strategy, the index information and the target reinforcement information, obtaining a corresponding replacement file, integrating the binary file and the index file, and packing to obtain a corresponding target application. The application reinforcement method extracts index information, generates a binary file based on the extracted target reinforcement information, replaces the content of the decompressed file, and finally packs to obtain a target application, so that the loading efficiency of the reinforced application is greatly improved by processing the key information.

The application relates to a data correlation storage method and device, computer equipment and a storage medium. The method comprises the following steps: acquiring a correlation data record identifier of a current latest correlation data packet to be searched; determining a correlation time and first offset information of the current latest correlation data packet according to the correlation data record identifier; acquiring second offset information of the current latest correlation data packet from a corresponding correlation index file based on the correlation time; and acquiring a correlation data packet corresponding to the second offset information from a corresponding correlation data packet file as a correlation data packet of a previous time sequence position based on the correlation time. The method can improve the data searching rate.

The invention provides a product package index management method and device, and the method comprises the steps: obtaining a product package uploading request which carries token information, a to-be-uploaded product package and metadata of the to-be-uploaded product package; the method comprises the following steps: acquiring metadata, analyzing and verifying the metadata, if verification succeeds, obtaining verified metadata, a dependency relationship list of a to-be-uploaded product package and a verified product package, storing the verified metadata and the dependency relationship list into an index database, acquiring full-amount index data in the index database based on a signal triggered at regular time, and uploading the full-amount index data to the product package. Processing the full-amount index data to obtain a full-amount index file, and storing the full-amount index file to a file storage module; and obtaining an index downloading request from a user and a local index version of a client of the user, and determining to return a total index file according to the index downloading request and the local index version, or generating and returning an incremental index file. Therefore, the index retrieval efficiency of the product packages is improved, and efficient product package management and index updating are achieved.

This invention discloses a method, device, and storage medium for writing and reading power grid signals in the field of power automation systems. The writing method includes: determining a cache based on the triplet of the power grid signal; if the power grid signal is written to the cache but the storage threshold is not exceeded, the power grid signal is written to the cache; otherwise, the power grid signal is written to an active data file. The reading method includes: determining a matching cache based on the triplet of the target power grid signal; if the target power grid signal is written in the cache, the power grid signal is directly returned; otherwise, a storage file directory is determined based on the triplet of the target power grid signal; the index file for the target power grid signal is searched from all index files in the storage file directory; and the target power grid signal is then searched from the corresponding data file based on the index file. This invention ensures that the power grid signal is not lost and achieves high-speed reading and writing of the power grid signal.

This invention discloses a method and apparatus for multilingual processing of mobile applications. The method includes: acquiring the application installation package corresponding to the mobile application to be detected and decompiling it to obtain source code files, layout resource files, resource index files, and image resource files; determining detection strategies corresponding to each file type and detecting the source code files, layout resource files, resource index files, and image resource files respectively, generating target detection results containing the objects to be processed; processing each object to be processed to generate translation data; and updating the resource files of the mobile application to be detected based on the generated translation data. This invention achieves full automation and intelligence in the internationalization transformation of mobile applications, significantly reducing labor costs and improving the quality and consistency of multilingual versions.