171 results about "Indexed file" patented technology

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention provides a method and a system for quickly and accurately jumping and playing an HLS (HTTP Live Streaming) video, which are characterized in that an m3u8 file is downloaded and analyzed, a detailed index of a TS (Transport Stream) fragment is constructed, the TS fragment is downloaded and stored in a local cache in a multi-cache mode, an FFmpeg tool is adopted to pull data in the local cache, then de-multiplexing, decoding and rendering are performed, and an intelligent Seek algorithm is utilized to quickly and accurately jump and play the HLS video. The TS fragment near the target time point can be quickly positioned in Seek, and the TS fragment is intelligently shifted forwards for a certain time to start downloading. The system comprises an m3u8 index file downloading and analyzing module, a double linked list construction module of TS fragments, a total byte number acquisition module of the TS fragments, a multiple cache module, an FFmpeg tool module and a Seek jump module. The method has the beneficial effects that rapid and accurate jump playing of the HLS video is realized, when the TS fragment is too long and the network condition is not ideal, the Seek operation waiting time of the user is effectively reduced, and the watching experience of the user is improved.

The invention relates to a video playback method, a control system, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the timestamp marking of an event in a video collection process, and generating an index file which is related to the event and can retrieve the time point of the event in a video through different index dimensions; when the video is played back, the index file is analyzed, the mark is displayed at a corresponding position of a video playing time axis in an icon mode, and the icon is linked with a preview frame which describes event information and can jump to a time point where a corresponding event is located in the video; using different index dimensions to search icons corresponding to events matched with the index dimensions, and clicking the icons to select video clips to be played through a preview box; meanwhile, the invention discloses a control system, electronic equipment and a computer readable storage medium according to the method. According to the invention, rapid positioning and accurate return visit of important events in the video can be satisfied, and the efficiency is improved.

The invention discloses a lightweight customer service operation backtracking analysis method and system based on an event stream snapshot, and relates to the technical field of backtracking recording, and the method comprises the steps: recording a DOM state of an initial page, traversing a DOM Tree of the whole page, converting the DOM Tree into JSON structure data through nodeType mapping, and generating a first screen DOM snapshot; updating incremental data after first screen snapshot, hijacking incremental change data by monitoring DOM incremental change, and storing the data into JSON structure data; and on the basis of the timestamp, assembling and restoring an event queue of the snapshots after analyzing by querying a screen recording index JSON file, reconstructing the snapshots into a corresponding DOM tree, and reproducing customer service operations covered in the timestamp. According to the invention, the technical design of event stream traceable recording is realized, and a new thought is provided for the application of the traceable recording technology.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The invention provides a data management system and method for a multi-modal robot cluster, a medium, a terminal and a program product. The system comprises a data container module, a data storage module and a data management module, wherein the data container module is used for segmenting each bag file into a plurality of theme files and index files; the I / O transponder module is used for responding to a write-in operation request, respectively writing input multi-modal data into corresponding theme files according to theme types, and adding index entries generated based on a hot update mechanism into index files; and / or, in response to a read operation request, retrieving a time sequence index mapped by the memory, and forwarding the offset parameter to each theme file to read message data; the theme management module is used for creating a hash table; and the time sequence index caching module is used for caching the updated index file and refreshing the cached index file back to the storage device. According to the method, the requirement of efficient real-time data exchange of the multi-modal robot cluster can be met, and the data read-write efficiency is improved.

The invention discloses an electronic archive management method for a business document generation layout file, and belongs to the technical field of electronic archive management. Comprising the following steps: constructing a multi-dimensional feature vector by collecting business document scene features, screening candidate templates from a template pool by adopting a multi-level similarity matching algorithm, and adjusting and determining a target template in combination with a dynamic structure; the basic metadata and the associated system data are integrated, and qualified metadata is output through multi-level rule verification and abnormal data correction; based on the target template, executing data filling typesetting and format resource preprocessing by adopting a double-thread asynchronous processing mechanism, and generating a layout file conforming to PDF / OFD double standards through an adaptive algorithm; calculating a hash value of the layout file and writing the hash value into a block chain to realize tamper-proof evidence storage, and realizing secure storage and quick retrieval by adopting a distributed architecture in which a main file is separated from an index file. According to the method, the problems of low template matching precision, incomplete data verification, low processing efficiency, insufficient file safety guarantee and the like in the prior art are solved.

The invention discloses a firmware upgrading method and device, electronic equipment and a storage medium, and relates to the technical field of servers, the method comprises the following steps: receiving a confirmation request from a substrate management controller; when it is determined that firmware upgrading is supported based on the confirmation request, confirmation information is sent; receiving each piece of original version information of a plurality of original firmware mirror images sent by the substrate management controller based on the confirmation information; searching the highest version information on which each piece of original version information depends in a preset mapping relation library; determining at least one original firmware mirror image to be upgraded according to the dependent highest version information; obtaining a storage path of mirror image identification information and a target firmware mirror image corresponding to each piece of original firmware to be upgraded; and generating an index file according to the mirror image identification information and the storage path, and sending the index file to the substrate management controller. According to the method and the device, the problems of long firmware upgrading time consumption and low upgrading efficiency caused by large volume of a full package for firmware upgrading are solved.

The application discloses a kind of high-performance distributed mass vector similarity search system and method, including Faiss Driver, several Faiss Worker and Etcd system;Faiss Driver is used to receive the query request of user end, and the query request is forwarded to the selected Faiss Worker by proxy, and is configured to perform loading configuration Etcd monitoring, exit pre-processing, service discovery and master-slave election task;Faiss Worker is the unit for executing query calculation in search system, and is configured to perform configuration management, shutdown processing, timing task, load index and query calculation task, for calculating similar vector retrieval and updating online or offline index file;Etcd system is used to save Faiss Worker list, master-slave state of Faiss Worker, health status of Faiss Worker, external storage module address of index file and index file list.The application introduces proxy forwarding service mechanism and master-slave node registration mechanism, and can efficiently process vector query calculation request.

The present invention discloses a data processing method, apparatus, computer equipment and storage medium. The method uses SQL statements written in advance according to the user's operating habits of using a database and the index structure of Elasticsearch as index classes, and writes index files. When using Elasticsearch to perform data operations, the pre-written index file is obtained, and when an operation instruction for Elasticsearch sent by the user is received, the index file is scanned and loaded; the corresponding index class in the index file is called according to the operation instruction, and the execution result corresponding to the operation instruction is obtained according to the operation instruction and the corresponding index class, and the execution result is fed back to the client; the present invention can obtain the data corresponding to Elasticsearch by writing simple SQL statements without writing complex script codes, thereby solving the problems of large workload and high user usage threshold caused by writing complex script codes, reducing user workload, reducing learning time and working time, lowering usage threshold and improving work efficiency.

This invention relates to a method for checking the consistency of row-level data files and index files based on the OpenGauss database. This method can be used to check the consistency of the physical files of the main table, the physical files of the index table, and the logical consistency of the physical files of the main table and the index table. This consistency checking method overcomes the shortcomings of traditional data file consistency verification methods, such as delayed startup and the possibility of business failures or even database instance anomalies due to check failures. Through this method, DBAs can periodically and proactively perform full consistency checks on the physical files of specified tables during daily operations and maintenance. It can also check the consistency relationship between the physical files of the b-tree indexes related to the main table and the physical files of the main table, thereby enabling timely detection of data file consistency issues in the database and taking corresponding remedial and mitigation measures to minimize potential impact and losses.

The invention relates to a log processing method based on dynamic triggering and index driving, and relates to the technical field of computer software, and the method comprises the following steps: coding log entries through a dictionary coding rule, generating coded log entries, and writing the coded log entries into a plaintext log file; monitoring a file state of the plaintext log file, and when the file state meets a preset dynamic triggering condition, compressing the plaintext log file to generate a compressed log file; generating an index file associated with the compressed log file, wherein the index file comprises metadata; and in response to a user query request, positioning and compressing a target data block in the log file based on the metadata, decompressing and reversely decoding the target data block, and filtering decoded log contents according to the query mode to output a log query result. By means of the scheme, development complexity is reduced, efficient real-time compression is achieved, full scanning is avoided, consumed time in the index positioning stage is reduced from the minute level to the millisecond level, and query efficiency is improved.

The present application relates to the technical field of database, in particular to an index updating method, product, medium and equipment. The index updating method comprises: triggering index page inspection by using a preset hybrid scheduling strategy, and identifying a to-be-merged page in an index file; judging whether a target page matching the to-be-merged page exists in the index file; if yes, acquiring a page lock of the to-be-merged page and the target page; merging the to-be-merged page and the target page, and releasing the page lock. The present application locks and releases by page granularity before and after page merging, ensures the atomicity and concurrent safety of the merging operation, avoids locking the whole table or the whole index, effectively suppresses the index file expansion without blocking normal read-write business, and improves the system availability.

The invention discloses a portable electronic genealogy rapid searching and displaying device and system, and solves the problem of rapid searching and displaying of names and character biography data of immediate elders. According to the technical scheme, through hardware integration of a commercialized serial port screen assembly and a customized control panel assembly, embedded systems such as FreeRTOS and the like and an FATFS file management system are combined; and the lineage chart visualization and the quick retrieval of the character biography data are realized. Compared with a traditional paper genealogy and a scanning electronic document, the method has the advantages that through a filename mechanism for associating the interface ID and the control ID of the serial port screen component with the text file for storing the biography data by the index file, the problems of shadow display of names corresponding to the names of the lineage diagrams and tedious checking and displaying of the cross-page lineage diagrams in the one-pulse-accompanying interface are solved; the problem of contrast display of straight elders of any two persons in the same genealogy is solved, and when the generations of the name to be checked exceed 10 generations, the checking and displaying efficiency is improved by more than hundreds of times.

The invention relates to a streaming media transmission method and system. The method comprises the following steps: receiving a request for default slice resources initiated by a client, wherein the request is used for starting streaming media playing or carrying out playing positioning; in response to the request, returning a corresponding media slice data stream according to the parameters carried by the request or the current state of the service; when the media slice data stream is returned, the identification information of the next media slice is carried in the HTTP response header; wherein in the live broadcast scene, the request carries a parameter for indicating the delay demand of the client, and one media slice is selected from the generated media slices for response according to the delay demand parameter; wherein in the on-demand service scene, the request carries a time offset parameter used for indicating a target playing position, an index file is pre-stored in the server, the index file is queried, and a corresponding target media slice is positioned according to the time offset parameter and returned. The method has the advantages of being simple, fast in first screen, accurate in dragging, free of additional downloading and the like.

The embodiment of the invention discloses an application file aggregation processing method and device, a storage medium and electronic equipment, and the method comprises the steps: determining a main application file package and a to-be-aggregated application file package for a target application, performing resource definition information analysis on a first resource definition file of a main application file package and a second resource definition file of a to-be-aggregated application file package to obtain a first resource mapping relation and first resource item information for the first resource definition file and second resource item information of the second resource definition file, and based on the first resource mapping relationship, the first resource item information and the second resource item information, carrying out resource identification merging to obtain a target resource definition file of a target application, and performing resource identifier updating on an original resource index file in the to-be-aggregated application file package based on the target resource definition file to obtain an aggregated resource index file.

The application provides a remote file differential transmission and iteration method and device. The method comprises the following steps: receiving a hash value of at least one file under a specific directory transmitted by a client, reading an index file in a target compressed package, traversing information of each file in the index file, obtaining a hash value of a current file, if the hash value of the current file is different from hash values of each file in the at least one file, and the hash value of the current file is different from hash values of the files that have been traversed, obtaining a compressed data size of the current file; determining a target file header, and sending the target file header and an index table in the target compressed package to the client; for each target file, determining compressed data of the target file, and sending the compressed data to the client; and sending a target file tail and at least part of data in the index file to the client, so that the file transmission speed is improved, and the storage space is saved.

The application discloses a multimedia recording method, device and system, and relates to the technical field of communication, and avoids the problem that the recorded content is lost due to switching of a recording server during recording. The recording method comprises the following steps: when a recording server receives a recording task, the recording server determines the identification of a recording starting slice according to recording information, and sends an index file request to a live server, wherein the index file request carries the identification of the recording starting slice. The recording server receives an index file sent by the live server, wherein the identification of the first slice in the index file is the identification of the recording starting slice. The recording information comprises the identification of a recorded slice written by another recording server performing the recording task.

The embodiment of the invention discloses a webpage picture loading method and device. The specific implementation mode of the method comprises the steps that a client side responds to a received request for loading a webpage picture, loads a Sprite map from a content distribution network and obtains an index file, and the Sprite map comprises a thumbnail of the webpage picture; querying the coordinate position of the thumbnail in the Sprite map in the index file according to the address of the webpage picture; and obtaining the thumbnail from the Sprite map according to the inquired coordinate position, and rendering the thumbnail. The server is used for generating a thumbnail based on the original picture in the picture resource library; based on the thumbnail, constructing a Sprite map, and generating an index file, the index file comprising an address of the Sprite map and a coordinate position of the thumbnail in the Sprite map; and publishing the Sprite map, the original map and the index file to a content distribution network. According to the embodiment, the abnormal problems of lagging and even unavailability caused by simultaneous display of massive pictures on a webpage are solved based on a Sprite map technology.

This application provides a data storage management method, apparatus, device, and storage medium, relating to the field of database technology. In this method, the database system's index file, log file, and multiple data files are all stored in non-volatile memory. Thus, when an operation instruction for an original data record in the database is received, the original data record is directly located from the multiple data files using the index file, and an operation transaction is executed on the located original data record. Upon successful execution of the operation transaction, the transaction number is added to the log file. Since updates to the index file, data file, and log file in non-volatile memory can be immediately persisted without needing to be flushed to disk, the additional time and resource overhead of migrating data between different storage media is avoided. This also improves data write and read speeds, meeting the real-time data read and write requirements of various application scenarios.

This application provides a rapid migration method and system based on customized data packages, as well as a readable storage medium. The rapid migration method based on customized data packages includes: extracting metadata from oil and gas exploration data using a general data acquisition module, employing the system's native API and file parsing algorithms; based on the metadata and the target operating system, formulating a migration strategy and monitoring the migration process through a control module, and generating a task execution list; dynamically adjusting the execution plan of the task execution list through a scheduling module, and generating a task execution priority list; and according to the task execution priority list, encapsulating and transmitting the data to the target system through a migration module, and unpacking the data according to the mapping index file and the unpacking priority list. Through the technical solution of this application, seamless data synchronization across operating systems can be achieved through customized data packaging and index mapping strategies, ensuring that the migrated data is immediately available and improving the execution efficiency of seismic exploration projects in multi-platform collaborative scenarios.

A system for customizable video playback includes: a customizable video playback server including a video database and a playback manager; and a plurality of customizable video playback devices, each including a dynamic index file and a playback controller, wherein the customizable video playback device enables a user to select a source video from the video database, and select a list of variable length video chunks from the source video, such that the variable length video chunks are sequenced by the dynamic index file, according to sequencing input from the user, to produce a customized video. Also disclosed is a method for customizable video playback, including selecting a source video, selecting variable-length video chunks, sequencing the customized video using a dynamic index file, and playing the customized video.

The application relates to the technical field of computer application, and discloses a mass file data stream storage method, a storage system and a big data processing system. A rotation state conversion model is arranged between a data stream and a storage node, and storage pressure is dispersed through multi-node caching. The storage method comprises the following steps: presetting a file size demarcation point; inputting mass file data; judging whether the size of the input file is smaller than or equal to the demarcation point; storing file data smaller than or equal to the demarcation point in a selected storage node through the rotation state conversion model; generating index information of all small files, and merging the index information into an index file; organizing data in the form of a B+ tree for each index file to obtain an index data bucket; storing a plurality of index data buckets in the form of data blocks in the storage node; and saving all index data buckets in sequence as an index data bucket queue. The application can effectively solve the problems of traditional distributed storage systems, such as write performance decline and low efficiency when facing mass files.

The application provides a file transmission method, an electronic device and a storage medium, and relates to the technical field of intranet security protection. According to the write parameters of a to-be-written file, an index file operation interface is called to determine whether an index file of the to-be-written file exists, if yes, according to the operation state of the to-be-written file in the index file and the write parameters of the to-be-written file, it is determined whether the index file of the to-be-written file is updated, when the to-be-written file is a large file or a small file, the index file operation interface is called according to the total size of the to-be-written file to update the storage location information in the index file where the to-be-written file is located, the updated index file records the real storage location information of the to-be-written file, and the real storage location information of the to-be-written file has the characteristics of high utilization of the disk space occupied by different data files, the write efficiency of the to-be-written file is improved, and the high-performance transmission requirement of the one-way import system is met.

The invention relates to the technical field of information retrieval, and discloses an advertisement indexing method and device, equipment and a storage medium. The method comprises the following steps: receiving an index request for advertisement data; predicting advertisement data matched with the index entry; preloading the predicted advertisement data from a first database; querying advertisement data matched with the index entry based on an index file cached in a memory; and obtaining advertisement data matched with the index request based on the queried advertisement data and the preloaded advertisement data. According to the embodiment of the invention, the advertisement indexing speed and efficiency can be improved.

A system for customizable video playback includes: a customizable video playback server including a video database and a playback manager; and a plurality of customizable video playback devices, each including a dynamic index file and a playback controller, wherein the customizable video playback device enables a user to select a source video from the video database, and select a list of variable length video chunks from the source video, such that the variable length video chunks are sequenced by the dynamic index file, according to sequencing input from the user, to produce a customized video. Also disclosed is a method for customizable video playback, including selecting a source video, selecting variable-length video chunks, sequencing the customized video using a dynamic index file, and playing the customized video.

The invention discloses an HLS streaming media load balancing-based forwarding synchronization method, which comprises the following steps of: writing into a node in a server cluster through a scheduling algorithm on the basis of an RTMP (Real Time Messaging Protocol) stream pushing access address, and obtaining a live broadcast data stream through a client on the basis of an HTTP-FLV (Hyper Text Transfer Protocol-Flash Virtualization) address; based on the real-time code stream data, driving and starting a slicer process by starting an hls instruction; obtaining first slice fragment data by waiting for a preset key frame interval based on the real-time code stream data, obtaining a slice file through a packaging module based on the first slice fragment data, and storing the slice file in a disk; a slice file storage disk successfully drives a closing file descriptor and generates a completion signal file, and the completion signal file is written into an index file of an HLS protocol in real time through a sliding window; copying the slice file and the index file to other nodes in the server cluster through a tool based on the completion signal file; and driving a deletion completion signal file based on the copy success signal, and deleting the historical slice file and the index record in real time to realize storage of the latest time sequence file in the disk.

The invention provides a data processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of data processing, in particular to the technical fields of data storage, distributed file systems and the like. According to the specific implementation scheme, in response to a storage request for storing a target file, a metadata block chain corresponding to a target directory where the target file is located is determined; the metadata block chain comprises one or more data blocks arranged in sequence; the data block stores metadata corresponding to the file under the target directory; under the condition that the residual space of the tail data block of the metadata block chain does not meet the requirement for storing the target metadata corresponding to the target file, a new data block is allocated to the tail of the metadata block chain to serve as a new tail data block of the metadata block chain; and writing the target metadata into an idle slot position of a tail data block of the metadata block chain according to a slot position sequence, and storing a corresponding relationship between the identifier of the target file and slot position information of the idle slot position in a directory index file corresponding to the target directory.

The application relates to a file processing control method, device, equipment, storage medium and program product. The method comprises the following steps: acquiring a file processing plan; acquiring a corresponding target index file from an upstream system according to the file processing plan; determining a target data file to be processed from the upstream system according to the file processing plan; when the index file corresponding to the target data file is successfully acquired, acquiring the target data file from the upstream system and processing the target data file; and when the index file corresponding to the target data file is not successfully acquired, returning to the step of acquiring the corresponding index file from the upstream system according to the file processing plan. The method can automatically perform business processing and reduce manual intervention.

The railway dispatch centralized data storage method and system, retrieval system and electronic device disclosed in the application, compared with the prior art, the storage method comprises the following steps: constructing a full-station information table of a current station site; acquiring real-time train operation data; combining the full-station information table, analyzing and identifying the change data in the real-time train operation data; updating the full-station information table in combination with the change data; storing the latest full-station information table in the form of a data file; calculating the position information and time label of the change data in the data file; the time label is combined with the position information to generate an index file in a fixed length and format; and the index file is stored. The technical scheme disclosed in the application can reduce the amount of stored data and improve the efficiency of data retrieval.