225 results about "Indexed file" patented technology

The invention discloses a high-precision three-dimensional point cloud visualization method, electronic equipment and a storage medium, and belongs to the technical field of geographic space information systems.The high-precision three-dimensional point cloud visualization method comprises the steps that S1, a point cloud file is input, and meta-information of the point cloud file is obtained; s2, performing scalable data geographic gridding processing on the point cloud file meta-information to obtain a basic grid object; s3, adopting a data stratified sampling method to obtain a multi-level grid object; s4, constructing a multi-level index file based on the multi-level grid, and outputting the multi-level index file; s5, performing high-availability, high-concurrency and compression processing on the output multi-level index file; and S6, performing real-time hierarchical scheduling rendering on the point cloud based on the processed multi-level index file. A point cloud is quickly split into small blocks by using a gridding technology, then parallel processing is performed, a hierarchical rendering level is generated by performing sub-sampling on a whole data set from bottom to top by using a plurality of sampling strategies, and meanwhile, a quick layering strategy is introduced, so that the throughput is remarkably improved.

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention discloses a method for constructing a 3D Tiles data structure. The method comprises the following steps: acquiring data of different sources and different types; constructing a corresponding data storage table for each type of data, reading information of each type of data, and storing the information in the corresponding data storage table; converting the coordinate system of each type of data into the same coordinate system; exporting each type of data after coordinate system conversion as a glTF model; the method comprises the following steps: constructing a 3D Tiles extension data structure consisting of an index file and a data file, adding schema attributes in the index file, and defining a plurality of data types in the schema attributes; adding a minimum unit attribute field in the root attribute of the index file to record a corresponding data type and an attribute value; and based on the constructed 3D Tiles extension data structure and the glTF model of each type of data, integrating each type of data into 3D Tiles format data.

The invention provides a method and a system for quickly and accurately jumping and playing an HLS (HTTP Live Streaming) video, which are characterized in that an m3u8 file is downloaded and analyzed, a detailed index of a TS (Transport Stream) fragment is constructed, the TS fragment is downloaded and stored in a local cache in a multi-cache mode, an FFmpeg tool is adopted to pull data in the local cache, then de-multiplexing, decoding and rendering are performed, and an intelligent Seek algorithm is utilized to quickly and accurately jump and play the HLS video. The TS fragment near the target time point can be quickly positioned in Seek, and the TS fragment is intelligently shifted forwards for a certain time to start downloading. The system comprises an m3u8 index file downloading and analyzing module, a double linked list construction module of TS fragments, a total byte number acquisition module of the TS fragments, a multiple cache module, an FFmpeg tool module and a Seek jump module. The method has the beneficial effects that rapid and accurate jump playing of the HLS video is realized, when the TS fragment is too long and the network condition is not ideal, the Seek operation waiting time of the user is effectively reduced, and the watching experience of the user is improved.

The invention relates to a video playback method, a control system, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the timestamp marking of an event in a video collection process, and generating an index file which is related to the event and can retrieve the time point of the event in a video through different index dimensions; when the video is played back, the index file is analyzed, the mark is displayed at a corresponding position of a video playing time axis in an icon mode, and the icon is linked with a preview frame which describes event information and can jump to a time point where a corresponding event is located in the video; using different index dimensions to search icons corresponding to events matched with the index dimensions, and clicking the icons to select video clips to be played through a preview box; meanwhile, the invention discloses a control system, electronic equipment and a computer readable storage medium according to the method. According to the invention, rapid positioning and accurate return visit of important events in the video can be satisfied, and the efficiency is improved.

The invention discloses a lightweight customer service operation backtracking analysis method and system based on an event stream snapshot, and relates to the technical field of backtracking recording, and the method comprises the steps: recording a DOM state of an initial page, traversing a DOM Tree of the whole page, converting the DOM Tree into JSON structure data through nodeType mapping, and generating a first screen DOM snapshot; updating incremental data after first screen snapshot, hijacking incremental change data by monitoring DOM incremental change, and storing the data into JSON structure data; and on the basis of the timestamp, assembling and restoring an event queue of the snapshots after analyzing by querying a screen recording index JSON file, reconstructing the snapshots into a corresponding DOM tree, and reproducing customer service operations covered in the timestamp. According to the invention, the technical design of event stream traceable recording is realized, and a new thought is provided for the application of the traceable recording technology.

The present application provides a message index processing method, a device, and a storage medium. The method comprises: acquiring a first index file from a local disk, wherein the first index file comprises a plurality of index slots and a plurality of index entries used for storing index information of different messages, index information corresponding to each of at least two messages mapped to a first index slot is stored in at least two index entries at non-contiguous addresses, and the first index slot stores address information of an index entry among the at least two index entries, said index entry storing index information of a message last mapped to the first index slot; performing format conversion on the first index file to obtain a second index file; and storing the second index file in an external distributed storage system.

The invention discloses an intelligent business archive management method and system, and the method comprises the steps: reading a contract file in a business archive, coding the contract file, configuring a project file and a financial file corresponding to the contract file according to the code of the contract file, carrying out the standardized coding of the files, and forming a standard coding data set; reading the standard coded data set, obtaining file information, and generating business archive early warning information according to the file information; standardized coding is carried out through identification information, and a standard coding data set is formed to carry out unified management of business archives; meanwhile, an index file is created, the standard coded data set is dynamically updated, and real-time updating of business archives is achieved on the basis of unified management; a natural language technology is adopted to realize quick and accurate search of the business archives, early warning information is generated for specific problems of files in the business archives and prompted in time, and whole-process intelligent management of the business archives of various types of associated files is realized.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The invention discloses a database system data query method and device based on index cache and a medium, and relates to the field of data query, the method comprises the following steps: writing specified data into a database according to a data writing request, and generating an operation record; updating the index cache based on the priority corresponding to the operation record in the memory queue; based on a preset time period, performing persistence processing on the index cache to generate an index file; and determining a corresponding query path according to whether a data table corresponding to the data query request has an index or not, and performing data query in an index cache or an index file based on the query path and whether the index cache is hit or not to obtain a query result. The problem that write-in performance and data consistency are difficult to consider at the same time is effectively solved, and the requirements of various application scenes with high requirements for database performance and data accuracy are met.

The invention provides a data management system and method for a multi-modal robot cluster, a medium, a terminal and a program product. The system comprises a data container module, a data storage module and a data management module, wherein the data container module is used for segmenting each bag file into a plurality of theme files and index files; the I / O transponder module is used for responding to a write-in operation request, respectively writing input multi-modal data into corresponding theme files according to theme types, and adding index entries generated based on a hot update mechanism into index files; and / or, in response to a read operation request, retrieving a time sequence index mapped by the memory, and forwarding the offset parameter to each theme file to read message data; the theme management module is used for creating a hash table; and the time sequence index caching module is used for caching the updated index file and refreshing the cached index file back to the storage device. According to the method, the requirement of efficient real-time data exchange of the multi-modal robot cluster can be met, and the data read-write efficiency is improved.

The invention relates to an ES-based data import optimization method and system. The method comprises the following steps: acquiring source data needing to be imported into an ES, and initializing an ES fragment group and a Hadoop cluster; performing fragmentation preprocessing on the source data by utilizing a Hadoop cluster to obtain a source data fragmentation group; according to the source data fragment groups, generating an index file conforming to an ES bottom-layer format, wherein each source data fragment group corresponds to one fragment in an ES cluster; compressing the index file by using a Zstand-ard compression algorithm to generate a compressed data block; distributing the compressed data block to a target node in an ES cluster according to a dynamic load fragmentation strategy; and the target node decompresses the compressed data block, and imports an index file obtained after decompression into the rear end of the current ES index file to complete import.

According to the intelligent set top box and the live broadcast delay reduction method provided by the invention, the HLS data of the live broadcast source after channel switching is obtained in response to the channel switching instruction; the HLS data comprises an index file, and the index file records downloading addresses and playing durations corresponding to a plurality of data files. And analyzing to obtain the playing duration and the downloading duration corresponding to each data file in the first index file. And then determining a first data file meeting the playing condition from back to front according to the to-be-played sequence of the plurality of data files, and taking the first data file meeting the playing condition as a target data file. And then playing is started from the target data file, and each data file after the target data file is cached, so that the live broadcast fluency is ensured. According to the method and the device, the target data file is found from back to front according to the to-be-played sequential storage of the plurality of data files, so that the first broadcast position is closer to the live broadcast time after channel switching, and the live broadcast delay is reduced.

The invention discloses an electronic archive management method for a business document generation layout file, and belongs to the technical field of electronic archive management. Comprising the following steps: constructing a multi-dimensional feature vector by collecting business document scene features, screening candidate templates from a template pool by adopting a multi-level similarity matching algorithm, and adjusting and determining a target template in combination with a dynamic structure; the basic metadata and the associated system data are integrated, and qualified metadata is output through multi-level rule verification and abnormal data correction; based on the target template, executing data filling typesetting and format resource preprocessing by adopting a double-thread asynchronous processing mechanism, and generating a layout file conforming to PDF / OFD double standards through an adaptive algorithm; calculating a hash value of the layout file and writing the hash value into a block chain to realize tamper-proof evidence storage, and realizing secure storage and quick retrieval by adopting a distributed architecture in which a main file is separated from an index file. According to the method, the problems of low template matching precision, incomplete data verification, low processing efficiency, insufficient file safety guarantee and the like in the prior art are solved.

The invention discloses a firmware upgrading method and device, electronic equipment and a storage medium, and relates to the technical field of servers, the method comprises the following steps: receiving a confirmation request from a substrate management controller; when it is determined that firmware upgrading is supported based on the confirmation request, confirmation information is sent; receiving each piece of original version information of a plurality of original firmware mirror images sent by the substrate management controller based on the confirmation information; searching the highest version information on which each piece of original version information depends in a preset mapping relation library; determining at least one original firmware mirror image to be upgraded according to the dependent highest version information; obtaining a storage path of mirror image identification information and a target firmware mirror image corresponding to each piece of original firmware to be upgraded; and generating an index file according to the mirror image identification information and the storage path, and sending the index file to the substrate management controller. According to the method and the device, the problems of long firmware upgrading time consumption and low upgrading efficiency caused by large volume of a full package for firmware upgrading are solved.

The application discloses a kind of high-performance distributed mass vector similarity search system and method, including Faiss Driver, several Faiss Worker and Etcd system;Faiss Driver is used to receive the query request of user end, and the query request is forwarded to the selected Faiss Worker by proxy, and is configured to perform loading configuration Etcd monitoring, exit pre-processing, service discovery and master-slave election task;Faiss Worker is the unit for executing query calculation in search system, and is configured to perform configuration management, shutdown processing, timing task, load index and query calculation task, for calculating similar vector retrieval and updating online or offline index file;Etcd system is used to save Faiss Worker list, master-slave state of Faiss Worker, health status of Faiss Worker, external storage module address of index file and index file list.The application introduces proxy forwarding service mechanism and master-slave node registration mechanism, and can efficiently process vector query calculation request.

The present invention discloses a data processing method, apparatus, computer equipment and storage medium. The method uses SQL statements written in advance according to the user's operating habits of using a database and the index structure of Elasticsearch as index classes, and writes index files. When using Elasticsearch to perform data operations, the pre-written index file is obtained, and when an operation instruction for Elasticsearch sent by the user is received, the index file is scanned and loaded; the corresponding index class in the index file is called according to the operation instruction, and the execution result corresponding to the operation instruction is obtained according to the operation instruction and the corresponding index class, and the execution result is fed back to the client; the present invention can obtain the data corresponding to Elasticsearch by writing simple SQL statements without writing complex script codes, thereby solving the problems of large workload and high user usage threshold caused by writing complex script codes, reducing user workload, reducing learning time and working time, lowering usage threshold and improving work efficiency.

This invention relates to a method for checking the consistency of row-level data files and index files based on the OpenGauss database. This method can be used to check the consistency of the physical files of the main table, the physical files of the index table, and the logical consistency of the physical files of the main table and the index table. This consistency checking method overcomes the shortcomings of traditional data file consistency verification methods, such as delayed startup and the possibility of business failures or even database instance anomalies due to check failures. Through this method, DBAs can periodically and proactively perform full consistency checks on the physical files of specified tables during daily operations and maintenance. It can also check the consistency relationship between the physical files of the b-tree indexes related to the main table and the physical files of the main table, thereby enabling timely detection of data file consistency issues in the database and taking corresponding remedial and mitigation measures to minimize potential impact and losses.

The invention relates to a log processing method based on dynamic triggering and index driving, and relates to the technical field of computer software, and the method comprises the following steps: coding log entries through a dictionary coding rule, generating coded log entries, and writing the coded log entries into a plaintext log file; monitoring a file state of the plaintext log file, and when the file state meets a preset dynamic triggering condition, compressing the plaintext log file to generate a compressed log file; generating an index file associated with the compressed log file, wherein the index file comprises metadata; and in response to a user query request, positioning and compressing a target data block in the log file based on the metadata, decompressing and reversely decoding the target data block, and filtering decoded log contents according to the query mode to output a log query result. By means of the scheme, development complexity is reduced, efficient real-time compression is achieved, full scanning is avoided, consumed time in the index positioning stage is reduced from the minute level to the millisecond level, and query efficiency is improved.

The present application relates to the technical field of database, in particular to an index updating method, product, medium and equipment. The index updating method comprises: triggering index page inspection by using a preset hybrid scheduling strategy, and identifying a to-be-merged page in an index file; judging whether a target page matching the to-be-merged page exists in the index file; if yes, acquiring a page lock of the to-be-merged page and the target page; merging the to-be-merged page and the target page, and releasing the page lock. The present application locks and releases by page granularity before and after page merging, ensures the atomicity and concurrent safety of the merging operation, avoids locking the whole table or the whole index, effectively suppresses the index file expansion without blocking normal read-write business, and improves the system availability.

The invention discloses a portable electronic genealogy rapid searching and displaying device and system, and solves the problem of rapid searching and displaying of names and character biography data of immediate elders. According to the technical scheme, through hardware integration of a commercialized serial port screen assembly and a customized control panel assembly, embedded systems such as FreeRTOS and the like and an FATFS file management system are combined; and the lineage chart visualization and the quick retrieval of the character biography data are realized. Compared with a traditional paper genealogy and a scanning electronic document, the method has the advantages that through a filename mechanism for associating the interface ID and the control ID of the serial port screen component with the text file for storing the biography data by the index file, the problems of shadow display of names corresponding to the names of the lineage diagrams and tedious checking and displaying of the cross-page lineage diagrams in the one-pulse-accompanying interface are solved; the problem of contrast display of straight elders of any two persons in the same genealogy is solved, and when the generations of the name to be checked exceed 10 generations, the checking and displaying efficiency is improved by more than hundreds of times.

A file generation method includes obtaining first information based on a resource index file, where the resource index file comprises indexes, file names, and first path information of a plurality of resource files, where the resource files include a first resource file and a second resource file, where the first information includes second path information and a file name of a first file; loading the first file based on the first information; obtaining the first resource file and the second resource file from the first file based on second information; and displaying the first page based on the first resource file and the second resource file.

The invention relates to a streaming media transmission method and system. The method comprises the following steps: receiving a request for default slice resources initiated by a client, wherein the request is used for starting streaming media playing or carrying out playing positioning; in response to the request, returning a corresponding media slice data stream according to the parameters carried by the request or the current state of the service; when the media slice data stream is returned, the identification information of the next media slice is carried in the HTTP response header; wherein in the live broadcast scene, the request carries a parameter for indicating the delay demand of the client, and one media slice is selected from the generated media slices for response according to the delay demand parameter; wherein in the on-demand service scene, the request carries a time offset parameter used for indicating a target playing position, an index file is pre-stored in the server, the index file is queried, and a corresponding target media slice is positioned according to the time offset parameter and returned. The method has the advantages of being simple, fast in first screen, accurate in dragging, free of additional downloading and the like.

The present invention relates to the technical field of operation and maintenance audit systems, and discloses a method, a system and a medium for character protocol playback based on an operation and maintenance audit system. After successful security verification, the playback module, according to the target protocol format, identifies the character protocol representing the target operation from the index file and the data file from the operation and maintenance audit system, and sends the uplink and downlink data of the corresponding character protocol to the terminal emulator. The terminal emulator renders the received uplink and downlink data of the corresponding character protocol to complete the playback. It realizes data parsing on the playback server of the playback module. At the same time, by identifying the target operation and obtaining the corresponding data, it realizes positioning key operations during playback and skipping insignificant idle time periods, and solves the technical problems of low retrieval efficiency when playing back a large character protocol video file and easy collapse of parsing data in the front-end browser.

The embodiment of the invention discloses an application file aggregation processing method and device, a storage medium and electronic equipment, and the method comprises the steps: determining a main application file package and a to-be-aggregated application file package for a target application, performing resource definition information analysis on a first resource definition file of a main application file package and a second resource definition file of a to-be-aggregated application file package to obtain a first resource mapping relation and first resource item information for the first resource definition file and second resource item information of the second resource definition file, and based on the first resource mapping relationship, the first resource item information and the second resource item information, carrying out resource identification merging to obtain a target resource definition file of a target application, and performing resource identifier updating on an original resource index file in the to-be-aggregated application file package based on the target resource definition file to obtain an aggregated resource index file.

A system and method for extracting full text from source files of any size in such a manner that all text can be rapidly and accurately searched via search engine while maintaining satisfactory system performance. A software tool that integrates with file shares or an enterprise content management system with the ability to merge and serialize the results of the extracted text via surrogate index files. The software tool is configured to handle text from large files in order to extract, store and access the file such that all of the text is searchable, regardless of the size of the original document in a reasonable amount of time. The Analytics Engine will omit this field during search and handle this field separately from other fields.

According to the index reconstruction method and device for the state data in the block chain system, the block chain system stores a data file and an index file through a persistent storage medium, the data file is used for storing a value of a state variable, the index file is used for storing an index entry, and the index entry comprises position information of the value of the state variable in the persistent storage medium; the method comprises the steps that a dredging index file and a target index file with the write-in time located behind a barrier point are combined, a new index file is obtained, the dredging index file is obtained by executing the current round of garbage collection on state data of a block chain system, and the barrier point is obtained when the current round of garbage collection starts to be executed; the index file is newly written into the persistent storage medium from the memory; and writing the new index file into the persistent storage medium.

The application provides a remote file differential transmission and iteration method and device. The method comprises the following steps: receiving a hash value of at least one file under a specific directory transmitted by a client, reading an index file in a target compressed package, traversing information of each file in the index file, obtaining a hash value of a current file, if the hash value of the current file is different from hash values of each file in the at least one file, and the hash value of the current file is different from hash values of the files that have been traversed, obtaining a compressed data size of the current file; determining a target file header, and sending the target file header and an index table in the target compressed package to the client; for each target file, determining compressed data of the target file, and sending the compressed data to the client; and sending a target file tail and at least part of data in the index file to the client, so that the file transmission speed is improved, and the storage space is saved.

The application discloses a multimedia recording method, device and system, and relates to the technical field of communication, and avoids the problem that the recorded content is lost due to switching of a recording server during recording. The recording method comprises the following steps: when a recording server receives a recording task, the recording server determines the identification of a recording starting slice according to recording information, and sends an index file request to a live server, wherein the index file request carries the identification of the recording starting slice. The recording server receives an index file sent by the live server, wherein the identification of the first slice in the index file is the identification of the recording starting slice. The recording information comprises the identification of a recorded slice written by another recording server performing the recording task.

The invention provides a point cloud preview method and a point cloud generation system, a laser scanning device and a point cloud preview device perform block storage on point cloud data according to the same data storage architecture, and the point cloud data of different point cloud blocks are stored in different point cloud files. After the point cloud preview device and the laser scanning device are disconnected and reconnected, a part of files with missing data can be confirmed by comparing the first index file and the second index file, namely the target point cloud file which is not updated synchronously due to disconnection of the device. Compared with the prior art, the point cloud synchronous updating and previewing can be realized by independently pulling the target point cloud file and the subsequently updated point cloud file, and compared with a mode of pulling the global point cloud file again, the data transmission quantity is reduced, the data transmission delay is reduced, and the efficiency and the real-time performance of the point cloud previewing after the equipment is reconnected can be improved.