294 results about "Indexed file" patented technology

The invention relates to the technical field of visual rendering, and provides a three-dimensional data visual rendering method and a visual rendering engine system.The method comprises the steps that space segmentation processing is conducted on three-dimensional model data to be rendered through the LOD technology to generate block slice data with different geometric detail levels, organizing the block slice data through a tree structure with a spatial relationship, and outputting the tree structure as an index file; the method comprises the following steps: adaptively screening block and slice data of different levels of detail based on a user vision field range, storing the block and slice data into a rendering request queue, querying block and slice data to be rendered from the rendering request queue according to index codes of the block and slice data, and updating a layer browser database; according to the method, to-be-rendered block slice data are downloaded and analyzed in parallel in batches in a separated collaborative operation mode, and a rendering task is executed according to a data analysis result, so that the rendering scheduling frame rate is remarkably improved, and rapid visualization of urban mass three-dimensional slice data at a webpage end is realized.

The invention discloses a high-precision three-dimensional point cloud visualization method, electronic equipment and a storage medium, and belongs to the technical field of geographic space information systems.The high-precision three-dimensional point cloud visualization method comprises the steps that S1, a point cloud file is input, and meta-information of the point cloud file is obtained; s2, performing scalable data geographic gridding processing on the point cloud file meta-information to obtain a basic grid object; s3, adopting a data stratified sampling method to obtain a multi-level grid object; s4, constructing a multi-level index file based on the multi-level grid, and outputting the multi-level index file; s5, performing high-availability, high-concurrency and compression processing on the output multi-level index file; and S6, performing real-time hierarchical scheduling rendering on the point cloud based on the processed multi-level index file. A point cloud is quickly split into small blocks by using a gridding technology, then parallel processing is performed, a hierarchical rendering level is generated by performing sub-sampling on a whole data set from bottom to top by using a plurality of sampling strategies, and meanwhile, a quick layering strategy is introduced, so that the throughput is remarkably improved.

The invention relates to a mirror image file processing method and device, and relates to the technical field of container mirror image generation. The method comprises the steps of obtaining target file system directory information of a target container in response to a mirror image file export request for the target container; the target file system directory information of the target container is used for representing file system directory information of a writable layer of the target container; comparing the target file system directory information of the basic mirror image with the target file system directory information of the target container to obtain a difference file of the target container relative to the basic mirror image; constructing a layer file of a new incremental layer based on the difference file; writing a layer file of the incremental layer into a mirror image layer file directory of the basic mirror image, and updating a list file and an index file of the basic mirror image to obtain a mirror image file of the target container; the manifest file comprises metadata of each mirror image layer in the basic mirror image, and the index file comprises metadata of the manifest file. By adopting the method, the export efficiency of the container mirror image file can be improved.

The invention discloses a method for constructing a 3D Tiles data structure. The method comprises the following steps: acquiring data of different sources and different types; constructing a corresponding data storage table for each type of data, reading information of each type of data, and storing the information in the corresponding data storage table; converting the coordinate system of each type of data into the same coordinate system; exporting each type of data after coordinate system conversion as a glTF model; the method comprises the following steps: constructing a 3D Tiles extension data structure consisting of an index file and a data file, adding schema attributes in the index file, and defining a plurality of data types in the schema attributes; adding a minimum unit attribute field in the root attribute of the index file to record a corresponding data type and an attribute value; and based on the constructed 3D Tiles extension data structure and the glTF model of each type of data, integrating each type of data into 3D Tiles format data.

The invention provides a method and a system for quickly and accurately jumping and playing an HLS (HTTP Live Streaming) video, which are characterized in that an m3u8 file is downloaded and analyzed, a detailed index of a TS (Transport Stream) fragment is constructed, the TS fragment is downloaded and stored in a local cache in a multi-cache mode, an FFmpeg tool is adopted to pull data in the local cache, then de-multiplexing, decoding and rendering are performed, and an intelligent Seek algorithm is utilized to quickly and accurately jump and play the HLS video. The TS fragment near the target time point can be quickly positioned in Seek, and the TS fragment is intelligently shifted forwards for a certain time to start downloading. The system comprises an m3u8 index file downloading and analyzing module, a double linked list construction module of TS fragments, a total byte number acquisition module of the TS fragments, a multiple cache module, an FFmpeg tool module and a Seek jump module. The method has the beneficial effects that rapid and accurate jump playing of the HLS video is realized, when the TS fragment is too long and the network condition is not ideal, the Seek operation waiting time of the user is effectively reduced, and the watching experience of the user is improved.

The embodiment of the invention provides a video enhancement method and device, a server and terminal equipment, in the video enhancement method, the terminal equipment obtains a video playing request carrying information of a video to be played, downloads a video file to be played from a video distribution source station, then explains a primary index file of the video file, and sends the explained primary index file to the terminal equipment; obtaining a secondary index address and a PQ parameter file address, and downloading a PQ parameter file from the video distribution source station according to the PQ parameter file address; and downloading code stream data of the video to be played from the video distribution source station according to the secondary index address. And finally, the terminal equipment obtains a PQ parameter corresponding to the terminal equipment according to the PQ parameter file, and performs video enhancement operation according to the PQ parameter and the code stream data to obtain enhanced code stream data, so that the video enhancement characteristic of the terminal equipment and the adaptation effect of different types of videos can be improved, and the user experience is improved. And the video playing effect of the terminal equipment is improved.

The invention relates to a video playback method, a control system, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the timestamp marking of an event in a video collection process, and generating an index file which is related to the event and can retrieve the time point of the event in a video through different index dimensions; when the video is played back, the index file is analyzed, the mark is displayed at a corresponding position of a video playing time axis in an icon mode, and the icon is linked with a preview frame which describes event information and can jump to a time point where a corresponding event is located in the video; using different index dimensions to search icons corresponding to events matched with the index dimensions, and clicking the icons to select video clips to be played through a preview box; meanwhile, the invention discloses a control system, electronic equipment and a computer readable storage medium according to the method. According to the invention, rapid positioning and accurate return visit of important events in the video can be satisfied, and the efficiency is improved.

The present application provides an index persistence method and device for a KV storage system, wherein the method includes: querying the first preset layer of a log structure merge tree, and finding from the tail metadata area that the key value key range of the index is a first preset data range; querying the index file corresponding to the first preset range, finding a portion of the second preset data range from the first-level index area by a binary search method, and reading back the data results of the preset data; performing data query in the second preset layer of the log structure merge tree and the third preset layer of the log structure merge tree, and checking the key value key to be queried, and reading back the data results of the preset data; merging the data results read back in the first, second, and third preset layers and returning them. The disclosed index persistence method can reduce index file read amplification without increasing the metadata management pressure of the file system.

The invention discloses a method for searching a base page and / or an increment page and computer equipment. The embodiment of the method comprises the following steps: receiving a read state key and a version; according to the state key and the version, matching the version and the page ID in the page identifier of the logic page according to the lexicographical order; searching in an index file of a basic page / incremental page according to the version and the page ID; and after the data file is found, reading the corresponding data file from the persistent medium according to the persistent medium position in the entry in the index.

The invention relates to an object storage management method and device, gateway equipment and a storage system. The storage gateway receives the current data and writes the current data into the corresponding block device; the storage gateway comprises a plurality of block devices, and each block device divides a data object according to a continuous offset range with a fixed length; setting a unique storage name for the current data to form a to-be-transmitted data object; after a preset uploading condition is met, uploading the to-be-uploaded data object in each block device to an object storage system; and after uploading is completed, generating index data carrying version information or time information according to the block device address and the unique storage name of each uploaded data object, and updating the index file. According to the method, the storage gateway realizes uploading processing and data management of the multi-version object, and is not limited by whether different object storage products support a multi-version control function, so that the storage gateway is flexibly adapted to all object storage products, and the compatibility with various object storage products is greatly improved.

The invention discloses a lightweight customer service operation backtracking analysis method and system based on an event stream snapshot, and relates to the technical field of backtracking recording, and the method comprises the steps: recording a DOM state of an initial page, traversing a DOM Tree of the whole page, converting the DOM Tree into JSON structure data through nodeType mapping, and generating a first screen DOM snapshot; updating incremental data after first screen snapshot, hijacking incremental change data by monitoring DOM incremental change, and storing the data into JSON structure data; and on the basis of the timestamp, assembling and restoring an event queue of the snapshots after analyzing by querying a screen recording index JSON file, reconstructing the snapshots into a corresponding DOM tree, and reproducing customer service operations covered in the timestamp. According to the invention, the technical design of event stream traceable recording is realized, and a new thought is provided for the application of the traceable recording technology.

The present application provides a message index processing method, a device, and a storage medium. The method comprises: acquiring a first index file from a local disk, wherein the first index file comprises a plurality of index slots and a plurality of index entries used for storing index information of different messages, index information corresponding to each of at least two messages mapped to a first index slot is stored in at least two index entries at non-contiguous addresses, and the first index slot stores address information of an index entry among the at least two index entries, said index entry storing index information of a message last mapped to the first index slot; performing format conversion on the first index file to obtain a second index file; and storing the second index file in an external distributed storage system.

The invention discloses an intelligent business archive management method and system, and the method comprises the steps: reading a contract file in a business archive, coding the contract file, configuring a project file and a financial file corresponding to the contract file according to the code of the contract file, carrying out the standardized coding of the files, and forming a standard coding data set; reading the standard coded data set, obtaining file information, and generating business archive early warning information according to the file information; standardized coding is carried out through identification information, and a standard coding data set is formed to carry out unified management of business archives; meanwhile, an index file is created, the standard coded data set is dynamically updated, and real-time updating of business archives is achieved on the basis of unified management; a natural language technology is adopted to realize quick and accurate search of the business archives, early warning information is generated for specific problems of files in the business archives and prompted in time, and whole-process intelligent management of the business archives of various types of associated files is realized.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The invention discloses a database system data query method and device based on index cache and a medium, and relates to the field of data query, the method comprises the following steps: writing specified data into a database according to a data writing request, and generating an operation record; updating the index cache based on the priority corresponding to the operation record in the memory queue; based on a preset time period, performing persistence processing on the index cache to generate an index file; and determining a corresponding query path according to whether a data table corresponding to the data query request has an index or not, and performing data query in an index cache or an index file based on the query path and whether the index cache is hit or not to obtain a query result. The problem that write-in performance and data consistency are difficult to consider at the same time is effectively solved, and the requirements of various application scenes with high requirements for database performance and data accuracy are met.

Systems and methods for sharing content between devices are disclosed. To request a shared piece of media content, a playback device generates and sends a request to content server. The playback device includes information in the request that indicates the playback capabilities of the device. The content server receives the request and determines the playback capabilities of the playback device from the information in the request. The content server then determines the assets that may be used by the playback device to obtain the media content and generates a top level index file for the playback device that includes information about the determined assets. The top level index file is then sent to the playback device that may then use the top level index file to obtain the media content using the indicated assets.

The invention provides a data management system and method for a multi-modal robot cluster, a medium, a terminal and a program product. The system comprises a data container module, a data storage module and a data management module, wherein the data container module is used for segmenting each bag file into a plurality of theme files and index files; the I / O transponder module is used for responding to a write-in operation request, respectively writing input multi-modal data into corresponding theme files according to theme types, and adding index entries generated based on a hot update mechanism into index files; and / or, in response to a read operation request, retrieving a time sequence index mapped by the memory, and forwarding the offset parameter to each theme file to read message data; the theme management module is used for creating a hash table; and the time sequence index caching module is used for caching the updated index file and refreshing the cached index file back to the storage device. According to the method, the requirement of efficient real-time data exchange of the multi-modal robot cluster can be met, and the data read-write efficiency is improved.

The invention relates to an ES-based data import optimization method and system. The method comprises the following steps: acquiring source data needing to be imported into an ES, and initializing an ES fragment group and a Hadoop cluster; performing fragmentation preprocessing on the source data by utilizing a Hadoop cluster to obtain a source data fragmentation group; according to the source data fragment groups, generating an index file conforming to an ES bottom-layer format, wherein each source data fragment group corresponds to one fragment in an ES cluster; compressing the index file by using a Zstand-ard compression algorithm to generate a compressed data block; distributing the compressed data block to a target node in an ES cluster according to a dynamic load fragmentation strategy; and the target node decompresses the compressed data block, and imports an index file obtained after decompression into the rear end of the current ES index file to complete import.

The present application discloses a method for finding useless files. First, find the paths and names of all files according to the directory index file. Then, divide all files of the software development project into two categories according to the file suffixes: code files and resource files. Then determine and record the dependencies of each code file. Then merge the dependencies of all code files to generate a complete dependency network of all code files. Finally, in the complete dependency network of all code files, the files corresponding to the independent subnets that do not contain the main file are regarded as useless files. The present application first forms a dependency network between files, and filters out useless files in combination with filtering rules, so that the search results are accurate and comprehensive.

According to the intelligent set top box and the live broadcast delay reduction method provided by the invention, the HLS data of the live broadcast source after channel switching is obtained in response to the channel switching instruction; the HLS data comprises an index file, and the index file records downloading addresses and playing durations corresponding to a plurality of data files. And analyzing to obtain the playing duration and the downloading duration corresponding to each data file in the first index file. And then determining a first data file meeting the playing condition from back to front according to the to-be-played sequence of the plurality of data files, and taking the first data file meeting the playing condition as a target data file. And then playing is started from the target data file, and each data file after the target data file is cached, so that the live broadcast fluency is ensured. According to the method and the device, the target data file is found from back to front according to the to-be-played sequential storage of the plurality of data files, so that the first broadcast position is closer to the live broadcast time after channel switching, and the live broadcast delay is reduced.

The invention discloses an electronic archive management method for a business document generation layout file, and belongs to the technical field of electronic archive management. Comprising the following steps: constructing a multi-dimensional feature vector by collecting business document scene features, screening candidate templates from a template pool by adopting a multi-level similarity matching algorithm, and adjusting and determining a target template in combination with a dynamic structure; the basic metadata and the associated system data are integrated, and qualified metadata is output through multi-level rule verification and abnormal data correction; based on the target template, executing data filling typesetting and format resource preprocessing by adopting a double-thread asynchronous processing mechanism, and generating a layout file conforming to PDF / OFD double standards through an adaptive algorithm; calculating a hash value of the layout file and writing the hash value into a block chain to realize tamper-proof evidence storage, and realizing secure storage and quick retrieval by adopting a distributed architecture in which a main file is separated from an index file. According to the method, the problems of low template matching precision, incomplete data verification, low processing efficiency, insufficient file safety guarantee and the like in the prior art are solved.

The invention belongs to the field of artificial intelligence and financial science and technology, and relates to a data backup recovery method which comprises the following steps: monitoring through a monitoring mechanism of a key value database, packaging a backup request into a backup request event, and writing the backup request event into a backup key value pair of the key value database; when a backup request event is monitored, calling a data writing instruction to write a data file into a preset storage position, and meanwhile, pausing a message of the consumption message middleware; after writing of the data file is completed, an index file is constructed according to metadata of the data file, and when construction of the index file is completed, snapshot backup operation is executed for backup; and after backup is completed, normal data processing is recovered. The invention further provides a data backup recovery device, computer equipment and a storage medium. In addition, the invention also relates to a block chain technology, and the data file can be stored in a block chain. According to the method, the data backup and recovery time can be greatly shortened, and the data backup and recovery timeliness is improved.

The invention belongs to the technical field of big data processing, and discloses an index construction method of mass seismic data, an index database and a query method.The index construction method of the mass seismic data comprises the steps that a data index analysis file for indexing a first keyword is created based on MapReduce, keyword-node distribution is conducted by reading the file, and the data index analysis file is stored in a database; according to the method, data distributed to each Reducer process is ordered in a Map partition stage when index files are created on the basis of a MapReduce parallel programming framework, and finally, each Reducer process outputs the index files in a multi-level data table form to obtain an overall ordered sorting result. The maximum innovation point of the index construction method for the massive seismic data is that two times of MapReduce operation are executed on target data, and all output results are selected not to be concentrated on a main node to be read, sorted and merged in a final stage, so that the problem that merging time is greatly increased along with the increase of the seismic data volume is solved, and the method is suitable for large-scale popularization and application. And the index creating efficiency of the PB-level massive seismic data is effectively improved.

The invention discloses a firmware upgrading method and device, electronic equipment and a storage medium, and relates to the technical field of servers, the method comprises the following steps: receiving a confirmation request from a substrate management controller; when it is determined that firmware upgrading is supported based on the confirmation request, confirmation information is sent; receiving each piece of original version information of a plurality of original firmware mirror images sent by the substrate management controller based on the confirmation information; searching the highest version information on which each piece of original version information depends in a preset mapping relation library; determining at least one original firmware mirror image to be upgraded according to the dependent highest version information; obtaining a storage path of mirror image identification information and a target firmware mirror image corresponding to each piece of original firmware to be upgraded; and generating an index file according to the mirror image identification information and the storage path, and sending the index file to the substrate management controller. According to the method and the device, the problems of long firmware upgrading time consumption and low upgrading efficiency caused by large volume of a full package for firmware upgrading are solved.

The application discloses a kind of high-performance distributed mass vector similarity search system and method, including Faiss Driver, several Faiss Worker and Etcd system;Faiss Driver is used to receive the query request of user end, and the query request is forwarded to the selected Faiss Worker by proxy, and is configured to perform loading configuration Etcd monitoring, exit pre-processing, service discovery and master-slave election task;Faiss Worker is the unit for executing query calculation in search system, and is configured to perform configuration management, shutdown processing, timing task, load index and query calculation task, for calculating similar vector retrieval and updating online or offline index file;Etcd system is used to save Faiss Worker list, master-slave state of Faiss Worker, health status of Faiss Worker, external storage module address of index file and index file list.The application introduces proxy forwarding service mechanism and master-slave node registration mechanism, and can efficiently process vector query calculation request.

The present invention discloses a data processing method, apparatus, computer equipment and storage medium. The method uses SQL statements written in advance according to the user's operating habits of using a database and the index structure of Elasticsearch as index classes, and writes index files. When using Elasticsearch to perform data operations, the pre-written index file is obtained, and when an operation instruction for Elasticsearch sent by the user is received, the index file is scanned and loaded; the corresponding index class in the index file is called according to the operation instruction, and the execution result corresponding to the operation instruction is obtained according to the operation instruction and the corresponding index class, and the execution result is fed back to the client; the present invention can obtain the data corresponding to Elasticsearch by writing simple SQL statements without writing complex script codes, thereby solving the problems of large workload and high user usage threshold caused by writing complex script codes, reducing user workload, reducing learning time and working time, lowering usage threshold and improving work efficiency.

This invention relates to a method for checking the consistency of row-level data files and index files based on the OpenGauss database. This method can be used to check the consistency of the physical files of the main table, the physical files of the index table, and the logical consistency of the physical files of the main table and the index table. This consistency checking method overcomes the shortcomings of traditional data file consistency verification methods, such as delayed startup and the possibility of business failures or even database instance anomalies due to check failures. Through this method, DBAs can periodically and proactively perform full consistency checks on the physical files of specified tables during daily operations and maintenance. It can also check the consistency relationship between the physical files of the b-tree indexes related to the main table and the physical files of the main table, thereby enabling timely detection of data file consistency issues in the database and taking corresponding remedial and mitigation measures to minimize potential impact and losses.

The invention relates to a log processing method based on dynamic triggering and index driving, and relates to the technical field of computer software, and the method comprises the following steps: coding log entries through a dictionary coding rule, generating coded log entries, and writing the coded log entries into a plaintext log file; monitoring a file state of the plaintext log file, and when the file state meets a preset dynamic triggering condition, compressing the plaintext log file to generate a compressed log file; generating an index file associated with the compressed log file, wherein the index file comprises metadata; and in response to a user query request, positioning and compressing a target data block in the log file based on the metadata, decompressing and reversely decoding the target data block, and filtering decoded log contents according to the query mode to output a log query result. By means of the scheme, development complexity is reduced, efficient real-time compression is achieved, full scanning is avoided, consumed time in the index positioning stage is reduced from the minute level to the millisecond level, and query efficiency is improved.

The present application relates to the technical field of database, in particular to an index updating method, product, medium and equipment. The index updating method comprises: triggering index page inspection by using a preset hybrid scheduling strategy, and identifying a to-be-merged page in an index file; judging whether a target page matching the to-be-merged page exists in the index file; if yes, acquiring a page lock of the to-be-merged page and the target page; merging the to-be-merged page and the target page, and releasing the page lock. The present application locks and releases by page granularity before and after page merging, ensures the atomicity and concurrent safety of the merging operation, avoids locking the whole table or the whole index, effectively suppresses the index file expansion without blocking normal read-write business, and improves the system availability.

The invention discloses a portable electronic genealogy rapid searching and displaying device and system, and solves the problem of rapid searching and displaying of names and character biography data of immediate elders. According to the technical scheme, through hardware integration of a commercialized serial port screen assembly and a customized control panel assembly, embedded systems such as FreeRTOS and the like and an FATFS file management system are combined; and the lineage chart visualization and the quick retrieval of the character biography data are realized. Compared with a traditional paper genealogy and a scanning electronic document, the method has the advantages that through a filename mechanism for associating the interface ID and the control ID of the serial port screen component with the text file for storing the biography data by the index file, the problems of shadow display of names corresponding to the names of the lineage diagrams and tedious checking and displaying of the cross-page lineage diagrams in the one-pulse-accompanying interface are solved; the problem of contrast display of straight elders of any two persons in the same genealogy is solved, and when the generations of the name to be checked exceed 10 generations, the checking and displaying efficiency is improved by more than hundreds of times.