Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

46results about How to "Reduce IO operations" patented technology

EXCEL data export method and export device in multi-concurrence large data volume environment

The invention discloses an EXCEL data export method in a multi-concurrence large data volume environment. The EXCEL data export method in the multi-concurrence large data volume environment comprises the following steps that (a) configuration information in a configuration file is set, the configuration information comprises data export format information, data table structure information, and the information about the data volume output every time, and the data export format is an xml format; (b) the configuration information is analyzed; (c) user inquiry conditions are obtained; (d) an executable statement of a database is generated, the executable statement of the database is generated according to the user inquiry conditions and the information about the data volume output every time; (e) data conversion and data output are carried out, the data needing exporting are converted and output in batches, and the memory is released every time output is finished. According to the EXCEL data export method and export device in the multi-concurrence large data volume environment, the output data format is defined as the xml format, the EXCEL files with a large data volume are exported in batches, the memory is released every time exportation is finished, and therefore occupation of the memory in the data downloading process can be largely reduced.
Owner:成都交大光芒科技股份有限公司

Method for semantic query of large-scale knowledge graph based on spark

The invention discloses a method for semantic query of a large-scale knowledge graph based on spark. The method comprises the steps that (1) entities and relations in each triple are replaced by corresponding id; (2) a layered sub-graph index is established based on categories and relations and the index is stored in a hdfs document; (3) operations related to sparql query are translated by an spark operation primitive language; (4) different score functions are distributed according to characteristics of each triple mode, and an execution sequence of each triple mode in the sparql query is determined; and (5) according to the execution sequences of the triple modes and the spark operation primitive language, query and linkage are executed, and then a linkage result is analyzed by a mapping list and then returned. According to the invention, efficient query of massive semantic data is supported; extendibility is very high; and the method has very high practical values for query and application based on large-scale semantic data.
Owner:ZHEJIANG UNIV

Rapid retrieval method and system for mass website basic information

The invention relates to a rapid retrieval method and system for mass website basic information. The method comprises the steps of collecting website basic information, and converting the basic information into a json formatted file of a fixed field to be used as a retrieval object; constructing a reverse index system; rapidly retrieving by use of a full-text retrieval method; and maintaining the reverse index system by use of a B tree structure. Through adoption of the method, working time is saved, and the retrieving efficiency is greatly improved.
Owner:NAT COMP NETWORK & INFORMATION SECURITY MANAGEMENT CENT

Massive vehicle-mounted machine track data storage method

The invention discloses a massive vehicle-mounted machine track data storage method which can meet the storage requirement of TB-grade track data generated every day under the condition of access of massive vehicle-mounted machine, and can search track data of a certain vehicle in a short time. The storage method takes a file system as a storage medium, the file system is divided into directory structures with three layers according to years, months and days, each vehicle-mounted machine generates a track file every day, the track file is stored in corresponding directories, and the track files in a previous day are combined and compressed at 0 o'clock every day.
Owner:北京中交兴路车联网科技有限公司

Method and device for selecting resources according to system configurations

The invention discloses a method for selecting resources according to system configurations. The method comprises the steps that according to identification information of a resource to be selected, a pre-generated correspondence set of resources and the configuration combinations, the configuration combinations corresponding to resources to be selected are obtained; a target configuration combination matched with the current system configuration is selected from the configuration combinations; according to the identification information of the resource to be selected, a corresponding resource in the resource set corresponding to the target configuration combination is selected. The invention further provides a device for selecting resources according to the system configurations. By adopting the method, due to the fact that the pre-generated correspondence set of the resources and the configuration combinations, every time one resource is selected, the configuration combination information of each host resource set of the resource can be rapidly obtained by inquiring the correspondence, the operation of searching for the resource set is greatly simplified, and therefore the resource selection speed can be increased and the system performance can be improved.
Owner:BANMA ZHIXING NETWORK HONGKONG CO LTD

A data block storage method, reading method, device and block chain

The present invention discloses a data block storage method and reading method, apparatuses thereof, and a block chain. The storage method comprises: before writing a new data block in the block chain, converting transaction record data in each row in a transaction record structure of the new data block to the processing of storing the data in a column structure; creating column structure storageidentification information in the new data block stored in a column structure; and storing the new data block with the column structure storage identification information into the block chain. Since the transaction data in each row is stored in a column structure, and the column structure storage identification information is created, when querying the transaction record data, instead of queryingthe entire transaction record data, only the transaction record data of the corresponding column needs to be queried according to the identification information; a large number of system IO operationsare reduced, large-capacity and high-concurrent query requirements can be supported, and efficient data processing can be facilitated; and in addition, by extending the columnar storage structure, changes in the future transaction record details can be handled.
Owner:CHINA MOBILE COMM LTD RES INST +1

Rapid association classification and hierarchical storage method for network security logs

The invention discloses a rapid association classification and hierarchical storage method for network security logs, which comprises the following steps: defining an XML (Extensible Markup Language) format log template according to different application metadata, the log template comprising alarm log information, association flow log information, application metadata log information, message log information and file attachment log information; associating the alarm logs, the associated flow logs, the application metadata logs, the message logs and the file attachment logs together through flow and transaction information in the logs, wherein each alarm log outputs a complete log; performing hierarchical storage mechanism output on logs, including values in alarm log information, associated flow log information, application metadata log information, message log information and file attachment log information; the hierarchical storage mechanism adopts two levels, the first level adopts a memory file system, and the second level adopts an SSD / HD storage system with RAID. According to the technical scheme, the performance problem of Json log format output is solved.
Owner:深圳市东晟数据有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products