86results about How to "Improve read and write performance" patented technology

The invention relates to a performance optimization method for a Ceph cache system based on a persistent memory, and the method comprises the steps: enabling a Ceph storage system based on the persistent memory to adjust the related parameter configuration of a cache and the persistent memory through a parameter optimization system, feeding back performance data through performance monitoring, completing the adjustment and optimization of configuration parameters, and finally obtaining an optimal performance parameter combination. Comprising the following steps: S1, configuring a persistent memory device; step S2, configuring a Ceph OSD (On Screen Display); s3, performance monitoring and sampling are carried out, and a sample set is generated; s4, dynamically adjusting the parameter optimization system; step S5, testing and verifying; the problem of slow data storage performance of a storage system constructed by a common HDD hard disk is solved, data caching is accelerated by utilizing the characteristics of high bandwidth, high throughput and data persistence of the persistent memory, and then the overall performance of the Ceph storage system is improved by integrally optimizing the parameters of the storage system after the persistent memory device is used.

The invention discloses an intelligent isolation and asynchronous cleaning HDFS recycle bin design method and system, and the method comprises the steps: creating an independent recycle bin directory for each user; one metadata file is maintained under each recycle bin directory; setting access permissions of a specific user and a system administrator for each recycle bin directory; metadata in a recycle bin of files is stored in a RocksDB, and two tables are designed in the RocksDB: the table 1 is used for clearing out expired files, and the table 2 is used for recovering and displaying the files; when the file is deleted, determining a recycle bin ID of a user according to a path before the file is deleted, and inserting recycle bin metadata of the file into the RocksDB; the specified file is found and recovered by querying metadata in the table 2, and the RocksDB is updated; and cleaning the expired file regularly or as required by utilizing the self-defined expiration time in the table 1, and updating the RocksDB. According to the method and the system, the problems of performance bottleneck and management complexity of the Hadoop recycle bin in a high-concurrency and large-data-volume scene are solved.

The invention discloses an air-situation fusion data recording and playback system and a playback method thereof. The air-situation fusion data recording and playback system comprises a data recording module, a data analysis module and a data visual display module. The method comprises the following steps: firstly, embedding a data recording module into an air-situation fusion system through an interface, acquiring key data in the system through a data recording interface in the working process of the system, and recording the data according to a preset rule to form a data file; secondly, the data analysis module operates file pointers of data files recorded in the system process according to a data recording rule to perform data offset so as to realize data anti-translation; and finally, the visual display module carries out time registration on the read data and then carries out visual playback display. According to the method, comprehensive analysis, recording and objective and real reproduction of the air situation information in the multi-source radar system and the fusion situation of the air situation information are achieved, a new thought is provided for data recording and playback of the multi-source radar air situation fusion system, reusability is high, and expandability is high.

The invention discloses a time sequence electroencephalogram data quality detection and restoration method and a time sequence electroencephalogram data quality detection and restoration system, and belongs to the technical field of industrial internet. According to the method, the problems that the electroencephalogram data is lost, the electroencephalogram data quality is poor and the electroencephalogram data storage efficiency is low are solved. According to the method, by calculating the integrity index of the electroencephalogram data, the hidden data value missing condition can be detected, then the data filling operation is guided according to the missing detection result, and the original electroencephalogram data characteristics can be recovered. Effectiveness indexes are established on the basis of effectiveness, change speed and acceleration of values, quantitative evaluation standards can be provided for reasonability of electroencephalogram data values so as to detect whether data points are reasonable and have sudden changes or abnormities or not, a data restoration method is further selected according to detection results, data stability is enhanced, data continuity is improved, and the accuracy of data restoration is improved. The electroencephalogram data quality is improved, and subsequent data analysis is facilitated. The method can be applied to electroencephalogram data quality detection and restoration.

The invention discloses a read-write driver circuit based on temperature sensing and a control method thereof, and the method comprises the steps: carrying out the quantification and coding of an obtained temperature signal, and obtaining temperature coding information; receiving test data and acquiring corresponding check coding information; voltage and pulse parameters corresponding to the current temperature coding information are determined according to the temperature coding-voltage-pulse initial corresponding relation; writing test data into a memory according to the determined voltage and pulse parameters; performing verification detection on the test data according to the verification coding information; if the detection is wrong, the test data is repeatedly written until the detection is accurate after the corresponding relation is adjusted according to the setting; and updating the corresponding relation between the current temperature code and the voltage and pulse parameters according to the finally determined voltage and pulse parameters. According to the scheme, the read-write parameters of the memories of the same batch and the same model at different temperatures are obtained through the preset corresponding relation table and real-time test adjustment, and excellent read-write performance is achieved on the premise that low power consumption and long service life are guaranteed.

The invention discloses a database storage method, which realizes high optimization of a storage space by finely classifying key value pairs and storing the key value pairs in different regions. The recovery frequency is dynamically adjusted, only the key value pairs marked as deleted are erased, storage fragments and the erasure frequency are reduced, the storage efficiency is improved, and the service life of storage equipment is prolonged. When the sectors are recycled, adjacent idle and invalid sectors are combined, so that the storage space utilization rate and the access efficiency are improved. When the new key value pairs are stored, the new key value pairs are preferentially distributed from the combined sector pool, the storage process is simplified, and the response speed is increased. The data access frequency and the sector erasure life are combined, the merged sectors are finely grouped, resource allocation is optimized, and the data access efficiency is improved. And meanwhile, a direct local modification technology is adopted, so that data migration and rewriting are reduced, and the updating operation efficiency is improved.

The present application belongs to the field of database technology, and specifically discloses a connection reuse method and device based on database distributed communication, the method comprising: receiving an SQL request from a business component, and starting a transaction based on the SQL request; if the current SQL statement is a start transaction statement, searching and determining the first connection slot that matches successfully from the connection pool cache, and taking the first connection slot from the connection pool cache, and executing the current SQL statement according to the first connection slot; looping and executing subsequent SQL statements in the transaction until the transaction ends when the current SQL statement is a commit statement or a rollback statement, updating the reference count of the connection slot, and returning the connection slot to the connection pool or continuing to retain it in the connection pool cache according to the reference count; when all SQL statements are executed, returning the connection slot to the connection pool. Through the present application, the connection utilization rate can be improved to improve the operating efficiency of the system.

The present invention discloses an operating system protection method based on the combination of soft and hard read-only. The method realizes soft read-only control from the system level and realizes bottom-level data read-only control at the hardware level. It is compatible with GPT and MBR partitioning forms, improves system access performance, and also ensures the stability and reliability of the operating system, and also ensures the security of the operating system. At the same time, this method can greatly reduce the number of read and write times of SSD solid-state storage disks, improve the read and write performance and life of SSDs, and the invention has good application prospects in key areas such as data security.

The utility model provides a payment terminal with a magnetic head waterproof structure, which relates to the field of financial transaction equipment and comprises a casing, one side of the casing is provided with a card swiping slot, one side in the casing close to the card swiping slot is provided with an installation slot used for installing a magnetic head assembly, the installation slot is provided with a sealing cover, and the sealing cover is inserted into the installation slot to form an isolation chamber. The magnetic head assembly is installed in the isolation chamber and comprises a connecting line, and the connecting line extends out of the isolation chamber and is electrically connected with the mainboard. The magnetic head assembly further comprises a magnetic head and a support, the magnetic head is installed on the support, the support comprises a top cover, the connecting line penetrates through the top cover, the top cover is provided with an annular protrusion around the connecting line, the top cover is provided with an insertion hole in a sealed insertion mode, and the annular protrusion is inserted into the insertion hole in a sealed mode. According to the utility model, the magnetic head assembly is isolated from the internal components of the device through the structure, the waterproof and dustproof effects of the financial transaction device are improved, the application scene of the device is expanded, and the service life of the device is prolonged.

The present disclosure provides an information processing method, device, equipment, storage medium and computer program product, relates to the technical field of computers, and particularly relates to the field of software development. The specific implementation scheme is as follows: acquiring at least one item of information in file information and version information of a specified version in a remote version library; archiving the at least one item of information to obtain an archiving package of the specified version; the type of the archiving package of the specified version is a first type or a second type, the archiving package of the first type carries the file information of the specified version, and the archiving package of the second type carries the file information and the version information of the specified version; sending the archiving package of the specified version to a third-party storage system; and the third-party storage system is used for storing the archiving package. The technical scheme of the present disclosure can archive at least one item of information in the file information and the version information of the specified version in the remote version library and store the information in the third-party storage system, so as to reduce the read-write pressure of the remote version library and improve the overall read-write performance and throughput.

The present invention provides a multi-tag anti-collision mechanism NFC reader / writer, comprising: an NFC reader / writer module, which is integrated with a tag anti-collision algorithm, and when the number of NFC tags is 1, a single NFC tag information is identified; when the number of NFC tags is greater than 1, the tag anti-collision identification algorithm is turned on and the identification order of the NFC tags is set, and then each NFC tag information is read one by one according to the identification order; an NFC antenna impedance matching module, which accepts the control of the NFC reader / writer module and automatically adapts the difference between the input impedance of the NFC antenna and the output impedance of the NFC reader / writer module. The multi-tag anti-collision mechanism NFC reader / writer provided by the present invention can orderly poll the information of multiple tags when reading multiple NFC tags through the tag anti-collision algorithm.

The present invention provides a method for optimizing a memory and a cache block, wherein the memory includes: firmware, in which a free list, a write cache list and a read cache list are arranged; when performing a read and write operation, the main control unit is used to call a cache block from the write cache list and the free list to perform a write operation, and to call a cache block from the read cache list and the free list to perform a read operation; when performing a recycling operation, when the mapping relationship of the host data to be erased matches the mapping relationship of the host data stored in a certain cache block in the write cache list and the read cache list, the host data of the cache block is erased, and the relevant information of the cache block is stored in the free list. Through the method for optimizing a memory and a cache block provided by the present invention, the allocation mode of the cache block can be optimized, so that the cache blocks can be mixed in different scenarios.

The invention relates to a data processing method, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that when a first process performs data reading and writing, a target node where a target copy is located is determined, and a target communication mode is determined according to the target node; and the first process performs data read-write interaction with a second process by adopting the target communication mode to complete read-write operation of to-be-processed data. By adopting the method, the data read-write performance can be improved.

The invention discloses a distributed synchronization method for multi-agent cluster data. The method comprises the following steps: determining an agent fragment structure; state updating and node fault detection in the cluster are realized by using a Gossip / SWIM protocol, and an active agent list in the cluster is determined; the maximum message length of network transmission is determined according to the network state, and a TCP / UDP protocol is adopted to carry out data communication between the intelligent agents; updating data information in the intelligent agent cluster by utilizing incremental synchronization operation; and domain-based synchronization is realized by using a cluster structure and a data label mechanism. According to the method, high reliability, real-time performance and safety in the data transmission process between agent clusters are met, and expandability and maintainability are supported, so that subsequent expansion and maintenance of the system are facilitated.

The present invention discloses a method and device for integrated uploading of files, and a method and device for downloading files, wherein the integrated uploading method comprises: obtaining multiple first files sent by a client, and metadata information of the first files, wherein the metadata information of the first files comprises name information, length and content information; calculating and generating offsets corresponding to each first file according to the length of each first file; integrating and generating a second file according to the offset and metadata information of each first file; uploading and writing the second file to a disk for storage. By implementing the present invention, the problems of poor disk read / write performance and low efficiency of uploading small files caused by concurrent uploading of multiple small files in the related art are solved, and the metadata information and content information of the uploaded multiple small files are combined to integrate into a large file, thereby reducing the additional disk read / write overhead and improving the disk read / write performance.

The invention discloses a routing method and device for a distributed erasure code deduplication system and a readable medium, and is used for solving the problems that in the erasure code deduplication system, part of data blocks are insufficient in reliability and the system performance is reduced, and the method comprises the following steps: adjusting the sequence of deduplication and erasure code coding, it is guaranteed that each data block of the file can participate in erasure code coding, and the same reliability guarantee is provided for each data block of the file; in combination with a cuckoo hash algorithm, a local deduplication technology is used for replacing global deduplication, so that the read-write performance of the system is improved; and a decentralized structure is designed, so that the problem of cluster failure caused by failure of a single node is avoided, and the performance of the system under a high-load condition is further improved. According to the invention, the read-write performance of the system is improved while high-reliability guarantee is provided for the system, and the performance improvement is more obvious under the condition of high load.

The invention discloses a disk data backup method of a virtual machine, a server and a storage medium, which are applied to a first server, and the first server supports a VMware virtual machine function. The method comprises the steps that a disk backup identifier sent by a second server is received, a first instruction is sent to a VMware server, the disk backup identifier is obtained by a third server from the VMware server and forwarded to the second server, and the first instruction comprises a disk identifier of a disk to be backed up and the disk backup identifier; obtaining disk data corresponding to a disk backup identifier in a to-be-backed-up disk determined by the VMware server according to the disk identifier; and sending the disk data to the second server. According to the invention, data transmission and data backup between heterogeneous servers can be realized.

The invention discloses an LSM-Tree structure storage and writing performance optimization method and system, and belongs to the technical field of storage and writing performance optimizing.A grouping log structure GLS is designed to be used for canceling the limitation that data on the same layer in an LSM-Tree structure are completely ordered; and respectively carrying out write operation and read operation, and maintaining the orderliness of data in a group through a grouping log structure GLS to realize write performance optimization.

This invention discloses a method and system for rapid batch data import into HBase based on parameter configuration, relating to the field of database technology. The method includes: configuring a data import and merging strategy for HBase tables in scenarios where batch data calculated by the Spark engine is imported into an HBase database; performing calculations on business data using the Spark engine, writing the generated dataset to HDFS and recording it in an information table; continuously adding HDFS file directories according to the file generation time order of the information table, and submitting an MapReduce task to generate an HFile file when the requirements of the data import and merging strategy are met; and importing the HFile file into the HBase database. This invention avoids the problem of too many small files in HBase, improves the read and write performance of the HBase database, and reduces the time spent on business calculations.

The embodiment of the present application proposes a read and write method for a multi-core storage device, including: the front end receives a first operation request, applies for a first node from a preset node pool according to the first operation request, pre-processes the information of the first node, and sends the first node and the first operation request to the back end through a preset message queue; the back end parses the first node according to the first operation request to obtain node data corresponding to the first node; when the front end receives a second operation request, applies for a second node from a preset node pool according to the second operation request, and generates a linked list according to the first node and the second node, wherein the linked list head of the linked list points to the first node; the back end obtains the node state of the first node, and when the node state is a processing state, parses the second node to obtain the node data corresponding to the second node. In the embodiment of the present application, the front end and the back end communicate based on the linked list to which nodes can be added in real time, thereby reducing the time of using the message queue and improving the read and write performance.

This invention discloses a chip packaging structure and method, including a molding compound I, which encapsulates at least four layers of chips. Through-holes (TVMs) are fabricated on the molding compound I and metallized. Redistribution lines are provided on the molding compound I, and balls are placed on the redistribution lines. This invention achieves vertical interconnection of multiple layers of chips through staggered chip stacking combined with TMV technology, effectively utilizing space and reducing package size. The TMV vias employ a solid metallization scheme, which can effectively improve the power integrity and signal integrity of the product, enhance the read / write performance of the storage product, increase I / O density and bandwidth, and reduce power consumption. The packaging structure can include multiple stacked structure arrays, suitable for large-scale integration, increasing packaging density.

The embodiment of the invention relates to a memory management method and device of a security chip and electronic equipment, a plurality of cards are integrated on the security chip, the plurality of cards share the physical space of a non-volatile memory (NVM) of the security chip, and the NVM virtual space corresponding to each card is isolated through a firewall. The NVM virtual space and the NVM physical space correspond to each other and are the same in size; the method comprises the following steps: in response to a received request for writing data into a target virtual address, writing the data into a cache region corresponding to a currently running target card; the data in the cache region is written into the NVM physical space in response to the fact that NVM writing conditions are met, and the NVM writing conditions include receiving of a transaction submission request, page crossing and active submission of a user. By adopting the technical scheme, the multi-card memory management of the security chip is realized, the erasing frequency is reduced, the read-write speed is increased, the read-write performance is improved, and the service life is prolonged.

The invention discloses a service renewal data processing method and device, and relates to the technical field of intelligent medical treatment. A specific embodiment of the method comprises the steps of receiving a renewal order completion instruction which is triggered by a user and carries a renewal service package identifier in response to the fact that a basic service package of the user is in an effective state, and obtaining available duration of the renewal service package; and combining the actual use time range of the basic service package with the available duration of the renewal service package to obtain the actual use time range of an aggregation service package formed based on the basic service package and the renewal server. According to the embodiment, service renewal can be realized based on the renewal service package.

The present invention discloses a hardware implementation method for optimizing KV storage performance based on configurable logic, including the following hardware implementation process: using CRC as a HASH function, and supporting 17 options, namely CRC16 to CRC32; using a chain address method to solve the HASH conflict problem, and the same chain is arranged from small to large according to the size of the key; adjusting the number of entries in the HEAD ZONE by adjusting the HASH function; wherein Key_info_buf is a unit containing a key and a pointer to a value. The present invention is a study based on a new KV storage form, KV-SSD, based on the implementation of HASH, hardware acceleration is achieved through a configurable logic, and the read and write performance can be adjusted in real time according to actual applications.

This application discloses a data processing method, terminal device, and storage medium. The data processing method includes: extracting a first storage tag from a first storage space to a second storage space, and generating a tag linked list based on the first storage tag; wherein the first storage tag is used to store information to be processed; constructing an identifier-tag mapping table and a file identifier linked list by traversing each first storage tag in the tag linked list; and completing the data processing of the information to be processed based on the tag linked list, the identifier-tag mapping table, and the file identifier linked list.

The invention provides an SSD bad block remapping method and device and computer equipment, and the method comprises the steps: reading a first-level remapping table and a second-level remapping table from an NAND to an SSD when the SSD is powered on; wherein remapping summary information of each super block is recorded in the primary remapping table, and remapping detailed information of each super block is recorded in the secondary remapping table; when a read-write instruction of a host is received, inquiring the first-level remapping table to judge whether physical block remapping exists in the super block needing to be read and written currently or not; if the super block has physical block remapping in the first-level remapping table, querying and obtaining the position of physical block remapping from the second-level remapping table according to summary information recorded in the first-level remapping table; and performing read-write operation according to the remapping position of the physical block. The method has the beneficial effects that the remapping bad block can be quickly queried on the basis of small memory overhead, so that the read-write efficiency is improved, and the read-write performance of the SSD is improved.

The present disclosure provides a method and device for improving the performance of a smart network card, wherein the method includes: obtaining the address of the table entry pointed to by the read request instruction of the current processing module; determining the hash value corresponding to the address according to the address of the table entry; determining the locking state of the cell corresponding to the read request instruction according to the hash value and a pre-constructed bitmap lock table containing multiple cells; and determining whether the scheduler performs a read operation according to the locking state of the cell. The present disclosure introduces a bitmap lock table structure to disassemble a lock in the prior art into multiple locks, thereby reducing the conflict probability of each lock and improving the read and write performance of the table entry.

The invention provides a storage method and a database system. The method comprises the steps that in response to modification operation of a plurality of data pages, a plurality of log records are generated, and each log record corresponds to the modification operation of one data page; writing the plurality of log records into a log storage node; based on the plurality of log records in the log storage node, updating the plurality of data pages to obtain a plurality of updated data pages; and writing the plurality of updated data pages into a data storage node. According to the scheme, the performance of the database system can be improved.

The invention provides a monitor central station ordered data storage method, an indexing method and computer equipment, and the method comprises the following steps: an ordered data storage step: receiving real-time data reported by a monitor, extracting the ordered data, converting the ordered data into a file storage data structure, compressing the data structure, and adding the compressed data structure to a latest ordered data file; a global offset obtaining step: after the ordered data is written, calculating the global offset of the ordered data by using the offset written into the ordered data file; and an index data storage step: constructing index information according to the global offset, calculating the position of the current data in the index data file by using the data timestamp, and writing or updating the index data to the corresponding position. According to the method, the classification and segmentation storage method is optimized on the basis of monitoring vital sign data characteristics, the monitoring data storage duration is prolonged, efficient, continuous and ordered indexes are established for waveform data and measured value data on the basis of the time sequence, the review data reading performance can be greatly improved, and efficient support is provided for other analysis and viewing.