46results about How to "Reduce the number of IOs" patented technology

An embodiment of the invention provides a method and a device for real-time statistics of logs. The method comprises the following steps of configuring a cluster statistics rule; carrying out rule matching on on-line logs and recording to-be-statistical information which meets the cluster statistics rule; receiving the recorded to-be-statistical information which conforms to the cluster statistics rule at every statistical period; carrying out cluster statistics operation on the received to-be-statistical information; storing a statistical result subjected to the cluster statistics operation; and querying the stored statistical result according to a received query request and showing a query result. The method and the device have the advantages of high statistical performance, low hardware requirements and capability of greatly saving the hardware cost.

The invention discloses a file reading method and system of distributed storage syste, an electronic device and a computer-readable storage medium. That method comprise the steps of: when an IO request of a client is received, determining a read-ahead upper limit accord to a data size of the IO request; Sending a read request with a size of the upper limit of the pre-read to the object storage device each time, and storing a return result of the read request into a memory until all data corresponding to the IO request are read; Returning data corresponding to the IO request stored in the memory to the client. Thus, the file reading method provided by the application can reduce the interaction times between the client and the object storage device, reduce the IO times of the disk, improve the sequential reading performance, thereby improving the performance of the entire storage system and enhancing the product competitiveness.

The embodiment of the invention provides a big data write-in method and device, a big data read method and device and a big data processing system. The write-in method includes the steps that a write-in request is received; big data are segmented into multiple pieces of subdata according to the write-in request; the subdata are uniform in length, and relative positions of data parts, corresponding to the same field, in the subdata are fixed; the subdata are written in a specified storage medium; storage positions, in the storage medium, of current subdata are added to all the subdata. The big data can be positioned easily, conveniently and rapidly, time consumption is reduced, the speed of storing and reading the big data is increased, and system performance and working efficiency are improved.

The invention discloses a method for calculating fund estimation values and risk indexes in real time, and the method comprises the steps: S1, obtaining a data source of a transaction system, and building a calculation data model; S2, grouping and loading the data sources according to the service; S3, carrying out parallel computing on the grouped and loaded data; Ss4, aggregating and summarizingresults of the parallel computation; and S5, generating an estimation result set or a risk control result set according to the business scene. The distributed big data framework is utilized, parallelcomputing of data can be easily achieved, the computing capacity of multiple computers can be utilized based on a distributed computer system, and the processing speed is higher than that of a single-machine system.

The invention discloses a backboard interface SMI and UART multiplexing method, and can solve the technical problems that in the design process of an existing router, the number of main control singleboard connectors needing to be designed and the number of layers of a backboard are large, and the design is complex. Based on a main control single board, a backboard unit and an interface single board, the method comprises the following steps that S100, an interface card is powered on, and whether a CPU exists on the single board or not is judged through a Uart interface of a CPU; S200, a body_ on signal of the interface single board and an SMI register are set; S300, the main control logic receives the body _ on signal of the interface single board, and an SMI interface is started to access an interface single board SMI register; And S400, whether the backboard interface is an SMI interface or not according to the value of the register is judged, the backboard interface is set as a Uart interface and the SMI interface is closed if not. According to the backboard interface SMI and UART multiplexing method, the number of connectors of a backboard main control slot position can be reduced, and the design of an interface single board cpu is reduced.

The invention provides an edge side message delivery method and apparatus, and an electronic device. The method comprises the steps of obtaining a working condition message and a to-be-confirmed message sent by an edge side device; performing data processing on the working condition message, and generating a feedback message for confirming reception; and updating a message database according to the to-be-confirmed message and a feedback message confirmed to be received; A data retransmission request is generated based on unacknowledged received messages in the message database. According to the method, whether the working condition message is successfully sent or not is checked on the cloud platform, if not, the cloud platform generates the data retransmission request, even if network flash occurs when the cloud platform sends the data retransmission request to the edge side equipment, the cloud platform can send the data retransmission request again due to the fact that the working condition message is not successfully sent, and the data retransmission request is sent to the edge side equipment. According to the method provided by the invention, the reliability of edge side message delivery is greatly improved, the IO frequency of edge side equipment data storage is reduced, and the system performance required by the edge side equipment is reduced.

The invention provides a bitmap storage method. The bitmap storage method includes the steps that stripes of a redundant array of inexpensive disks raid are evenly distributed according to the number of CPUs, and multiple blocks corresponding to the CPUs one to one are acquired, wherein each block comprises multiple raid stripes; multiple bit pairs are selected from a memory and used for representing the use states of the blocks, and a region bitmap is acquired, wherein the bit pairs comprise first bits and second bits, the first bits are used for representing whether the blocks are written or not, and the second bits are used for representing whether the blocks are initialized. By the adoption of the bitmap storage method, the IO number of the stripe blocks to which a computer has access for the first time after the computer is restarted can be reduced, the first-time IO write speed is higher after the computer is restarted, when the computer is restarted, the initialization and reconstruction progress is kept to a large degree, and multiple restarts are allowed in the reconstruction or initialization process; the storage region of the bitmap is saved, and then the probability that the bitmap in superblocks breaks down is reduced.

The invention relates to the technical field of data processing, and provides a caching method, system and device for small block input and a storage medium, and the method comprises the steps: S110,integrating multiple write requests belonging to an object into an IO set belonging to the object; S120, transmitting the integrated IO set to a placement strategy group; S130, integrating the IO setsin the placement strategy group; and S140, performing caching processing on the metadata of the object of the IO set in the integrated placement strategy group. By utilizing the method and the device, the IO quantity of PG processing can be reduced, CPU resources are released, and the data processing efficiency is improved.

The invention discloses a transaction log playback method and device of a distributed core system, equipment and a medium. The method comprises the steps that in the desensitization processing process, a log processing sequence number is obtained according to a transaction request timestamp field in a transaction log; wherein if the transaction request time of different transaction logs is the same, the corresponding log processing sequence numbers are the same; according to the log processing parameters, processing the log processing sequence number to obtain a log playback sequence number; wherein the log playback sequence numbers are continuous numerical values, and each log playback sequence number corresponds to one transaction log. Compared with the prior art, the embodiment of the invention is suitable for a scene with a large transaction volume in a distributed core system, the success rate of transaction log playback is improved, and the automatic test efficiency and coverage rate are improved.

The invention discloses a database query method and system, and belongs to the technical field of data query; the method includes, based on a KV storage engine, storing data queried from a disk by a database according to a SELECT statement defined by a user in the KV storage engine; defining metadata for a data set queried by a user, and recording data information; recording metadata state information of the batch of queried data at different time nodes through a state recorder, and recording metadata changes caused by operation into the state recorder when the data are operated every time. The problems that a traditional database query method is low in large-batch data query efficiency, large-batch data memory occupation is high, system performance is affected, and the traditional database query method is not suitable for scenes where the same batch of data is repeatedly used can be solved. The performance of repeatedly using the query data is remarkably improved, the disk loss is reduced, the function is expanded, and the operation convenience is improved.

The invention belongs to the field of wireless communication, and particularly relates to a reconfigurable electromagnetic metasurface biasing method, which at least comprises an array surface formed by a reconfigurable electromagnetic metasurface unit and a biasing circuit unit, and is characterized by comprising a DAC (Digital-to-Analog Converter) module (9), an array bottom surface unit (8), an array top surface unit (10) and a Pin tube (1), and the array bottom surface unit (8) and the array top surface unit (10) are connected through a lead and a via hole. The reconfigurable electromagnetic metasurface biasing circuit is simplified, the number of biasing lines is from o-n2 to o-n, the number of IO interfaces occupied by a rear-end circuit is reduced, and the influence of the biasing lines on the electromagnetic property of a unit is reduced; and the number and the positions of the current-limiting resistors are reduced, and extra microwave loss caused by the current-limiting resistors is avoided.