Data processing method and device
A data processing device and data processing technology, applied in the direction of file/folder operation, input/output to record carrier, file system, etc., can solve the problems of long time for multiple messages, inconvenient operation, low writing rate, etc., to achieve The writing process is fast and stable
Active Publication Date: 2019-06-04
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The disadvantage is: message writing involves parsing each message, resulting in low writing rate
Therefore, it takes a long time to write multiple messages, and it is easy to be disturbed and cause the writing to fail
[0005] Read phase: In most message transmission storage models, the server uses random read operations on messages. This solution has a high time consumption in disk seeking, so the read efficiency is low
And, in a few message transmission storage models, the consumption water level of each consumption operation is recorded in the client, but the record is stored in the client, which has the disadvantage of inconvenient operation
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
[0023] In order to enable those skilled in the art to better understand the present invention, the terms and concepts appearing in this article are briefly introduced as follows.
[0024] Data message (message): referred to as a message, which loads user data and transmits it between producers, data servers, and consumers.
[0025] Message producer (producer): Producer fo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a data processing method and device, which can be used for writing data rapidly and stably. The data processing method comprises the steps of converting the received multiple information into multiple writing commands, and adding the writing commands into writing batch processing; writing the batch processing which is taken as a batch of information sequence into a pre-writing log file; forwarding the information in the pre-writing log file to files with different information themes according to information theme types; and recording forwarding site information which is used as an assisted positioning forwarding starting point for next forwarding operation.
Description
technical field [0001] The invention relates to the field of computer data storage, in particular to a data processing method and device. Background technique [0002] Today is an era of data explosion, and real-time data processing has become the focus of attention of Internet and traditional IT companies. In the model of message transmission and storage, the producer usually provides data to the data server for storage, and then the consumer extracts the data from the data server. In this process, it is very important to ensure stable and efficient data transmission and real-time fast storage. [0003] The operation method of the existing data server is usually as follows: [0004] Writing phase: The server immediately parses each received message, and then writes it to the corresponding message topic file according to the topic type to which the message belongs. The disadvantage is: message writing involves parsing each message, resulting in low writing rate. Therefor...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F16/16
Inventor 洪彬吴娅张侃刘彦伟
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD