Unlock instant, AI-driven research and patent intelligence for your innovation.

A data storage method and device

A data storage and data technology, applied in the computer field, can solve problems such as low machine learning efficiency and achieve the effect of improving efficiency

Active Publication Date: 2017-08-25
MICRO DREAM TECHTRONIC NETWORK TECH CHINACO
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Embodiments of the present invention provide a data storage method and device to solve the problem of low efficiency of machine learning based on stored data in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data storage method and device
  • A data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to improve the efficiency of machine learning based on stored data, the embodiment of the present invention only extracts the data required for subsequent machine learning from log files, and converts the extracted data into a unified format for storage, which can effectively improve the subsequent data based on storage. Efficiency in machine learning.

[0021] Preferred embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

[0022] figure 1 The data storage process provided for the embodiment of this application specifically includes the following steps:

[0023] S101: The server obtains the log file.

[0024] In the embodiment of the present invention, the server may acquire log files according to a set period, and each time the log file is acquired, the following steps S102-S103 may be performed to store data in the log file.

[0025] Among them, the data in the log file obtained by the ser...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application discloses a data storage method and device, which are used to solve the problem of low efficiency of machine learning based on stored data in the prior art. After the server obtains the log file, the server extracts the specified type of data in the log file, then merges the extracted data according to the type of the extracted data, converts the merged data into a specified format, and finally converts the converted data Combined storage with the data currently saved by itself. Through the above method, the server can extract only the data required for machine learning from the log files, and can convert the data in different formats into data in a unified format and store it, so there is no need to spend a lot of money when performing machine learning based on the stored data. Cleaning data in less time can effectively improve the efficiency of machine learning.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data storage method and device. Background technique [0002] With the rapid development of the network, the data in the log files generated by social-related services such as Weibo is also massive. How to store these log files for subsequent use (such as subsequent machine learning based on the data in the log files) ) has become an urgent problem to be solved. [0003] In the prior art, the log files are generally stored through the HDFS file management mode of the hadoop server cluster. Specifically, each data in the log file is divided into several data blocks according to time, for example, the data in the log file is divided into several data blocks by day (one day's data is combined into one data block), and stored on the server . [0004] However, because the sources of each log file are different, the format of the data in the log file is quite different...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 陆伟
Owner MICRO DREAM TECHTRONIC NETWORK TECH CHINACO