Data analysis method and device, storage medium and electronic device

A data analysis and data technology, applied in the computer field, can solve the problems of poor output processing ability, data extraction format and content writing, and inability to carry out corresponding processing, etc., to improve efficiency and improve the quality of data analysis.

Pending Publication Date: 2020-02-07
RUN TECH CO LTD BEIJING
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the actual work process, it is often necessary to process a large amount of data information in a non-uniform format. Due to the variety of internal formats of the data, the traditional method is to convert the data into Json format data for analysis, and the output with poor regularity Poor processing power
However, when there is a large amount of data in a non-uniform format, it cannot be processed accordingly
In addition, because the existing technology only analyzes data in one format, the extracted data format and extracted content are hard-coded and cannot be changed randomly

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data analysis method and device, storage medium and electronic device
  • Data analysis method and device, storage medium and electronic device
  • Data analysis method and device, storage medium and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] figure 1 It is a flow chart of the data parsing method provided in Embodiment 1 of the present application. This embodiment is applicable to batch parsing of data. The method can be executed by the data parsing device provided in the embodiment of the present application. The device can be composed of software and It may be realized in the form of / or hardware, and may be integrated into electronic devices such as smart terminals or servers for data processing.

[0036] Such as figure 1 As shown, the data parsing method includes:

[0037] S110. Acquire data content of the data to be parsed, and determine a data format of the data to be parsed according to the data content.

[0038] Wherein, the data to be parsed may be data in Json format, or data in an unknown text storage format, for example, the data format is txt or other formats. Specifically, the format of the data to be parsed may be determined according to the suffix of the data to be parsed. If it is a stand...

Embodiment 2

[0050] In order to enable those skilled in the art to understand the solution more clearly, the present application also provides a preferred implementation manner.

[0051] The present invention is aimed at large-volume or regular processing of complex format string processing technology, specifically, from a large amount of complex data, according to a self-defined data extraction method, from the original data to obtain data information that meets the use requirements.

[0052] Concretely, the technical solution of the present invention adopts the following steps to realize:

[0053] a) Obtain the original data for analysis, and specify the content and format of the final data to be obtained;

[0054] b) Obtain the original data, and regularly obtain the total amount of files stored in the file;

[0055] c) Specify extraction and mapping rules for the final required data content and format;

[0056] d) Run the extraction and mapping rules to clean the target data from the...

Embodiment 3

[0076] figure 2 is a schematic structural diagram of the data analysis device provided in Embodiment 3 of the present application. Such as figure 2 As shown, the data analysis device includes:

[0077] A data format determining module 210, configured to obtain the data content of the data to be parsed, and determine the data format of the data to be parsed according to the data content;

[0078] An analysis template determination module 220, configured to determine whether there is an analysis template corresponding to the data format among the preset analysis templates;

[0079] The data parsing module 230 is configured to use the parsing template to parse out the target data content from the data to be parsed if the parsing template determining module 220 determines that it exists; wherein, the location of the target data content is pre-configured in the parsing template.

[0080] The technical solution provided by the embodiment of the present application obtains the d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data analysis method and device, a storage medium and an electronic device. The method comprises the steps of obtaining data content of to-be-analyzed data,and determining a data format of the to-be-analyzed data according to the data content; determining whether an analysis template corresponding to the data format exists in preset analysis templates or not; if so, analyzing the to-be-analyzed data by adopting the analysis template to obtain the target data content; wherein the position of the target data content is pre-configured in the analysis template in advance. By implementing the technical scheme provided by the invention, the effect of improving the data analysis efficiency and the data analysis quality can be achieved.

Description

technical field [0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a data analysis method, device, storage medium, and electronic equipment. Background technique [0002] Due to the increasing size of software systems, various data formats are used. In the actual work process, it is often necessary to process a large amount of data information in a non-uniform format. Due to the variety of internal formats of the data, the traditional method is to convert the data into Json format data for analysis, and the output with poor regularity Poor processing power. However, when there is a large amount of data in a non-uniform format, it cannot be processed accordingly. In addition, because the existing technology only analyzes data in one format, the format and content of the extracted data are hard-coded and cannot be changed randomly. Contents of the invention [0003] Embodiments of the present application pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25
CPCG06F16/258
Inventor 迟银宝火一莽万月亮
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap