A data analysis method and device

A data analysis and data technology, applied in the computer field, can solve problems such as unrecognizable nested data, and achieve the effects of reducing repetitive development workload, improving analysis efficiency, and improving versatility

Active Publication Date: 2022-03-01
BEIJING SOHU NEW MEDIA INFORMATION TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present application provides a data analysis method and device, which has solved the technical problem that traditional data analysis methods cannot identify nested data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data analysis method and device
  • A data analysis method and device
  • A data analysis method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0050] See figure 1 , shows a flow chart of a data parsing method in an embodiment of the present application, the method is applied to a computer, such as figure 1 As shown, the method may include the following steps:

[0051] S110. Read data to be parsed.

[0052] The data to be parsed in this application may be a data record in the database, or a line of text in the local file system, or a line of text read in the distributed file system, or a network communication request.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application provides a data parsing method and device, which describe the organizational structure of data through configuration information, that is, the configuration information configures a data nested structure. According to the configuration information, it is parsed layer by layer according to the nesting order of the data nesting structure from outside to inside. For example, if the value in the key-value pair obtained by parsing still needs to be parsed, continue to parse the value, and repeat the parsing process until parsing to the innermost layer. This method analyzes the data nested structure layer by layer through the nested analysis method, and finally can directly obtain the structured key-value pair data, without the need to analyze in batches, which improves the analysis efficiency. In addition, the method improves the versatility of the parsing logic through nested parsing, so that when the data structure changes, only the configuration information needs to be modified, and the parsing logic does not need to be modified, which reduces the workload of repeated development.

Description

technical field [0001] The present application relates to the field of computer technology, and more specifically relates to a data analysis method and device. Background technique [0002] In big data systems, data is usually generated and stored in the form of logs. Log data is usually semi-structured data, which needs to be parsed into structured data in the form of key-value pairs when analyzing it. A key-value pair is a data storage structure of a computer program. The key is the number corresponding to the stored data, and the value is the stored data. The corresponding value can be quickly and uniquely located through the key. [0003] In a big data system, the data to be processed comes from different departments, different systems or even different companies, and the data generation rules corresponding to different organizations may be different. With the accumulation of time, changes in requirements, and design problems of some old systems, some data is not compl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F8/41
CPCG06F8/427
Inventor 王帅
Owner BEIJING SOHU NEW MEDIA INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap