Method and device for analyzing non-standard JSON string

A parsing method and JSON technology, applied in the field of big data, can solve the problems of small data volume and low parsing efficiency of non-standard JSON strings, and achieve the effect of improving parsing efficiency

Active Publication Date: 2021-10-01
CHINA CONSTRUCTION BANK
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Most of the traditional JSON parsing algorithms are aimed at parsing standard JSON strings, and the amount of applicable data is relatively small
However, there are a large number of non-standard JSON strings in big data stream computing. When parsing non-standard JSON strings, it is necessary to manually intervene to identify non-standard JSON strings and convert non-standard JSON strings into standard JSON strings. String, and then further parsed, the parsing efficiency of non-standard JSON string is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for analyzing non-standard JSON string
  • Method and device for analyzing non-standard JSON string
  • Method and device for analyzing non-standard JSON string

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. Here, the exemplary embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention.

[0061] The term "and / or" in this article only describes an association relationship, which means that there can be three kinds of relationships, for example, A and / or B can mean: there is A alone, A and B exist at the same time, and B exists alone. situation. In addition, the term "at least one" herein means any one of a variety or any combination of at least two of the more, for example, including at least one of A, B, and C, which may mean including from A, Any one or more elements selected from the set formed by B and C.

[0062] In the description of this specif...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for analyzing a non-standard JSON string. The method comprises the following steps: acquiring the non-standard JSON string, wherein the head of the non-standard JSON string comprises identification information; converting the non-standard JSON string into a comma separation value (CVS) file format to obtain a target field of an STRING type; extracting a JSON (JavaScript Object Notation) string of which the identification information is removed from the target field by utilizing an SUBSTRING function; and when a non-standard separator exists in the JSON string of which the identification information is removed, replacing the non-standard separator with a preset standard separator by using a regular expression to obtain a standard JSON string. The invention relates to the technical field of big data, wherein the non-standard JSON string is converted into the standard JSON string according to the SUBSTRING function and the regular expression, so that the analysis efficiency of the non-standard JSON string is improved.

Description

technical field [0001] The invention relates to the technical field of big data, in particular to a method and device for parsing non-standard JSON strings. Background technique [0002] This section is intended to provide a background or context to embodiments of the invention that are recited in the claims. The descriptions herein are not admitted to be prior art by inclusion in this section. [0003] JSON (JavaScript Object Notation, JS Object Notation) is frequently used in streaming computing for big data processing, and 90% of the data is transmitted through JSON. In the process of large data flow calculation and data storage, in order to facilitate calculation and management, identification information is often added to the head of the JSON string, which leads to various forms of JSON strings. In addition, the separation in some JSON strings There may also be non-standard delimiters that cannot be recognized by the machine; identification information in the header o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/205G06F40/151
CPCG06F40/205G06F40/151
Inventor 李超范先爽吴迪丁萍
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products