Data processing method and device

A data processing and data technology, applied in the field of big data, can solve the problem of low efficiency of log file processing

Pending Publication Date: 2019-09-06
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the embodiment of the present invention provides a data processing method and device to solve the problem of low processing efficiency of user behavior log files in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to better understand the technical solutions of the present invention, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0032] It should be clear that the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0033] Terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0034] It should be understood that the term "an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and device, and relates to the technical field of big data, and the method comprises the steps: obtaining first file data which is user behavior log data; reading a segmentation rule of the first file data, wherein the segmentation rule is at least one of fixed-part segmentation, fixed-capacity segmentation and fixed-line segmentation; segmenting the first file data according to a segmentation rule to obtain a plurality of sub-files, each sub-file comprising at least one piece of user behavior log data; writing the plurality ofsub-files into a target database, wherein each sub-file is provided with a time period identifier; and screening the target database according to a preset screening condition, obtaining user behaviorlog data conforming to the screening condition, wherein the screening condition comprises any one of user information, time period information and user behavior groups. According to the technical scheme provided by the embodiment of the invention, the problem of low user behavior log file processing efficiency in the prior art can be solved.

Description

[0001] 【Technical field】 [0002] The present invention relates to the technical field of big data, in particular to a data processing method and device. [0003] 【Background technique】 [0004] At present, the customer service server on the windows platform, with the rapid growth of access and data volume, the data volume of the log file used to record user behavior becomes very large, so that the user behavior log file cannot be directly downloaded to the local, or the file is too large A large value leads to extremely slow reading speed, which makes the processing efficiency of user behavior log files low. [0005] 【Content of invention】 [0006] In view of this, embodiments of the present invention provide a data processing method and device to solve the problem of low processing efficiency of user behavior log files in the prior art. [0007] In order to achieve the above object, according to one aspect of the present invention, a data processing method is provided, the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/18G06F16/16G06F16/14
CPCG06F16/1815G06F16/16G06F16/148
Inventor 陈义哲
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap