Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for processing big data on an e-commerce platform

A technology for e-commerce platform and big data processing, applied in electronic digital data processing, special data processing applications, file systems, etc. Effect of Throughput Rate

Active Publication Date: 2022-03-22
苏州易康萌思网络科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a method and system for processing big data on an e-commerce platform, which can prevent overloading when collecting data, and solve the problems of low write throughput and high memory usage when storing big data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for processing big data on an e-commerce platform
  • A method and system for processing big data on an e-commerce platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

[0028] see figure 1 , an embodiment of the present invention proposes a flow chart of a big data processing method, the data center sends a collection request, and the data collection response starts. The data center communicates with each collection node through polling, periodically polls each collection device whether it is ready, if yes, then enter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and system for processing big data on an e-commerce platform. By generating multiple collection agents, the collection network is divided into different modules. Each collection agent is responsible for the collection nodes in different modules, and the write cache is the bottom layer. The file system provides a high-performance write cache service, divides the file collection into multiple categories, merges massive files into large files, and finally writes large files to the file system for persistent storage. After write caching and write merging, it avoids the unfriendliness of massive file writing to the file system, thereby optimizing the write throughput rate and memory usage.

Description

technical field [0001] The invention relates to the technical field of computer data processing, in particular to a method and system for processing big data on an e-commerce platform. Background technique [0002] In the era of the mobile Internet, online shopping has become a habit that people take for granted. In a good Internet environment, e-commerce is developing rapidly, and more and more retail companies choose e-commerce to develop their own business. The Alibaba platform alone has cultivated a large number of online brands. As a virtual and easy way, e-commerce requires the cooperation of many social service links while providing convenience to consumers. It not only represents a new consumption experience, but also represents a development of retail and its supporting services. new format of business. E-commerce is a booming business model, which brings new opportunities for the development of small and medium-sized enterprises. In the process of coordinated de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/13G06F16/172G06F16/182G06F16/17
Inventor 汪建刚周娟陈燕
Owner 苏州易康萌思网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products