Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

E-commerce platform big data processing method and system

An e-commerce platform and big data processing technology, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of low write throughput rate and high memory occupancy rate, and achieve optimized memory occupancy rate and optimized write throughput. effect of speed

Active Publication Date: 2018-10-30
苏州易康萌思网络科技有限公司
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a method and system for processing big data on an e-commerce platform, which can prevent overloading when collecting data, and solve the problems of low write throughput and high memory usage when storing big data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • E-commerce platform big data processing method and system
  • E-commerce platform big data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work belong to the protection of the present invention. scope.

[0028] see figure 1 , an embodiment of the present invention proposes a flow chart of a big data processing method, the data center sends a collection request, and the data collection response starts. The data center communicates with each collection node through polling, periodically polls each collection device whether it is ready, if yes, then enter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an e-commerce platform big data processing method and an e-commerce platform big data processing system. Through generating multiple collection agents, a collection network isdivided into different modules, each collection agent is responsible for collection nodes in the different modules, a file system using a write cache as the bottom layer provides a high performance write caching service, a file set is divided into multiple classes, mass files are combined into a big file, and finally the big data is written into the file system for storing constantly. Through write caching and write combination, unfriendliness of writing of the mass files to the file system is avoided, and thus the write throughput rate and the memory occupancy rate are optimized.

Description

technical field [0001] The invention relates to the technical field of computer data processing, in particular to a method and system for processing big data on an e-commerce platform. Background technique [0002] In the era of the mobile Internet, online shopping has become a habit that people take for granted. In a good Internet environment, e-commerce is developing rapidly, and more and more retail companies choose e-commerce to develop their own business. The Alibaba platform alone has cultivated a large number of online brands. As a virtual and easy way, e-commerce requires the cooperation of many social service links while providing convenience to consumers. It not only represents a new consumption experience, but also represents a development of retail and its supporting services. new format of business. E-commerce is a booming business model, which brings new opportunities for the development of small and medium-sized enterprises. In the process of coordinated de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 汪建刚周娟陈燕
Owner 苏州易康萌思网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com