Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method, system, electronic device and computer readable medium

A data processing and data technology, applied in the Internet field, can solve problems such as system crashes, inability to provide services, and rising pv data writing requests, and achieve the effect of dispersing computing pressure

Active Publication Date: 2022-07-05
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for example, in the scenario of real-time page views (pv) calculation of traffic data, as the traffic data continues to flow in, the system will continue to accumulate operations on the pv data. When the data flood peak arrives, the write request volume of pv data at this moment It will rise rapidly, and the number of operations per second of the node where this data (hereinafter referred to as hot data) is located will far exceed its processing capacity, which may cause connection blockage, even system crash, and the problem of being unable to provide services

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, system, electronic device and computer readable medium
  • Data processing method, system, electronic device and computer readable medium
  • Data processing method, system, electronic device and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood, however, that these descriptions are exemplary only, and are not intended to limit the scope of the present disclosure. Also, in the following description, descriptions of well-known structures and techniques are omitted to avoid unnecessarily obscuring the concepts of the present disclosure.

[0034] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure. The terms "comprising", "comprising" and the like as used herein indicate the presence of stated features, steps, operations and / or components, but do not preclude the presence or addition of one or more other features, steps, operations or components.

[0035] All terms (including technical and scientific terms) used herein have the meaning as commonly understood by one of ordinary skill in the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure provides a data processing method, comprising: creating a plurality of sub-data in different nodes of a cluster system for associating one main data, determining at least one of the sub-data in response to an operation on the main data, and The at least one sub-data is operated on, the at least one sub-data is updated, and the main data is updated according to the at least one updated sub-data. In addition, the present disclosure also provides a data processing system, an electronic device, and a computer-readable medium.

Description

technical field [0001] The present disclosure relates to the field of Internet technologies, and more particularly, to a data processing method, system, electronic device, and computer-readable medium. Background technique [0002] In real-time data calculation, due to the use of distributed consistent hashing algorithm, the performance of read and write operations on data is very high, and a single node can support 100,000 read and write operations per second. In the case of high data concurrency, a method of expanding nodes is adopted in the prior art to support a high number of operations per second. However, for example, in the scenario of real-time page views (pv) calculation of traffic data, with the continuous inflow of traffic data, the system will continue to accumulate the pv data. It will rise rapidly, and the number of operations per second of the node where this data (hereinafter referred to as hotspot data) is located will far exceed its processing capacity, w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/1001H04L67/1095
Inventor 王海银
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More