Data processing method and device, electronic equipment and storage medium

A data processing and database technology, which is applied in the fields of electronic equipment and computer readable storage media, devices, data acquisition, and data processing methods, can solve problems such as waste of database resources, sudden increase in data requests, and pressure on the database, so as to reduce database pressure. Effects of stress, increased read and write speed

Pending Publication Date: 2021-05-28
GUANGZHOU NETSTAR INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of implementing the present application, the inventor found that when performing aggregation processing in the existing method, the object is often aggregated after the object is successfully released, and the obtained aggregated data is synchronously written into the database, for example, mysql In the database; however, during the peak hours of user activity, for example, at night or on holidays, due to the sharp increase in the number of objects released, the corresponding aggregation processing will also increase accordingly, and the existing objects are synchronously sent to the database after the object is successfully released. The way of writing aggregated data will cause the data request volume of the database to increase suddenly during pe

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] The embodiment of the present disclosure provides a data processing method, please refer to figure 1 , which is a schematic flowchart of a data processing method provided by an embodiment of the present disclosure. The method can be implemented by an electronic device, and the electronic device can be a server, for example, a blade server, a rack server, etc., or it can also be a server cluster deployed in the cloud, which is not specifically limited here; of course, in During specific implementation, according to actual needs, the method may also be applied to terminal equipment, which is not specifically limited here.

[0038] Such as figure 1 As shown, the method in this embodiment may include the following steps S1100-S1300, which will be described in detail below.

[0039] Step S1100, obtain the aggregated message to be processed from the cache queue, wherein the aggregated message includes the target identifier of the target object and a task category, and the t...

Embodiment 2

[0084] Corresponding to the first method embodiment above, this embodiment also provides a data acquisition method, which can be applied to an electronic device, for example, can be used in a server.

[0085] Please see image 3 , which is a schematic flowchart of a data acquisition method provided by an embodiment of the present disclosure. Such as image 3 As shown, the method includes the following steps S3100-S3300, which will be described in detail below.

[0086] Step S3100, receiving an object acquisition request sent by a terminal device, wherein the object acquisition request includes a target identifier of the target object to be acquired, and the target object is associated with a target topic.

[0087] Step S3200, when it is determined according to the target ID and the topic ID of the target topic that the target object is not stored in the third database, according to the target ID and the topic ID, obtain the The target object described above, wherein the sec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and device and electronic equipment, and the method comprises the steps: obtaining a to-be-processed aggregation message from a cache queue, the aggregation message comprising a target identifier and a task category of a target object, and the task category representing the category of a task processing item executed on the target object; according to the target identifier and the task category, executing the task processing item on the target object to obtain a processing result; and storing the processing result according to a preset storage rule. According to the method, the data processing amount in the system can be reduced, so that the database pressure is relieved, and the data reading and writing speed is increased.

Description

technical field [0001] The present disclosure relates to the technical field of Internet data processing, and more specifically, to a data processing method, device, electronic equipment, and computer-readable storage medium. The present disclosure also relates to a data acquisition method. Background technique [0002] In the Internet field, users can publish a variety of objects through terminal devices, such as video, text, and images; after the terminal device sends the object to be published by the user to the server, the server can aggregate the objects. Aggregate objects into the same category; in this way, when other users use terminal devices to browse objects, the server can display objects under the category that the user is interested in to the user for viewing, so as to improve user stickiness. [0003] In the process of implementing the present application, the inventor found that when performing aggregation processing in the existing method, the object is ofte...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2455G06F16/2457G06F16/27G06F16/28
CPCG06F16/24552G06F16/24578G06F16/27G06F16/284
Inventor 黄威威何俊华
Owner GUANGZHOU NETSTAR INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap