Concurrent Data Acquisition for Microblog Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional microblog systems face significant delays in data acquisition due to the sequential retrieval of user data, where each piece of data is acquired only after the previous one, leading to increased waiting times for users.

Innovation Solution

A data acquisition method that involves receiving data acquisition requests, determining relevant data identifiers, querying local mappings for cached data, and generating concurrent data requests in a preset packet format to efficiently retrieve multiple data identifiers from a data storage server, reducing the need for successive data acquisition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sequential data acquisition is used to ensure accurate data retrieval, then data completeness is improved, but data acquisition time increases

Engineering Contradiction:
Improvedata completenessVSAvoiddata acquisition time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the data acquisition process into multiple parallel tasks, where each task acquires data for a specific user or data set. Instead of sequentially processing each data request one by one, the system divides the overall acquisition task into independent segments that can be executed concurrently, thereby reducing total acquisition time while maintaining data completeness through systematic coverage of all required data sets

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges multiple data acquisition requests into a single batch operation. By combining multiple individual data acquisition tasks into one unified request that retrieves multiple data sets simultaneously, the system reduces the number of sequential operations required, thereby decreasing data acquisition time while ensuring all required data is retrieved in one coordinated action

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple data requests are sent sequentially to ensure proper data retrieval, then data accuracy is improved, but system response speed deteriorates

Engineering Contradiction:
Improvedata accuracyVSAvoidsystem response speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent performs preliminary actions by pre-processing and validating data requests before sending them to the storage system. The system prepares multiple data acquisition requests in advance, organizes them into proper formats, and validates their correctness before execution. This preliminary preparation ensures that when the actual data retrieval occurs, it can be done accurately and efficiently in parallel, improving both data accuracy and response speed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary layer that manages and coordinates multiple data acquisition requests. This intermediary component receives, validates, and organizes multiple data requests, then distributes them for parallel processing while ensuring data accuracy through centralized control and coordination, effectively decoupling the complexity of multiple requests from the actual data retrieval operations

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP2698730B1Data acquisition method, device and system
Publication Date: 2018.06.13 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP2698730B1 patent drawingFigure 1~2
  • EP2698730B1 patent drawingFigure 3~4
  • EP2698730B1 patent drawingFigure 5~6

AI summary

The present invention discloses a data acquisition method, including: receiving at least one first data acquisition request, wherein the first data acquisition request carries a data selection condition; acquiring all the data identifiers satisfying the data selection condition according to the data selection condition; and concurrently acquiring all the data corresponding to the data identifiers according to the data identifiers, and returning the acquired data. Also disclosed is a data acquisition apparatus, including: a data acquisition request receiving module, a data identifier acquiring module, and a first data acquiring module. According to the embodiments of the present invention, data identifiers are determined according to a data selection condition, and all the data corresponding to the data identifiers is concurrently acquired according to the data identifiers, thereby reducing a data feedback delay caused by successive acquisition of data in the prior art. Concurrent acquisition of the data improves data acquisition efficiency, such that the data is timely feedback to a user and user satisfaction of a data user is enhanced.