Group Data Processing Using Selective Caching for Large Groups

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing group interaction systems face performance optimization challenges and resource inefficiencies due to increased group member counts, leading to request hotspots and resource waste.

Innovation Solution

Implement a data processing method involving a group forwarding layer that associates each group with specific service nodes, caching only relevant group data, and utilizing cloud technologies for efficient data storage and processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all service nodes cache all group data to ensure data availability, then data access reliability is improved, but cache memory consumption increases significantly

Engineering Contradiction:

Improvedata access reliabilityVSAvoidcache memory consumption

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments group data into two categories: basic group data (cached by specific service nodes) and member detail data (stored in distributed storage). Service nodes are segmented to cache only basic group data for their associated groups, rather than all group data. This segmentation reduces cache memory consumption while maintaining data access reliability through the distributed storage layer.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by having each service node cache only the basic group data relevant to its associated groups, rather than uniformly caching all group data. This localized caching strategy optimizes memory usage by storing data only where it is needed for service operations, reducing overall cache consumption while maintaining reliability for local data access.

Inventive Principle:

Principle #3Local quality

2Device complexity

If service nodes process all group requests independently to reduce system complexity, then system architecture simplicity is improved, but processing efficiency deteriorates due to request hotspots

Engineering Contradiction:

Improvesystem architecture simplicityVSAvoidprocessing efficiency

Core Design Contradiction:

Device complexityVSProductivity

Solution Approach 1:

The patent introduces a group forwarding layer as an intermediary between the access layer and group logic layer. This intermediary layer receives group-related requests, determines the target service node based on group association, and forwards requests accordingly. This mediator approach balances system complexity by adding a coordination layer while improving processing efficiency by distributing requests to appropriate service nodes, avoiding hotspots.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Speed

If service nodes cache basic group data locally to improve access speed, then data retrieval speed is improved, but cache memory usage increases

Engineering Contradiction:

Improvedata retrieval speedVSAvoidcache memory usage

Core Design Contradiction:

SpeedVSQuantity of substance

Solution Approach 1:

The patent segments group data into basic group data (cached locally in service nodes) and member detail data (stored in distributed storage). By segmenting the data cache, the system improves retrieval speed for frequently accessed basic group information while avoiding the memory overhead of caching complete group data, including large member lists, locally in service nodes.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by caching only the essential basic group data locally in service nodes, rather than caching all group data. This partial caching provides sufficient speed improvement for common operations while minimizing cache memory usage. Full group data can be retrieved from distributed storage when needed, balancing speed and memory usage.

Inventive Principle:

Principle #16Partial or excessive action

4Adaptability or versatility

If the system supports large group sizes to meet user communication needs, then user communication capability is improved, but resource waste increases due to request hotspots

Engineering Contradiction:

Improveuser communication capabilityVSAvoidresource waste

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The group forwarding layer acts as a mediator that efficiently routes requests for large groups to the appropriate service nodes that cache the relevant basic group data. This intermediary approach enables the system to support large group sizes with good user communication capability while reducing resource waste by avoiding repeated full data retrievals and distributing the processing load across multiple service nodes.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250217289A1Data processing method, system and apparatus, and electronic device and storage medium

Publication Date: 2025.07.03 TENCENT TECHNOLOGY (SHENZHEN) CO LTD

AI summary

A data processing method including acquiring, by a first service node in a group forwarding layer, a service processing request related to a target group from an access layer, the service processing request comprising a first group identifier of the target group, determining, by the first service node, target service nodes caching basic group data of the target group from a plurality of second service nodes in a group logic layer according to the first group identifier, the target service nodes being some nodes among the plurality of second service nodes, and transmitting, by the first service node, the service processing request to the target service nodes, such that the target service nodes determine a member size of the target group according to the basic group data of the target group and perform processing on the service processing request according to the member size of the target group.