Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Crowd portrait storage and orientation system and method under big data high concurrency

A directional system and big data technology, applied in database indexing, database updating, structured data retrieval, etc., can solve problems such as inability to make full use of multi-core servers, inability to retain historical data, main server service interruption, etc., and achieve flexible loading and release. memory space, achieve fast and accurate, application reduction effect

Pending Publication Date: 2021-08-24
苏州合数科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

What's even more frightening is that the full synchronization of a large amount of data will cause the main server to occupy a large amount of CPU and memory resources, causing the service to be interrupted and the server unable to respond to requests
Again, redis is single-threaded, and a single server cannot make full use of the CPU of a multi-core server
Memory utilization is also very uneconomical
Finally, redis also needs to be manually deleted when the full update delete operation is performed, and at the same time, master-slave synchronization is required, causing the system to interrupt the service
At the same time, only physical deletion can be performed, and historical data cannot be retained

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crowd portrait storage and orientation system and method under big data high concurrency
  • Crowd portrait storage and orientation system and method under big data high concurrency
  • Crowd portrait storage and orientation system and method under big data high concurrency

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0025] like figure 1 As shown, the crowd portrait storage and orientation system under high concurrency of big data, the output end of the crowd portrait storage and orientation system is connected to the DSP bidding server, and the input end is respectively connected to the DSP bidding server, the distributed message system server and the DMP server. The storage and orientation system includes a crowd portrait cache system, a reading system, a compression writing system, and a message processing management system.

[0026] The method of crowd portrait storage and orientation under the high concurrency of big data, through the segmentation of the crowd portrait data, block identification formed by block calculation, load or create shared memory files, create file-based shared memory, and generate custom cache , to map the shared memory into the cache. The self-defined cache starts timer automatic management, checks the update status by blocks at regular intervals, if the upda...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a crowd portrait storage and orientation system and method under big data high concurrency. The crowd portrait storage and orientation system is based on a user-defined cache system of a shared memory of a file and a message processing management system, performs bit mapping based on crowd portrait data, converts a user identifier (ID) into a 64-bit hash value for storage, has multiple hash functions, performs cyclic comparison, and performs compression writing for avoiding collision. Based on the combination of the bit operation and the read process of an orientation function module of the check value, a set of complete crowd portrait storage and orientation system is formed. The system has the advantages of strong robustness, advancement, versatility, good maintainability and usability.

Description

technical field [0001] The invention relates to a system and method for storing and orienting crowd portraits under high concurrency of large data. Background technique [0002] With the development of network technology and the rapid popularization of smart terminals, the mobile Internet and traditional Internet have brought new opportunities and challenges to big data precision marketing companies. [0003] Among big data precision marketing companies, the Internet advertising platform DSP (Demand Side Platform) is an online real-time advertising platform, which has two core features, one is very fast data calculation speed and technology under a large amount of data, and the other is high concurrency Advanced user targeting technology capabilities. [0004] Internet advertising platforms have extremely demanding requirements on data computing technology, speed, and user orientation technology. The entire time between the media seller platform sending a bidding request t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22
CPCG06F16/2255G06F16/24552G06F16/23G06F16/27G06F9/544G06F9/547G06Q30/0271G06Q30/0275Y02D10/00
Inventor 徐高省
Owner 苏州合数科技有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com