Database system applied to real-time big data scene

Abstract

The invention discloses a database system applied to a real-time big data scene. The database system applied to the real-time big data scene is characterized by comprising a data capturing module which is used for defining the range for capturing a data source, automatically capturing webpage data, performing content extraction and repetition exclusion, and performing context analysis; a feature database module which is used for storing Cookie data, advertisement position dada and linked data; a real-time database module which is used for performing indexing and sharding storage on the data in the feature database module; an advertisement putting module which is used for obtaining advertisement feature data from the real-time database module, comparing the advertisement feature data with the data in the feature database module, and finally determining whether to put advertisement to specific users and which advertisement is put to the users. The database system disclosed by the invention has the beneficial effects that as a three-level storage structure of internal memory, SSD and hard disk is adopted, the system not only provides high-speed real-time data access ability, but also can effectively cope with super-large scale data storage and has the disaster recovery ability.

Description

technical field [0001] The present invention relates to a database system, in particular to a database system (big data system for short) applied in a real-time big data scene, and belongs to the field of computer data calculation. Background technique [0002] Big data (big data, mega data), or massive data, refers to massive, high-growth and diverse information assets that require new processing models to have stronger decision-making power, insight discovery power, and process optimization capabilities . Big data refers to the use of all data for analysis and processing without shortcuts such as random analysis (sampling survey). The 4V characteristics of big data: Volume (mass), Velocity (high speed), Variety (variety), Value (value). [0003] Big data is widely used in information search, advertising, finance and other fields. Each big data system with different application types has different characteristics. The response speed, data volume, data type and access mode...

AI Technical Summary

Problems solved by technology

[0007] Traditional big data processing facilities such as Hadoop have made a lot of optimizations in dealing with large-scale data volumes, but applications with strong real-time access requirements such as advertising cannot be tried at all. This is a common problem in the industry.

Images