Database system applied to real-time big data scene

A database and big data technology, applied in the field of database systems, can solve the problem that applications with strong real-time access requirements such as advertisements cannot be tried, and achieve the effect of high-speed real-time data access capability, increased cost, and guaranteed atomicity

Active Publication Date: 2015-08-12
BEIJING BIKU TIANDI CULTURE CO LTD
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Traditional big data processing facilities such as Hadoop have made a lot of optimizations in dealing with large-scale data volumes, but applications with strong real-time access requirements such as advertising cannot be tried at all. This is a common problem in the industry.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database system applied to real-time big data scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to facilitate the understanding of various aspects of the system of the present invention, the system of the present invention will be specifically introduced below in conjunction with the drawings and specific embodiments.

[0038] First, the system of the present invention needs to prepare basic data before it is put into use. The data capture module sets up a constraint category, that is, limits the scope of captured data sources, and then automatically collects and parses specified website data information through crawlers, and performs content extraction, weight ranking, context analysis, etc. to determine the content characteristics of specific links And the context relationship, and finally save the cleaned and calculated data to the linked database. At the same time, the advertising demand side enters the advertising delivery demand into the advertising database according to its own needs.

[0039] After the basic data is ready, each sub-module is star...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a database system applied to a real-time big data scene. The database system applied to the real-time big data scene is characterized by comprising a data capturing module which is used for defining the range for capturing a data source, automatically capturing webpage data, performing content extraction and repetition exclusion, and performing context analysis; a feature database module which is used for storing Cookie data, advertisement position dada and linked data; a real-time database module which is used for performing indexing and sharding storage on the data in the feature database module; an advertisement putting module which is used for obtaining advertisement feature data from the real-time database module, comparing the advertisement feature data with the data in the feature database module, and finally determining whether to put advertisement to specific users and which advertisement is put to the users. The database system disclosed by the invention has the beneficial effects that as a three-level storage structure of internal memory, SSD and hard disk is adopted, the system not only provides high-speed real-time data access ability, but also can effectively cope with super-large scale data storage and has the disaster recovery ability.

Description

technical field [0001] The present invention relates to a database system, in particular to a database system (big data system for short) applied in a real-time big data scene, and belongs to the field of computer data calculation. Background technique [0002] Big data (big data, mega data), or massive data, refers to massive, high-growth and diverse information assets that require new processing models to have stronger decision-making power, insight discovery power, and process optimization capabilities . Big data refers to the use of all data for analysis and processing without shortcuts such as random analysis (sampling survey). The 4V characteristics of big data: Volume (mass), Velocity (high speed), Variety (variety), Value (value). [0003] Big data is widely used in information search, advertising, finance and other fields. Each big data system with different application types has different characteristics. The response speed, data volume, data type and access mode...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2219
Inventor 刘彤
Owner BEIJING BIKU TIANDI CULTURE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap