Internet usage data recording system and method with configurable data collector system

Abstract

An internet usage data recording system and method is described. In one embodiment, the present invention provides a network usage recording system. The network usage recording system includes a configurable collector. The collector includes an encapsulator for reading a plurality of network data records from a network data source and converting the network data records to a plurality of normalized metered events. An aggregator is provided for processing the normalized metered events to create aggregated normalized metered events. A data storage system is provided, wherein the aggregator periodically stores the aggregated normalized metered events in the data storage system.

Description

CROSS REFERENCE TO RELATED APPLICATIONS[0001]This patent application is related to the following Non-Provisional U.S. Patent Applications: Ser. No. 09 / 559,438 entitled “Internet Usage Data Recording System And Method Employing Batch Correlation Of Independent Data Sources,” Ser. No. 09 / 559,693, entitled “Internet Usage Data Recording System And Method Employing Distributed Data Processing And Data Storage,” and Ser. No. 09 / 560,032, entitled “Internet Usage Data Recording system And Method Employing A Configurable Rule Engine For The Processing And Correlation Of Network Data,” which are all filed on even date herewith, are all assigned to the same assignee as the present application, and are all herein incorporated by reference.THE FIELD OF THE INVENTION[0002]The present invention relates to a network usage data recording system and method, and more particularly, to an Internet usage data collection system and method having a configurable data collector system.BACKGROUND OF THE INVE...

AI Technical Summary

Benefits of technology

[0090]The distributed data storage system of the present invention provides many benefits to the network usage data recording system 120. In particular, the distributed data storage system provides for data processing, reduction, and storage at each collector location, independent of data processing and storage at another location or level. As such, data may be processed at different rates (often depending on the data so...

Problems solved by technology

Most consumers today have only limited access bandwidth to the Internet via an analog telephony modem, which has a practical data transfer rate upper limit of about 56 thousand bits per second.

As such, this higher access bandwidth significantly increases the potential for network congestion and bandwidth abuse by heavy users.

With this much higher bandwidth available, the usage difference between a heavy user and light user can be quite large, which makes a fixed-price, all-you-can-use pricing plan difficult to sustain; if the service provider charges too much for the service, the light users will be subsidizing the heavy users; if the service provider charges too little, the heavy users will abuse the available network bandwidth, which will be costly for the service provider.

These types of services increase the duration of time that a user is connected to the network as well as requiring significantly more bandwidth to be supplied by the service provider.

Such queuing often creates a bottleneck at the central processing system.

Also, if an error occurs at the central processing system (e.g., loss of power, data fault or other error), data which has not yet been correlated and persistently stored, such as queue data, may be lost.

Images