AAI/MAGIC Traffic Data Monitor Archive Architecture


The Network Monitor Archive is a database of network measurements collected from various testbeds. Currently sites on the AAI and MAGIC are monitored. Included among the types of information collected are throughput measurements based on switch cell and router packet counts, as well as connectivity and round-trip time information based on ping.

The Network Monitor Archive architecture includes the Configuration Database, Time Series Database, traffic and connectivity information Collectors, and various plot and information summary utilities.

The Configuration Database contains information on the equipment to be monitored, and the specifics of the physical and logical interfaces that are being observed. Included are timestamps indicating the beginning and end times of the measurements for that entity. This allows queries to be formulated regarding the active devices within certain time periods. Other attributes include type of equipment, as well as special display directives.

The time series database contains the actual measurements collected by the system. These measurements are stored in Netlogger format for easy integration with other tools. The measurements are stored using Unix directories and files for efficient retrieval by the display tools. Compress of the measurement files is optionally enabled.

The Collector gathers traffic and connectivity measurements via a variety of tools, such as SNMP queries and ping probes. The Collector retrieves information from the monitored devices based on the entities specified in the Configuration Database, and stores the data in the Time Series Database.

A variety of display tools are included, such as a thumbnail generator for rapid perusal of commonly monitored entities, a more flexible archive plotter for complex queries, a real-time plotter so that currently active streams can be monitored during experiments, and a summary generator so that high level information on usage and connectivity over time periods can be displayed.

Note that various functions can be distributed to different physical machines in the network(s).

For more information, please contact
Joseph B. Evans , evans@ittc.ku.edu
or Victor S. Frost , frost@ittc.ku.edu