Home


Project Overview

Our Publications


Personnel


Reference Shelf


Links


Data


Private


News

Hierarchical Inference of Unicast Network Topologies Based on End-to-end Measurements



Project Title: Hierarchical Inference of Unicast Network Topologies Based on End-to-end Measurements

PI Involved: Alfred O. Hero III,
Professor, Electrical Engineering & Computer Science, University of Michigan

Student: Meng-Fu Clyde Shih
Ph.D. 2005, Electrical Engineering & Computer Science, University of Michigan

Project Description

Network topology discovery is useful for constructing estimates of internal link connectivity from edge measurements. Without any cooperation from the internal routers, topology estimation can be formulated as hierarchical clustering of the leaf nodes based on pair-wise correlations as similarity metrics. We investigate three types of similarity metrics: queueing delay measured by sandwich probes, delay variance measured by packet pairs, and loss rate measured also by packet pairs. Unlike previous work which first assumes the network topology is a binary tree and then tries to generalize to a non-binary tree, we provide a framework which directly deals with general logical tree topologies. Based on our proposed finite mixture model for the set of similarity measurements we develop a penalized hierarchical topology likelihood that leads to a natural clustering of the leaf nodes level by level. A hierarchical algorithm to estimate the topology is developed in a similar manner by finding the best partitions of the leaf nodes. Our simulations show that the algorithm is more robust than binary-tree based methods. The three types of similarity metrics are also evaluated under various network load conditions using ns-2. For background on network topology discovery see references [2-4]. For details on our method see [1].
Logical Tree Network Structure
Fig. 1: Logical tree network with internal routers 12 – 18 to be discovered


Formula - Fig. 2
Average Edit Distance Percentage of Correctly Identified trees
Fig. 2: Model experiment 1. “HTE” denotes the proposed hierarchical topology estimation algorithm. “DBT” denotes the deterministic binary tree classification algorithm in [3], and “LBT” denotes the likelihood-based binary tree algorithm in [4]. Threshold-based link pruning is used to generalize binary tree estimates obtained from the DBT or LBT. The results are averaged over 1000 independent simulations.


Formula 1 - Fig. 3
Formula 1 - Fig. 3
Average Edit Distance Percentage of Correctly Identified trees
Fig. 3: Model experiment 2. Threshold-based link pruning is used to generalize binary tree estimates obtained from the DBT or LBT. The results are averaged over 1000 independent simulations.


Lightly Loaded Net Lightly Loaded Network
Fig. 4: Performance comparison of the proposed HTE algorithm using the three investigated probing schemes in a lightly-loaded network simulated by ns-2. The results are averaged over 30 independent simulations.


Lightly Loaded Net Lightly Loaded Network
Fig. 5: Performance comparison of the HTE algorithm using the three investigated probing schemes in a moderately-loaded network simulated by ns-2. The results are averaged over 30 independent simulations.


Lightly Loaded Net Lightly Loaded Network
Fig. 6: Performance comparison of the HTE algorithm using the three investigated probing schemes in a heavily-loaded network simulated by ns-2. The results are averaged over 30 independent simulations.


Lightly Loaded Net Lightly Loaded Network
Fig. 7: The true network topology and the median topology estimate computed from 30 independent simulations in ns-2 (Left). The distribution of tree edit distance between the topology estimates and the true topology (Right).

References

1. M. Shih and A. Hero, "Topology Discovery on Unicast Networks: A Hierarchical Approach Based on End-to-End Measurements,"     CSPL Technical Report TR-357, Department of EECS, University of Michigan, March 2005.
2. Bestavros, J. Byers, K.Harfoush, "Inference and Labelling of Metric-Induced Network Topologies,"     IEEE Infocom 2002, New York, NY, June 2002.
3. N.G. Duffield, J. Horowitz, F. Lo Presti, and D.Towsley, "Multicast Topology Inference from Measured End-to-End Loss,"     IEEE Trans. Info. Theoryy, vol.48, pp. 26-45, Jan. 2002.
4. R. Castro, M. Coates, R. Nowak, "Likelihood Based Hierarchical Clustering,"     IEEE Trans. Signal Processing, vol. 52, no. 8, pp. 2308-2321, Aug. 2004.
5. C. Shih (Hero advisor), “Unicast Internet Tomography,” PhD thesis, Dept. EECS, University of Michigan, Jan. 2005.
6 M.F. Shih and Alfred O. Hero III “Topology Discovery on Unicast Networks: A Hierarchical Approach Based on End-to-End Measurements”, CSPL Technical Report TR-357, Dept. of EECS, University of Michigan, Mar 2005.

Acknowledgements

We would like to thank Eric Boyd at Internet 2 for their help in this project.