Hierarchical Inference of Unicast Network Topologies Based on End-to-end Measurements
Project Title: Hierarchical Inference of Unicast Network Topologies Based on End-to-end Measurements
PI Involved: Alfred O. Hero III,
Professor, Electrical Engineering & Computer Science, University of Michigan
Student: Meng-Fu Clyde Shih
Ph.D. 2005, Electrical Engineering & Computer Science, University of Michigan
Project Description
Network topology discovery is useful for
constructing estimates of internal link connectivity from edge measurements. Without
any cooperation from the internal routers, topology estimation can be
formulated as hierarchical clustering of the leaf nodes based on pair-wise
correlations as similarity metrics. We investigate three types of similarity
metrics: queueing delay measured by sandwich probes, delay variance measured by
packet pairs, and loss rate measured also by packet pairs. Unlike previous work
which first assumes the network topology is a binary tree and then tries to
generalize to a non-binary tree, we provide a framework which directly deals
with general logical tree topologies. Based on our proposed finite mixture
model for the set of similarity measurements we develop a penalized
hierarchical topology likelihood that leads to a natural clustering of the leaf
nodes level by level. A hierarchical algorithm to estimate the topology is
developed in a similar manner by finding the best partitions of the leaf nodes.
Our simulations show that the algorithm is more robust than binary-tree based
methods. The three types of similarity metrics are also evaluated under various
network load conditions using ns-2. For background on network topology discovery see references [2-4]. For details on
our method see [1].
 |
Fig. 1: Logical tree network with internal routers 12 – 18 to be discovered |
|
 |
|
Fig. 4: Performance comparison of the proposed HTE algorithm using the three
investigated probing schemes in a lightly-loaded network simulated by ns-2. The
results are averaged over 30 independent simulations.
|
|
 |
|
Fig. 5: Performance comparison of the HTE algorithm using the three investigated
probing schemes in a moderately-loaded network simulated by ns-2. The results
are averaged over 30 independent simulations.
|
|
 |
|
Fig. 6: Performance comparison of the HTE algorithm using the three investigated
probing schemes in a heavily-loaded network simulated by ns-2. The results are
averaged over 30 independent simulations.
|
|
 |
|
Fig. 7: The true network topology and the median topology estimate computed from 30
independent simulations in ns-2 (Left). The distribution of tree edit distance
between the topology estimates and the true topology (Right).
|
References
1. M. Shih and A. Hero,
"Topology Discovery on Unicast Networks: A Hierarchical Approach Based on End-to-End Measurements,"
    CSPL Technical Report TR-357, Department of EECS, University of Michigan, March 2005.
2. Bestavros, J. Byers, K.Harfoush,
"Inference and Labelling of Metric-Induced Network Topologies,"
    IEEE Infocom 2002, New York, NY, June 2002.
3. N.G. Duffield, J. Horowitz, F. Lo Presti, and D.Towsley,
"Multicast Topology Inference from Measured End-to-End Loss,"
    IEEE Trans. Info. Theoryy, vol.48, pp. 26-45, Jan. 2002.
4. R. Castro, M. Coates, R. Nowak,
"Likelihood Based Hierarchical Clustering,"
    IEEE Trans. Signal Processing, vol. 52, no. 8, pp. 2308-2321, Aug. 2004.
5. C. Shih (Hero advisor),
“Unicast Internet Tomography,” PhD thesis,
Dept. EECS, University of Michigan, Jan. 2005.
6 M.F. Shih and Alfred O. Hero III
“Topology Discovery on Unicast Networks: A Hierarchical Approach
Based on End-to-End Measurements”,
CSPL Technical Report TR-357, Dept. of EECS, University of Michigan, Mar 2005.
Acknowledgements
We would like to thank Eric Boyd at Internet 2 for their help in this project.