Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data

SEI Report
In this paper, John McHugh describes problems with monitoring and analyzing traffic on high-speed networks.
Publisher

Software Engineering Institute

Abstract

As network traffic increases, the problems associated with monitoring and analyzing the traffic on high speed networks become increasingly difficult. In this paper, we introduce a new conceptual framework based on sets of IP addresses, for coming to grips with this problem. The analytical techniques are described and illustrated with examples drawn from a dataset collected from a large operational network. 

Cite This SEI Report

McHugh, J. (2004, March 24). Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data. Retrieved August 9, 2026, from https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/.

@techreport{mchugh_2004,
author={McHugh, John},
title={Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data},
month={Mar},
year={2004},
institution={Software Engineering Institute, Carnegie Mellon University},
url={https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/},
note={Accessed: 2026-Aug-9}
}

McHugh, John. "Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data." Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, March 24, 2004. https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/.

J. McHugh, "Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data," Software Engineering Institute, Carnegie Mellon University. Software Engineering Institute, 24-Mar-2004 [Online]. Available: https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/. [Accessed: 9-Aug-2026].

McHugh, John. "Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data." Software Engineering Institute, Carnegie Mellon University, Software Engineering Institute, 24 Mar. 2004. https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/. Accessed 9 Aug. 2026.

McHugh, John. Sets, Bags, and Rock and Roll? Analyzing Large Data Sets of Network Data. Software Engineering Institute. 2004. https://www.sei.cmu.edu/library/sets-bags-and-rock-and-roll-analyzing-large-data-sets-of-network-data/