|
CheapLogger 2 - 15 Jul 2007 - Main.AaronStriegel
|
| |
| META TOPICPARENT |
name="WebHome" |
Cheap Logger | | |
Project Commentary | |
< < | CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC? ) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity. | > > | CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity. | | | | |
< < | The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements/improvements regarding reassembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame. | > > | The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements regarding re-assembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame. | | |
Visible Research Output | |
< < |
- C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, Coimbra, Portugal, May 2006 [PDF] [BibTex] [Presentation]
- C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. [BibTeX]
| > > |
-
C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, pp. 501-512, Coimbra, Portugal, May 2006. DOI
-
C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. Issue Link Abstract
| | |
Ongoing Work
- Performance studies with Intel Mac mini
- Analyzing steps to achieve 10 Gb/s sustained logging
| |
> > |
| META FILEATTACHMENT |
attachment="JoeMuffawDiag.png" attr="" comment="Diagram - Cheap Logger" date="1184529815" name="JoeMuffawDiag.png" path="JoeMuffawDiag.png" size="96300" stream="JoeMuffawDiag.png" user="Main.AaronStriegel" version="1" |
|
|
|
CheapLogger 1 - 25 May 2007 - Main.AaronStriegel
|
|
> > |
| META TOPICPARENT |
name="WebHome" |
Cheap Logger
Project Overview
Creating high quality network trace files is a difficult task to accomplish on a limited budget. High network speeds may overburden an individual system running packet logging software such as tcpdump, resulting in trace files with missing information and making analysis difficult or incomplete. High end specialized systems may perform the job well, but may be out of reach due to financial constraints. To that end, we developed the Cheap Logger (CLog) system which utilizes inexpensive COTS hardware to create high quality, complete network trace files. A scalable distributed storage system enables the CLog system to expand and continue to create high quality, complete network data trace files even at extremely high data rates.
Project Commentary
CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC? ) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity.
The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements/improvements regarding reassembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame.
Visible Research Output
- C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, Coimbra, Portugal, May 2006 [PDF] [BibTex] [Presentation]
- C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. [BibTeX]
Ongoing Work
- Performance studies with Intel Mac mini
- Analyzing steps to achieve 10 Gb/s sustained logging
|
|
|
|
|
 Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding TWiki? Send feedback
|
|