University of Notre Dame NetScale Laboratory

View   r2  >  r1  ...
CheapLogger 2 - 15 Jul 2007 - Main.AaronStriegel
Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Cheap Logger

Line: 8 to 8
 

Project Commentary

Changed:
<
<
CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC? ) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity.
>
>
Cheap Logger Overview CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity.
 
Changed:
<
<
The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements/improvements regarding reassembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame.
>
>
The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements regarding re-assembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame.
 

Visible Research Output

Changed:
<
<
  • C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, Coimbra, Portugal, May 2006 [PDF] [BibTex] [Presentation]
  • C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. [BibTeX]
>
>
  • C C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, pp. 501-512, Coimbra, Portugal, May 2006. DOI
  • J pdf C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. Issue Link Abstract
 

Ongoing Work

  • Performance studies with Intel Mac mini
  • Analyzing steps to achieve 10 Gb/s sustained logging
Added:
>
>
META FILEATTACHMENT attachment="JoeMuffawDiag.png" attr="" comment="Diagram - Cheap Logger" date="1184529815" name="JoeMuffawDiag.png" path="JoeMuffawDiag.png" size="96300" stream="JoeMuffawDiag.png" user="Main.AaronStriegel" version="1"

CheapLogger 1 - 25 May 2007 - Main.AaronStriegel
Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

Cheap Logger

Project Overview

Creating high quality network trace files is a difficult task to accomplish on a limited budget. High network speeds may overburden an individual system running packet logging software such as tcpdump, resulting in trace files with missing information and making analysis difficult or incomplete. High end specialized systems may perform the job well, but may be out of reach due to financial constraints. To that end, we developed the Cheap Logger (CLog) system which utilizes inexpensive COTS hardware to create high quality, complete network trace files. A scalable distributed storage system enables the CLog system to expand and continue to create high quality, complete network data trace files even at extremely high data rates.

Project Commentary

CLog was born out of our need to log full packet payloads for the purpose of similarity extraction from a tap on the University of Notre Dame Internet connection (commercial Internet + Internet2). Unfortunately, normal COTS hardware possessed insufficient aggregate write capacity during storms of heavy incoming/outgoing capacity. To that end, we developed the CLog software that uses a collection of Mac minis (PowerPC? ) coupled with a low cost external workstation (Sun Dual-Core Opteron) to enable logging at a sufficient rate for the current network capacity.

The majority of the software for CLog was developed in C through the work of two REU students, Jeff Smith and Will Bordogna. Additional enhancements/improvements regarding reassembly were applied through a subsequent REU by Andrew Matta and Dan Dugovic. The performance studies represented in the visible research output were conducted by Chad Mano. The work itself has been supported by the CAREER grant of Dr. Striegel (CNS03-47392) as part of the NetScale Laboratory at Notre Dame.

Visible Research Output

  • C. Mano, J. Smith, W. Bordogna, A. Striegel, "High Speed Packet Logging on a Budget," in Proc. of IFIP Networking, Coimbra, Portugal, May 2006 [PDF] [BibTex] [Presentation]
  • C. D. Mano, J. Smith, W. Bordogna, A. Matta, D. Dugovic, A. Striegel, "CLog: Low Cost Gigabit Full Packet Logging," Journal of Communications, vol. 1, no. 7, pp. 17-23, Nov/Dec 2006. [BibTeX]

Ongoing Work

  • Performance studies with Intel Mac mini
  • Analyzing steps to achieve 10 Gb/s sustained logging

Revision 2r2 - 15 Jul 2007 - 20:05:53 - AaronStriegel
Revision 1r1 - 25 May 2007 - 03:34:56 - AaronStriegel
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
Syndicate this site RSSATOM