University of Notre Dame NetScale Laboratory

Lockdown: Simplifying Enterprise Network Management

Project Premise

ENAVis Viewer

What is going on in my network? Why is it behaving how it does? The answer to these relatively innocuous questions provides the foundation for our research. Namely, how can we quickly convey a situational awareness of the network displaying the who, what, and where of communications that are going on in the network in order to better understand why it is behaving the way that it is.

The problem is complicated by the fact that complex network systems are hard to understand and visualize. In particular, when networks approach hundreds, thousands, or even tens of thousands of nodes, the problems seem nearly insurmountable. The causes for these problems are due to the specific data not being available or the inability to correlate and present the data in a meaningful and understandable way with existing tools or techniques. Unfortunately, most popular management approaches focus on analysis with respect to only addresses (hosts) and ports, providing the where of a connection but missing a considerable portion of the context of the data. Moreover, administrators of the network face an overwhelming amount of data and with the identification of distributed system problems being an exceptionally cumbersome and time consuming task.

There is a tremendous need for tools that allow administrators to sift through massive amounts of traffic information in its appropriate context while doing so in a visually appealing and interactive manner that encourages data exploration, rather than hindering it. Critically, the inclusion of relatively simple context (user, application data) coupled with advanced data analysis techniques can shed significant light on the question of what is really going on in my network?

To that end, we created the ENAVis network visualization tool (see movie here), a tool in the larger software suite of the Lockdown project. ENAVis brings the notion of local context to visualization through the introduction of a novel HUA (Host, User, Application) control that allows one to explore the network graph from the perspective of the essential elements, seamlessly adding or removing context as appropriate. Features of the tool include:

  • Lightweight agent to gather context (limited CPU impact, limited storage cost)
  • Dynamic graph construction / deconstruction – add / remove context exploring relationships of hosts versus applications versus users
  • Exploration points for examining relationship links or entity information (ex. tell me more)
  • Work currently underway examining our nearly two year pool of agent data with respect to data mining on network graphs

A typical application of the tool might involve the following scenarios:

  • Capture any events and report whenever > 100 files are accessed by an application that communicates with an external host
  • Display all vectors into a particular host, note any paths with untrusted links
  • Display communities of users, i.e. show communities grouped by common applications and even common files
  • Show user to user and application to application connectivity, i.e. what users are talking to each other and what applications are talking to each other

Notable awards for this work include the best paper award for LISA (Large Installation System Administration) 2008 conference and second place at the National Security Innovation Competition (NSIC) 2009. Recently, our project was displayed in a booth at the National Homeland Defense Symposium VII. Our current software package sits at the level of TRL 5 / 6 with the data mining / automated analysis portions at a TRL 5 and the visualization / browsing aspects at at a TRL 6.

Moving Further with the Lockdown Suite of Project

Despite an ever increasing breadth of commercial and academic offerings into the field of security, the adoption of robust, fine granularity solutions by the enterprise has yet to occur on a significant threshold. While common lower end techniques such as virus scanners and firewalls have experienced near ubiquitous adoption, higher end solutions such as integrated endpoint security clients have seen only limited adoption with their adoption rates shrinking in recent years. Given the choice between manageability at the cost of simplicity versus mechanism efficacy / richness of expressiveness at the cost of complexity, network administrators are choosing ease of management with insufficient resources as the primary driving factor.

We posit that new research is needed that places the manageability of the system at the forefront rather than as an issue to be solved after the system is secure. We define manageability of a security approach in that security should streamline the entire process of policy distribution, policy validation, policy auditing, and most importantly, debugging when systems or security components fail. Put simply, we posit that given the implicitly distributed nature of the network, security approaches that create unfriendly obstacles to debugging will always experience adoption difficulties. The goal of this research is to make significant strides with regards to management of the security process, specifically focusing on three issues: management, visualization, and debugging. We focus on delivering an economy of expressiveness for enforcement mechanisms to contain complexity while coupling streamlined, pervasive monitoring to dramatically assist debugging.

The key outgrowths of this research address the following areas:

  • Management as a first order property of system design: The work will develop a suite of software tools to visualize the security network and to explore the benefits and trade offs of prioritizing management over coverage with regards to resource impact and risk management. Secondary aspects include bringing experimental studies regarding tool efficacy / productivity improvements with expertise from our collaborators in business (D'Arcy), psychology (Crowell), and our Office of Information Technology Information Security effort (Chapple).
  • Novel data mining / visualization: While visualization and exploration are the first steps, we intend to explore how to automate or guide the extraction of meaningful relationships, specifically drawing upon the rich work in social networking to assist with assessing the health of the network. Preliminary aspects include building modules into our visualization tool coupled with distributed execution on the grid of various machine learning algorithms (Chawla).
  • Creation of a streamlined framework for security management: Finally, the work will offer commentary on balancing expressiveness versus complexity to demonstrate minimal but effective security mechanisms. More importantly, the work will examine the trade offs of information gain for the monitoring of various properties not only with respect to security but also with respect to management and debugging (i.e. how much does characteristic X improve decision making versus characteristic Y).

People Involved

Faculty:

Students:

Previous Students:

  • Tim Wright: graduate student - initial data gathering concept for risk management
  • Brian Sullivan: undergraduate student - PHP / web browsing of database
  • Greg Allan: undergraduate student - REU exploration of the usage of SONia for visualization
  • Ben Roesch: undergraduate student - Windows agent development

Further Information

Information directly on the Wiki:

Research publications:

  • J A. Blaich, A. Striegel, D. Thain, "Reflections on The Virtues of Modularity: A Case Study in Linux Security Modules," to appear in Software: Practices and Experience.
  • J M. Chapple, A. Striegel, J. D'Arcy, "An Analysis of Firewall Rulebase (Mis)Management Practices," Information System Security Association Journal, February 2009. Link
  • C Q. Liao, A. Blaich, A. Striegel, D. Thain, "ENAVis: Enterprise Network Activities Visualization," in Proc. of LISA (Large Installation System Administration) Conference, San Diego, CA, Nov. 2008 - Winner of Best Paper Award. bubble
    • Winner of best paper award
  • Poster Andrew Blaich, Qi Liao, Brian Sullivan, Greg Allan, Aaron Striegel, Douglas Thain, "Lockdown: Distributed Policy Analysis and Enforcement within the Enterprise Network," poster at USENIX Security, August 2007. Writeup pdf
  • Lockdown: Tech Report TR-2007-05*
  • Thesis Q. Liao, "Improving Network Insight Through Local Context Gathering and Analysis," Master Thesis, University of Notre Dame. Adviser: Dr. Aaron Striegel, Committee: Dr. Douglas Thain, Dr. Nitesh Chawla.
  • Slides for CSE-SRS-2007 Poster Symposium.

Related Work / Efforts

  Attachment Action Size Date Who Comment
pdf LFS.pdf props, move 141.9 K 06 Oct 2008 - 14:24 QiLiao Lockdown File System, Parser, and Visualization Manual
png LFS_directories.png props, move 75.1 K 08 Oct 2008 - 02:55 QiLiao Document directories structure for Lockdown File System (LFS)
png LFS_process_time.png props, move 7.4 K 08 Oct 2008 - 02:56 QiLiao The time to process each day's raw data with increasing number of hosts in deployment.
ppt LISA08-ENAVis.ppt props, move 2904.0 K 18 Nov 2008 - 20:28 QiLiao LISA '08 Talk slides
jpg NSIC09-Check.jpg props, move 830.3 K 08 May 2009 - 20:44 AaronStriegel NSIC 2nd place prize picture
png all_usr33_hop1.png props, move 288.0 K 11 Jun 2008 - 19:16 AaronStriegel User 33 connectivity view
png case-app-policy.png props, move 177.2 K 11 Jun 2008 - 19:19 AaronStriegel Example - app vs. policy
png case_clapton_app.png props, move 599.6 K 11 Jun 2008 - 19:19 AaronStriegel Example - clapton app usage
png meta_graph.png props, move 52.4 K 11 Jun 2008 - 19:16 AaronStriegel HUA metagraph control
png server_client_directories.png props, move 53.8 K 08 Oct 2008 - 02:56 QiLiao Document directories structure for Lockdown file server and visualization client
png usr-largeview.png props, move 1821.4 K 11 Jun 2008 - 19:17 AaronStriegel All user view graph
png video-thumb.png props, move 8.3 K 16 Jan 2009 - 19:22 AndrewBlaich  
r48 - 10 Nov 2009 - 03:47:23 - AaronStriegel
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
Syndicate this site RSSATOM