Current Projects

• Large Scale Parallel Tools: OpenSpeedShop Frameworks Plugins
  

  This project explores using Open Speed Shop Frameworks Plugins to provide scalable memory usage and correctness tools.

  
  Faculty:
  • Jonathan Aldrich CMU
  Students:
  • Ciera Jaspan CMU
  Mentors:
  • Dave Montoya HPC-3
  • Steve Painter HPC-1
• Data Intensive Super Computing for Science
  

  This project explores how well suited data intensive computing programming/run time paradigms like map reduce and other graphs apply to scientific applications.

  
  
  Documents
  • Introducing Map-Reduce to High End Computing PDSW08 paper
  • Introducing Map-Reduce to High End Computing PDSW08 talk
  Faculty:
  • Julio Lopez CMU
  Mentors:
  • Gary Grider HPC-DO
  • James Nunez HPC-5
  • John Bent HPC-5
  • Salman Habib T-08
  • Thomas Brettin B-6
  • Pavel Senin B-6
  • Tony Heaton HPC-5
  • Michael Fisk ACS-PO
  • Laura Monroe HPC-5
• File System and File Structure
  

  The concept is to head HPC file system storage towards file formats in the file system.  It is quite possible that many file types like N processes to 1 file with small strided writes might be served well by special handling at the file system level.  Decades ago, file types and access methods were used and were supported within a single file system.  The IBM MVS storage systems allowed for many different file types, partitioned data sets, indexed sequential, virtual sequential, and sequential to name a few.  Storage for modern HPC systems may benefit from a new parallel/scalable version of file types.  There is much research to be done in this area to determine the usefulness of this concept and how such a thing would work with modern supercomputers and future HPC languages and operating environments.

  
  
  Documents
  • Efficient Data Placement in a Hybrid Storage Architecture
  • The related LANL Parallel Log Structured File Systems PLFS
  • Large-scale Evaluation of GIGA+ Scalable Directories
  • Comparing Performance of Solid State Devices and Mechanical Disks PDSW08 talk
  • Network File System (NFS) in High Performance Networks
  • Log-structured Files for Fast Checkpointing
  Faculty:
  • Garth Gibson CMU
  Students:
  • Milo Polte CMU
  Mentors:
  • Gary Grider HPC-DO
  • James Nunez HPC-5
  • John Bent HPC-5

Past Projects

• Multi-Dimensional Metadata and Massive Directories in Parallel File Systems
  
  
  Documents
  • Crossing the Chasm: Sneaking a Parallel File System into Hadoop
  • Multi-Dimensional Metadata and Massive Directories in Parallel File Systems Poster
  • Multi-Dimensional Metadata and Massive Directories in Parallel File Systems Presentation
  Faculty:
  • Garth Gibson CMU
  Students:
  • Milo Polte CMU
  Mentors:
  • Gary Grider HPC-DO
  • James Nunez HPC-5
  • John Bent HPC-5