Using Hadoop for HPC Applications
NERSC Training Event
10:00 - 14:00 PDT
Oct. 5, 2011
Concurrently presented on the web and at NERSC's Oakland Scientific Facility
No registration is required for NERSC users; for others registration is now closed.
NERSC Users: Log in to the web site with your NERSC username and password and click on the "Web Meeting Info" link to the left to join.
Using Hadoop for HPC Applications
Lavanya Ramakrishnan, NERSC Technology Integration Group
The MapReduce programming model and its open source implementation Hadoop is gaining traction in the scientific community for addressing the needs of data focused scientific applications. The requirements of these scientific applications are significantly different from the web 2.0 applications that have traditionally used Hadoop. The tutorial will provide an overview of Hadoop technologies, discuss some use cases of Hadoop for science and present the programming challenges with using Hadoop for legacy applications. Participants will access the Hadoop system at NERSC for the hands-on component of the tutorial.
Hands-on Exercises
Downloads
-
HadoopTutorial-Oct2011.pdf | Adobe Acrobat PDF file