Using Hadoop for HPC Applications

NERSC Training Event

10:00 - 14:00 PDT

Oct. 5, 2011

Concurrently presented on the web and at NERSC's Oakland Scientific Facility

No registration is required for NERSC users; for others registration is now closed.

NERSC Users: Log in to the web site with your NERSC username and password and click on the "Web Meeting Info" link to the left to join.

Using Hadoop for HPC Applications

Lavanya Ramakrishnan, NERSC Technology Integration Group

The MapReduce programming model and its open source implementation Hadoop is gaining traction in the scientific community for addressing the needs of data focused scientific applications. The requirements of these scientific applications are significantly different from the web 2.0 applications that have  traditionally used Hadoop. The tutorial  will provide an overview of Hadoop technologies, discuss some use cases of Hadoop for science and present the programming challenges with using Hadoop for legacy applications. Participants will access the Hadoop system at NERSC for the hands-on component of the tutorial.

Hands-on Exercises

Instructions

Recording