U.S.
DEPARTMENT OF
ENERGY

For more information about the Office of Science, go to Office of Science

Program Announcement
To DOE National Laboratories
LAB 09-22

Joint Mathematics/Computer Science Institute

SUMMARY:

The Office of Advanced Scientific Computing Research (ASCR) of the Office of Science (SC), U.S. Department of Energy (DOE), hereby invites proposals for research under a unified management structure to address key challenges where collaborative research in applied mathematics and computer science efforts are required to bridge the gap between large complex scientific applications software and next-generation hardware.

The strategic vision for the Advanced Scientific Computing Research (ASCR) program in the Department of Energy's Office of Science includes a portfolio of high performance computing resources to enable DOE and the Nation's world leadership in areas of science important to the Department's mission. ASCR plans to address these challenges through a balanced program that provides DOE's and the Nation's scientists with high performance production and leadership- class computing resources while fostering the architectural development of the next generation of high end computer hardware and supporting software. One key assumption that underpins the success of the "petascale to extreme scale" plan is that the scientific software application- computer hardware gaps expected to appear can be successfully addressed.

General-purpose, extreme scale computing systems are likely to be technologically feasible within the next 10-15 years. These systems could contain between 10 million and 100 million processing elements or cores. There is widespread agreement that these systems will push the envelope of a number of important technologies, including processor architecture, scale of multicore integration (perhaps into the range of 1000 cores per chip or beyond), power management, and packaging. Incremental or evolutionary advances of current programming paradigms and strategies have little chance of providing the functionality and utility needed to harness extreme scale computing for scientific discovery and advances. Transformational breakthroughs in programming models, system software, and algorithms will be necessary to enable scientific discovery through simulation on these leadership computers.

This Announcement calls for innovative approaches that integrate applied mathematics and computer science to develop the insights and tools that are required for computers at extreme scales to be effective tools for scientific discovery through simulation. The activities supported by this Announcement may be a combination of basic research, creation of algorithms for advanced architectures, and demonstration of new mathematical, computer science and algorithmic concepts. Conferences, "summer schools", or other similar activities that explore, in a collaborative setting, the research and utilization of the combination of applied mathematics and computer science to enable high-performance computing at the extreme scale may be considered. Partnerships among universities, National Laboratories, and industry are strongly encouraged.

More information on this solicitation is provided in the Supplementary Information below.

PROPOSAL DUE DATE: June 5, 2009, 8:00 p.m., Eastern Time

Formal proposals submitted in response to this Announcement must be received by June 5, 2009, 8:00 p.m. Eastern time, to permit timely consideration of awards. You are encouraged to transmit your proposal well before the deadline. PROPOSALS RECEIVED AFTER THE DEADLINE WILL NOT BE REVIEWED OR CONSIDERED FOR AWARD.

FOR FURTHER INFORMATION CONTACT: Karen Pao, karen.pao@science.doe.gov, (301) 903-5384; and Osni Marques, oamarques@ascr.doe.gov, (301) 903-9925.

SUPPLEMENTARY INFORMATION:

The complexity of extreme-scale systems represent a major challenge to large application codes: how can the scientific applications efficiently use these systems?

With the hardware breakthroughs required to reach extreme scales, application software can no longer ignore the radical increases in node and processor core counts, multi-mode parallelism, reduced memory per core, heterogeneous nodes, and fault tolerance. This unprecedented level of complexity will require significant new levels of scalability and functionality - as well as reliability and ease of use - in application software.

A wide variety of topics may be appropriate for this research effort. Examples may include, but not limited to:

  • Synchronization barrier: Algorithms for science and engineering applications require synchronization. These barriers may be implemented in the application codes either explicitly or by using parallel language directives, in the communication libraries, in systems calls, or a combination of all of the above. Are there opportunities for distributing barriers and achieving greater performance?
  • Fault tolerance for optimizing systems performance: For large-scale science and engineering applications, it is imperative that the entire system can handle faults and failures gracefully. Are there new tools that will inform the application teams as to how to optimally divide fault tolerance amongst the numerical algorithms for an application, the simulation software, and the systems software and hardware?
  • Efficient implementation and optimization of scientific software: Algorithms for science and engineering applications often follow certain computation and communication patterns. Are there novel methods for the analysis of these patterns that may lead to compiler optimization, performance tuning, automated tuning of application codes, and the efficient implementation of these algorithms on current and future architecture?
  • Architecture-aware programming models and algorithms: Whether the architecture is manycore, multicore, or anything else, scalability of the applications is the key to fully utilizing the available compute power. Can we develop portable programming models that achieve scalability of the application codes on a class or multiple classes of architecture? Can numerical algorithms for applications be developed so that they are aware of the architecture and automatically perform a variety of tasks to optimize performance?
For more information, please see the following workshop and conference reports: Management Plan

The proposal must contain a management plan that establishes and maintains the appropriate balance between research activities in applied mathematics and computer science. The Principal Investigator will be identified in the proposal as the individual responsible for managing the overall project. The management plan will be evaluated for feasibility and compatibility with the proposed technical goals.

Community Building

An important goal of this notice is to establish the foundation for expanding the traditional boundaries of both mathematics and computer science to continuously advance both fields, and to build a community of versatile researchers who are committed to the common goal of high- performance computing for scientific discovery. The proposal will need to include plans for the dissemination of research results, such as:

  • Publications, conferences, and other educational activities: what mechanisms will the project employ to present its work to a broader community to ensure sustained activities in the research area?
  • Code release: how will the codes be released to allow other researchers to continue building and expanding on the knowledge gained?
  • Testing at scale: will the project perform software testing at scale? If so, what are the requirements for this testing (for example, hardware, specific architecture, specific testbed, etc)?
Collaboration and Communication

The proposal should identify potential collaborations or other interactions that will facilitate the exchange of ideas and dissemination of information among research centers in industry, universities, and/or laboratories. Further information on preparation of collaborative proposals may be accessed via the internet at: http://www.sc.doe.gov/grants/Colab.html

ESTIMATED FUNDING

It is anticipated that up to a total of $4 million annually will be available for multiple awards for this program. Awards are planned to be made in Fiscal Year 2009, and proposals may request project support for up to three years. All awards are contingent on the availability of funds and programmatic needs. DOE is under no obligation to pay for any costs associated with the preparation or submission of a proposal. DOE reserves the right to fund, in whole or part, any, all, or none of the proposals submitted in response to this Notice.

SUBMISSION INFORMATION

The instructions and format described below must be followed. You must reference Program Announcement LAB 09-22 on all submissions and inquiries about this Program Announcement.

OFFICE OF SCIENCE
GUIDE FOR PREPARATION OF SCIENTIFIC/TECHNICAL PROPOSALS
TO BE SUBMITTED BY NATIONAL LABORATORIES

Proposals from National Laboratories submitted to the Office of Science (SC) as a result of this Program Announcement will follow the Department of Energy Field Work Proposal process with additional information requested to allow for scientific/technical merit review. The following guidelines for content and format are intended to facilitate an understanding of the requirements necessary for SC to conduct a merit review of a proposal. Please follow the guidelines carefully, as deviations could be cause for declination of a proposal without merit review.

1. Evaluation Criteria

After an initial screening for eligibility and responsiveness to the solicitation, proposals will be subjected to scientific merit review (peer review). The proposals will be evaluated against the following criteria, which are listed in descending order of importance. Included with each criteria are the detailed questions that will be asked of the reviewers.

    1. Scientific and/or Technical Merit of the Proposed Research
    2. Appropriateness of the Proposed Method or Approach
    3. Competency of Applicant's Personnel and Adequacy of Proposed Resources
    4. Reasonableness and Appropriateness of the Proposed Budget
    5. Other Appropriate Factors
The evaluation process will include program policy factors such as the relevance of the proposed research to the terms of the Announcement and the Department's programmatic needs. External peer reviewers are selected with regard to both their scientific expertise and the absence of conflict-of-interest issues. Non-federal reviewers may be used, and submission of a proposal constitutes agreement that this is acceptable to the investigator(s) and the submitting institution.

2. Summary of Proposal Contents

  • Field Work Proposal (FWP) Format (Reference DOE Order 412.1A) (DOE ONLY)
  • Proposal Cover Page
  • Table of Contents
  • Budget (DOE Form 4620.1) and Budget Explanation
  • Abstract (one page)
  • Narrative (main technical portion of the proposal, including background/introduction, proposed research and methods, timetable of activities, and responsibilities of key project personnel)
  • Literature Cited
  • Biographical Sketch(es)
  • Description of Facilities and Resources
  • Other Support of Investigator(s)
  • Appendix (optional)
2.1 Number of Copies to Submit

Please have your lab administrator submit the entire lab proposal and FWP via Searchable FWP (https://www.osti.gov/fwp). If you have questions about who your lab administrator is or how to use Searchable FWP, please contact the Searchable FWP Support Center.

Also, to assist in expediting the review process, please submit via federal express, a single PDF file of the entire LAB proposal and FWP on a CD along with two hard copies to the address below.

To identify that the FWP is responding to this Program Announcement, when sending your CD please identify the Program Announcement Title and Program Announcement number on the Federal Express package.

Please send the CD and 2 hard copies via Federal Express to:

    Teresa Beachley
    Office of Advanced Scientific Computing Research, SC-21.1
    Office of Science
    19901 Germantown Road
    Germantown, MD 20874-1290
    ATTN: Program Announcement LAB 09-22
3. Detailed Contents of the Proposal

Adherence to type size and line spacing requirements is necessary for several reasons. No researcher should have the advantage, by using small type, of providing more text in their proposals. Small type may also make it difficult for reviewers to read the proposal. Proposals must have 1-inch margins at the top, bottom, and on each side. Type sizes must be at least 11 point. Line spacing is at the discretion of the researcher, but there must be no more than 6 lines per vertical inch of text. Pages should be standard 8 1/2" x 11" (or metric A4, i.e., 210 mm x 297 mm).

3.1 Field Work Proposal Format (Reference DOE Order 412.1A) (DOE ONLY)

The Field Work Proposal (FWP) is to be prepared and submitted consistent with policies of the investigator's laboratory and the local DOE Operations Office. Additional information is also requested to allow for scientific/technical merit review. Laboratories may submit proposals directly to the SC Program office listed above. A copy should also be provided to the appropriate DOE operations office.

3.2 Proposal Cover Page

The following proposal cover page information may be placed on plain paper. No form is required.

    Title of proposed project
    SC Program announcement title
    Name of laboratory
    Name of principal investigator (PI)
    Position title of PI
    Mailing address of PI
    Telephone of PI
    Fax number of PI
    Electronic mail address of PI
    Name of official signing for laboratory*
    Title of official
    Fax number of official
    Telephone of official
    Electronic mail address of official
    Requested funding for each year; total request
    Use of human subjects in proposed project:
      If activities involving human subjects are not planned at any time during the proposed project period, state "No"; otherwise state "Yes", provide the IRB Approval date and Assurance of Compliance Number and include all necessary information with the proposal should human subjects be involved.
    Use of vertebrate animals in proposed project:
      If activities involving vertebrate animals are not planned at any time during this project, state "No"; otherwise state "Yes" and provide the IACUC Approval date and Animal Welfare Assurance number from NIH and include all necessary information with the proposal.
    Signature of PI, date of signature
    Signature of official, date of signature*

*The signature certifies that personnel and facilities are available as stated in the proposal, if the project is funded.

3.3 Table of Contents

Provide the initial page number for each of the sections of the proposal. Number pages consecutively at the bottom of each page throughout the proposal. Start each major section at the top of a new page. Do not use unnumbered pages and do not use suffices, such as 5a, 5b.

3.4 Budget and Budget Explanation

A detailed budget is required for the entire project period and for each fiscal year. It is preferred that DOE's budget page, Form 4620.1 be used for providing budget information*. Modifications of categories are permissible to comply with institutional practices, for example with regard to overhead costs.

A written justification of each budget item is to follow the budget pages. For personnel this should take the form of a one-sentence statement of the role of the person in the project. Provide a detailed justification of the need for each item of permanent equipment. Explain each of the other direct costs in sufficient detail for reviewers to be able to judge the appropriateness of the amount requested.

Further instructions regarding the budget are given in section 4 of this guide.

* Form 4620.1 is available at web site: http://www.science.doe.gov/grants/budgetform.pdf

3.5 Abstract

Summarize the proposal in no more than two pages. Give the project objectives (in broad scientific terms), the approach to be used, and what the research is intended to accomplish. State the hypotheses to be tested (if any). At the top of the abstract give the project title, names of all the investigators and their institutions, and contact information for the principal investigator, including e-mail address.

3.6 Narrative (main technical portion of the proposal, including background/introduction, proposed research and methods, timetable of activities, and responsibilities of key project personnel).

The narrative comprises the research plan for the project and is limited to 15 pages (maximum). It should contain enough background material in the Introduction, including review of the relevant literature, to demonstrate sufficient knowledge of the state of the science. The major part of the narrative should be devoted to a description and justification of the proposed project, including details of the methods to be used. It should also include a timeline for the major activities of the proposed project, and should indicate which project personnel will be responsible for which activities.

If any portion of the project is to be done in collaboration with another institution (or institutions), provide information on the institution(s) and what part(s) of the project it will carry out. Further information on any such arrangements is to be given in the sections "Budget and Budget Explanation," "Biographical Sketches," and "Description of Facilities and Resources." Collaborative research projects with institutions that receive grants, such as universities, industry, and non-profit organizations, are allowed under this Announcement. See the section on Collaboration. Further information on collaboration may be accessed at http://www.science.doe.gov/grants/Colab.html.

3.7 Literature Cited

Give full bibliographic entries for each publication cited in the narrative. Each reference must include the names of all authors (in the same sequence in which they appear in the publication), the article and journal title, book title, volume number, page numbers, and year of publication. Include only bibliographic citations. Principal investigators should be especially careful to follow scholarly practices in providing citations for source materials relied upon when preparing any section of the proposal.

3.8 Biographical Sketches

This information is required for senior personnel at the institution submitting the proposal and at all subcontracting institutions (if any). The biographical sketch is limited to a maximum of two pages for each investigator and must include:

Education and Training. Undergraduate, graduate and postdoctoral training, provide institution, major/area, degree and year.

Research and Professional Experience. Beginning with the current position list, in chronological order, professional/academic positions with a brief description.

Publications. Provide a list of up to 10 publications most closely related to the proposed project. For each publication, identify the names of all authors (in the same sequence in which they appear in the publication), the article title, book or journal title, volume number, page numbers, year of publication, and website address if available electronically. Patents, copyrights and software systems developed may be provided in addition to or substituted for publications.

Synergistic Activities. List no more than 5 professional and scholarly activities related to the effort proposed.

To assist in the identification of potential conflicts of interest or bias in the selection of reviewers, the following information must also be provided in each biographical sketch.

    Collaborators and Co-editors: A list of all persons in alphabetical order (including their current organizational affiliations) who are currently, or who have been, collaborators or co-authors with the investigator on a research project, book or book article, report, abstract, or paper during the 48 months preceding the submission of the proposal. Also, include those individuals who are currently or have been co-editors of a special issue of a journal, compendium, or conference proceedings during the 24 months preceding the submission of the proposal. If there are no collaborators or co-editors to report, this should be so indicated.

    Graduate and Postdoctoral Advisors and Advisees: A list of the names of the individual's own graduate advisor(s) and principal postdoctoral sponsor(s), and their current organizational affiliations. A list of the names of the individual's graduate students and postdoctoral associates during the past five years, and their current organizational affiliations.

3.9 Description of Facilities and Resources

Facilities to be used for the conduct of the proposed research should be briefly described. Indicate the pertinent capabilities of the institution, including support facilities (such as machine shops), that will be used during the project. List the most important equipment items already available for the project and their pertinent capabilities. Include this information for each subcontracting institution (if any).

3.10 Other Support of Investigators

Other support is defined as all financial resources, whether Federal, non-Federal, commercial, or institutional, available in direct support of an individual's research endeavors. Information on active and pending other support is required for all senior personnel, including investigators at collaborating institutions to be funded by a subcontract. For each item of other support, give the organization or agency, inclusive dates of the project or proposed project, annual funding, and level of effort (months per year or percentage of the year) devoted to the project.

3.11 Appendix

Information not easily accessible to a reviewer may be included in an appendix, but do not use the appendix to circumvent the page limitations of the proposal. Reviewers are not required to consider information in an appendix, and reviewers may not have time to read extensive appendix materials with the same care they would use with the proposal proper.

The appendix may contain the following items: up to five publications, manuscripts accepted for publication, abstracts, patents, or other printed materials directly relevant to this project, but not generally available to the scientific community; and letters from investigators at other institutions stating their agreement to participate in the project (do not include letters of endorsement of the project).

4. Detailed Instructions for the Budget
(DOE Form 4620.1 "Budget Page" may be used).

4.1 Salaries and Wages

List the names of the principal investigator and other key personnel and the estimated number of person-months for which DOE funding is requested. Proposers should list the number of postdoctoral associates and other professional positions included in the proposal and indicate the number of full-time-equivalent (FTE) person-months and rate of pay (hourly, monthly or annually). For graduate and undergraduate students and all other personnel categories such as secretarial, clerical, technical, etc., show the total number of people needed in each job title and total salaries needed. Salaries requested must be consistent with the institution's regular practices. The budget explanation should define concisely the role of each position in the overall project.

4.2 Equipment

DOE defines equipment as "an item of tangible personal property that has a useful life of more than two years and an acquisition cost of $50,000 or more." Special purpose equipment means equipment which is used only for research, scientific or other technical activities. Items of needed equipment should be individually listed by description and estimated cost, including tax, and adequately justified. Allowable items ordinarily will be limited to scientific equipment that is not already available for the conduct of the work. General purpose office equipment normally will not be considered eligible for support.

4.3 Domestic Travel

The type and extent of travel and its relation to the research should be specified. Funds may be requested for attendance at meetings and conferences, other travel associated with the work and subsistence. In order to qualify for support, attendance at meetings or conferences must enhance the investigator's capability to perform the research, plan extensions of it, or disseminate its results. Consultant's travel costs also may be requested.

4.4 Foreign Travel

Foreign travel is any travel outside Canada and the United States and its territories and possessions. Foreign travel may be approved only if it is directly related to project objectives.

4.5 Other Direct Costs

The budget should itemize other anticipated direct costs not included under the headings above, including materials and supplies, publication costs, computer services, and consultant services (which are discussed below). Other examples are: aircraft rental, space rental at research establishments away from the institution, minor building alterations, service charges, and fabrication of equipment or systems not available off- the-shelf. Reference books and periodicals may be charged to the project only if they are specifically related to the research.

a. Materials and Supplies

The budget should indicate in general terms the type of required expendable materials and supplies with their estimated costs. The breakdown should be more detailed when the cost is substantial.

b. Publication Costs/Page Charges

The budget may request funds for the costs of preparing and publishing the results of research, including costs of reports, reprints page charges, or other journal costs (except costs for prior or early publication), and necessary illustrations.

c. Consultant Services

Anticipated consultant services should be justified and information furnished on each individual's expertise, primary organizational affiliation, daily compensation rate and number of days expected service. Consultant's travel costs should be listed separately under travel in the budget.

d. Computer Services

The cost of computer services, including computer-based retrieval of scientific and technical information, may be requested. A justification based on the established computer service rates should be included.

e. Subcontracts

Subcontracts should be listed so that they can be properly evaluated. There should be an anticipated cost and an explanation of that cost for each subcontract. The total amount of each subcontract should also appear as a budget item.

4.6 Indirect Costs

Explain the basis for each overhead and indirect cost. Include the current rates.