skip to navigation | skip to content
Inslee listens to a constituent.

Montage of Wing Point in Bainbridge Island and the Edmonds Ferry.

Jay Inslee: Washington's 1st Congressional District

Home > Issues > Environment > Politics vs. Science

Issues

Environment

Withdraw Proposal to Subject Scientific Studies to Political Review

11 March 2004

U.S. Rep. Jay Inslee (WA-01) joined several other Members of Congress today in calling for the withdrawal of a proposed new regulation that would distort the use of scientific studies conducted by federal agencies by subjecting the studies to political review.

Currently all scientific studies conducted by federal agencies are peer reviewed by panels of external experts in the subject area, who analyze the studies’ methodology and validity before publication or use in regulation. Unfortunately, the Office of Management and Budget (OMB) has proposed new rules for the review panels that would:

  1. Limit the participation of scientists who have primarily academic backgrounds, and cause the review panels to instead be loaded with scientists who have industry ties.
  2. Require that if a review panel includes a scientist who has advocated a position on the issue under review, then it must also include a scientist holding the opposite position, even if the advocated position is widely accepted among the scientific community and the opposing position is on the fringes of acceptable science.
  3. Give control over the scientific review process to the desk officers within the OMB, who are rarely scientists and who are certainly not specialists in the scientific and regulatory fields being reviewed for the federal agencies.

"This proposal is just the administration's latest tactic to distort science for political gain," said Inslee. "Federal agencies should be making their decisions based on accurate scientific data, not on facts that have been altered by those with industry ties and fringe opinions. This proposal should be immediately withdrawn."

The text of a letter sent to the OMB today by Inslee and other Members of Congress follows:

March 11, 2004

The Honorable Joshua Bolten
Administrator
The Office of Management and Budget
725 17th Street NW
Washington, DC 20503

Dear Mr. Bolten:

We are writing about the Proposed Bulletin on Peer Review and Information Quality published in the Federal Register on September 15, 2003. As strong supporters of science in the public interest, we share the concern of the Office of Management and Budget (OMB) that federal regulatory decisions be based on the best available science. However, the current proposal has many flaws and will ensure neither sound nor timely regulatory decisions. We urge you to abandon this ill-advised plan.

The proposal’s vision of scientific peer review is very different from the way peer review is conducted by professional scientists. Most scientific journals select their reviewers on the basis of scientific and technical expertise, previous publications in the journal, and prestige in their field. Reviewers often perform many reviews for the same journal, bringing to bear extensive familiarity with the scientific subject at hand. Convening and overseeing review panels is the exclusive responsibility of the journal’s editorial board, all of whom are professional scientists, and is carefully controlled so as to guard the journal’s scientific integrity and reputation.

The OMB’s proposed bulletin departs significantly from these criteria for the selection of peer reviewers. In particular, it adopts an unsupportable distinction between conflicts stemming from federal agency funding versus private corporate funding. Potential reviewers can be disqualified if they are "currently receiving or seeking substantial funding from the [federal] agency" coordinating the review. However, there is no parallel rule to disqualify scientists whose funding comes from the regulated industry. The criteria exclude potential reviewers with "financial interests in the matter at issue," but this rule would not clearly disqualify a scientist whose research funds come from a private corporate source affected by the proposed regulation.

Furthermore, upon completion of the peer review, the OMB proposed guidelines require the report to "disclose the names, organizational affiliations, and qualifications of all peer reviewers, as well as any current or previous involvement by a peer reviewer with the agency or issue under peer review consideration." Again, the bulletin makes no mention of disclosure of peer reviewers’ possible industry funding sources or other ties to corporate entities (such as board memberships, ownership of affected patents, or consulting fees) that might be affected by federal regulations based on the peer review results. Experts who have "conducted multiple peer reviews for the same agency in recent years" are also disqualified, although there is no reason to believe that if someone has assisted in previous independent peer reviews, he or she would be rendered insufficiently independent to conduct another one.

Fundamentally, departing from standard peer review procedures on the basis of an assumption that public agency funding can corrupt a reviewers’ judgment but that private corporate funding cannot, is completely artificial and unconnected to reality. Professional scientific journals appropriately weigh possible conflicts of interest stemming from federal and corporate funding streams equally. For example, the peer review ethics guidelines issued by the International Committee of Medical Journal Editors state

Reviewers must disclose to editors any conflicts of interest that could bias their opinions of the manuscript, and they should disqualify themselves from reviewing specific manuscripts if they believe it to be appropriate.

No distinction is drawn between public and private funding as sources for conflicts of interest.

It is worth noting that when it comes to the biases of the authors of the articles being reviewed, the trend among top scientific journals is to be more sensitive about the appearance of bias stemming from private corporate funding than from public funding. For example, the New England Journal of Medicine, one of the world’s leading biomedical journals, requires all authors to disclose consulting fees, paid advisory board memberships, lecture fees when speaking at the invitation of a commercial sponsor, and any grant money received from industry. Authors are not asked to disclose any funding or other ties to government agencies. The journal Nature, one of the world’s leading general science journals, requires authors to disclose any grants they receive from "organizations that may gain or lose financially through publication of the paper". Authors are not required to disclose funds from public grants, although most authors voluntarily include this information in the text of published articles.

The OMB bulletin also departs from standard professional scientific practice by disqualifying any reviewers who have "in recent years advocated a position on the specific matter at issue." The definition of what constitutes advocating a position is unclear. The proposal further indicates that if a reviewer who "is or appears to be biased" must be selected "in order to obtain a panel with appropriate expertise," an additional reviewer with a "contrary bias" must also be selected whether or not that person’s scientific views are on the margin. Peer reviewers for professional scientific journals frequently advocate positions on scientific issues as they analyze and publish their scientific data. Many also advocate policy positions based on their scientific conclusions and/or personal convictions. Yet professional scientific journals do not disqualify them from peer review panels on this basis, nor do they seek to include extra reviewers with a "contrary bias". Peer review is intended to ensure that the science is accurate and widely respected, whether or not the reviewers have biases. Trying to balance biases without regard to the scientific views of the reviewer will undoubtedly lead to results that wander from the principle of scientific consensus that peer review strives to achieve.

Read in conjunction with your proposed requirement that only public funding, not private, be disclosed, the result you seem to be striving for is the disqualification of reviewers who do public work for their government, leaving only reviewers who assist in the profit-making enterprises of particular companies. This is not a neutral approach. A neutral approach would simply require the disclosure by reviewers of all potential sources of conflict, public or private.

Finally, the proposal places ultimate control of the federal peer review process in the hands of the Office of Information and Regulatory Affairs (OIRA) within OMB. This office would decide which information would receive peer review and which would not, and rule on the acceptability of agencies’ peer review processes. While OIRA has authority over federal information management, its desk officers are rarely scientists and certainly not specialists in all scientific fields reviewed by federal agencies. Control over the peer review process at scientific journals is the province of the scientific experts who make up the journal’s editorial board, who have extensive professional experience in the field. Publishers, financiers and other non-scientists connected with scientific journals are not permitted oversight of or input into the journal’s peer review process. Giving OIRA ultimate control over all federal peer review runs the risk of politicizing and distorting science.

The proposal clearly recognizes the validity of scientific journal peer review, stating that "for purposes of this Bulletin, peer review undertaken by a scientific journal may generally be presumed to be adequate." This makes the differences between the proposal and accepted scientific practice all the more glaring. The National Academies, composed of the nation’s premier scientists, engineers and doctors who have participated in scientific peer review for their entire professional careers, have closely examined the issue of scientific peer review in federal agencies. In his comments on the bulletin submitted to OMB, National Academy of Sciences President Bruce Alberts said

[T]he highly prescriptive type of peer review that OMB is proposing differs from accepted practices of peer review in the scientific community, and if enacted in its present form is likely to be counterproductive.

In light of the scope of this proposal and the extensive differences between this vision of federal and professional scientific peer review, we ask that you answer the following questions:

  1. Does OMB consider funding from federal agencies a more serious source of bias than funding from private sources? If so, why?
  2. Does OMB consider other, non-funding links to federal agencies a more serious source of bias than non-funding links to private sources, such as consulting fees, speaking fees, or paid service on advisory boards? If so, why?
  3. Why would OMB require peer reviewers to disclose links to federal agencies, but not to companies and industries potentially affected by regulatory decisions based on the peer reviewed science?
  4. Would OMB’s proposal disqualify a potential peer reviewer whose research funding comes from an industry potentially affected by regulations based on the outcome of the peer review? If not, why not?
  5. Under this proposal, how would OMB ensure that a scientist employed by a private company potentially affected by a peer review process is automatically excluded from serving on that panel? Would such employment constitute a "financial interest in the matter at issue" as per the selection criteria? If not, why not?
  6. Why does OMB believe that conducting multiple reviews for the same agency could compromise a reviewer’s objectivity and be a basis for disqualification?
  7. What form of advocacy does OMB envision as a disqualification for a potential peer reviewer: a scientific publication, a policy statement, a media interview, or something else? In order to determine such advocacy, will OMB require agencies to do background research on the political positions taken by potential reviewers?
  8. Would a position advocated by a private company on a specific "matter at issue" exclude any potential peer reviewer employed or funded by that company? If not, why not?
  9. What form of "bias" does OMB envision in the selection of reviewers? Is a scientific opinion based on peer-reviewed and rigorous scientific data considered bias? Does OMB intend to conduct reviews of bias or to direct agencies to compile information on the "biases" of their potential reviewers?
  10. How much control will the Administrator of OIRA have over the selection of peer review panels and the selection of which science must be reviewed? How will OMB and OIRA prevent redundant review of previously published science? Will the OIRA Administrator override panel selections by individual agencies, even when those agencies have more expertise in the science considered and thus the suitability of individual reviewers?
  11. Does OMB know of situations in which current federal peer review policies produced distorted or inaccurate reviews? If so, please provide examples. If not, why is OMB attempting to fix a problem that apparently does not exist?

Given the nature and severity of these differences, we believe that it is unlikely that minor changes will make the proposal acceptable. We urge OMB to withdraw the current proposal and develop a new one which is more in concord with professional scientific peer review practices and is informed by the conclusions of the National Academies’ careful examination.

We appreciate your attention to this important matter, and look forward to a response to our questions by April 15, 2004.

Sincerely,

Edward Markey

Jay Inslee

Rush Holt

Henry Waxman

Michael Honda

Brian Baird

Jim McDermott

Sam Farr

Eddie Bernice Johnson