CERES ES8 Terra Edition2 |
Investigation: CERES
Data Product: ERBE-like Instantaneous TOA Estimates (ES8)
Data Set: Terra (Instruments: FM1, FM2)
Data Set Version: Edition2
The purpose of this document is to inform users of the accuracy of this data product which has been determined by the CERES Team. This document briefly summarizes key validation results, provides cautions where users might easily misinterpret the data, provides helpful links to further information about the data product, algorithms, and accuracy, gives information about planned data improvements, and, finally, automates registration in order to keep users informed of new validation results, cautions, or improved data sets as they become available.
User applied revisions are a method CERES uses to identify improvements to existing archived data products that are simple for users to implement, and allow correction of data products that would not be possible in the archived versions until the next major reprocessing 1 to 2 years in the future. All revisions applicable to this data set are noted in the section User Applied Revisions to Current Edition.
This document is a high-level summary and represents the minimum information for scientific users of this data product. It is strongly suggested that authors, researchers, and reviewers of research papers re-check this document for the latest status before publication of any scientific papers using this data product.
The deep space calibration maneuvers planned for early in the Terra mission were delayed, resulting in larger uncertainties in the CERES Terra scan angle dependent offsets (zero-level counts) used in the level 1b BDS data product. BDS level 1b data is the input to the ES8 data product. The early unavailability of deep space scans puts a larger uncertainty on the CERES archived data products, and the BDS Terra Edition2 archived Data Quality Summary gives an estimate of this uncertainty. Both the BDS and ES8 Terra Edition2 Data Products utilize offsets determined using ground calibration data. While CERES/TRMM showed consistency of ground and in-space determined offsets of 1 digital count or better (roughly 0.5% or better) further indirect analysis as well as final deep space scans are required to confirm this level of consistency on the Terra instruments.
This document discusses the Terra ERBE-like Science Product [ES8] data set version Edition2. Additional information is in the Description/Abstract Guide. The files in this data product contain one day (24 hours) of filtered and unfiltered radiances, top-of-the-atmosphere (TOA) fluxes, and scene identification. Each radiance and its associated viewing angles are located in colatitude and longitude at a reference level of 30 km. The unfiltering algorithm produces radiances for three spectral bands for each measurement point or footprint: the longwave (LW) band measures energy emitted by the Earth's surface and atmosphere predominantly from wavelengths >5 microns, the shortwave (SW) band measures reflected sunlight primarily from wavelengths <5 microns, and the window (WN) band measures energy emitted mostly from the Earth's surface over the wavelength range from about 8 microns to about 12 microns. Radiances are converted to fluxes at the TOA for the SW and LW bands. For the WN band, only filtered and unfiltered radiances are recorded on this product.
The data are organized in time of observation. The three principal scan modes are the Fixed Azimuth Plane (FAP) mode, the Rotating Azimuth Plane (RAP) mode and the Along-Track mode. In all cases, the instrument scans across the Earth with views of space on either side which gives a full Earth view. The FAP mode produces uniform area sampling while the RAP mode produces angular sampling of the radiances.
A full list of parameters on the ES8 is contained in the CERES Data Product Catalog (PDF) and a full definition of each parameter is contained in the ES8 Collection Guide (PDF).
When referring to a CERES data set, please include the satellite name and/or the CERES instrument name, the data set version, and the data product. Multiple files which are identical in all aspects of the filename except for the 6 digit configuration code (see Collection Guide) differ little, if any, scientifically. Users may, therefore, analyze data from the same satellite/instrument, data set version, and data product without regard to configuration code. Depending upon the instrument analyzed, these data sets may be referred to as "CERES Terra FM1 Edition2 ES8" or "CERES Terra FM2 Edition2 ES8."
Corrections implemented in the CERES Terra Edition2 ES8 products consist of:
The CERES Terra Edition1 ES8 data set contained significant errors in the FM2 Daytime LW data which have been corrected in Edition2. These Edition1 products did not meet the stated CERES accuracy goals for certain scene types. The problem is a slow drift in the gain of the FM2 Total channel from launch through present data which is accounted for in Edition2. Studies comparing FM1 and FM2 with each other as well as with onboard calibration sources, 3-channel consistency checks, and deep convective clouds have all confirmed that the effective FM2 Total channel gain is changing roughly 0.28%/yr for the Total channel over the first 12 months of data collection. Gain changes in the SW and 8-12 micron Window channels on both Terra FM1 and FM2 instruments are below 0.1%/yr and are not statistically significant. Tables 1 through 3 present the changes made to the radiometric gains to account for changes between the calibration and space environments, on-orbit changes in instrument responsivity, and on-orbit changes in the sensor spectral response functions.
Table 1. Ground to Flight Changes in the sensor radiometric gains
FM1 (%) | FM2 (%) | |
---|---|---|
Total | 0.20 | 0.12 |
Window | 0.48 | 1.3 |
Shortwave | -.26 | 0.16 |
Table 2. On-orbit gain changes expressed as a linear drift over the time period March 2000 - Feb 2001.
FM1 (%/yr) | FM2 (%/yr) | |
---|---|---|
Total | 0.125 | 0.28 |
Window | - | - |
Shortwave | - | - |
Table 3. On-orbit changes in the spectral response functions expressed as a linear drift over the time period March 2000 - Feb 2001.
FM1 (%/yr) | FM2 (%/yr) | |
---|---|---|
SW/Total (<0.3 microns) | - | 1.0 |
LW/Total (>0.3 microns) | - | - |
Window | - | - |
Shortwave | - | - |
Since the CERES Daytime LW measurements are determined by differencing the Total and SW channels, the resultant LW error is correlated with the amplitude of the scenes daytime SW flux. Figures 1 and 2 show the average differences between daytime co-located FM1 and FM2 nadir footprints stratified by scene type for the Edition1 and Edition2 data products respectively. Bright scenes are defined as those where the SW radiance value exceeds 200 Wm-2sr-1. The largest errors will exist for instantaneous daytime deep convective cloud LW fluxes: by February 2001 these reached a value of about 10 Wm-2 in the Terra Edition1 ES8 data products. For Terra Edition1 global clear-sky fluxes, the FM2 error reaches about 1 Wm-2, and for global mean all-sky fluxes the error reaches about +2 Wm-2. As seen in Figure 2, the Terra Edition2 data products remove this drift, with the resulting bias errors dropping to about 2 Wm-2 for deep convective clouds, and less than 1Wm-2 for both global clear sky and all-sky mean fluxes.
Figure 1. Terra Edition1 ES8 direct comparison of daytime co-located FM1 and FM2 nadir footprints. (FM2 minus FM1 TOA flux)
Figure 2. Terra Edition2 ES8 direct comparison of daytime co-located FM1 and FM2 nadir footprints. (FM2 minus FM1 TOA flux)
The purpose of User Applied Revisions is to provide the scientific community early access to algorithm improvements which will be included in the future Editions of the CERES data products. The intent is to provide users simple algorithms along with a description of how and why they should be applied in order to capture the most significant improvements prior to their introduction in the production processing environment. It is left to the user to apply a revision to data ordered from the Atmospheric Science Data Center. Note: Users should never apply more than one revision. Revisions are independent and the latest, most recent revision to a data set includes all of the identified adjustments.
The CERES Science Team has approved a table of scaling factors which users should apply to the Edition2 ES8 parameters CERES SW filtered radiance, CERES SW unfiltered radiance, and CERES SW flux at TOA. Users should multiply each instance of these parameters by the scaling factor that corresponds to the proper instrument and month. This revision is necessary to account for spectral darkening of the transmissive optics on the CERES SW channels. By June 2005, this darkening has reduced the average global all-sky SW flux measurements by 1.1 and 1.8 percent for Terra FM1 and FM2 respectively. A complete description of the physics of this darkening appears in the CERES BDS Quality Summaries under the Expected Reprocessing section. After application of this revision to the Edition2 ES8 product, users should refer to the data as Terra ES8 Edition2_Rev1.
The ES8 products contain estimates of instantaneous filtered radiance, unfiltered radiance, TOA flux, and scene type. The nature of an estimate is that it is uncertain with a bias error and a random error about the bias which can be measured by its standard deviation. Thus, an understanding of the uncertainty in an instantaneous estimate must consider both biases and standard deviations. Often the uncertainty is given in terms of the RMS error which includes both the bias and standard deviation.
Uncertainties in the filtered radiances are given in Table 1. The total (TOT) channel errors are given separately for night and day since daytime TOT contains both shortwave and longwave radiance while nighttime contains only longwave. The filtered radiances are determined from the instrument counts by multiplying by a gain. If this gain is in error, then the filtered radiances appear to be biased. The measurements are also subject to random measurement noise. All of these errors are combined and given as RMS errors.
Systematic Bias Error (Accuracy) | Mean Zero Random Error Standard Deviation (Precision) | Instantaneous RMS error | |||||
---|---|---|---|---|---|---|---|
Instrument Channel | Typical Valuea Wm-2sr-1 | Instrument Requirementsb 1 std dev |
Ground Cal. Gain errorc 3 std dev |
Instrument Drift over 6 months | Instrument Requirementsb 3 std dev |
Instrument Noised 1 std dev |
|
SW | 45 | 1.0% | 1.0% | 0% | 1% | 0.3% | 0.45% |
TOT-day | 125 | 0.5% | 0.5% | 0% | 1% | 0.1% | 0.19% |
TOT-night | 70 | 0.5% | 0.1% | 0% | 0.5% | 0.1% | 0.11% |
WN | 4.6e | 0.3 Wm-2sr-1 | 1.0%f | 0% | - | 0.5% | 1.0% |
|
Uncertainties in the unfiltered radiances are given in Table 2. The unfiltered radiances are linearly related to the filtered radiances by coefficients which are denoted "Spectral Correction Coefficients" (SCC). These are mean coefficients and introduce random error. The nighttime unfiltered LW radiance is determined from the TOT filtered channel radiance at night. The daytime longwave, however, is derived from the TOT, SW and WN filtered radiances.
Spectral Band | Typical Valuea Wm-2sr-1 |
Spectral Correction Bias Error | Spectral Correction Random Error 1 std dev |
Instantaneous RMS error |
---|---|---|---|---|
SW | 60 | 0 | 0.4% | 0.6% |
LW-day | 85 | 0 | 0.1% | 0.2% |
LW-night | 80 | 0 | 0.1% | 0.15% |
WN | 6.4b | 0 | 0.6% | 1% |
|
Uncertainties in the TOA fluxes are given in Table 3. The fluxes are derived by multiplying radiance by π and dividing by an anisotropic factor from the Angular Distribution Models (ADM). These ADMs are mean models and introduce random error which is the dominant error for flux.
Spectral Band | Typical Valuea Wm-2 |
ADM Bias Errorb |
ADM Random Errorc std dev |
Instantaneous RMS error |
---|---|---|---|---|
SW | 210 | 1.0% | 12% | 12.1% |
LW-day | 265 | 0.5% | 5% | 5.0% |
LW-night | 250 | 0.5% | 5% | 5.0% |
|
There are several cautions the CERES Team notes regarding the use of the CERES Terra Edition2 ES8 data:
Users are responsible for applying revisions as noted in the section entitled "User Applied Revisions to Current Edition".
The validity of the filtered radiances, unfiltered radiances, TOA fluxes, and identified scene types has been examined with various validation studies and quality checks.
The unfiltered radiances are linear functions of the filtered radiances where the coefficients are the Spectral Correction Coefficients (SCC). The SCCs are based on the spectral response of the instrument channel, Sil, where l is wavelength and i = SW, TOT, WN for shortwave, total, and window channel, respectively. The Sil has been measured as part of the instrument calibration and characterization. The SCCs are based on a database of spectral radiances from typical surfaces, such as ocean, land, desert, snow, and cloud. The methodology used in producing Terra Edition2 unfiltered radiances is the same as that used in the CERES TRMM Edition2 ES8 product and is outlined in Loeb et al., (2000). This method differs from that used on ERBE. To unfilter SW radiances, the ERBE unfiltering algorithm used a theoretical ratio between unfiltered and filtered radiances defined at various angles in overcast and cloud-free conditions over ocean, land, desert and snow. Interpolation between these theoretical ratios was used to determine coefficients under partly and mostly cloudy conditions. The ERBE approach has been shown to produce large errors when applied to CERES due to the differences between the CERES and ERBE spectral response functions (see Loeb et al., 2000).
To estimate uncertainties in instantaneous unfiltered radiances for each channel, the unfiltering algorithm was used to estimate radiances from approximately 10,000 theoretical test cases representative of clear and cloudy conditions over ocean, land and snow. The test calculations were determined from MODTRAN + DISORT radiative transfer calculations at high spectral resolution and represent a wide range of cases.
Errors in instantaneous SW unfiltered radiances from both FM1 and FM2 were found to be <0.5% (relative). By comparison, uncertainties in PFM instantaneous unfiltered SW radiances were generally <1%. The reduction in error was particularly marked for clear oceanic scenes because the FM1 and FM2 spectral response functions are flatter than PFM at wavelengths between 0.3-0.4 microns.
In contrast, the theoretical results revealed slightly larger uncertainties in unfiltered LW radiances from FM1 and FM2 compared to PFM. For most scenes, FM1 and FM2 uncertainties remain less than 0.4% (relative) compared to 0.2% for PFM. However, for extremely cold clouds (e.g. deep convective clouds), uncertainties in FM1 and FM2 unfiltered radiances can reach 1% for both daytime and nighttime conditions.
In the WN channel, all three instruments showed very small uncertainties in unfiltered radiances (<0.2%) for all scenes.
Coincident FM1 and FM2 unfiltered radiances from four days in March 2000 were compared. Both instruments operated in cross-track scan mode during these days and thus viewed the same scenes from the same viewing geometry. Results were stratified by scene type and solar zenith angle.
Unfiltered radiances measured by FM1 and FM2 on Terra are also compared to radiances measured by the CERES Proto-Flight Model (PFM) on TRMM. The measurements are matched in time, space and viewing geometry to provide comparisons independent of angular and diurnal models. Comparisons of SW radiances require both the zenith and the relative azimuth angles to be matched. This match is obtained by rotating the scanning plane of one of the instruments to scan parallel to the other instrument. For LW and nighttime WN comparisons, we match the zenith angles only. Daytime WN radiances are compared for matched zenith and relative azimuth because heating of land surfaces can vary with azimuth.
Observations from the two instruments are considered coincident if made within +/-15 minutes of each other. Spatial resolution discrepancy between FM1/FM2 and PFM is reduced by averaging the radiances on a 1-deg grid. Zenith angles are matched to +/-5 deg and relative azimuth angles are required to be within +/-10 deg. Any differences found between FM1/FM2 and PFM can be attributed to uncertainties in either radiometric calibration or spectral unfiltering process described above. A more detailed description of this comparison method can be found in Haeffelin et al. (2000).
A 3-channel intercomparison of Tropical Deep Convective Clouds was used in conjunction with direct measurements of Tropical DCC SW Albedo to assess both the consistency of the SW channels and SW portion of the total channels and to rigorously determine which channel is responsible for any apparent inconsistencies (i.e. SW or SW/TOT). Additionally these studies determine whether any inconsistencies are changing with time or remaining stable. Further details on these two studies may be found in Priestley et al. (2000) and Currey and Green (1998).
Currey, C. and Green, R., 1998,"Validation of the CERES shortwave measurements over desert and cloud scenes", Am. Meteor. Soc., 10th conference on atmospheric radiation, 567-570.
Haeffelin, M., B. Wielicki, J.P. Duvel, K. Priestley, M. Viollier, 2000: "Inter-calibration of CERES and ScaRaB Earth radiation budget datasets using temporally and spatially collocated radiance measurements". Geophysical Research Letters, (in press).
Loeb, N.G., K.J. Priestley, D.P. Kratz, E.B. Geier, R.N. Green, B.A. Wielicki, P. O'R. Hinton, and S.K. Nolan, 2000: Determination of unfiltered radiances from the Clouds and the Earth's Radiant Energy System (CERES) instrument. J. Appl. Meteor. (in press).
Priestley et al., "Postlaunch Radiometric Validation of the Clouds and the Earth's Radiant Energy System (CERES) Proto-Flight Model on the Tropical Rainfall Measuring Mission (TRMM) Spacecraft through 1999", J. Appl. Meteor., 39 (12), 2249-2258, December 2000.
The current "Edition2" data are expected to be reprocessed into a validated/archived/publishable Edition 3 after the Terra mission is completed.
The CERES Team expects to reprocess the ERBE S8 data product for ERBS, NOAA-9, NOAA-10, and the ES8 data product for TRMM in the future. The purpose of the reprocessing is to generate a consistent, long-term climate record, where advances in the data calibration and processing will be incorporated to remove former errors. The major contribution to reprocessing will be an improved set of Angular Distribution Models (ADMs) based on CERES data and the MLE as the scene identifier. Other improvements include more accurate scanner offsets for NOAA-9 and NOAA-10, correction of the low daytime longwave flux for NOAA-9, drift corrections, and a possible resolution correction for CERES so that the CERES and ERBE footprints will be similar in size.
The CERES Team has gone to considerable trouble to remove major errors and to verify the quality and accuracy of these data. Please provide a reference to the following paper when you publish scientific results with the data:
Wielicki, B. A., B. R. Barkstrom, E. F. Harrison, R. B. Lee III, G. L. Smith, and J. E. Cooper, 1996: Clouds and the Earth's Radiant Energy System (CERES): An Earth Observing System Experiment, Bull. Amer. Meteor. Soc., 77, 853-868.
When data from the Langley Data Center are used in a publication, we request the following acknowledgment be included:
"These data were obtained from the Atmospheric Science Data Center at NASA Langley Research Center."
The Data Center at Langley requests a reprint of any published papers or reports or a brief description of other uses (e.g., posters, oral presentations, etc.) of data that we have distributed. This will help us determine the use of data that we distribute, which is helpful in optimizing product development. It also helps us to keep our product-related references current.
For questions or comments on the CERES Quality Summary, contact the User and Data Services staff at the Atmospheric Science Data Center.
A Portable Document Format (PDF) reader (such as Adobe Acrobat Reader) is required to open and view PDF documents.