Sensor Fusion

Sensor Fusion

In March and April of 2004, hyperspectral imagery, topographic lidar data, and high resolution digital color imagery were collected simultaneously aboard the NOAA Citation for coastal project areas in Florida and California.The data are being used to support a number of research objectives, including shoreline extraction and feature attribution, and coral reef mapping.

Airborne Data Acquisition

An Applanix, medium format, digital sensor system (DSS), an Optech ALTM 50 kHz LIDAR and an ITRES CASI-2 Hyperspectral Imager were installed on a NOAA Citation Jet. To facilitate accurate geo-referencing, each sensor had its own inertial measurement unit (IMU). A single GPS antenna was used for all three sensors. This signal was split three ways to accommodate the three sensors. The data were acquired at a flying height of 4500 ft and at a flying speed that ranged between 130-160 knots. All data were flown either into or away from the sun, in order to avoid sun glint on the hyperspectral and digital imagery. Additionally, factors such as swath width, sensor integration times, and field of views were taken into account during the planning phase of this project in order to achieve sufficient overlap and avoid data gaps.

Field Data Acquisition

For each study site, approximately 25 ground control points were occupied with GPS, for 15 minutes in order to assess the horizontal positional accuracy of the digital imagery and CASI-2 Hyperspectral products (Figure 2a). The post-processed accuracy of the 25 ground control points was at the centimeter level. Spectral signatures of coastal features were also collected for each study site using a handheld Analytical Spectral Device (ASD) FieldSpecPro spectrometer (Figure 2b). Targets thought to be homogeneous and large enough to be seen in the hyperspectral imagery were identified. For each target, eighty spectral signatures were acquired using the absolute reflectance mode and then averaged.

Data Processing

A radiance hyperspectral data cube, consisting of seventy-two spectral bands at a spectral resolution of 8 nanometers spanning the 430-970 nanometer range of the electromagnetic spectrum, was collected for each study site. The GSD for each image scene was 2.0 meters in the across track and 2.4 meters in the along track. An important step in hyperspectral processing is converting the data from at-sensor radiance to reflectance. The data collected at all study sites were atmospherically corrected using the Empirical Line Method. This method involves the use of field spectral reflectance signatures acquired during the time of data acquisition.

Lidar data with a 1 meter point spacing in the along and across track was post processed using Optech's proprietary software. A digital elevation model (DEM) with a post spacing of 1 meter was used for data fusion in this research project. The digital photographs were imported into Socetset, a digital photogrammetric workstation. The DSS imagery was geo-referenced using direct geo-referencing from blending of the GPS/IMU data. Fifty-centimeter ortho-photograhs were created, using the lidar DEM, to correct for terrain displacement. Figure 3 represents a sample of these datasets for the Fort Desto Beach area.

Sensor Fusion for Shoreline Mapping

The lidar data points were processed through NGS' VDatum vertical transformation tool, then interpolated to a grid to create a DEM referenced to the appropriate tidal datum, such as mean high water (MHW). With the lidar DEM referenced vertically to MHW, a zero-contour was extracted which represents the MHW shoreline. The next step was to perform a classification on the CASI-2 hyperspectral data. A classified thematic map was created from the CASI-2 hyperspectral data using the Mahalanobis Distance Classifier. This thematic map contained sand, pier and seawall classes. GIS software was then used to intersect the lidar-derived shoreline with the classification image so the shoreline vector would pick up the attributes from the classified thematic map.

Aerial Photograph Lidar Hyperspectral collecting spectral signatures Classification of HSI Shoreline derived from lidar Auto-extracted and feature attributed shoreline