DMIT 2012-04-04
From NOAA Environmental Data Management Wiki
Contents |
DMIT Telecon 2012-04-04
Attendees
- Galen Evans, OpenGeo - gevans@opengeo.org
- Kenneth Bossung, OpenGeo - kbossung@opengeo.org
- Justin Deoliveira, OpenGeo - jdeolive@opengeo.org
- Jeff DLB
- Kevin O'Brien
- Roy Mendelssohn
- Julie Bosch
- Jim Sargent
- Jebb Stewart
- Jim Calkins
- Kim Jenkins
- Matt Austin
- Micah Wengren
- Ted Habermann
- Steve Hankin
- Dave Neufeld
- Ken Casey
- Tina Chang
- Scott Cross
- Susan McLean
Agenda
- Announcements
- Briefing by OpenGeo (Kenneth Bossung, Galen Evans)
- Project updates:
- The Project Formerly Known as NOAA Data Catalog Prototype
- UAF
- Geoportal Server implementations
- others as needed
Announcements
NOAA EDM Conference registration now open at https://www.regonline.com/edmc2012 NetCDF templates for CF feature types (points, profiles, grids, trajectories, etc.), conforming to CF 1.6 and ACDD conventions, published by NODC last week!!! URL: http://www.nodc.noaa.gov/data/formats/netcdf/
OpenGeo Presentation
http://opengeo.org/ Slides will be posted on DMIT Wiki Micah Wengren - NOAA Opensource Project "Lots of NOAA groups are publishing shapefiles" - are there examples of this?
Status Reports
Data Management Dashboard
Slides will be posted on DMIT Wiki Sue: IOCM conference in Boulder 2012-08-13 or so. IOCM implementing Geoportal Can Matt present on the dashboard? Kim: Any assistance needed from existing Geoportal admins? Would be good to have ongoing collaboration.
Unified Access Framework
Continuing work on Catalog Cleaner tool. Had some scalability issues-- ~3 months to crawl clean catalog. Complete rewrite--multi-phase crawling, performance improvements. Should be more scalable. Will produce new clean catalog. Willl include better links to services available. Also working on extensions from gridded to in situ data. Some discrete feature netCDF files exist. Usually offer single features rather than collections. Unidata working on ncStream; IOOS SOS supports collections. UAF looking at ERDDAP as middleman to aggregate into collections. UAF meeting @ Seattle? in 2 weeks. This is just a telcon, sometime during the week of April 23rd. Kevin presenting on UAF at ESIP Interop session (Wed, April 4, 2pm – 3pm MDT) Working with NODC to establish Geoportal front-end over UAF WAF. Matt: What about duplicate titles in the metadata? Not fixed yet. Ted: Some improvements in ncISO approach should be made. Data providers need to be able to offer "Metadata Services" which associate custom xslt's with datasets in their catalogs. This is similar to the approach currently used for providing data services. Providers give a name for those services and a URL pattern. The idea is that they would give a service name and an xslt for each service. There are many people that are ready to use this capability immediately.
Geoportal Server implementations
NODC: Good progress on scalability testing. ~1M records desired. Would like to be able to catalog at granule level, not just at collection level. Testing ability to index many records and to get responses back in reasonable time. So far have about 650,000 ISO records indexed in a test geoportal... getting about 30 records/sec indexing rate. Searches return quickly... roughly 1 to 2 sec. Sue: How useful are search results? Often there are too many results. Ken: Yes, understand that problem. Focus on internally-held data and on two-tiered search?? -- collection/granule Matt: Is this similar to what CWIC is doing? Ken: Yes, Working with CWIC. We meet with them each month and want to make sure what we are doing supports the CEOS IDN (Integrated Data Network, for collections) and CWIC (CEOSS WGISS Integrated Catalog, for granules).
Metadata Projects / Improvements
Metadata improvements - The current implementations of metadata in netCDF are generally flat parameter/value. There are many documentation needs that benefit from documentation objects that hold together related attributes. The capability to create and access these sorts of objects exists in HDF and netCDF4. We need to develop some conventions (next version of ACDD) in this area. Candidates are proposed at https://geo-ide.noaa.gov/wiki/index.php?title=NetCDF,_HDF_and_ISO_Metadata. Input from this group would be great! [ACDD = Attribute Conventions for Dataset Discovery] The ESIP CF-Cluster is evolving into a Documentation Cluster which will probably meet for the first time this summer. NOAA people are encouraged to help out...
