Indiana University

Follow us on Facebook!

Data Catalog

Overview

Data Catalog harvests data product metadata from distributed THREDDS catalogs into an XMC Cat instance. The metadata (including data product location) is then available to applications via the XMC Cat API. Data catalog metadata harvesting employs a shared nothing ingest pipeline to allow for the indexing of large catalogs such as NEXRADIII and has indexed of over 17 thousand collections and 2 million files.

Resources

Data Catalog Dashbaord A visual tool for querying against Data Catalog

Contact
  • Jeffrey Cox [jefcox at indiana dot edu]

Project Contributors

Current:

  • Beth Plale, Project Director 
  • Jeffrey Cox
  • Milinda Pathirage

Historical:

  • Yogesh Simmhan
  • Heejoon Chae
  • Related News, Events and Publications:

    PTI hosted the ODI Pipeline, Portal, and Archive proposal review

    The One Degree Imager (ODI) is the flagship of the Wisconsin, Indiana, Yale, NOAO (WIYN) Consortium's new instrument initiatives for the 3.5 meter telescope installed at Kitt Peak National Observatory in Arizona.

    LEAD II/Trident workflows for timely weather products: challenge of Vortex2 PRAGMA 19 Workshop, Changchun, China, Sept 13-15, 2010. Keynote talk by Beth Plale.