2 and 20 - Home Page | CoastWatch-West Coast

2 and 20 - Home Page | CoastWatch-West Coast

EML, KNB, and ERDDAP Bob Simons DOC / NOAA / NMFS / SWFSC / ERD Monterey, CA [email protected] (Special thanks to Margaret O'Brien) What ERDDAP looks like

to a user: ERDDAP Your Favorite Client Software What ERDDAP looks like to a data provider: OBIS

SOS THREDDS Hyrax Database 3 ERDDAP ERDDAP

Files 2 1 4 Your Favorite Client Software

... Acting as a middleman allows ERDDAP to

Improve each dataset's metadata. Generate ISO 19115 metadata. Standardize the format of time data. Provide a unified way for users to search for datasets. Offer a standard way to request data from any dataset. Let users specify the response file format.

Make life easier for data providers and for users. Gridded Data A RESTful URL specifies an entire request: dataset, response file type, subset: http://coastwatch.pfeg.noaa.gov/erddap/griddap/jplMURSST41.html ?analysed_sst[(2016-07-01T09:00:00Z)][(-89.99):(89.99)][(-179.00):(180)] Special file types: .html (Data Access Form), .graph (graph form), .fgdc,

.iso19115, .das, .dds Data file types: .asc, .csv, .esriAscii, .json, .htmlTable, .mat, .nc, .odvTxt, .tsv, ... Image file types: .geotif, .kml, .pdf, .png, .transparentPng Tabular Data

A RESTful URL specifies an entire request: dataset, response file type, subset: http://coastwatch.pfeg.noaa.gov/erddap/tabledap/pmelTaoDySst.html ?longitude,latitude,T_25,time&time=2011-08-10T12:00:00Z Special file types: .html (Data Access Form), .graph (graph form), .fgdc, .iso19115, .das, .dds, .subset Data file types: .asc, .csv, .esriCsv,

.htmlTable, .geoJson, .json, .mat, .nc, .ncCF, .ncCFMA, .odvTxt, .tsv, .xhtml, ... Image file types: .geotif, .kml, .pdf, .png, .transparentPng Knowledge Network for Biocomplexity (KNB) An NSF-funded data repository for

ecologists and environmentalists A DataONE (NSF) Member Node Downloadable: EML metadata files and tabular data files https://knb.ecoinformatics.org/# Ecological Metadata Language (EML)

is a great XML-based metadata language for describing ecological tabular scientific datasets.

It is standardized, mature, well-documented. The XML is easy for a human to read and understand Indentation that is just right (cough, not like OGC, cough) There are tools to help users It has XML tags for a full description of the variables Everything is very well done! https://knb.ecoinformatics.org/#external//emlparser/docs/index.html

What if we combined ERDDAP and EML?! + GenerateDatasetsXml A tool that comes with ERDDAP It generates the description of a dataset that ERDDAP needs to serve the datasets.

New EDDTableFromEML option New EDDTableFromEMLBatch option https://coastwatch.pfeg.noaa.gov/erddap/download/EDDTableFromEML.html It works great! Added 200 SBC LTER datasets in 20 minutes! The EML has all the information ERDDAP needs. That was key. EML succeeds brilliantly!

The EML always a link to the data file. That was key. EML succeeds brilliantly! The data files have diverse but usable formats. The date time formats are not well described in the EML, but can be determined. I added other new ERDDAP features, e.g., timezones. The conversion succeeds with about 90% of EML files.

The rest are fixable (e.g., make a date+time variable). Advantages of having the datasets in ERDDAP: Users can now do Google-like searches for datasets of interest. Time is now formatted consistently. Users can now see subsets of the dataset and make custom graphs and maps

without downloading the data. Data are now available in a consistent file format of the user's choice. ERDDAP generates ISO 19115 XML for inclusion in data.gov catalog. Interactive - not download, parse, then explore. Public Access to Research Results (PARR) Requirements

Government funded data shall be publicly and freely: Discoverable via a catalog (data.noaa.gov -> data.gov) Understandable via metadata Accessible via a web service (e.g., ERDDAP / DAP) (not just downloadable files or a shopping cart) Your data available within one year (by last year ASAP!) ERDDAP can help with all of these requirements! https://www.whitehouse.gov/blog/2013/02/22/expanding-public-access-results-federally-fundedresearch

https://www.whitehouse.gov/sites/default/files/microsites/ostp/ostp_public_access_memo_2013.pdf A Bridge One can easily envision one ERDDAP with NOAA/USGS datasets and KNB/EML datasets offering a consistent way to search for and access all ecological/environmental datasets. What's Next?

Work with people using EML / tabular datasets to set up an ERDDAP and add datasets. Call or email me! Let's talk! Thank you! Questions? Comments? Suggestions? Want to work on this?

email [email protected] Give ERDDAP a try! http://coastwatch.pfeg.noaa.gov/erddap/

Recently Viewed Presentations

  • Power and Conflict - WordPress.com

    Power and Conflict - WordPress.com

    Tissue, Imtiaz . Dharker. Which quotation would be most appropriate? How is political conflict presented in London? Mind-forg'd manacles Chartered Thames Black'ning church Runs in blood down palace walls. Write a short paragraph answering the question, using your chosen quotation.
  • Vorlesung Finanzgeschichte - Institut

    Vorlesung Finanzgeschichte - Institut

    Das gläubige Vertrauen auf den charismatischen »Führer«, das Verfallensein an den Hitler-Mythos, das Ian Kershaw und jüngst Hans-Ulrich Wehler als stärkstes Bindemittel des Regimes beschrieben haben - es taucht nicht einmal mehr auf." Volker Ullrich, Hitlers zufriedene Räuber, in: Die...
  • Variabilitatea genetica 1. 2. Recombinarea genetica Variatia (diversitatea)

    Variabilitatea genetica 1. 2. Recombinarea genetica Variatia (diversitatea)

    DEFINITIE: variabilitatea este (1) tendinta caracteristicilor genetice individuale de a fi diferite la nivel populational (2) potentialul unui genotip de a se modifica, atunci cand este supus actiunii unor factori de mediu sau genetici
  • Update on the RFE Energy Sector and on the RFE LEAP Modeling ...

    Update on the RFE Energy Sector and on the RFE LEAP Modeling ...

    National Energy Sector: main trends in between the two crisis periods. Energy sector share in the russian economy (2008): about 25% of GDP, more than 48% of total taxes, more than 68% in total export income and 28% in total...
  • GCSO FY17 Build Your AutoCAD IQ! - damassets.autodesk.net

    GCSO FY17 Build Your AutoCAD IQ! - damassets.autodesk.net

    Autodesk AutoCAD Community Forums. Ask your peers and share your knowledge. AutoCAD Customer Council. Join the Beta to influence the future of AutoCAD! For AutoCAD: [email protected] For AutoCAD LT: [email protected] Autodesk Help Webinars. Build Your AutoCAD IQ! Live. Build Your...
  • PowerPoint-Präsentation

    PowerPoint-Präsentation

    Calculate position by intersecting distances (pseudoranges) Jürgen Sturm. Autonomous Navigation for Flying Robots. GPS. 24+ satellites, 12 hour orbit, 20.190 km height. 6 orbital planes, 4+ satellites per orbit, 60deg distance.
  • Welcome to Hillview! 02/27/20 1 Left Gazebo Right

    Welcome to Hillview! 02/27/20 1 Left Gazebo Right

    Welcome to Hillview! * * * * The gazebos allow our residents and families to enjoy and private area in the shade. Left Gazebo Right Gazebo * * When you enter our front entrance you will be greeted by our...
  • Ne v ad a Co Tra nf ns

    Ne v ad a Co Tra nf ns

    Crash Modification Factor (CMF) Method. CMFs from HSM Part D or FHWA CMF Clearinghouse (4 stars or above) CMF selected must match project. Situational - area type, time of day. Geometrics - number of lanes, driveway density. Operational - ADT,...