This slide will demonstrate how to use visualization and analysis tools such as IDV and GrADS to access HDF data via OPeNDAP.
To see animation in some slides, please visit:
http://hdfeos.org/workshops/ws13/presentations/day1/jxl_opendap_tutorial.ppt
Driving Behavioral Change for Information Management through Data-Driven Gree...
Using visualization tools to access HDF data via OPeNDAP
1. The HDF Group
Using visualization tools to
access HDF data via
OPeNDAP
Joe Lee and Kent Yang
The HDF Group
The 13th HDF and HDF-EOS Workshop
November 3-5, 2009
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
1
www.hdfgroup.org
2. HDF-OPeNDAP Tutorial Outline
• Why OPeNDAP?
• OPeNDAP Client Tools
o Visualization and Analysis
• OPeNDAP Servers
• Viewing Data with Panoply
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
2
www.hdfgroup.org
3. Why So Difficult?
• Getting and Listening to MP3 song
o Yesterday - Beatles
• Getting and Viewing HDF-EOS dataset
o Yesterday’s Ozone - OMI
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
3
www.hdfgroup.org
4. Mirador – Data Access Made Simple
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
4
www.hdfgroup.org
5. Access HDF via FTP/HTTP
Users
Tool (IDL)
All I want is x-region data but data is
missing.
Aura
All I want is a dataset, not the entire file.
OMI
FTP
Local HDF
Files
November 3-5, 2009
FTP / HTTP
Clients
FTP / HTTP
Servers
HDF/HDF-EOS Workshop XIII
HDF Files
5
www.hdfgroup.org
6. Why MP3?
Why OPeNDAP?
• MP3 over CD
• Pick one song, not album (Quick)
• Listen now and Buy later (Right)
• OPeNDAP over FTP/HTTP
• Pick one dataset, not file (Quick)
• View now and Download later (Right)
• Benefit: Save Time and Resource!
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
6
www.hdfgroup.org
7. OPeNDAP Concept
Typical Remote Access
OPeNDAP client
Visualization
Visualization
View Data
tools
(e.g. grads)
(User)
Tools
Remote Data
(HDF4/5)
Local Data
(HDF4/5)
OPeNDAP
FTP
Server
FTP Client
DataTransfer Protocol (DAP) via Internet
File Access
(FTP)
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
7
www.hdfgroup.org
8. Access HDF via FTP/HTTP
Aura
Users
HDF Tool
OMI
FTP/
HTTP
Local HDF
Files
November 3-5, 2009
FTP / HTTP
Clients
FTP / HTTP
Servers
HDF/HDF-EOS Workshop XIII
HDF Files
8
www.hdfgroup.org
9. Access HDF via OPeNDAP
Aura
Users
OMI
DAP
OPeNDAP
Client Tool
November 3-5, 2009
OPeNDAP
Servers
HDF/HDF-EOS Workshop XIII
HDF Files
9
www.hdfgroup.org
10. OPeNDAP – Why Not?
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
10
www.hdfgroup.org
11. How toHow to HDF via OPeNDAP
Enjoy Enjoy MP3
MP3
HDF via OPeNDAP
1. Install MP3 player
1. Install OPeNDAP tool
2. Search web for MP3
2. Search web for data
3. Listen to your MP3
3. View data
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
11
www.hdfgroup.org
14. Search Web for Data
• Open Web Browser
• Search omi opendap (or Enter URL)
• http://acdisc.gsfc.nasa.gov/opendap/
(http://www.hdfgroup.org/projects/opendap4/opendap4_demo.html)
• (Click HDF-EOS5)
• (Click Aura OMI Level 3)
• Click OMTO3d.003
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
14
www.hdfgroup.org
15. Search Web for OPeNDAP Data
• Pick the Date
• Select & Copy the DATA URL (Ctrl-C)
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
15
www.hdfgroup.org
16. View Data
•
•
•
•
•
November 3-5, 2009
Start Application
Enter URL (Album)
Pick Dataset (Track)
Set Projection (Equalizer)
Enter Lat / Lon (FF/REW)
HDF/HDF-EOS Workshop XIII
16
www.hdfgroup.org
17. Examples and Demo Pages
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
17
www.hdfgroup.org
18. The HDF Group
Thank You!
• More Tools Examples:
http://hdfeos.org/software/idv.php
http://hdfeos.org/examples/using_grads.php
• More Demo Servers and Data:
http://hdfgroup.org/projects/opendap
http://hdfgroup.org/projects/opendap4
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
18
www.hdfgroup.org
19. Acknowledgements
This work was supported by cooperative agreement
number NNX06AC83A, NNX08AO77A and
NNX06AG75A from the National Aeronautics and
Space Administration (NASA).
Any opinions, findings, conclusions, or
recommendations expressed in this material are
those of the author[s] and do not necessarily reflect
the views of the National Aeronautics and Space
Administration.
November 3-5, 2009
HDF/HDF-EOS Workshop XIII
19
www.hdfgroup.org
Hi, my name is Joe Lee and I am a software developer at The HDF Group.
For the last two years, I’ve been working on HDF-OPeNDAP project.
In this talk, I’ll give you a tutorial how to access HDF through OPeNDAP.
Here’s the outline of my talk.
First, I’ll give an introduction to OPeNDAP and explain why OPeNDAP is useful.
Next, I’ll go over the available OPeNDAP client tools.
They are primarily used for visualization of data and some of them allow you to do analysis.
Then, I’ll talk about how to find OPeNDAP servers and data.
Finally, I’ll present a live demo for viewing OPeNDAP ata.
Before I begin, I want to ask you a simple question.
Compared to enjoying MP3 song from the internet, how do you feel about enjoying HDF-EOS dataset?
For example, if you search for the song Yesterday by Beatles, you can easily listen to a sample in less than 10 seconds.
However, how about viewing the NASA OMI data collected yesterday?
If you search for NASA OMI ozone data, you’ll find GES DISC site as a top result
since NASA has made a great effort to make data accessible simple and easy.
You’ll see three choices - FTP/HTTP and OPeNDAP.
Normally users pick FTP or HTTP over OPeNDAP since they are familiar with them.
Here’s how it works with FTP/HTTP.
However, there are at least two problems for accessing HDF in this manner.
If you are not still convinced the inconvenience, think why MP3 became so popular over compact discs.
You like MP3 because you can pick one song at a time.
You can examine the content first and then buy it later if you like.
Same for data access.
This is how remote data can be accessed via OPeNDAP.
Normally, users can view local data file “after download” using scientific data using visualization tools like GrADS.
In DAP, this can be done remotely and on-demand.
The benefit of OPeNDAP is clear when you want to view a small dataset; you don’t have to download the entire data from the server.
DAP is a kind of value-added service on top of HTTP.
For people who are not familiar with OPeNDAP, I’ll explain how OPeNDAP works with HDF.
OPeNDAP is an open implementation of easy data access through visualization tools like IDV.
Our work bridges the existing OPeNDAP framework and HDF so that visualization is possible over the Internet.
As you can see, OPeNDAP simplifies the access of the remote data.
As long as data service provider supports OPeNDAP servers, so why not use OPeNDAP?
Let’s try it now.
This is how you enjoy internet music.
Same 3 easy steps for OPeNDAP.
There are many choices for OPeNDAP tools.
Some of them can do analysis.
If you download and unzip panoply, you’ll see this.
It’s time to locate OPeNDAP servers and search for data.
The key thing to remember is the Data URL.
Here are some sneak previews of the new HDF-EOS website.
I’m showing these because we have more opendap examples.
Thank you for listening.
Here are the URLS that I’ve mentioned during the tutorial.
Supported by NASA for last two years.
Any questions?
Wouldn’t it be cool to convert HDF-EOS to mp3?