SlideShare uma empresa Scribd logo
1 de 19
An Overview of
HDF-EOS
(Part II)

Doug Ilg
Raytheon STX
Doug.Ilg@gsfc.nasa.gov
(301) 441-4089
1
Outline
The Swath Interface
What is an HDF-EOS File?

2
In
str
u

me
nt

Pa

th

Swath Data Sets
Instrument

Profiles

In
str
u

m

en
t

Pa

th

Instrument
Scan Lines

Along Track
Along Track

3
A Swath Structure
Dimension
Name: Scan
Size: 16

“Temp”

“Time”
Dimension
Name: Track
Size: 42

Dimension
Name: Geotrack
Size: 21

Map1
DataDimension: “Track”
Geodimension: “Geotrack”
Offset: 1
Increment: 2

4
Components of the Swath
Interface
Access
Definition
Basic I/O
Inquiry
Utility
Subset
5
Tips on Writing a Swath
Order of calls is significant:
– define dimensions before using them to
define fields of maps
– setting a compression method affects all
subsequently defined fields

Unless a dimension map is defined, a 1to-1 mapping is assumed during
subsetting. This can produce strange
results.
6
Swath Subsetting Features
By Time
– SWdeftimeperiod/SWextractperiod

By Geolocation
– SWdefboxregion/SWextractregion

By “Vertical” field
– SWdefvrtregion/SWextractregion

Tip: use Time or Geolocation first, then
Vertical
7
Compression Methods for
Swaths
Run-Length Encoding
Adaptive Huffman
Gzip

8
Question:
What’s an HDF-EOS File?

9
Some Answers
ECS: An HDF file with ECS metadata
Any file with an HDF-EOS object in it
A file with only HDF-EOS objects in it

10
My Answer
You’ve asked the wrong question.
The difference between HDF and HDFEOS is at the object level, not the file
level.

11
Key
An HDF file

HDF-EOS

One or more HDF-EOS data objects
with attendant structural metadata

ECS
Metadata

Core and possibly Archive
metadata

HDF

One or more HDF data objects
12
HDF

•Portability
•Elementary data access
•Basic self-description

HDF-EOS

• Geolocation information
tightly coupled to data
• Fully standardized
geographical subsetting
• Moderate self-description

ECS
Metadata

• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
13
HDF

An HDF file with a set of
HDF data objects

Services Provided
•Portability
•Elementary data access
•Basic self-description
Services Not Provided
• Geolocation information
tightly coupled to the data
• Fully standardized
geographical subsetting
• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
14
HDF-EOS

An HDF file with a set of
HDF-EOS data objects

Services Provided
• Portability
• Elementary data access
• Moderate self-description
• Geolocation information
tightly coupled to the data
• Fully standardized
geographical subsetting
Services Not Provided
• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
15
Services Provided
• Portability
• Elementary data
access
HDF-EOS
• Moderate selfdescription
• Geolocation information
HDF
tightly coupled to some
of the data
• Partially standardized
geographical subsetting
An HDF file with a mixed
Services Not Provided
set of HDF-EOS and HDF • ECS ingest, archiving,
data objects
search, and distribution
• Enhanced self-description
• Fully standardized
geographical subsetting
16
HDF
ECS
Metadata

An HDF file with a set of
HDF data objects with
ECS metadata

Services Provided
• Portability
• Elementary data access
• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
Services Not Provided
• Geolocation information
tightly coupled to the data
• Fully standardized
geographical subsetting

17
HDF-EOS
ECS
Metadata

An HDF file with a set of
HDF-EOS data objects
with ECS metadata

Services Provided
• Portability
• Elementary data access
• Geolocation information
tightly coupled to the data
• Fully standardized
geographical subsetting
• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
Services Not Provided
• None

18
HDF-EOS

HDF
ECS
Metadata
An HDF file with a
mixed set of HDF and
HDF-EOS data objects
with ECS metadata

Services Provided
• Portability
• Elementary data access
• Geolocation information
tightly coupled to some of
the data
• Partially standardized
geographical subsetting
• ECS ingest, archiving,
search, and distribution
• Enhanced self-description
Services Not Provided
• Fully standardized
geographical subsetting
19

Mais conteúdo relacionado

Mais procurados

Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020GEO Analytics Canada
 
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...GEO Analytics Canada
 
Ccsds based file delivery protocol (cfdp) v1p3
Ccsds based file delivery protocol (cfdp) v1p3Ccsds based file delivery protocol (cfdp) v1p3
Ccsds based file delivery protocol (cfdp) v1p3Aritra Sarkar
 
Improving long-term preservation of EOS data by independently mapping HDF4 da...
Improving long-term preservation of EOS data by independently mapping HDF4 da...Improving long-term preservation of EOS data by independently mapping HDF4 da...
Improving long-term preservation of EOS data by independently mapping HDF4 da...The HDF-EOS Tools and Information Center
 
Leverage data analytics to reduce human space mission risks Presentation
Leverage data analytics to reduce human space mission risks PresentationLeverage data analytics to reduce human space mission risks Presentation
Leverage data analytics to reduce human space mission risks PresentationJason Loveland
 
TGS GPS- Russian well database
TGS GPS- Russian well database TGS GPS- Russian well database
TGS GPS- Russian well database TGS
 

Mais procurados (20)

Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020Geo Analytics Canada Overview - May 2020
Geo Analytics Canada Overview - May 2020
 
Why is postgis awesome?
Why is postgis awesome?Why is postgis awesome?
Why is postgis awesome?
 
Bridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data ProductsBridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data Products
 
Guided Tour of Pythonian Museum
Guided Tour of Pythonian MuseumGuided Tour of Pythonian Museum
Guided Tour of Pythonian Museum
 
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...
STAC, ZARR, COG, K8S and Data Cubes: The brave new world of satellite EO anal...
 
Multidimensional Scientific Data in ArcGIS
Multidimensional Scientific Data in ArcGISMultidimensional Scientific Data in ArcGIS
Multidimensional Scientific Data in ArcGIS
 
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs ProjectsGES DISC Eexperiences with HDF Formats for MEaSUREs Projects
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
 
HDFCloud Workshop: HDF5 in the Cloud
HDFCloud Workshop: HDF5 in the CloudHDFCloud Workshop: HDF5 in the Cloud
HDFCloud Workshop: HDF5 in the Cloud
 
HDF and netCDF Data Support in ArcGIS
HDF and netCDF Data Support in ArcGISHDF and netCDF Data Support in ArcGIS
HDF and netCDF Data Support in ArcGIS
 
Ccsds based file delivery protocol (cfdp) v1p3
Ccsds based file delivery protocol (cfdp) v1p3Ccsds based file delivery protocol (cfdp) v1p3
Ccsds based file delivery protocol (cfdp) v1p3
 
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 dataUsage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
Usage of NCL, IDL, and MATLAB to access NASA HDF4/HDF-EOS2/HDF-EOS5 data
 
ICESat-2 Metadata and Status
ICESat-2 Metadata and StatusICESat-2 Metadata and Status
ICESat-2 Metadata and Status
 
Improving long-term preservation of EOS data by independently mapping HDF4 da...
Improving long-term preservation of EOS data by independently mapping HDF4 da...Improving long-term preservation of EOS data by independently mapping HDF4 da...
Improving long-term preservation of EOS data by independently mapping HDF4 da...
 
Working with Scientific Data in MATLAB
Working with Scientific Data in MATLABWorking with Scientific Data in MATLAB
Working with Scientific Data in MATLAB
 
HDF OPeNDAP Project Update and Demo
HDF OPeNDAP Project Update and DemoHDF OPeNDAP Project Update and Demo
HDF OPeNDAP Project Update and Demo
 
Tag-Based Browsing of Digital Collections with Inverted Indexes and Browsing ...
Tag-Based Browsing of Digital Collections with Inverted Indexes and Browsing ...Tag-Based Browsing of Digital Collections with Inverted Indexes and Browsing ...
Tag-Based Browsing of Digital Collections with Inverted Indexes and Browsing ...
 
Improved Methods for Accessing Scientific Data for the Masses
Improved Methods for Accessing Scientific Data for the MassesImproved Methods for Accessing Scientific Data for the Masses
Improved Methods for Accessing Scientific Data for the Masses
 
Leverage data analytics to reduce human space mission risks Presentation
Leverage data analytics to reduce human space mission risks PresentationLeverage data analytics to reduce human space mission risks Presentation
Leverage data analytics to reduce human space mission risks Presentation
 
TGS GPS- Russian well database
TGS GPS- Russian well database TGS GPS- Russian well database
TGS GPS- Russian well database
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 

Semelhante a HDF-EOS Overview Part II

LoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internet
LoCloud Geocoding Application, Runar Bergheim, Asplan Viak InternetLoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internet
LoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internetlocloud
 
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...locloud
 
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...The HDF-EOS Tools and Information Center
 
Edward King SPEDDEXES 2014
Edward King SPEDDEXES 2014Edward King SPEDDEXES 2014
Edward King SPEDDEXES 2014aceas13tern
 
iXblue - DELPH geophysical software
iXblue - DELPH geophysical softwareiXblue - DELPH geophysical software
iXblue - DELPH geophysical softwarePhilippe ALAIN
 
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...The HDF-EOS Tools and Information Center
 

Semelhante a HDF-EOS Overview Part II (20)

What is HDF-EOS?
What is HDF-EOS?What is HDF-EOS?
What is HDF-EOS?
 
ESDIS Status (2002)
ESDIS Status (2002)ESDIS Status (2002)
ESDIS Status (2002)
 
Profile of HDF-EOS5 Files
Profile of HDF-EOS5 FilesProfile of HDF-EOS5 Files
Profile of HDF-EOS5 Files
 
LoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internet
LoCloud Geocoding Application, Runar Bergheim, Asplan Viak InternetLoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internet
LoCloud Geocoding Application, Runar Bergheim, Asplan Viak Internet
 
The Landsat 7 Processing System (LPS) Level Zero-R Science Products
 The Landsat 7 Processing System (LPS) Level Zero-R Science Products The Landsat 7 Processing System (LPS) Level Zero-R Science Products
The Landsat 7 Processing System (LPS) Level Zero-R Science Products
 
Geoservices Activities at EDINA
Geoservices Activities at EDINAGeoservices Activities at EDINA
Geoservices Activities at EDINA
 
GIS ANALYTICS-2011
GIS ANALYTICS-2011GIS ANALYTICS-2011
GIS ANALYTICS-2011
 
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
 
HDF5, HDF-EOS and Geospatial Data Archives
HDF5, HDF-EOS and Geospatial Data ArchivesHDF5, HDF-EOS and Geospatial Data Archives
HDF5, HDF-EOS and Geospatial Data Archives
 
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
 
Profile of HDF-EOS5 Files
Profile of HDF-EOS5 FilesProfile of HDF-EOS5 Files
Profile of HDF-EOS5 Files
 
HDF-EOS Development: Current Status and Tools
HDF-EOS Development: Current Status and ToolsHDF-EOS Development: Current Status and Tools
HDF-EOS Development: Current Status and Tools
 
Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
HDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance SupportHDF-EOS Development Status and Maintenance Support
HDF-EOS Development Status and Maintenance Support
 
Edward King SPEDDEXES 2014
Edward King SPEDDEXES 2014Edward King SPEDDEXES 2014
Edward King SPEDDEXES 2014
 
iXblue - DELPH geophysical software
iXblue - DELPH geophysical softwareiXblue - DELPH geophysical software
iXblue - DELPH geophysical software
 
HDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and ToolsHDF-EOS Maintenance, Current Development and Tools
HDF-EOS Maintenance, Current Development and Tools
 
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
Content Framework for Operational Environmental Remote Sensing Data Sets: NPO...
 
The HDF-EOS5 Tutorial
The HDF-EOS5 TutorialThe HDF-EOS5 Tutorial
The HDF-EOS5 Tutorial
 
HDF Explorer
HDF ExplorerHDF Explorer
HDF Explorer
 

Mais de The HDF-EOS Tools and Information Center

STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...The HDF-EOS Tools and Information Center
 

Mais de The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Último

A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 

Último (20)

A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 

HDF-EOS Overview Part II

  • 1. An Overview of HDF-EOS (Part II) Doug Ilg Raytheon STX Doug.Ilg@gsfc.nasa.gov (301) 441-4089 1
  • 2. Outline The Swath Interface What is an HDF-EOS File? 2
  • 4. A Swath Structure Dimension Name: Scan Size: 16 “Temp” “Time” Dimension Name: Track Size: 42 Dimension Name: Geotrack Size: 21 Map1 DataDimension: “Track” Geodimension: “Geotrack” Offset: 1 Increment: 2 4
  • 5. Components of the Swath Interface Access Definition Basic I/O Inquiry Utility Subset 5
  • 6. Tips on Writing a Swath Order of calls is significant: – define dimensions before using them to define fields of maps – setting a compression method affects all subsequently defined fields Unless a dimension map is defined, a 1to-1 mapping is assumed during subsetting. This can produce strange results. 6
  • 7. Swath Subsetting Features By Time – SWdeftimeperiod/SWextractperiod By Geolocation – SWdefboxregion/SWextractregion By “Vertical” field – SWdefvrtregion/SWextractregion Tip: use Time or Geolocation first, then Vertical 7
  • 8. Compression Methods for Swaths Run-Length Encoding Adaptive Huffman Gzip 8
  • 10. Some Answers ECS: An HDF file with ECS metadata Any file with an HDF-EOS object in it A file with only HDF-EOS objects in it 10
  • 11. My Answer You’ve asked the wrong question. The difference between HDF and HDFEOS is at the object level, not the file level. 11
  • 12. Key An HDF file HDF-EOS One or more HDF-EOS data objects with attendant structural metadata ECS Metadata Core and possibly Archive metadata HDF One or more HDF data objects 12
  • 13. HDF •Portability •Elementary data access •Basic self-description HDF-EOS • Geolocation information tightly coupled to data • Fully standardized geographical subsetting • Moderate self-description ECS Metadata • ECS ingest, archiving, search, and distribution • Enhanced self-description 13
  • 14. HDF An HDF file with a set of HDF data objects Services Provided •Portability •Elementary data access •Basic self-description Services Not Provided • Geolocation information tightly coupled to the data • Fully standardized geographical subsetting • ECS ingest, archiving, search, and distribution • Enhanced self-description 14
  • 15. HDF-EOS An HDF file with a set of HDF-EOS data objects Services Provided • Portability • Elementary data access • Moderate self-description • Geolocation information tightly coupled to the data • Fully standardized geographical subsetting Services Not Provided • ECS ingest, archiving, search, and distribution • Enhanced self-description 15
  • 16. Services Provided • Portability • Elementary data access HDF-EOS • Moderate selfdescription • Geolocation information HDF tightly coupled to some of the data • Partially standardized geographical subsetting An HDF file with a mixed Services Not Provided set of HDF-EOS and HDF • ECS ingest, archiving, data objects search, and distribution • Enhanced self-description • Fully standardized geographical subsetting 16
  • 17. HDF ECS Metadata An HDF file with a set of HDF data objects with ECS metadata Services Provided • Portability • Elementary data access • ECS ingest, archiving, search, and distribution • Enhanced self-description Services Not Provided • Geolocation information tightly coupled to the data • Fully standardized geographical subsetting 17
  • 18. HDF-EOS ECS Metadata An HDF file with a set of HDF-EOS data objects with ECS metadata Services Provided • Portability • Elementary data access • Geolocation information tightly coupled to the data • Fully standardized geographical subsetting • ECS ingest, archiving, search, and distribution • Enhanced self-description Services Not Provided • None 18
  • 19. HDF-EOS HDF ECS Metadata An HDF file with a mixed set of HDF and HDF-EOS data objects with ECS metadata Services Provided • Portability • Elementary data access • Geolocation information tightly coupled to some of the data • Partially standardized geographical subsetting • ECS ingest, archiving, search, and distribution • Enhanced self-description Services Not Provided • Fully standardized geographical subsetting 19