SlideShare a Scribd company logo
1 of 23
TP3/ACE measurementandperfSONAR update John Hicks International Networking Indiana University jhicks@iu.edu
Overview ,[object Object]
ARK project
Network ServicesDLT & High Performance storage/transfer hosts ,[object Object]
ACE update,[object Object]
Perfsonar Here is a suggested list of baseline data that networks should make available: Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput)
Traceroute SNMP (Utilization, Errors) Link-Status (Up/Down, AdminUp, AdminDown) Circuit-Status (Logical mapping of multi-domain)
PerfSonar Here is a recommended list of tools to have available in an on-demand diagnostic sense: Reverse-Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput) Reverse-Traceroute The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.
Dynamic Circuits Internet2 is engaged in standardization effort within the Open Grid Forum (OGF) NSI WG (signal circuit creation) NML WG (topology support of circuits and monitoring) NMC WG (performance middleware) NM WG (measurement definition) Internet2 is engaged in GLIF experimental networks perfSONAR Demos Automated GOLE Demos
IRIS & DYGir Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners. Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011 Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps Three NSF awards of interest (total $3.5 million) IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million) DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k) DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual
IRIS Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links IRIS will provide a software framework to enable performance monitoring services on IRNC links Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators Develop new functionality specific to international exchange points Work with the IRNC link awardees to help them deploy the software
DyGir Objective: enable researchers to reserve dedicated bandwidth over IRNC links  Allow for more distributed collaboration DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite Prototype new functionality specific to international exchange points Work with 2+ of the IRNC link awardees to help them deploy the prototype software
Archipelago (Ark)  CAIDA’s measurement infrastructure Built on decade of achievements, from SIGCOMM to MOMA  Launch 12 Sept 2007 54 active IPv4 probers 18 in US 16 active IPv6 probers collaborators can run vetted measurements on security-hardened platform publish analyses of views from individual monitors support for meta-data mgt, analysis, and infoviz
summary of the expected traffic  Outgoing:  ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication) ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor) no ICMP rate limiting UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor) TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection) Incoming:  NTP and DNS responses ssh (22/tcp) from only CAIDA's /24 prefix ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host no ICMP rate limiting TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)
Active Measurements ,[object Object]
IPv6 Topology
DNS Names & Query/Response Traffic
Alias Resolution
All measurements are active probes with low rate of probing.,[object Object]
Other Links IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks http://www.caida.org/funding/irnc/ Archipelago (Ark) network measurement platformhttp://www.caida.org/projects/ark/ Archipelago Monitor Statisticshttp://www.caida.org/projects/ark/statistics/ Please send questions and comments to ark-info@caida.org.
Network Services TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe. We want to do more: Develop documentation to increase the ease of use Dedicated infrastructure for data movement Install HP data movers in PoP’s Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services
Data Logistics Toolkit (DLT) The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area.  A key DLT service is implementing a global “drop box” that supports automatic data postitioning.  This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast.  The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration.
Dlt (Cont.) The DLT is comprised of various software systems:  IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network.   This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet).  REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC).  The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally. perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network.  The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective. Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users.  Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN. UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits.  It is a key part of the DLT’s discovery and coordination service.
Dlt (Cont.) The DLT will be implemented on TransPAC3. Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo.  This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region. Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place.

More Related Content

What's hot

Building a Regional 100G Collaboration Infrastructure
Building a Regional 100G Collaboration InfrastructureBuilding a Regional 100G Collaboration Infrastructure
Building a Regional 100G Collaboration InfrastructureLarry Smarr
 
A brief history of streaming video in the Internet
A brief history of streaming video in the InternetA brief history of streaming video in the Internet
A brief history of streaming video in the InternetStenio Fernandes
 
Lambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingLambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingTal Lavian Ph.D.
 
The ECP Exascale Computing Project
The ECP Exascale Computing ProjectThe ECP Exascale Computing Project
The ECP Exascale Computing Projectinside-BigData.com
 
CARLETON_SrSysEng08.11.2015
CARLETON_SrSysEng08.11.2015CARLETON_SrSysEng08.11.2015
CARLETON_SrSysEng08.11.2015Rich Carleton
 
Exascale Computing Project Update
Exascale Computing Project UpdateExascale Computing Project Update
Exascale Computing Project Updateinside-BigData.com
 
Curriculum Vitae
Curriculum VitaeCurriculum Vitae
Curriculum Vitaebutest
 
Datacom module 2: Data Communication Architecture, Protocols, and Standards
Datacom module 2:  Data Communication Architecture, Protocols, and StandardsDatacom module 2:  Data Communication Architecture, Protocols, and Standards
Datacom module 2: Data Communication Architecture, Protocols, and StandardsJeffrey Des Binwag
 
Grid optical network service architecture for data intensive applications
Grid optical network service architecture for data intensive applicationsGrid optical network service architecture for data intensive applications
Grid optical network service architecture for data intensive applicationsTal Lavian Ph.D.
 
Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd Iaetsd
 
IRJET- Internet Video Streaming Service for Social Network
IRJET- Internet Video Streaming Service for Social NetworkIRJET- Internet Video Streaming Service for Social Network
IRJET- Internet Video Streaming Service for Social NetworkIRJET Journal
 
Analysis and overview of Flooding Attack in Optimized link State Routing prot...
Analysis and overview of Flooding Attack in Optimized link State Routing prot...Analysis and overview of Flooding Attack in Optimized link State Routing prot...
Analysis and overview of Flooding Attack in Optimized link State Routing prot...IJESM JOURNAL
 
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1Tal Lavian Ph.D.
 
An extensible, programmable, commercial-grade platform for internet service a...
An extensible, programmable, commercial-grade platform for internet service a...An extensible, programmable, commercial-grade platform for internet service a...
An extensible, programmable, commercial-grade platform for internet service a...Tal Lavian Ph.D.
 
Moolle fan-out control for scalable distributed data stores
Moolle  fan-out control for scalable distributed data storesMoolle  fan-out control for scalable distributed data stores
Moolle fan-out control for scalable distributed data storesSungJu Cho
 

What's hot (19)

[.ppt]
[.ppt][.ppt]
[.ppt]
 
Building a Regional 100G Collaboration Infrastructure
Building a Regional 100G Collaboration InfrastructureBuilding a Regional 100G Collaboration Infrastructure
Building a Regional 100G Collaboration Infrastructure
 
A brief history of streaming video in the Internet
A brief history of streaming video in the InternetA brief history of streaming video in the Internet
A brief history of streaming video in the Internet
 
Lambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computingLambda data grid: communications architecture in support of grid computing
Lambda data grid: communications architecture in support of grid computing
 
The ECP Exascale Computing Project
The ECP Exascale Computing ProjectThe ECP Exascale Computing Project
The ECP Exascale Computing Project
 
CARLETON_SrSysEng08.11.2015
CARLETON_SrSysEng08.11.2015CARLETON_SrSysEng08.11.2015
CARLETON_SrSysEng08.11.2015
 
Exascale Computing Project Update
Exascale Computing Project UpdateExascale Computing Project Update
Exascale Computing Project Update
 
Curriculum Vitae
Curriculum VitaeCurriculum Vitae
Curriculum Vitae
 
Datacom module 2: Data Communication Architecture, Protocols, and Standards
Datacom module 2:  Data Communication Architecture, Protocols, and StandardsDatacom module 2:  Data Communication Architecture, Protocols, and Standards
Datacom module 2: Data Communication Architecture, Protocols, and Standards
 
Grid optical network service architecture for data intensive applications
Grid optical network service architecture for data intensive applicationsGrid optical network service architecture for data intensive applications
Grid optical network service architecture for data intensive applications
 
Curtis Resume
Curtis ResumeCurtis Resume
Curtis Resume
 
Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)Iaetsd survey on big data analytics for sdn (software defined networks)
Iaetsd survey on big data analytics for sdn (software defined networks)
 
DeStephen Derek RESUME
DeStephen Derek RESUMEDeStephen Derek RESUME
DeStephen Derek RESUME
 
DeStephen Derek Resume
DeStephen Derek ResumeDeStephen Derek Resume
DeStephen Derek Resume
 
IRJET- Internet Video Streaming Service for Social Network
IRJET- Internet Video Streaming Service for Social NetworkIRJET- Internet Video Streaming Service for Social Network
IRJET- Internet Video Streaming Service for Social Network
 
Analysis and overview of Flooding Attack in Optimized link State Routing prot...
Analysis and overview of Flooding Attack in Optimized link State Routing prot...Analysis and overview of Flooding Attack in Optimized link State Routing prot...
Analysis and overview of Flooding Attack in Optimized link State Routing prot...
 
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1
Optical Network Infrastructure for Grid, Draft-ggf-ghpn-opticalnets-1
 
An extensible, programmable, commercial-grade platform for internet service a...
An extensible, programmable, commercial-grade platform for internet service a...An extensible, programmable, commercial-grade platform for internet service a...
An extensible, programmable, commercial-grade platform for internet service a...
 
Moolle fan-out control for scalable distributed data stores
Moolle  fan-out control for scalable distributed data storesMoolle  fan-out control for scalable distributed data stores
Moolle fan-out control for scalable distributed data stores
 

Similar to TransPAC3/ACE Measurement & PerfSONAR Update

OptIPuter Overview
OptIPuter OverviewOptIPuter Overview
OptIPuter OverviewLarry Smarr
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
 
Enhancing Network Visibility Based On Open Converged Network Appliance
Enhancing Network Visibility Based On Open Converged Network ApplianceEnhancing Network Visibility Based On Open Converged Network Appliance
Enhancing Network Visibility Based On Open Converged Network ApplianceOpen Networking Summit
 
Software defined network
Software defined networkSoftware defined network
Software defined networkBogamoga1
 
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...Danny Alex Lachos Perez
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research PlatformLarry Smarr
 
The OptIPuter as a Prototype for CalREN-XD
The OptIPuter as a Prototype for CalREN-XDThe OptIPuter as a Prototype for CalREN-XD
The OptIPuter as a Prototype for CalREN-XDLarry Smarr
 
For your final step, you will synthesize the previous steps and la
For your final step, you will synthesize the previous steps and laFor your final step, you will synthesize the previous steps and la
For your final step, you will synthesize the previous steps and laShainaBoling829
 
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARK
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARKANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARK
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARKIJNSA Journal
 
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...PROIDEA
 
TechWiseTV Workshop: Segment Routing for the Datacenter
TechWiseTV Workshop: Segment Routing for the DatacenterTechWiseTV Workshop: Segment Routing for the Datacenter
TechWiseTV Workshop: Segment Routing for the DatacenterRobb Boyd
 
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale NetworkThe Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale NetworkOpen Networking Summits
 
Dynamic classification in silicon-based forwarding engine environments
Dynamic classification in silicon-based forwarding engine environmentsDynamic classification in silicon-based forwarding engine environments
Dynamic classification in silicon-based forwarding engine environmentsTal Lavian Ph.D.
 
5G-USA-Telemetry
5G-USA-Telemetry5G-USA-Telemetry
5G-USA-Telemetrysnrism
 
A Scenario-Based Review Of IPv6 Transition Tools
A Scenario-Based Review Of IPv6 Transition ToolsA Scenario-Based Review Of IPv6 Transition Tools
A Scenario-Based Review Of IPv6 Transition ToolsTye Rausch
 

Similar to TransPAC3/ACE Measurement & PerfSONAR Update (20)

OptIPuter Overview
OptIPuter OverviewOptIPuter Overview
OptIPuter Overview
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
 
Enhancing Network Visibility Based On Open Converged Network Appliance
Enhancing Network Visibility Based On Open Converged Network ApplianceEnhancing Network Visibility Based On Open Converged Network Appliance
Enhancing Network Visibility Based On Open Converged Network Appliance
 
Software defined network
Software defined networkSoftware defined network
Software defined network
 
Introduction to ns3
Introduction to ns3Introduction to ns3
Introduction to ns3
 
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...
Delivering Application-Layer​ Traffic Optimization​ (ALTO) Services based on ...
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research Platform
 
The OptIPuter as a Prototype for CalREN-XD
The OptIPuter as a Prototype for CalREN-XDThe OptIPuter as a Prototype for CalREN-XD
The OptIPuter as a Prototype for CalREN-XD
 
Networking revolution
Networking revolutionNetworking revolution
Networking revolution
 
For your final step, you will synthesize the previous steps and la
For your final step, you will synthesize the previous steps and laFor your final step, you will synthesize the previous steps and la
For your final step, you will synthesize the previous steps and la
 
SDN approach.pptx
SDN approach.pptxSDN approach.pptx
SDN approach.pptx
 
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARK
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARKANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARK
ANALYZING NETWORK PERFORMANCE PARAMETERS USING WIRESHARK
 
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
PLNOG 17 - Nicolai van der Smagt - Building and connecting the eBay Classifie...
 
TechWiseTV Workshop: Segment Routing for the Datacenter
TechWiseTV Workshop: Segment Routing for the DatacenterTechWiseTV Workshop: Segment Routing for the Datacenter
TechWiseTV Workshop: Segment Routing for the Datacenter
 
Arun project-Final
Arun project-FinalArun project-Final
Arun project-Final
 
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale NetworkThe Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
 
Sigcomm16 sdn-nvf-topics-preview
Sigcomm16 sdn-nvf-topics-previewSigcomm16 sdn-nvf-topics-preview
Sigcomm16 sdn-nvf-topics-preview
 
Dynamic classification in silicon-based forwarding engine environments
Dynamic classification in silicon-based forwarding engine environmentsDynamic classification in silicon-based forwarding engine environments
Dynamic classification in silicon-based forwarding engine environments
 
5G-USA-Telemetry
5G-USA-Telemetry5G-USA-Telemetry
5G-USA-Telemetry
 
A Scenario-Based Review Of IPv6 Transition Tools
A Scenario-Based Review Of IPv6 Transition ToolsA Scenario-Based Review Of IPv6 Transition Tools
A Scenario-Based Review Of IPv6 Transition Tools
 

More from International Networking at Indiana University

More from International Networking at Indiana University (17)

ACE: Opportunities For African Connectivity To The USA
ACE: Opportunities For African Connectivity To The USAACE: Opportunities For African Connectivity To The USA
ACE: Opportunities For African Connectivity To The USA
 
IN@IU - Who We Are & Where We're At
IN@IU - Who We Are & Where We're AtIN@IU - Who We Are & Where We're At
IN@IU - Who We Are & Where We're At
 
Pakistan Network Connectivity via ACE-TP3
Pakistan Network Connectivity via ACE-TP3Pakistan Network Connectivity via ACE-TP3
Pakistan Network Connectivity via ACE-TP3
 
TransPAC3 2010 NSF Annual Report
TransPAC3 2010 NSF Annual ReportTransPAC3 2010 NSF Annual Report
TransPAC3 2010 NSF Annual Report
 
ACE and TransPAC3 - Cooperative Partnerships to facilitate Global R/E Collabo...
ACE and TransPAC3 - Cooperative Partnerships to facilitate Global R/E Collabo...ACE and TransPAC3 - Cooperative Partnerships to facilitate Global R/E Collabo...
ACE and TransPAC3 - Cooperative Partnerships to facilitate Global R/E Collabo...
 
Catalysing inter-regional network-enabled collaboration through workshopping ...
Catalysing inter-regional network-enabled collaboration through workshopping ...Catalysing inter-regional network-enabled collaboration through workshopping ...
Catalysing inter-regional network-enabled collaboration through workshopping ...
 
Ace+tp3 smm sa sig
Ace+tp3 smm sa sigAce+tp3 smm sa sig
Ace+tp3 smm sa sig
 
TransPAC2 Workplan - IRNC Final Review
TransPAC2 Workplan - IRNC Final ReviewTransPAC2 Workplan - IRNC Final Review
TransPAC2 Workplan - IRNC Final Review
 
Us india workshop workshop program v 7.1
Us india workshop workshop program v 7.1Us india workshop workshop program v 7.1
Us india workshop workshop program v 7.1
 
US-India Workshop Report
US-India Workshop ReportUS-India Workshop Report
US-India Workshop Report
 
Tein3 safs talk
Tein3 safs talkTein3 safs talk
Tein3 safs talk
 
Research and Education Connectivity to Pakistan
Research and Education Connectivity to PakistanResearch and Education Connectivity to Pakistan
Research and Education Connectivity to Pakistan
 
Dedicated R&E Network Connects Pakistan And The US
Dedicated R&E Network Connects Pakistan And The USDedicated R&E Network Connects Pakistan And The US
Dedicated R&E Network Connects Pakistan And The US
 
International Networking @ Indiana University
International Networking @ Indiana UniversityInternational Networking @ Indiana University
International Networking @ Indiana University
 
Jet - ACE & TransPAC3
Jet - ACE & TransPAC3Jet - ACE & TransPAC3
Jet - ACE & TransPAC3
 
BP Talk - IN@IU
BP Talk - IN@IUBP Talk - IN@IU
BP Talk - IN@IU
 
GLIF Geneva - ACE & TransPAC3
GLIF Geneva - ACE & TransPAC3GLIF Geneva - ACE & TransPAC3
GLIF Geneva - ACE & TransPAC3
 

Recently uploaded

SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 

Recently uploaded (20)

SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 

TransPAC3/ACE Measurement & PerfSONAR Update

  • 1. TP3/ACE measurementandperfSONAR update John Hicks International Networking Indiana University jhicks@iu.edu
  • 2.
  • 4.
  • 5.
  • 6. Perfsonar Here is a suggested list of baseline data that networks should make available: Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput)
Traceroute SNMP (Utilization, Errors) Link-Status (Up/Down, AdminUp, AdminDown) Circuit-Status (Logical mapping of multi-domain)
  • 7. PerfSonar Here is a recommended list of tools to have available in an on-demand diagnostic sense: Reverse-Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput) Reverse-Traceroute The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.
  • 8. Dynamic Circuits Internet2 is engaged in standardization effort within the Open Grid Forum (OGF) NSI WG (signal circuit creation) NML WG (topology support of circuits and monitoring) NMC WG (performance middleware) NM WG (measurement definition) Internet2 is engaged in GLIF experimental networks perfSONAR Demos Automated GOLE Demos
  • 9. IRIS & DYGir Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners. Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011 Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps Three NSF awards of interest (total $3.5 million) IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million) DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k) DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual
  • 10. IRIS Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links IRIS will provide a software framework to enable performance monitoring services on IRNC links Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators Develop new functionality specific to international exchange points Work with the IRNC link awardees to help them deploy the software
  • 11. DyGir Objective: enable researchers to reserve dedicated bandwidth over IRNC links Allow for more distributed collaboration DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite Prototype new functionality specific to international exchange points Work with 2+ of the IRNC link awardees to help them deploy the prototype software
  • 12. Archipelago (Ark) CAIDA’s measurement infrastructure Built on decade of achievements, from SIGCOMM to MOMA Launch 12 Sept 2007 54 active IPv4 probers 18 in US 16 active IPv6 probers collaborators can run vetted measurements on security-hardened platform publish analyses of views from individual monitors support for meta-data mgt, analysis, and infoviz
  • 13. summary of the expected traffic Outgoing: ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication) ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor) no ICMP rate limiting UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor) TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection) Incoming: NTP and DNS responses ssh (22/tcp) from only CAIDA's /24 prefix ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host no ICMP rate limiting TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)
  • 14.
  • 16. DNS Names & Query/Response Traffic
  • 18.
  • 19. Other Links IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks http://www.caida.org/funding/irnc/ Archipelago (Ark) network measurement platformhttp://www.caida.org/projects/ark/ Archipelago Monitor Statisticshttp://www.caida.org/projects/ark/statistics/ Please send questions and comments to ark-info@caida.org.
  • 20. Network Services TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe. We want to do more: Develop documentation to increase the ease of use Dedicated infrastructure for data movement Install HP data movers in PoP’s Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services
  • 21. Data Logistics Toolkit (DLT) The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area. A key DLT service is implementing a global “drop box” that supports automatic data postitioning. This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration.
  • 22. Dlt (Cont.) The DLT is comprised of various software systems:  IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network. This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet). REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC). The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally. perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network. The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective. Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users. Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN. UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits. It is a key part of the DLT’s discovery and coordination service.
  • 23. Dlt (Cont.) The DLT will be implemented on TransPAC3. Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo. This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region. Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place.
  • 26. TransPAC3 (TP3) update TP3 will look similar to TP2 Install MX480 Upgrade existing (1 & 10 Gig) hosts Install more 10G host in cooperation with KDDI Install DLT resources Continue support of perfSONAR & Dynamic Circuit services
  • 27. TransPAC3 (TP3) update ACE will provide new R&E connectivity between the US & Europe Install (1 & 10 Gig) hosts Install DLT resources Continue support of perfSONAR & Dynamic Circuit service Work with the DICE group to integrate authentication & authorization (AA) services Modular approach with OSCARS 0.6 (Target Q2,2011) Work with the DICE group to design a system compatible with the ESnet Science Data Network, the Internet2 ION Service, and GÉANT’s Autobahn virtual circuit services
  • 28. Questions John Hicks Indiana University jhicks@iu.edu