1. Networked Performing Arts
Behind
the Curtain
Ben Fineman, Internet2

2. Photo by: R.A. Whiteside
Sight and Sound

3. Capturing Sight and Sound

4. Transmitting
Sight and
Sound

5. Two-way
Transmission

6. Two-way
Transmission:
Advanced
Networks

9. Capture

10. Capture Encode

13. Balancing Act

14. Balancing Act

15. Balancing Act: Quality

16. Balancing Act: Audio
Quality
How
How Often
Accurat
e
How
Much
• How Often: Sampling Rate

17. Balancing Act: Sampling
Rate
§ Limits frequency range
§ CD quality is 44.1 kHz

18. Balancing Act: Audio
Quality
How
How Often
Accurat
e
How
Much
• How Accurate: Bit Depth

19. Balancing Act: Audio
Quality
§ Limits quality
§ CD quality 16 bit = 65,536 levels
§ Studio quality 24 bit = 16,777,216
levels

20. Balancing Act: Audio
Quality
How
How Often
Accurat
e
How
Much
• How Much: Bit Rate

21. 44.1 kHz x 16 bit x 2 channels
= 1.41 Mbps

22. Balancing Act: Audio
Quality
• “Compression” – making digital signals
smaller

23. Balancing Act: Bit Rate
• Distinct from bit depth
• Many compression formats available
§ Lossy/lossless
§ Popular example: MP3
§ Popular consumer conferencing: Siren
14/22

24. Balancing Act: Audio
Quality

25. Balancing Act: Video
Quality
How
How Often
Accurat
e
How
Much
• How Often: Frame Rate

26. Balancing Act: Frame Rate
§ 60i: Standard for consumer
broadcast/DVD/VHS, some HDTV
• Actually 59.94i, or 29.97 fps
§ 24p: Standard for film
§ 30p/60p: Some HDTV
§ Be aware of international differences!

27. Balancing Act: Video
Quality
How
How Often
Accurat
e
How
Much
• How Accurate: Resolution

28. Resolution: How Accurate

29. Balancing Act: Video
Quality
How
How Often
Accurat
e
How
Much
• How Much: Bit Rate

30. Balancing Act: Video
Quality

31. Balancing Act: Video
Quality
• Various compression formats available
§ MPEG-1, MPEG-2 (eg VCD, DVD)
§ MPEG-4 Part 2, MPEG-4 AVC/SVC
§ Microsoft: WMV, VC-1
§ H.263, H.264 (MPEG-4 AVC)
§ DV25

32. Balancing Act: Video
Quality

33. Balancing Act

34. Balancing Act:
Performance

35. Balancing Act:
Performance
Latenc
y
• How Fast
§ Network latency
§ Codec Latency

36. Balancing Act:
Performance
Latenc
y

37. Balancing Act

38. Balancing Act:
Performance
• How Much (bit rate)

39. Balancing Act: Bandwidth
12
10
8
6
4
2
0

40. Balancing Act: Bandwidth
12
10
8
6
4
2
0

41. Capture Encode
DV camera DV camera
with audio inputs

42. Canopus ADVC-300
Encode
Canopus ADVC-700

43. Software
Encode
Send

44. Poor
Encode Send OK
Great

45. OK
Poor
Encode Send
Great

46. VBrick
Great
Encode Send
Poor
Digital River
OK
TandbergTV

47. MPEG2
• Latency: Broadcast only (in general)
• Quality:
§ Audio: Compressed
§ Video: Compressed
• Bandwidth: 6 - 25 Mbps

48. OK
Encode Send OK Polycom
OK
Tandberg
Lifesize

49. Encode Send

50. UltraGrid/iHDTV
LOLA

51. DVTS: What is it?
• “Open source” software developed by
the WIDE Project (ie it’s free!)
• Sends firewire source over Internet
with no additional compression

52. DVTS: Vital Stats
• Latency: Good enough for
conversation
• Quality:
§ Audio: 48kHz/16 bit uncompressed
§ Video: Standard definition, DV25
compression
• Bandwidth: 30 Mbps

53. DVTS: What do I need?
• Capture: DV or standard camera
• Encode: In DV camera, or separate
encoder
• Send: Computer running DVTS
• Transport: 30Mbps network
+ +

54. Great
OK
OK

55. ConferenceXP
• Latency: Good enough for
conversation
• Quality:
§ Audio: Up to uncompressed
§ Video: Up to uncompressed
• Bandwidth: Variable, 1Mb to >30Mb

56. ConferenceXP
Great
OK
Great

57. LOLA
• Latency: Good enough for
simultaneous performance
• Quality:
§ Audio: 44.1kHz, 24bit, uncompressed
§ Video: Up to uncompressed (SD)
• Bandwidth: 92Mbps to 460Mbps

58. LOLA
Great
Great
Poor

59. iHDTV/Ultragrid
• Latency: Good enough for
conversation
• Quality:
§ Audio: 48kHz/16 bit uncompressed, 2+
channels
§ Video: 1080i HD, compressed or
uncompressed
• Bandwidth: 250 Mbps to 1.5 Gbps

60. iHDTV/Ultragrid
Great
OK
Poor

61. Balancing Act
•
H.323 Videoconferencing
•
Desktop Videoconferencing (eg
Skype)

62. Balancing Act
•
Many kinds of MPEG-2 and
MPEG-4
•
Lossless compressions
•
HDDVTS

63. Balancing Act
•
Uncompressed codecs
•
DVTS

64. Tanspor
Capture Encode Send
t

65. • Appropriate Bandwidth
Tanspor
t • Low or 0% loss
• Low or no jitter
• Multicast (if
broadcasting)

66. Multicast
Unicast

67. Tanspor
Capture Encode Send Receive Decode
t

68. Receive Decode

69. Software
Receive Decode

70. Tanspor
Capture Encode Send Receive Decode Display
t

71. Display

72. Echo
Display

73. Display Polycom
Tandberg
} AEC
Lifesize

74. Display
Polycom
Music Mode

75. Display
EchoDamp

76. Codec
RME Fireface 800
EchoDamp

77. Examples

78. New World Symphony: DVTS

79. Remote Master Classes: DVTS

80. DVTS: Example

81. DVTS: Example

82. DVTS: Example

83. Philadelphia Orchestra: MPEG2

84. MPEG2 Multicast
HD-DVTS
Amino
TandbergTV
Amino
Amino

85. Kinetic Shadows: MPEG2

86. MPEG2 Example
VBrick
VBrick

87. Screen
Screen Screen
Display
Stage (Top down)

88. Strategic Camera Position
}
Capture
Immersion
Strategic Display Position Display

89. Adding Machine: DVTS

90. Screen
Screen Screen
Stage (Top down)

91. Screen
Screen Screen
Stage (Top down)

92. Arthron

94. Conference XP: Remote Instruction

95. ConferenceXP: Example

96. ConferenceXP: Example

97. Simultaneous Performance

98. Bitflow ALT-PCE-AN1
Industrial Camera
RME Fireface 800

99. Emerging Applications:
iHDTV
• ResearchChannel along with the
University of Washington
iHDTV/Ultragrid

100. 1Gbps Ethernet 1Gbps Ethernet
Blackmagic Decklink
Aja Xena HS
1Gbps Ethernet 1Gbps Ethernet

101. 2000 -> 2010

102. Uncompressed HD
Simultaneous
Remote Performance
Real-time Screen
Mapping

103. Emerging Applications:
CineGrid 4k
4k
1080

104. 12
10
8
6
4
2
0

105. CineGrid 4k

106. bfineman@internet2.edu
www.internet2.edu

107. • References
§ DTVS:
http://www.internet2.edu/communities/dvts/
§ WIDE Project: http://www.sfc.wide.ad.jp/
§ New World Symphony:
http://www.nws.edu/internet2/
§ iHDTV: http://www.washington.edu/ihdtv/
§ Ultragrid:
http://dragon.maxgigapop.net/twiki/bin/view/DRAGON/
UltraGrid
§ EchoDamp: http://echodamp.com/

108. • References