Unraveling Multimodality with Large Language Models.pdf
Interactive Paper @ ETH Zurich
1. Interactive Paper @ ETH Zurich
Moira C. Norrie, Beat Signer, Adriana Ispas, Nadir Weibel
Global Information Systems Lab
Department of Computer Science
ETH Zurich
http://vub.academia.edu/BeatSigner
29 November 2007
2. Paper in Everyday Settings
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 2
3. Digital Pen and Paper
Developed by Anoto
Different pen manufacturers
Logitech, Maxel, Nokia, ...
Pattern space
60 million km2
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 3
4. Interactive Paper
Linking active areas to resources
image
video clip
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 4
5. iPaper @ ETH Zurich
Tools
Cross-Media
Link Infrastructure
Applications
Publishing
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 5
7. EdFest Demo
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 7
8. EdFest Architecture Overview
Context XCM
content publishing
Engine platform
Context DB Metadata DB Appln DB
Text-to-Speech
Engine Client
ICR Software
Controller handwriting
recognition
iServer/iPaper Active
iPaper Client
cross-media Components
link server
Link DB
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 8
9. Content Publishing Framework
iServer / iPaper
cross-media link server
XCM XML link
iPublish
definition
content publishing publishing framework
data
• paper link data
publish • active areas
Structure Style • layers
• digital resources
• user model
import PDF
XML data of XSL CSS
festival venues
and events
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 9
10. Design of Interactive Paper Documents
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 10
11. Rough Guide
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 11
12. PaperWeb Print-n-Link
The Myth of the
Paperless Office,
written by A. J.
Sellen and
R. Harper,
November 2001
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 12
14. Concluding Remarks
Digital Pen and Paper technology is here
several commercial products and applications
mainly used for data capture from forms
Interactive Paper is on the way
beginnings of commercial solutions
potential shown in research settings
general platforms and tools emerging
Future challenges
business models and solutions
29 November 2007 Moira C. Norrie and Beat Signer / Institute for Information Systems 14