1. Visualizing Digital Collections at
Archive-It
Kalpesh Padia, Yasmin Alnoamany, Michele C. Weigle
Department of Computer Science
Old Dominion University, Norfolk, VA
kpadia@cs.odu.edu
http://ws-dl.blogspot.com/

2. Archive-It
6/11/2012 JCDL 2012 2
http://archive-it.org

3. 11 Collections, 2K+ Sites, 70K+ Mementos
6/11/2012 JCDL 2012 3

4. Data Retrieval & Processing
• Retrieval:
 Screen scrape
 Copy collection hierarchy
 Store page content
• Processing:
 Calculate TF and TF-IDF
 Generate screenshots
 Generate wordles
 Heuristic categorization
 Construct JSON
6/11/2012 JCDL 2012 4

5. Visualizations – Bubble Chart
Title bar
Visualization
Area
Visualization
Options
6/11/2012 JCDL 2012 5

6. Visualizations – Image Plot with Wordle
6/11/2012 JCDL 2012 6

7. Visualizations – Image Plot with Wordle
6/11/2012 JCDL 2012 7

8. Visualizations – Image Plot with Wordle
6/11/2012 JCDL 2012 8

9. Visualizations - Timeline
6/11/2012 JCDL 2012 9

10. Visualizations - Timeline
6/11/2012 JCDL 2012 10

11. Visualizations - Timeline
6/11/2012 JCDL 2012 11

12. Visualizations - Timeline
6/11/2012 JCDL 2012 12

13. Visualizations - Timeline
6/11/2012 JCDL 2012 13

14. No categorization
6/11/2012 JCDL 2012 14
http://www.archive-it.org/collections/2836

15. Improper Categorization
6/11/2012 JCDL 2012 15
http://www.archive-it.org/collections/2323

16. Rule based categorization
News Web Sites
Blogs
Social Media
Videos
6/11/2012 JCDL 2012 16
http://www.archive-it.org/collections/2836

17. Special URI and TLD based categorization
Pakistani news sites
6/11/2012 JCDL 2012 17
http://www.archive-it.org/collections/2836

18. Comparison
Pakistan Floods Collection Pakistan Floods Collection after
without categorization categorization
6/11/2012 JCDL 2012 18

19. Future Work
• Detailed user evaluation
• Generic system for any digital archive
• Visualization of mementos
6/11/2012 JCDL 2012 19

20. Conclusion
• Novel visual interface
• Bubble chart
6/11/2012 JCDL 2012 20

21. Conclusion
• Novel visual interface
• Bubble chart
• Image plot
6/11/2012 JCDL 2012 21

22. Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
6/11/2012 JCDL 2012 22

23. Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
• Timeline
6/11/2012 JCDL 2012 23

24. Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
• Timeline
• Heuristic categorization
6/11/2012 JCDL 2012 24

25. Extra Info
6/11/2012 JCDL 2012 25

26. Digital Archives
http://lcweb2.loc.gov/diglib/lcwa/html/visual/visual-browse.html
http://www.webarchive.org.uk/ukwa/collection/4325386/page/1
6/11/2012 JCDL 2012 26

27. Visualizing Archives
http://www.webarchive.org.uk/ukwa/wall/Blogs
6/11/2012 JCDL 2012 27

28. Browsing Archive-IT collections
http://www.archive-it.org/collections/1068
6/11/2012 JCDL 2012 28

29. Time Span
Small 1 Day - 2 Weeks
Time span Medium 2 Weeks - 4 Months
Large > 4 Months
http://wayback.archive-it.org/1068/*/http://amigosdemujeres.org/
6/11/2012 JCDL 2012 29

30. Groups
Small 1
Groups Medium 2-5
Large >5
http://www.archive-it.org/collections/1068
6/11/2012 JCDL 2012 30

31. URI Domains
Small 1 - 10
URI Domains Medium 11 - 20
Large > 20
http://www.archive-it.org/collections/2836
6/11/2012 JCDL 2012 31

32. Sites & Source Types
Small 1 - 10
Sites Medium 11 - 99
Large > 99
Small 1
Source Types Medium 2-5
Large >5
http://www.archive-it.org/collections/2836
6/11/2012 JCDL 2012 32