Slides from my presentation at Nordichi 2012 on our development of a new type of interface, Tangible 3D Tabletops, which combines tangible tabletops with 3D projection on physical objects.

1. TANGIBLE 3D TABLETOPS:
COMBINING TANGIBLE TABLETOP INTERACTION WITH 3D PROJECTION
Peter Dalsgaard & Kim Halskov
Center for Advanced Visualisation and Interaction (CAVI)
Participatory Information Technology Centre (PIT)
Aarhus University

2. Related work
The setup
AGENDA
Basic principles
Design considerations
Next steps

3. RELATED WORK: TANGIBLE TABLETOPS, E.G. REACTABLE
Bencina, R., Kaltenbrunner, M. and Jordà, S. 2005. Improved Topological Fiducial Tracking in the reacTIVision System

4. RELATED WORK: 3D PROJECTION ON PHYSICAL OBJECTS
Dalsgaard, P. and Halskov, K. 2011. 3D Projection on Physical Objects: Design Insights from Five Real Life Cases

5. Buxton, W. 1997. Living in Augmented Reality: Ubiquitous Media and Reactive
Environments. Video Mediated Communication, K. Finn, A. Sellen and S. Wilber (Eds.).
Erlbaum, Hillsdale, NJ, USA, 363-384.
Merrill, D., Kalanithi, J. and Maes, P. 2007. Siftables: towards sensor network user
interfaces. Proc. of TEI 2007, ACM Press, 75-78.
FURTHER
RELATED WORK Patten, J., Ishii, H., Hines, J. and Pangaro, G. 2001. Sensetable: A wireless object
tracking platform for tangible user interfaces. CHI ‘01: Proc. SIGCHI Conference on
Human Factors in Computing Systems. , 253-260.
Hancock, M. Nacenta, M., Gutwin, C., and Carpendale, S. 2009. The effects of
changing projection geometry on the interpretation of 3D orientation on
tabletops. Proc. Of ITS '09, ACM Press, 157-164.
Marquardt, N., Jota, R., Greenberg, S., and Jorge, J.A. 2011.The Continuous Interaction
Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital
Surface. Proc. Interact 2011, 461-476.
Williams, C., Yang, X. D., Partridge, G., Millar-Usiskin, J., Major, A. and Irani, P. 2011.
TZee: exploiting the lighting properties of multi-touch tabletops for tangible 3d
interactions. Proc. of CHI '11. ACM Press 1363-1372.
Baudisch, P. Becker, T. and Frederik Rudeck. 2010. Lumino: tangible building blocks
based on glass fiber bundles. Proc. of SIGGRAPH '10, ACM Press.
Spindler, M., Martsch, M. & Dachselt, R. 2012. Going beyond the surface: studying
multi-layer interaction above the tabletop. CHI 2012. ACM, New York, NY, USA,
1277-1286.

6. THE SETUP

9. BASIC PRINCIPLES:
COMBINING
TANGIBLES AND
TABLETOP SURFACE
Projection on 3D object Projection on 3D object
that matches surface that stands out from surface
Projection on flat object Projection on flat object
that matches surface that stands out from surface

10. COMBINING 2D AND 3D CONTENT ON TANGIBLES AND TABLETOP

11. TECHNICAL ISSUES
RESOLUTION OCCLUSION LAG

12. 1. How to combine and connect content and functions of
tangibles and tabletop surface
DESIGN
CONSIDERATIONS
2. How to develop dynamic content on tangibles that are
simultaneously displays and input devices
3. How to take advantage of visual effects and the
combination of 2D and 3D on tangibles and tabletop
surface

13. 1. COMBINING AND CONNECTING CONTENT AND FUNCTIONS OF TANGIBLES AND
TABLETOP SURFACE

14. 2. DYNAMIC CONTENT ON TANGIBLES THAT ARE BOTH DISPLAYS AND INPUT DEVICES
3. VISUAL EFFECTS AND THE COMBINATION OF 2D AND 3D ON TANGIBLES AND TABLETOP

15. Finding good use cases in order to learn if and how this
interface is particularly suited for certain situations
NEXT STEPS Higher resolution (table and tangibles) and more projectors
Exploring more complex and dynamic content on tangibles
Exploring more complex and dynamic content on tabletop
Developing a typology of interface components and
principles
Amorphous shapes Augmented tabletop Symbiotic interfaces Augmented tangibles

16. Tangible 3D Tabletops combine 3D projection and tangible
tabletops
SUMMARY:
TANGIBLE 3D TABLETOPS
A new form of interface in which 2D and 3D content can
be combined and connected in various ways
Tangibles can serve as simultaneous input and output
devices
Existing visual effects can be employed in new ways, and
new effects can be developed for this particular medium
We are just beginning to explore the potentials and
challenges of this type of interface

17. QUESTIONS?
TANGIBLE 3D TABLETOPS:
COMBINING TANGIBLE TABLETOP INTERACTION WITH 3D PROJECTION
Peter Dalsgaard (dalsgaard@cavi.dk) & Kim Halskov (halskov@cavi.dk)
Center for Advanced Visualisation and Interaction (CAVI)
Participatory Information Technology Centre (PIT)
Aarhus University