Three prototypes (three w.i.p.) that try to explore the ways in which an AR mobile application can interact with a work of art having in mind the public, the researchers and the restorers: 1) A study on how augmented reality can help the comprehension off the geometric construction of the perspective in the holy Trinity fresco in the church of Santa Maria Novella in Florence Italy 2) A study about of augmented reality and the visualization of another series of frescos in the same church in Florence and the exceptional chapter house that contain them. 3) And the study about multispectral photography and AR on paintings and in the future for three-dimensional works of art.

1. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
AR for Cultural Heritage
Giovanni Landi @AWE2014

2. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Three works in progress will be shown that explore the possible
interactions between an AR mobile application and a work of art, using
different datasets provided by researchers from different fields:
•The HolyTrinity fresco (Masaccio, 1426) and the studies of Prof. M.T.
Bartoli about linear perspective in the early renaissence.
•The S.Maria Novella Chapter House (frescos by Andrea di Bonaiuto,
1355) and its Phase Shift 3d Laser Scan by Arch. Carlo Battini.
• Panoramic Multispectral Imaging of Early 1900 Sicilian Devotional Art by
Dr. Antonio Cosentino.

3. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
The HolyTrinity
•Church of Santa Maria Novella, Florence, Italy
•317cm (125in) wide and 667cm(263in) high.
•Painted by Masaccio in 1426 at the age of 25 in 26 days
•First real example of geometrically correct Linear
Perspective

4. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it

5. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it

6. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
ATRIANGLE IN A SQUARE
Frontal perspective view of a cube with a side of d,
the point of view O at a distance of 1.5 times d,
the horizon on the support plane of the cube.
The image of the upper face of the cube stays between the sides of the triangle.
The rear edge of the cube lies at 2/5 of the height of the isosceles triangle.
The viewing angle is 68°.
Image courtesy of M.T.Bartoli

7. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of M.T.Bartoli
ATRIANGLE IN A SQUARE
Frontal perspective view of a cube with a side of d,
the point of view O at a distance of 1.5 times d,
the horizon on the support plane of the cube.
The image of the upper face of the cube stays between the sides of the triangle.
The rear edge of the cube lies at 2/5 of the height of the isosceles triangle.
The viewing angle is 68°.

8. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of M.T.Bartoli

9. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
AR Application based on Unity and Vuforia
3D section:
Users can explore a 3d complete reconstruction of HolyTrinity
Perspective construction section:
Users can follow step by step the geometric construction of the
fresco’s perspective through intuitive outline animations showing the
relations between 2d and 3d.
In both sections the users is notified when he is staying in the exact
position Masaccio chose as the point of view of his poerspective.

10. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it

11. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Video

12. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Future developments:
Other superimposed contents about the fresco’s
realization: explanation of the used fresco
techniques and reconstruction of the fast paced 28
days sequence the artist followed to complete the
fresco.

13. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
The former chapterhouse, now the "Spanish Chapel"
(or Cappellone degli Spagnoli)
•Church of Santa Maria Novella, Florence, Italy
•Construction started c. 1343 and was finished in 1355
•Decorated from 1365 to 1367 by Andrea di Bonaiuto

14. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of C.Battini

15. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of C.Battini

16. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
The chapterhouse 3d scanned by Arch.Carlo Battini using a Zoller-Fröhlich
3DImager 5006i phase shift LARA spot Laser Scanner.
Image courtesy of C.Battini

17. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
A 3d mesh was
obtained from the
pointcloud using the
Cyclone software

18. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
AR Application based on Unity and Vuforia
AR section:
Users can explore the 3d reconstruction of the Chapterhouse and its
frescos from a perspective that make them extremely readable.
This section was intended for printed material.
360° section:
Users can explore the frescos in an immersive 360° user experience
and “project” himself near to the walls to better examine the details of
them.

19. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of Darts Engineering

20. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
DEMO

21. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Future developments
For the existing sections:
•High definition Imagery
• 3d Animations showing the geometrical construction
of the vault
New section for on site usage:
•Tracking of the original frescos
•Superimposed outlines of the fresco’s most important
features
•
Images courtesy of C.Battini

22. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Early 1900 Sicilian Devotional Art

23. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Panoramic Multispectral Imaging is a valid
alternative to more costly equipment for high
resolution imaging.
•Implementable with consumer panoramic
imaging tools
•Resolutions up to 25 pixel/mm
•The stitching software is easy to use
•No specialized personnel or intensive training
requred
Image courtesy of A.Cosentino

24. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of A.Cosentino

25. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Image courtesy of A.Cosentino

26. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
AR Application based on Unity and Vuforia
Users can choose what layer of the multispectral dataset they want to
explore, and use their fingers on the device’s screen to expose it
drawing directly on the painting.

27. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
DEMO

28. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Future developements:
Give the possibility to users to leave localized annotations on the work
of art.
Use a combination of “structure for motion methodologies” and 3d
tracking to apply the same techniques to threedimensional objects and
datasets.

29. AWE2014
AR for Cultural Heritage
© Giovanni Landi
giovannilandi@yahoo.it
Thanks for your attention!