ASE 2014 Augmented Reality Teaching

ASE Conference

University of Birmingham, 9th January 2014

Augmented
Reality
Teaching
Dr. Francisco Pérez García
Head of Technology Dept. , Pompeu Fabra High School, Martorell
Head of i-Campus Project, University of Barcelona, Barcelona
U

1

U N IV E R S ITAT D E B A R C E L O N A

Unitat de Farmacologia i Farmacognòsia - Facultat de Farmàcia

B

The author respects article 32 of the Spanish Law of Intellectual
Property to use images and other materials contained in this
presentation.
The Berne Convention provides for a specific exception to allow
uses of copyrighted works for the purpose of teaching:
“ Art.10.2.-It shall be a matter for legislation in the countries of the
Union, and for special agreements existing or to be concluded
between them, to permit the utilization, to the extent justified by the
purpose, of literary or artistic works by way of illustration in
publications, broadcasts or sound or visual recording for teaching,
provided such utilization is compatible with fair practice”

U

2


Dr. Francisco Pérez García - Institut Pompeu Fabra

B

Contents of this presentation
1. Augmented reality (AR) as a disruptive technology?
2. Level 0: AR with no programming knowledge
a) App: Google Googles (QR and GeoWeb)
b) Online: www.learnar.org
c) Free software: BuildAR
3. Level 1: AR with minor programming skills
a) Open Source software: processing 2
b) libraries NyAR4psg, OBJLoader, etc
c) Online: Create 3D objects
http://www.123dapp.com/catch
4. Level 2: AR with programming skills: Google Glasses
U

3



B

Augmented reality
A disruptive technology?
Lavandula angustifolia

Something that generates a very
important change

U

4



B

Augmented reality
A disruptive technology?
Lavandula angustifolia

Something that generates a very
important change

U

5



B

Higher
Level 2

Programming
skills
Level 1
Lower

Level 0

LEVEL OF PROGRAMMING SKILLS REQUIRED
TO CREATE AUGMENTED REALITY APPLICATIONS
U

6



B

Types of Augmented
Reality
Hiperlinks in the real
world
Marker based augmented
reality
Markerless augmented
reality
Geoweb-Internet of places
Internet of things

Trigger by
QR
Markers
Objects or pictures

Objects and GPS position
Sensors, objects and GPS
U

7



B

Level 0 AUGMENTED REALITY: QR CODE
http://www.goqr.me (among many other ways to generate QR)
Zint Barcode Generator

U

8



B

U

9



B

U

10



B

U

11



B

U

12



B

13

Internet of places - Geoweb

U


B

U

14



B

http://www.learnar.org AUGMENTED REALITY WITH A BROWSER AND MARKERS
U

15



B

U

16



B

U

17



B

U

18



B

U

19



B

U

20



B

U

21



B

U

22



B

U

23



B

http://6007.stem.org.uk Gravity, Bugs, Sounds and Materials
24

U


B

Creating book with Augmented Reality with www.zooburst.com
U

25



B

Download Build AR free version at
http://www.buildar.co.nz/home/download/?did=6
Two examples in the next slides
U

26



B

27

http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdf
Movement to understand eclipse

U

B

28

http://www.buildar.co.nz/buildar-showcase-2/
Movement to understand Stirling engine

U


B

Students using technology or students creating technology?
U

29



B

TO CREATE AUGMENTED REALITY APPS WE NEED CREATIVE STUDENTS…
U

30



B

WITH COMMON HARDWARE, AND…
U

31



B

SOME SOFTWARE,
AND PROGRAMING SKILLS?

32

U


B

U

33



B

U

34



B

Processing

Open Source software
Derived from Java
Many available examples
Many contributed libraries: for Arduino, 3DObject,
QRCode, Box2D for games, Open Computer Vision,
for Augmented Reality like NyAR4psg or NyAR2, etc.

U

35



B

Marker augmented reality
(NyAR4psg, NyAR2 libraries)
Loading 3D objects
Markerless augmented reality
(Saito OBJLoader library)
(OpenCV library)

Lego robots
(NTXcomm library)

QR code library

Data communication
(libraries for SMS,
SQL databases,…)

Games (pBox2D library)

Machine learning
(Gnet library)
Arduino library
(http://tecnologies.net/?page_id=206)
36

U


B

U

37



B

AUGMENTED REALITY MARKERS

U

38



B

U

39



B

U

40



B

We need extra libraries and programs to start executing
augmented reality code with Processing:
• Libraries
 GSVideo
http://sourceforge.net/projects/gsvide
o/files/gsvideo/1.0

• Programs
 QuickTime
http://www.apple.com/es/quicktime/d
ownload/

 OBJLoader

https://code.google.com/p/saitoobjloader/
 Nyar4psg-1.3.1

http://sourceforge.jp/projects/nyartoolkit/
releases/?package_id=8920

 WinVDIG

http://www.eden.net.nz/7/2007100
8/

U

41



B

Quicktime 7:
http://www.apple.com/ca/quicktime/download/

http://www.eden.net.nz/7/20071008/

U

42



B

GSVIDEO LIBRARY (ONLY FOR PROCESSING 1.5.1)
http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0/

U

43



B

MAIN AR LIBRARY FOR PROCESSING: NyAR4psg
http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920

U

44



B

MULTIMARKER LIBRARY FOR AUGMENTED REALITY
USING PROCESSING

http://cpbotha.net/files/nyar4psg_multimarker/

U

45



B

http://code.google.com/p/saitoobjloader/downloads/list

U

46



B

WHERE WE HAVE TO PUT THE
EXTRA LIBRARIES
Libraries: Inside processing
(modes>java>libraries)

U

47



B

WHERE WE HAVE TO PUT THE
EXTRA PROGRAMS
Programs: At the same folder than processing

U

48



B

SIMPLELITE.PDE
SIMPLEST CODE FOR AUGMENTED REALITY
USING PROCESSING

U

49



B

CODE CHANGES IF GSVIDEO LIBRARY IS USED

import processing.video.*; //core library
import codeanticode.gsvideo.*; //gsvideo contributed library
Capture cam;
GSCapture cam;
cam=new Capture(this,width,height);
cam=new GSCapture(this,width,height);
cam.start();
U

50



B

U

51



B

U

52



B

U

53



B

U

54



B

CREATING 3D OBJECTS FROM PHOTOGRAPHS

U

55



B

U

56



B

U

57



B

Creating 3D objects with
www.blender.org

www.sketchup.org

U

58



B

http://flash.tarotaro.org/ar/MarkerGeneratorOnline.swf

U

59



B

http://www.brosvision.com
ar-marker-generator/

U

60



B

Online quiz about processing:
http://blocs.xtec.cat/pile/2013/05/quiz1.swf

U

61



B

Computer vision OpenCV library + Processing 2.1

U

62



B

Level 2. AR WITH GOOGLE GLASSES

U

63



B

U

64



B

U

65



B

U

66



B

Woodpecker images from @tecnotic
67

U


B

John and Anne
are getting fat. I
must send a
message now

I detected a
weigth of 60.4kg
Anne’s seat

John’s seat
My sensor
measured 70.2kg

THE INTERNET OF THINGS
U

68



B

References
http://www.tecnologies.net
http://www.processing.org
http://www.learningprocessing.com/
http://www.openprocessing.org
http://www.creativeapplications.net/category/processing/
https://www.coursera.org/course/digitalmedia

U

69



B

U

70



B

MOOC from University of London about www.processing.org

U

71



B

U

72



B

http://www.wiley.com/WileyCDA/WileyTitle/productCd1118036638,miniSiteCd-SYBEX,descCd-DOWNLOAD.html

U

73



B

ACKNOWLEDGEMENTS

-To the Government of Catalonia, Department of Education
for the school innovation project “Technological Creativity” at
Pompeu Fabra High School
-To the University of Barcelona for the innovation project “i-Campus”

U

74



B

THANK YOU VERY MUCH
FOR YOUR ATTENTION
QUESTIONS?

U

75



B

ASE 2014 Augmented Reality Teaching

Recomendados

Recomendados

Mais conteúdo relacionado

Mais de Francisco Perez

Mais de Francisco Perez (20)

Último

Último (20)

ASE 2014 Augmented Reality Teaching