1. The ARLearn toolkit for mobile serious
games and field-trips
dr. Stefaan Ternier
Open University of the Netherlands
1
Friday, November 2, 12

2. Augmented Reality
=
camera + gps + accelerometer
2
Friday, November 2, 12

3. Augmented Reality: Locatory
3
Friday, November 2, 12

4. 4
Friday, November 2, 12

5. Senses
• sight
• hearing
• taste
• smell
• touch
• balance
• ....
5
Friday, November 2, 12

6. ARLearn: hearing
6
Friday, November 2, 12

7. Milgram, P. and Kishino, A. F. (1994) Taxonomy of Mixed Reality Visual Displays
IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329.
•Real environment •Virtual environment
•enriched with virtual objects •enriched with virtual objects
7
Friday, November 2, 12

8. ARLearn Architecture
– Serious game engine
• Score
• Progress
• Team play
– Android and streetview
clients
– excursions possible
– notification framework
– Rich media: video, audio,
multiplechoice questions, ...
– location based assignments
and triggers Media
8
Friday, November 2, 12

9. Lifecycle of a media item
Invisible
dependsOn
visible
disappearOn
Invisible
9
Friday, November 2, 12

10. ARLearn data model
10
Friday, November 2, 12

11. ARLearn dependency model
11
Friday, November 2, 12

12. ARLearn Case studies
Florence case Amsterdam case Hostage case
Game Scavenger game Adventure game Decision game
design
Delivery augmented reality augmented virtuality augmented reality
Channel
Pedagogic situated learning expository learning learning through
approach decision taking
12
Friday, November 2, 12

13. Cultural Science Fieldtrip in Florence
13
Friday, November 2, 12

14. Lessons Learned
• Choose a location for fieldwork with proper GPS
reception
• High buildings, narrow streets :(
• Reserve time for users to make themselves
acquainted with the smartphone
• Battery life ~ GPS/network operations
• Balance between automatic start and manual start
of audiofragments.
14
Friday, November 2, 12

15. Hostage Simulation: Real World
Training for critical situations
15
Friday, November 2, 12

16. Roles / teams
Head of Office - Security Officer - Staff Welfare
a role is performed by a small group with smartphone.
advance organizer for real drill
take decissions / collaborate
16
Friday, November 2, 12

17. 17
Friday, November 2, 12

18. 18
Friday, November 2, 12

19. Streetlearn: ARLearn streetview client
• cultural heritage case :
Amsterdamse grachtengordel
• Unesco site with 100% google streetview coverage
• storyboard based on real historic event:
smuggling marihuana from Libanon in early 1970s
• Player takes role of Ada Jobse, a police officer
19
Friday, November 2, 12

20. Streetlearn: ARLearn streetview client
20
Friday, November 2, 12