Presentation given by Mark Billinghurst and Gun Lee on how to develop for Google Glass. Given on February 4th in Christchurch New Zealand.

1. Developing for Google Glass
February 4th 2014
Mark Billinghurst, Gun Lee
HIT Lab NZ
University of Canterbury

2. The Glass Class – Feb 17th – 21st
 Intensive Glass Course
 See http://arforglass.org/

3. Overview






Introduction to Glass
Concept Design Non-programmers
Rapid Prototyping Simple programming
Mirror API - Server Development
Native Applications - Java/Android Developers
More Resources

4. Introduction

5. Google Glass

8. View Through Google Glass
Always available peripheral information display
Combining computing, communications and content capture

9. User Interface
 dfasdf

10.  Hardware
 CPU TI OMAP 4430 – 1 Ghz
 16 GB SanDisk Flash,1 GB Ram
 570mAh Battery
 Input
 5 mp camera, 720p recording, microphone
 GPS, InvenSense MPU-9150 inertial sensor
 Output
 Bone conducting speaker
 640x360 micro-projector display

11. User Experience
 Truly Wearable Computing
 Less than 46 ounces
 Hands-free Information Access
 Voice interaction, Ego-vision camera
 Intuitive User Interface
 Touch, Gesture, Speech, Head Motion
 Access to all Google Services
 Map, Search, Location, Messaging, Email, etc

12. Glassware Applications
 https://glass.google.com/glassware

13. Concept Design Tools

14. Glass Sim – http://glasssim.com/
 Simulate the view through Google Glass
 Multiple card templates

15. Glass UI Templates
 Google Glass PSD Templates
 http://glass-ui.com/
 http://dsky9.com/glassfaq/the-google-glass-psd-template/
 UXPin Wireframing Tool
 http://uxpin.com/

16. Glass Application Storyboard
 http://dsky9.com/glassfaq/google-glass-storyboardtemplate-download/

17. Glass Application Flow

18. Rapid Prototyping

19. Processing
 Programming tool for Artists/Designers
 http://processing.org
 Easy to code, Free, Open source, Java based
 2D, 3D, audio/video support
 Processing For Android
 http://wiki.processing.org/w/Android
 Generates Glass Ready .apk file

21. Development Environment

22. Hello World
//called initially at the start of the Processing sketch!
void setup() {!
size(640, 360);!
background(0);!
} !
!
//called every frame to draw output!
void draw() {!
background(0);!
//draw a white text string showing Hello World!
fill(255);!
text("Hello World", 50, 50);!
}!

23. Demo

24. Hello World Image
PImage img; // Create an image variable!
!
void setup() {!
size(640, 360);!
//load the ok glass home screen image!
img = loadImage("okGlass.jpg"); // Load the image into
the program !
}!
!
void draw() {!
// Displays the image at its actual size at point (0,0)!
image(img, 0, 0);!
}!

25. Demo

26. Touch Pad Input
 Tap recognized as DPAD input
!void keyPressed() {!
!if (key == CODED){!
!
!if (keyCode == DPAD) {!
!// Do something ..!
 Java code to capture rich motion events
 import android.view.MotionEvent;!

27. Motion Event
//Glass Touch Events - reads from touch pad!
public boolean dispatchGenericMotionEvent(MotionEvent event) {
!
float x = event.getX(); // get x/y coords !
float y = event.getY();!
int action = event.getActionMasked(); // get code for action
!
!
switch (action) { // let us know which action code shows up
!
!case MotionEvent.ACTION_DOWN:!
!
!touchEvent = "DOWN";!
!
!fingerTouch = 1;!
!break; !
!case MotionEvent.ACTION_MOVE:!
!
!touchEvent = "MOVE";!
!
!xpos = myScreenWidth-x*touchPadScaleX;!
!
!ypos = y*touchPadScaleY;!
!break;!

28. Demo

29. Sensors
 Ketai Library for Processing
 https://code.google.com/p/ketai/
 Support all phone sensors
 GPS, Compass, Light, Camera, etc
 Include Ketai Library
 import ketai.sensors.*;!
 KetaiSensor sensor;!

30. Using Sensors
 Setup in Setup( ) function
 sensor = new KetaiSensor(this);!
 sensor.start();!
 sensor.list();
 Event based sensor reading
void onAccelerometerEvent(…)!
{!
accelerometer.set(x, y, z);!
}!

31. Sensor Demo

32. Other Tools
 App Inventor – visual programming for Android
 http://appinventor.mit.edu/
 Phone Gap – Android Apps using Javascript
 http://phonegap.com/
 Phone Gap for Glass
 https://github.com/brendajin/googleglass-phonegap-example
 WearScript
 Using Javascript/HTML to develop Glass Applications
 http://www.wearscript.com/

33. Mirror API + Glass GDK

34. Timeline Metaphor

35. Glassware and Timeline

36. Glassware and Timeline
 Static Cards
 Static content with text, HTML, images, and (link to) video.
 e.g. notification messages, news clip
 Live Cards
 Dynamic content updated frequently.
 e.g. compass, timer
 Immersions
 Takes over the whole control, out from timeline.
 e.g. interactive game

37. Glassware Development
 Mirror API
 Server programming, online/web application
 Static cards / timeline management
 GDK
 Android programming, Java (+ C/C++)
 Live cards & Immersions
 https://developers.google.com/glass/

38. Mirror API
 REST API
 Java servlet, PHP, Go,
Python, Ruby, .NET
 Timeline based apps
 Static cards
- Text, HTML, media attachment (image & video)
- Standard and custom menu items
 Manage timeline
- Subscribe to timeline notifications
- Sharing with contacts
- Location based services

39. Mirror API based Web App
Glassware Web app
3. Insert a static card
User sees the card

40. Develop with Mirror API
 Create a Google APIs Console project
 Prepare a web server
 https callback for OAuth 2.0
 Minimum storage for credentials
 Create a web application
 Java servlet, PHP, Go, Python, Ruby, .NET
 Implement Oauth 2.0 authentication
 Use Mirror API to make REST API calls
- Wrapper classes/methods provided

41. Example

42. Example

43. Example

44. Example

45. Example
On your Glass

46. GDK
 Glass Development Kit
 Android 4.0.3 ICS + Glass specific APIs
 Use standard Android Development Tools

47. GDK
 GDK add-on features
 Timeline and cards
 Menu and UI
 Touch pad and gesture
 Media (sound, camera and voice input)

48. Live Cards vs. Immersions
 Live cards display frequently updated
information to the left of the Glass clock.
 Integrate rich content into the timeline
 Simple text/images to full-blown 3D graphics
 Immersions let you build a user
experience outside of the timeline.
 Build interactive experiences
 Extra control, less user input constraints

49. Live Cards vs. Immersions

50. Live Cards

51. Immersions

52. Develop with GDK
 Android 4.0.3 (API 15) SDK and GDK Sneak
Peek from the Android SDK Manager.
 Project settings:
 Minimum and Target SDK Versions: 15
 Compile with: GDK Sneak Peek
 Theme: None (allows the Glass theme to be applied.)
 GDK samples
 File > New Project > Android Sample Project
 On Glass, turn on USB debugging
 Settings > Device Info > Turn on debug

53. Example
 Android App with a full-screen Activity
 Add Voice Trigger to launch
 Handle touch input
 Manipulating timeline

54. Example
 Add Voice Trigger to launch
 Add intent filter to AndroidManifest.xml

55. Example
 Add Voice Trigger to launch (continued)
 Add xml/voice_trigger.xml to res folder
 Add voice_trigger_title string resource

56. Example
 Handle touch input

57. Example
 Adding static cards to timeline

58. Summary
 Use Mirror API if you need ...
 Use GDK if you need ...
 Or use both

59. Resources
 Main Developer Website
 https://developers.google.com/glass/
 Glass Apps Developer Site
 http://glass-apps.org/glass-developer
 Google Glass Emulator
 http://glass-apps.org/google-glass-emulator
 AR for Glass Website
 http://www.arforglass.org/

60. Books
 Programming Google Glass
 Eric Redmond
 Rapid Android Development:
Build Rich, Sensor-Based
Applications with Processing
 Daniel Sauter

61. More Information
 Mark Billinghurst
 mark.billinghurst@hitlabnz.org
 Gun Lee
 gun.lee@hitlabnz.org