An overview and update presentation on Google App Engine given by Google Developer Advocate Christian Schalk at the 2011 DevFest Singapore and Jakarta events. Developer Advocate Wesley Chun also participated in the Q&A.

2. Christian Schalk
Google Developer Advocate
with Wesley Chun
Google App Engine Overview and Update
DevFest 2011
Singapore/Jakarta

3. Agenda
● Part I: What is App Engine?
● Part II: App Engine Product Update
○ Growth and Adoption
○ App Engine successes & use cases
○ App Engine Leaving Preview (BIG DEAL)
● Part III: App Engine Recent Features
○ Go, HRD, Backends, Pull Queues, etc.

4. Why does App Engine exist?

5. What is App Engine?
Build and run your web apps on Google’s infrastructure
● Easy to build
● Easy to maintain
● Easy to scale
Focus on building your app, let us wear the pagers!

6. App Engine Usages
● Mobile/Tablet ● Consumer Web Apps
○ App backends ○ Unpredictable traffic
○ Cloud persistence ○ Scale
● Social/Mobile Games ● Business Web Apps
○ Speed, scale ○ Enterprise
○ API integrations ○ Java runtime

7. Cloud Development in a Box
● Development SDK
● Local development tools
○ DevServer
○ Eclipse plugin
● Specialized API services
● Cloud-based dashboard
● Automatic scaling
○ Built-in fault tolerance
○ Automated load balancing
● Continuously evolving...

8. Language Runtime Options
GO Java
Experimental

9. Specialized API access to Google Infrastructure

10. Development Tools for App Engine
Cloud
Application Dashboar
d
Local
Development Console Google Plugin for Eclipse GoogleAppEngineLauncher
(Java) (Python)

11. App Engine Dashboard

12. Google Plugin for Eclipse

13. Demo: Getting started with App Engine
Building, testing and deploying a new cloud app in
2 minutes!

14. Agenda
● Part I: What is App Engine?
● Part II: App Engine Product Update
○ Growth and Adoption
○ App Engine successes & use cases
○ App Engine Leaving Preview (BIG DEAL)
● Part III: App Engine Recent Features
○ Go, HRD, Backends, Pull Queues, etc.

15. App Engine Evolution Through The Years
2008 2009 2010 2011
App Engine Batch write/read Java Task Queues Blobstore Multitenancy Hi-Replication
Launch Https DB Import XMPP Appstats Instance Console Datastore
Python Status- cron incoming email cursors Always On Channel API
Datastore Dashboard Mapper hi-perf imag Files API
Memcache 10 min tasks Remote API
logs export Prosp Search

16. App Engine - By the Numbers
100,000+
Active developers per month
300,000+
Active apps per week

17. App Engine - A Larger Number
2,000,000,000+
Page views per
day

18. Notable App Engine Customers

19. Royal Wedding - Scalability Success
Official blog & live stream apps
hosted on App Engine
On Wedding day...
Blog app served:
● Up to 2k requests per second
● 15 million pageviews
● 5.6 million visitors
Live stream app served:
● Up to 32k requests per second
● 37.7 million pageviews
● 13.7 million visitors
http://goo.gl/F1SGc

20. WebFilings - Enterprise Sucess
Enterprise customers:
● Procter & Gamble
● Delta Airlines
● Valero Energy
● Sprint/Nextel
● eBay
● United Airlines
● Dish Network
● ...

21. Gaming Success on App Engine

22. What about security?
App Engine SAS 70/SSAE 16/ISAE 3402 Certified

23. App Engine Has Left Preview!
● App Engine is now production!
○ Long-term commitment by Google to App Engine
○ Long-term commitment by App Engine to our users
○ Full Google Product - 3 year deprecation support
● 3 service classes
○ Free
■ Small Apps, Experiments
○ Paid - $9/app/month + usage
■ SLA 99.95%
○ Premium - $500/month + usage
■ Operational Support, SLA, Unlimited Apps
www.google.com/enterprise/cloud/appengine/pricing.html

24. Production Pricing Update
● Instance-based charging
○ CPU-hours is replaced by Instance Hours (IH)
■ 1 instance running for 1 hour
○ Similar to instances & tuning in admin console today
● APIs
○ No longer charged per CPU-hour
○ Charged per operation
● Tuning your app optimization article
○ code.google.com/appengine/articles/managing-resources.html

25. Agenda
● Part I: What is App Engine?
● Part II: App Engine Product Update
○ Growth and Adoption
○ App Engine successes & use cases
○ App Engine Leaving Preview (BIG DEAL)
● Part III: App Engine Recent Features
○ Go, HRD, Backends, Pull Queues, etc.

26. Go language runtime
● Released SDK for Mac & Linux
○ Windows port in the works
● Uses tweaked Python SDK tools for App Engine
● Announced at Google I/O (May 2011)
● Launched in App Engine (Jul 2011)

27. High Replication Datastore
● High Replication Datastore (HRD) introduced early 2011
○ Replacing Master/Slave (M/S) original App Engine
datastore as default
○ Uses Paxos algorithm for higher availability
○ Data written to multiple data centers
■ Slightly slower writes, but reads at pace w/ M/S
● Data stored is eventually-consistent
● Delivered ~99.999% uptime since launch!

28. HRD Now the Default
● Very well-received thus far
○ googleappengine.blogspot.com/2011/03/high-replication-
datastore-solid-choice.html
● Self migration tools now available!

29. Backends
Frontend
Configured
Backends
For transient, "front facing",
Web requests... For long/permanent
running "backend" jobs

30. Backends
● Long-running servers... no more deadlines... at all!
● Fully configurable instances with options:
○ RAM: 128MB to 1GB
○ CPU: 600MHz to 4.8GHz no request deadlines
● Can run indefinitely
○ Resident or Dynamic - Public or Private
○ Automatic restarts
● Used in conjunction with front-facing Web apps
● Easy to configure (backends.yaml, backends.xml)

31. Pull Queues
● Alternative to original "Task Queues" now called "Push Queues"
● What's the difference?
○ Lets you decide when to execute tasks!
● Push Queue Details
○ Producers can enqueue tasks
○ Consumer can pull (lease) tasks from queue
○ App Engine app can be producer or consumer
○ Callable via a REST API
■ Can configure ACLs for external access
● google.com/events/io/2011/sessions/putting-task-queues-to-work.
html

32. Release 1.5.5
● HRD apps
○ Cross Group (XG) transactions
○ Python 2.7 (experimental)
○ Cloud SQL (preview)
○ Full-Text Search (trusted tester)
○ HRD Migration Tool
● Higher limits
○ File uploads 10MB → 32MB, URLFetch POST 1MB → 5MB
○ Frontend requests 30s → 60s, URLFetch 10s → 60s
○ Max files 3,000 → 10,000
● Other
○ Google Storage File API
○ Admin console number of billed instances

33. Release 1.6!
● Out of preview!
○ New pricing
○ Scheduler knobs
○ Raised or removed limits
○ Python 2.7 SDK support
○ New query planner
○ Python mapreduce
○ Datastore callbacks for Java
http://googleappengine.blogspot.com/2011/11/app-engine-160-out-of-
preview-release.html

34. App Engine
Roadmap
● Custom domain SSL
● Full text search
● Your next App Engine app!
code.google.com/appengine/docs/roadmap.html

35. Summary
● App Engine: Build scalable apps in the cloud
○ Use familiar environments: Java, Python, & now Go
○ Runs on high-performance Google infrastructure
● In short history: achieved significant users & traffic
○ 100K+ devs/mo, 300K+ active apps/wk, 2B+ view/day
● Build both web and non-UI apps
○ Mobile, game, business, retail, dating, weddings...
● Is now production!
○ Formal pricing, SLA, operational support
○ Commitment: Google to GAE, GAE to users

36. Q&A
Wesley Chun
profiles.google.com/wescpy
@wescpy
Christian Schalk
profiles.google.com/cschalk
@cschalk