1. Building Social Media
Sites in Ruby

2. Who am I

3. things to cover
What’s social world going on?
Social data storage in MongoDB
Streaming social data with MQ
Others worthy to mention

4. Trends
Facebook, Fan Page
Twitter, Promoted Topics/Accounts
Media Agency: Brand Website -> Social

5. Categories
Social Network
Social Community Management
Social Monitoring/Measurement

6. success
radian6: twitter $1,500/M + bandwidth cost
iWOMcooperator: Sina weibo RMB20,000/M
TweetDeck
SocialBro

7. dev platforms
graph.facebook.com
dev.twitter.com
- documentations
- endpoints, request and response examples
- tools for developers

8. Social Data
id: "209664525731998_247270968638020"
from:
name: "Vanessa Tam"
id: "100000116574145"
to:
data:
-
name: "The House of Dancing Water"
category: "Arts/entertainment/nightlife"
id: "209664525731998"
message: "La=)"
actions:
-
name: "Comment"
link: "http://www.facebook.com/209664525731998/posts/247270968638020"
-
name: "Like"
link: "http://www.facebook.com/209664525731998/posts/247270968638020"
type: "status"
created_time: "2011-08-17T15:02:55+0000"
updated_time: "2011-08-17T15:44:36+0000"
likes:
data:
-
name: "Phoebe Lee"
id: "100002673212002"
count: 199
comments:
data:
-
id: "209664525731998_247270968638020_3569720"
from:
name: "The House of Dancing Water"
category: "Arts/entertainment/nightlife"
id: "209664525731998"
message: "Welcome!"
created_time: "2011-08-17T15:44:11+0000"
-
id: "209664525731998_247270968638020_3569724"
from:
name: "Vanessa Tam"
id: "100000116574145"
message: "okok"
created_time: "2011-08-17T15:44:32+0000"
-
id: "209664525731998_247270968638020_3569725"
from:
name: "Vanessa Tam"
id: "100000116574145"
message: "=)"
created_time: "2011-08-17T15:44:36+0000"
count: 3

9. Why not RDBMS
Scalability
- Horizontally
Flexibility
- Scheme change

10. Comparison...
Key-Value
Scalibility & Performance Memcached MongoDB RDBMS
Depth of Functionality

11. Intro to MongoDB
Schema Free
Document Base
High Performance
JSON Style Storage: BSON
Dynamic Query

12. a lot of more...
Flexibility:
- Schema Free
- Database setting: replication, secondary DB
- Model: data type, collection, _id, associations
- Lazy Cursor
e.g. rubyconftw = RubyConf.where(:location=>“Taiwan”) #cursor created
puts rubyconftw.entries #cursor executed

13. more...
Capped Collection
- logs, messages
- fixed after being created
... ...

14. ODM
MongoMapper
MongoRecord
Mongoid
- Rails 3
- Active Record Style
- Ruby Driver

15. not good at...
SQL-base tool (BI)
High Transactional Operations

16. Streaming
Twitter
Sina Weibo
Stream has...

17. Twitter Stream API
Streaming API: UserID, Keyword, geo-
Location
User Stream: User Level
Site Stream: Application Level

18. What’s wrong...
Unstable Traffic
- online time
- irregular events
Data Lost
- updated response
- invalid response

19. AMQP & RabbitMQ
AMQP: reliable safe
RabbitMQ: A leading AMQP implementation

20. fit into streaming
publishing, subscription
cool at...
No worries?

21. Testing
Web Access
fakeweb
API endpoint URL & response

22. Hoptoad / Airbrake
notify you exceptions
>= direct email notification

23. background workers
stalker
resque: redis-base
delayed_jobs: assign different queues to
different workers?

24. Things to checkout...
MongoDB:http://www.mongodb.org/
Mongoid:http://mongoid.org/
EventMachine:http://rubyeventmachine.com/
Twitter Stream Plugins:
http://rubygems.org/gems/twitterstream
rabbitMQ:http://www.rabbitmq.com/getstarted.html
Hoptoad:https://github.com/thoughtbot/hoptoad_notifier