keyyyyyyyyyy

1. Sidi Chang
Insight Data Science Data Engineering Fellow
Jun 23rd 2016
JustBid

2. Sealed/blind second price auction

3. Motivation
• Generate random data to simulate bidding process and compare
bidding strategy
• Provide recommendation to bidders

4. Data Pipeline
Simulated Data

5. Data
• 10K bidders, 100 days, 30% growth-rate each month
• Nearly 15 million bidding

6. Recommendation

7. Recommendation
For 𝑵 = 𝟏𝟎 million, it takes more than a year…
(AWS m4.large cluster)

9. Challenges
• MinHash Algorithm implemented in distributed system
• Use different database for different purposes

10. About me
• MS in CS and Operations Research