2. What’s BigQuery
Official site : https://cloud.google.com/bigquery/docs/
BigQuery is Google's fully managed, petabyte scale, low
cost analytics data warehouse.
BigQuery is NoOps—there is no infrastructure to manage
and you don't need a database administrator—so you can
focus on analyzing data to find meaningful insights, use
familiar SQL, and take advantage of our pay-as-you-go
model.
→ WDH: SQL like (easy to use), Petabyte scale(for Huge data)
3. Features of BigQuery
Column oriented Database
Full Scan instead of using Index
Charge for scanned data size
http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf
https://www.flickr.com/photos/mairin/galleries/72157624181197793/
https://cloud.google.com/blog/big-data/2016/03/google-bigquery-cuts-historical-data-storage-cost-in-half-and-accelerates-many-queries-by-10x
4. The first step - overview -
1. Preparation (create account)
2. Try BigQuery with prepared data
3. Upload your data to your BigQuery storage and try it.
5. Preparation steps
1. Preparation (create account)
1. Create your Google account
2. Move to Google Cloud platform (has no account)
3. “Try IT Free”
4. “Sign up for free trial”
5. Account registration
6. Move to Google Cloud Platform (login)
7. Select ‘BigQuery’ from left menu (top-left icon)
6. Create your google account
1. Preparation (create account)
1. Create your Google account
https://accounts.google.com/signUp
7. Move to Google Cloud Platform
1. Preparation (create account)
2. Go to Google Cloud platform (has no account)
3. “Try IT Free”
https://cloud.google.com
8. Move to Google Cloud Platform
1. Preparation (create account)
2. Go to Google Cloud platform (has no account)
3. “Try IT Free”
https://cloud.google.com
9. Move to Google Cloud Platform
1. Preparation (create account)
2. Go to Google Cloud platform (has no account)
3. “Try IT Free”
https://cloud.google.com
12. Move to Google Cloud Platform
1. Preparation (create account)
6. Move to Google Cloud Platform (login)
7. Select ‘BigQuery’ from left menu (top-left icon)
https://cloud.google.com
13. Move to Google Cloud Platform
1. Preparation (create account)
6. Move to Google Cloud Platform (login)
7. Select ‘BigQuery’ from left menu (top-left icon)
https://cloud.google.com
14. Move to Google Cloud Platform
1. Preparation (create account)
6. Move to Google Cloud Platform (login)
7. Select ‘BigQuery’ from left menu (top-left icon)
https://cloud.google.com
27. More query
SELECT actor, actor_attributes_name , count( actor_attributes_name ) as amount
FROM [bigquery-public-data:samples.github_timeline]
group by actor, actor_attributes_name order by amount desc LIMIT 1000
28. Much more query
You can check query syntax
by yourself.
https://cloud.google.com/
bigquery/query-reference
29. Upload your data
1. Create database
2. Create Table (with CSV)
3. check “Table ID”
4. QUERY!