26. Cloud OnAir
BigQuery ML
What’s new in BigQuery ML
● BigQuery ML が近日 GA
● [New] k-means クラスタリングのサポート (Beta)
● [New] 機械学習モデルの evaluation charts の
BigQuery UI 上での可視化
● [New] 強調フィルタリング (Matrix factorization) の サ
ポート (Alpha)
● [New] TensorFlow を用いたディープニューラルネット
ワークのサポート (Alpha)
● [New] BigQuery 上でのプレディクション用の
TensorFlow モデルのインポート (Alpha)
● [New] Feature pre-processing functions (Alpha)
27. Cloud OnAir
BigQuery ML
ユースケース:
● カスタマーセグメンテーション
● 製品(E-commerce 等における)の分類
k-means clustering (Beta)
デフォルト設定と各種オプション
● Optional: Number of clusters. Default log10
(num_rows)
clusters.
● Distance type - Euclidean (default), Cosine
● Works on a mix of Numeric and Categorical features
● Supports all major SQL data types including GIS
CREATE MODEL
yourmodel
OPTIONS (model_type =
“kmeans”) AS SELECT..
ml.PREDICT maps rows
to closest clusters
31. Cloud OnAir
構造化データは機械学習分野の成長を牽引
% of total value potential
Structured
Time series
Image
Video
Text
Audio
Data type
55-94
50-83
25-42
17-30
16-26
7-13
Range
Source: McKinsey Global Institute
34. Cloud OnAir
Google Brain の最新モデルも AutoML Tables で
Phase 2: Architecture Search & Tuning
Classification Regression
Loss Function Selector
Auto Model Type Selection
NN Auto Layer
Constructor
Tree Auto Constructor
…
Auto Feature: Selection & Embedding
Phase 1: Auto Data Preprocessing (TF Transform)
Categorical
Features
Numerical Features
Text
Features
DateTime
Features
...
Phase 3 CV,
Bagging
Ensemble
Phase 4 Deploy
123
35. Cloud OnAir
適用例: Mercari Price Suggestion Challenge
Training data
ID Name Item
Condition
Categories Brand
name
Shipping Item
description
Price
0 MLB Cincinnati
Reds T Shirt
Size XL
3 Men, Tops,
T-shirts
1 No description yet $10
1 Razer
BlackWidow
Chroma
Keyboard
3 Electronics,
Computers &
Tablets,
Components &
Parts
Razer 0 This keyboard is in great condition and works
like it came out of the box. All of the ports are
tested and work perfectly. The lights are
customizable via the Razer Synapse app on
your PC.
$52
2 AVA-VIV
Blouse
1 Women, Tops &
Blouses, Blouse
Target 1 Adorable top with a hint of lace and a key hole
in the back! The pale pink is a 1X, and I also
have a 3X available in white!
$10
3 Leather Horse
Statues
1 Home, Home
Décor, Home
Décor Accents
1 New with tags. Leather horses. Retail for [rm]
each. Stand about a foot high. They are being
sold as a pair. Any questions please ask. Free
shipping. Just got out of storage
$35
Kaggle で公開されたテストデータを AutoML を使って分析