Nordic Statistical Meeting 26.-28.8.2019, Helsinki

1. Machine learning on Classification of
Economic Activities
August 28, 2019 Kristin Foldal Haugen, Statistics Norway 1

2. Use of machine learing in classification work
2
SIC:
49.410
49.420
53.200
49.392
43.120
“Truck
transport”
Business
description
Machine
learning
model
Code

3. What is a SIC code?
50.201
3
NACE
Sea and coastal freight water
transport

4. What is a SIC code?
50.201
4
SIC
Freight ocean transport

5. What is a SIC code?
50.202
5
SIC
Freight coastal transport

6. Problems with manual classification
6

7. Problems with manual classification
7
Inaccurate descriptions
Timeconsuming
90 000 classifications every year

8. October 17, 2019 Kristin Foldal Haugen, Statistics Norway 8

9. Training the model
9
The model
Text =
code
..education
= 85.20
..steel =
24.10
1.5 mill business descriptions
820 different SIC codes +texts
Index

10. Training the model
10
Dataset
Training Test

11. Pre-processing the data
11

12. Obstacles Less
frequent
SIC
codes
More
frequent
SIC
codes
12

13. Obstacles
13
1
2
3

14. Obstacles
14
Jeg Bokmål
EgNynorsk
Æ Dialect

15. Model performance
fastText
15
Accuracy Recall / precision
0,6082 0,2552
Partly correct
accuracy
Recall /precision
0,8572 0,48
Not a good
measurement
for
Imbalanced
datasets
44
Accuracy
Less
frequent
Frequent

16. Model performance
fastText
16
Accuracy Recall / precision
0,6082 0,2552
Partly correct
accuracy
Partly correct
Recall /precision
0,8572 0,48
Better
measurement
for imbalanced
datasets
44 Recall/
precision
Less
frequent
Frequent

17. How to move on
• Solve obstacles
• ML-project in
(The United Nations Economic
Commission for Europe)
• Serbia
• Poland
• Belgium
• Mexico
• Norway
• Canada
17

18. Please share your ideas with us!
Thank you!
August 28, 2019 Kristin Foldal Haugen, Statistics Norway 18
Kristin: krf@ssb.no
Tatsiana: tpa@ssb.no
Thivyesh: ivy@ssb.no