The slides summarize an analysis on the demand pattern of analyst opportunity (like data analyst, data science) in the U.S.
In a nutshell, it answer four questions, including the demand trend, demand source, degree and skill requirement based on the online job posting data.
2. Objective
Understand the demand of analytics jobs
a. What is the trend of demands for analyst?
b. Which location/industry the demand come from?
c. What degree is required to launch job in analytics?
d. What skills are needed in the analytics jobs?
3. Approach
Data
Source
Extracted
Features
● Job Title
● Company Name
● Company Type
● Company Industry
● Job Location
● Key Skills (SQL,
Python, etc)
● Degree
Web
Scrape
Database
Text
Mining CouchDB
NoSQL DB
Second Hand Data
First Hand Data
Indeed
Trend Search
4. Definition
What do we mean by “analyst”?
Analyst
Data Analyst
(Engineer)
Business Analyst
(Business)
Match Keywords
data engineer, data scientist, machine
learning, technical analyst, system analyst,
security analyst, data modeler, data
architect etc.
Match Keywords
business intelligence,
business analyst, program manager,
product manager, marketing,
and other analysts not categorized as
data analyst (engineer)
who is responsible for
designing algorithms, softwares, or
infrastructure that enable analysis
who is responsible for
conducting decision-related analysis
and communicate w/ client
5. Business Analyst (Business) is four time
as much as Data Analyst (Engineer)
4,000+
16,000+
* Number of Active Job Posts on Linkedin Given the Pre-selected Keywords
12. Demand for Business Analyst and Data Analyst
are slightly different across industries
Top1
for Both Role
* which industry the job belong comes from the Linkedin company profile page
13. What is the degree requirement
for the analyst position
14. Data Analyst (Engineer) has higher preference towards
Ph.D than Business Analyst (Business)
65% jobs express
degree requirement
65%
% of Job Mentioning BS/MS/Phd
18%
PhD
Only
16. Data Analyst has more specific
skills requirement than Business Analyst
Data Analyst
(Engineer Side)
Business Analyst
(Business Side)
3.0 1.3
# of Skills Required in the Job Post
* Among the extracted skill set, on average,
data analyst position requires 3.0 skills while business requires 1.3 skills
17. SQL is the most important skill for Analyst (Engineer)
as Excel for Analyst (Business).
SQL
High for Engineer
Excel
High for Business
Java, Hadoop, Python
R, SAS, Machine Learning
Moderate for Engineer
Presentation
Moderate for Business
18. What is the trend of the demand
for those high/moderate skills?
Python R Machine L’ning
Hadoop SAS Java
Excel Presentation SQL
19. What about the trend for the skill
Business Engineer
High Moderate High Moderate
Excel Presentation SQL Python, R, ML, Hadoop SAS, Java
20. Takeaway
For Staffing and Recruiting Company:
1. Monitor skills instead of job titles
2. Focus on “Business Analysis” if the company want to
expand business in eastern coast
3. Help candidates prepare interview by helping them
enhance top required skills (SQL, Presentation)
25. The skill requirement of analyst is very diverse -
not a skills satisfy more than half of the jobs
Top 20 Skills for Analytical Positions
NO skill can satisfy
the requirement of
more than 35% jobs
26. Limitations/Next Steps
Limitations
1. Single Source: Job data is only from single source (only Linkedin)
2. Only June/July data could be crawled, no time series analysis could
be done with our own data
3. No way to detect job duplication (single job, multiple posts)
Next Step
1. Scrape data from multiple sources (indeed, monster)
2. Run the script weekly so calculate job data over time
3. Calculate the similar of two job posts to reduce duplication
4. Store the job into MySQL database