In the recent past, I have had lot of discussions around changing job-landscape, resources up-skilling/cross-skilling, key capabilities a company needs for digital transformation, and others.
I started down this path as a hobby and set myself a target of building a small MVP/may be even an Alpha version where I can automatically analyze a few job postings and parse out the key skills.
That turned into a sort of obsession.Soon I had a sample set of 76 data scientist jobs, ran Natural Language Processing (NLP) on it, looked at patterns, created a custom Named Entity Recognition (NER) model, trained it all using Google ML, all stored in Google Big Query, created a bunch of Python Flask APIs, and build a React JS front-end to show case all that data.
The result is this model can now recognize 200 different skills and classify Tech Stacks, Leadership Skills, and Job Specific Skills.
Listed below are the top 10 tech stacks:
Listed below are the top 10 job-specific skills:
- Machine Learning or ML
- Data Analysis
- Data Engineering
- Big Data
- Learning Models
- Deep Learning
- Time Series
- Product Engineering
- Predictive Modeling
- Software Development
Listed below are the top 5 leadership skills:
- Problem Solving
- Team Player
I am continuing to improve it (data set, models, skill sets etc.). In addition, mapping things like ML=Machine Learning and mapping various iterations of leadership skills to a master skill.
You can check out the live version of this tool at this link.
Let me know what you all think and share additional jobs that you would be interested in learning about.
Originally published at https://www.digitallymani.com on June 14, 2020.