Evaluation of the trends in jobs and skill-sets using data analytics: a case study

Armin Alibasic, Himanshu Upadhyay, Mecit Can Emre Simsekler, Thomas Kurfess, Wei Lee Woon, Mohammed Atif Omar

    Research output: Contribution to journalArticlepeer-review

    7 Scopus citations


    Introduction: Fast-emerging technologies are making the job market dynamic, causing desirable skills to evolve continuously. It is therefore important to understand the transitions in the job market to proactively identify skill sets required. Case description: A novel data-driven approach is developed to identify trending jobs through a case study in the oil and gas industry. The proposed approach leverages a range of data analytics tools, including Latent Semantic Indexing (LSI), Latent Dirichlet Allocation (LDA), Factor Analysis and Non-Negative Matrix Factorization (NMF), to study changes in the market. Further, our approach is capable of identifying disparities between skills that are covered by the educational system, and the skills that are required in the job market. Discussion and evaluation: The results of the case study show that, while the jobs most likely to be replaced are generally low-skilled, some high-skilled jobs may also be at risk. In addition, mismatches are identified between skills that are imparted by the education system and the skills required in the job market. Conclusions: This study presents how job market and skills required evolved over time, which can help decision-makers to prepare the workforce for highly demanding jobs and skills. Our findings are in line with the concerns that automation is decreasing the demand for certain skills. On the other hand, we also identify the new skills that are required to strengthen the need for collaboration between minds and machines.

    Original languageBritish English
    Article number32
    JournalJournal of Big Data
    Issue number1
    StatePublished - Dec 2022


    • Data analytics
    • Data mining
    • Future of work
    • Jobs and skills analysis
    • Natural language processing


    Dive into the research topics of 'Evaluation of the trends in jobs and skill-sets using data analytics: a case study'. Together they form a unique fingerprint.

    Cite this