Dataset Creation from Job Portals using Scrapping and EDA Implementation to Enhance Employability

Abstract

The Computer Science is a highly sought-after field, offering some of the best job opportunities in the Information Technology sector through various job portals. Students often find that their skills in computing can open many doors in the rapidly evolving tech industry. There's a significant gap between the skills taught in educational settings and those demanded by the industry, largely due to the rapid evolution of technology. To address this, educational institutions need to frequently update their curricula collaborate with industry leaders to ensure students acquire relevant, up-to-date skills for the workforce. Thus, it's essential to analyze the skills that are currently in demand within the IT industry. A job portal is an online platform where companies can post job listings, offering a quick, reliable, and precise way to connect with potential employees. In this Research Paper, the Web Scrapping procedures and methods have been developed in Python to scrape employment details of Information Technology field from renowned job portals like Naukri.com, Monster.com, TimesJobs.com, Internshala.com and Myamcat.com. After scrapping, EDA (Exploratory Data Analysis) has been performed on scrapped data to summarize main characteristics of data set.