Summary
Software Engineer with a background in developing and maintaining data extraction solutions for a leading Data-as-a-Service (DaaS) provider. Seeking a Junior or Associate Data Engineer position to leverage experience in Python, SQL, data harvesting, and processing large-scale datasets (billions of data points). Actively enhancing data engineering skills through the IBM Data Engineering Professional Certificate program, with a strong desire to build and optimize robust data pipelines and contribute to data-driven solutions.
Professional Experience
Software Engineer
TalentNeuron (Acquired from Gartner by Leeds Equity, UK) | Bangalore, India
Feb 2023 - May 2024
- Contributed to the development and maintenance of a core Data-as-a-Service (DaaS) product built upon ~3 trillion data points and ~2.2 billion candidate profiles, delivering global labor market intelligence across 110+ countries.
- Engineered and maintained data extraction pipelines contributing to the daily collection and processing of millions of unique job posting data points.
- Contributed to the development and enhancement of in-house data harvesting tools (Universal Harvester, AuthTool) used for building and managing extraction scripts.
- Mentored 3 junior developers, improving team onboarding efficiency by 25%.
Associate Software Engineer
Gartner, Inc. | Bangalore, India
Aug 2022 - Jan 2023
- Built and maintained automated data collection scripts using Python, JavaScript, XPath, and CSS from diverse online sources.
- Led a critical data extraction script migration project, coordinating with 15+ team members to redesign, optimize, and ensure the reliability of data harvesting processes.
- Documented technical workflows and processes using Confluence, improving knowledge sharing and team consistency.
Data Operations Intern
Gartner, Inc. | Bangalore (Remote)
Jun 2021 - Aug 2022
- Assisted in developing web scraping scripts using Python, XPath, and CSS to extract data from diverse online sources.
- Collaborated with senior developers on a script migration project, contributing to the design and testing of web scraping spiders.
- Promoted from Data Operations Intern to Full-Time Associate at Gartner, Inc. due to significant project contributions and demonstrated value to the organization.
Skills
Programming & Databases
Python | SQL | JavaScript | HTML/CSS | RDBMS - PostgreSQL | NoSQL Concepts (Learning) | Data Modeling Concepts (Learning)
Data Engineering
Data Extraction | ETL/ELT Concepts (Learning) | Data Pipelines (Development & Maintenance) | Data Warehousing Concepts (Learning) | Apache Spark/PySpark (Learning) | Airflow (Learning) | Linux/Shell Scripting (Learning)
Cloud (AWS)
S3 | CloudWatch | Learning: Glue, Lambda, Redshift
Tools & Platforms
Git | Jira | Confluence | BitBucket | Jenkins | Redmine
Projects
Details about personal projects coming soon. Please check my GitHub profile for current work.
Certificates
- IBM Data Engineering Professional Certificate (In Progress)
- Completed: Introduction to Data Engineering, Python for Data Science, AI & Development, Python Project for Data Engineering, Introduction to Relational Databases (RDBMS), Databases and SQL for Data Science with Python
- Currently Taking: Hands-on Introduction to Linux Commands and Shell Scripting
- Microsoft Power BI Desktop for Business Intelligence (Udemy)
Education
Bachelor of Technology (B.Tech) in Mechatronics Engineering
A.P.J Abdul Kalam Technological University | Kerala, India
Graduated: Jul 2022
Higher Secondary in Computer Science
Excel Public School | Mahe, India
Graduated: Mar 2016