Kartikey Mullick
Girona
Summary
Experienced Data Engineer specializing in designing and managing data platforms, implementing robust data pipelines, and enhancing data processes. Skilled in working within cloud-native environments, utilizing Python, GCP, and AWS to deliver optimal results. Demonstrated expertise in efficiently translating business requirements into effective data platforms that drive organizational success.
Overview
9
9
years of professional experience
Work History
Senior Data Engineer
Passby
2021.11 - Current
- Architect and maintain fault-tolerant, resilient, and scalable SQL and Spark pipelines on Airflow for data in GCP, AWS and Snowflake processing 1 TB/day of spatio-temporal data.
- Manage GCP, AWS and Snowflake cloud environments for the complete organization with IaC tools.
- Create ML infra to sort experiments and train models at scale on distributed data.
- Integrated data quality and observability techniques, reducing data quality incidents.
- Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques.
- Maintain BI dashboards with Looker and Grafana for sharing data insights with internal stakeholders.
- Manage stakeholder relationships and data product delivery with SLAs to multiple clients.
Data Engineer
Glintsolar
2020.10 - 2021.10
- Designed GIS data pipeline in GCP using DataFlow, optimizing multi dimensional data storage in zarr format.
- Employed Python to process and analyze multi dimensional data efficiently with Dask and xarray.
- Integrated new sources of GIS data into GCS from open source rasters and shapefiles, ensuring optimal GIS data format.
- Contributed to backend development for web applications by writing optimized Cloud Functions to process GIS data
Machine Learning Engineer
Coreview Systems (Formerly Crysagi Systems)
2019.05 - 2021.09
- Led the development of data orchestration pipelines using Airflow in AWS to facilitate on-demand data transfers from various sources to AWS Redshift.
- Leveraged data analysis techniques to develop a sophisticated malware detection model, processing 500 TB of data stored in AWS Redshift.
- Led the creation of deep learning models for executing natural language test cases on web applications.
Data Analyst
Leapbike Technologies Pvt. Ltd
2018.10 - 2019.04
- Wrote and optimized SQL queries for managing and monitoring electric bike fleet databases in PostgreSQL.
- Utilized the Metabase data visualization tool to optimize operating costs and increase revenue.
- Analyzed streaming data from GPS sensors mounted on all e-bikes in the fleet.
Lab Assistant
Lastec Lab, DRDO
2015.05 - 2015.07
- Worked on basic analog signal processing, converting analog signal to digital and recovering analog signal back.
- Prepared detailed reports for presentation of results
Backend Developer
Veritas Technologies LLC
2018.01 - 2018.06
- Developed, tested and deployed data backup integrity feature from scratch in Java, in enterprise software product for data management.
- Worked in Agile software developing environment and used Git for version control.
- Explained findings and progress in weekly presentations, was commended for clear and concise method of explanation.
Education
Post Graduate Diploma - Machine Learning And AI
Birla Institute Of Technology And Science (BITS)
Pilani10.2020
Bachelor of Engineering (B.E) (Hons) - Electronics and Instrumentation
Birla Institute Of Technology And Science (BITS)
Pilani08.2017
Skills
- Python
- SQL (OLTP & OLAP)
- Databases (PostgreSQL, BigQuery, Snowflake, Redshift)
- Spark
- Bash
- Docker
- Kubernetes
- Terraform
- AWS (S3, EMR, Athena, SNS, SQS, Kinesis, IAM)
- GCP (GCS, Dataproc, PubSub, Cloud Run, VPC)
- BI Dashboards (DataStudio, Grafana)
Languages
- English (Professional fluency)
- Hindi (Native)
Timeline
Senior Data Engineer
Passby
2021.11 - Current
Data Engineer
Glintsolar
2020.10 - 2021.10
Machine Learning Engineer
Coreview Systems (Formerly Crysagi Systems)
2019.05 - 2021.09
Data Analyst
Leapbike Technologies Pvt. Ltd
2018.10 - 2019.04
Backend Developer
Veritas Technologies LLC
2018.01 - 2018.06
Lab Assistant
Lastec Lab, DRDO
2015.05 - 2015.07
Post Graduate Diploma - Machine Learning And AI
Birla Institute Of Technology And Science (BITS)
Bachelor of Engineering (B.E) (Hons) - Electronics and Instrumentation
Birla Institute Of Technology And Science (BITS)