Data Scientist
Python
SQL
Active 10 days ago
Invite to interview
Download CVCV
Overview
Technical skills
Timeline
Roles
Overview
Data Engineer with about 3 years of experience building scalable ETL/ELT pipelines, data transformations, and analytics-ready datasets. Hands-on with Python, SQL, Apache Airflow, PySpark, Databricks, dbt, and cloud data platforms including GCP (BigQuery) and AWS (S3/Glue), with added containerization and monitoring using Docker/Kubernetes and Prometheus/Grafana.
Phone
Technical skills
Languages
2
Python
SQL
Databases
5
Google BigQuery
Snowflake
PostgreSQL
MySQL
Databricks
DevOps
13
Kubernetes
GCP
Amazon S3
Grafana
AWS Lambda
Docker
GitLab
Prometheus
Rest API
GitLab CI
CI/CD
IAM
AWS
AI/ML
4
Airflow
Pandas
Spark
dbt
Other
6
pySpark
AWS Glue
GDPR
ETL/ELT
BigQuery
Jenkins
Timeline
Data Engineer
•
Middle
Metro Labs Pvt Ltd
•
Full-Time
Built scalable ETL/ELT pipelines to ingest and transform data from relational databases, REST APIs, and flat files. Implemented data validation and profiling to improve data quality, and used orchestration with Apache Airflow for reliable scheduled workflows. Developed warehouse and analytics data models, including dbt transformations, and optimized SQL and pipeline performance for large datasets. Supported cloud data platform migration toward Snowflake and BigQuery and added monitoring/alerting with Prometheus and Grafana.
Python
SQL
Airflow
pySpark
Databricks
Pandas
ETL/ELT
AWS Glue
dbt
GitLab
GitLab CI
CI/CD
Docker
Kubernetes
Prometheus
Grafana
Amazon S3
AWS Lambda
Google BigQuery
Snowflake
GCP
PostgreSQL
MySQL
Rest API
IAM
GDPR
Spark
