Arvind Nitb
Data Scientist
Python
SQL
Active 2 days ago
Download CVCV
Overview
Technical skills
Timeline
Roles
Overview
Data Engineer focused on production data platforms and governed analytics for field-analytics use cases. Built and orchestrated PySpark pipelines in Microsoft Fabric, optimized Spark performance to reduce pipeline runtime, and implemented data quality and validation frameworks. Worked with Amazon EKS, Amazon Redshift, and S3-based Parquet ingestion to support dimensional modeling and semantic-layer analytics.
Phone
Technical skills
Languages
2
Python
SQL
DevOps
8
Amazon S3
Amazon EKS
AWS
Azure
Kubernetes
Docker
Git
CI/CD
Databases
6
Amazon Redshift
Microsoft Fabric
PostgreSQL
Snowflake
Delta Lake
Databricks
Other
9
Spark
pySpark
Power BI
Airflow
Tableau
IAM
Dimensional Modeling
ETL/ELT
Self-Healing
Timeline
Data Engineer, Business Technology Solutions Associate
·
Middle
ZS Associates
·
Full-Time
Owned an end-to-end data platform for a pharmaceutical field-analytics product, covering multi-source ingestion through a governed semantic layer for analytics-ready data. Optimized a critical Spark pipeline by profiling execution, improving checkpointing, and reworking ingestion of large Parquet sources to significantly reduce runtime. Built and orchestrated multiple production PySpark pipelines in Microsoft Fabric using a metadata-driven master pipeline, improving reliability and self-healing behavior. Implemented data quality and validation checks with automated anomaly detection and modeled star-schema structures to support governed KPI analytics.
pySpark
Spark
Microsoft Fabric
Amazon EKS
Amazon Redshift
Amazon S3