Senior Data Engineer
Smart Apply
Similar jobs
Salary
≈ $19k – $42k per year (Estimated)
Location
In office (Pune)
Seniority
Senior
Employment
Full-Time
First seen by Alion on Oct 26, 2026.
Overview
Company
Impact
Profile match
Crisil is an agile and innovative, global analytics company driven by its mission of making markets function better.
- Implement Data Architecture: Implement scalable, secure, and efficient data architecture on on-prem and cloud platforms (Azure/GCP/AWS) to support business growth and data-driven decision-making.
- Collaborate with data engineers, and product teams to identify data requirements and develop data models that meet business needs.
- Data Ingestion and Integration:
- Develop and maintain data ingestion pipelines using various tools and technologies, such as Apache Spark, PySpark, Kafka, and Flume.
- Experience with GenAI tooling: LangChain, OpenAI API, Amazon Bedrock, or Vertex AI integrations, Claude, Copilot
- Integrate data from multiple sources, including relational databases, NoSQL databases, APIs, and files.
- Batch and Stream Processing:
- Develop and maintain batch and stream processing pipelines using tools like Apache Spark & databricks.
- Integrate with messaging systems, such as Apache Kafka, Amazon Kinesis, and Google Cloud Pub/Sub.
- SQL Knowledge:
- Very strong SQL knowledge, including query optimization, indexing, and database design.
- Delta Lake and Data Warehouse:
- Design and implement Delta Lake and data warehouse/mart solutions to support business intelligence, reporting, and analytics.
- Develop and maintain data pipelines to ingest, process, and store data in Delta Lake and data warehouses.
- Distributed Databases and Data Warehousing:
- Implement and maintain data warehouses, such as Amazon Redshift, Google BigQuery, and Azure Synapse Analytics.
- Database Design and Development:
- Design, develop, and maintain efficient and scalable database systems across different platforms of relational databases (such as Oracle, MySQL, PostgreSQL, SQL Server).
- Collaborate with cross-functional teams to understand data requirements and translate them into effective database solutions.
- Implement and design data models and database schemas that align with business needs, ensuring data integrity and efficient data retrieval.
- Develop and optimize database queries, stored procedures, and functions for maximum performance and responsiveness.
- Performance Tuning and Optimization:
- Analyze and monitor database performance using diagnostic tools, identifying and resolving performance bottlenecks and inefficiencies.
- Optimize data processing workflows and queries to improve performance, reduce latency, and increase throughput.
- Data Management: Implement data archival mechanisms and data retention policies to ensure efficient data storage.
- Ensure the security and integrity of data by implementing access controls, data encryption, and backup and recovery strategies.
- Automation and Integration:
- Identify and implement automation solutions for data workflows.
- Collaborate with the development team to integrate database solutions into software applications effectively.
- Data Mart and Data Lake: Design and implement data marts and data lakes to support business intelligence, reporting, and analytics.
- Develop and maintain data pipelines to ingest, process, and store data in data lakes, such as Apache Hadoop, Amazon S3, and Azure Data Lake Storage.
- CI/CD and Automation:
- Develop and maintain automated testing, deployment, and monitoring scripts using tools like Jenkins, GitLab CI/CD, or similar.
- Ensure continuous integration and delivery of data pipelines and applications.
- Data Analysis and Modeling:
- Strong data analysis skills, including data modeling, data mining, and data visualization.
- Collaborate with data modelers to develop and implement data models to drive business insights and decision-making.
- Analyze complex data sets to identify trends, patterns, and correlations.
- Exploration of New Tools:
- Ability to explore new tools and technologies, and quickly develop proof-of-concepts (POCs) for data engineering open-source tools.
- Documentation: Document database design, configurations, and technical specifications.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,995,566 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Pune
Snowflake Developer - Data Engineering
2 hours ago
≈ $15k – $39k per year (Estimated) • In office • 4+ years exp • Bengaluru
Python
SQL
Python
pySpark
Databases
Snowflake
AI/ML
Spark
dbt
DevOps
Prometheus
Azure
CI/CD
Git
AWS
Cortex
Analytics
ETL/ELT
Management
Agile
Apply
Snowflake Senior Data Engineer
2 hours ago
≈ $19k – $40k per year (Estimated) • In office • Chennai
Python
SQL
Databases
Snowflake
Analytics
ETL/ELT
Apply
GCP Senior Data Engineer
2 hours ago
≈ $19k – $42k per year (Estimated) • In office • 5+ years exp • Bachelor's Degree • Pune
Python
SQL
AI/ML
Hadoop
Spark
Machine Learning
DevOps
GCP
CI/CD
Analytics
ETL/ELT
Apply
Oracle Database Administrator
2 days ago
≈ $16k – $33k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Pune
SQL
Databases
Oracle
AI/ML
Exa
DevOps
Azure
Management
Jira
ServiceNow
Agile
Scrum
ITIL
Apply
GCP Data Engineer
2 hours ago
≈ $10k – $27k per year (Estimated) • In office • 3+ years exp • Hyderabad
Python
Java
SQL
Databases
Google BigQuery
AI/ML
Machine Learning
DevOps
GCP
Analytics
ETL/ELT
Management
Agile
Apply
Senior Ab Initio Developer
1 day ago
≈ $19k – $40k per year (Estimated) • Hybrid • 5+ years exp • Pune
SQL
Databases
Teradata
DevOps
Linux
Unix
Analytics
ETL/ELT
Management
Agile
Apply
Azure Data Engineer - (Snowflake & ADB)
1 day ago
≈ $13k – $35k per year (Estimated) • Hybrid • 3+ years exp • Pune
Python
SQL
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
AI/ML
Spark
DevOps
Azure DevOps
Azure
CI/CD
Git
Analytics
ETL/ELT
Azure Data Factory
Dimensional Modeling
Management
Agile
Apply
Lead Data Scientist
1 day ago
≈ $37k – $80k per year (Estimated) • In office • 7+ years exp • Bengaluru • Pune
Python
SQL
Python
Hypothesis
AI/ML
Machine Learning
DevOps
GCP
Azure
AWS
Analytics
Tableau
Power BI
Apply
Sr. Data Engineer
1 day ago
≈ $20k – $43k per year (Estimated) • In office • 3+ years exp • Pune
Python
SQL
Databases
Apache Kafka
Google BigQuery
AI/ML
Great Expectations
DevOps
GCP
Analytics
ETL/ELT
Apply
Azure Backend Lead
1 day ago
≈ $21k – $51k per year (Estimated) • In office • Pune
DevOps
Azure
CI/CD
Apply
This is one of many
1,995,566 more open roles from verified company boards, updated every day.