{"id":3299682,"url":"https://alion.io/job/crisil-senior-data-engineer","title":"Senior Data Engineer","company":{"id":1803904,"name":"CRISIL","domain":"crisil.com","url":"https://alion.io/company/crisil","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":19000,"max_usd":42000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"GCP","optional":false},{"name":"GitLab CI","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Hadoop","optional":false},{"name":"Jenkins","optional":false},{"name":"LangChain","optional":false},{"name":"MySQL","optional":false},{"name":"OpenAI","optional":false},{"name":"Oracle","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Vertex AI","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-10-26T21:53:01Z","employer_posted_date":null,"last_verified_at":"2026-10-26T21:53:01Z","board_verified":false,"closed_at":null,"days_open":2,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":2},"description":"Implement Data Architecture: Implement scalable, secure, and efficient data architecture on on-prem and cloud platforms (Azure/GCP/AWS) to support business growth and data-driven decision-making.\nCollaborate with data engineers, and product teams to identify data requirements and develop data models that meet business needs.\nData Ingestion and Integration:\nDevelop and maintain data ingestion pipelines using various tools and technologies, such as Apache Spark, PySpark, Kafka, and Flume.\nExperience with GenAI tooling: LangChain, OpenAI API, Amazon Bedrock, or Vertex AI integrations, Claude, Copilot\nIntegrate data from multiple sources, including relational databases, NoSQL databases, APIs, and files.\nBatch and Stream Processing:\n Develop and maintain batch and stream processing pipelines using tools like Apache Spark & databricks.\nIntegrate with messaging systems, such as Apache Kafka, Amazon Kinesis, and Google Cloud Pub/Sub.\nSQL Knowledge: \nVery strong SQL knowledge, including query optimization, indexing, and database design.\nDelta Lake and Data Warehouse:\nDesign and implement Delta Lake and data warehouse/mart solutions to support business intelligence, reporting, and analytics.\nDevelop and maintain data pipelines to ingest, process, and store data in Delta Lake and data warehouses.\nDistributed Databases and Data Warehousing:\nImplement and maintain data warehouses, such as Amazon Redshift, Google BigQuery, and Azure Synapse Analytics.\nDatabase Design and Development:\nDesign, develop, and maintain efficient and scalable database systems across different platforms of relational databases (such as Oracle, MySQL, PostgreSQL, SQL Server).\nCollaborate with cross-functional teams to understand data requirements and translate them into effective database solutions.\nImplement and design data models and database schemas that align with business needs, ensuring data integrity and efficient data retrieval.\nDevelop and optimize database queries, stored procedures, and functions for maximum performance and responsiveness.\nPerformance Tuning and Optimization:\nAnalyze and monitor database performance using diagnostic tools, identifying and resolving performance bottlenecks and inefficiencies.\nOptimize data processing workflows and queries to improve performance, reduce latency, and increase throughput.\nData Management: Implement data archival mechanisms and data retention policies to ensure efficient data storage.\nEnsure the security and integrity of data by implementing access controls, data encryption, and backup and recovery strategies.\nAutomation and Integration:\nIdentify and implement automation solutions for data workflows.\nCollaborate with the development team to integrate database solutions into software applications effectively.\nData Mart and Data Lake: Design and implement data marts and data lakes to support business intelligence, reporting, and analytics.\nDevelop and maintain data pipelines to ingest, process, and store data in data lakes, such as Apache Hadoop, Amazon S3, and Azure Data Lake Storage.\nCI/CD and Automation:\n Develop and maintain automated testing, deployment, and monitoring scripts using tools like Jenkins, GitLab CI/CD, or similar.\nEnsure continuous integration and delivery of data pipelines and applications.\nData Analysis and Modeling:\nStrong data analysis skills, including data modeling, data mining, and data visualization.\nCollaborate with data modelers to develop and implement data models to drive business insights and decision-making.\nAnalyze complex data sets to identify trends, patterns, and correlations.\nExploration of New Tools:\nAbility to explore new tools and technologies, and quickly develop proof-of-concepts (POCs) for data engineering open-source tools.\nDocumentation: Document database design, configurations, and technical specifications.","description_format":"text","description_chars":3838,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Credit Bureaus & Rating Agencies","Financial Data & Market Intelligence"],"lifecycle":[{"event":"open","at":"2026-10-26T23:09:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":28,"reasons":["seen:2","velocity","win:early"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/crisil-senior-data-engineer","json_url":"https://alion.io/job/crisil-senior-data-engineer.json","meta":{"generated_at":"2026-10-29T06:13:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9456,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1803904},"rest":"https://alion.io/mcp/rest/get_company?id=1803904"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcrisil-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcrisil-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcrisil-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/crisil-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcrisil-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3299682}},{"tool":"search_jobs","arguments":{"company":"crisil.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3299682},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}