{"id":2937982,"url":"https://alion.io/job/quantiphi-senior-data-engineer-6","title":"Senior Data Engineer","company":{"id":6155,"name":"Quantiphi","domain":"quantiphi.com","url":"https://alion.io/company/quantiphi","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":70,"open_postings":66,"ghost_share":0.5,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":32,"computed_at":"2026-10-21T05:46:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India","Mumbai, India","Thiruvananthapuram, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":47000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flask","optional":false},{"name":"GCP","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Machine Learning","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Teradata","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-20T16:34:58Z","employer_posted_date":"2026-10-20","last_verified_at":"2026-10-21T14:27:39Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":1},"description":"While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.\nIf working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!\nRole: Senior Data Engineer - Python, Spark & Databricks\nExperience Level: 4-7 Years\nWork Shift: 6:00 PM - 3:00 AM IST (US Business Hours Shift)\nWork location: Remote\nNotice Period: 0-15 days(Looking for immediate joiners or currently serving Notice period)\nRole & Responsibilities: \n ETL/ELT Data Pipeline Engineering: Design, build, and optimize scalable real-time and batch data pipelines using Python, SQL, PySpark, Spark Structured Streaming, Delta Live Tables, and Medallion Architecture (Bronze, Silver, Gold layers) for high-performance analytics.Must have hands-on experience working with terabyte-scale (TB) datasets and designing distributed data processing solutions.\nDatabricks & Lakehouse Management: Manage Databricks workflows, clusters, and Delta Lake. Implement Unity Catalog for metadata management, fine-grained access control, OAuth-based authentication, and enterprise security compliance.\n Cloud Infrastructure & Migration: Experience working with at least one major cloud platform (GCP, AWS, or Azure). Lead cloud migrations from legacy databases (Oracle, Teradata, SQL Server) to cloud environments (GCS, AWS S3, Azure Data Lake Storage, Snowflake, Redshift).\nCI/CD & DevOps Automation: Build end-to-end CI/CD pipelines using Terraform and GitHub Actions to automate data pipeline deployments, infrastructure provisioning, and proactive monitoring.\nWeb Services & Application Scripting: Develop and deploy custom data processing scripts and data-driven APIs using Python and web frameworks like Flask.\nContainerization & Innovation: Utilize Docker for containerized processing and evaluate emerging technologies for data-intensive machine learning tasks.\nStakeholder Collaboration: Work closely with business stakeholders and cross-functional engineering teams to translate business requirements into technical architectures and data-driven insights.\nSkills expectations:\nCore Data Engineering & Big Data: Advanced hands-on experience in Python, SQL, PySpark, and expert-level SQL query optimization for massive datasets.\nDatabricks Expertise: Strong proficiency in Databricks functionalities, including Workflows, Unity Catalog, Delta Lake, and Delta Live Tables.\n Cloud Platform Services: Deep familiarity across major cloud environments (GCP, AWS S3/Redshift, Azure ADLS Gen2).\nDevOps & Infrastructure: Solid experience in Terraform, GitHub Actions, Docker, and CI/CD best practices for data platforms.\nWeb Frameworks: Practical experience with Python web frameworks such as Flask.\n Collaborative & Agile Mindset: Strong problem-solving, communication, and ownership skills to guide projects and mentor team members in a fast-paced environment.\nIf you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!","description_format":"text","description_chars":3195,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Consulting & Integration","Document AI","Cloud Consulting & Migration","Data Engineering & Migration Services"],"lifecycle":[{"event":"open","at":"2026-10-20T16:34:58Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":32,"reasons":["conf:3","stale_co","velocity","win:early"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/quantiphi-senior-data-engineer-6","json_url":"https://alion.io/job/quantiphi-senior-data-engineer-6.json","meta":{"generated_at":"2026-10-21T19:50:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":28091,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6155},"rest":"https://alion.io/mcp/rest/get_company?id=6155"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fquantiphi-senior-data-engineer-6"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fquantiphi-senior-data-engineer-6"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fquantiphi-senior-data-engineer-6"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/quantiphi-senior-data-engineer-6\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fquantiphi-senior-data-engineer-6"}]}