{"id":3268272,"url":"https://alion.io/job/partex-leadprincipal-data-engineer-data-engineering","title":"Lead/Principal Data Engineer - Data Engineering","company":{"id":63175,"name":"Partex","domain":"partex.ai","url":"https://alion.io/company/partex","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":29000,"max_usd":61000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"ArangoDB","optional":false},{"name":"Docker","optional":false},{"name":"ElasticSearch","optional":false},{"name":"Knowledge Graph","optional":false},{"name":"Kubernetes","optional":false},{"name":"Neo4j","optional":false},{"name":"Python","optional":false},{"name":"Scrapy","optional":false},{"name":"Spark","optional":false},{"name":"Databricks","optional":true},{"name":"Google BigQuery","optional":true},{"name":"Hadoop","optional":true},{"name":"LLM","optional":true},{"name":"Snowflake","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-10-26T10:21:17Z","employer_posted_date":null,"last_verified_at":"2026-10-26T10:21:17Z","board_verified":false,"closed_at":null,"days_open":5,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":5},"description":"Role snapshot:\n\nAbout Partex.AI:\n\nPartex.AI works at the intersection of artificial intelligence and healthcare. We help leading life-sciences and healthcare organizations speed up medical research, diagnostics and therapeutic development through data-driven intelligence.\n\nWe are a fast-growing company with a global outlook and a focus on real-world impact. Our Data & AI team of 40+ engineers is scaling quickly, and we are building the leadership layer that will take it to the next stage.\n\nAbout the role:\n\nYou will own the data platform that powers our AI products: large-scale crawling and ingestion, processing pipelines, storage, and the data behind our knowledge graph. You will lead a team of data engineers and be accountable for a platform that is reliable, scalable and cost-efficient.\n\nThis is a hands-on leadership role. You will set the architecture, stay close to the code, and work with data science and AI engineering teams so they get the data they need, when they need it.\n\nPosition:\n\nLead / Principal Data Engineer (1 opening)\n\nLocation:\n\nPune, India\n\nReporting to:\n\nHead of Data & AI\n\nExperience:\n\n10+ years in data or backend engineering, including 3+ years leading engineers\n\nLevel:\n\nLead or Principal, based on depth of experience\n\nKey responsibilities:\n\nTechnical ownership:\n\n- Own the architecture of the data platform: ingestion, distributed crawling, batch and streaming pipelines, and our MongoDB and Elasticsearch data warehouse.\n\n- Design and scale data pipelines that process large volumes of structured and unstructured healthcare and life-sciences data.\n\n- Lead the data side of knowledge graph integration, including entity resolution, graph modelling and loading into graph databases.\n\n- Set standards for data quality, lineage, monitoring, testing and documentation.\n\n- Identify and fix performance, scalability and cost issues across the platform.\n\n- Choose tools and infrastructure, and keep the stack current and maintainable.\n\nTeam leadership and delivery:\n\n- Lead a team of data engineers: sprint planning, task allocation and day-to-day unblocking.\n\n- Own delivery for your projects, including tracking progress, managing risks and giving status updates to stakeholders.\n\n- Review code and designs, and raise the engineering bar of the team.\n\n- Mentor engineers, run regular 1:1s and support their growth plans.\n\n- Interview and hire for your team.\n\nBusiness and clients:\n\n- Design data architecture for client pitches and support technical due diligence.\n\n- Work with data science and AI engineering leads to plan data needs for new products.\n\nMust-have qualifications:\n\n- 10+ years in data or backend engineering, with at least 3 years leading a team of engineers.\n\n- Strong Python and solid computer science fundamentals: data structures, algorithms and system design.\n\n- Experience designing and running large-scale distributed crawling and ingestion, for example with Scrapy.\n\n- Hands-on experience with distributed processing such as Spark, Kafka or similar.\n\n- Deep production expertise in MongoDB and Elasticsearch, the core of our data warehouse: data modelling, index and mapping design, query performance, sharding and scaling. Experience with at least one graph database such as Neo4j or ArangoDB.\n\n- Experience with pipeline orchestration (Airflow or similar), Docker, Kubernetes and a major cloud platform.\n\n- Proven ownership of delivery: planning, estimation and keeping stakeholders informed.\n\n- Bachelor's or Master's degree in Computer Science or Engineering, or equivalent experience.\n\nNice-to-have qualifications:\n\n- Experience with healthcare, life-sciences or biomedical data sources.\n\n- Experience with lakehouse or warehouse platforms such as Databricks, Snowflake or BigQuery.\n\n- Experience preparing data for ML and LLM workloads, including vector databases and embedding pipelines.\n\n- Familiarity with data governance and compliance for sensitive data.\n\n- Infrastructure-as-code experience with Terraform or similar.\n\nSkills\nData Engineering, Python, MongoDB, ElasticSearch, Hadoop, Spark, Kafka","description_format":"text","description_chars":4069,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Biotechnology","Bioinformatics","Knowledge Graphs","Drug Discovery AI"],"lifecycle":[{"event":"open","at":"2026-10-26T10:29:35Z"}],"visa":[],"liveness":{"score":85,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.855,"p_room":1,"age_days":4,"expected_fill_days":28,"reasons":["seen:4","win:early"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/partex-leadprincipal-data-engineer-data-engineering","json_url":"https://alion.io/job/partex-leadprincipal-data-engineer-data-engineering.json","meta":{"generated_at":"2026-10-31T17:16:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27068,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":63175},"rest":"https://alion.io/mcp/rest/get_company?id=63175"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpartex-leadprincipal-data-engineer-data-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpartex-leadprincipal-data-engineer-data-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpartex-leadprincipal-data-engineer-data-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/partex-leadprincipal-data-engineer-data-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpartex-leadprincipal-data-engineer-data-engineering"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3268272}},{"tool":"search_jobs","arguments":{"company":"partex.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3268272},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}