{"id":1265834,"url":"https://alion.io/job/clarivate-lead-product-ai-data-engineer","title":"Lead Product AI Data Engineer","company":{"id":5458,"name":"Clarivate","domain":"clarivate.com","url":"https://alion.io/company/clarivate","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":75,"open_postings":16,"ghost_share":0.063,"stale_share":0.813,"repost_share":0.063,"time_to_fill_p50_days":28,"computed_at":"2026-10-15T05:46:00Z"}},"role":"Product","role_family":"Product","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":28000,"max_usd":50000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":11},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Embeddings","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Machine Learning","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"LLM","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-09-09T05:12:53Z","employer_posted_date":null,"last_verified_at":"2026-09-09T05:12:53Z","board_verified":false,"closed_at":null,"days_open":36,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":36},"description":"About the Role:\n\nWe are seeking a Lead Product AI Data Engineer to take ownership of the development of data engineering and AI capabilities within our healthcare-focused product ecosystem.\n\nThe role is highly hands-on and suited for an engineer who can independently design and develop scalable data pipelines while contributing to AI-enabled features, machine learning workflows, and intelligent data applications.\n\nYou will collaborate with product, analytics, data science, and engineering teams to convert complex datasets into reliable product capabilities.\n\nKey Responsibilities:\n\n- Develop and maintain scalable data pipelines supporting AI-enabled healthcare and medical device products.\n\n- Build data ingestion, transformation, processing, and integration workflows using Python and PySpark.\n\n- Develop ETL/ELT pipelines and workflow orchestration using Apache Airflow.\n\n- Implement data processing and storage solutions using Databricks, Snowflake, and Delta Lake.\n\n- Write optimized SQL queries and develop data models for analytical and product workloads.\n\n- Create reusable data pipelines for machine learning and AI use cases.\n\n- Work with Data Scientists to prepare training datasets, implement feature engineering workflows, and integrate ML models into production applications.\n\n- Support the implementation of Generative AI features using LLMs, RAG, embeddings, vector databases, and AI APIs.\n\n- Contribute to the development of AI agents and intelligent workflows for data-driven product use cases.\n\n- Build data preparation and retrieval workflows for enterprise AI applications.\n\n- Implement data validation, quality checks, monitoring, and pipeline observability.\n\n- Troubleshoot pipeline failures, data issues, performance bottlenecks, and production incidents.\n\n- Deploy and operate data workloads on AWS or Azure cloud environments.\n\n- Participate in technical design and architecture discussions and contribute practical implementation recommendations.\n\n- Conduct code reviews and promote clean, maintainable, and scalable engineering practices.\n\n- Work closely with Product Managers, Data Scientists, Analysts, and other engineers to understand product requirements and deliver solutions.\n\nTechnical Skills:\n\n- Strong hands-on programming experience in Python.\n\n- Good experience with PySpark and distributed data processing.\n\n- Hands-on experience with Snowflake, Databricks, and Delta Lake.\n\n- Experience building and managing Airflow workflows.\n\n- Strong SQL skills and experience with databases such as PostgreSQL, Oracle, Snowflake, or Databricks.\n\n- Working knowledge of AWS or Azure cloud platforms.\n\n- Understanding of data engineering concepts including ETL/ELT, data modeling, data quality, pipeline optimization, and distributed processing.\n\n- Exposure to Generative AI, LLMs, RAG, vector databases, embeddings, or AI agents.\n\n- Understanding of machine learning data pipelines and basic MLOps concepts.\n\n- Exposure to specification-driven development approaches such as SpecKit or OpenSpec is an advantage.\n\nPreferred Domain Experience:\n\n- Experience with Healthcare, Life Sciences, Pharmaceutical, Biotechnology, or Medical Device data is desirable.\n\n- Awareness of data privacy, security, governance, and regulatory considerations is an advantage.\n\nQualifications:\n\n- Bachelor's degree or equivalent qualification in Computer Science, Software Engineering, Data Engineering, Artificial Intelligence, or a related discipline.\n\n- 5 - 7 years of experience in data engineering, software engineering, AI engineering, or related technical roles.\n\n- Strong problem-solving skills with the ability to independently own technical deliverables.\n\n- Good communication and collaboration skills with cross-functional teams.\n\nSuccess in this Role:\n\n- Success will be measured by the quality and reliability of data pipelines, successful delivery of AI-enabled product features, pipeline performance, production stability, engineering efficiency, and the ability to translate product requirements into scalable technical solutions.\nSkills\nData Engineering, Python, PySpark, Snowflake DB, Databricks, Apache Airflow, Generative AI, LLM, AI Integration, Data Pipeline, ETL","description_format":"text","description_chars":4198,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Providers & Datasets","Scientific & Lab Software"],"lifecycle":[{"event":"open","at":"2026-09-25T22:00:00Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":0.6,"p_active":0.48,"p_room":0.55,"age_days":36,"expected_fill_days":28,"reasons":["seen:36","stale_co","velocity","win:tail","comp:brand"],"computed_at":"2026-10-15T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/clarivate-lead-product-ai-data-engineer","json_url":"https://alion.io/job/clarivate-lead-product-ai-data-engineer.json","meta":{"generated_at":"2026-10-15T14:33:53Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":22268,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5458},"rest":"https://alion.io/mcp/rest/get_company?id=5458"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fclarivate-lead-product-ai-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fclarivate-lead-product-ai-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fclarivate-lead-product-ai-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/clarivate-lead-product-ai-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fclarivate-lead-product-ai-data-engineer"}]}