{"id":3677545,"url":"https://alion.io/job/clearwater-senior-software-engineer","title":"Senior Software Engineer","company":{"id":3868529,"name":"Clearwater","domain":"clearwatersecurity.com","url":"https://alion.io/company/clearwatersecurity","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"Docker","optional":false},{"name":"Embeddings","optional":false},{"name":"GCP","optional":false},{"name":"Hybrid Search","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"OpenSearch","optional":false},{"name":"pgvector","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Reranking","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Databricks","optional":true},{"name":"ETL/ELT","optional":true},{"name":"Google BigQuery","optional":true},{"name":"HIPAA","optional":true},{"name":"JavaScript","optional":true},{"name":"Knowledge Graph","optional":true},{"name":"LLMOps","optional":true},{"name":"PostgreSQL","optional":true},{"name":"SIEM","optional":true},{"name":"Snowflake","optional":true},{"name":"SOC 2","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-11-03T11:35:00Z","employer_posted_date":null,"last_verified_at":"2026-11-03T11:35:00Z","board_verified":false,"closed_at":null,"days_open":2,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":2},"description":"You'll build the data and retrieval foundation that makes Clearwater's AI agents accurate, grounded, and measurable. This is a hands-on software engineering role, not a research role: you'll write production pipelines and services, build retrieval and evaluation systems, and ship the product surfaces that expose them. You'll work across security and threat data at scale.\n\nResponsibilities: \nBuild and operate data pipelines (batch and streaming) that ingest, normalize, and enrich large volumes of security and telemetry data.\nDesign retrieval systems for agents: chunking, embeddings, hybrid search, reranking, vector and graph stores, and freshness and access control.\nBuild evaluation harnesses and datasets to measure agent and retrieval quality, regressions, and cost.\nBuild backend APIs and services in Python and the full-stack features that surface data and AI insights to users.\nDesign data models and manage relational, analytical, and vector stores for performance and cost.\nAdd data quality checks, lineage, observability, and governance, including PII and sensitive data handling.\nUse AI agents to automate data engineering work such as pipeline generation, data validation, and documentation.\nContainerize and deploy on Kubernetes and the cloud with CI/CD, and mentor engineers on data and AI practices.\n\nFirst 12 months: \nShip production pipelines and retrieval services with clear quality and reliability targets.\nDeliver a retrieval and evaluation framework that measurably improves agent accuracy.\nEstablish the team's patterns for data quality, grounding, and sensitive-data handling.\n\nRequirements: \n4+ years of professional software engineering with strong data-engineering exposure and sound testing and CI/CD practices.\n1+ year building production systems involving LLMs, retrieval (RAG), or large-scale data pipelines.\nStrong Python and SQL, including query optimization and data modeling.\nHands-on with pipeline or stream-processing tooling such as Airflow, Dagster, Spark, or Kafka, or an equivalent.\nExperience with vector stores and retrieval design (pgvector, OpenSearch, or similar), and with evaluating retrieval quality.\nDocker, working Kubernetes knowledge, and experience on AWS, Azure, or GCP.\n\nNice to have: \nWorking JavaScript/TypeScript, enough to build and ship full-stack features.\nExperience with security, threat intelligence, or SIEM/telemetry data.\nHealthcare or compliance-driven data experience (HIPAA, SOC 2, HITRUST).\nKnowledge graphs or graph databases.\nLLMOps and evaluation tooling experience.\nExperience with a lakehouse or warehouse such as Snowflake, Databricks, or BigQuery.\nOpen-source contributions or public data or retrieval projects.\nSkills\nAirflow, Dagster, ETL, Kafka, Python, SQL, Spark","description_format":"text","description_chars":2752,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Health Care"],"lifecycle":[{"event":"open","at":"2026-11-03T11:35:00Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":36,"reasons":["seen:1","win:early"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/clearwater-senior-software-engineer","json_url":"https://alion.io/job/clearwater-senior-software-engineer.json","meta":{"generated_at":"2026-11-05T18:19:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24151,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3868529},"rest":"https://alion.io/mcp/rest/get_company?id=3868529"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fclearwater-senior-software-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fclearwater-senior-software-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fclearwater-senior-software-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/clearwater-senior-software-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fclearwater-senior-software-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3677545}},{"tool":"search_jobs","arguments":{"company":"clearwatersecurity.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3677545},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}