{"id":3289603,"url":"https://alion.io/job/firmable-senior-data-engineer-data-platform","title":"Senior Data Engineer - Data Platform","company":{"id":14688,"name":"Firmable","domain":"firmable.ai","url":"https://alion.io/company/firmable","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_company_offices","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":89000,"max_usd":201000,"period":"year","method":"global_role_seniority_cell","sample_n":2679},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon ECS","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Braintrust","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude Code","optional":false},{"name":"Cursor","optional":false},{"name":"dbt","optional":false},{"name":"Embeddings","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GDPR","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"Promptfoo","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SOC 2","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Structured Outputs","optional":false}],"status":"live","first_seen_at":"2026-10-10T23:30:06Z","employer_posted_date":null,"last_verified_at":"2026-10-10T23:30:06Z","board_verified":false,"closed_at":null,"days_open":20,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":20},"description":"Firmable is the market-leading B2B sales intelligence platform in Asia Pacific — and we're scaling that success globally at pace. Backed by leading investors and 2,000+ customers strong, we exist to give sales teams an unfair advantage: the deepest company and people data of any platform, enriched with real-time signals, served at the right moment by intelligent agents.\nOur data is the product. Building it now means building with LLMs in the pipeline, and setting the standard for when to trust them.\nThe RoleAs Senior Data Engineer — Data Platform, you'll architect the transformation and warehouse layer that turns billions of raw records into the world's most accurate B2B dataset, and design how LLM-based extraction, enrichment, and validation run inside it as production infrastructure.\nYou make the architecture calls: model design and materialisation, warehouse cost and performance, orchestration patterns the team builds on, and the rule-vs-LLM standard for every quality and enrichment step. You know when a dbt test does the job, when an LLM check is needed, and when both belong together.\nThis is hands-on senior engineering with sharp architecture judgement. You write the reference implementation, then the team builds on it.\nWhat You'll Own\nLLM-in-the-pipeline architecture — the patterns for extraction, enrichment, entity resolution, and semantic validation over millions of records a day: structured outputs, retries, human-review fallbacks, and the abstractions others reuse\n\nEval harnesses — design the labelled sets, scorers, judge calibration, and regression suites that gate every prompt or model change; own precision/recall targets per check\n\nThe rule-vs-LLM standard — deterministic checks (dbt tests, data contracts, SQL) wherever structure allows; LLMs only where semantic judgement is needed; codified so the team can apply it without you\n\nCost and drift — token budgets per pipeline, model routing (cheap models for classification, stronger ones for hard cases), drift detection on vendor updates, and the token math behind the ceilings\n\nObservability — every LLM call logged with prompt version, model, cost, latency, and decision, alongside pipeline alerting that surfaces problems before they cascade\n\nWarehouse and transformation architecture — dbt layers that encode real business logic; Snowflake performance, clustering, materialisation, and cost over billions of rows\n\nOrchestration and infrastructure — Airflow patterns for recovery and cost-aware scheduling; AWS infrastructure as code\n\nMatching and deduplication — embeddings and retrieval patterns for company and people entity resolution across 13 markets\n\nCross-functional voice — technical voice for the platform in architecture decisions with sourcing, data quality, product, and analytics\n\nWhat We're Looking ForMust Haves\n5+ years building production data platforms in business-critical environments, with architecture you've owned end to end and 2+ years experience with Snowflake\n\nWorked with billions of rows — you know what breaks at that scale and how to design pipelines and checks that don't\n\nShipped LLMs inside data pipelines as production systems — extraction, enrichment, or validation with structured outputs, versioned prompts, and labelled eval sets. You can show the repo\n\nDesigned eval harnesses others depend on — scorers, labelled sets, judge calibration, regression suites; you can talk through what they caught and what they missed\n\nSharp judgement on rules vs. LLMs — you reach for a dbt test or SQL first, defend the call either way, and have codified the standard for a team\n\nExpert Python and SQL — production-grade, performance-aware, comfortable at very large scale\n\nExpert dbt and Snowflake — modular transformation layers with real business logic; warehouse design, query optimisation, clustering, RBAC, cost at scale\n\nExtensive Airflow — orchestration, dependency management, recovery patterns, cost optimisation in production\n\nSolid AWS — S3, Lambda, Glue, ECS, RDS\n\nAI coding tools are how you work — Claude Code, Cursor, or equivalent, daily, with real shipped work to show for it\n\nArchitecture judgement and a product mindset — when to refactor, optimise, ship, or redesign; you care how data quality lands with customers, not just uptime\n\nHighly Valued\nEval frameworks (Braintrust, Promptfoo, Inspect) and LLM tracing (Logfire, OpenTelemetry)\n\nEmbeddings, vector search, or fuzzy matching for entity resolution at scale\n\nFine-tuning or distilling small models to replace expensive LLM calls\n\ndbt Cloud and CI/CD for data pipelines\n\nSpark or PySpark; streaming (Kafka, Kinesis, Snowpipe Streaming)\n\nB2B data: firmographics, people data, company registries\n\nData privacy and compliance (GDPR, SOC2, CCPA)\n\nHow We BuildFirmable is an AI-native organisation. AI coding tools, automated testing, and AI-assisted review are how we work by default. Every LLM check ships with a labelled eval set, measured precision/recall, and a prompt version you can roll back. Every LLM call in production is logged from day one; retrofitting later is not the plan.\nWe run lean and ship fast — small senior teams, no layers, minimal process, weekly releases moving toward daily. Teams own their stack end to end. There are no fixed hours and no handholding. If you're not already working this way, this role isn't right for you.\nWhy This Role\nLLMs as production infrastructure — not a demo, not a notebook; models making millions of decisions a day on data customers pay for, and you set how they ship\n\nGreenfield architecture — eval harnesses, drift detection, cost controls, and the rule-vs-LLM standard for the warehouse are largely unbuilt; you'll architect them\n\nScale that matters — billions of rows, 13 markets, and a dataset nobody else has\n\nSmall team, massive leverage — your architecture reaches every Firmable customer, every day\n\nCompetitive base + meaningful equity — a share in the upside we're building toward\n\nFirmable is an equal opportunity employer. We believe diverse teams build better products.\nReady to architect the AI-native data platform behind the world's smartest B2B sales intelligence platform? Apply now — let's talk!\nOriginally posted on Himalayas","description_format":"text","description_chars":6197,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Sales Enablement","Lead Generation","Marketing & Sales AI"],"lifecycle":[{"event":"open","at":"2026-10-26T19:11:04Z"}],"visa":[],"liveness":{"score":50,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.783,"p_room":0.75,"age_days":20,"expected_fill_days":22,"reasons":["seen:20","velocity","win:late"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/firmable-senior-data-engineer-data-platform","json_url":"https://alion.io/job/firmable-senior-data-engineer-data-platform.json","meta":{"generated_at":"2026-10-31T08:16:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12291,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":14688},"rest":"https://alion.io/mcp/rest/get_company?id=14688"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffirmable-senior-data-engineer-data-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffirmable-senior-data-engineer-data-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffirmable-senior-data-engineer-data-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/firmable-senior-data-engineer-data-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffirmable-senior-data-engineer-data-platform"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3289603}},{"tool":"search_jobs","arguments":{"company":"firmable.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3289603},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}