{"id":3289628,"url":"https://alion.io/job/firmable-data-engineer-data-platform","title":"Data Engineer - Data Platform","company":{"id":14688,"name":"Firmable","domain":"firmable.ai","url":"https://alion.io/company/firmable","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon ECS","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Claude Code","optional":false},{"name":"Cursor","optional":false},{"name":"dbt","optional":false},{"name":"Embeddings","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GDPR","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SOC 2","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Structured Outputs","optional":false}],"status":"live","first_seen_at":"2026-10-10T00:27:31Z","employer_posted_date":null,"last_verified_at":"2026-10-10T00:27:31Z","board_verified":false,"closed_at":null,"days_open":19,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":19},"description":"Firmable is the market-leading B2B sales intelligence platform in Asia Pacific — and we're scaling that success globally at pace. Backed by leading investors and 2,000+ customers strong, we exist to give sales teams an unfair advantage: the deepest company and people data of any platform, enriched with real-time signals, served at the right moment by intelligent agents.\nOur data is the product. Building it now means building with LLMs in the pipeline, and knowing exactly when to trust them.\nThe RoleAs Data Engineer — Data Platform, you'll build the pipelines that turn billions of raw records into the clean, modelled datasets our product, analytics, and AI systems depend on. Some of that is classic data engineering: SQL, dbt, orchestration, warehouse performance. A growing share is not: LLM-based extraction, enrichment, and validation running inside the pipeline at scale.\nThe hard part isn't calling a model. It's making a probabilistic component behave like a reliable one: labelled eval sets, precision and recall you can measure, versioned prompts, cost ceilings, and the harnesses that catch regressions when a vendor silently changes the model under you.\nThis is a hands-on engineering role with real ownership. You'll own reliability, cost, and whether downstream consumers can trust the data, whether it came from a SQL join or a language model.\nWhat You'll Own\nLLM-in-the-pipeline systems — extraction, enrichment, entity resolution, and semantic validation steps that run over millions of records a day with structured outputs, retries, and human-review fallbacks\n\nEval harnesses — labelled sets, scorers, and regression suites that gate every prompt or model change; precision/recall tracked per check, not vibes\n\nRules vs. LLMs — deterministic checks (dbt tests, data contracts, SQL) wherever structure allows; LLMs where semantic judgement is needed; the discipline to know which is which\n\nCost and drift — token budgets per pipeline, model routing (cheap models for classification, stronger ones for hard cases), drift detection on vendor updates\n\nObservability — every LLM call logged with prompt version, model, cost, latency, and decision, alongside standard pipeline alerting that surfaces problems before they cascade\n\nCore pipelines and warehouse — Airflow orchestration, dbt models across staging to mart, Snowflake performance and cost over billions of rows, AWS infrastructure as code\n\nMatching and deduplication — embeddings and retrieval patterns for company and people entity resolution across 13 markets\n\nWhat We're Looking ForMust Haves\n3+ years in data engineering or data infrastructure, with production pipelines you've owned end to end and 2+ years experience with Snowflake\n\nStrong Python and SQL — production-grade, performance-aware, comfortable at very large scale\n\nShipped LLMs inside data pipelines — extraction, enrichment, or validation in production, with structured outputs and a labelled eval set that tells you where the model gets it wrong\n\nHarness engineering experience — you've built or maintained eval or test harnesses for LLM outputs, and you can talk through what they caught\n\nSharp judgement on rules vs. LLMs — you reach for a regex or a dbt test first and can defend the call either way\n\nProduction dbt and Airflow — modular, tested models; DAGs that recover gracefully\n\nCloud warehouse experience — Snowflake preferred; schema design, query optimisation, cost management\n\nAI coding tools are how you work — Claude Code, Cursor, or equivalent, daily, with real shipped work to show for it\n\nOwnership and systems thinking — you weigh upstream dependencies and downstream impact before changing anything\n\nHighly Valued\nEval frameworks and LLM tracing (Logfire, OpenTelemetry)\n\nEmbeddings, vector search, or fuzzy matching for entity resolution at scale\n\nFine-tuning or distilling small models to replace expensive LLM calls\n\nAWS at scale (S3, Lambda, Glue, ECS, RDS) and PostgreSQL\n\nSpark or PySpark; streaming (Kafka, Kinesis, Snowpipe Streaming)\n\nData privacy and compliance (GDPR, SOC2, CCPA)\n\nHow We BuildFirmable is an AI-native organisation. AI coding tools, automated testing, and AI-assisted review are how we work by default. Every LLM check ships with a labelled eval set, measured precision/recall, and a prompt version you can roll back. Every LLM call in production is logged from day one; retrofitting later is not the plan.\nWe run lean and ship fast — small senior teams, no layers, minimal process, weekly releases moving toward daily. Teams own their stack end to end. There are no fixed hours and no handholding. If you're not already working this way, this role isn't right for you.\nWhy This Role\nLLMs as production infrastructure — not a demo, not a notebook; models making millions of decisions a day on data customers pay for\n\nGreenfield harnesses — eval coverage, drift detection, and cost controls for in-pipeline LLMs are largely unbuilt; you'll ship them\n\nScale that matters — billions of rows, 13 markets, and a dataset nobody else has\n\nSmall team, massive leverage — your pipelines reach every Firmable customer, every day\n\nCompetitive base + meaningful equity — a share in the upside we're building toward\n\nFirmable is an equal opportunity employer. We believe diverse teams build better products.\nReady to build the AI-native data platform behind the world's smartest B2B sales intelligence platform? Apply now — let's talk!\nOriginally posted on Himalayas","description_format":"text","description_chars":5449,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Sales Enablement","Lead Generation","Marketing & Sales AI"],"lifecycle":[{"event":"open","at":"2026-10-26T19:11:04Z"}],"visa":[],"liveness":{"score":62,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.806,"p_room":0.9,"age_days":18,"expected_fill_days":29,"reasons":["seen:18","win:mid"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/firmable-data-engineer-data-platform","json_url":"https://alion.io/job/firmable-data-engineer-data-platform.json","meta":{"generated_at":"2026-10-29T00:49:01Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1202,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":14688},"rest":"https://alion.io/mcp/rest/get_company?id=14688"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffirmable-data-engineer-data-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffirmable-data-engineer-data-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffirmable-data-engineer-data-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/firmable-data-engineer-data-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffirmable-data-engineer-data-platform"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3289628}},{"tool":"search_jobs","arguments":{"company":"firmable.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3289628},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}