{"id":10285,"url":"https://alion.io/job/darkroom-senior-data-engineer","title":"Senior Data Engineer","company":{"id":3445,"name":"Darkroom","domain":"darkroomagency.com","url":"https://alion.io/company/darkroom","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":91,"open_postings":8,"ghost_share":0,"stale_share":0.375,"repost_share":0,"time_to_fill_p50_days":36,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Islamabad, Pakistan"],"countries":["PK"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":59000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2324},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"BigQuery","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SOC 2","optional":false},{"name":"SQL","optional":false},{"name":"AI Agents","optional":true},{"name":"Dagster","optional":true},{"name":"dbt","optional":true},{"name":"GCP","optional":true},{"name":"Google Cloud Run","optional":true},{"name":"Langfuse","optional":true},{"name":"LLM","optional":true},{"name":"pgvector","optional":true},{"name":"PostgreSQL","optional":true}],"status":"live","first_seen_at":"2026-06-05T15:18:51Z","employer_posted_date":"2026-06-05","last_verified_at":"2026-10-16T21:37:42Z","board_verified":true,"closed_at":null,"days_open":133,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":132},"description":"What we're building\nWe're empowering small teams with technology that makes it easier to market and grow businesses. Our current focus is to help consumer brands shift from \"workflow automation\" to \"agent management\" within their marketing operations. Shadow is the AI coordination layer - providing shared AI memory, centralized agent control, and model orchestration for marketing teams.\nWhy join Shadow?\nProduct Ownership You'll ship production code daily and help steer key product and technical decisions.\n\nShape the Engineering Culture You'll influence how we work-tools, processes, standards, and hiring.\n\nWork with Challenger Consumer Brands Talk directly to customers (CEOs, CMOs, VP's) of fast-growing consumer brands-some doing $80M-$500M in revenue.\n\nThe agency behind the product\nShadow is built alongside Darkroom - a performance marketing agency that's been operating for 10 years, employs 100+ people, runs 100+ clients at a time, and has worked with over 1,000 consumer brands. The agency is both our proving ground and our first user, which means the data you build with is real marketing data at real volume from day one - not a synthetic demo.\nThis is a fully remote role supporting a team in the EST time zone (9 AM-5 PM EST).\nThe role\nYou own the pipelines that bring the world's marketing data into Shadow - and keep them fast, accurate, and reliable as we scale to thousands of users. Every brand connects its full stack (ad platforms, ecommerce, analytics, email/SMS), and you make that data land cleanly, normalize into shared schemas, and stay in sync. The agent is only as good as the data underneath it; that layer is yours.\nThis is a hands-on, build-heavy engineering role for someone who has run large data systems before and wants to do it again in a smaller, faster environment.\nWhat you'll own\nBuild and scale the ingestion layer across third-party marketing APIs (Meta, Google, TikTok, GA4, Shopify, Klaviyo, and more) - auth, extraction, rate-limit handling, backfill, and incremental sync.\n\nDesign normalization and transformation pipelines that map messy, platform-specific data into shared, queryable schemas (e.g. a unified creative/campaign/order model).\n\nOwn data reliability at scale - sync accuracy, freshness, coverage, and observability. Build the systems that detect when a connection breaks or a number looks wrong before a user does.\n\nEngineer for multi-tenant scale and security: pipelines and storage that stay performant and cost-efficient across 1,000+ users and hundreds of connected brands - with strict data isolation, privacy, and compliance built in, not bolted on.\n\nPartner with the AI and data-science teams to expose clean, well-modeled data the agent can retrieve and reason over.\n\nMust haves\nExperience building and operating large enterprise data pipelines engineered for scale - systems serving 1,000+ users (or equivalent data volume / tenancy), where reliability, isolation, and cost at scale were real constraints you solved.\n\nStrong SQL and Python, with production experience in a modern data warehouse (BigQuery, Snowflake, Redshift, or similar).\n\nDeep familiarity with ETL/ELT patterns, incremental sync, schema design, and data modeling for analytics.\n\nBuilt and maintained integrations against third-party APIs - OAuth flows, pagination, rate limits, schema drift, and the operational reality of connectors that break.\n\nA bias toward observability and data quality: you instrument your pipelines and you don't ship data you can't trust.\n\nExperience building or operating within SOC 2-compliant systems with enterprise-grade security and privacy - you've handled sensitive customer data under real compliance constraints (access controls, encryption, data isolation, auditability) and treat it as a first-class engineering requirement.\n\nNice to haves\nExperience in martech, adtech, or an adjacent data-heavy marketing domain - you've worked with ad platform or ecommerce data before and know where the bodies are buried (attribution windows, currency/timezone messes, deduping across platforms).\n\nFamiliarity with our stack: GCP (BigQuery, Cloud Run), PostgreSQL + pgvector, and orchestration/transformation tooling (dbt, Airflow, Dagster, or similar).\n\nExperience with pipeline observability and tracing in an AI/LLM context (e.g. Langfuse).\n\nComfort supporting data that feeds AI agents and retrieval systems, not just dashboards.\n\nCulture fit\nObsessive about data organization at scale. We're hiring for someone who lives in the data layer and wants to own it end to end.\n\nYou’re a power AI user. You've embedded AI into every workflow you touch and you think in systems - not one-off prompts, but repeatable structures that compound.\n\nEntrepreneurial. You don't need much direction to move fast, you pivot when the situation demands it, and what you ship is production-grade, not a prototype you hand off for someone else to finish.\n\nWhat we offer\nUnlimited PTO + Local holidays (Relevant to your hub): Rebooting is part of the work. Take the time you need to stay sharp.\n\nRemote-First Culture: Many roles are fully remote. Employees based in or near our New York or Lisbon HQs are expected to work hybrid with weekly in-office time. Hub locations include Brazil and Spain.\n\nParental Leave: Flexible parental leave to support new parents during this important transition.\n\nGrowth: Our interdisciplinary model gives every employee exposure far beyond their core role. Grow your skills, expand your influence, and stay at the forefront of the industry.\n\nEqual Opportunity Statement\nWe are an equal opportunity workplace-we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national orientation, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.","description_format":"text","description_chars":5928,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Parental leave","Unlimited PTO"],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"},{"name":"Spain","iso":"ES","kind":"country"},{"name":"India","iso":"IN","kind":"country"},{"name":"Pakistan","iso":"PK","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Creative Agencies","E-commerce Marketing","Digital Marketing"],"lifecycle":[{"event":"open","at":"2026-06-05T15:18:51Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.484,"p_room":0.28,"age_days":132,"expected_fill_days":36,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/darkroom-senior-data-engineer","json_url":"https://alion.io/job/darkroom-senior-data-engineer.json","meta":{"generated_at":"2026-10-16T23:38:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5663,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3445},"rest":"https://alion.io/mcp/rest/get_company?id=3445"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdarkroom-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdarkroom-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdarkroom-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/darkroom-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdarkroom-senior-data-engineer"}]}