{"id":694489,"url":"https://alion.io/job/twenty-staff-data-engineer","title":"Staff Data Engineer","company":{"id":685785,"name":"Twenty","domain":"twenty.io","url":"https://alion.io/company/twenty-2","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":94,"open_postings":27,"ghost_share":0,"stale_share":0.037,"repost_share":0,"time_to_fill_p50_days":135,"computed_at":"2026-11-02T06:13:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":192000,"max":455000,"currency":"USD","period":"year","gross":null,"usd_annual":455000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"ClickHouse","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Grafana","optional":false},{"name":"Loki","optional":false},{"name":"Mimir","optional":false},{"name":"PagerDuty","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Amazon EC2","optional":true},{"name":"Amazon ECS","optional":true},{"name":"Amazon Kinesis","optional":true},{"name":"Apache Iceberg","optional":true},{"name":"Apache Kafka","optional":true},{"name":"CI/CD","optional":true},{"name":"Datadog","optional":true},{"name":"Delta Lake","optional":true},{"name":"Docker","optional":true},{"name":"NATS","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Presto","optional":true},{"name":"RabbitMQ","optional":true},{"name":"Splunk","optional":true},{"name":"Trino","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-05-19T13:27:14Z","employer_posted_date":"2026-09-29","last_verified_at":"2026-11-02T19:52:18Z","board_verified":true,"closed_at":null,"days_open":167,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":166},"description":"About the Company\nAmerica is under sustained cyber attack. Our adversaries infiltrate our networks, steal our IP, and degrade the digital infrastructure that modern life runs on. They’ve learned-correctly-that those attacks rarely produce consequences.\nTwenty was founded to change that, by making our adversaries think twice before they attack us. Our vision is American and allied primacy in cyberspace-a future where they cannot contest us, deterrence is assured, and the free world remains secure.\nFounded in 2024, Twenty Technologies (www.twenty.io) industrializes offensive cyber operations for the U.S. and its allies. Headquartered in Arlington, Virginia, Twenty has raised $168M from Khosla Ventures, Accel, Caffeinated Capital, Friends & Family Capital, Point72 Ventures, General Catalyst, and In-Q-Tel.\nMission | On Site | Full Time | U.S. Citizenship Required / No Active Clearance Required\nRole Summary\nYou'll be based in Twenty's New York City office, building and operating the data integrations that feed Twenty's mission-critical platform. Twenty builds software for cyber operations, and the applications this role feeds are used by operators and analysts working against hard national security problems. This is a hands-on engineering role with real production ownership: you'll build the pipelines that retrieve, process, and integrate new data sources into our applications, monitor the health of the data flowing through the systems you can reach, and debug production issues when they surface. Where your work runs in environments you can't access, you'll partner with Twenty's forward deployed engineers, who operate on-site at customer facilities, to get it deployed and keep it healthy. You'll join the data platform team, reporting to its engineering manager. The data integration tooling you'll build on is young and under active development. You'll be among its first production users, and what you learn in operation will directly shape how it evolves.\nIf you're an experienced data engineer who wants your work in the hands of operators the same week you build it, and you'd rather own a production system end to end than ship features into a backlog, this role is for you.\nWhat You'll Do\nData Source Integration & Pipeline Development\nDesign and build data pipelines that retrieve, parse, transform, and load new data sources into Twenty's applications, primarily as AWS Glue jobs written in PySpark.\n\nInvestigate unfamiliar source systems and data formats, working with Twenty's engineers to understand semantics, access patterns, and constraints before writing code.\n\nDesign schemas and data models that fit the platform's performance characteristics and the shape of the data, including analytical models in ClickHouse.\n\nWrite code that is testable, debuggable, and maintainable by engineers operating it in environments you can't access. Tests carry unusual weight here: they're how the field trusts a change you'll never see run.\n\nWrite integration code that meets the security standards of classified environments: no hardcoded secrets, disciplined credential handling, and audit-ready practices throughout, so your work moves through customer approval processes without friction.\n\nDeployment & Field Support\nDeploy, operate, and iterate on integrations against the systems reachable from the office, end to end.\n\nPackage pipelines and integrations destined for restricted environments so forward deployed engineers and customer deployment teams can install, verify, and operate them without you in the room.\n\nSupport field deployments remotely: reproduce issues, cut fixes, and move them through the pipeline quickly when an on-site engineer is blocked.\n\nOperate and improve pipelines built elsewhere on the team, and feed operational learnings back into their design.\n\nProduction Health & Monitoring\nMonitor the health of data pipelines and platform services using the LGTM stack (Grafana, Loki, Tempo, Mimir).\n\nTrack data quality, throughput, and freshness; identify anomalies and degradations before they become incidents.\n\nBuild and improve the dashboards and alerts that make pipeline health visible to the team and to the forward deployed engineers who depend on it.\n\nIncident Response & Debugging\nDiagnose and resolve production issues in the data path: failed ingests, malformed source data, pipeline stalls, performance degradation.\n\nOwn resolution of incidents within your sphere of responsibility, escalating with a clear picture of what you found, not just what triggered the alert.\n\nDrive root cause analysis and post-incident reviews, and turn findings into runbooks, fixes, or upstream design changes.\n\nParticipate in on-call rotation using PagerDuty, with clear escalation paths across the engineering team.\n\nField & Platform Collaboration\nWork closely with forward deployed engineers on-site at customer facilities, sharing context in both directions so field reality and platform design stay connected.\n\nTurn operational observations, data source opportunities, and recurring patterns from the field into platform capabilities rather than one-off fixes.\n\nWho You Are\nYou independently identify the right solution to ambiguous, open-ended problems. New data sources arrive undocumented and messy; you investigate, form a design, and deliver without waiting for a spec.\n\nYou respond with urgency to operational issues and own resolution within your sphere. You're unafraid to call an incident when the signal warrants it.\n\nYou proactively create and update runbooks and documentation for the components you own. Some of the environments your code runs in are ones you'll never touch, and what you write down is what the engineers there have to work with.\n\nYou make informed decisions by consulting the right stakeholders and balancing detail with the big picture, and you execute against the spirit of the requirement, not just the letter.\n\nYou actively seek out and eliminate sources of toil. Repetitive manual work is a design problem, and you treat it like one.\n\nYou understand the customer and the mission well enough to know which work has the greatest impact, and you redirect your focus when what you're doing isn't moving the needle.\n\nYou tailor your communication to your audience, whether that's a forward deployed engineer at a customer site, a product engineer in Arlington, or a teammate across the desk, and you proactively share information so the right people stay informed and aligned.\n\nYou're comfortable building for restricted environments where deployment is gated, feedback loops are longer than you'd like, and disciplined engineering practice is the price of admission.\n\nMust Have\n5+ years of experience in data engineering, or software engineering with a substantial data infrastructure focus.\n\nExpert Python skills, with a track record of designing and maintaining production-grade codebases that other engineers extend and depend on.\n\nHands-on experience building and operating ETL/ELT pipelines with Spark (PySpark), ideally as AWS Glue jobs.\n\nStrong SQL and schema design skills, including the ability to analyze access patterns and make sound partitioning and indexing decisions.\n\nExperience with column-oriented analytical databases (example technologies: ClickHouse, Redshift, BigQuery).\n\nExperience debugging production data systems: reading logs, tracing failures across components, and root-causing issues under time pressure.\n\nDemonstrated ability to work independently on production systems, including sound judgment about when to decide and when to escalate.\n\nAbility to work on-site full-time at Twenty's New York City office, with an initial onboarding period at our Arlington, VA office and occasional travel there afterward.\n\nNice to Have\nExperience with data lake and large-scale query technologies (example technologies: Apache Iceberg, Delta Lake, Trino, Presto, Athena).\n\nExperience with streaming and message queue technologies (example technologies: Kafka, NATS, Kinesis, RabbitMQ).\n\nHands-on experience with observability tooling (Grafana, Datadog, Splunk, or similar).\n\nExperience deploying and operating software in air-gapped, classified, or otherwise restricted environments.\n\nFamiliarity with containerized environments (Docker and container orchestration) and CI/CD concepts.\n\nTech Environment (You Might Work With)\nCloud: AWS (EC2, ECS, RDS, CloudWatch), including deployments into closed enclave environments\n\nData processing: AWS Glue jobs running PySpark\n\nAnalytics: ClickHouse, with ClickPipes for ingestion\n\nContainers: Docker, orchestrated on Amazon ECS\n\nObservability: Grafana, Loki, Tempo, Mimir (LGTM stack)\n\nAlerting / on-call: PagerDuty\n\nMessaging: NATS\n\nDatabases: PostgreSQL\n\nData integration: Twenty's purpose-built data platform and integration layer (in active development)\n\nLanguages in use across engineering: Go, TypeScript, Python\n\nSecurity / Work Environment\nThis role requires U.S. citizenship and eligibility to obtain a U.S. Government security clearance; no active clearance is required to start. Work is performed at Twenty's New York City office. Onboarding begins with a stint of roughly two weeks at Twenty's Arlington, VA office, and travel to Arlington after that is occasional and as needed. Some of the systems this role builds for are restricted, and tooling constraints apply when working with them.\nBenefits\nWhat's on the table:\nHealth. Medical, dental, and vision plan options. Life / AD&D, disability coverage options.\n\nFamily. Paid parental leave for eligible full-time employees. 12 weeks for birthing parents, 4 for non-birthing parents, 6 weeks for adoptive, foster, or intended parents through surrogacy.\n\nVacation. Paid holidays and flexible PTO. Take what you need.\n\nRetirement. 401(k) with pre-tax and Roth options. HSA/FSA options, dependent care FSA.\n\nBenefits vary by location, role, and eligibility. Full plan details provided during the interview and offer process.\nIf this role sounds like you, apply and share with us your interest\nDue to U.S. government contract and security requirements, this role is limited to U.S. citizens. Some positions may also require eligibility to obtain and maintain a U.S. Government security clearance. Any active clearance requirement will be listed in the role description.\nTwenty is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran status, disability, or any other protected status, consistent with applicable law.\nIf you need a reasonable accommodation during the hiring process, let us know and we will work with you.","description_format":"text","description_chars":10650,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[]},"benefits":["Parental leave"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["National Security","Cyber Warfare"],"lifecycle":[{"event":"open","at":"2026-09-11T01:41:42Z"}],"visa":[],"liveness":{"score":35,"band":"fade","label":"Fading","p_open":1,"p_active":0.794,"p_room":0.44,"age_days":166,"expected_fill_days":135,"reasons":["conf:3","velocity","win:tail","crowd:"],"computed_at":"2026-11-02T06:13:15Z"},"pay":{"stated_usd_annual":455000,"is_top_pay":true},"html_url":"https://alion.io/job/twenty-staff-data-engineer","json_url":"https://alion.io/job/twenty-staff-data-engineer.json","meta":{"generated_at":"2026-11-02T21:30:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30084,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":685785},"rest":"https://alion.io/mcp/rest/get_company?id=685785"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftwenty-staff-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftwenty-staff-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftwenty-staff-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/twenty-staff-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftwenty-staff-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":694489}},{"tool":"search_jobs","arguments":{"company":"twenty.io","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":694489},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}