{"id":3617552,"url":"https://alion.io/job/drw-senior-data-engineer-unified-platform-2","title":"Senior Data Engineer, Unified Platform","company":{"id":58537,"name":"DRW","domain":"drw.com","url":"https://alion.io/company/drw","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":84,"open_postings":152,"ghost_share":0.191,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":73,"computed_at":"2026-11-03T05:54:40Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chicago, United States","New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":160000,"max":250000,"currency":"USD","period":"year","gross":null,"usd_annual":250000},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Bash","optional":false},{"name":"ClickHouse","optional":false},{"name":"Delta Lake","optional":false},{"name":"Flink","optional":false},{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-02T15:19:39Z","employer_posted_date":"2026-11-02","last_verified_at":"2026-11-03T21:40:29Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":1},"description":"DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.\nHeadquartered in Chicago with offices throughout the U.S., Canada, Europe, and Asia, we trade a variety of asset classes including Fixed Income, ETFs, Equities, FX, Commodities and Energy across all major global markets. We have also leveraged our expertise and technology to expand into three non-traditional strategies: real estate, venture capital and cryptoassets.\nWe operate with respect, curiosity and open minds. The people who thrive here share our belief that it’s not just what we do that matters-it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.\nThe Data Ecosystem team is an important part of DRW’s Unified Platform (UP) organization, building the platform capabilities, managed infrastructure, and metadata management systems that underpin our common query layer and power thousands of batch and streaming pipelines delivering data across DRW. \nAs a Senior Data Engineer in our Unified Platform organization, you will design, build, and operate the data platform and managed services used by Traders, Quantitative Researchers, and Back-Office personnel. You will own engineering projects and service components, work directly with platform users to solve technical problems, and contribute to metadata management and governance capabilities. This is a hands-on role combining technical design ownership, software development, production support, and mentorship within the broader platform architecture. \nKey Responsibilities \nDesign, build, and operatemanaged platform services for data storage, distributed query execution, batch and streaming processing, and workload orchestration. \nOwn technical designs and implementation decisions for services and components within the broader platform architecture, andlead their delivery from requirements through deployment and support. \nAutomate provisioning, configuration, upgrades, and monitoring formanaged services, reducing manual operationsand improving consistency across deployments. \nBuild and integrate metadata management tools, including data catalogs and lineage tracking, to help users discover datasets and understand their structure, ownership, and dependencies. \nImplementschema governance, data quality checks, access controls, and usage tracking in line with established policies, working with security and data stakeholders on technical requirements. \nWork with users of managed services to diagnose integration and performance issues, clarify technical requirements, and improve the services their workloads depend on. \nImprove the reliability and performance of managed services and shared processing infrastructure through observability, capacity management, and testing. Participate in production support and incident response for these services, resolving root causes and maintainingoperational runbooks. \nDeliver platform upgrades and data migrations with appropriate validation and compatibility checks to protect downstream workloads. \nLead design and code reviews for the services you own, document technical trade-offs, and contribute improvements to architectural patterns shared across the team. \nMentor less experienced engineers through hands-on collaboration and feedback, promoting maintainable code, automated testing, and sound operational practices. \nRequired Qualifications \n7+ years of experience working with modern data technologies and/or building data-intensive distributed systems. \nExpertisein Java and/or Python, with a proven ability to deliver high-quality, maintainable production software, and strong familiarity with SQL, Bash, and Linux environments. \nExperience building and operatingmanaged data or infrastructure services offered to other teams, including operational automation and production support. \nDemonstrated ownership of engineering projects or service components from technical design through deployment and ongoing operation. \nStrong understanding of distributed systems trade-offs, including fault tolerance, concurrency, partitioning, and recovery from partial failures. \nProduction experience with batch and streaming systems, including practical knowledge of state management, retries, replay, and data consistency. \nExperience with data processing or query technologies such as Flink, Spark, or ClickHouse, and the ability to evaluate their performance and operational trade-offs. \nExperience with multiple storage technologies, including object storage, relational or NoSQL databases, and event streaming systems such as Kafka. Familiarity with open table formats such as Iceberg or Delta Lake. \nPractical experience with data modeling, schema governance and evolution, and data quality controls. Experience integrating metadata management, data cataloging, or lineage capabilities into data systems. \nExperience with data formats and serialization systems such as Arrow, Parquet, Protobuf, or Avro. \nExperience with cloud-native data infrastructure, including Kubernetes, workflow orchestration, automated deployment, and production monitoring. \nStrong communicationand problem-solving skills, with the ability to troubleshoot issues with platform users, collaborate across teams, prioritize competing work, and deliver in a fast-paced trading environment. \nDesirable Qualifications \nExperience extending or scaling data catalogs or lineage tracking tools across multiple storage and compute technologies. \nExperience implementing access controls, usage tracking, or other governance capabilities in shared data environments. \nFamiliarity with financial datasets and the needs of trading, quantitative research, or back-office users. \nThe annual base salary range for this position is $160,000 to $250,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus. In addition, DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.\nFor more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice.\nCalifornia residents, please review the California Privacy Notice for information about certain legal rights at https://drw.com/california-privacy-notice.\n[#LI-TL1]","description_format":"text","description_chars":6780,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Hedge Funds & Alternative Investments"],"lifecycle":[{"event":"open","at":"2026-11-02T17:07:30Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":73,"reasons":["conf:3","velocity","win:early","comp:brand"],"computed_at":"2026-11-03T05:54:40Z"},"pay":{"stated_usd_annual":250000,"is_top_pay":true},"html_url":"https://alion.io/job/drw-senior-data-engineer-unified-platform-2","json_url":"https://alion.io/job/drw-senior-data-engineer-unified-platform-2.json","meta":{"generated_at":"2026-11-04T01:37:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2458,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58537},"rest":"https://alion.io/mcp/rest/get_company?id=58537"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdrw-senior-data-engineer-unified-platform-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdrw-senior-data-engineer-unified-platform-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdrw-senior-data-engineer-unified-platform-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/drw-senior-data-engineer-unified-platform-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdrw-senior-data-engineer-unified-platform-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3617552}},{"tool":"search_jobs","arguments":{"company":"drw.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3617552},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}