{"id":4640966,"url":"https://alion.io/job/brooksource-senior-data-engineer-2","title":"Senior Data Engineer","company":{"id":2385307,"name":"Brooksource","domain":"brooksource.com","url":"https://alion.io/company/brooksource","size_band":"201-500","is_staffing_agency":false,"employer_type":"staffing","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":70,"max":85,"currency":"USD","period":"hour","gross":null,"usd_annual":170000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"CI/CD","optional":false},{"name":"DuckDB","optional":false},{"name":"Flink","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Java","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-19T21:40:29Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-19T22:29:43Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Senior Data Infrastructure Engineer\nRemote (Eastern or Central time zone preferred)\nContract (Remote)\nCompensation: $70 – $85 per hour\nABOUT THE ROLE\nWe are seeking a Data Infrastructure Engineer to help build and scale a next-generation data platform for a leading Media & Entertainment organization. The platform orchestrates complex data flows, ingestion pipelines from box office vendors, internal metadata applications, and unstructured contract artifacts. You will design, build, and operate the foundational infrastructure that delivers this critical data to key downstream systems and executive decision-makers. As a core engineer on the team, you will collaborate closely with data pipeline developers and business stakeholders to map out our technical roadmap. We are looking for an engineer who thrives on autonomy, is comfortable navigating ambiguity, and wants to own infrastructure initiatives from concept to production.\nWHAT YOU'LL DO\nDesign and evolve data architecture supporting both real-time and batch data movement, primarily within AWS.\nBuild normalization and transformation pipelines that reconcile data from approximately 10 different sources while preserving raw data.\nImplement and manage streaming and batch data ingestion using technologies such as Kafka, Flink, and Debezium.\nWrite and maintain infrastructure as code for pipeline components using tools like Terraform.\nWork with streaming technologies to move data in near real-time, alongside batch/export-based ingestion.\nPartner with engineering and business stakeholders to define how retained data supports historical analysis and forecasting.\nAdvise on architecture decisions where multiple related projects’ infrastructure overlaps, maximizing reuse and efficiency.\nCollaborate with CRM-focused business solutions teams on data integration points, including platforms like Salesforce.\nContribute to a diverse, equitable, and inclusive work culture.\nWHAT YOU BRING\nStrong hands-on experience with AWS as the primary environment for day-to-day work.\nExperience with streaming and change-data-capture tools (e.g., Kafka, Flink, Debezium).\nProficiency working with various source databases (SQL Server, MySQL, Postgres).\nExperience with lakehouse architecture and tools (Iceberg, AWS Glue, Lake Formation).\nFamiliarity with DuckDB or similar analytical querying tools.\nExperience with Terraform for infrastructure as code.\nExperience with GitHub Actions or similar CI/CD tools.\nProficiency in Java or Python for data application development.\nExperience designing data normalization and transformation logic across multiple disparate data sources.\nAbility to design for long-term data retention and support downstream analytics/forecasting use cases.\nExposure to integrating with CRM platforms (e.g., Salesforce) as a data source or destination is a plus.\nStrong analytical and problem-solving skills with exceptional attention to detail.\nExcellent verbal and written communication skills.\nWHAT'S IN IT FOR YOU\nWork for a globally recognized leader in Media & Entertainment.\nOwnership of core data architecture decisions within a newly forming data engineering initiative.\nDirect influence over how data is structured, retained, and delivered across multiple projects.\nOpportunity to work with large-scale datasets and modern cloud data platforms.\nGrow your career in a fast-paced, innovative environment.\nBe part of a diverse, equitable, and inclusive team culture.\nApplications will be accepted through September 25, 2026.","description_format":"text","description_chars":3508,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Recruiting & Staffing","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-19T22:29:43Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":6,"reasons":["conf:1","win:early"],"computed_at":"2026-11-19T23:42:30Z"},"pay":{"stated_usd_annual":170000,"is_top_pay":true},"html_url":"https://alion.io/job/brooksource-senior-data-engineer-2","json_url":"https://alion.io/job/brooksource-senior-data-engineer-2.json","meta":{"generated_at":"2026-11-19T23:42:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":310,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2385307},"rest":"https://alion.io/mcp/rest/get_company?id=2385307"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbrooksource-senior-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbrooksource-senior-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbrooksource-senior-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/brooksource-senior-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbrooksource-senior-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4640966}},{"tool":"search_jobs","arguments":{"company":"brooksource.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4640966},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}