{"id":89936,"url":"https://alion.io/job/540-senior-data-engineer-2","title":"Senior Data Engineer","company":{"id":20426,"name":"540","domain":"540.co","url":"https://alion.io/company/540-co","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"GitLab","optional":true}],"status":"live","first_seen_at":"2026-08-17T15:20:47Z","employer_posted_date":"2026-08-17","last_verified_at":"2026-10-16T14:33:48Z","board_verified":true,"closed_at":null,"days_open":59,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":59},"description":"540 is seeking a Senior Data Engineer to support a mission-critical federal health data modernization initiative. The team is bringing together information from diverse defense and federal systems to build scalable data pipelines, APIs, and data products that improve how critical health data is integrated, accessed, and used.\nIn this role, you’ll serve as a senior technical contributor, delivering scalable, production-ready data capabilities while establishing reusable patterns for data ingestion, integration, and delivery. You’ll solve complex data challenges, guide engineering teams, and help shape the technical foundation of a growing data platform ecosystem supporting federal health missions.\nLocation: Remote within the continental United States. Periodic travel may be required\nCitizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance\nEducation Requirement: Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related technical field (preferred)\n540 Internal Thrive Level: Senior Data Engineer\nWHY 540?\n540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation - we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.\nHOW YOU’LL DRIVE IMPACT\nDesign, develop, and maintain scalable, production-ready data pipelines and data products using Spark (Python/SQL) in a Databricks environment\nLead the integration and transformation of complex data from diverse DoW and federal health systems and sources into reliable, reusable data products\nDesign scalable approaches for data ingestion, integration, and exchange, including API-based integrations and services\nEstablish and promote reusable data engineering patterns, standards, and best practices that improve consistency, scalability, and maintainability across data products\nProvide technical guidance on data architecture, pipeline design, data modeling, integration approaches, and engineering practices\nMonitor, troubleshoot, and optimize production workflows and data pipelines, identifying performance, reliability, and scalability improvements\nDefine and implement data validation, quality, and governance practices that improve the reliability and usability of data products\nTroubleshoot complex technical and data integration challenges, identify root causes, and drive sustainable solutions\nCollaborate with engineers, architects, analysts, and customer stakeholders to translate complex data needs into scalable technical solutions\nProvide technical guidance and mentorship to other engineers, helping teams navigate complex or unfamiliar technical challenges\nProactively identify opportunities to improve engineering tools, processes, and patterns and help drive their adoption across the team\nTake ownership of complex technical areas and help maintain engineering quality, consistency, and cohesion as the platform and portfolio of data products grow\nREQUIRED SKILLS & EXPERIENCE\n10+ years of data engineering, software engineering, or related technical experience\nExtensive hands-on experience designing, building, and operating production data pipelines and data products\nAdvanced proficiency with Python and SQL\nStrong experience with Apache Spark and distributed data processing\nExperience working with Databricks or similar modern data platforms\nExperience designing and maintaining ETL/ELT processes for complex, large-scale datasets\nExperience integrating data across disparate systems and consuming or developing API-based data integrations\nStrong understanding of data modeling, data architecture, data quality, and data governance principles\nExperience troubleshooting and optimizing complex production data pipelines for performance, reliability, and scalability\nExperience working with Git-based development workflows and modern software engineering practices\nExperience working in terminal / command-line environments\nDemonstrated experience providing technical guidance, mentoring engineers, and influencing engineering practices\nStrong client and stakeholder communication skills, with the ability to translate technical concepts and recommendations for both technical and non-technical audiences\nAbility to independently navigate ambiguity, identify technical risks, and drive complex engineering challenges toward resolution\nExperience spotting security, privacy and compliance issues and working with security/compliance/legal stakeholders\nNICE TO HAVE SKILLS & EXPERIENCE\nAWS cloud experience\nExperience working with very large datasets, including datasets with billions of records\nExperience with Palantir Foundry\nGitLab experience\nExperience working with Advana or similar DoW data environments\nExperience working with federal health, financial, or other regulated and sensitive data\nExperience using AI/ML to accelerate work, including automating routine tasks, accelerating development and debugging\nBENEFITS & PERKS\nFlexible PTO + all Federal holidays off\nHealth, dental and vision insurance plans\nFlexible Spending Account (FSA)\n401k with employer match\nCompany-sponsored life insurance, short- and long-term disability \nProfessional development (training, certifications, conferences)\nPaid cloud developer accounts\nReferral bonuses\nHQ office perks (parking / metro reimbursement, nitro coffee & lunches) \nAnnual social events (540 Week, hackathon, charity golf tournament, etc.)\nAccess to 540’s Washington Capitals & Nationals tickets\nEQUAL EMPLOYMENT OPPORTUNITY (EEO)\n540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.\nThis policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.","description_format":"text","description_chars":6196,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":true,"languages":[]},"benefits":["401k plan","Life insurance","Professional development","Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["DevOps & Platform Engineering","Digital Government","DevSecOps","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-08-17T15:20:47Z"}],"visa":[],"liveness":{"score":39,"band":"fade","label":"Fading","p_open":1,"p_active":0.708,"p_room":0.55,"age_days":59,"expected_fill_days":51,"reasons":["conf:0","win:tail"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/540-senior-data-engineer-2","json_url":"https://alion.io/job/540-senior-data-engineer-2.json","meta":{"generated_at":"2026-10-16T15:00:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14751,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":20426},"rest":"https://alion.io/mcp/rest/get_company?id=20426"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2F540-senior-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2F540-senior-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2F540-senior-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/540-senior-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2F540-senior-data-engineer-2"}]}