{"id":1650844,"url":"https://alion.io/job/steampunk-senior-data-engineer-databricks","title":"Senior Data Engineer - Databricks","company":{"id":3854754,"name":"Steampunk","domain":"steampunk.com","url":"https://alion.io/company/steampunk-5","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["McLean, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":140000,"max":180000,"currency":"USD","period":"year","gross":null,"usd_annual":180000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Alation","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"Azure","optional":false},{"name":"C++","optional":false},{"name":"CI/CD","optional":false},{"name":"Collibra","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Informatica","optional":false},{"name":"Java","optional":false},{"name":"MS SQL","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-10-02T00:14:38Z","employer_posted_date":"2026-10-02","last_verified_at":"2026-10-12T17:12:33Z","board_verified":true,"closed_at":null,"days_open":10,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":10},"description":"Overview\nWe are looking for a seasoned Senior Data Engineer to work with our team and clients to develop enterprise-grade data platforms, data lakes and lakehouses, services, and pipelines using Databricks. We are looking for more than just a Senior Data Engineer; we are seeking a technologist with excellent communication and customer service skills and a passion for data and problem solving.\nContributions\nLead and support the design, development, and migration of data lake and lakehouse environments using Databricks, with a focus on performance, reliability, and scalability.\nAssess and understand existing ETL jobs, workflows, data marts, BI tools, reports, and associated data dependencies.\nDesign, develop, and optimize scalable data pipelines and data processing solutions using Databricks.\nAddress technical inquiries concerning customization, integration, enterprise architecture, and the features and functionality of data products.\nDevelop and support database, data warehouse, data mart, data lake, and lakehouse solutions in cloud environments such as AWS, Azure, or GCP.\nApply hands-on expertise with Databricks, SQL, PySpark/Python, and cloud technologies to support data engineering solutions.\nSupport an Agile software development lifecycle.\nContribute to the continued growth of our AI & Data Exploitation Practice.\nQualifications\nAbility to obtain and maintain a U.S. government security clearance.\nBachelor's degree in computer science, information systems, engineering, or a related technical discipline.\n5-7 years of industry experience developing production software and solving complex technical problems.\n5-7 years of direct experience in Data Engineering, including experience with tools and technologies such as:\nBig data technologies: Databricks, Apache Spark, Delta Lake, or similar.\nRelational SQL: preferably T-SQL; alternatively PostgreSQL or MySQL.\nData pipeline and workflow management tools: Databricks Workflows, Airflow, AWS Step Functions, or similar.\nCloud services: Databricks on AWS, S3, EC2, RDS, or Azure equivalents.\nObject-oriented or scripting languages: PySpark/Python, Java, C++, Scala, or similar.\nData lakehouse architecture and technologies such as Delta Lake or Apache Iceberg.\nAdvanced SQL knowledge and experience working with relational databases, including query development and optimization, as well as familiarity with a variety of database technologies.\nExperience manipulating, processing, and extracting value from large, disparate datasets.\nAbility to assess existing data pipelines, understand their purpose and functionality, and efficiently reimplement or modernize them using Databricks.\nExperience working with structured and unstructured data.\nExperience architecting data systems, including transactional systems and data warehouses.\nExperience with the software development lifecycle (SDLC), CI/CD practices, and development, test, and production environments.\nExperience with data cataloging tools such as Informatica EDC, Unity Catalog, Collibra, Alation, Microsoft Purview, or Amazon DataZone is a plus.\nDemonstrated commitment to data governance and data management best practices.\nExperience working in an Agile environment.\nExperience supporting project teams of developers and data scientists building web-based interfaces, dashboards, reports, analytics solutions, and machine learning models.\nAbout steampunk\nSteampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $140,000 to $180,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk’s total compensation package for employees. Learn more about additional Steampunk benefits here.\nIdentity Statement\nAs part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.\nSteampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. If you want to learn more about our story, visit http://www.steampunk.com.\nWe are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.","description_format":"text","description_chars":4834,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-02T00:14:38Z"}],"visa":[],"liveness":{"score":22,"band":"cold","label":"Long shot","p_open":1,"p_active":0.615,"p_room":0.35,"age_days":10,"expected_fill_days":5,"reasons":["conf:2","velocity","win:tail","comp:brand,attention"],"computed_at":"2026-10-12T06:55:09Z"},"pay":{"stated_usd_annual":180000,"is_top_pay":true},"html_url":"https://alion.io/job/steampunk-senior-data-engineer-databricks","json_url":"https://alion.io/job/steampunk-senior-data-engineer-databricks.json","meta":{"generated_at":"2026-10-12T18:06:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29122,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3854754},"rest":"https://alion.io/mcp/rest/get_company?id=3854754"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsteampunk-senior-data-engineer-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsteampunk-senior-data-engineer-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsteampunk-senior-data-engineer-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/steampunk-senior-data-engineer-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsteampunk-senior-data-engineer-databricks"}]}