{"id":3825170,"url":"https://alion.io/job/credence-aws-databricks-engineer","title":"AWS Databricks Engineer","company":{"id":3864336,"name":"Credence","domain":"credence.ai","url":"https://alion.io/company/credence-4","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"B","score":80,"open_postings":14,"ghost_share":0,"stale_share":0.786,"repost_share":0,"time_to_fill_p50_days":33,"computed_at":"2026-11-06T05:58:05Z"}},"role":"DevOps","role_family":"DevOps","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["McLean, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":155000,"max":185000,"currency":"USD","period":"year","gross":null,"usd_annual":185000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS CDK","optional":false},{"name":"AWS Lambda","optional":false},{"name":"CI/CD","optional":false},{"name":"CloudFormation","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FedRAMP","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab","optional":false},{"name":"IAM","optional":false},{"name":"Jenkins","optional":false},{"name":"OpenTofu","optional":false},{"name":"Pandas","optional":false},{"name":"Pydantic","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-05T18:15:07Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-07T04:49:12Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Overview\nJoin a team where innovation meets mission. Our AI, cloud, cyber, and modernization solutions save agencies thousands of hours, safeguard national security, and strengthen health and humanitarian missions worldwide. With 1,700+ team members, 1,500+ AI/data experts, and 100+ prime contracts, we deliver at scale and with purpose.\nWe’ve been recognized as a Top Workplace by the Washington Post for six straight years and named to the Inc. 5000 Fastest Growing Private Companies 13 of the past 14 years. Credence is a welcoming home for those looking to grow and contribute to positive change. We encourage all employees to expand beyond their boundaries and dive into important, world-changing federal challenges.\nPosition Summary\nCredence has an immediate need for an AWS Databricks Engineer to join our growing AI and Automation practice. You will serve as a key technical contributor responsible for designing, building, and optimizing scalable cloud-based data solutions using AWS and Databricks. You’ll develop robust data pipelines, implement modern data lakehouse architectures, and collaborate across engineering, data science, and stakeholder teams to deliver secure, high-performance data capabilities that advance federal missions.\nResponsibilities include, but are not limited to, the duties listed below:\nDatabricks EngineeringDesign, build, and optimize scalable data pipelines and processing workflows using Databricks, Apache Spark, PySpark, and Delta Lake. \n\n Data Lakehouse ArchitectureDesign and implement modern lakehouse solutions using Databricks and AWS services. Apply medallion architecture (Bronze/Silver/Gold layers) to improve data quality, governance, lineage, performance, and accessibility. \n\nAWS Data IntegrationBuild and maintain ETL/ELT pipelines integrating structured, semi-structured, and unstructured data across AWS services such as S3, Glue, RDS, Redshift, Lambda, and related cloud data platforms. \n\nData Transformation & OptimizationDevelop efficient data transformation workflows using SQL, Python, and PySpark. Optimize Spark workloads, queries, clusters, and storage configurations for performance, reliability, and cost efficiency. \n\nData Governance & QualityImplement data quality, cataloging, lineage, governance, and access-control practices across Databricks and AWS environments, including the use of Unity Catalog where applicable. \n\n Cloud Automation & DevOpsAutomate data platform deployments and workflows using Infrastructure as Code (IaC), CI/CD pipelines, Git-based development practices, and AWS-native deployment tools. \n\nCollaborative EngineeringWork closely with data engineers, software engineers, data scientists, cloud engineers, and mission stakeholders to translate business and technical requirements into production-ready data solutions. \n\nTechnical Rigor & DocumentationDevelop clean, maintainable, and well-documented code while following engineering, security, and federal development standards. Support code reviews, testing, troubleshooting, and technical design documentation. \n\nRequirements\nU.S. citizenship with the ability to obtain and maintain a Secret clearance is required. \nBachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related technical field. \nHands-on experience in data engineering, cloud engineering, or related technical roles. \nHands-on experience building and maintaining production data solutions using Databricks, Apache Spark, and PySpark. \nStrong experience with AWS data services such as S3, Glue, RDS, Redshift, Lambda, IAM, and CloudWatch. \nStrong understanding of ETL/ELT processes, data lake and lakehouse architectures, data modeling, and large-scale data processing. \nHands-on experience with Delta Lake, SQL, Python, and Spark-based data processing. \nExperience developing, scheduling, monitoring, and troubleshooting production data pipelines and workflows. \nExperience with Git and CI/CD platforms such as GitLab, GitHub Actions, Jenkins, or AWS CodePipeline. \nUnderstanding of cloud security, identity and access management, encryption, and secure data-handling practices. \nStrong communication skills and a client-oriented mindset with the ability to collaborate across technical and non-technical teams. \nPreferred\nExperience implementing Databricks Lakehouse Architecture and medallion architecture using Bronze, Silver, and Gold data layers. \nExperience with Databricks Unity Catalog, Delta Live Tables, Databricks Workflows, or similar data orchestration and governance capabilities. \nStrong Python proficiency and experience with data engineering libraries and frameworks such as PySpark, Pandas, and Pydantic. \nExperience with Infrastructure as Code tools such as Terraform, OpenTofu, AWS CDK, or CloudFormation. \nAWS and/or Databricks certifications, such as AWS Certified Data Engineer - Associate, AWS Certified Solutions Architect, or Databricks Certified Data Engineer credentials. \nKnowledge of federal cybersecurity, RMF, FedRAMP, or other government regulatory and compliance frameworks. \nExperience delivering cloud-native data solutions within federal government or other highly regulated environments. \nSalary Range: $155,000 - $185,000 annually. Actual compensation will be determined based on the selected candidate's experience, education, certifications, skills, and overall qualifications.\nBenefits\nHealth Care Plan (Medical, Dental & Vision)\nRetirement Plan (401k, IRA)\nLife Insurance (Basic, Voluntary & AD&D)\nPaid Time Off (Vacation, Sick & Public Holidays)\nFamily Leave (Maternity, Paternity)\nShort Term & Long Term Disability\nTraining & Development\nWellness Resources","description_format":"text","description_chars":5672,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":true,"languages":[]},"benefits":["401k plan","Life insurance","Parental leave","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["National Security","Information Security","IT Consulting & Digital Transformation","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-11-05T18:15:07Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 3 · green card filings: 1","filings_12m":3,"filings_prev_12m":8,"green_card_filings_12m":1,"median_offered_wage_usd":131250,"route":null,"cap_exempt":false,"checked_at":"2026-11-06T22:30:08+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":3}],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":0,"expected_fill_days":33,"reasons":["conf:2","stale_co","velocity","win:early"],"computed_at":"2026-11-06T05:58:05Z"},"pay":{"stated_usd_annual":185000,"is_top_pay":true},"html_url":"https://alion.io/job/credence-aws-databricks-engineer","json_url":"https://alion.io/job/credence-aws-databricks-engineer.json","meta":{"generated_at":"2026-11-07T05:14:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12728,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3864336},"rest":"https://alion.io/mcp/rest/get_company?id=3864336"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcredence-aws-databricks-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcredence-aws-databricks-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcredence-aws-databricks-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/credence-aws-databricks-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcredence-aws-databricks-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3825170}},{"tool":"search_jobs","arguments":{"company":"credence.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3825170},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}