Sr Data Engineer - Databricks

Your Job

Georgia-Pacific is seeking a Senior Databricks Data Engineer to join our Data Platform team in Atlanta, Georgia. In this role, you will create long-term value across four business units by expanding access to trusted, high-quality data spanning hundreds of systems and thousands of data assets. You will build and enhance our Databricks platform, deliver reliable and scalable data pipelines, and help establish reusable engineering patterns that align with enterprise architecture, governance, security, and data-quality standards.

This role is based in Atlanta, GA at our GP HQ located on Peachtree St. It is hybrid with an expectation of three (3) days in office per week.

Our Team

The Georgia-Pacific Data Platform team partners with Data Governance, Data Delivery, Data Product Owners, Solution Architects, and other platform and product teams. Together, the team develops governed, reusable capabilities that improve data accessibility, reliability, lineage, and quality while supporting analytics, advanced analytics, and AI use cases across the enterprise.

What You Will Do

• Design, build, deploy, and support Databricks-native data engineering solutions, including Delta Lake pipelines, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader ingestion pipelines, Unity Catalog resources, and CI/CD automation
• Develop reliable, governed data platforms and pipelines that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data assets
• Create automated tools, reusable templates, and self-service patterns that accelerate data development, ingestion, feature engineering, and consumption
• Operate and improve the platform through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization aligned with long-term scalability and resilience goals
• Partner with product owners, operations teams, architects, and delivery teams to identify common use cases, prioritize platform enhancements, and expand adoption
• Integrate Databricks pipelines with enterprise governance, metadata, lineage, classification, certification, ownership, and data-quality capabilities
• Develop and curate governed data assets for AI and advanced analytics use cases, including semantic models, APIs, Genie Spaces, and AI agents
• Implement validation rules, monitoring, and remediation processes that improve the fitness and reliability of critical data assets

Who You Are (Basic Qualifications)

• Experience designing, building, and supporting production-grade Databricks, Delta Lake, and Apache Spark pipelines for batch and streaming workloads
• Experience developing Databricks Jobs (i.e. Lakeflow Declarative Pipelines, Structured Streaming) and multi-task workflows, including scheduling, parameters, dependencies, retries, notifications, and operational monitoring
• Experience implementing Databricks infrastructure and environment-aware deployment automation using Terraform, Databricks Asset Bundles, or other Infrastructure as Code practices, Git, and CI/CD workflows
• Experience implementing data governance and access controls with Unity Catalog, including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions
• Experience using Python and Spark diagnostic tools, including job logs, Spark UI, query plans, partitioning, join optimization, and Adaptive Query Execution, to troubleshoot and optimize production data workloads
• Must have legal authorization to work permanently in the United States for any employer without requiring a visa transfer or visa sponsorship

What Will Put You Ahead

• Experience building production ingestion pipelines with Databricks Auto Loader
• Advanced Python experience applied to data engineering, automation, reusable libraries, and platform capabilities
• Experience with open table formats such as Delta Lake, Apache Hudi, or Apache Iceberg
• Experience developing governed data assets for AI, semantic modeling, APIs, advanced analytics, Genie Spaces, or AI agents
• Experience with AWS, Microsoft Azure, or Google Cloud and native storage services such as Amazon S3, Azure Data Lake Storage Gen2, OneLake, or Google Cloud Storage

At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate’s knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.

Hiring Philosophy

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here.

Who We Are

Georgia-Pacific and its subsidiaries are among the world’s leading manufacturers and marketers of bath tissue, paper towels and napkins, tableware, paper-based packaging, cellulose, specialty fibers, and building products. Our products are part of everyday life for people around the world.

At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.

Our Benefits

Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength, focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes medical, dental, vision, flexible spending and health savings accounts, life insurance, AD&D, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave, and adoption assistance. Specific eligibility criteria are set by the applicable Summary Plan Description, policy, or guideline, and benefits may vary by geographic region. If you have questions about which benefits apply to you, please speak to your recruiter.

Equal Opportunities

Equal Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, all offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please review the E-Verify information for additional details.