Senior Data Engineer

Principal Mineral hires a Senior Data Engineer for Camden Copper/Metis Endeavor. The role builds and maintains a Databricks lakehouse, production data pipelines, and reliable data assets, while partnering with business owners to validate KPIs and support analytics, automation, and machine learning.

Responsibilities

• Architect, build, and maintain batch and near-real-time ELT/ETL pipelines that are scalable, reliable, and maintainable
• Ingest and curate data from disparate systems, including internal ERP systems and external market, trade, and commodity API feeds
• Design, build, and maintain central data models in dbt (or similar) that support analytics, data science, optimization, and agentic AI workflows
• Partner with business owners and subject matter experts to define and standardize operational KPIs (yield, inventory, margins, component SKUs) in a unified semantic layer
• Perform QA checks against source systems and business reports; reconcile discrepancies with data owners
• Implement data quality validation, monitoring, and alerting so downstream consumers can trust the data
• Help establish and follow best practices for data modeling, naming, version control, and documentation
• Optimize lakehouse architecture and pipeline performance while balancing cost and scalability
• Collaborate with ML and platform engineers on model training, scoring, and deployment needs
• Ensure solutions meet standards for security, privacy, lineage, and governance, including requirements tied to PMC’s U.S. government contracts
• Implement and review role-based access control and security-as-code with the DevOps/MLOps Engineer

Skills

• 4+ years of professional data engineering experience building production pipelines
• Strong SQL and Python; experience with Spark or a comparable distributed engine
• Hands-on experience with a lakehouse or cloud warehouse (Databricks preferred; Snowflake or BigQuery considered)
• Experience with dbt or a comparable transformation and testing framework
• Experience with Git-based workflows, CI, and orchestration (Databricks Workflows, Airflow, or similar)
• Comfort working directly with non-technical business owners to define metrics and resolve data issues
• Ability to work as a U.S. person and support government contract data requirements
• Experience extracting data from SAP (ECC or S/4HANA) or other ERP systems
• Experience in manufacturing, supply chain, or industrial data
• Experience with Unity Catalog, Delta Lake, and data quality tooling
• Experience supporting ML feature pipelines

Company Overview