Data Engineer III-6377

Data Engineer III

itD is seeking a Data Engineer III to build, optimize, and maintain scalable data pipelines and analytics-ready datasets that power critical operational decisions across Meta’s Global Response Ecosystem. This role will support workforce measurement, response ecosystem reporting, pipeline automation, and historical data backfills, helping global operations teams make informed, data-driven decisions. The ideal candidate will bring strong expertise in SQL, Python, large-scale data engineering, and pipeline orchestration, with a proven ability to develop reliable ETL/ELT workflows and maintain high-quality data infrastructure.

Location: Onsite - Menlo Park, California (CA), United States.

Pay Rate: DOE

Duration: 6 Months

We provide comprehensive medical benefits, a 401k plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using advanced SQL and Python to support large-scale analytics and reporting requirements.
• Build, optimize, and maintain data workflows across Hive/Spark-based data warehouse environments, ensuring performance, accuracy, and reliability.
• Develop and manage pipeline orchestration workflows using Dataswarm, Airflow, or equivalent tools, including scheduling, backfills, and failure troubleshooting.
• Create and maintain analytics-ready datasets and data models supporting workforce measurement, staffing, capacity, and productivity reporting.
• Monitor pipeline health, implement data quality checks, and establish monitoring practices to ensure data accuracy and adherence to service-level agreements (SLAs).
• Maintain and improve legacy data pipelines, automate manual workflows, and develop self-service datasets to improve operational efficiency.
• Partner with data scientists, data architects, analysts, and operations stakeholders to translate business requirements into reliable data solutions and support reporting and dashboard development.

Internal Responsibilities

• Attend regular internal practice community meetings.
• Collaborate with your itD practice team on industry thought leadership.
• Complete client case studies and learning material (blogs, media material).
• Build out material to contribute to the Digital Transformation practice.
• Attend internal itD networking events (in person and virtual).
• Work with leadership on career fast-track opportunities.

Required Qualifications and Skills

• Strong proficiency in advanced SQL, including Presto, Trino, or Spark SQL.
• Basic to intermediate Python programming experience for production ETL/ELT development.
• Experience building, optimizing, and maintaining large-scale data pipelines across Hive/Spark-based data warehouse environments.
• Strong understanding of data warehousing fundamentals, including partitioning, incremental loads, data modeling, and query performance optimization.
• Experience with pipeline orchestration tools such as Dataswarm, Airflow, or equivalent platforms.
• Experience troubleshooting pipeline failures, managing historical backfills, implementing data quality checks, and maintaining reliable workflows.
• Understanding of data pipeline monitoring, reliability, and SLA requirements.

Preferred Qualifications and Skills

• Experience supporting dashboard backends using Unidash, Tableau, or similar reporting platforms.
• Familiarity with operations and support analytics, including workforce, capacity, staffing, and productivity metrics.
• Experience with Git, version control, code reviews, and technical documentation.
• Experience automating manual workflows and building self-service datasets.
• Exposure to data quality frameworks, anomaly detection, and SLA alerting.
• Experience working with data scientists, analysts, and business stakeholders in large-scale data environments.
• Familiarity with data engineering process certifications such as Six Sigma, CBPP, BPM, ISO 20000, ITIL, or CMMI.

Education

• Bachelor's degree in Computer Science, Computer Engineering, or a related technical field required.

Company Description

About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints.

The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. itD is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application process, or to perform the essential functions of a position, please contact us at [email protected] and let us know the nature of your request and your contact information.

Additional Info

Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!