2,441,359open jobs
150,180companies
296,361added this week
Browse all
Location
In office (Austin)
Seniority
Senior · 10+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 20, 2026. Virta Sant scores B on the Alion truth index.

Overview
Company
Impact
Profile match
We are a global team of cloud experts. We provide an end-to-end set of capabilities to help organizations thrive in the cloud.

Senior Data Engineer - Capacity Planning & Forecasting

Type: Remote | Brazil, Mexico, Chile, or Colombia

Coverage: Pacific Hours (8:00 AM - 5:00 PM PST)

Experience: 10+ years

Organization: Data Platform / Infrastructure Engineering

Job Description:

We are looking for an experienced Data Engineer to join our Data Platform organization, focusing on infrastructure capacity planning, forecasting, utilization analytics, and cost optimization.

The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and analytical data models that integrate infrastructure telemetry, cloud consumption, workload demand, and financial data.

This role will play a critical part in enabling data-driven infrastructure investment decisions by providing visibility into compute, GPU, TPU, storage, and cloud resource utilization, forecasting future capacity requirements, and identifying cost optimization opportunities.

The candidate will collaborate closely with Infrastructure Engineering, Data Science, Finance, Procurement, and Business Operations teams to build reliable data products that support strategic capacity planning.

Key Responsibilities:

Data Engineering & Pipeline Development:

Design, develop, and maintain scalable ETL/ELT data pipelines to ingest, process, and transform large volumes of infrastructure and cloud consumption data.

Integrate data from multiple sources, including cloud billing systems, infrastructure telemetry, workload management platforms, and financial systems.

Develop optimized data models and analytical datasets for infrastructure utilization, capacity tracking, and cost reporting.

Implement data validation, reconciliation, monitoring, and quality checks to ensure data accuracy and reliability.

Optimize data pipelines for performance, scalability, and operational efficiency.

Capacity Planning & Forecasting:

Develop data-driven solutions to monitor and forecast infrastructure capacity requirements.

Analyze historical and current utilization trends across GPU, TPU, CPU, memory, and storage resources.

Build forecasting models to predict future compute demand based on workload growth and business requirements.

Identify capacity constraints, resource bottlenecks, underutilization, and potential infrastructure risks.

Support capacity planning through demand forecasting, scenario analysis, and capacity optimization.

Develop dashboards and reporting solutions to track available capacity, committed capacity, utilization, and projected demand.

Cloud Cost & Infrastructure Analytics:

Analyze cloud infrastructure consumption and billing data across AWS, GCP, Azure, or other cloud platforms.

Develop cost attribution models to understand infrastructure spending across workloads, teams, and business units.

Calculate key infrastructure cost metrics, including:

Cost per GPU hour

Cost per CPU hour

Cost per workload/job

Cost per inference request

Cost per million tokens

Identify cost optimization opportunities, including idle resources, underutilized infrastructure, and inefficient capacity commitments.

Partner with Finance and Procurement teams to reconcile infrastructure costs and support financial planning.

Data Modeling & Analytics:

Design and maintain dimensional and analytical data models for infrastructure capacity and financial reporting.

Develop reusable datasets and metrics to support operational and strategic decision-making.

Perform root-cause analysis of utilization anomalies, cost fluctuations, and capacity deviations.

Build automated reports and dashboards to provide actionable insights to stakeholders.

Ensure consistency between operational telemetry, consumption records, and financial reporting.

Stakeholder Collaboration:

Work closely with Infrastructure Engineering teams to understand workload patterns, infrastructure architecture, and capacity requirements.

Collaborate with Finance and Procurement teams on infrastructure budgeting, cloud commitments, and cost forecasting.

Partner with Data Science and Machine Learning teams to understand AI/ML workload requirements and compute consumption patterns.

Translate complex technical and financial data into meaningful insights and recommendations for leadership.

Qualifications:

Required Technical Skills:

Programming & Data Processing

Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.

Proficiency in Python for data processing, automation, and analytical workflows.

Experience with Pandas, PySpark, or similar data processing frameworks.

Data Engineering

Hands-on experience building scalable ETL/ELT pipelines.

Strong understanding of data warehousing, data modeling, and distributed data processing.

Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.

Knowledge of data quality frameworks, pipeline monitoring, and data governance.

Cloud & Infrastructure

Experience working with AWS, Google Cloud Platform, or Microsoft Azure.

Understanding of cloud billing, resource utilization, and consumption datasets.

Knowledge of compute, storage, networking, and infrastructure resource metrics.

Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable.

Capacity Planning & Forecasting

Understanding of capacity management, resource utilization, and demand forecasting.

Experience analyzing historical trends and predicting future resource requirements.

Knowledge of time-series forecasting, statistical modeling, and scenario analysis.

Ability to identify infrastructure bottlenecks and resource optimization opportunities.

Visualization & Reporting

Experience with Tableau, Power BI, Looker, or similar visualization tools.

Ability to develop operational dashboards and executive-level reporting.

Preferred Qualifications:

Experience in cloud infrastructure analytics or FinOps.

Exposure to GPU/TPU capacity planning and AI/ML infrastructure.

Understanding of machine learning inference workloads and compute economics.

Experience working with large-scale infrastructure telemetry datasets.

Knowledge of infrastructure cost allocation and unit economics.

Experience supporting financial forecasting, budgeting, or procurement decisions.

Key Performance Indicators (KPIs):

Data pipeline reliability and successful execution rates.

Accuracy and completeness of infrastructure utilization data.

Accuracy of capacity demand forecasts.

Visibility into infrastructure capacity and resource consumption.

Identification of cloud cost optimization opportunities.

Reduction in manual reporting and reconciliation efforts.

Timeliness and accuracy of capacity and financial reporting.

Educational Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline.

Equivalent practical experience in Data Engineering, Infrastructure Analytics, or Capacity Planning will also be considered.

Ideal Candidate Profile:

The ideal candidate is a technically strong Data Engineer with an analytical mindset and an understanding of infrastructure economics. They should be comfortable working with large-scale datasets, developing reliable data pipelines, analyzing resource utilization, and translating complex data into actionable capacity and cost optimization insights.

The candidate should demonstrate strong problem-solving skills, ownership, attention to detail, and the ability to collaborate across engineering and business teams.

Core Competencies: Data Engineering | SQL | Python | Cloud Analytics | Capacity Planning | Demand Forecasting | Infrastructure Optimization | FinOps | Data Modeling | Business Analytics

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,441,359 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Remote, many countries
Similar stack
Same company
Austin
$200k – $242k per year · Remote (United States) · 6+ years exp · PhD · United States
Python
SQL
AI/ML
Reinforcement Learning
AI Agents
LLM
LLM Guardrails
Machine Learning
Apply
In office · 4+ years exp · Master's Degree · New York
Python
SQL
Apply
$140k per year · In office · Full-Time · McLean
Python
Python
pySpark
Databases
MySQL
PostgreSQL
Apache Kafka
AI/ML
Spark
DevOps
CI/CD
AWS
Amazon S3
Amazon Kinesis
Analytics
AWS Glue
Apply
In office · 1+ year exp · Master's Degree · Houston
AI/ML
Machine Learning
Apply
$87k – $110k per year · Remote (United States) · Full-Time · 4+ years exp · Master's Degree
Python
SAS
Stata
AI/ML
Time Series
Apply
Junior Data Scientist 9 hours ago
Remote (EAEU) · Moscow
Python
SQL
AI/ML
Machine Learning
Apply
Remote (likely EAEU) · Moscow
Python
Java
Python
SQLAlchemy
pySpark
Databases
PostgreSQL
Apache Iceberg
Apache Kafka
Greenplum
AI/ML
Spark
Airflow
AI Agents
Flink
DevOps
Yandex Cloud
CI/CD
Git
AWS
Kubernetes
GitLab
Amazon S3
Linux
Apply
Remote (likely EAEU) · Moscow
Python
SQL
Databases
MySQL
PostgreSQL
Db2
ClickHouse
Apache Iceberg
MinIO
MS SQL
Apache Kafka
Greenplum
Trino
AI/ML
Spark
Airflow
dbt
Flink
DevOps
Git
Amazon S3
Apply
Remote (likely EAEU) · 3+ years exp · Bachelor's Degree · Moscow
Python
Java
SQL
Databases
Apache Kafka
Amazon Redshift
Analytics
ETL/ELT
Talend
Apply
ETL Developer 11 hours ago
$26k – $43k per year · Remote (likely EAEU) · Moscow
Python
SQL
Python
pySpark
Databases
PostgreSQL
Oracle
ClickHouse
Apache Iceberg
Delta Lake
RabbitMQ
MinIO
Apache Kafka
Greenplum
Vertica
AI/ML
Hadoop
Spark
Airflow
dbt
DevOps
CI/CD
Git
Docker
Amazon S3
Linux
Analytics
ETL/ELT
Management
Confluence
Jira
Apply
In office · Full-Time · 1+ year exp · Brussels
Python
SQL
PowerShell
Databases
MS SQL
AI/ML
Copilot
Cursor
DevOps
Git
Analytics
ETL/ELT
Management
Agile
Scrum
Apply
In office · 2+ years exp · Master's Degree · Bengaluru
Python
SQL
SAS
Analytics
Microsoft Excel
Apply
Equity · In office · 3+ years exp · Bachelor's Degree · South Africa
Python
SQL
Databases
Snowflake
AI/ML
Copilot
DevOps
Rest API
Azure DevOps
Azure
AWS
Analytics
Power BI
ETL/ELT
Management
Jira
Agile
Scrum
Apply
$115k – $192k per year · In office · Full-Time · 8+ years exp · Philadelphia
Python
Java
Scala
Databases
ElasticSearch
AI/ML
Spark
Model Context Protocol
AI Agents
RAG
A2A
Semantic Search
Knowledge Graph
DevOps
Terraform
CI/CD
Management
Agile
Kanban
Apply
In office · Full-Time · Gorinchem
Python
MATLAB
AI/ML
Machine Learning
SpaceTech
MBSE
Apply
In office · Full-Time · Austin
Python
Python
pySpark
Databases
Databricks
AI/ML
Spark
DevOps
FinOps
Analytics
ETL/ELT
Apply
Senior Data Engineer 16 days ago
In office · Full-Time · 5+ years exp · Austin
Databases
Snowflake
AI/ML
Airflow
dbt
DevOps
Prometheus
CI/CD
Cortex
Analytics
Tableau
Power BI
ETL/ELT
Dimensional Modeling
Apply
In office · Full-Time · 7+ years exp · Bachelor's Degree · Austin
Python
Go
Java
Databases
PostgreSQL
Apache Kafka
AI/ML
Spark
Flink
DevOps
Rest API
gRPC
Terraform
GCP
Istio
OpenTelemetry
Crossplane
Envoy
KEDA
Linkerd
Prometheus
Azure
CI/CD
GitOps
ArgoCD
AWS
Docker
Kubernetes
Grafana
SRE
Platform Engineering
Service Mesh
Bazel
SLI/SLO/SLA
Linux
Cybersecurity
Keycloak
SOC 2
GDPR
Apply
In office · Full-Time · PhD · Austin
Databases
Snowflake
Neo4j
AI/ML
OpenAI
DevOps
Terraform
Azure
CI/CD
Kubernetes
Platform Engineering
Configuration Management
Bicep
Azure AKS
Cybersecurity
Microsoft Sentinel
Microsoft Defender
SOC 2
HIPAA
Least Privilege
Microsoft Defender for Cloud
Microsoft Entra ID
SIEM
Cryptography
Vault
Apply
In office · Full-Time · 5+ years exp
JavaScript
Java
TypeScript
SQL
Node JS
Databases
Snowflake
Neo4j
Azure SQL Database
AI/ML
Model Context Protocol
dbt
LLM
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Cybersecurity
Microsoft Entra ID
Apply
In office · 12+ years exp · Bachelor's Degree · Austin
Databases
Google BigQuery
AI/ML
AI Agents
Agentic Workflows
DevOps
GCP
Apply
In office · Bachelor's Degree · Austin
Apply
In office · 7+ years exp · Austin
DevOps
Windows
VPN
Wi-Fi
Management
Jira
ServiceNow
ITSM
Apply
$30k – $70k per year · In office · Full-Time · Austin
Apply
Registered Nurse (RN) 3 hours ago
In office · Austin
Apply
See all jobs
This is one of many
2,441,359 more open roles from verified company boards, updated every day.