Software Development Engineer 4

Responsibilities:

• Platform -Reliability and Operations: Ensure availability, stability, observability, and scalability of the data platform. Own production issue resolution, RCA, and continuous improvements.
• Architecture and Feature Development: Lead design and delivery of platform features. Make informed choices across data architectures (e. g., batch vs. streaming, Delta vs. Iceberg), orchestration tools (Airflow, Argo), and scalability patterns.
• Performance and Cost Efficiency: Implement best practices for partitioning, indexing, and resource optimization. Drive cost efficiency through FinOps-aligned design and observability.
• Platform Thinking and Governance: Treat platform as a productbalance usability, governance, and adoption. Define and track KPIs for usage, performance, and cost.
• Code Excellence and Engineering Discipline: Write modular, testable, and maintainable code. Build CI/CD pipelines, structured logging, and enable observability and debugging by design.
• Collaboration and Leadership: Collaborate across teams, own stakeholder communication, drive sprint execution, and contribute to documentation. Mentor engineers and influence best practices.
• Governance and Reliability: Apply data access policies, SLA/SLO tracking, and schema evolution best practices. Enable monitoring, auditing, and incident management.
• Leadership and Ownership: Take initiative, prioritize business impact, mentor team members, and drive accountability in delivery and technical decision-making.

Requirements:

• 7-10 years in backend engineering.
• Proficient in Java, Shell, Kubernetes, CI/CD, Terraform, observability tools, and Linux-based systems.
• Know about Cloud and Data Ecosystem.
• Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet, Delta, Iceberg), and compute engines (Databricks, Clickhouse, Trino).
• System Design and Optimization: Design scalable, fault-tolerant systems with efficient storage, caching, and cost control.
• Experience with model serving frameworks is a plus.