SDE IV

Responsibilities:

• Platform Reliability and Operations: Ensure availability, stability, observability, and scalability of the data platform. Own production issue resolution, RCA, and continuous improvements.
• Architecture and Feature Development: Lead design and delivery of platform features. Make informed choices across data architectures (e. g., batch vs. streaming, Delta vs. Iceberg), orchestration tools (Airflow, Argo), and scalability patterns.
• Performance and Cost Efficiency: Implement best practices for partitioning, indexing, and resource optimization. Drive cost efficiency through FinOps-aligned design and observability.
• Platform Thinking and Governance: Treat the platform as a product balanced on usability, governance, and adoption. Define and track KPIs for usage, performance, and cost.
• Code Excellence and Engineering Discipline: Write modular, testable, and maintainable code. Build CI/CD pipelines and structured logging, and enable observability and debugging by design.
• Collaboration and Leadership: Collaborate across teams, own stakeholder communication, drive sprint execution, and contribute to documentation. Mentor engineers and influence best practices.

Requirements:

• Experience and Skills: 7-10 years in platform/data engineering. Proficient in Python, Shell, Kubernetes, CI/CD, Terraform, observability tools, and Linux-based systems.
• Cloud and Data Ecosystem: Hands-on with Azure/GCP/AWS, modern orchestration tools, data formats (Parquet, Delta, and Iceberg), and compute engines (Databricks, Clickhouse, and Trino).
• System Design and Optimization: Design scalable, fault-tolerant systems with efficient storage, caching, and cost control. Experience with model serving frameworks is a plus.
• Governance and Reliability: Apply data access policies, SLA/SLO tracking, and schema evolution best practices. Enable monitoring, auditing, and incident management.
• Leadership and Ownership: Take initiative, prioritize business impact, mentor team members, and drive accountability in delivery and technical decision-making.