Principal Software Engineer, Core Infrastructure
Leads development and begins architecting components of scalable, elastic distributed systems. Defines and enforces scalability requirements for owned components; optimizes code and data paths for high-throughput, hyper-scale workloads; and leverages data plane platforms for large-scale retrieval, storage, and processing. Designs fault-tolerant, in-service-upgradable systems using redundancy, replication, failover, and policies for partitions, applying load-shedding, throttling, and rate-limiting to handle network unreliability while meeting SLOs.
Establishes KPIs and telemetry; builds proactive dashboards and alerts; and designs complex validation (fault injection, brownouts), replication, and synchronization for correctness and durability. Proactively diagnoses and resolves production issues, mentors peers, and ensures operational readiness. Implements robust security controls, executes remediation, maintains compliance documentation, and develops IaC and automation that enable safe patching, updates, and rollbacks within change-management plans.
System Design & Architecture - System Scalability:
- Lead the development and implementation, and begin to architect, components of scalable distributed systems that support horizontal and vertical scaling to meet system demands, including leveraging distributed state management tools.
- Optimize code and/or systems for large-scale data processing and high-throughput requirements to support hyper-scale systems.
- Define scalability requirements for owned components and ensure design and implementation requirements are met.
- Design systems to scale with elasticity (e.g., effectively scaling both up and down).
- Leverage data plane platforms to effectively handle large-scale data retrieval, storage, and processing.
- Design performance and load testing.
System Reliability Design:
- Build and design fault-tolerant components and systems capable of withstanding in-service updates by implementing redundancy, replication, and automatic failover mechanisms.
- Design systems to effectively handle service disruptions (e.g., network partitions) by prioritizing consistency, availability, or partition tolerance.
- Implement and optimize approaches to handle network unreliability, including load-shedding, throttling, and rate-limiting.
- Design components and systems that are durable and adhere to service level objectives (SLOs), setting expectations for availability and durability of other computing services within the department.
System Reliability Performance:
- Define key performance indicators (KPIs) and telemetry to identify gaps or issues in running systems.
- Build and customize moderately complex dashboards, telemetry systems, and alerting mechanisms to proactively monitor components and system health..
Correctness / Availability:
- Design and implement functional and correctness requirements for feature sets and/or systems in new or existing systems.
- Design complex test scenarios (e.g., fault-injection, brown-out) to evaluate system correctness.
- Implement data replication and synchronization techniques to maintain data integrity and availability.
Operational Troubleshooting & Incident Management:
- Take a proactive role in diagnosing, debugging, and resolving issues in active components and systems to support ongoing operation, and mentor others in these processes.
- Implement strategies to prevent interruptions, ensuring no maintenance windows are required for customers and users when resolving issues.
- Maintain expertise in owned components and systems to ensure effective troubleshooting and performance.
- Meet operational readiness expectations through design and implementation.
- Serve in operational support rotations, providing guidance in incident response and root cause investigations.
Compliance & Security:
- Implement robust security measures to protect data and applications in multi-tenant environments, including encryption techniques and access controls.
- Execute remediation plans to address identified security gaps.
- Ensure cloud infrastructure is in compliance with industry standards and regulations and that documentation is up to date.
Automation & Change Management:
- Develop and maintain automation scripts and tools (e.g., Infrastructure as Code (IaC)) to manage cloud infrastructure.
- Create and adhere to change management plans for patching, updating, and rolling back applications, and begin designing systems and components to allow for automation of these processes.
Minimum Job Qualifications
Education and/or Experience:
11 years of experience in software development
OR
Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development
OR
Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development
OR
Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development
OR
Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development
OR
Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 year of experience in software development.
Job Skills:
Same skills as prior level plus;
Data Analysis: Demonstrated ability to analyze and interpret data to produce actionable business insights.
Agile Methodologies: Demonstrated ability to use agile methodologies to drive continuous improvement and product delivery.
Automation: Demonstrated ability in or knowledge of automation, including designing, implementing, and managing automated tools, processes, or systems to streamline operations.
Compliance: Demonstrated knowledge of and adherence to regulatory, legal, and organizational compliance requirements.
Quality Assurance: Demonstrated ability in or knowledge of quality assurance, including ensuring adherence to standards and implementing quality control measures.
Scripting Languages: Demonstrated ability in or knowledge of scripting languages, including writing and maintaining scripts to improve system efficiency.
Software Test Plans: Demonstrated ability to develop and execute effective software test plans to validate product quality.
User Experience Development: Demonstrated ability in or knowledge of user experience development, including designing intuitive and effective user interfaces and content.
Code Review: Demonstrated ability to conduct in-depth code reviews for software quality assurance.
Embedded Systems: Demonstrated ability to develop embedded systems, balancing hardware and software for optimal performance.
Software Estimation: Demonstrated ability to provide accurate software effort and complexity estimates for project planning and scheduling.
Cloud - Cloud Platforms Experience:
3 year of academic or professional experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).
Testing and Automation Experience:
5 years of experience working in testing and automation at the system level.
Distributed Systems Experience:
4 year of experience working with delivering and operating large-scale distributed systems.
Preferred Job Qualifications
Education and/or Experience:
11 years of experience in software development
OR
Bachelor's of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development
OR
Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 7 years of experience in software development
OR
Master's of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development
OR
Master's Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development
OR
Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 years of experience in software development.
People Leadership / Management Experience:
1 year of experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).