Sr Specialist System Engineering (Kubernetes, CI/CD Pipeline, Python automation)

Job Responsibilities

• Serve as the primary off-shoreDevOps/Infra support lead for Automation Tools and 4G/5G Core Network Simulators across NPRD/Labs and PROD environments.

• Design, build, and maintain Azure DevOps CI/CD pipelines using a 3-tier (hyper→macro→micro) architecture to automate packaging, publishing, and deployments.

• Develop and maintainHelm v3 (OCI) charts for application and infra components; package/publish artifacts to JFrogArtifactory OCI.

• Automate Kubernetes deployments via Python orchestration (e.g., deploy.py), including config substitution, sequencing, and post-deployhealth checks.

• Own secrets management end-to-end: Ansible Vault encryption, HashiCorpVault runtime retrieval (AppRole/KV), and token rotation with zero-plaintextcontrols.

• Provision and operateinfrastructure: KVM/QEMU/libvirtVM lifecycle on Simzonehosts; implement SR-IOV passthrough and host networking configurations.

• Author/maintainInfrastructure-as-Codeusing OpenStack HEAT (on-premVM provisioning) and Azure Bicep (NAKS/AON resources).

• Configure advanced K8s networking and security: MultusNADs (multi-NICpods), MetalLBL2 VIPs, Calico policies, SR-IOV for performance I/O.

• Manage storage and stateful services: Rook-Cephprovisioning (RWX/RWO), local-storagefor single-nodeclusters, PVC sizing, and storage class governance.

• Build/maintainlarge Ansible automation footprint (deployment, upgrades, backup/restore, mechIDmgmt, vault operations, compliance tasks).

• Operate AOSM lifecycle pipelines (nfPL0→nfPL4) to publish NF definitions, build deployment configs, deploy to NAKS, and onboard to HCEV.

• Drive environment promotion (NPRD→PROD): release branching, versioning updates, quarterly release coordination, and consistency across lab/pre-prod/prod.

• Maintain per-instanceconfiguration at scale (20+ K8s instances) using real-parameters-values.json/ input-values.jsonand enforce correctness across environments.

• Implement observability and verification: deploy kube-prometheus-stack, integrate DevOps metrics (DORA Build Events API), and standardize service health checks.

• Own certificate lifecycle management via cert-managerand vault-issuerpatterns, including rotation workflows and Vault PKI integration.

• Maintain supply-chainsecurity artifacts (bom.yamlvalidation, images.jsonversion tracking, reproducible builds with pinned versions).

• Administer multi-repogovernance (30+ repos across GitHub + ADO): branch protections, PR governance, and cross-repodependency coordination.

• Build AI-assistedDevOps tooling (agentic workflow with specialized agents) to accelerate analysis, pipeline engineering, diagnostics, and self-healingoperations.

• Provide incident response and operational troubleshooting: kubectldiagnosis, log analysis, NF status checks, backup/restore execution, and chaos testing support.

Job Qualifications/ Required Qualifications

• Hands-onexperience operating Kubernetes platforms and production-grade CI/CD pipelines (Azure DevOps, GitHub/GitOps).

• Strong automation skills in Python ,Ansible, and Bash for deploymentorchestration and operational tooling.

• Deep experience with Helm 3 (OCI) packaging and release management; artifact publishing (JFrogArtifactory OCI).

• Expertisein secretsmanagement (HashiCorpVault + Ansible Vault), credential rotation, and secure repo practices.

• Experience with infrastructure provisioning and IaC(OpenStack HEAT and/or Azure Bicep) across hybrid environments.

• Strong troubleshooting and incident management skills across K8s clusters, networking, and stateful services.

• Working knowledge of advanced K8s networking/storage (Multus, SR-IOV, MetalLB, Calico; Rook-Ceph/local storage).

• Understanding of 5G/LTE telecom networking fundamentals and containerized NF operational needs (e.g., DPDK / SCTP / GTP considerations).

• IP/Networking/routing/firewalls/Ubuntu repo's packages knowledge and hands on experience

Preferred Qualifications

• Experience operating AOSM pipelines (nfPL0→nfPL4) and NF onboarding workflows into NAKS/AON/HCEV environments.

• Experience managing KVM/QEMU/libvirtVM fleets on bare-metal, including SR-IOV passthrough and host networking.

• Experience with supply-chainsecurity artifacts (BOM generation/validation, digest pinning, reproducible builds).

• Proven ability to manage large-scale repo/pipeline governance across many repos with strong PR/branch policy discipline.

• Experience building or integrating AI-assistedDevOps workflows for diagnostics, automation, and operational self-healing.

Additional Job Information

This is an offshore role that requires daily collaboration with U.S. stakeholders, including overlapping work hours to ensure effective partnership and meet business needs.

Weekly Hours:

Time Type:

Location:

AT&T and its subsidiaries are committed to equal employment opportunity. All hiring, promotion, and other employment decisions remain merit-based and free from discrimination on the basis of race, color, religion, religious creed, national origin, ancestry, age, sex, sexual orientation, gender, gender identity, gender expression, physical disability, mental disability, pregnancy, medical condition, genetic information, marital status, citizenship status, military status, veteran status, or any other characteristic protected by federal, state, or local laws. In addition, AT&T will provide reasonable accommodations to qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made. Click here to learn more or request an application accommodation here.