{"id":136147,"url":"https://alion.io/job/two95-big-data-platform-engineer-2","title":"Big Data Platform Engineer","company":{"id":3423,"name":"Two95 International","domain":"two95.com","url":"https://alion.io/company/two95","size_band":"201-500","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"D","score":51,"open_postings":501,"ghost_share":0.808,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":15500,"max_usd":42000,"period":"year","method":"role_country_seniority_unknown","sample_n":171},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache NiFi","optional":false},{"name":"Azure","optional":false},{"name":"Azure AKS","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Bicep","optional":false},{"name":"CI/CD","optional":false},{"name":"DNS","optional":false},{"name":"Docker","optional":false},{"name":"Git","optional":false},{"name":"Istio","optional":false},{"name":"Kubernetes","optional":false},{"name":"Nginx","optional":false},{"name":"Service Mesh","optional":false},{"name":"Terraform","optional":false},{"name":"VPN","optional":false},{"name":"ArgoCD","optional":true},{"name":"Azure Data Factory","optional":true},{"name":"GitOps","optional":true},{"name":"Grafana","optional":true},{"name":"Microsoft Defender","optional":true},{"name":"Microsoft Defender for Cloud","optional":true},{"name":"OpenTelemetry","optional":true},{"name":"Platform Engineering","optional":true},{"name":"PowerShell","optional":true},{"name":"Prometheus","optional":true},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-08-03T00:00:00Z","employer_posted_date":"2026-08-03","last_verified_at":"2026-10-29T14:47:22Z","board_verified":true,"closed_at":null,"days_open":87,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":87},"description":"Experience Requirements\n8+ years of overall IT experience\n5+ years of experience in Cloud Infrastructure Engineering\n4+ years of experience working with Kubernetes platforms\n3+ years of experience supporting enterprise-scale Data Platforms\n3+ years of experience in DevOps/SRE practices\n2+ years of experience working with Azure Data Services\nMandatory Skills\nCandidates must possess strong hands-on experience in the following areas:\nApache NiFi\nAzure Event Hub\nAzure Functions\nEnterprise-scale Data Platform Administration These are core and non-negotiable requirements. Profiles without hands-on experience in Apache NiFi and Azure Event Hub will not be considered.\nRequirements\n1. Azure Kubernetes Service - AKS\nStrong Expertise\nAKS cluster deployment and administration\nCluster upgrades and patch management\nNode pool management\nIngress Controllers, including NGINX and Application Gateway\nRBAC implementation\nAKS security hardening\nAutoscaling using HPA, VPA, and Cluster Autoscaler\nPersistent storage management\nTroubleshooting cluster issues\nNetwork policies\nExperience\nProduction support of AKS environments\nMulti-node and multi-environment AKS setups\nHigh availability and disaster recovery implementation\n2. Kubernetes and Azure Networking\nKubernetes Networking\nKubernetes networking concepts\nServices, Ingress, and Load Balancers\nDNS resolution\nPod-to-Pod communication\nPod-to-Service communication\nNetwork Policies\nService Mesh concepts, preferably Istio\nCNI Architecture\nAzure Networking\nVirtual Networks\nSubnets\nPrivate Endpoints\nPeering\nNetwork Security Groups\nUser Defined Routes\nAzure Firewall\nVPN connectivity\n3. Docker and Containerization\nDocker image creation and optimization\nContainer lifecycle management\nRegistry management\nSecurity scanning\nMulti-stage builds\nContainer troubleshooting\nAzure Container Registry\nImage versioning and governance\n4. Azure DevOps and CI/CD\nCI/CD Expertise\nAzure DevOps Pipelines\nYAML pipelines\nBuild and Release pipelines\nGit repositories\nBranching strategies\nInfrastructure Deployment\nInfrastructure as Code\nARM Templates\nBicep\nTerraform\nAutomation\nDeployment automation\nEnvironment promotion\nRelease management\n5. Monitoring and Observability\nAzure Monitor\nMonitoring strategy implementation\nAlert configuration\nDashboard creation\nLog Analytics\nKQL query development\nPerformance analysis\nTroubleshooting\nApplication Monitoring\nAzure Application Insights\nDistributed tracing\nMetrics collection\nAKS Monitoring\nCluster health monitoring\nPod performance monitoring\nResource optimization\n6. Azure Event Hub Candidates must have strong hands-on experience in:\nEvent Hub architecture\nNamespace management\nConsumer groups\nScaling and throughput units\nMonitoring and troubleshooting\nSecurity and access control 7. Azure Functions Candidates must have hands-on experience in:\nDeployment and operations support\nFunction App management\nScaling configuration\nManaged Identity integration\nMonitoring and troubleshooting\nCI/CD deployment 8. Apache NiFi Candidates must have strong hands-on experience in:\nNiFi cluster setup and maintenance\nFlow deployment\nSecurity configuration\nPerformance tuning\nMonitoring\nTroubleshooting Preferred\nNiFi Registry\nCluster scaling\nHigh availability implementation 9. Infrastructure as Code Must-Have Skills\nTerraform\nBicep\nARM Templates\nRequired Capabilities\nPlatform provisioning •Environment consistency •Version-controlled infrastructure Good-to-Have Skills Platform Engineering •GitOps using ArgoCD or Flux •Platform automation •Self-service platform concepts •Internal Developer Platform Observability •Grafana •Prometheus •OpenTelemetry Security •Microsoft Defender for Cloud\nKubernetes security best practices •Container security •Secrets management •Vulnerability management Data Platform •Azure Data Factory •Synapse Analytics Cloud •Multi-region architecture •Disaster recovery planning •Landing Zone implementation Scripting •PowerShell •Bash •Python\nKey Responsibilities\nManage and support AKS-based Big Data platform infrastructure.\nAdminister Apache NiFi, Azure Event Hub, and Azure Functions.\nImplement and maintain CI/CD pipelines using Azure DevOps.\nMonitor platform health using Azure Monitor and Log Analytics.\nTroubleshoot platform, networking, and infrastructure issues.\nImplement infrastructure automation through Terraform and Bicep.\nEnsure platform security, governance, and compliance.\nCollaborate with Data Engineering teams for platform enablement.\nPerform upgrades, patching, capacity planning, and optimization.\nSupport production incidents and platform reliability initiatives.","description_format":"text","description_chars":4584,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-08-03T00:00:00Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":1,"p_active":0.158,"p_room":0.28,"age_days":87,"expected_fill_days":20,"reasons":["conf:3","agency","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/two95-big-data-platform-engineer-2","json_url":"https://alion.io/job/two95-big-data-platform-engineer-2.json","meta":{"generated_at":"2026-10-29T16:13:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24213,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3423},"rest":"https://alion.io/mcp/rest/get_company?id=3423"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftwo95-big-data-platform-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftwo95-big-data-platform-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftwo95-big-data-platform-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/two95-big-data-platform-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftwo95-big-data-platform-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":136147}},{"tool":"search_jobs","arguments":{"company":"two95.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":136147},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}