{"id":1051065,"url":"https://alion.io/job/mastercard-senior-data-engineer-10","title":"Senior Data Engineer","company":{"id":252,"name":"Mastercard","domain":"mastercard.com","url":"https://alion.io/company/mastercard","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":92,"open_postings":137,"ghost_share":0.007,"stale_share":0.496,"repost_share":0.036,"time_to_fill_p50_days":20,"computed_at":"2026-09-27T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":25000,"max_usd":52000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":9},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Apache NiFi","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"Linux","optional":false},{"name":"Platform Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Docker","optional":true},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-09-16T00:00:00Z","employer_posted_date":"2026-09-16","last_verified_at":"2026-09-27T05:12:55Z","board_verified":true,"closed_at":null,"days_open":12,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":12},"description":"Our Purpose\nMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.\nTitle and Summary\nSenior Data EngineerJob Posting Title: Senior Data Engineer - Spark / Kafka / NiFiWho is Mastercard?\nMastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our culture is guided by the Mastercard Way-own it, simplify it, sense of urgency, thoughtful risk taking, unlock potential, and be inclusive.\n________________________________________\nJob Summary\nWe are seeking a highly skilled Senior Data Engineer with deep expertise in Testing, validating, Developing and supporting large-scale batch and real-time data platforms built on Apache Spark, Apache Kafka, and Apache NiFi.\nThe ideal candidate will have a strong background in distributed systems, streaming architectures, event-driven platforms, and cloud-native data processing.\nThe successful candidate will collaborate with cross-functional teams to design innovative solutions, enhance platform capabilities, and ensure operational excellence in production environments.\nKey Responsibilities\nDevelop, test, validate and maintain, scalable batch and real-time data processing applications using Apache Spark, Kafka, and NiFi.\nBuild validation suite for high-performance, fault-tolerant, and resilient distributed systems capable of handling large data volumes.\nDevelop reusable frameworks, libraries, and shared platform components to accelerate engineering productivity.\nTranslate business and technical requirements into scalable software solutions.\nContribute to architecture discussions, technical designs, and engineering standards.\nStreaming & Data Platform Engineering\nCreate and implement validation suite for Spark batch and streaming applications to process high-volume datasets efficiently.\nValidate and support Apache NiFi data ingestion, transformation, and routing workflows.\nBuild reliable data pipelines supporting real-time and near-real-time processing requirements.\nImplement solutions for data replay, recovery, checkpoint management, and failure handling.\nPerformance & Scalability\nAnalyze system bottlenecks and optimize application performance, throughput, and resource utilization.\nImprove scalability, reliability, and availability of distributed applications.\nDevelop and test solutions leveraging modern storage technologies including Apache Ozone, Ceph, and cloud-native storage platforms.\nBuild deployment automation and operational tooling to improve platform reliability.\nMonitor production environments and proactively address operational concerns.\nParticipate in troubleshooting, root-cause analysis, and incident resolution activities.\nEngineering Excellence\nParticipate in code reviews and promote engineering best practices.\nMaintain high-quality documentation for systems, APIs, and platform components.\nCollaborate closely with Product, Architecture, Platform, and DevOps teams.\nContribute to CI/CD processes and continuous improvement initiatives.\nMentor junior engineers and foster a culture of technical excellence and innovation.\nRequired Qualifications\nBachelor's degree in Computer Science, Engineering, or related technical field.\n6+ years of hands-on software deployment, validation, testing, development experience on large-scale data-intensive applications.\nStrong expertise in Apache Spark (Batch and Structured Streaming).\nStrong experience with Apache Kafka and event-driven architectures.\nExperience developing, testing and supporting Apache NiFi data flows.\nProficiency in Scala, pyspark or Python.\nStrong SQL and data modeling skills.\nExperience working with distributed storage systems such as Apache Ozone, Ceph, HDFS, or cloud-based object stores.\nHands-on experience with Linux, Git, shell scripting, and CI/CD pipelines.\nStrong analytical, problem-solving, and communication skills.\nExperience operating production-grade distributed systems in cloud or hybrid-cloud environments.\nPreferred Qualifications\nExperience building observability solutions using monitoring and logging platforms.\nKnowledge of data governance, metadata management, and data platform best practices.\nExperience with containerization and orchestration technologies (Docker, Kubernetes).\nKnowledge of performance engineering, resilience testing, and production readiness assessments.\nExperience building engineering automation frameworks and reusable validation platforms.\nFamiliarity with observability tools, monitoring systems, and operational analytics.\nExperience in highly regulated, transaction-processing, or large-scale enterprise environments.\nCorporate Security Responsibility\nAll activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:\nAbide by Mastercard’s security policies and practices;\n\nEnsure the confidentiality and integrity of the information being accessed;\n\nReport any suspected information security violation or breach, and\n\nComplete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.","description_format":"text","description_chars":5930,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cards & Card Issuing","Payment Processing & Gateways"],"lifecycle":[{"event":"open","at":"2026-09-18T23:50:55Z"}],"liveness":{"score":58,"band":"ok","label":"Likely open","p_open":1,"p_active":0.642,"p_room":0.9,"age_days":11,"expected_fill_days":20,"reasons":["conf:0","stale_co","wave","velocity","win:mid","comp:brand"],"computed_at":"2026-09-27T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/mastercard-senior-data-engineer-10","json_url":"https://alion.io/job/mastercard-senior-data-engineer-10.json","meta":{"generated_at":"2026-09-28T04:37:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":2927,"day_limit":5000,"remaining_today":2073,"minute_limit":60,"resets_at":"2026-09-29T00:00:00Z"}}}