{"id":3795828,"url":"https://alion.io/job/cognizant-senior-azure-data-engineer-2","title":"Senior Azure Data Engineer","company":{"id":85,"name":"Cognizant","domain":"cognizant.com","url":"https://alion.io/company/cognizant","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Cognizant Careers","truth_index":{"grade":"A","score":87,"open_postings":181,"ghost_share":0.011,"stale_share":0.47,"repost_share":0.072,"time_to_fill_p50_days":22,"computed_at":"2026-11-06T05:58:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sydney, Australia"],"countries":["AU"],"hiring_countries":["AU"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Bitbucket","optional":false},{"name":"CI/CD","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Hadoop","optional":false},{"name":"Jenkins","optional":false},{"name":"Jira","optional":false},{"name":"MongoDB","optional":false},{"name":"MS SQL","optional":false},{"name":"MySQL","optional":false},{"name":"Oracle","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-04T23:29:08Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-06T23:22:44Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"What makes Cognizant a unique place to work? The combination of rapid growth and an unique place international and innovative environment! This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world.\nAt Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.\nPosition Summary\nData Engineer with 6+ years of experience with end-to-end Big Data Pipeline design, ETL pipeline build using Apache Spark, Hive, Py-Spark and also having a hand-on experience in building of real-time data pipeline using Hadoop ecosystem. Also worked on mainly Agile methodology. Working for service-based IT consultancies have provided me the opportunities to work for different clients all over the globe. This has exposed me to different types of enterprise environments, which helped me gain knowledge in terms of technology, people, process and delivery.\nMandatory Skills\nSkills/Tools:Apache Spark, Sqoop, Py-spark, Spark SQL,Sterling\nDatabase:Hive, MySQL, Oracle,Oracle, Mongo, Sqoop, MS SQL,IBM-DB\nLanguage and No-SQL :Python,\nBuild Tools:Expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and Jenkins\nJob Scheduler:Familiarity with control-M scheduling tool for ordering the Job pipeline.\nMonitoring and Logging:Skills in using monitoring tools and analysing the root cause using Spark Logs\nSecurity and Compliance:Understanding of security best practices and compliance requirements\nBusiness Domain Knowledge: Banking (BFSI), Cards and Payments\nRoles And Responsibilities\nBeing part of the DDEP team, worked on Data Transformation Data Completeness, Data Validation, Data Schema Validation, Data duplication and Data accuracy to ensure proper data feed to production tables \nWorking on developing features as per client requirement and client requirement and involved in discussing the feasibility of changes to ensure successful run of developed code. \nInvolved in Building shell Scripts for various activities that is not handled by DDEP framework and building transformation logic using Py-spark and Spark SQL and by using same populating the records into SCD Table. \nWorked in code deployment activities in DEV, SIT and SVP Layer via CICD pipeline using Jenkins. \nHave good knowledge on SCD type 2 logics to maintain both history and active Records. \nHave worked on Analyzing the jobs and providing RCA if issues raised post sprint Release. \nTook part in Implementation and Design Walkthrough with various teams and worked on Production Deployment on change related Activities. \nProven Experience in delivering projects successfully through effective planning, prioritizing, team building , task scheduling and tracking scheduled tasks.lnvolved in creating control M Jobs for Ingestion Layer from edge node to RAW/Landing Layer and transformation layer. \nUtilize Atlassian tools, including Jira, confluence, and Bitbucket, for project management and team collaboration. \nInvolved on doing the Tech PIV and testing the functionality of the tables as part of Production Implementation \nWorking with Sterling and able to get confidence from client to handle the delivery single handedly. \nSalary Range: 90k-100k\nDate of Posting: 3/11/2026\nNext Steps: If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.\nFor a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.","description_format":"text","description_chars":3907,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Australia","iso":"AU","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Engineering Services","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-11-05T09:22:46Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":22,"reasons":["conf:0","velocity","win:early","comp:brand"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/cognizant-senior-azure-data-engineer-2","json_url":"https://alion.io/job/cognizant-senior-azure-data-engineer-2.json","meta":{"generated_at":"2026-11-07T01:42:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4177,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":85},"rest":"https://alion.io/mcp/rest/get_company?id=85"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcognizant-senior-azure-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcognizant-senior-azure-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcognizant-senior-azure-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cognizant-senior-azure-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcognizant-senior-azure-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3795828}},{"tool":"search_jobs","arguments":{"company":"cognizant.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3795828},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}