{"id":4476836,"url":"https://alion.io/job/natwest-group-data-engineer-python-pyspark-aws-avp","title":"Data Engineer – Python, PySpark & AWS, AVP","company":{"id":184520,"name":"NatWest Group","domain":"natwestgroup.com","url":"https://alion.io/company/natwestgroup","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":99,"open_postings":12,"ghost_share":0,"stale_share":0.25,"repost_share":0,"time_to_fill_p50_days":15,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Data Science","role_family":"Data Science","seniority":"head","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon S3","optional":false},{"name":"API Gateway","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"IAM","optional":false},{"name":"Jira","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Kubernetes","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-17T17:56:18Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T17:56:18Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Join us as a Data Engineer\nWe’re looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure\nDay-to-day, you’ll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights\nIf you’re ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you\nWe're offering this role at associate vice president level\nWhat you’ll do\nYour daily responsibilities will include you developing a comprehensive knowledge of our data structures and metrics, advocating for change when needed for product development. You’ll also provide transformation solutions and carry out complex data extractions.\nWe’ll expect you to develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions. You’ll also source new data by using the most appropriate tooling before integrating it into the overall solution to deliver it to our customers.\nYou’ll also be responsible for:\nDriving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to build data solutions\nParticipating in the data engineering community to deliver opportunities to support our strategic direction\nCarrying out complex data engineering tasks to build a scalable data architecture and the transformation of data to make it usable to analysts and data scientists\nBuilding advanced automation of data engineering pipelines through the removal of manual stages\nLeading on the planning and design of complex products and providing guidance to colleagues and the wider team when required\nThe skills you’ll need\nTo be successful in this role, you’ll have an understanding of data usage and dependencies with wider teams and the end customer. You’ll also have experience of extracting value and features from large scale data.\nWe’ll expect you to have experience of ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling capabilities.\nYou’ll also need:\nAt least eight years of experience building and supporting enterprise-scale data pipelines and analytics solutions using advanced Python and PySpark for large-scale batch and real-time processing\nStrong experience in data warehousing, including dimensional modelling, star and snowflake schemas, fact and dimension design, SCD, ETL/ELT frameworks, data lake and data warehouse architectures, data quality and governance\nStrong expertise in PostgreSQL database design, optimisation and query tuning, along with AWS services including S3, Glue, EMR, Lambda, RDS, ECS/EKS, CloudWatch, IAM and API Gateway\nExperience translating business requirements into HLD/LLD documents and designing secure, scalable and resilient integration patterns for enterprise applications and data platforms\nExperience with CI/CD pipelines, multi-environment release management, automated testing and production troubleshooting with root-cause analysis\nStrong Agile delivery experience with Product Owners, Architects and business stakeholders, including Jira, sprint planning, estimation, backlog grooming and retrospectives, with exposure to AI-assisted development tools such as Kiro and Copilot and mentoring engineers as an advantage\nHours\n45 Job Posting Closing Date:\n23/11/2026","description_format":"text","description_chars":3537,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Wealth Management & Financial Advisors"],"lifecycle":[{"event":"open","at":"2026-11-17T17:56:18Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":15,"reasons":["conf:2","win:early"],"computed_at":"2026-11-17T20:03:22Z"},"pay":null,"html_url":"https://alion.io/job/natwest-group-data-engineer-python-pyspark-aws-avp","json_url":"https://alion.io/job/natwest-group-data-engineer-python-pyspark-aws-avp.json","meta":{"generated_at":"2026-11-17T20:03:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1895,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":184520},"rest":"https://alion.io/mcp/rest/get_company?id=184520"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnatwest-group-data-engineer-python-pyspark-aws-avp"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnatwest-group-data-engineer-python-pyspark-aws-avp"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnatwest-group-data-engineer-python-pyspark-aws-avp"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/natwest-group-data-engineer-python-pyspark-aws-avp\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnatwest-group-data-engineer-python-pyspark-aws-avp"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4476836}},{"tool":"search_jobs","arguments":{"company":"natwestgroup.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4476836},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}