{"id":4285199,"url":"https://alion.io/job/prudential-senior-data-engineer-microsoft-fabric","title":"Senior Data Engineer - Microsoft Fabric","company":{"id":5562,"name":"Prudential","domain":"prudential.com","url":"https://alion.io/company/prudential","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-14T05:58:10Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Letterkenny, Ireland"],"countries":["IE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Ansible","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"CloudFormation","optional":false},{"name":"Microsoft Excel","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"Splunk","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"AWS Glue","optional":true},{"name":"AWS Lambda","optional":true},{"name":"AWS Step Functions","optional":true}],"status":"live","first_seen_at":"2026-08-20T00:00:00Z","employer_posted_date":"2026-08-20","last_verified_at":"2026-11-14T01:42:15Z","board_verified":true,"closed_at":null,"days_open":86,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":86},"description":"Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, you’ll unlock an exciting and impactful career - all while growing your skills and advancing your profession at one of the world’s leading financial services institutions.\nYour Team & Role\nAs a Senior Data Engineer you will analyze, design, develop, test, and perform ongoing maintenance to build high quality data pipelinesthat drive platform delivery. You will implement capabilities to solve sophisticated business problems, deploy innovative products, services and experiences to delight our customers! In addition to applied experience,you will bring excellent problem solving, communication and teamwork skills, along with agile ways of working, strong business insight, an inclusive leadership attitude and a continuous learning focus to all that you do.\nHere is What You Can Expect on a Typical Day\nBuild and optimize data pipelines in Microsoft Fabric, logic and storage systems with latest coding practices and industry standards and modern design patterns and architectural principles; actively code and execute against the roadmap\n\nDevelop high quality, well documented and efficient code adhering to all applicable Prudential standards\n\nConduct complex data analysis and report on results, prepare data for prescriptive and predictive modeling, combine raw information from different sources\n\nCollaborate with data analysts, scientists, and architects on data projects to enhance data acquisition, transformation, organization processes, data reliability, efficiency, and quality\n\nWrite unit, integration tests and functional automation, researching problems discovered by quality assurance or product support, developing solutions to address the problems\n\nBring an applied understandingof relevant and emerging technologies, begin to identify opportunities to provide input to the team and coach others, and embed learning and innovation in the day-to-day\n\nWork on complex problems in which analysis of situations or data requires an in-depth evaluation of various factors\n\nUse programming languages including but not limited to Python, SQL, Scala, Pyspark/Apache Spark, Shell scripting\n\nThe Skills & Expertise You Bring\nBachelor of Computer Science or Engineering or experience in related fields\n\nExperience in working with DevOps automation tools & practices; Knowledge of full software development life cycle (SDLC)\n\nLeveragediverse ideas, experiences, thoughts and perspectives to the benefit of the organization\n\nKnowledge of business concepts tools and processes that are needed for making sound decisions in the context of the company's business\n\nAbility to learn new skills and knowledge on an on-going basis through self-initiative and tackling challenges\n\nExcellent problem solving, communication and collaboration skills; enjoy learning new skills!\n\nApplied experience with several of the following:\nProgramming Language: Python, SQL, Scala, Pyspark/Apache Spark, Shell scripting\n\nMicrosoft Fabric - proven experience building and optimizing data pipelines in MS Fabric\n\nData Ingestion, Integration & Transformation: Moving data from multiple sources, formats, and volumes to analytics platforms through various tools. Preparing data for further analysis; transforming and mapping raw data to generate insights and wrangling data through tools.\n\nDatabase Management System: Storing, organizing, managing, and delivering data using relational DBs, NoSQL DBs, Graph DBs, and data warehouse technologies.\n\nDatabase tools: Data architecture to store, organize, and manage data. Experience with SQL and NoSQL based databases for storage and processing of structured, semi-structured & unstructured data.\n\nReal-Time Analytics: Spark, Kinesis Data Streams\n\nData Buffering: Kinesis, Kafka\n\nWorkflow Orchesration: Airflow, AppFlow, Austosys, Cloudwatch, Splunk\n\nData Visualization: Tableau, Power BI, MS Excel\n\nData Lakes & Warehousing: Building Data Models, Data Lakes and Data Warehousing\n\nData Protection and Security: Knowledge of data protection, security principles and services; data loss prevention, role based access controls, data encryption, data access capture and core security services\n\nCommon Infrastructure as Code (IaC) Frameworks: Ansible, CloudFormation\n\nCloud Computing: Knowledge of fundamentals of AWS architectural principles and services; Strong ability on cloud formation and to write code; Knowledge of AWS core services\n\nTesting/Quality: Unit, interface and end user testing concepts and tooling inclusive of non-functional requirements (performance, usability, reliability, security/vulnerabilityscanning, etc.) including how testing integrated into Dev Ops; accessibility awareness\n\nPreferred qualifications:\nServerless data pipeline development using AWS Glue, Lambda and Step functions\n\nOther Certifications?\n\nYou’ll Love Working Here Because You Can\nJoin a team and culture where your voice matters; where every day, your work transforms our experiences to make lives better. As you put your skills to use, we’ll help you make an even bigger impact with learning experiences that can grow your technical AND leadership capabilities. You’ll be surprised by what this rock-solid organization has in store for you.\n-PGIM Ireland is proud to be an equal opportunity employer and is committed to equal employment opportunity regardless of applicants’ gender, civil status, family status, sexual orientation, religion, age, disability, race or membership of the traveler community. PGIM Ireland's aim is to hire the best people for the open roles and all appointments will be made on merit.\nAny offer of employment made by PGIM Ireland will be contingent on receiving satisfactory references. Applicants should be aware that background checks will be carried out on all candidates offered a position within PGIM Ireland.","description_format":"text","description_chars":6054,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Wealth Management & Financial Advisors","Asset Management & Funds","Life Insurance & Annuities"],"lifecycle":[{"event":"open","at":"2026-11-13T21:34:21Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":1,"p_active":0.559,"p_room":0.28,"age_days":86,"expected_fill_days":30,"reasons":["conf:4","win:tail","crowd:brand"],"computed_at":"2026-11-14T05:58:10Z"},"pay":null,"html_url":"https://alion.io/job/prudential-senior-data-engineer-microsoft-fabric","json_url":"https://alion.io/job/prudential-senior-data-engineer-microsoft-fabric.json","meta":{"generated_at":"2026-11-14T06:31:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10975,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5562},"rest":"https://alion.io/mcp/rest/get_company?id=5562"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fprudential-senior-data-engineer-microsoft-fabric"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fprudential-senior-data-engineer-microsoft-fabric"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fprudential-senior-data-engineer-microsoft-fabric"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/prudential-senior-data-engineer-microsoft-fabric\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fprudential-senior-data-engineer-microsoft-fabric"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4285199}},{"tool":"search_jobs","arguments":{"company":"prudential.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4285199},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}