{"id":4412301,"url":"https://alion.io/job/scotiabank-lead-data-engineer-2","title":"Lead Data Engineer","company":{"id":1754303,"name":"Scotiabank","domain":"scotiabank.com","url":"https://alion.io/company/scotiabank-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":{"grade":"A","score":100,"open_postings":47,"ghost_share":0,"stale_share":0.064,"repost_share":0.043,"time_to_fill_p50_days":17,"computed_at":"2026-11-16T05:46:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dallas, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flink","optional":false},{"name":"Java","optional":false},{"name":"Machine Learning","optional":false},{"name":"Platform Engineering","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-11-16T22:51:55Z","employer_posted_date":"2026-11-16","last_verified_at":"2026-11-16T22:51:55Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Requisition ID: 279559\nSalary Range: -\nPlease note that the Salary Range shown is a guideline only. Salary offered may vary based on factors, including, but not limited to, the successful candidate’s relevant knowledge, skills, and experience.\nJoin a purpose driven winning team, committed to results, in an inclusive and high-performing culture.\nPurpose\nEnterprise Data & AI Platforms is one of the most strategically significant organizations at Scotiabank, helping to build the future of banking. Our vision is to build world-class data and AI platforms that power data-enabled decision making, AI innovation, and technology modernization across the Bank. We embrace cutting-edge, AI-native ways of building technology to turn the Bank's data into trusted, intelligent capabilities. Here, every individual's work shapes how Scotiabank innovates with data and AI, safely and at scale.\nWe are seeking a Lead Data Engineer to design, build, and operate secure, scalable, and reliable data solutions for Scotiabank businesses and enterprise functions. This hands-on role spans batch and streaming data platforms, data products, cloud services, data quality, governance, and production operations.\nYou will own the technical design and delivery of an application, coordinate the engineering work of the contributors alongside you, and make sound design decisions within enterprise architecture and control standards. You will work closely with product owners, business stakeholders, architects, data scientists, AI engineers, and the platform, cybersecurity, and governance teams.\nThe role requires strong engineering judgment, comfort with ambiguity, and accountability for outcomes from design through production stabilization and continuous improvement\nWhat You'll Do\nLead technical discovery and design for the application you own, turning requirements into designs and estimates within enterprise patterns.\nDesign, build, and test streaming and batch data pipelines and services that are cloud-native and AI-native, using distributed computing and a modern technology stack.\nOwn planning and delivery of your application, guide contributors through code and design reviews, and mentor junior engineers.\nOwn production readiness and support for your application, including monitoring, runbooks, incident triage, and root-cause analysis.\nBuild security, privacy, and regulatory requirements into your application and escalate control gaps.\nEnable AI and advanced analytics with governed, permission-aware data foundations and contracts for machine learning, generative AI, and agentic solutions.\nApply responsible AI practices, including privacy, explainability, auditability, and human oversight, in the data and AI applications you deliver.\nWhat You'll Bring\nBachelor's degree in Computer Science, Engineering, or a related discipline, or equivalent experience.\n6+ years in data, software, or platform engineering, or equivalent experience.\nExpert-level proficiency in Python or Java, with strong engineering practices in testing, code quality, and performance.\nStrong expertise in large-scale distributed processing, such as Apache Spark and Apache Flink.\nStrong experience building on cloud data and MPP platforms such as Databricks and Snowflake, including performance, reliability, and cost optimization.\nStrong understanding of data governance, lineage, and security tools such as Unity Catalog, Snowflake Horizon, and Apache Polaris.\nStrong knowledge of open table formats such as Delta Lake and Apache Iceberg, including schema evolution, transactions, and interoperability.\nProven ability to independently lead technical design and delivery of a complex application and coordinate contributors.\nExperience mentoring junior engineers and guiding code and design reviews.\nAbility to communicate designs, risks, and trade-offs to business and technical audiences.\nHands-on experience applying AI-native and agentic development techniques, with appropriate review, security, and control practices.\nPreferred Qualification\nStrong cloud engineering expertise across Azure and AWS, including security, observability, and infrastructure automation.\nStrong command of data engineering design principles, including batch and streaming, data modeling, ETL/ELT, data contracts, and quality.\nProduction-engineering experience, including CI/CD, automated testing, infrastructure as code, monitoring, and incident response.\nExperience in financial services or another highly regulated environment.\nUnderstanding of responsible AI and model risk management practices in a regulated environment.\nAbility to evaluate technologies objectively based on workload, scale, security, and total cost rather than\nInterested?\nIf your experience is closely related but doesn’t align perfectly with every qualification, we do encourage you to apply - you might be the right candidate for this or other roles at Scotiabank!\nAt Scotiabank, every employee is empowered to reach their fullest potential, respected for who they are and, embraced for their differences. That’s why we work to grow and diversify talent and engage employees in a performance-oriented culture.\nWhat's in it for you?\nScotiabank wants you to be able to bring your best self to work - and life, every day. With a focus on holistic well-being, our many flexible benefit programs are designed to help support your unique family, financial, physical, mental, and social health needs.\n#Dallas\nLocation(s): United States : Texas : Dallas\nScotiabank is a leading bank in the Americas. Guided by our purpose: \"for every future\", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.\nAt Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.\nScotiabank is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by federal, state, or local law.","description_format":"text","description_chars":6839,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Wealth Management & Financial Advisors","Investment Banking & M&A Advisory","Digital Banks & Neobanks"],"lifecycle":[{"event":"open","at":"2026-11-16T22:51:55Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":17,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-17T00:01:20Z"},"pay":null,"html_url":"https://alion.io/job/scotiabank-lead-data-engineer-2","json_url":"https://alion.io/job/scotiabank-lead-data-engineer-2.json","meta":{"generated_at":"2026-11-17T00:01:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":39,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1754303},"rest":"https://alion.io/mcp/rest/get_company?id=1754303"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fscotiabank-lead-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fscotiabank-lead-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fscotiabank-lead-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/scotiabank-lead-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fscotiabank-lead-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4412301}},{"tool":"search_jobs","arguments":{"company":"scotiabank.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4412301},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}