Sr. Data Engineer

The Enterprise Data Warehouse & Analytics team provides support of our data warehouse environment and analytics tools. This allows our business leaders access to business intelligence data in order to develop strategies for our organization to grow.

As a Sr. Data Engineer, you will be involved in implementing Snowflake cloud strategies, modernizing legacy systems, building real-time reporting solutions, and coding for the future of data processing using technologies included but not limited to AWS, Confluent Kafka, Aurora PostgreSQL, Snowflake, Matillion and Informatica. This is a subset of the overall responsibilities which will include multiple initiatives assigned by IT leadership.

How you will spend your time:

• Designing, building and maintaining optimal cloud data pipelines, architecture and data sets for ETL, real-time architecture, and data sets for streaming and ETL using Kafka and Precisely, alongside Snowflake structures. This includes cloud data platform structures to organize and store data.
• Building and optimizing PySpark ETL jobs for S3-to-Aurora data loading using metadata-driven mappings and field validation along with collecting performance metrics.

• Develop and maintain AWS Lambda functions and Event Bridge schedules and rules to orchestrate pipeline workflows, handle operational status, and send alerts.
• Develop and optimize Aurora PostgreSQL schemas, stored procedures, Real time and batch-load processes, indexes, and queries; troubleshoot database and data-processing issues.
• Building and managing high-performance relational database structures, focusing on PostgreSQL DB replication, optimization, and real-time reporting pipelines. Develop and optimize Aurora PostgreSQL schemas, stored procedures, Real time and batch-load processes, indexes, and queries; troubleshoot database and data-processing issues.

• Implementing governance and data lifecycle management strategies around the flow of data within UMB which includes policy and automated approaches. Implementing organizational models to oversee data collection, storage, and utilization.

• Design and support Kafka topics, partitions, retention policies, and access controls to meet data-volume and availability needs. Build and maintain producers and consumers that publish and process events reliably, preserving key-based ordering where required.

• Mentoring team members in collaboration with the senior architect while applying cloud expertise to modernize technologies and evaluate complex data trends.
• Evaluating, assessing and translation of data including identifying anomalies, trends and correlation of similar data sets.

• Creating models and standards to govern which data is to be collected, how it is stored, arranged, and utilized in data systems and within the organization.

We are excited to talk if you have:

• Bachelor’s Degree in Information Technology and at least 5 years of experience in a technical role supporting and designing application technologies OR at least 8 years of relevant work experience in a technical role supporting and designing application technologies.
• At least 5 years of experience in cloud data development / engineering, specifically utilizing Azure or AWS, with hands-on experience deploying and managing Snowflake data platforms.
• At least 5 years of experience with Data Pipeline Development and Business Intelligence implementations, featuring subject matter expertise in Modern Data Platform architectures including Apache Kafka for streaming, PostgreSQL DB management, and Precisely for data integration and replication.
• A business first mindset and comfortable with change as well as having a passion to learn and use new modern technologies, including databases, code sets, and integration best practices.

Bonus Points if you have:

• Banking or financial services industry experience.

Applicants must have legal authority to work in the United States. Work Visa sponsorship is not available for this position.

Compensation Range:

The posted compensation range on this listing represents UMB’s good faith and reasonable estimate based on its budget and what it expects to be the starting pay for this role, but the actual compensation may vary by geographic location, experience level, and other job-related factors. Please see the description of benefits included with this job posting for additional information.

UMB offers competitive and varied benefits to eligibleassociates, such asPaid Time Off; a 401(k) matching program; annual incentive pay; paid holidays; a comprehensive company sponsored benefit plan including medical, dental, vision, and other insurance coverage; health savings, flexible spending, and dependent care accounts; adoption assistance; an employee assistance program; fitness reimbursement; tuition reimbursement; an associate wellbeing program; an associate emergency fund; and various associate banking benefits. Benefit offerings and eligibility requirements vary.

Are you ready to be part of something more?

You're more than a means to an end-a way to help us meet the bottom line. UMB isn't comprised of workers, but of people who care about their work, one another, and their community. Expect more than the status quo. At UMB, you can expect more heart. You'll be valued for exactly who you are and encouraged to support causes you care about. Expect more trust. We want you to do the right thing, no matter what. And, expect more opportunities. UMBers are known for having multiple careers here and having their voices heard.

UMB and its affiliates are committed to inclusion and diversity and provide employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex (including gender, pregnancy, sexual orientation, and gender identity), national origin, age, disability, military service, veteran status, genetic information, or any other status protected by applicable federal, state, or local law. If you need accommodation for any part of the employment process because of a disability, please send an e-mail to [email protected] to let us know the nature of your request.

If you are a California resident, please visit our Privacy Notice for California Job Candidates to understand how we collect and use your personal information when you apply for employment with UMB.

#LI-MD1