Sr. Data Engineer

Purpose 

The IT Engineer Senior Data is responsible for designing and developing solutions and interfaces for the Data Platforms and Data Insights teams.  This includes various data interfaces to and from databases, applications, and API’s to ingest data into the Cloud data environment, the landing zone, the Enterprise Data Warehouse, any downstream applications, as well as any data quality or metadata solutions.  In addition, the Data Engineer will be responsible for data profiling, creating ETL (extract, transformation, and load) scripts within the data warehouse, designing data models using Entity Relationship modeling tools, and loading data into various data platforms using batch, stream, and bulk utilities.  The Data Engineer will also be responsible for scheduling jobs and workflows as well as versioning and documenting their designs and data flows.  The Data Engineer will use agile, iterative, and waterfall methodologies and will provide the highest level of support. 

Responsibilities 

Act as an expert in the areas of data engineering, architecture, advanced analytics, or data science 

Create data interfaces and scripts to load the enterprise data warehouse, data lake, data marts and other analytics environments to support enterprise-wide data consumption 

Build an enterprise data pipeline to improve access to real/near-real-time data across the enterprise 

Design and develop ETL (Extract, Transform, and Load) jobs within the data warehouse and other data platforms 

Create templates and engineering patterns to reduce the time-to-deploy new data assets or changes to an existing data model or analytics solution 

Act as a technical expert on the different data interface solutions (expertise in SQL, Python, Informatica, Azure Data Factory, and SQL Server Integration Services recommended) 

Assist in optimizing and tuning data interfaces, jobs, and workflows and look for ways to improve efficiencies and effectiveness of existing solutions 

Partner with key business teams to understand their data needs and assist them in building the appropriate data interfaces to meet their business needs 

Partner with the security and risk teams to build appropriate security and compliance into the data platforms 

Partner with the enterprise technology function to ensure effective and efficient operation of all data environments 

Foster continuous process improvement within the data & insights organization and functions   

Cultivate strong relationships with all stakeholders of the data & insights team 

About You 

Bachelor's degree in computer science, engineering or related field of study 

3 years IT experience 

3 years of experience delivering high-profile projects in a complex enterprise environment 

3 years developing and delivering data engineering solutions in data warehousing 

3 years developing with data-specific coding languages like SQL 

1-3 years developing and optimizing Multi-Parallel Processing databases like Teradata, Azure SQL DW, Big Query, or Snowflake 

1-3 years developing and optimizing integration tools like Informatica, Azure Data Factory, or SSIS 

Proficient in integrating data in diverse technical environments 

Strong planning and organizational skills 

Experience in measuring and communicating the value of data platforms and tools 

Experience in multiple enterprise environments, industries and development methodologies 

Physical Requirements 

Ability to travel up to ~10% of the time, which may include weekends and evenings, as needed 

Most work is performed in a temperature-controlled environment 

Incumbent may sit for long periods of time at a desk or computer terminal 

Incumbent may use calculators, keyboards, telephone and other office equipment in the course of a normal workday 

Stooping, bending, twisting and reaching may be required in completion of job duties