Data Engineer (SQL/SSIS)

We are looking for an experienced Data Engineer with strong expertise in SQL Server, data integration, and structured data processing. The role will focus primarily on building, supporting, and troubleshooting reliable data loads and integrations, including ServiceNow extracts and future data solutions using Microsoft Fabric.

The ideal candidate will have strong SQL skills, hands-on experience working with JSON and XML data, and an analytical mindset with the ability to investigate issues, evaluate different solutions, and quickly learn unfamiliar technologies.

Key Responsibilities

• Design, develop, maintain, and troubleshoot complex SQL Server solutions and data processing workflows.
• Develop and support data loads and extracts from enterprise platforms, including ServiceNow.
• Work with complex SQL constructs, including:
• Stored procedures
• Common Table Expressions
• MERGE statements
• Window functions such as ROW_NUMBER, RANK, DENSE_RANK, LEAD, and LAG
• Conditional branching and complex process flows
• Perform SQL query analysis and optimization and understand database locking considerations.
• Process structured and semi-structured data, particularly JSON and XML, including parsing within SQL Server.
• Develop and support SSIS solutions involving loops, derived columns, and script tasks.
• Work with REST APIs and various authentication methods to support data extraction and integration.
• Use tools such as PowerShell to troubleshoot API endpoints and inspect data returned from third-party applications.
• Work with Git-based source control and Microsoft Fabric development environments.
• Troubleshoot unexpected integration or platform changes by reviewing documentation, validating endpoints, analyzing returned data, and identifying appropriate solutions.

Required Skills & Experience

• 5–7 years of relevant experience in data engineering, database development, business intelligence data integration, or a related area.
• Strong hands-on expertise in SQL Server and advanced SQL development.
• Strong experience with:
• Stored procedures
• Common Table Expressions
• MERGE
• Window functions
• Query optimization
• Complex SQL processing logic
• Strong working knowledge of JSON and XML, including schemas and parsing structured data.
• Experience developing and supporting data integration and ETL solutions.
• Experience with SSIS, including:
• For and ForEach loops
• Derived columns
• Script tasks
• Familiarity with C#, especially for SSIS script tasks.
• Exposure to REST APIs, including:
• Basic and OAuth2 authentication
• GET, POST, PUT, PATCH, and DELETE methods
• Good understanding of troubleshooting data-processing and integration issues.
• Strong analytical and problem-solving skills.
• Ability to independently investigate issues, consider alternative solutions, and learn new technologies as requirements change.

Strong SQL capability and comfort working with JSON and XML should be treated as essential requirements, consistent with the original skill recommendation.

Preferred / Good-to-Have Skills

• Experience with Microsoft Fabric, particularly:
• Warehouses
• Gateways
• Parameterized connections
• Basic familiarity with semantic models
• Git integration
• Build and support current and future data-loading solutions using Microsoft Fabric.
• Experience using PowerShell for troubleshooting APIs and integration endpoints.
• Familiarity with Git, Visual Studio Code, and Git Bash.