Snowflake Developer

As part of the transaction monitoring project, there is a requirement for the Yardi Diamond database onboarding onto Snowflake by extending the existing schema with additional source entities from the Diamond property management database, requiring replication of existing ETL patterns, new data mappings, and comprehensive quality assurance.

Position Summary:

We are seeking a skilled Snowflake Developer to design, build, and optimize the data platform components required to onboard the Yardi Diamond property management database into our Snowflake environment. Working alongside the Yardi Developer, this role owns the Snowflake-side architecture: staging schema design, stored procedure development, ingestion pipelines, view/transformation layers, file exports, and platform performance. The successful candidate will extend the existing 24-table staging schema while preserving established ETL conventions.

Key Responsibilities:

• Schema Design & Extension: Design and create new staging tables within Staging database for Yardi Diamond entities (Lease, Tenant, Unit, Charge, GL Journal, Budget, Vendor, Work Order, Purchase Order). Maintain consistency with existing naming conventions, SOURCEDB column tagging, and ETL audit columns (ETL_LAST_UPDATED_BY, ETL_LAST_UPDATED_ON).
• Data Ingestion Pipelines: Build and configure Snowflake ingestion infrastructure - stages, file formats, COPY INTO commands - to receive data extracted from Yardi Diamond by the Yardi Developer.
• Stored Procedure Development: Author SQL stored procedures following established patterns for data pre-processing, transformation, post-processing, and file generation. Implement EXECUTE AS CALLER execution, structured error handling, and ETL logging to ETL logging tables.
• View & Transformation Layer: Create Snowflake views and transformation logic for downstream consumption by the Consumption reporting layer, following existing patterns.
• Multi-Currency Integration: Extend the existing currency framework to support Diamond-sourced exchange rates and base-currency conversions.
• File Export Pipelines: Develop outbound CSV file generation procedures for Diamond data, extending the existing pattern using internal stages and the stage file format.
• ETL Logging & Monitoring: Implement structured logging using ETL logging tables. Configure Snowflake tasks for scheduling, alerts for pipeline failures, and retry mechanisms.
• RBAC & Security: Configure role-based access control for new objects, following the existing RBAC pattern. Ensure sensitive data (KYC, ACH) is appropriately secured with masking policies where required.
• Performance Optimization: Tune warehouse sizing, implement clustering keys on high-volume tables (e.g., FUND_BATCH at 1.5M+ rows), and optimize query performance for the expanded Diamond data volumes.
• Incremental Load Strategies: Implement CDC-based incremental loading, MERGE/upsert patterns, and historical backfill procedures following the existing pattern for Diamond data.
• Collaboration: Work closely with the Yardi Developer to define data contracts (source schemas, data types, delivery frequency), and with the Quality Engineer to support test data provisioning and defect resolution.
• Documentation: Maintain technical documentation covering Snowflake schema DDL, stored procedure specifications, pipeline runbooks, and deployment guides.

Required Skills & Experience:

• Snowflake: 4+ years hands-on experience with Snowflake, including SQL stored procedures (EXECUTE AS CALLER), stages, COPY INTO, Snowpipe, tasks, streams, views, file formats, dynamic tables, RBAC, data masking policies, and performance tuning.
• SQL: Expert-level SQL skills - complex joins, window functions (ROW_NUMBER, RANK, QUALIFY), CTEs, MERGE statements, dynamic SQL (EXECUTE IMMEDIATE), and structured exception handling within stored procedures.
• ETL/ELT Architecture: Proven experience designing enterprise ETL/ELT pipelines on Snowflake, including incremental load strategies, CDC patterns, idempotent processing, and orchestration with Snowflake tasks or external schedulers.
• Data Modelling: Strong understanding of staging, integration, and presentation layer patterns (Kimball or Data Vault). Experience designing schemas that accommodate multiple source systems via source-tagging patterns.
• Python & Snowpark: Experience with Python for data engineering tasks - Snowpark DataFrames, pandas, and scripted ETL orchestration.
• Source Control & CI/CD: Experience with Git, dbt, or Schema change for Snowflake migration management and deployment automation.
• Cloud Platforms: Familiarity with AWS (S3, Lambda) for staging and connectivity.
• Real Estate / Investment Management Domain (Desirable): Familiarity with fund accounting, Transfer Agent (TA) processing, capital call workflows, investor reporting, and real estate property management.
• Yardi Awareness (Desirable): Basic understanding of Yardi database structures is a plus but not required - the Yardi Developer will lead source-side work.

Technical Environment:

Snowflake, Snowpark, Python, SQL, Git, dbt / Schema change, AWS, Comply Advantage, JIRA

Skills

CDC, ELT, ETL, SQL, Snowflake, Snowpipe, dbt