Founding Data Engineer

Responsibilities:

• Design, develop, and maintain third-party data ingestion pipelines, including webhook integrations and source-data reconciliation.
• Build and optimise batch processing workflows to handle large datasets within scheduled processing windows.
• Implement multi-tenant data isolation to ensure reliability and prevent cross-tenant performance issues.
• Design and maintain data backfill and replay mechanisms to support data recovery and reprocessing.
• Maintain append-only, auditable records to ensure automated decisions are traceable and reconstructable.
• Build and manage resilient vendor API integrations using circuit breakers, retry mechanisms, and reconciliation processes.
• Implement and maintain operational infrastructure, including alerting, data partitioning, and idempotent job processing.

Requirements:

• Around 4-7 years of experience building and operating production systems, with strong expertise in PostgreSQL, including schema design, query optimisation, and large-scale batch processing.
• Hands-on experience owning production data pipelines, including data ingestion, transformation, reconciliation, and serving.
• Strong proficiency in SQL, including multi-step transformations, window functions, statistical aggregates, and incremental computation.
• Experience transforming raw event or order data into cohort, retention, and funnel metrics.
• Production-level experience with Python backend development, with the ability to maintain clean separation between business logic and framework-specific components.
• Strong understanding of test-driven development, particularly for batch processing jobs and data reconciliation workflows.
• Experience troubleshooting production issues involving queue backlogs, webhook failures, and data reconciliation.
• Strong written communication skills and experience working in documentation-driven environments.
• Ability to independently manage deliverables, make technical decisions, and take ownership of outcomes with minimal supervision.

Nice to Have:

• Hands-on experience with Django in production environments.
• Experience working with e-commerce platforms.
• Familiarity with streaming and event-driven architectures, including Kafka or similar technologies.
• Knowledge of probabilistic and approximate data structures such as HyperLogLog, Bloom Filters, and t-digest.
• Experience developing server-rendered web applications.

Skills

PostgreSQL, Postgres, Python, SQL, dbt