Senior Software Developer

We are seeking a highly skilled senior Apache NiFi developer. This role focuses on designing and building scalable, resilient data pipelines that power trade processing, regulatory reporting, and downstream analytics. You will work on high-throughput, low-latency data flows, ensuring seamless integration across complex financial systems while maintaining strict data integrity, security, and compliance standards.

Responsibilities:

• Design, develop, and maintain scalable data flows using Apache NiFi to support post-trade processing and data distribution.
• Build robust ingestion, transformation, and routing pipelines for structured and unstructured financial data.
• Integrate NiFi with internal and external systems, including APIs, messaging platforms, and databases.
• Optimise NiFi performance (throughput, latency, back-pressure, clustering) for high-volume trading environments.
• Implement monitoring, alerting, and troubleshooting for production data pipelines to ensure reliability and uptime.
• Ensure data quality, lineage, governance, and compliance with financial regulations.
• Develop reusable processors, templates, and frameworks to standardise data integration patterns.
• Collaborate with data architects, platform engineers, and business stakeholders to translate requirements into technical solutions.
• Lead code reviews, enforce engineering best practices, and mentor junior developers.
• Support deployment, release management, and production issue resolution.

Requirements:

• 5+ years of experience in data engineering or integration roles.
• Strong hands-on expertise with Apache NiFi (processors, controllers, flow design, clustering, security).
• Deep understanding of ETL/ELT and real-time data streaming architectures.
• Experience in Java processors and integrations.
• Experience with messaging systems (Kafka) and RESTful APIs.
• Solid experience with SQL and relational/non-relational databases.
• Familiarity with Linux/Unix environments and scripting.
• Experience with cloud platforms (AWS) and containerisation (Docker/Kubernetes).
• Strong understanding of data formats (JSON, XML, Avro, CSV) and data transformation techniques.

Preferred Experience:

• Experience in capital markets, trading platforms, or post-trade processing systems.
• Knowledge of trade lifecycle, settlement, and regulatory reporting workflows.
• Familiarity with data governance, lineage, and audit requirements in financial systems.
• Exposure to big data ecosystems (Hadoop and Spark).
• Experience with CI/CD pipelines and version control for NiFi flows.

Skills

AWS, Apache NiFi, Docker, ELT, ETL, Java, Kafka, Kubernetes, Linux, NiFi, SQL, streaming