Senior/Data Engineer

iLabs is a global software product engineering company headquartered in Sri Lanka, with deep roots in the US Silicon Valley. We deliver world-class solutions in Web, eCommerce, Mobile, AI/ML, and Cloud technologies, serving industries such as fintech, edtech, medtech, martech, and hospitality. Guided by our vision to become a global powerhouse in information technology to push humanity forward we focus on delivering innovative, impactful solutions that empower businesses and create meaningful change in the world.

With a global talent network, we build agile remote teams for leading tech companies worldwide, including Silicon Valley pioneers. Our in-house ventures include Cloud of Goods, a fast-growing eCommerce rental marketplace, and Xenia, a customizable web platform for modern businesses.

At iLabs, we're on a mission to advance lifestyles through technology and empower our partners to scale smarter and faster. Our culture is driven by creativity, innovation, ownership, teamwork, and global impact; giving you the opportunity and freedom to challenge the norm, spark change, and make a real difference.

If you're ready to break boundaries and create your defining moment, we're here to make it happen. Be part of something bigger. Join iLabs

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for batch and real-time workloads.
• Develop and manage data integration, storage, and processing solutions that support analytics and business needs.
• Ensure data quality, reliability, and performance across the data platform.
• Build and maintain APIs and services that make data accessible to internal teams and applications.
• Write SQL, DDL, and Python code for pipeline development, data validation, troubleshooting, and performance tuning.
• Define and follow best practices for data modeling, documentation, backup, and recovery.
• Work with software engineers, DevOps, ML engineers, and data scientists to deliver on organizational goals.
• Mentor junior team members and contribute to code reviews and engineering standards.

Shift: 9.00am - 6.00pm

Location: Battaramulla (On-Site)

Requirements

• BS/MS in Computer Science, Engineering, or a related field.
• 3 - 5 years of experience in a data engineering role.
• Strong experience with lakehouse architectures and Delta Lake.
• Hands-on experience with streaming and CDC technologies such as Kafka and Debezium.
• Proficiency with workflow orchestration tools such as Apache Airflow.
• Experience with distributed query engines such as Trino/Presto and Hive.
• Strong Python skills.
• Advanced SQL, with a strong grasp of data warehousing, relational database theory, and NoSQL databases.
• Experience building APIs with FastAPI, Django, or Flask.
• Hands-on experience with AWS.
• Comfortable working in Linux environments.
• Excellent communication, interpersonal, and organizational skills.

Nice to Have

• Experience with Databricks.
• Exposure to GCP or Azure (e.g., Azure Data Factory).
• Experience with Spark or other large-scale data processing frameworks.
• Docker and Kubernetes experience.
• Knowledge of data modeling and design patterns.
• Web scraping experience (Selenium, Beautiful Soup, or similar).
• Familiarity with CI/CD and monitoring tools.