Data Engineer - DataBricks (Gujarat - Onsite)

About CloudLabs:

CloudLabs Inc was founded in 2014 in USA with the mission to provide exceptional IT & Business consulting services at a competitive price, to help clients realize the best value from their investments. Within a short span, CloudLabs evolved from pure-play consulting into a transformative partner for Business Acceleration Advisory, Transformative Application Development & Managed Services - enabling digital transformations, M&A transitions, Automation & Process-driven optimizations & complex Integration initiatives for enterprises across the globe. As a Strategic Planning & Implementation Partner for global companies, CloudLabs has seen a 200% uptake in winning high-value, high-impact and high-risk projects that are critical for the business.

With offices in the US, Canada & India and with the team of 250+ experienced specialists, CloudLabs is now at an inflection point and ready for its next curve of progress.

Please write & follow us here:

Website: cloudlabsit.com

LinkedIn: CloudLabs Inc

Email us: [HIDDEN TEXT]

Experience Required: 4+ years in Senior Project Manager

Job type: Fulltime

Job Location: Gandevi - Gujarat (Hybrid)

Start Date: Immediate or as soon as available

What we offer:

• We welcome candidates rejoining the workforce after career break/parental leave and support their journey to reacclimatize too corporate.
• Flexible remote work.
• Opportunity to work remotely is available.

About the Role

We are looking for an experienced Data Engineer with strong expertise in Databricks and Big Data technologies. The candidate will be responsible for building scalable data pipelines, implementing modern Lakehouse architectures, and supporting enterprise analytics initiatives.

Key Responsibilities

• Design and develop scalable data pipelines using Databricks and Spark.
• Build and maintain Lakehouse architectures and data platforms.
• Develop and optimize ETL/ELT processes using PySpark and SQL.
• Implement Delta Lake best practices for data reliability and performance.
• Integrate data from multiple structured and unstructured sources.
• Collaborate with business teams, architects, and data scientists to deliver data solutions.
• Monitor data pipelines and troubleshoot data processing issues.
• Implement data governance, security, and compliance controls.
• Perform query optimization and performance tuning for large-scale data workloads.

Required Skills:

• Must have 4 to 5 years of experience in Data Engineering.
• Hands-on experience with Databricks and Apache Spark.
• Strong proficiency in PySpark and SQL.
• Experience with Delta Lake and Lakehouse architecture.
• Experience working on AWS, Azure platforms.
• Knowledge of Data Warehousing and Data Modeling concepts.
• Hands-on experience in orchestrating workflows using Airflow, Azure Data Factory, or similar tools.
• Experience with Git-based version control and CI/CD practices.

Good to Have

• Databricks Certified Data Engineer Associate/Professional.
• Experience with Snowflake.
• Knowledge of streaming technologies such as Kafka, Event Hubs, or Kinesis.
• Key Competencies
• Strong technical and analytical capabilities.
• Excellent debugging and troubleshooting skills.
• Effective communication and collaboration skills.
• Ability to work in a fast-paced, agile environment.