Software Development Engineer II

We're seeking a Software Development Engineer II (SDE2) to join our Data and Reporting team. This role is ideal for someone who thrives at the intersection of data engineering and backend engineering, helping transform raw data into meaningful insights that drive business decisions across Sales and Revenue, Billing, Traffic, User engagement and behaviour.

Responsibilities:

• Design and implement scalable data pipelines using Spark (Scala/PySpark) and manage workflows in Databricks.
• Work with structured/unstructured data and create curated data layers (bronze, silver, gold) to serve various reporting needs.
• Develop and maintain integrations with internal APIs and external data sources to ingest and transform operational data.
• Collaborate with cross-functional teams to deliver dashboards and reports using BigQuery and Looker.
• Partner with backend teams and data stakeholders to improve data quality, lineage, and performance.
• Troubleshoot data discrepancies and ensure the timely delivery of critical reports for business stakeholders.

Requirements:

• 3+ years of experience in a similar data engineering or backend-focused role.
• Strong programming skills in Scala, and/or Python and/or Java.
• Solid understanding of Apache Spark, Databricks, and big data processing.
• Experience with Google BigQuery, Looker, or other BI/reporting tools.
• Working knowledge of backend development: Java/Python, RESTful APIs, MySQL/PostgreSQL.
• Experience with batch and near-real-time data pipelines, preferably on GCP or other cloud platforms.
• Strong problem-solving skills and ability to work independently in a remote setup.

Skills

apache spark, bigquery, databricks, java, looker, pyspark, python, scala, spark