Senior Data Engineer

As a data engineer, your mandate is to build the data transformation pipelines & reporting infrastructure that serve our members and run our company. This role will impact One's vision by writing, reviewing, and shipping code and collaborating with others across the company. You will work closely across the Engineering, Product, Compliance and Customer Support team(s) working with stakeholders as highly technical, communicative, and emotionally intelligent partners. This role reports to the Manager, Data Engineering.

Responsibilities:

• Building and maintaining one's data infrastructure.
• Developing and owning one's streaming data transformation pipeline.
• Managing and supporting reporting and analytics tools.
• Collaborating closely with our Data Analysts and Data Scientists.
• Tracking and defining metrics around performance.
• Additional duties as assigned by your manager.

Requirements:

• 5 + years of experience.
• Experience in Databricks, Apache Spark, Scala, Python, and SQL.
• Experience designing and implementing low-latency data pipelines using Spark structured streaming.
• Experience optimising SQL queries and lake/warehouse data structures.
• Cost-conscious creative problem solving.
• Proficient in AWS cloud services and technologies.
• Experience building, shipping and growing non-trivial products and services.