Senior Software Engineer- Big Data & Java

What your day-to-day will look like:

• Identify, prioritize and execute tasks in the software development life cycle.
• Work with business to iterate over software requirements.
• Develop tools and applications by producing clean, efficient code.
• Automate tasks through appropriate tools and scripting.
• Analyze and debug systems.
• Perform validation and verification testing in a test-driven manner
• Review the work of others, and invite others to review your work.
• Collaborate with internal teams and vendors to fix and improve products.
• Ensure software is up-to-date with latest technologies.
• Work with distributed computing systems like Apache Hudi and Trino for big data processing.

What qualifications we’re looking for:

• Experience with distributed computing tools like Apache Hudi, Spark, Kafka, Flink, Beam, Trino, DataBricks and other big data technologies.
• Experience with distributed storage systems like ADLS, HDFS, S3, DLT etc.
• Familiarity with Hadoop, Spark, Databricks or other distributed computing systems.
• Understanding of data partitioning and sharding techniques.
• Knowledge of distributed computing principles and how they apply to large-scale data processing.
• Experience in writing clean code that performs well at scale using languages such as Python, Java etc.
• Knowledge of relational databases (e.g. Microsoft SQL Server, MySQL).
• Solid experience writing RESTful API endpoints.
• Absolutely love TDD and have working knowledge of it.
• Proficient in GIT.
• Experience using system and performance monitoring tools (e.g. New Relic, DataDog).
• Excellent organization, critical-thinking and personal leadership skills
• Self-starter with the ability to deliver with minimal supervision.
• Being okay with the uncomfortable feeling that comes from learning new things.
• Team player.
• Analytical mind with problem-solving aptitude.
• Proven experience as a great Engineer.
• BSc/BA in Computer Science or a related degree.

Bonus points for:

• Experience with distributed computing
• Experience writing code/scripts in Python
• Experience with Spring Boot.
• Nice to have React, Selenium automation and cloud experience.
• Experience with Docker, Kubernetes and Istio.
• Experience with Ansible.
• Experience with Jenkins CI/CD pipeline.
• Linux and IP networking knowledge.
• Experience with AWS/Azure cloud services or equivalent.
• Experience with SAML, OAuth and OpenID Connect.
• Experience working on a SaaS product.
• Experience with Service Oriented Architecture.
• Knowledge of scripting languages such as Python, Bash or Groovy.
• On-call experience with production grade systems.
• Has mentored others in a professional setting.
• Generative AI Code Assistants - Use of Generative AI Code Assistants (e.g. Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset.