Lead Software Engineer - Spark Scala

Responsibilities

Understand the business needs and transform it to a technical solution
implement new solution in BigData ecosystem
maintain the existing solution by enhancing and providing support technically
follow the agile methodology and best practices in day to day work
Lead and steer the Datalake team techno - functionally
Work along with BA and AMs to refine and give technical insights for Data engineering topics
Propose new solutions to improve the efficiency wherever possible
Understand functional requirements and raise clarifications with BAs and others concerned.
Should have experience in coordinating onsite/offshore team members. Delivery ownership for offshore deliverables.
Should be able to estimate from high level requirement and do an independent estimate from detailed functional
specification
Capability to provide technical design and implement on complex requirement.
Understand Agile practices (daily scrum, iteration planning, retrospective, test driven, model storming) and follow the same.
Meticulously review the design, test cases and code
Coding, Unit Testing and Integration Testing.

Profile required

Requires  8+ years relevant experience.
Should have experience in leading activities and also hands on experience on the technical stack mentioned below
Hadoop stack :- Scala, Hive, HDFS, Spark, Yarn – Mandatory skill - Scala
Awareness in Parallel computing, Data storage, Resource Mgmt. ·Very comfortable in Linux .
Experience of GIT & CI / CD ·Delivery of reliable, scalable, modular and quality software that fully meets client expectations. Individual is independent and accountable for the results
Good knowledge in Jenkins, GIT, SQL,SSAS