Pyspark Engineer

Infosys is hiring a PySpark Engineer to contribute to software design, development, testing, integration, and production support. The role supports data-processing applications and involves documenting requirements and design decisions, maintaining code quality and system reliability, and helping users transition to new applications.

Responsibilities

• Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided
• Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions
• Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability
• Conduct code reviews, do changes to the codebase and maintain code repositories
• Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards
• Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications
• Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability
• Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects

Skills

• A collaborative spirit and excellent communication skills
• The ability to handle end to end SDLC phases from requirement gathering to implementation
• A knack for translating complex requirements into actionable development tasks
• A passion for design and hands-on coding experience
• A proactive approach to testing, troubleshooting, and refining our applications
• The ability to work with cross-functional teams and do software integration
• Experience with Spark/Hadoop/HDFS architecture, YARN, Confluent Kafka, HBase, Hive, Impala, and NoSQL databases
• Bachelor's degree or foreign equivalent required from an accredited institution
• Will also consider three years of progressive experience in the specialty in lieu of every year of education
• Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply
• Infosys is unable to provide immigration sponsorship for this role now or in the future
• Experience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting

Benefits

• As a full-time Infosys employee, eligible for Medical/Dental/Vision/Life Insurance
• As a full-time Infosys employee, eligible for Long-term/Short-term Disability
• As a full-time Infosys employee, eligible for Health and Dependent Care Reimbursement Accounts
• As a full-time Infosys employee, eligible for Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)
• As a full-time Infosys employee, eligible for a 401(k) plan and contributions dependent on salary level
• As a full-time Infosys employee, eligible for paid holidays plus Paid Time Off

Company Overview