Big Data Developer

Role: Mid-level Big Data Engineer

Position Type: Full-Time Contract (40hrs/week)

Contract Duration: 6 months+

Work Schedule: 8 hours/day (Mon-Fri)

Location: Hyderabad, Hybrid(Wed and Thursday to be onsite)

We are looking for an experienced Big Data Engineer to develop, implement, test, and optimize large-scale batch and API-based applications on AWS. The ideal candidate will have strong hands-on programming experience in Scala, PySpark, and Java, along with expertise in Spark/Hadoop processing, AWS services, and Linux scripting.

Key Responsibilities

• Develop and maintain big data batch applications and API-based services on AWS.
• Build REST and SOAP web services using Scala, PySpark, Java, or related technologies.
• Work with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
• Develop and support AWS workloads using EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway.
• Tune and optimize batch processing performance across Spark, Hadoop, EMR, Java, and Python applications.
• Use Linux, shell scripting, and Python for automation, troubleshooting, and operational support.
• Collaborate with DevOps teams on version control, CI/CD, and deployment processes.

Requirements

• 6+ years of experience developing and testing big data applications.
• Strong Scala, PySpark, and Java programming skills.
• Hands-on AWS experience, particularly EMR and related batch-processing services.
• Experience with Spark, Hadoop/HDFS, MapReduce, and REST/SOAP services.
• Strong Linux and shell scripting skills.

Location: Hyderabad, hybrid — onsite Wednesday and Thursday.