Big Data Engineer - Spark/Python
First seen by Alion on Oct 30, 2026.
Job Description :
- 6+ Years of in Big Data & Data related technology experience.
- Expert level understanding of distributed computing principles.
- Expert level knowledge and experience in Apache Spark.
- Hands on programming with Python.
- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.
- Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming.
- Experience with messaging systems, such as Kafka or RabbitMQ.
- Good understanding of Big Data querying tools, such as Hive, and Impala.
- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files.
- Good understanding of SQL queries, joins, stored procedures, relational schemas.
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
- Knowledge of ETL techniques and frameworks.
- Performance tuning of Spark Jobs.
- Experience with native Cloud data services Azure databricks OR GCP.
- Ability to lead a team efficiently.
- Experience with designing and implementing Big data solutions.
- Practitioner of AGILE methodology.
We Offer :
- Opportunity to work on technical challenges that may impact across geographies.
- Vast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certifications.
- Opportunity to share your ideas on international platforms.
- Sponsored Tech Talks & Hackathons.
- Possibility to relocate to any EPAM office for short and long-term projects.
- Focused individual development.
Benefit package :
- Health benefits, Medical Benefits.
- Retirement benefits.
- Paid time off.
- Flexible benefits.
Skills
Data Engineering, Apache Spark, Python, Big Data, Hadoop, Kafka, ETL, Hive, SQL