{"id":1285386,"url":"https://alion.io/job/xtag-services-big-dataaws-data-engineer","title":"Big Data/AWS Data Engineer","company":{"id":3800680,"name":"xTag Services","domain":"xtagservices.com","url":"https://alion.io/company/xtag-services","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"junior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":12000,"max_usd":30000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":11},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon ECS","optional":false},{"name":"Amazon S3","optional":false},{"name":"API Gateway","optional":false},{"name":"AWS","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"Cassandra","optional":false},{"name":"CI/CD","optional":false},{"name":"Hadoop","optional":false},{"name":"Java","optional":false},{"name":"Kotlin","optional":false},{"name":"Linux","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"SOAP","optional":false},{"name":"Spark","optional":false},{"name":"Bitbucket","optional":true},{"name":"CloudFormation","optional":true},{"name":"Git","optional":true},{"name":"GitHub","optional":true},{"name":"GitLab","optional":true},{"name":"Gradle","optional":true},{"name":"Jenkins","optional":true},{"name":"Maven","optional":true}],"status":"live","first_seen_at":"2026-08-17T04:15:18Z","employer_posted_date":null,"last_verified_at":"2026-08-17T04:15:18Z","board_verified":false,"closed_at":null,"days_open":54,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":54},"description":"Big Data / AWS Data Engineer\n\nAbout the Opportunity :\n\nWe are looking for experienced Big Data / AWS Data Engineers with strong hands-on expertise in designing, developing, implementing, testing, and optimizing Big Data applications on AWS Cloud. The role involves working on both API and Batch applications using technologies such as Java, Scala, Kotlin, Python, Spark, Hadoop, Cassandra, Snowflake, and AWS services.\n\nPosition Details :\n\nClient : Altimetrik\n\nJob Location : Hyderabad\n\nWork Model : Hybrid 2 days per week at client location\n\nOpen Positions : 2\n\nClient Interview : In-person interview for final discussion \n\nKey Responsibilities :\n\n- Analyze, design, code, implement, test, and support Big Data applications on AWS Cloud.\n\n- Develop and maintain both API-based and Batch applications.\n\n- Build scalable data processing solutions using Spark, Hadoop, HDFS, MapReduce, and related Big Data technologies.\n\n- Develop applications using Scala, PySpark, Java, Kotlin, and Python.\n\n- Develop and integrate REST APIs and SOAP Web Services.\n\n- Implement AWS-based Batch and API microservices using services such as EMR, EC2, ECS, S3, Airflow, Step Functions, and AWS API Gateway.\n\n- Perform performance tuning and optimization of batch applications across Spark, Hadoop, EMR, Java, and Python.\n\n- Develop automation pipelines for data ingestion and transformation in Snowflake using Spark.\n\n- Work with Linux environments and develop Shell/Python scripts for automation and operational activities.\n\n- Follow software engineering best practices for version control, build management, deployment, and CI/CD.\n\n- Collaborate with development, data, DevOps, and client teams to deliver high-quality solutions.\n\nRequired Technical Skills :\n\nBig Data & Programming :\n\n- Strong hands-on experience with Big Data applications\n\n- Scala\n\n- PySpark\n\n- Java\n\n- Python\n\n- Kotlin\n\n- Spark\n\n- Hadoop\n\n- HDFS\n\n- MapReduce\n\n- Cassandra\n\nAWS Cloud : \n\n- Strong experience with AWS services, particularly : EMR, EC2, ECS, S3, Airflow, AWS Step Functions, and AWS API Gateway.\n\n- Experience developing both Batch applications and API-based microservices on AWS is required.\n\nData Engineering :\n\n- Snowflake\n\n- Spark-based data processing\n\n- Data ingestion pipelines\n\n- Data transformation pipelines\n\n- Batch processing and optimization\n\n- Big Data application performance tuning\n\nAPIs & Web Services :\n\n- REST APIs\n\n- SOAP Web Services\n\n- API-based microservices\n\nLinux & Scripting :\n\n- Linux\n\n- Shell scripting\n\n- Python scripting and automation\n\nGood-to-Have Skills :\n\n- Git, GitHub\n\n- Bitbucket\n\n- GitLab\n\n- IntelliJ IDEA\n\n- PyCharm\n\n- Maven\n\n- Gradle\n\n- Jenkins\n\n- Artifactory\n\n- AWS CodeCommit\n\n- AWS CloudFormation, and CI/CD pipeline development.\n\nCandidate Profile :\n\nThe ideal candidate should have :\n\n- Strong hands-on development experience in Big Data and AWS Cloud.\n\n- Good programming skills in Scala, PySpark, and/or Java.\n\n- Practical experience building and optimizing Spark/Hadoop-based applications.\n\n- Experience working with AWS cloud-native services for Batch and API workloads.\n\n- Strong understanding of data ingestion, transformation, and processing pipelines.\n\n- Good problem-solving and debugging skills.\n\n- Ability to work effectively in a hybrid client environment.\n\n- Willingness to attend an in-person client interview for the final discussion.\n\nWork Location & Interview :\n\nLocation : Hyderabad\n\nWork Model : Hybrid 2 days per week at client location\n\nFinal Client Discussion : In-person\nSkills\nBig Data, AWS, Data Engineering, PySpark, Hadoop, Python, Scala, Apache Airflow, Snowflake DB, Data Pipeline","description_format":"text","description_chars":3622,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology","Professional Services","Enterprise Apps Implementation Partners"],"lifecycle":[{"event":"open","at":"2026-09-26T04:00:00Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.382,"p_room":0.28,"age_days":54,"expected_fill_days":16,"reasons":["seen:54","velocity","win:tail","crowd:junior"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/xtag-services-big-dataaws-data-engineer","json_url":"https://alion.io/job/xtag-services-big-dataaws-data-engineer.json","meta":{"generated_at":"2026-10-11T02:20:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":3726,"day_limit":5000,"remaining_today":1274,"minute_limit":60,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800680},"rest":"https://alion.io/mcp/rest/get_company?id=3800680"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fxtag-services-big-dataaws-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fxtag-services-big-dataaws-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fxtag-services-big-dataaws-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/xtag-services-big-dataaws-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fxtag-services-big-dataaws-data-engineer"}]}