{"id":2129821,"url":"https://alion.io/job/ibm-data-engineer-data-platforms-aws","title":"Data Engineer-Data Platforms-AWS","company":{"id":86,"name":"IBM","domain":"ibm.com","url":"https://alion.io/company/ibm","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"IBM Careers","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"dbt","optional":false},{"name":"DynamoDB","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-10-08T00:00:00Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T11:00:54Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. As a seasoned Data Engineer specializing in Data Platforms on AWS, you will advise on, develop, and maintain data engineering solutions on the AWS Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various AWS services. Your primary responsibilities will include:\nDesign and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis, ensuring seamless integration and operation of data engineering solutions.\nCreate Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS, demonstrating expertise in various AWS Data Platform components.\nManage Data Services: Schedule and manage data services on the AWS Platform, ensuring efficient operation of data engineering solutions.\nDevelop Batch and Real-time Pipelines: Develop batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.\nEnsure Seamless Integration: Ensure seamless integration and operation of data engineering solutions, leveraging expertise in open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform.\nDesigning Data Engineering Solutions: Experience with designing, building, and operating batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis.\nDeveloping Data Layers: Experience in creating data layers on AWS RedShift, Aurora, and DynamoDB, and migrating data using AWS DMS, with proficiency in various AWS Data Platform components.\nManaging Data Services: Experience in scheduling and managing data services on the AWS Platform, ensuring efficient operation of data engineering solutions.\nDeveloping Batch and Real-time Pipelines: Experience with developing batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.\nIntegrating Open Source Technologies: Experience in leveraging open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform to ensure seamless integration and operation of data engineering solutions.\nProficiency in Open Source: Experience with leveraging open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform to ensure seamless integration and operation of data engineering solutions.\nExpertise in AWS Services: Experience with various AWS Data Platform components, including S3, RedShift, RedShift Spectrum, AWS Glue with Spark, AWS Glue with Python, Lambda functions with Python, AWS Glue Catalog, and AWS Glue Databrew.\nKnowledge of Data Migration: Experience with migrating data using AWS DMS and creating data layers on AWS RedShift, Aurora, and DynamoDB. India Data & Analytics Hybrid Professional GURGAON, IN (0063) IBM India Private Limited","description_format":"text","description_chars":3616,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Quantum Science & Computing","Servers & Data Center Hardware","Quantum Computing Hardware"],"lifecycle":[{"event":"open","at":"2026-10-09T00:54:33Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.858,"p_room":1,"age_days":4,"expected_fill_days":15,"reasons":["conf:2","velocity","win:early","comp:brand"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/ibm-data-engineer-data-platforms-aws","json_url":"https://alion.io/job/ibm-data-engineer-data-platforms-aws.json","meta":{"generated_at":"2026-10-12T15:42:36Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24748,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":86},"rest":"https://alion.io/mcp/rest/get_company?id=86"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fibm-data-engineer-data-platforms-aws"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fibm-data-engineer-data-platforms-aws"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fibm-data-engineer-data-platforms-aws"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ibm-data-engineer-data-platforms-aws\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fibm-data-engineer-data-platforms-aws"}]}