{"id":3377587,"url":"https://alion.io/job/ibm-data-engineer-6","title":"Data Engineer","company":{"id":86,"name":"IBM","domain":"ibm.com","url":"https://alion.io/company/ibm","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"IBM Careers","truth_index":{"grade":"A","score":100,"open_postings":30,"ghost_share":0,"stale_share":0,"repost_share":0.033,"time_to_fill_p50_days":15,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":97000,"max_usd":212000,"period":"year","method":"role_country_seniority_unknown","sample_n":3718},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EventBridge","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Fivetran","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Hadoop","optional":false},{"name":"Machine Learning","optional":false},{"name":"MLFlow","optional":false},{"name":"MySQL","optional":false},{"name":"OpenShift","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"SAP BTP","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Unstructured.io","optional":false},{"name":"ABAP","optional":true}],"status":"live","first_seen_at":"2026-10-27T00:00:00Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-10-29T14:29:22Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. Data Engineer embedded with the client's teams to design and deliver hands-on solutions on the AWS/Databricks platform. The role combines architecture and engineering, and you will build and prove solutions with the client. Work includes re-engineering legacy data workloads and supporting data migration from MySQL to Databricks Lakebase. Responsibilities\nWork onsite or embedded with client teams to understand business problems and turn them into working technical solutions.\nDesign and build data pipelines and integrations using Fivetran, Databricks, and AWS services.\nLead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation.\nIntegrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products.\nBuild prototypes and reference implementations, then work with the client to harden them for production.\nSupport data and AI use cases, including integration with GCP-based ML/GenAI components.\nEstablish engineering standards: CI/CD, testing, observability, security, and cost control.\nCoach client and delivery team members, and communicate status, risks, and design decisions to stakeholders.\nDesign end-to-end data solutions across multiple platforms, applying industry standards and best practices to meet client needs.\nLead the development of data platform architectures, including cognitive components and unstructured data technologies, annotation, and related data and analytics.\nManage and maintain large data repositories, ensuring scalability and performance.\nCreate data solutions on cloud-native platforms (AWS, with GCP for ML/GenAI), tailored to client requirements.\nCollaborate with clients to understand their needs and deliver customized data solutions that meet their business objectives. This job can be performed from anywhere in the US\nMust be able to travel 4 days per week (mandatory).\nDatabricks Certified Data Engineer or Machine Learning Professional.\nAdvanced hands-on expertise in data engineering and solution architecture, with demonstrated ability to design and deliver complex data solutions.\nStrong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python, including large-scale batch and streaming workloads.\nExperience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns.\nExperience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines.\nHands-on experience designing scalable data platforms and pipelines using technologies such as Kafka, Amazon EventBridge, or Amazon SQS, along with Terraform and CI/CD practices.\nExperience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies.\nKnowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U.\nExposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP.\nExperience with Git-based version control and branching strategies for data workloads.\nExperience in the utilities or energy industry, with relevant Databricks and/or AWS certification. United States Infrastructure & Technology Hybrid Professional Multiple Cities PARAMUS RESEARCH TRIANGLE PARK Charlotte Boston Atlanta Denver Minneapolis Dallas Houston Austin Chicago New York (0147) International Business Machines Corporation Amazon Web Services Analytics Architecture Big Data Design Hadoop Management MapReduce Scalability Azure Solution Design Snowflake Data Warehouse Data Platform Unstructured Data OpenShift Scale Cloud-native Data","description_format":"text","description_chars":4407,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["LLM & Generative AI","Quantum Science & Computing","Servers & Data Center Hardware","Quantum Computing Hardware"],"lifecycle":[{"event":"open","at":"2026-10-28T03:22:38Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"green card filings: 7","filings_12m":0,"filings_prev_12m":19,"green_card_filings_12m":7,"median_offered_wage_usd":182500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":99,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.993,"p_room":1,"age_days":2,"expected_fill_days":15,"reasons":["conf:4","wave","velocity","win:early","comp:brand"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/ibm-data-engineer-6","json_url":"https://alion.io/job/ibm-data-engineer-6.json","meta":{"generated_at":"2026-10-29T17:48:08Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26544,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":86},"rest":"https://alion.io/mcp/rest/get_company?id=86"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fibm-data-engineer-6"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fibm-data-engineer-6"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fibm-data-engineer-6"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ibm-data-engineer-6\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fibm-data-engineer-6"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3377587}},{"tool":"search_jobs","arguments":{"company":"ibm.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3377587},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}