{"id":4612939,"url":"https://alion.io/job/capgemini-senior-data-engineer-23","title":"Senior Data Engineer","company":{"id":145,"name":"Capgemini","domain":"capgemini.com","url":"https://alion.io/company/capgemini","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"B","score":79,"open_postings":1779,"ghost_share":0.006,"stale_share":0.807,"repost_share":0.024,"time_to_fill_p50_days":31,"computed_at":"2026-11-19T09:08:57Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gdańsk, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-11-19T11:11:38Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-19T15:31:38Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.\nYour role\nOur client is expanding its data platform team as part of its ongoing data modernization initiatives. They are looking to add Data Engineer to support the evolution of the Microsoft-based analytics and data platform.\nEmpoloyee will need to be able to provide overlap with the customer's US Eastern Time working hours, including availability through approximately 4:30 PM ET.\nYour tasks\nDesign, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.\nBuild and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.\nDemonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.\nMeasures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements; explains capacity behavior to platform and engineering teams.\nYour profile\nMicrosoft Fabric or Databricks production engineering\nApache Spark and Spark UI troubleshooting\nShuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown\nDelta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE\nFabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation\nProduction Python library development, packaging, validation, logging, testing, versioning, and documentation\nOperational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness\nWhat You'll love about working here\nWell-being culture: medical care with Medicover, private life insurance, and sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast 'Let's talk about wellbeing' which you can listen to on Spotify.\n Access to over 70 training tracks with certification opportunities (e.g., GenAI, Architects, Google) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings. \nContinuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy.\n Enjoy hybrid working model onboarding that fits your life - after completing , connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.\nGet to know us\nCapgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.\nDo you want to get to know us better? Check our Instagram - @capgeminipl or visit our Facebook profile - Capgemini Polska. You can also find us on YouTube.\nAbout Capgemini\nCapgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market-leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.\nMake it real | www.capgemini.com","description_format":"text","description_chars":4698,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Home office","Hybrid work","Life insurance"],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Systems Integrators","Management Consulting","Engineering Services"],"lifecycle":[{"event":"open","at":"2026-11-19T15:31:38Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":31,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-19T17:21:41Z"},"pay":null,"html_url":"https://alion.io/job/capgemini-senior-data-engineer-23","json_url":"https://alion.io/job/capgemini-senior-data-engineer-23.json","meta":{"generated_at":"2026-11-19T17:21:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":28848,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":145},"rest":"https://alion.io/mcp/rest/get_company?id=145"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcapgemini-senior-data-engineer-23"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcapgemini-senior-data-engineer-23"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcapgemini-senior-data-engineer-23"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/capgemini-senior-data-engineer-23\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcapgemini-senior-data-engineer-23"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4612939}},{"tool":"search_jobs","arguments":{"company":"capgemini.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4612939},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}