{"id":2117020,"url":"https://alion.io/job/luxoft-senior-data-engineer-investment-data","title":"Senior Data Engineer (Investment Data)","company":{"id":171185,"name":"Luxoft","domain":"luxoft.com","url":"https://alion.io/company/luxoft","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career sitemap","truth_index":{"grade":"A","score":85,"open_postings":8,"ghost_share":0,"stale_share":0.5,"repost_share":0.5,"time_to_fill_p50_days":11,"computed_at":"2026-10-12T06:55:09Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":76000,"max_usd":115000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":68},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"pySpark","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Datadog","optional":true},{"name":"Dynatrace","optional":true},{"name":"Python","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-09-25T07:05:10Z","employer_posted_date":null,"last_verified_at":"2026-09-25T07:05:10Z","board_verified":false,"closed_at":null,"days_open":17,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":17},"description":"We’re looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrives in ambiguous environments—proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in our lakehouse, to making data discoverable, reliable, and cost-efficient. You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.\n\nParticipate in requirements clarification and sprint planning sessions.\n\nDesign technical solutions and implement them, inc ETL Pipelines – Build robust data pipelines in PySpark to extract, transform, using PySpark\n\nOptimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability\n\nWriting unit and integration tests.\n\nSupport QA teammates in the acceptance process.\n\nResolving PROD incidents as a 3rd line engineer.\n\nWymagania\nMUST \nBachelor’s degree (Computer Science, Engineering, Information Systems, or related discipline).\n\n5+ years experience in data engineering roles (flexible based on depth of capability).\n\nStrong hands-on experience with Databricks in production environments (prerequisite).\n\nStrong programming experience with PySpark (must) and strong SQL (must).\n\nProven experience with Declarative Pipelines / pipeline orchestration on Databricks (prerequisite).\n\nStrong understanding of data engineering fundamentals: ingestion patterns, transformation design, incremental processing, testing, performance tuning.\n\nExperience delivering production-ready datasets with appropriate operational controls (monitoring, troubleshooting, reliability patterns).\n\nExperience with modern Lakehouse concepts (Delta tables, optimization strategies, file skipping, metadata/statistics awareness).\n\nExposure to data governance practices: cataloguing, documentation, business glossary/terms, lineage.\n\nExperience working in enterprise environments with CI/CD pipelines and structured release processes.\n\nFamiliarity with vendor market data feeds (e.g., Bloomberg, Refinitiv, MSCI, FactSet) or similar multi-source mastering patterns.\n\nNICE TO HAVE \nStrong Hands-on Expertise in Palantir Foundry. Proven experience with Foundry pipelines, ontologies, data lineage, transformations, and platform governance.\n\nProven Migration Experience from Palantir / to Databricks. Demonstrated experience leading or executing platform migrations, including pipeline conversion, data model redesign, and production cutover.\n\nFamiliarity with Dynatrace or Datadog for system observability and monitoring.\n\nDatabricks certification, cloud certifications (Azure/AWS), or enterprise data architecture certifications.","description_format":"text","description_chars":3006,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology","Software","IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-08T23:22:33Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 41 · green card filings: 50","filings_12m":41,"filings_prev_12m":39,"green_card_filings_12m":50,"median_offered_wage_usd":124258,"route":null,"cap_exempt":false,"checked_at":"2026-10-03T21:08:04+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":4}],"liveness":{"score":28,"band":"fade","label":"Fading","p_open":0.85,"p_active":0.742,"p_room":0.45,"age_days":16,"expected_fill_days":11,"reasons":["seen:16","urgency","velocity","win:tail","comp:brand"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/luxoft-senior-data-engineer-investment-data","json_url":"https://alion.io/job/luxoft-senior-data-engineer-investment-data.json","meta":{"generated_at":"2026-10-12T20:29:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":33277,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":171185},"rest":"https://alion.io/mcp/rest/get_company?id=171185"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fluxoft-senior-data-engineer-investment-data"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fluxoft-senior-data-engineer-investment-data"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fluxoft-senior-data-engineer-investment-data"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/luxoft-senior-data-engineer-investment-data\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fluxoft-senior-data-engineer-investment-data"}]}