{"id":4559584,"url":"https://alion.io/job/epam-systems-poland-senior-data-software-engineer-azure-spark","title":"Senior Data Software Engineer (Azure, Spark)","company":{"id":2612641,"name":"EPAM Systems Poland","domain":"epam-poland.pl","url":"https://alion.io/company/epam-poland","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gdańsk, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Spark","optional":false},{"name":"Anthropic","optional":true},{"name":"AWS","optional":true},{"name":"AWS Glue","optional":true},{"name":"Azure Cosmos DB","optional":true},{"name":"Azure Data Factory","optional":true},{"name":"CI/CD","optional":true},{"name":"Copilot","optional":true},{"name":"Databricks","optional":true},{"name":"Delta Lake","optional":true},{"name":"ETL/ELT","optional":true},{"name":"GCP","optional":true},{"name":"Microsoft Fabric","optional":true},{"name":"Pandas","optional":true},{"name":"Platform Engineering","optional":true},{"name":"pySpark","optional":true},{"name":"Python","optional":true},{"name":"Scala","optional":true}],"status":"live","first_seen_at":"2026-11-18T18:05:30Z","employer_posted_date":null,"last_verified_at":"2026-11-18T18:05:30Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"We are looking for a Senior Data Software Engineer to contribute to the design and development of a modern enterprise data platform focused on large-scale financial data processing. The platform is being built to deliver new capabilities rather than maintain legacy systems, with a strong emphasis on data quality, governance, and scalable processing across cloud-native technologies. The role involves working on data ingestion, transformation, modeling, and optimization within a medallion architecture, supporting both structured and complex datasets, including private markets data.\nNice to have\nHands-on experience with Microsoft Fabric and OneLake\nExpertise in Cosmos DB (NoSQL API) specifically\nFamiliarity with financial instruments and financial services data\nFamiliarity with AI-assisted development tools such as GitHub Copilot and awareness of industry-standard LLMs\nUnderstanding of Data Science fundamentals and collaboration experience with DS teams\nRequirements\n5+ years of experience in data engineering, with a focus on large-scale data processing\nProficiency in Microsoft Fabric, Apache Spark, and Python\nSkills in Pandas, Delta Lake, and Parquet for data processing, storage, and optimization\nKnowledge of Cosmos DB for bitemporal data storage and retrieval\nFamiliarity with AWS Glue for supporting ETL workflows\nExpertise in Spark Streaming for near real-time processing with watermarking support\nCompetency in CI/CD tools for building automated validation pipelines\nBackground in mentoring engineers and establishing coding standards and best practices\nEnglish proficiency at B2 level or higher\nResponsibilities\nLead the design, development, and optimization of scalable data engineering solutions on Azure, using Spark-based processing (PySpark, SparkSQL, Scala, or equivalent)\nOwn end-to-end data transformation pipelines, including ingestion, transformation, storage, and analytics\nWork with Azure-native data services such as Data Factory, Databricks, and Synapse\nSupport high-performance data access patterns using Cosmos DB (NoSQL API) where applicable\nCollaborate with data scientists, AI engineers, and product stakeholders to enable data-driven analytics and insights\nMentor and guide junior engineers, setting coding standards and best practices\nEnsure data quality, security, governance, and performance across platforms\nContribute to technical decision-making and solution architecture discussions\nBuild and maintain data pipelines within a medallion architecture, supporting structured and complex datasets\nApply CI/CD practices to automate validation and deployment of data pipelines\nWe offer\nWe gather like-minded people:\nTop tech minds driving innovation in AI, cloud and digital platform modernization\nSupportive team and agile, startup-like culture\nHybrid by design mode and opportunity to work remotely within Poland\nChance to work abroad for up to 60 days annually\nBusiness-driven relocation opportunities\n\nWe provide growth opportunities:\nCareer development programs\nThought leadership, mentoring, soft skills and well-being programs\nCertification (Anthropic, Gemini, GCP, Azure, AWS)\nEnglish classes\n\nWe cover it all:\nStable pay\nParticipation in the Employee Stock Purchase Plan with a 15% discount\nBenefits package (health insurance, multisport, shopping vouchers)\nReferral bonuses up to $2,000\nOffices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more\nCorporate, social and well-being events\n\nPlease, note:\nBenefits listed above are available to employees only\nWe are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually\nWe will reach out to selected candidates exclusively\n\nEPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.\nTech stack\nData Engineering\nApache Spark\nMicrosoft Azure\nPython\nMicrosoft Fabric\nSpark Streaming\nPandas\nDelta Lake\nAzure Cosmos DB\nCI/CD","description_format":"text","description_chars":4206,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Growth opportunities","Health insurance"],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-18T20:25:15Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":15,"reasons":["seen:0","win:early","comp:brand"],"computed_at":"2026-11-19T03:10:30Z"},"pay":null,"html_url":"https://alion.io/job/epam-systems-poland-senior-data-software-engineer-azure-spark","json_url":"https://alion.io/job/epam-systems-poland-senior-data-software-engineer-azure-spark.json","meta":{"generated_at":"2026-11-19T03:10:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5628,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2612641},"rest":"https://alion.io/mcp/rest/get_company?id=2612641"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fepam-systems-poland-senior-data-software-engineer-azure-spark"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fepam-systems-poland-senior-data-software-engineer-azure-spark"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fepam-systems-poland-senior-data-software-engineer-azure-spark"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/epam-systems-poland-senior-data-software-engineer-azure-spark\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fepam-systems-poland-senior-data-software-engineer-azure-spark"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4559584}},{"tool":"search_jobs","arguments":{"company":"epam-poland.pl","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4559584},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}