{"id":2365322,"url":"https://alion.io/job/sigma-software-group-senior-data-engineer-databricks-migration-6","title":"Senior Data Engineer (Databricks Migration)","company":{"id":6266,"name":"Sigma Software Group","domain":"sigma.software","url":"https://alion.io/company/sigma-software-group","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kharkiv, Ukraine"],"countries":["UA"],"hiring_countries":["UA"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":33000,"max_usd":85000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2157},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"BigQuery","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Machine Learning","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-12T10:16:12Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-13T03:35:06Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Are you a Senior Data Engineer passionate about building scalable, high-performance data platforms and working with modern Lakehouse technologies? Join Sigma Software’s Data Engineering Center of Excellence and contribute to the modernization of an enterprise-scale analytics ecosystem for the retail domain.\nWe are looking for a Senior specialist with strong Databricks, PySpark, and cloud data engineering expertise to participate in the migration of a large-scale analytical platform from BigQuery to Databricks. You will collaborate with international teams, contribute to architectural decisions, and help shape reliable and scalable data solutions.\nWe at Sigma Software create opportunities for continuous learning, technology growth, and meaningful engineering impact while working on complex international projects.\nCUSTOMER\nOur Customer is a leading retail technology company specializing in AI-driven pricing optimization solutions for enterprise retailers. The company helps businesses improve profitability and competitiveness through advanced analytics, automation, and intelligent pricing strategies. Their platform combines business intelligence with sophisticated algorithms to support data-informed pricing decisions at scale for global retail organizations.\nPROJECT\nThe project focuses on the strategic migration of a large-scale analytical platform from a legacy BigQuery ecosystem to a modern Databricks Lakehouse architecture. The platform processes high-volume retail datasets, machine learning workloads, analytics pipelines, and customer-specific business logic.\nAs part of the modernization initiative, the engineering team is implementing scalable Spark-based processing, Delta Lake architecture, medallion data layers, and modern governance practices. The role offers an opportunity to work with distributed data processing systems, optimize large-scale workloads, and contribute to the evolution of an enterprise-grade data platform.\nKey Technologies: Databricks, Apache Spark, PySpark, Delta Lake, Python, SQL, Airflow, GCP, CI/CD, Unity Catalog\n Participate in the migration of a large-scale analytical platform from BigQuery to Databricks\nDesign and implement scalable Lakehouse architectures using Databricks and Delta Lake\nAnalyze existing ETL / ELT workloads and define migration approaches\nDevelop and optimize data pipelines processing large volumes of retail and analytical data\nImplement incremental processing strategies and scalable transformation frameworks\nBuild and maintain Spark-based data processing solutions using PySpark\nDesign and maintain medallion architecture layers including Bronze, Silver, and Gold\nImplement data governance and security best practices using Unity Catalog\nCollaborate with Data Science, Analytics, Product, and Customer Engineering teams\nParticipate in architecture discussions and technical solution design\nDevelop reusable data platform components and engineering standards\nConduct code reviews and contribute to platform reliability and maintainability\nTroubleshoot and optimize complex SQL and Spark workloads\nSupport production deployments and platform modernization activities\n 5+ years of professional experience as a Data Engineer\nStrong programming skills in Python and advanced SQL\nHands-on commercial experience with Databricks\nStrong knowledge of Apache Spark, primarily PySpark\nExperience designing and building modern cloud-based data platforms\nExperience developing ETL / ELT pipelines and large-scale data processing solutions\nHands-on experience with Delta Lake\nExperience with Spark Declarative Pipelines\nExperience with cluster monitoring, metrics analysis, and performance optimization\nStrong understanding of distributed data processing architectures\nSolid understanding of data warehousing concepts and dimensional modeling\nExperience with Airflow or similar orchestration tools\nExperience optimizing complex analytical SQL workloads\nExperience implementing CI / CD practices for data engineering platforms\nStrong troubleshooting and performance optimization skills\nAbility to work collaboratively in cross-functional international teams\nUpper-Intermediate or higher English level\nWILL BE A PLUS\nExperience working with GCP cloud services\nExperience with AWS or Azure cloud platforms\nExperience in retail analytics or pricing optimization domains\nExperience supporting machine learning or AI-related data workloads\nExperience with platform modernization and cloud migration initiatives\n PERSONAL PROFILE\nStrong analytical and problem-solving mindset\nProactive and ownership-driven approach\nAbility to work independently and collaboratively\nGood communication and stakeholder collaboration skills\nPassion for scalable data engineering and modern data platforms\nInterest in continuous learning and technology innovation","description_format":"text","description_chars":4812,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"Ukraine","iso":"UA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-12T16:32:58Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":28,"reasons":["conf:0","win:early"],"computed_at":"2026-10-13T04:27:51Z"},"pay":null,"html_url":"https://alion.io/job/sigma-software-group-senior-data-engineer-databricks-migration-6","json_url":"https://alion.io/job/sigma-software-group-senior-data-engineer-databricks-migration-6.json","meta":{"generated_at":"2026-10-13T04:27:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6984,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6266},"rest":"https://alion.io/mcp/rest/get_company?id=6266"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsigma-software-group-senior-data-engineer-databricks-migration-6"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsigma-software-group-senior-data-engineer-databricks-migration-6"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsigma-software-group-senior-data-engineer-databricks-migration-6"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sigma-software-group-senior-data-engineer-databricks-migration-6\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsigma-software-group-senior-data-engineer-databricks-migration-6"}]}