{"id":2171227,"url":"https://alion.io/job/sigma-software-group-senior-data-engineer-5","title":"Senior Data Engineer","company":{"id":6266,"name":"Sigma Software Group","domain":"sigma.software","url":"https://alion.io/company/sigma-software-group","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":63000,"max_usd":96000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":68},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Airflow","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Feature Store","optional":false},{"name":"GCP","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"MLFlow","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-09T12:04:15Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T00:55:40Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"We are looking for a Senior Data Engineer to join our Data Engineering Team and take ownership of high-impact, greenfield data initiatives. You will work on building modern cloud-native data platforms, migrating on-premises legacy systems to the cloud, and laying the architectural foundation for AI-ready data infrastructure.\nIn this role, you will collaborate closely with Machine Learning, Data Science, and Product teams, serving as a key technical contributor and thought leader. You will also drive R&D efforts around agentic AI architectures, event-driven systems, and LLM-ready data pipelines - turning architectural concepts into production-grade solutions.\n Design and build scalable cloud-native data platforms from greenfield to production\nDesign and implement near-real-time ingestion pipelines using event-driven patterns\nDefine and enforce data platform standards including Data Lake and Lakehouse principles, medallion architecture, and data contracts\nRefactor, optimize, and modernize Spark and PySpark scripts for performance and maintainability\nIntroduce best practices for code quality, testing, and CI/CD across data pipelines\nDrive adoption of AI tooling and agentic workflows within the Data Engineering team\nEnsure data quality, observability, scalability, and reliability across all platforms and pipelines\nDesign and deliver self-service tooling and microservices that simplify platform usage\nCollaborate with cross-functional stakeholders including Product, Machine Learning, and Data Science teams\nContribute to architecture decisions and technical R&D initiatives\n 5+ years of professional experience in Data Engineering\nStrong Python and SQL development skills\nHands-on experience with Apache Spark and PySpark including query optimization and performance tuning\nExperience working with Databricks or Snowflake\nPractical experience with at least one major cloud provider such as Azure, AWS, or GCP\nExperience with stream processing technologies including Kafka or Spark Structured Streaming\nStrong understanding of ETL/ELT patterns, data modelling, and data warehousing concepts\nExperience with orchestration tools such as Apache Airflow or Azure Data Factory\nKnowledge of Infrastructure as Code tools including Terraform\nUnderstanding of production-grade systems including observability, scalability, reliability, and performance\nAbility to independently lead technical initiatives from concept to delivery\nStrong communication and collaboration skills\nUpper-Intermediate or higher English level\nWILL BE A PLUS\nFamiliarity with RAG pipeline design and LLM integration patterns\nKnowledge of data governance frameworks and tools such as Unity Catalog or Apache Atlas\nExperience with dbt for data transformation and modelling\nFamiliarity with MLflow, Feature Stores, or ML platform integrations\n PERSONAL PROFILE\nProactive and self-driven mindset\nStrong analytical and architectural thinking\nAbility to work independently and take ownership of technical decisions\nPassion for innovation and modern engineering practices\nKnowledge-sharing and team-oriented approach\nStrong problem-solving skills","description_format":"text","description_chars":3122,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-09T12:09:56Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":28,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/sigma-software-group-senior-data-engineer-5","json_url":"https://alion.io/job/sigma-software-group-senior-data-engineer-5.json","meta":{"generated_at":"2026-10-12T01:08:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1195,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6266},"rest":"https://alion.io/mcp/rest/get_company?id=6266"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsigma-software-group-senior-data-engineer-5"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsigma-software-group-senior-data-engineer-5"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsigma-software-group-senior-data-engineer-5"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sigma-software-group-senior-data-engineer-5\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsigma-software-group-senior-data-engineer-5"}]}