{"id":2498138,"url":"https://alion.io/job/allcloud-da-senior-data-engineer","title":"D&A - Senior Data Engineer","company":{"id":36623,"name":"AllCloud","domain":"allcloud.io","url":"https://alion.io/company/allcloud","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Comeet","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ra'anana, Israel"],"countries":["IL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":83000,"max_usd":214000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2157},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EC2","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"IAM","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"Agile","optional":true},{"name":"Airflow","optional":true},{"name":"dbt","optional":true},{"name":"MLFlow","optional":true}],"status":"live","first_seen_at":"2026-10-14T00:37:44Z","employer_posted_date":"2026-10-14","last_verified_at":"2026-10-14T20:43:28Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Description\nAbout AllCloud\nAllCloud is a leader in amplifying organizations’ cloud potential through AI. With a track record of hundreds of successful migrations and implementations across AWS and Salesforce, AllCloud has developed strategies and solutions that enable businesses of all sizes to remain at the forefront of innovation.\nAllCloud is a leader in AI-led professional and managed services. As an AWS Premier and audited managed services Partner, and Salesforce Consulting partner, AllCloud provides comprehensive AI-led cloud journey support, from initial migration to ongoing management through our Engage Managed Services. Our expertise ensures that clients remain aligned with ecosystem best practices while focusing on their core business growth.\nAllCloud serves clients across the globe with offices in EMEA and North America. www.allcloud.io\nJob Description\nWe are looking for a talented and experienced Mid-Level Data Engineer with a passion for data and cloud technologies to join our team. In this role, you will be a key player in designing, developing, and maintaining our AWS and Databricks-based data platform. You will bridge the gap between robust Data Engineering, Database Administration (DBA), and high-performance Analytics Engineering.\nThe ideal candidate understands the Lakehouse architecture, has experience managing modern cloud data warehouses like Snowflake, and possesses the ability to build scalable ETL pipelines that drive data-driven business decisions.\nKey Responsibilities\nEnd-to-End Pipelines: Develop and maintain complex ETL/ELT pipelines using Python/PySpark on the Databricks platform, as well as loading and transforming data within Snowflake.\nData Architecture: Implement and manage data layers following the Medallion architecture (Bronze, Silver, Gold) using Delta Lake.\nOptimization & Analytics: Set up and manage Databricks SQL Warehouses, perform query optimization, and utilize internal visualizations for rapid data exploration.\nCloud Infrastructure: Leverage AWS cloud services to manage data storage, compute resources, and secure data movement.\nDBA & Performance Tuning: Act as a custodian for our data platform-managing indexing, clustering, vacuuming, and performance tuning across both Delta Lake and relational/warehouse environments to ensure cost-efficiency and high speed.\nData Modeling: Design data models (Star Schema / Snowflake) in the Gold layer to ensure optimal performance for BI tools (e.g., Power BI, Tableau).\nData Governance: Manage metadata, permissions, and lineage using Unity Catalog and platform-specific access controls.\nQuality Control: Implement automated Data Quality tests as an integral part of the CI/CD data pipelines.\nRequirements\n5+ years of experience as a Data Engineer or Data Engineer/DBA - Must.\nStrong hands-on experience with the AWS ecosystem (S3, IAM, EC2, etc.) and modern cloud data warehouses, specifically Snowflake.\nAt least 1 year of intensive, hands-on experience with the Databricks platform (including Notebooks and Workflows).\nHigh proficiency in PySpark (or Spark Scala).\nExpertise in writing complex SQL (Window Functions, CTEs) alongside DBA-level performance tuning (query profiling, indexing, partition pruning).\nTechnical Knowledge: Practical experience with Delta Lake, file formats (Parquet), and working with Cloud Storage (AWS S3 / Azure ADLS).\nModeling: Proven experience in designing Fact and Dimension tables.\nAdvantages (Nice to Have)\nExperience with Delta Live Tables (DLT) or dbt (Data Build Tool) on Databricks or Snowflake.\nFamiliarity with MLOps concepts and MLflow.\nOfficial AWS, Snowflake, or Databricks Certifications.\nExperience with external orchestration tools (e.g., Apache Airflow).\nSoft Skills\nAbility to work independently and lead tasks end-to-end in an Agile environment.\nStrong troubleshooting skills for complex, distributed processes and database bottlenecks.\nExcellent communication skills and the ability to collaborate with various stakeholders (Analysts, Product Managers, and Data Scientists).\nAllCloud is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, provincial, or local law.","description_format":"text","description_chars":4301,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Israel","iso":"IL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Enterprise Apps Implementation Partners","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-10-14T05:18:14Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":38,"reasons":["conf:1","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/allcloud-da-senior-data-engineer","json_url":"https://alion.io/job/allcloud-da-senior-data-engineer.json","meta":{"generated_at":"2026-10-14T20:52:58Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27855,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":36623},"rest":"https://alion.io/mcp/rest/get_company?id=36623"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fallcloud-da-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fallcloud-da-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fallcloud-da-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/allcloud-da-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fallcloud-da-senior-data-engineer"}]}