{"id":4632282,"url":"https://alion.io/job/cloudberry360-lead-data-platform-engineer","title":"Lead Data Platform Engineer","company":{"id":5093329,"name":"CloudBerry360","domain":"cloudberry360.com","url":"https://alion.io/company/cloudberry360","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Hudi","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"dbt","optional":false},{"name":"GDPR","optional":false},{"name":"GitHub","optional":false},{"name":"IAM","optional":false},{"name":"Least Privilege","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Prefect","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-19T17:39:41Z","employer_posted_date":null,"last_verified_at":"2026-11-19T17:39:41Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"We are hiring a hands-on engineer to build data platform from scratch: an AWS lakehouse serving board \nKPIs and embedded dashboards, in both the UK and Ireland. \n\nTitle - Lead Data Platform Engineer (hands-on) \nCompany - Cloudberry360 \nLocation - Bangalore \nStart - Immediate\n\nAbout us and the work \n\nCloudberry360 is a digital product development and services company with teams in the UK and India. \nWe build product stacks for clients across several domains. You will join a large Cloudberry team already embedded with a fast-growing client operating in the UK and Ireland. The client runs a microservice platform (CRM, agent portal, identity) used by estate and letting agencies. You will be the first data platform hire and will build its data platform from the ground up. It will power board and branch KPIs internally, and embedded dashboards for each agency customer. \n\nWhat you'll do\n\nYou will design the platform and write most of its first version yourself. \n• Stand up the AWS foundations for the UK and Ireland in Terraform: accounts, S3, Glue Iceberg \ncatalog, Lake Formation permissions \n• Build change-data-capture pipelines from the microservice databases with AWS DMS, landing \nstraight into the lakehouse \n• Load external sources: PostHog product analytics and public property datasets (Price Paid, EPC, \nBER, PPR) \n• Model bronze, silver and gold layers in dbt, including incremental marts, history (SCD2) and \ntests \n• Mask and minimise personal data, and enforce row and column level access for internal and \nagency users \n• Deliver the first internal KPI dashboards and the first embedded, tenant-isolated agency \ndashboard \n• Set up orchestration, data quality alerting, CI/CD and Iceberg table maintenance \n• Agree KPI definitions with the client's product and business teams, and push back where needed \n• Set engineering standards, then help hire and mentor the data team as it grows \n\nTech environment .\nThe target stack is set, but you will have a real say in the final choices. \nLayer - Technology Ingestion AWS DMS (full load + CDC), scheduled batch loaders, PostHog batch \nexports \nStorage - Amazon S3 + Apache Iceberg, AWS Glue catalog \nGovernance - AWS Lake Formation, IAM, two AWS regions (London, Ireland) \nTransformation - dbt Core on Amazon Athena \nOrchestration - Dagster or Amazon MWAA (Airflow) \nBI - Amazon Quick Sight with embedded dashboards and tag-based row-level \nsecurity \nEngineering - Terraform, GitHub, CI/CD, Python, SQL \n\nWhat you'll bring \n\nAround 6–9 years in data engineering, with at least 2–3 years building modern lakehouse or dbt \nplatforms hands-on. \n• Production AWS data work: S3, DMS, Glue, Lake Formation and IAM, ideally across more than \none region or account \n• Apache Iceberg (or Delta/Hudi) in production: table design, partitioning, compaction, snapshot \nexpiry \n• Deep dbt experience: incremental models, snapshots, tests and keeping a growing project tidy \n• Excellent SQL and solid Python \n• Terraform (or similar) and CI/CD for data projects \n• An orchestrator: Dagster, Airflow or Prefect \n• Change-data-capture pipelines from operational databases (Postgres or MySQL) \n• Practical GDPR knowledge: personal data masking, data residency and least-privilege access \n• Confidence with stakeholders: turning business questions into clear KPI definitions \n• A track record of building something from zero, not only maintaining it","description_format":"text","description_chars":3400,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-19T20:09:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["seen:0","win:early"],"computed_at":"2026-11-19T22:18:05Z"},"pay":null,"html_url":"https://alion.io/job/cloudberry360-lead-data-platform-engineer","json_url":"https://alion.io/job/cloudberry360-lead-data-platform-engineer.json","meta":{"generated_at":"2026-11-19T22:18:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6860,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5093329},"rest":"https://alion.io/mcp/rest/get_company?id=5093329"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcloudberry360-lead-data-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcloudberry360-lead-data-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcloudberry360-lead-data-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cloudberry360-lead-data-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcloudberry360-lead-data-platform-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4632282}},{"tool":"search_jobs","arguments":{"company":"cloudberry360.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4632282},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}