{"id":786508,"url":"https://alion.io/job/bettercotton-data-engineer-architect-digital-products","title":"Data Engineer & Architect, Digital Products","company":{"id":670422,"name":"Better Cotton","domain":"bettercotton.org","url":"https://alion.io/company/bettercotton","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Rippling","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["New Delhi, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":30000,"max_usd":59000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":13},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Power BI","optional":false},{"name":"Delta Lake","optional":true},{"name":"pySpark","optional":true},{"name":"Python","optional":true},{"name":"Spark","optional":true},{"name":"SQL","optional":true},{"name":"Unity","optional":true}],"status":"live","first_seen_at":"2026-09-07T14:35:40Z","employer_posted_date":"2026-09-07","last_verified_at":"2026-10-14T04:58:08Z","board_verified":true,"closed_at":null,"days_open":36,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":36},"description":"Starting Date: December 2026/ January 2027\nContract type: Full-time and open-ended\nSalary: From 2,716,737 INR\nLocation: India; Delhi, Ahmedabad (Hybrid)\nApplication closing date: 15th October 2026\nIf we receive a high volume of applications, we may close this vacancy earlier than the advertised deadline, so we encourage you to apply as soon as possible.\nAbout the Job\nThe Data Engineer & Architect, Digital Products exists to turn Better Cotton’s fragmented organisational data into governed, production-grade data infrastructure. Combining architecture with hands-on delivery, the role defines the target-state lakehouse and then builds the platform, pipelines, data models and controls that make it operational, so that field tools, supply chain systems, traceability, compliance, impact reporting and future AI-enabled services can rely on trusted, reusable data. In doing so, the role reduces manual reconciliation, strengthens data quality, security and governance, and enables evidence-based decision-making across Better Cotton in support of its mission and Vision for Change.\nThe Challenge\nLooking ahead to 2030, we are targeting reducing GHG emissions from cotton production by half, big cuts in synthetic pesticide use, improve soil health across our network, improve farm income and support women’s empowerment among farmers and farm workers.\nResponsibilities\nIn this role, you will be responsible for:\nBuild and operate ingestion and ETL/ELT pipelines across field tools, supply chain systems, middleware APIs, legacy systems and partner platforms, so that priority data is delivered reliably, incrementally and observably.\nDesign and own the target-state lakehouse architecture, enterprise data warehouse, data marts and data models, ensuring a scalable, secure and maintainable platform that separates transactional and analytical workloads and meets data residency, privacy and retention requirements.\nLead the phased extraction and migration of high-volume historical data from legacy systems, reconciling large and complex datasets without disrupting live operations.\nEstablish and operate platform environments, infrastructure as code, CI/CD, identity, access controls, encryption and audit logging together with IT and Security, keeping the platform secure, repeatable and cost-efficient.\nImplement the data catalogue, data dictionary, metadata management, automated lineage and data-quality monitoring, translating governance policies into measurable and enforceable platform controls.\nBuild trusted, reusable data products for reporting, traceability, compliance, impact measurement, member services and AI/ML use cases, enabling Power BI and analytics teams to work from governed data.\nExperience\nthe following skills, knowledge, and experience:\nEssential\nA degree in Computer Science, Engineering or a related field, or equivalent practical experience.\nStrong hands-on experience in data engineering, architecture and production data-platform delivery, including responsibility for ingestion and ETL/ELT pipelines, medallion (bronze/silver/gold) lakehouse, data warehouse and data mart design, distributed processing at scale, and the migration and reconciliation of large or complex datasets, with a track record of delivering platforms that operate in production.\nExperience across the Microsoft data ecosystem, including Microsoft Fabric, Azure Synapse, Azure Data Lake Storage and Power BI semantic models, alongside Databricks and other cloud-native platforms.\nExperience with distributed systems and large-scale data processing, including query optimisation, partitioning and clustering, file and storage optimisation, caching and cost control on consumption-based platforms.\nExperience with orchestration and transformation tooling such as Databricks Workflows, Apache Airflow, Dagster or dbt, applying medallion architecture and ELT-first patterns.\nExperience working in international, multicultural, or mission-driven environments is an asset.\nProfessional certifications in Databricks, cloud platforms (AWS or Azure or GCP) or data architecture are desirable but not required.\nApplies expert SQL and strong Python to model, transform and reconcile large datasets efficiently.\nBuilds and operates production lakehouse workloads and pipelines using Spark/PySpark, Delta Lake, Unity Catalog and Databricks Workflows, applying medallion architecture.\nFluency in written and spoken English is essential.\nDesirable\nExperience designing and implementing lakehouse, data warehouse and data mart architectures, with a strong understanding of data modelling principles.\nExperience with cloud platforms (Azure, AWS or GCP) and CI/CD practices.\nKnowledge of data governance, security and data quality practices, including access controls, lineage, cataloguing and monitoring frameworks.\nProficiency in Hindi, Gujarati, Marathi, Tamil or other Indian languages is desirable to support collaboration with local teams, partners and field-level stakeholders.\nWhat we offer\n- Hybrid working opportunity, with the office based in Delhi.\n- The opportunity to work from anywhere in the world for up to one month per year\n- Flexible working, with core hours from 10 am to 4 pm local time\n- Continuous learning and development\n- Pension scheme\n- A generous annual leave package, including paid holiday, public holidays, additional paid days off during the festive season, study and exam days, and extra discretionary leave for life events such as family weddings or moving home\n- Enhanced parental benefits\n- The opportunity to make your mark and make a difference.\nWorking arrangements\nThe position is full-time (40 hours per week) and will be based in Delhi or Ahmedabad, requiring travel between the two. Better Cotton Initiative offers flexible working, with core hours being 10 am - 4 pm Better Cotton Initiative offers flexible working, with core hours being 10 am - 4 pm. The position may require limited international travel.\nApply now\nSend us your CV (2 pages maximum) and a brief cover letter (1-page maximum) by or before 15.10.2026 via the application link.\nIn your cover letter, please include an explanation of why your experience is specifically relevant to this role at Better Cotton Initiative. We want to see your personal style - what makes you tick and why you think your next opportunity is here with us.\nBetter Cotton Initiative does not use artificial intelligence or in its hiring process. Every application is reviewed by our Talent Acquisition team and relevant hiring managers to ensure a fair and human-led assessment experience.\nOur hiring process\nInitial Screening:\nApplicant screening is a crucial step in our recruitment process. This stage may involve a brief phone interview or video call to evaluate your suitability for the position. During this screening, we review resumes and cover letters, and may conduct initial background checks to narrow down the pool of applicant. Internal candidates are encouraged to inform their line manager about their application to promote transparency and help facilitate a smooth transition if selected.\nInterviews:\nIf you successfully pass the initial screening, you will be invited for interviews. The interview process at Better Cotton Initiative may include one or more rounds of interviews with various stakeholders, such as the hiring manager, team members, and potentially senior management. As an internal candidate, you may have discussions regarding your current responsibilities and how they will transition to the new position.\nAssessment and Testing:\nDepending on the role, you might be required to complete assessments, technical tests, or skills evaluations to gauge your competency and suitability for the position. Internal candidates may have the option to demonstrate their existing skills through current job performance or past project outcomes.\nReference Checks:\nOnce you progress further in the process, reference checks are conducted to validate your work history, skills, and qualifications, and for some roles, your education and criminal history. Internal candidates may be asked for references from current or previous supervisors within Better Cotton Initiative to provide insights into their performance and capabilities.\nOffer stage:\nAfter completing interviews, assessments, and reference checks, the hiring team evaluates your performance and fit for the role. If you are selected and your references are relevant and satisfactory, you will receive a formal job offer letter outlining the terms of employment, compensation, benefits, and any other relevant details. For internal candidates, the offer process may include a discussion about how your transition to the new role will be managed and any support needed for a smooth handover.\nAbout Better CottonInitiative\nBetter Cotton Initiativeis a global not-for-profit organisation supporting the production of more equitable and sustainable cotton at farm level. We exist to catalyse the cotton farming community with partners, governments and others to continuously drive positive impact by setting standards and facilitating the supply and demand of more sustainable cotton from farm to brand. In just 15 years we have aligned more than a fifth of the world’s cotton with our standard and helped farmers and farming communities thrive. Join us in building a better, more sustainable future for cotton worldwide.\nAbout our Values\nThe post holder will be expected to operate in line with our workplace values which are:\nTrustworthy (including honest, transparent, credible) \nAs having Integrity (including responsible, authentic) \nPositive (including problem-solving, pragmatic) \nEngaging (including adaptable, inclusive, holistic) \nDaring (including courageous, innovative, game-changing) \nBeing you @ Better CottonInitiative\nBetter Cotton Initiative is committed to creating a diverse environment and is proud to be an equal opportunity employer with a strong commitment to good practice and transparency in the management of natural, human, and financial resources.\nWe have a zero-tolerance approach to any attitudes or behaviours that put children or adults at risk of harm. Safeguarding incidents are acts of serious misconduct and are grounds for disciplinary action, up to and including, dismissal and referral to relevant authorities for criminal prosecution. Therefore, all offers of employment are subject to satisfactory references and appropriate screening checks.","description_format":"text","description_chars":10444,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"Tamil","level":"Advanced (C1)","optional":true},{"language":"Marathi","level":"Advanced (C1)","optional":true},{"language":"Hindi","level":"Advanced (C1)","optional":true},{"language":"Gujarati","level":"Advanced (C1)","optional":true},{"language":"English","level":"All levels","optional":false}]},"benefits":["Annual leave","Continuous learning","Flexible schedule","Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Digital Goods","Textile Manufacturing","Nonprofits & Foundations"],"lifecycle":[{"event":"open","at":"2026-09-12T02:06:35Z"}],"visa":[],"liveness":{"score":39,"band":"fade","label":"Fading","p_open":1,"p_active":0.711,"p_room":0.55,"age_days":36,"expected_fill_days":36,"reasons":["conf:1","win:tail"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/bettercotton-data-engineer-architect-digital-products","json_url":"https://alion.io/job/bettercotton-data-engineer-architect-digital-products.json","meta":{"generated_at":"2026-10-14T06:52:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8207,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":670422},"rest":"https://alion.io/mcp/rest/get_company?id=670422"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbettercotton-data-engineer-architect-digital-products"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbettercotton-data-engineer-architect-digital-products"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbettercotton-data-engineer-architect-digital-products"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bettercotton-data-engineer-architect-digital-products\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbettercotton-data-engineer-architect-digital-products"}]}