{"id":3290582,"url":"https://alion.io/job/cogniify-databricks-architect-india","title":"Databricks Architect - India","company":{"id":4610,"name":"Cogniify","domain":"cogniify.ai","url":"https://alion.io/company/cogniify","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":[],"countries":[],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":116000,"max_usd":246000,"period":"year","method":"global_role_seniority_cell","sample_n":781},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Dagster","optional":false},{"name":"Data Vault","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"FinOps","optional":false},{"name":"Fivetran","optional":false},{"name":"GCP","optional":false},{"name":"GDPR","optional":false},{"name":"HIPAA","optional":false},{"name":"MLFlow","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"SOC 2","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"AI Agents","optional":true},{"name":"Apache Hudi","optional":true},{"name":"Flink","optional":true},{"name":"LLM","optional":true}],"status":"live","first_seen_at":"2026-10-07T16:45:51Z","employer_posted_date":null,"last_verified_at":"2026-10-07T16:45:51Z","board_verified":false,"closed_at":null,"days_open":22,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":22},"description":"Databricks Architect — Senior / SpecialistThe RoleWe're seeking a Databricks Architect (Senior/Specialist level) to serve as a senior technical authority for data architecture and analytics engineering on the Databricks Lakehouse platform across Cognify Analytics and our client engagements. In this role, you will design and own Databricks-based data platform architecture, lead complex data engineering initiatives, and ensure our data capabilities are enterprise-grade, governed, and future-ready. You will bridge data engineering, analytics, and AI/ML — combining deep hands-on expertise in Databricks, Python, and SQL with strong architectural judgment and stakeholder communication.\nMust-Have Skills (Non-Negotiable)\nDatabricks — hands-on architecture and engineering experience on the Databricks Lakehouse Platform (production-grade, at scale)\n\nPython — strong professional proficiency for data engineering and pipeline development\n\nSQL — advanced proficiency for data modeling, transformation, and performance tuning\n\nCandidates without demonstrable, hands-on experience in all three of the above will not be considered.\nWhat You'll Do\nOwn the architecture and design of Databricks-based data platforms, including lakehouse design (Delta Lake), medallion architecture, and unified analytics layers.\n\nServe as the senior technical authority on Databricks platform design, providing guidance on architecture, tooling, modeling, and engineering standards across teams and projects.\n\nDesign and build ingestion, transformation, and orchestration pipelines using Python, SQL, PySpark, and Databricks Workflows.\n\nArchitect data mesh and data product strategies, defining domain ownership, data contracts, and self-service consumption patterns on Databricks.\n\nEstablish and evangelize best practices across the data lifecycle: ingestion, transformation, modeling, quality, observability, governance, and consumption.\n\nDrive the integration of Databricks with AI/ML capabilities, including feature engineering pipelines, vector data infrastructure for RAG, and MLflow-based model workflows.\n\nLead complex data migration, platform modernization, and consolidation initiatives for enterprise clients across industries.\n\nEvaluate emerging data technologies (Apache Iceberg, Unity Catalog, Delta Live Tables, Mosaic AI) to inform architectural decisions.\n\nSolve complex, ambiguous, high-impact data architecture problems that span multiple teams, platforms, or organizational boundaries.\n\nDrive cross-functional alignment between data engineering, analytics, AI/ML, platform engineering, security, and product teams.\n\nMentor senior data engineers and analysts, fostering a culture of technical excellence.\n\nRepresent Cognify Analytics in discussions with client stakeholders and leadership on data capabilities, strategy, and technical roadmaps.\n\nDefine and enforce data governance, compliance (GDPR, HIPAA, SOC2), and responsible data management standards across all Databricks environments.\n\nDrive FinOps maturity for the Databricks platform, including compute optimization, cluster policies, storage lifecycle management, and cost forecasting.\n\nWhat We're Looking For\nBachelor's, Master's, or equivalent professional experience in Computer Science, Data Science, Statistics, or a related field.\n\n6–9 years of professional experience in data engineering, analytics engineering, or data architecture, with demonstrated technical leadership on at least a few large-scale engagements.\n\nMandatory, hands-on expertise in Databricks, Python, and SQL in production environments.\n\nStrong working knowledge of the modern data stack: dbt, Airflow/Dagster, Fivetran/Airbyte, Spark, Kafka, and cloud-native data services.\n\nSolid grasp of data modeling methodologies (Kimball, Data Vault, Activity Schema, OBT) and the judgment to apply them across contexts.\n\nExperience with cloud data infrastructure on AWS, Azure, or GCP (any combination is acceptable, alongside Databricks).\n\nProven ability to influence technical direction and align technical and business stakeholders on complex architecture topics.\n\nStrong understanding of data governance, data quality, cataloging, lineage, and regulatory compliance frameworks.\n\nExperience mentoring engineers and contributing to a high-performing data team.\n\nStrong understanding of how data platforms serve AI/ML workloads, including feature engineering, vector data, and model input/output pipelines.\n\nPreferred Qualifications\nExperience architecting Databricks-based platforms that directly serve LLM-based systems, RAG pipelines, and agentic AI architectures at enterprise scale.\n\nDeep familiarity with lakehouse table formats: Delta Lake, Apache Iceberg, and Apache Hudi.\n\nTrack record of implementing data mesh, data product, or federated data governance patterns.\n\nExperience with real-time analytics and streaming architectures: Kafka, Flink, Spark Structured Streaming.\n\nExperience with advanced Databricks features: Unity Catalog, Delta Live Tables, Databricks Workflows, MLflow, and Mosaic AI.\n\nContributions to open-source data projects, data architecture publications, or industry standards bodies.\n\nBackground in financial services, healthcare, SaaS, or enterprise consulting requiring high data compliance, security, and operational rigor.\n\nExperience leading data engineering across geographically distributed teams and multi-client engagements.\n\nWhy Join Cognify Analytics?\nJoin a team of industry veterans from Google, Meta, and top-tier tech companies.\n\nWork on impactful, high-scale data and analytics projects with leading global clients.\n\nEnjoy a flexible, remote-first culture focused on innovation and excellence.\n\nCompetitive salary, equity options, and continuous learning opportunities.\n\nShape the future of modern data platforms and AI-powered analytics at a rapidly growing company.\n\nWe are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.\nPerks and Benefits\nUnlimited PTO\n\nGenerous parental leave, above industry standards\n\nOpen communication with management and company leadership\n\nSmall, dynamic teams = massive impact\n\nMedical, Dental, and Vision coverage\n\nAccess to Disability & Life insurance\n\nMental health and wellbeing support\n\nAnnual bonus program\n\nEmployer Stock Purchase Program (ESPP)\n\nYearly team building experiences\n\nMentorship and sponsorship opportunities\n\nManager resources and support\n\nWe are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.\nOriginally posted on Himalayas","description_format":"text","description_chars":7076,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Equity","Life insurance","Parental leave","Unlimited PTO"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["MLOps","Custom Software Development","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-10-26T19:11:04Z"}],"visa":[],"liveness":{"score":66,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.857,"p_room":0.9,"age_days":21,"expected_fill_days":41,"reasons":["seen:21","velocity","win:mid"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/cogniify-databricks-architect-india","json_url":"https://alion.io/job/cogniify-databricks-architect-india.json","meta":{"generated_at":"2026-10-29T20:01:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29795,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4610},"rest":"https://alion.io/mcp/rest/get_company?id=4610"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcogniify-databricks-architect-india"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcogniify-databricks-architect-india"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcogniify-databricks-architect-india"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cogniify-databricks-architect-india\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcogniify-databricks-architect-india"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3290582}},{"tool":"search_jobs","arguments":{"company":"cogniify.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3290582},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}