{"id":4161608,"url":"https://alion.io/job/tata-consultancy-services-databricks-architect","title":"Databricks Architect","company":{"id":222,"name":"Tata Consultancy Services","domain":"tcs.com","url":"https://alion.io/company/tata-consultancy-services","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"A","score":100,"open_postings":114,"ghost_share":0.018,"stale_share":0,"repost_share":0.254,"time_to_fill_p50_days":9,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Marlborough, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":110000,"max":140000,"currency":"USD","period":"year","gross":null,"usd_annual":140000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-12T12:14:17Z","employer_posted_date":null,"last_verified_at":"2026-11-12T12:14:17Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Tata Consultancy Services is hiring a Databricks Architect to build and optimize scalable data pipelines and governed data models for Customer 360 analytics. The role also establishes business semantics and enables conversational analytics through Databricks tools, while supporting data quality, security, and CI/CD practices.\n\nResponsibilities\nData Pipeline Development: Design, code, and deploy robust and scalable batch and streaming data pipelines using PySpark, Spark SQL, and Lakeflow (Lakeflow Connect for ingestion and Lakeflow Declarative Pipelines) to ingest data from sources such as Point-of-Sale (POS), e-commerce platforms, loyalty systems, and marketing clouds\nData Modeling & Transformation: Implement complex data transformations and business logic within the Medallion architecture (Bronze, Silver, Gold layers). Build and optimize the final \"Gold\" dimension tables that will serve as the single source of truth. Define governed business KPIs on top of the Gold layer using Unity Catalog Metric Views (business semantics) so metrics are computed once and reused consistently across BI, SQL, and Genie\nData Quality: Implement data quality frameworks and cleansing routines to ensure the accuracy and trustworthiness of the Customer 360 data\nPerformance Optimization: Proactively monitor, debug, and tune Databricks jobs and Spark clusters for performance and cost-efficiency. Implement best practices for partitioning, caching, and data layout in Delta Lake\nInfrastructure as Code (IaC) & CI/CD: Work with DevOps teams to manage Databricks environments, clusters, and job deployments using tools like Terraform and AWS DevOps/GitHub Actions. Champion and implement CI/CD best practices for data pipelines\nData Governance & Security: Implement data governance features within Databricks Unity Catalog, including data lineage tracking, fine-grained access controls (row/column-level security and ABAC policies), tags, and data masking to ensure compliance and security across BI and AI/agent workloads\nC ollaboration: Partner closely with Functional Consultants, Data Scientists, and Analytics Engineers to understand their data requirements and deliver well-structured, consumption-ready datasets\nSemantic Modeling & Business Semantics: Build and govern Unity Catalog Business Semantics, authoring Metric Views (measures, dimensions, joins, synonyms, materialization), Domains, Pages, and Glossary terms, and certifying trusted assets so every dashboard, SQL query, notebook, and AI agent works from the same governed definitions\nGenie & Agentic Analytics Enablement: Configure and curate AI/BI Genie Spaces and the Genie Ontology (instructions, trusted assets, example queries, synonyms) to deliver accurate natural-language, conversational analytics for business users, and enable consumption through AI/BI Dashboards and Databricks One\n\nSkills\n10+ years of hands-on data engineering experience, with at least 3 years focused on the Databricks/Spark\n• Ecosystem\nDeep, hands-on expertise with the Databricks Lakehouse Platform, including Delta Lake,\n• Structured Streaming, Lakeflow Declarative Pipelines (formerly Delta Live Tables), Databricks SQL, and cluster/serverless configuration and optimization\nHands-on experience with Unity Catalog Business Semantics, including Metric Views (measures, dimensions, materialization), Domains, and Pages/Glossary to define governed, reusable KPIs once and serve them consistently across SQL, BI, and AI agents\nExpert-level proficiency in Python and PySpark\nAdvanced SQL skills are essential\nStrong understanding of data modeling principles, including dimensional modeling\n• (Kimball), data warehousing concepts, and ETL/ELT design patterns\nProven experience working with a major cloud provider (Azure, AWS, or GCP), particularly with\n• data storage S3 and related services\nExperience with software engineering best practices, including version control (Git),\n• code reviews, testing, and CI/CD\nDatabricks\nWorking knowledge/exposure of AI/BI Genie (Genie Spaces, Genie Ontology, trusted assets), Genie Code for agentic pipeline/SQL development, Databricks One for business-user consumption, and Mosaic AI for building and serving AI/ML models and agents\n\nBenefits\nDiscretionary Annual Incentive.\nMedical & Health coverage\nDental & Vision coverage\nDisability Planning & Insurance\nPet Insurance Plans\nMaternal & Parental Leaves\nAuto & Home Insurance\nIdentity Theft Protection\nCommuter Benefits\nCertification & Training Reimbursement\nVacation\nTime Off\nSick Leave\nHolidays\nLegal Assistance\n401K Plan\nPerformance Bonus\nCollege Fund\nStudent Loan Refinancing\n\nCompany Overview\nTata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. It was founded in 1968, and is headquartered in Mumbai, Maharashtra, IND, with a workforce of 10001+ employees. Its website is http://www.tcs.com.\n\nCompany H1B Sponsorship\nTata Consultancy Services has a track record of offering H1B sponsorships, with 2916 in 2026, 7880 in 2025, 9690 in 2024, 8537 in 2023, 11159 in 2022, 9813 in 2021, 11984 in 2020. Please note that this does not guarantee sponsorship for this specific role.","description_format":"text","description_chars":5224,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Parental leave"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Systems Integrators","Management Consulting"],"lifecycle":[{"event":"open","at":"2026-11-12T12:20:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":9,"reasons":["seen:0","win:early","comp:brand"],"computed_at":"2026-11-12T13:45:39Z"},"pay":{"stated_usd_annual":140000,"is_top_pay":false},"html_url":"https://alion.io/job/tata-consultancy-services-databricks-architect","json_url":"https://alion.io/job/tata-consultancy-services-databricks-architect.json","meta":{"generated_at":"2026-11-12T13:45:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":28624,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":222},"rest":"https://alion.io/mcp/rest/get_company?id=222"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftata-consultancy-services-databricks-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftata-consultancy-services-databricks-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftata-consultancy-services-databricks-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tata-consultancy-services-databricks-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftata-consultancy-services-databricks-architect"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4161608}},{"tool":"search_jobs","arguments":{"company":"tcs.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4161608},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}