{"id":37135,"url":"https://alion.io/job/baker-tilly-us-senior-data-engineer","title":"Senior Data Engineer","company":{"id":6269,"name":"Baker Tilly","domain":"bakertilly.com","url":"https://alion.io/company/baker-tilly-us","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":80,"open_postings":91,"ghost_share":0,"stale_share":0.813,"repost_share":0,"time_to_fill_p50_days":28,"computed_at":"2026-10-25T05:49:26Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":24000,"max_usd":48000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Embeddings","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Feature Store","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"MLFlow","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-08-03T00:00:00Z","employer_posted_date":"2026-08-03","last_verified_at":"2026-10-25T12:56:54Z","board_verified":true,"closed_at":null,"days_open":83,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":83},"description":"Overview\nBTVK Advisory is a leading advisory firm whose specialized professionals guide clients through an ever-changing business world, helping them win now and anticipate tomorrow. BTVK Advisory, and its affiliated entities, have operations in North America, South America, Europe, Asia, and Australia. BTVK Advisory’s ultimate parent entity, Baker Tilly US, LLP, is an independent member of Baker Tilly International, a worldwide network of independent accounting and business advisory firms in 141 territories, with 43,000 professionals and a combined worldwide revenue of $5.2 billion.\nBaker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, gender identity, sexual orientation, or any other legally protected basis, in accordance with applicable federal, state or local law.\nTo be added to all ET through Experienced requisitions Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group, LP, employee e-mail accounts are considered property of Baker Tilly Advisory Group, LP, and are not subject to payment of agency fees. In order to be an authorized recruitment agency (\"search firm\") for Baker Tilly Advisory Group, LP, there must be a formal written agreement in place and the agency must be invited, by Baker Tilly's Talent Attraction team, to submit candidates for review via our applicant tracking system.\nJob Description:\nResponsibilities:\nDesign, build, and maintain robust, scalable ETL/ELT pipelines on Azure Databricks to ingest, transform, and curate data across the medallion architecture - from raw/bronze landing through silver and gold to platinum/consumption-ready layers - ensuring reliability, performance, and timeliness.\nIngest structured, semi-structured, and unstructured data from a wide range of source systems using custom streaming pipelines (Spark Structured Streaming, Auto Loader), native and partner connectors (Lakeflow Connect, JDBC/CDC), Databricks Marketplace, and Delta Sharing, following proper governance.\nBuild and manage Unity Catalog assets (catalogs, schemas, tables, and Volumes) and configure or mount external locations/Volumes for governed access to cloud storage such as ADLS Gen2.\nDesign and implement audit, control, and operational-metadata tables that capture pipeline run history, data lineage, record counts, data-quality outcomes, and exception handling, enabling end-to-end observability, reconciliation, and auditability.\nDefine and apply data governance strategies across the lakehouse - including access control, data classification, PII handling, lineage, retention, and data-quality frameworks - leveraging Unity Catalog and aligned to enterprise standards.\nDevelop reusable, performant Delta Lake data models optimized for downstream AI/ML, analytics, and reporting consumption, applying techniques such as partitioning, Z-ordering / liquid clustering, and OPTIMIZE.\nPrepare and structure analytics- and AI-ready datasets with upstream AI/ML activities in mind - supporting feature engineering, feature stores, embeddings/vector data, and ML-ready data products for the organization’s AI initiatives.\nEnable cross-cloud data movement and sharing - migrating or sharing data from other cloud platforms (e.g., AWS, GCP) and cloud data warehouses into the Azure Databricks lakehouse, including via Delta Sharing.\nTroubleshoot and resolve data pipeline and data-quality issues to ensure consistent, dependable data delivery, and partner with BI, analytics, and business teams to deliver curated, analytics-ready datasets for Power BI and Tableau.\nOrchestrate and automate workflows using Databricks Workflows/Jobs and Lakeflow Declarative Pipelines (DLT), with CI/CD via Git and Databricks Asset Bundles; contribute to data engineering standards, documentation, code reviews, testing, and continuous improvement.\nDeliver projects using Agile or hybrid methodologies, manage tasks independently, provide accurate status updates, and proactively identify risks or dependencies.\nQualifications:\nBachelor’s degree required, preferably in Information Technology, Computer Science, Data Science, Analytics, or Statistics.\n5-8 years of hands-on experience in data engineering, data integration, or analytics engineering, including substantial time delivering on Databricks.\nDeep, hands-on experience with Azure Databricks and its critical components, including workspaces, clusters/SQL warehouses, Unity Catalog, and ADLS Gen2 integration.\nStrong proficiency in Spark/PySpark and SQL, including the ability to develop complex queries and perform advanced data transformations.\nProven experience building medallion-architecture pipelines (bronze → silver → gold → platinum) on Delta Lake.\nHands-on experience ingesting structured, semi-structured, and unstructured data via custom streams (Structured Streaming / Auto Loader), connectors, Databricks Marketplace, and Delta Sharing.\nPractical experience with Unity Catalog governance, including access control, lineage, data classification, and Volumes/external locations.\nExperience designing audit/control and operational-metadata tables and data-quality frameworks for pipeline observability and reconciliation.\nExperience migrating or sharing data across cloud platforms and modern data ecosystems (e.g., AWS, GCP, Snowflake, Redshift, BigQuery) into a Databricks lakehouse.\nFamiliarity with data orchestration (Databricks Workflows/Jobs, DLT) and CI/CD practices (Git, Databricks Asset Bundles) within data engineering environments.\nSolid understanding of data governance, data-quality frameworks, and metric standardization, with experience supporting AI, advanced analytics, or automation initiatives, coupled with strong analytical and problem-solving skills.\nPreferred / Bonus Qualifications:\nExperience handling tax, assurance, and financial data, including familiarity with the sensitivity, confidentiality, and regulatory considerations associated with such data.\nExposure to AI/ML enablement on Databricks (e.g., MLflow, feature stores, Mosaic AI, Vector Search) and an understanding of how curated data feeds these workloads.\nHands-on experience with Power BI and/or Tableau data modeling and semantic-layer design for downstream consumption.\nRelevant Databricks certification (e.g., Databricks Certified Data Engineer Professional).","description_format":"text","description_chars":6461,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Audit & Assurance Firms","Management Consulting","Accounting & Bookkeeping Services","Tax Advisory & Preparation"],"lifecycle":[{"event":"open","at":"2026-08-03T00:00:00Z"}],"visa":[],"liveness":{"score":10,"band":"cold","label":"Long shot","p_open":0.9,"p_active":0.403,"p_room":0.28,"age_days":83,"expected_fill_days":28,"reasons":["conf:73","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-25T05:49:26Z"},"pay":null,"html_url":"https://alion.io/job/baker-tilly-us-senior-data-engineer","json_url":"https://alion.io/job/baker-tilly-us-senior-data-engineer.json","meta":{"generated_at":"2026-10-25T20:08:40Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":28544,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-26T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6269},"rest":"https://alion.io/mcp/rest/get_company?id=6269"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbaker-tilly-us-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbaker-tilly-us-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbaker-tilly-us-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/baker-tilly-us-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbaker-tilly-us-senior-data-engineer"}]}