{"id":4654100,"url":"https://alion.io/job/ltm-associate-principal-data-engineering-20","title":"Associate Principal - Data Engineering","company":{"id":9353,"name":"LTM","domain":"ltm.com","url":"https://alion.io/company/ltm","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"RippleHire","truth_index":{"grade":"B","score":76,"open_postings":175,"ghost_share":0.006,"stale_share":0.943,"repost_share":0.006,"time_to_fill_p50_days":42,"computed_at":"2026-11-20T05:46:30Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sarasota, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":11,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"IAM","optional":false},{"name":"Jenkins","optional":false},{"name":"Microsoft Entra ID","optional":false},{"name":"MLFlow","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Shuffle","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-18T00:00:00Z","employer_posted_date":"2026-11-20","last_verified_at":"2026-11-20T02:56:18Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"Experience 11to15 years\nRoleTechnical Lead\nRole Summary\nWe are looking for an experienced Databricks Technical Lead with 11 to15 years of overall experience and strong expertise in designing and delivering enterprisescale data engineering solutions The candidate should have handson experience with Databricks Lakehouse architecture Delta Lake PySpark Unity Catalog and cloudnative data services with the ability to build secure scalable and productionready data platforms\nPrimary Skills\nDatabricks\nPySpark Spark\nDelta Lake and Lakehouse Architecture\nBronze Silver and Gold data architecture\nDatabricks Workflows\nUnity Catalog\nDatabricks Serverless Compute\nSQL and Data Modeling\nCloud Data Engineering preferably AzureAWS\nData Pipeline Development and Optimization\nData Quality Monitoring and Observability\nCICD and DevOps for Data Engineering\nKey Responsibilities\nDesign develop test deploy and support enterprisescale data products data pipelines and integration solutions using Databricks and cloudnative technologies\nBuild and maintain Bronze Silver and Gold data layers within a Lakehouse architecture using Delta Lake PySpark Databricks Workflows Unity Catalog and serverless compute\nDevelop scalable data transformation validation and enrichment pipelines supporting analytics reporting operational and AIML workloads\nImplement robust data quality monitoring reconciliation and observability controls to ensure trusted and reliable data products\nDesign and maintain enterprise data models business rules and reusable data engineering frameworks aligned with architectural standards\nWork closely with solutiondata architects product owners business stakeholders and engineering teams to translate requirements into scalable technical solutions\nConduct and participate in technical design reviews code reviews unitintegration testing and CICD processes\nTroubleshoot complex pipeline platform and performance issues and optimize Spark workloads for performance reliability and cost\nImplement data governance security lineage and rolebased access controls using Unity Catalog and cloudnative security capabilities\nAutomate deployment testing dataquality validation monitoring and operationalsupport activities\nCreate and maintain technical designs data mappings operational procedures engineering standards and support documentation\nMentor engineers and provide technical leadership around Databricks Spark data engineering and software engineering best practices\nContinuously evaluate newer Databricks and cloud capabilities to improve scalability automation performance and maintainability\nSecondary Skills\nCloud Microsoft Azure or AWS\nAzure ADLS Gen2 Azure Data Factory Key Vault Entra ID\nAWS S3 IAM Glue and related data services\nProgramming Python SQL\nDevOps Azure DevOps GitHub Actions Jenkins\nInfrastructure as Code Terraform\nData Modeling Dimensional modeling StarSnowflake schemas\nStreaming Apache Kafka Spark Structured Streaming\nOrchestration Databricks Workflows ADF or Airflow\nData Governance Data lineage RBAC data classification and metadata management\nEngineering Git automated testing CICD and AgileScrum\nExposure to MLflow Databricks SQL and AIML workloads would be advantageous\nQualifying Questions\n1 Databricks Architecture\nHave you designed and implemented an enterprise Databricks Lakehouse solution using Bronze Silver and Gold layers Please briefly explain how you used Delta Lake PySpark and Unity Catalog in the solution\nQualify if Candidate demonstrates handson ownership of Medallion architecture Delta tables transformation pipelines and Unity Catalog rather than only theoretical knowledge\n2 Performance Production Troubleshooting\nDescribe a production DatabricksSpark pipeline performance issue you resolved What was the root cause and what specific optimization techniques did you use\nQualify if Candidate can discuss practical techniques such as partitioning shuffle optimization skew handling Spark execution plans join strategies caching file sizingcompaction Photon or clusterserverless optimization\n3 Governance CICD\nHow have you implemented enterprise data governance and automated deployment in Databricks using Unity Catalog and CICD\nQualify if Candidate demonstrates experience with catalogsschemas RBAC or privileges lineage service principalsmanaged identities environment promotion Gitbased version control and automated deployment","description_format":"text","description_chars":4378,"description_truncated":false,"requirements":{"experience_years_min":11,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Enterprise Apps Implementation Partners"],"lifecycle":[{"event":"open","at":"2026-11-20T02:56:18Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 565","filings_12m":565,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":112500,"route":null,"cap_exempt":false,"checked_at":"2026-11-19T07:44:56+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":54}],"liveness":{"score":38,"band":"fade","label":"Fading","p_open":1,"p_active":0.379,"p_room":1,"age_days":2,"expected_fill_days":42,"reasons":["conf:2","stale_co","evergreen","velocity","win:early","comp:brand"],"computed_at":"2026-11-20T05:46:30Z"},"pay":null,"html_url":"https://alion.io/job/ltm-associate-principal-data-engineering-20","json_url":"https://alion.io/job/ltm-associate-principal-data-engineering-20.json","meta":{"generated_at":"2026-11-20T06:21:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4026,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9353},"rest":"https://alion.io/mcp/rest/get_company?id=9353"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fltm-associate-principal-data-engineering-20"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fltm-associate-principal-data-engineering-20"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fltm-associate-principal-data-engineering-20"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ltm-associate-principal-data-engineering-20\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fltm-associate-principal-data-engineering-20"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4654100}},{"tool":"search_jobs","arguments":{"company":"ltm.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4654100},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}