{"id":4052039,"url":"https://alion.io/job/techstra-solutions-mid-level-databricks-engineer-techstra-solutions","title":"Mid-Level Databricks Engineer - Techstra Solutions","company":{"id":4431605,"name":"Techstra Solutions","domain":"techstrasolutions.com","url":"https://alion.io/company/techstra-solutions","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pittsburgh, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure Data Factory","optional":true},{"name":"Azure DevOps","optional":true},{"name":"Machine Learning","optional":true},{"name":"Power BI","optional":true},{"name":"Rest API","optional":true}],"status":"live","first_seen_at":"2026-11-11T02:14:03Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T02:14:03Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"We are seeking a Mid-Level Databricks Engineer to design, develop, and support scalable data solutions using Databricks and modern cloud data platforms. This role will focus on building reliable data pipelines, implementing lakehouse architectures, improving data quality, and supporting analytics and AI use cases.\nThe ideal candidate has strong hands-on experience with Databricks, SQL, Python/PySpark, Delta Lake, and cloud data services and can work independently within established architectural and data governance standards.\nKey Responsibilities\nDesign, build, test, and maintain data pipelines using Databricks, PySpark, Python, and SQL.\nDevelop ingestion and transformation processes across Bronze, Silver, and Gold layers using Medallion Architecture principles.\nBuild and optimize Delta Lake tables, including data partitioning, schema management, and performance tuning.\nDevelop batch and streaming pipelines using Databricks capabilities such as Auto Loader, Structured Streaming, Workflows, and Delta Live Tables/Lakeflow Declarative Pipelines, where appropriate.\nIntegrate structured and semi-structured data from databases, APIs, files, cloud storage, and enterprise applications.\nImplement data quality validation, reconciliation, exception handling, monitoring, and logging.\nWork with Unity Catalog to support data governance, access controls, metadata management, lineage, and data discovery.\nDevelop reusable frameworks and components for ingestion, transformation, and data validation.\nTroubleshoot pipeline failures and performance issues and implement sustainable fixes.\nParticipate in code reviews and follow established development, testing, security, and deployment standards.\nSupport CI/CD practices for Databricks development and collaborate with DevOps teams on automated deployments.\nWork closely with data architects, analysts, data scientists, governance teams, and business stakeholders.\nCreate and maintain technical documentation, data mappings, pipeline specifications, and operational support documentation.\nRequired Qualifications\n8-10 years of experience in data engineering, ETL/ELT development, or related data platform development.\n5+ years of hands-on Databricks experience preferred.\nStrong proficiency with:Python / PySpark\nSQL\nApache Spark\nDelta Lake\nDatabricks notebooks, jobs/workflows, and compute\n\nExperience developing scalable ETL/ELT pipelines and working with large datasets.\nUnderstanding of lakehouse, data warehouse, and Medallion Architecture concepts.\nExperience with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud.\nExperience working with Git-based source control and CI/CD processes.\nUnderstanding of data quality, metadata, lineage, security, and data governance concepts.\nStrong troubleshooting, analytical, and problem-solving skills.\nAbility to work effectively in an Agile delivery environment.\nPreferred Qualifications\nExperience with Databricks Unity Catalog.\nExperience with Azure Data Lake Storage, Azure Data Factory, Azure DevOps, or comparable AWS/GCP services.\nExperience with Databricks Asset Bundles and infrastructure/deployment automation.\nFamiliarity with REST APIs, JSON, Parquet, Avro, and other common data formats.\nExposure to Power BI\nExperience supporting data science, machine learning, or GenAI workloads is a plus.\nDatabricks certification such as Databricks Certified Data Engineer Associate is a plus.\nWhat We're Looking For\nA successful candidate should be able to take a defined data requirement or technical design and independently turn it into a production-ready Databricks solution. They should be comfortable troubleshooting problems, collaborating with senior engineers and architects, and helping less-experienced developers follow good engineering practices.\nLeveling distinction: This is not primarily an architecture role. The emphasis is on hands-on engineering, independent delivery, code quality, data reliability, and Level 2 production support.","description_format":"text","description_chars":3977,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-11T02:14:03Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 8 · green card filings: 1","filings_12m":8,"filings_prev_12m":3,"green_card_filings_12m":1,"median_offered_wage_usd":132500,"route":null,"cap_exempt":false,"checked_at":"2026-11-10T11:34:35+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":4}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","win:early"],"computed_at":"2026-11-11T03:42:50Z"},"pay":null,"html_url":"https://alion.io/job/techstra-solutions-mid-level-databricks-engineer-techstra-solutions","json_url":"https://alion.io/job/techstra-solutions-mid-level-databricks-engineer-techstra-solutions.json","meta":{"generated_at":"2026-11-11T03:42:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3262,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4431605},"rest":"https://alion.io/mcp/rest/get_company?id=4431605"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftechstra-solutions-mid-level-databricks-engineer-techstra-solutions"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftechstra-solutions-mid-level-databricks-engineer-techstra-solutions"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftechstra-solutions-mid-level-databricks-engineer-techstra-solutions"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/techstra-solutions-mid-level-databricks-engineer-techstra-solutions\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftechstra-solutions-mid-level-databricks-engineer-techstra-solutions"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4052039}},{"tool":"search_jobs","arguments":{"company":"techstrasolutions.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4052039},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}