{"id":4586532,"url":"https://alion.io/job/crg-databricks-data-engineer","title":"Databricks Data Engineer","company":{"id":4535437,"name":"CRG","domain":"getcrg.com","url":"https://alion.io/company/crg-2","size_band":"5000+","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":{"label":"EST","utc_offset_min":-5,"utc_offset_max":-5},"hiring_geo_confidence":"structured","locations":["Salisbury, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":65,"max":68,"currency":"USD","period":"hour","gross":null,"usd_annual":136000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GitHub","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-19T07:08:49Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-19T07:08:49Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Databricks Data Engineer100% Remote - EST Hours\n12 Month Contract\n$65-$68/hour W2 (No C2C or Sponsorship available)\nWe are seeking a highly skilled Databricks Data Engineer to support the Retail Spine initiative, working with a wide range of retail datasets to design, build, and optimize scalable data solutions. This role requires deep hands-on expertise in Databricks and the ability to contribute immediately by developing new pipelines while enhancing existing data workflows. The ideal candidate brings extensive experience building end-to-end data engineering pipelines with CDC (Change Data Capture) capabilities and thrives in a fast-paced Azure-based environment leveraging Databricks, PySpark, and Kafka streaming.\nKey Responsibilities\nDesign, build, and optimize end-to-end ETL/ELT pipelines using Databricks and Apache Spark (PySpark).Develop and maintain scalable data solutions on Microsoft Azure, leveraging Databricks, Delta Lake, and Kafka streaming.Build robust pipelines with Change Data Capture (CDC) to support incremental data processing and real-time/near real-time data needs.Work across both new pipeline development and enhancement of existing pipelines, quickly understanding current codebases to deliver improvements.Integrate and process data from diverse sources including:Flat files, XML, JSON, SQL Server and JDBC systems, Kafka topics, APIs, MQ, Unity Catalog volumes and other enterprise platforms.Implement data quality frameworks, including writing technical data quality rules and quarantining error records.Apply canonical data modeling techniques, including SCD Type 1 and Type 2 implementations.Ensure high levels of data reliability, performance, scalability, and monitoring across all workflows.Automate workflows using Databricks Workflows and CI/CD pipelines (GitHub), focusing on reuse, efficiency, and standardization.Collaborate with developers, architects, and product owners, and engage with stakeholders, source teams, and downstream consumers as needed.Participate actively in Agile/Scrum ceremonies and deliver high-quality solutions within defined timelines.Required Qualifications\nExtensive hands-on experience with Databricks, with ability to contribute from day one.Proven experience building end-to-end data engineering pipelines with CDC capabilities.Strong proficiency in PySpark and SQL (required); Python experience is a plus.Experience working in Microsoft Azure cloud environments.Knowledge of:\nDelta LakeDistributed data processing frameworksStreaming technologies (Kafka)Data modeling (SCD Type 1 & Type 2)Experience integrating data from multiple structured and unstructured data sources.Familiarity with GitHub and CI/CD pipelines for version control and deployment.Strong understanding of data architecture, performance optimization, and pipeline scalability.Category Code: JN008\nSeniority Level: Mid-Senior Level","description_format":"text","description_chars":2882,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-19T07:08:49Z"}],"visa":[],"liveness":{"score":52,"band":"ok","label":"Likely open","p_open":1,"p_active":0.516,"p_room":1,"age_days":0,"expected_fill_days":25,"reasons":["conf:0","agency","win:early"],"computed_at":"2026-11-19T07:50:30Z"},"pay":{"stated_usd_annual":136000,"is_top_pay":false},"html_url":"https://alion.io/job/crg-databricks-data-engineer","json_url":"https://alion.io/job/crg-databricks-data-engineer.json","meta":{"generated_at":"2026-11-19T07:50:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13393,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4535437},"rest":"https://alion.io/mcp/rest/get_company?id=4535437"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcrg-databricks-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcrg-databricks-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcrg-databricks-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/crg-databricks-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcrg-databricks-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4586532}},{"tool":"search_jobs","arguments":{"company":"getcrg.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4586532},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}