{"id":3910168,"url":"https://alion.io/job/sharp-decisions-senior-databricks-engineer","title":"Senior Databricks Engineer","company":{"id":4478732,"name":"Sharp Decisions","domain":"sharpdecisions.com","url":"https://alion.io/company/sharp-decisions","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Jersey City, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Active Directory","optional":false},{"name":"Azure","optional":false},{"name":"Crowdstrike","optional":false},{"name":"Databricks","optional":false},{"name":"GDPR","optional":false},{"name":"Git","optional":false},{"name":"Jenkins","optional":false},{"name":"Microsoft Sentinel","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"ServiceNow","optional":false},{"name":"SharePoint","optional":false},{"name":"SIEM","optional":false},{"name":"SQL","optional":false},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-07T05:59:07Z","employer_posted_date":null,"last_verified_at":"2026-11-07T05:59:07Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Sharp Decisions is seeking a Senior Databricks Engineer to support a cybersecurity data initiative and build a security and risk data platform for Information Security. The role focuses on designing, developing, testing, and deploying cloud data solutions, developing cybersecurity data feeds, establishing data governance, and collaborating with technical and business stakeholders.\n\nResponsibilities\nDesign, develop, test, and support cloud data solutions focusing on data ingestion, data quality, tuning, and performance of upstream cybersecurity data sources using Databricks\nProvide indirect leadership and mentorship to junior team members; lead data feed development efforts and design initiatives\nParticipate in development meetings to align priorities and objectives, assign tasks, and share experiences across applications under development\nConsult with technology and development teams to coordinate integration of applications within the broader software ecosystem\nCapture and document metadata for Key Data Elements (KDEs) to ensure accuracy and completeness for Data Quality (DQ) rules and daily dataset processing\nWork with the data architecture team to align KDEs to logical data models, develop physical data structures, and document physical data names, definitions, and types\nPartner with data owners and stakeholders to create technical requirements and DQ rules around data elements needed in the data warehouse\nPartner with Business Management and Data Owners to identify critical metrics and data fields required for metric dashboards\nEstablish views to encapsulate data for downstream consumption and ensure alignment with DQ rules established on metadata\nUtilize IBM TWS production job scheduling and adhere to standards around daily scheduling and batch monitoring of production jobs\nIdentify and resolve data quality issues including inaccuracies and incomplete information; implement improved procedures and processes\n\nSkills\n8+ Years Experience\nAzure Databricks, Python, PySpark, SQL\nAzure Databricks & Unity Catalog\nAzure Data Factory\nAzure Data Lake Storage\nAzure Functions\nAzure Event Grid\nAzure Log Analytics & Monitor\nPython / Java\nSQL Server, Oracle / PL-SQL, T-SQL\nETL / ELT\nREST API & Microservices\nCI/CD — Git, Jenkins, Azure DevOps\nCollibra DQIM/DQE, IBM Infosphere DA\n* Strong knowledge of enterprise Information Security data domains: Phishing, Identity Management, Privileged Access, Cloud Security, Incident Response, Vulnerability Management, and Threat Detection\n* Data knowledge of PaaS/SaaS products including ServiceNow, CrowdStrike, MS Purview, Proofpoint, WIZ.IO, JIRA, SharePoint, and Azure Active Directory\n* Understanding of information security frameworks (NIST, CIS, CRI Profile) and regulatory compliance (NYSDFS, GDPR, CCPA)\n* Financial services or similarly regulated environment experience strongly preferred\n* Knowledge of Microsoft Sentinel for SIEM\n* Knowledge of IBM Tivoli Workload Scheduler\n* Exposure to Power BI for data visualization and reporting\n\nBenefits\nHybrid work arrangement: 3 days onsite\nContract to Hire\nW2 employment only\n\nCompany Overview\nSharp Decisions is a staffing and recruiting company that offers technology and business staffing solutions. It was founded in 1990, and is headquartered in New York, New York, USA, with a workforce of 201-500 employees. Its website is http://sharpdecisions.com.\n\nCompany H1B Sponsorship\nSharp Decisions has a track record of offering H1B sponsorships, with 27 in 2026, 6 in 2025, 13 in 2024, 2 in 2023, 10 in 2022, 7 in 2021, 10 in 2020. Please note that this does not guarantee sponsorship for this specific role.","description_format":"text","description_chars":3634,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Security","IT Consulting & Digital Transformation","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-07T06:24:45Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 29 · green card filings: 1","filings_12m":29,"filings_prev_12m":4,"green_card_filings_12m":1,"median_offered_wage_usd":137667,"route":null,"cap_exempt":false,"checked_at":"2026-11-06T22:30:08+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":8}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["seen:0","win:early"],"computed_at":"2026-11-07T06:49:24Z"},"pay":null,"html_url":"https://alion.io/job/sharp-decisions-senior-databricks-engineer","json_url":"https://alion.io/job/sharp-decisions-senior-databricks-engineer.json","meta":{"generated_at":"2026-11-07T06:49:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1107,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4478732},"rest":"https://alion.io/mcp/rest/get_company?id=4478732"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsharp-decisions-senior-databricks-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsharp-decisions-senior-databricks-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsharp-decisions-senior-databricks-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sharp-decisions-senior-databricks-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsharp-decisions-senior-databricks-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3910168}},{"tool":"search_jobs","arguments":{"company":"sharpdecisions.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3910168},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}