{"id":3879976,"url":"https://alion.io/job/coastal-data-platform-architect-databricks","title":"Data Platform Architect (Databricks)","company":{"id":1793257,"name":"Coastal","domain":"coastalcloud.us","url":"https://alion.io/company/coastalcloud","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Paycor","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Indianapolis, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Master Data Management","optional":false},{"name":"pySpark","optional":false},{"name":"Rest API","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-11-06T17:45:49Z","employer_posted_date":"2026-11-06","last_verified_at":"2026-11-07T07:29:18Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Data Platform Architect\nRole Overview\nWe are seeking an experienced, hands-on Data Platform Architect & Integration Lead to design, build, and deliver integrations that consume Master Data products published in Databricks and feed them into an enterprise commercial CRM platform, as part of a large-scale CRM modernization program.\nMaster Data sources (customer, account, and product master) are exposed as governed data products in Databricks - curated Delta tables registered in Unity Catalog. This role owns the consumption of those data products and their reliable, validated delivery into the target CRM and enterprise ecosystem, while re-platforming existing integrations onto modern, cloud-native patterns.\nThis is a working, hands-on leadership role. The person leads the integration workstream and personally performs the coding, code review, and deployment work - not oversight alone. Every skill listed is expected to be backed by direct, hands-on delivery experience.\nKey Responsibilities\nHands-On Integration DeliveryPersonally perform coding, code review, and deployment activities, and any other assigned work related to this transformation - leading the team does not replace individual hands-on contribution.\nMust have hands-on experience across all required skills; the person is expected to build, not only direct others who build.\nOwn the end-to-end integration lifecycle: design specification, build, unit testing, deployment across dev / sandbox / UAT / prod, runbooks, and knowledge transfer.\nProduce design specifications, deployment steps, and rollback approaches, and deliver them hands-on.\n\nDatabricks Data-Product Consumption & IntegrationConsume Databricks data products (Delta Lake tables via Unity Catalog) as the source of master data, respecting the data-product contract - schema, refresh cadence, quality guarantees, and access model.\nMove master data from Databricks into the CRM using the appropriate pattern - Apache Iceberg interoperability, Spark / PySpark-based movement, or API-based delivery - selecting the right mechanism per integration by volume, latency, and directionality.\nBuild transformation and mapping logic (PySpark / Spark SQL) to reconcile the data-product schema with the target CRM data model, including handling master-data change (deltas, data-change requests, reference data).\nRe-platform existing master-data integrations onto the Databricks-data-product and modern integration patterns, ensuring parity, reconciliation, and no data loss during transition.\nImplement observability, data-quality checks, error handling, data-gap detection, and reprocessing across the Databricks-to-CRM flows.\n\nClient Engagement & MeetingsParticipate in and lead all relevant client meetings - design reviews, working sessions, governance forums, and status discussions - representing the integration workstream directly with the client.\nCommunicate technical decisions, risks, and dependencies clearly to client stakeholders and delivery teams.\n\nMulti-Vendor (Dual-SI) CollaborationCollaborate with the second System Integrator (SI) partner responsible for independently testing and validating this team’s build.\nReview the second SI’s test findings, triage them, and resolve the defects - ensuring fast, clean cross-vendor root-cause and closure rather than back-and-forth.\nMaintain clean build-to-test handoffs and shared traceability so defects are resolved efficiently across vendors.\n\nOn-Site Presence & TravelMust be present in person in Indianapolis.\nIf not working from Indianapolis, must travel for all important meetings as required by the program.\n\nPatterns, Standards & Data PartnershipDefine reusable integration patterns and interface contracts for master-data flows that other build and assurance teams can work to.\nPartner with data-product owners and data-engineering teams to align on data-product schemas, versioning, refresh frequency, access, and change management.\nEnsure data integrity, security, privacy, and, where applicable, regulated-industry compliance across connected systems.\n\nMust-Have Technical Skills\nAll of the following require direct, hands-on experience:\nDatabricks - hands-on with Delta Lake, Unity Catalog, and consuming / publishing data products; lakehouse / medallion architecture.\nAI - hands-on experience applying AI in a data, integration, or software-development context.\nData services on AWS - hands-on experience building data and transformation services / pipelines on AWS.\nAPI - hands-on REST API design, build, and implementation at scale.\nPySpark - strong, hands-on PySpark and Spark SQL for data movement and transformation.\nMaster Data / MDM - hands-on experience integrating customer, account, and product master data into downstream systems, including schema mapping, reconciliation, and master-data change handling.\nDemonstrated ability to lead a build team while remaining hands-on - doing the build, review, and deployment work directly.\nWhy Coastal, and what we offer:\nFlexible working hours with an emphasis on a life-work balance (in that order!)\nRemote flexible work; “Live by the beach, work in the Cloud,” plus company office locations in Palm Coast, FL; Atlanta, GA; Tysons, VA & Lexington, KY; travel as required to client locations \nUnlimited Paid Time Off (RTO), 401K with Company Match, and Medical, Vision, & Dental coverage \nCompetitive quarterly bonus opportunities\nContinuing education and certification reimbursements, specifically within the Salesforce and Snowflake ecosystems; plus occasional in-house competitions with spot bonuses\nA flexible and fun team culture! We value transparency, support, flexibility, growth, teamwork, fun, and so much more\nFrequent team and culture activities, virtual & in-person, including Lunch and Learns, Happy Hours, team-building events\nMonthly All-Hands calls to bring the company together, and an open-door leadership policy with access to mentorship and guidance\nOpportunities for accelerated growth, networking, and career guidance and support\nTrust, transparency and respect across all levels of the company\nCoastal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.\nThis policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.","description_format":"text","description_chars":6669,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":["401k plan","Certification reimbursement","Flexible schedule"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"},{"name":"Kentucky","iso":null,"kind":"city"},{"name":"Florida","iso":null,"kind":"city"},{"name":"Virginia","iso":null,"kind":"city"},{"name":"Georgia","iso":null,"kind":"city"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Information Technology","Enterprise Apps Implementation Partners"],"lifecycle":[{"event":"open","at":"2026-11-06T17:45:49Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":40,"reasons":["conf:2","win:early"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/coastal-data-platform-architect-databricks","json_url":"https://alion.io/job/coastal-data-platform-architect-databricks.json","meta":{"generated_at":"2026-11-07T09:01:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6388,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1793257},"rest":"https://alion.io/mcp/rest/get_company?id=1793257"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcoastal-data-platform-architect-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcoastal-data-platform-architect-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcoastal-data-platform-architect-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/coastal-data-platform-architect-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcoastal-data-platform-architect-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3879976}},{"tool":"search_jobs","arguments":{"company":"coastalcloud.us","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3879976},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}