{"id":1245274,"url":"https://alion.io/job/csci-consulting-databricks-sme","title":"Databricks SME","company":{"id":673601,"name":"csci consulting","domain":"csciconsulting.com","url":"https://alion.io/company/csciconsulting","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Indianapolis, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":111000,"max_usd":214000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":604},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Machine Learning","optional":false},{"name":"Master Data Management","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure DevOps","optional":true},{"name":"Bicep","optional":true},{"name":"GitHub","optional":true},{"name":"GitLab","optional":true},{"name":"Jenkins","optional":true},{"name":"Kubernetes","optional":true},{"name":"MLFlow","optional":true},{"name":"Power BI","optional":true},{"name":"ServiceNow","optional":true},{"name":"Tableau","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-09-25T15:09:00Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-09-25T23:19:40Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Description\nCSCI Consulting is looking for a Databricks Subject Matter Expert (SME) to support our Department of War client. In this role, the consultant will serve as the technical lead for Databricks-based data modernization initiatives, providing architecture, engineering, governance, analytics, and cloud data platform expertise to support mission-critical data, reporting, AI/ML, and decision-support capabilities.\nResponsibilities\nServe as the primary Databricks SME supporting enterprise data and analytics initiatives\nDesign, develop, and optimize scalable data platforms using the Databricks Lakehouse architecture\nLead the implementation of data engineering, data integration, and data transformation solutions using Databricks and Apache Spark\nDesign and implement Medallion Architecture frameworks, including bronze, silver, and gold data layers\nDevelop and maintain ETL/ELT pipelines for structured and unstructured data sources\nConfigure and optimize Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables\nSupport cloud-native data solutions within Azure, AWS, or multi-cloud environments\nCollaborate with business stakeholders, architects, developers, and data teams to translate requirements into scalable solutions\nSupport data governance, metadata management, data quality, and master data management initiatives\nOptimize platform performance, scalability, availability, and cost efficiency\nDevelop technical documentation, architecture diagrams, data-flow diagrams, and operational procedures\nSupport enterprise analytics, business intelligence, artificial intelligence, and machine learning initiatives\nImplement and support DevSecOps, CI/CD, and Infrastructure-as-Code practices\nIntegrate Databricks solutions with enterprise applications, APIs, databases, and cloud services\nSupport cybersecurity, compliance, audit, and data protection requirements\nProvide technical mentorship and guidance to engineers, analysts, and project teams\nParticipate in Agile ceremonies, technical reviews, solution demonstrations, and program planning activities\nMinimum Requirements\n7+ years of experience supporting enterprise data engineering, analytics, or data platform initiatives\n5+ years of hands-on experience with Databricks and Apache Spark\nExperience designing and implementing enterprise data lake, data warehouse, or Lakehouse architecture\nStrong expertise with Databricks Lakehouse Platform and Delta Lake\nAdvanced proficiency with SQL, Python, PySpark, and distributed data processing\nExperience building and maintaining ETL/ELT pipelines and data integration solutions\nExperience supporting Azure, AWS, or other cloud-based data platforms\nKnowledge of data governance, data quality, metadata management, and data security best practices\nExperience troubleshooting performance, scalability, and reliability issues in large-scale data environments\nExperience developing technical documentation and communicating complex technical concepts to both technical and non-technical audiences\nAbility to obtain and maintain the security clearance required by the program\nU.S. Citizenship required where mandated by the applicable government contract\nAble to obtain security clearance\nCreativity and adaptability in problem-solving\nAbility to work with clients to understand their needs\nStrong organizational and time-management skills\nExcellent written and verbal communication skills\nProfessional presence\nPreferred Skills\nDatabricks Certified Data Engineer Associate, Professional Data Engineer, or related Databricks certification\nExperience supporting Department of War, DoD, Intelligence Community, or Federal data modernization programs\nExperience with Unity Catalog, Delta Live Tables, MLflow, Databricks Workflows, and Databricks Asset Bundles\nExperience implementing modern data architecture including Data Mesh, Data Fabric, and Lakehouse strategies\nExperience supporting Artificial Intelligence (AI), Machine Learning (ML), and Generative AI initiatives\nExperience integrating Databricks with SAP, Salesforce, ServiceNow, Oracle, or other enterprise platforms\nExperience with Power BI, Tableau, Qlik, or other enterprise reporting and visualization platforms\nExperience implementing DevSecOps, CI/CD pipelines, and Infrastructure-as-Code frameworks\nExperience using Azure DevOps, GitHub, GitLab, Jenkins, or other enterprise development platforms\nKnowledge of Kubernetes, containerization technologies, and cloud-native architecture\nExperience with Terraform, Bicep, or other infrastructure automation tools\nExperience supporting data governance and compliance requirements within regulated environments\nExperience working within Agile or SAFe delivery frameworks\nAbility to work in a team environment, as well as independently\nStrong customer and vendor relationship skills\nDemonstrated ability to comply with data standards and policies\nMotivation to learn new technologies and methodologies that demonstrate value\nPast experience working with a Federal government agency\nDepartment of War, etc. experience is a plus!\nAbout CSCI\nCSCI is an award-winning information technology and financial management consulting firm founded on one simple philosophy: “Do what is right, always.” We apply this philosophy across all elements of our growing business, from delivering world-class services for customers to providing an environment where associates thrive both personally and professionally. At CSCI, work and fun aren’t diametrically opposed!\nAt CSCI, our goal is to hire people with proven track records and retain them with an energizing, diverse company culture. We value each associate’s natural drive to excel, and we provide them with the freedom to do things their way. CSCI seeks the best and brightest in the industry-those who are ready to move their lives and career forward. Join us today and get excited about Mondays again!\nBenefits of Working at CSCI\nCompetitive salaries\nGenerous Paid Time Off (PTO) package\nPaid holidays aligned to the Federal calendar\nFull health benefits including medical, dental, vision, and life insurance \n401(k) retirement plan\nTeam building events\nProfessional development support \nLegal\nCSCI complies with all applicable Federal, state, and local employment regulations. Please reach out to  with any questions. \nEqual Employment Opportunity\nAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or veteran status, or any other applicable state or federal protected class. CSCI provides affirmative action in employment for qualified Individuals with a Disability and Protected Veterans in compliance with Section 503 of the Rehabilitation Act and the Vietnam Era Veterans’ Readjustment Assistance Act.\nIf you require an accommodation, please contact CSCI Human Resources for further assistance. For questions regarding the qualifications listed above, please contact the CSCI Recruiting Team.\nE-Verify\nCSCI participates in E-Verify to confirm the employment eligibility of all newly hired employees. For more information, please visit www.dhs.gov/E-Verify. \nCalifornia Consumer Privacy Act (CCPA) Notice\nAs part of the application and recruitment process, CSCI Consulting, Inc. may collect personal information as described under the California Consumer Privacy Act (CCPA). \nThis information is collected solely for employment-related purposes, including evaluating your qualifications, processing your application, and complying with legal obligations. \nBy applying to this position, you acknowledge that you have read and understand the following notice regarding the collection of your personal information as a job applicant: \nCategories of Information Collected: Personal identifiers, employment history, educational information, and any other information provided in your application or as part of the interview process.\nPurposes for Collecting Information: To review your application, assess your qualifications, and manage the hiring process.\nRetention and Security: Information collected will be retained indefinitely and will be securely stored and handled in accordance with CCPA guidelines and CSCI Consulting, Inc. policies.\nRights of Applicants: Under CCPA, California residents have the right to request information about the personal data we collect, delete it, and request restrictions on certain uses. However, some information may be retained as required by law. \nFor further information, or to exercise your rights under the CCPA, please contact CSCI’s HR team. \nDisclaimer\nThe above declarations are not intended to be an all-inclusive list of the duties and responsibilities of the job described, nor are they intended to be such a listing of the skills and abilities required to do the job. Rather, they are intended only to describe the general nature of the job.","description_format":"text","description_chars":8922,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Life insurance","Professional development","Retirement plans"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-09-25T17:19:38Z"}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":47,"reasons":["conf:4","win:early"],"computed_at":"2026-09-26T03:31:19Z"},"pay":null,"html_url":"https://alion.io/job/csci-consulting-databricks-sme","json_url":"https://alion.io/job/csci-consulting-databricks-sme.json","meta":{"generated_at":"2026-09-26T03:31:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":3754,"day_limit":5000,"remaining_today":1246,"minute_limit":60,"resets_at":"2026-09-27T00:00:00Z"}}}