{"id":4052862,"url":"https://alion.io/job/better-debt-solutions-data-engineer","title":"Data Engineer","company":{"id":671250,"name":"Better Debt Solutions","domain":"betterdebtsolutions.com","url":"https://alion.io/company/betterdebtsolutions","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Irvine, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":140000,"max":155000,"currency":"USD","period":"year","gross":null,"usd_annual":155000},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"MariaDB","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"GCP","optional":true},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-11-11T02:20:36Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T02:48:38Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Better Companies is a multi-brand financial services organization providing debt relief, tax support, and business funding solutions. We’re strengthening our operations, refining our systems, and building a more cohesive, efficient experience across our brands. Our approach is grounded in transparency, strong operational foundations, and well-structured processes that support reliable execution and scalable growth.\nAbout the Role\nWe are seeking an experienced Data Engineer to design, build, support, and optimize our modern enterprise data platform. In this role, you will modernize our data architecture toward a Microsoft Fabric-based environment, developing reliable ingestion pipelines and modeling data into trusted lakehouse and warehouse layers. A key focus of the position involves accelerating data transformation performance and maximizing the efficiency of Fabric capacity utilization. You will take ownership of end-to-end data reliability, ensuring the freshness, completeness, and accuracy of data required for operational reporting and AI-driven insights. If you are solutions-oriented, thrive on ambiguity, and take pride in turning complex data problems into reliable systems, we’d love to have you on our team.\nLocation: Irvine, CA (Fully In-Office)\nCompensation: $140,000 - $155,000 / year\nJob Type: Full-Time (Exempt/Salary)\nWhat You'll Be Doing\nIn this role, priorities can shift rapidly based on system optimization needs, business analytics demands, and strategic platform initiatives. \nData Platform Architecture & Lakehouse Engineering\nDesign and implement scalable data warehouse and Lakehouse architectures utilizing Microsoft Fabric and Azure.\n\nArchitect and organize data structures within OneLake, Fabric Warehouse, and Lakehouse using a medallion (bronze, silver, gold) approach.\n\nDevelop and maintain ingestion and transformation pipelines using Data Factory in Fabric (pipelines, Copy jobs) and Spark/Python notebooks.\n\nIngest data from REST APIs and relational databases (MySQL/MariaDB, PostgreSQL/Redshift, SQL Server), including sources operating behind on-premises data gateways.\n\nDesign dimensional models and star schemas with SCD Type 2 history and conformed dimensions to support cross-functional reporting.\n\nCentralize business logic in curated gold-layer tables to ensure semantic models remain consistent and feed near-real-time operational dashboards.\n\nPerformance Tuning & Capacity Optimization\nProfile and tune Spark and SQL workloads to accelerate transformation run times via partitioning, file sizing, join strategies, and caching.\n\nRedesign legacy full-reload processes into incremental and change-data-capture (CDC) pipelines to minimize compute overhead.\n\nMonitor and manage Fabric capacity (CU) consumption with the Fabric Capacity Metrics app to prevent compute throttling during peak workloads.\n\nMaintain Delta tables using OPTIMIZE, VACUUM, and V-Order to ensure fast read performance in Direct Lake and warehouse queries.\n\nAudit existing pipelines, notebooks, and dataflows to eliminate redundant processing and consolidate duplicate logic.\n\nData Reliability, Observability & Stakeholder Collaboration\nImplement automated freshness, volume, and completeness monitoring alongside proactive alerting on all production pipelines.\n\nReconcile loaded data against source systems to resolve ingestion gaps and anomalies at the root cause.\n\nExecute safe historical data corrections and backfills with dry runs and validation prior to deploying to production.\n\nCollaborate closely with vendor partners, internal business users, BI, and analytics teams to deliver cost-efficient, scalable data solutions.\n\nWho You Are\nWe value adaptability, a solutions-oriented mindset, and deep technical curiosity: \nBachelor's degree in Computer Science, Data Science, Information Systems, or a related field (or equivalent professional experience).\n\n7+ years of hands-on experience in Data Engineering or Data Platform Development, including direct production experience with Microsoft Fabric and Azure data technologies.\n\nProven ability to identify, decompose, and solve complex data challenges independently and as part of a team. You adapt smoothly to shifting priorities, take initiative in fast-paced environments, and maintain resilience when troubleshooting intricate system issues.\n\nStrong proficiency in Python, PySpark, and advanced SQL. Proven track record of reducing run times and compute costs through workload optimization, incremental loading, and dimensional modeling (star schema, SCD Type 2).\n\nPractical experience with Git-based development and deployment promotion workflows using Azure DevOps or GitHub.\n\nExcellent communicator with the ability to bridge conversations across executive leadership (CEO, COO), vendor partners, and non-technical stakeholders alike.\n\nBonus Points (Great to Have)\nMicrosoft Fabric Data Engineer Associate (DP-700) certification.\n\nFamiliarity with Azure AI Foundry or Azure Machine Learning.\n\nExperience leveraging AI-assisted coding tools to accelerate pipeline development.\n\nFamiliarity with secondary cloud ecosystems such as Google Cloud Platform (GCP).\n\nPrior database administration (DBA) experience managing data security, redundancy, and high availability.\n\nWhat We Offer\nComprehensive medical, dental, and vision insurance coverage options.\n\nPaid vacation and paid company holidays throughout the year.\n\nLunch is on us every Friday!\nA vibrant team culture featuring regular quarterly social events, team outings, and annual holiday parties.\n\n401(k) retirement savings plan options to support your long-term financial health.\n\nDirect visibility and reporting to executive leadership (CEO & COO), giving you the autonomy to architect and scale our enterprise data footprint.\n\nWe are an Equal Opportunity Employer and consider all qualified applicants without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth, breastfeeding, and related medical conditions), gender, gender identity, gender expression, sexual orientation, marital status, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military or veteran status, or any other status protected by applicable federal, state, or local laws. We are committed to providing reasonable accommodations and to maintaining a workplace free from discrimination and retaliation. #StaffAccountant #GeneralLedger #NetSuite #AccountingCareers #Big4","description_format":"text","description_chars":6508,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Insurance coverage","Retirement plans","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Financial Advisory, Valuation & Restructuring","Tax Advisory & Preparation"],"lifecycle":[{"event":"open","at":"2026-11-11T02:48:38Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":36,"reasons":["conf:3","win:early"],"computed_at":"2026-11-11T05:49:22Z"},"pay":{"stated_usd_annual":155000,"is_top_pay":true},"html_url":"https://alion.io/job/better-debt-solutions-data-engineer","json_url":"https://alion.io/job/better-debt-solutions-data-engineer.json","meta":{"generated_at":"2026-11-11T06:10:06Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8648,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":671250},"rest":"https://alion.io/mcp/rest/get_company?id=671250"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbetter-debt-solutions-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbetter-debt-solutions-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbetter-debt-solutions-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/better-debt-solutions-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbetter-debt-solutions-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4052862}},{"tool":"search_jobs","arguments":{"company":"betterdebtsolutions.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4052862},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}