{"id":4506102,"url":"https://alion.io/job/rocket-companies-senior-software-developer-data-forge","title":"Senior Software Developer - Data Forge","company":{"id":1967610,"name":"Rocket Companies","domain":"rocket.com","url":"https://alion.io/company/rocket-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":75,"open_postings":112,"ghost_share":0,"stale_share":0.991,"repost_share":0,"time_to_fill_p50_days":32,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seattle, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":166900,"max":203900,"currency":"USD","period":"year","gross":null,"usd_annual":203900},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Delta Lake","optional":false},{"name":"Kubernetes","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-17T00:00:00Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-18T02:44:51Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Data Forge owns the data lake and builds the reusable, production-grade datasets that turn raw company signals into reliable data products for ML, search, analytics, and product teams.\nWe build on shared infrastructure owned by our sister teams. What we own is the lake itself and what lives in it: the storage architecture, catalog, schemas, SLAs, and the lifecycle of every curated dataset we deliver. Our work shows up in conversational search, home recommendations, agent matching, clickstream analytics, and the ML ranking and relevance features behind Redfin's core product.\nThree strategic bets define our roadmap. First, Fill the Lake: we are systematically bringing every meaningful raw signal at Redfin into a single, well-governed data store - migrating legacy systems, onboarding new source systems, and expanding coverage so every team builds on the same underlying data rather than maintaining their own copies. Second, unification of our Snowflake and data lake environments: we are converging on a single Iceberg lakehouse where the same tables are queryable through SQL, Spark, and ML tooling - no split schemas, no duplicate copies for different consumers. Third, accessibility: we are reducing the friction between raw lake data and the feature teams who need it, building the data contracts, discovery patterns, and self-service interfaces that let ML engineers and product teams find, trust, and use lake data without needing a Data Forge engineer in the loop.\nWe are building operational AI tooling to reduce the on-call overhead that comes with owning a large and growing catalog of production datasets.\nAbout the role\nOwn a data product or pipeline family end to end: understand the source system, design the extraction and transformation, own the schema, and deliver to downstream consumers with clear SLAs and change management. Ownership means you are accountable when it breaks and driving it forward when it doesn't.\nBuild data products that feature teams can actually use: user behavior profiles, property data, clickstream features, agent and customer data - delivered with clear schemas, data contracts, and enough documentation that ML engineers and product teams can build on them without asking you first. The goal is not just correctness but accessibility.\nMigrate legacy systems to production-grade Airflow and Iceberg pipelines: phase the work carefully, run shadow validation before cutover, deliver clean post-migration cleanup, and retire what you replaced. We do these on live systems with downstream consumers watching.\nExtract data reliably from complex source systems: Postgres replicas under production load, Kafka consumers (KCL), AWS Lambda-based ingest pipelines, and third-party feeds - handling schema drift, timeout tuning, connection reliability, and backfill strategy.\nDrive unification of our Snowflake and data lake environments: lead the Glue-to-Snowflake catalog migration in your area, design Iceberg tables that serve both SQL analysts and ML consumers from a single source of truth, and reduce the number of places teams have to look to find the same data.\nBuild operational AI tooling for the data platform: extend our alert triage agent, design diagnostic automation, and reduce on-call toil by building tooling that learns from production signals.\nPartner with ML, analytics, and product teams to deliver on shared milestones: communicate proactively when timelines shift, unblock downstream consumers quickly, and represent data quality as a first-class concern.\nAbout you\nYou have 5+ years building and operating data pipelines or data products at scale. You've owned production datasets - not just written DAGs - and you understand the difference between a pipeline that runs and a pipeline teams can trust.\nYou are fluent across the full stack data engineering requires: Python and SQL for pipeline logic and transformations; Terraform and Kubernetes for infrastructure management; Spark for distributed processing; Airflow for orchestration. You can work across all of these in the same week without needing a specialist for each layer.\nYou have worked with Iceberg, Hive, or Delta Lake in production: you understand compaction strategy, merge-on-read vs. copy-on-write tradeoffs, partition spec design, and how write concurrency affects table health over time.\nYou have extracted data from complex, legacy source systems - Postgres replicas, Kafka consumers (KCL), AWS Lambda ingest pipelines - and built extraction pipelines that handle schema drift, failures, and large backfills without heroic intervention.\nYou think carefully about data modeling and reusability: not just \"does this table answer the question\" but \"how will downstream teams depend on this, and how do I make it reliable enough that they can build on it without asking me first.\"\nYou approach legacy migrations methodically: shadow validation, phased cutover, explicit cleanup. You know that \"it works in test\" is not the same as \"it is safe to cut over,\" and you take that seriously when ML models and product features are downstream.\nYou treat resource constraints as first-class design inputs: Spark executor tuning, pod memory requests, namespace quota management, S3 storage costs. When you own pipelines that run every hour, reliability and cost are not afterthoughts.\nYou are comfortable with AI-assisted development and excited to build operational AI for a data platform: alert triage, automated diagnostics, pipeline scaffolding. You think about feedback loops and how to make tooling smarter from production signals.\nYou have operated production pipelines on-call: you can triage a P2 alert, trace a data quality regression to its source system, and write a postmortem worth reading.\nYou are a force multiplier. You raise the people around you through code review, design feedback, and mentorship - and you communicate clearly with the engineers, analysts, and ML practitioners who depend on your data to do their own work.\nWhat you’ll get\nOur team members fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We’ve got your back. Check out our full list of Benefits and Perks.\nOn-Call Expectations \nThis role may include participation in an on-call rotation to support production systems and ensure service reliability. On-call responsibilities may include coverage during nights and weekends. If applicable, frequency and scheduling will be determined by team needs and communicated accordingly.\nAbout us\nRedfin is a technology-driven real estate company with the country's most-visited real estate brokerage website. As part of Rocket Companies (NYSE: RKT), Redfin is creating an integrated homeownership platform from search to close to make the dream of homeownership more affordable and accessible for everyone. Redfin’s clients can see homes first with on-demand tours, easily apply for a home loan with Rocket Mortgage, and save thousands in fees while working with a top local agent.\nThis job description is an outline of the primary responsibilities of this position and may be modified at the discretion of the company at any time. Decisions related to employment are not based on race, color, religion, national origin, sex, physical or mental disability, sexual orientation, gender identity or expression, age, military or veteran status or any other characteristic protected by state or federal law. The company provides reasonable accommodations to qualified individuals with disabilities in accordance with applicable state and federal laws. Applicants requiring reasonable accommodations in completing the application and/or participating in the application process should contact a member of the Human Resources team, at .\nThe compensation information below is provided in compliance with all applicable job posting disclosure requirements. The compensation for this position is $166,900.00-$203,900.00. The position may also be eligible for an annual bonus, incentives, and other employment-related benefits including, but not limited to, medical, dental, and vision benefits, 401K retirement plan, and paid-time off. More information regarding these benefits and others can be found here. The information regarding compensation and other benefits included in this paragraph is the company’s current, good faith estimate at the time of posting. [Compensation and benefits are subject to modification from time to time as the Company, in its sole and exclusive discretion, deems appropriate.] The Company may determine during its future reviews of the proposed compensation and benefits provided for this position, that the compensation and benefits for such position should be reduced. In no event will the Company reduce the compensation for the position to a level below the applicable jurisdictional minimum wage rate for the position. Los Angeles County and San Francisco Candidates only: qualified applicants with arrest or conviction records will be considered for employment per the Fair Chance Ordinance and the Fair Chance Initiative for Hiring.","description_format":"text","description_chars":9371,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Real Estate Brokerage","Personal Finance Apps & Education","Mortgage Lending & Brokers"],"lifecycle":[{"event":"open","at":"2026-11-18T02:44:51Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":32,"reasons":["conf:3","win:early","comp:brand"],"computed_at":"2026-11-18T05:47:10Z"},"pay":{"stated_usd_annual":203900,"is_top_pay":true},"html_url":"https://alion.io/job/rocket-companies-senior-software-developer-data-forge","json_url":"https://alion.io/job/rocket-companies-senior-software-developer-data-forge.json","meta":{"generated_at":"2026-11-18T05:47:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10567,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1967610},"rest":"https://alion.io/mcp/rest/get_company?id=1967610"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Frocket-companies-senior-software-developer-data-forge"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Frocket-companies-senior-software-developer-data-forge"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Frocket-companies-senior-software-developer-data-forge"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/rocket-companies-senior-software-developer-data-forge\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Frocket-companies-senior-software-developer-data-forge"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4506102}},{"tool":"search_jobs","arguments":{"company":"rocket.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4506102},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}