{"id":3982955,"url":"https://alion.io/job/ziprecruiter-engineering-manager-big-data-job-understanding","title":"Engineering Manager, Big Data, Job Understanding","company":{"id":701831,"name":"ZipRecruiter","domain":"ziprecruiter.com","url":"https://alion.io/company/ziprecruiter-2","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":true,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":88,"open_postings":39,"ghost_share":0,"stale_share":0.462,"repost_share":0,"time_to_fill_p50_days":46,"computed_at":"2026-11-09T06:03:00Z"}},"role":"Leadership","role_family":"Leadership","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["New York, United States","Santa Monica, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200000,"max":265000,"currency":"USD","period":"year","gross":null,"usd_annual":265000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Docker","optional":false},{"name":"Embeddings","optional":false},{"name":"Flink","optional":false},{"name":"Hadoop","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Delta Lake","optional":true},{"name":"GCP","optional":true},{"name":"HBase","optional":true},{"name":"Scala","optional":true}],"status":"live","first_seen_at":"2026-11-09T17:48:16Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-09T20:27:16Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)\nOur Mission: \nTo actively connect people to their next great opportunity. \nWho We Are: \nZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.\nAbout the Team:\nRecommendations Ecosystem\nThe Recommendations Ecosystem group owns the intelligence that connects job seekers and jobs in our marketplace. We aim to understand every job and every job seeker well enough to make matches that work for both sides. We structure and enrich the jobs corpus, build the foundational models that encode jobs and job seekers, and run the matching engines that put the right opportunities in front of the right people.\nWhat our team owns\nOur group is the authoritative source for job understanding and matching intelligence, focusing on accuracy, relevance, and trust:\nJobs Corpus Understanding: ZipRecruiter takes in millions of job postings from employers, partners, and feeds. We own the ingestion and enrichment pipelines that turn raw postings into structured data. We use ML classifiers to infer job attributes like education requirements and pay, and we attach company and location data. We find and suppress fraudulent listings or terms of use violations, so the marketplace stays safe and worth using. The result is a canonical view of every job that recommendations, search, and employer products build on.\nFoundational Models and Embeddings: At the core of ZipRecruiter's matching ecosystem are models that encode everything we can learn about jobs and job seekers. We build LLM-based embedding models from job content, resumes, and behavioral signals. These are the building blocks for matching and other ML models across the company, and we serve them at scale online and in batch.\nMatching Engines: We are responsible for the ML systems that recommend jobs to job seekers and job seekers to employers across our app, website, and email. The engines cover large-scale candidate retrieval over vector DBs and orchestration that delivers fresh, personalized recommendations.\nAbout the Job:\nZipRecruiter’s Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.\nWe are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.\nLead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.\nDrive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.\nPrioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.\nOwn and lead improvements to fraud detection and blocking mechanisms.\nPartner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.\nEnsure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience. \nMinimum Qualifications:\n5+ years of professional software development experience.\n2+ years of experience as a software engineering leader\nDeep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).\nStreaming technologies (Kafka, Flink, Beam).\nStrong CS fundamentals (data structures, algorithms) and coding skills.\nExperience with containerization technologies like Docker and Kubernetes.\nExperience working on a B2C or B2B Product\nThis role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.\nMust have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations) \nPreferred Qualifications:\nCloud platforms (GCP, AWS, Azure).\nModern data storage solutions (Delta Lake, HBase, Hudi).\nScala\nAs part of our team you’ll enjoy:\nCompetitive compensation\nExceptional benefits package\nFlexible Vacation & Paid Time Off\nEmployer-matched 401(k) plan \nThe US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.\nDepending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.\nZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.\nPrivacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: https://www.ziprecruiter.com/careers/job-applicant-privacy-notice","description_format":"text","description_chars":6107,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Equity","Hybrid work"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Job Boards & Aggregators","HR & Recruiting AI"],"lifecycle":[{"event":"open","at":"2026-11-09T20:27:16Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 19 · green card filings: 13","filings_12m":19,"filings_prev_12m":30,"green_card_filings_12m":13,"median_offered_wage_usd":145313,"route":null,"cap_exempt":false,"checked_at":"2026-11-09T07:32:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":1}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":46,"reasons":["conf:2","win:early"],"computed_at":"2026-11-09T23:26:59Z"},"pay":{"stated_usd_annual":265000,"is_top_pay":true},"html_url":"https://alion.io/job/ziprecruiter-engineering-manager-big-data-job-understanding","json_url":"https://alion.io/job/ziprecruiter-engineering-manager-big-data-job-understanding.json","meta":{"generated_at":"2026-11-09T23:26:59Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13029,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":701831},"rest":"https://alion.io/mcp/rest/get_company?id=701831"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fziprecruiter-engineering-manager-big-data-job-understanding"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fziprecruiter-engineering-manager-big-data-job-understanding"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fziprecruiter-engineering-manager-big-data-job-understanding"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ziprecruiter-engineering-manager-big-data-job-understanding\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fziprecruiter-engineering-manager-big-data-job-understanding"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3982955}},{"tool":"search_jobs","arguments":{"company":"ziprecruiter.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3982955},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}