{"id":466715,"url":"https://alion.io/job/peregrine-technologies-staff-software-engineer-data-infrastructure-2","title":"Staff Software Engineer, Data Infrastructure","company":{"id":179573,"name":"Peregrine Technologies","domain":"peregrine.io","url":"https://alion.io/company/peregrine-technologies","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":81,"open_postings":28,"ghost_share":0,"stale_share":0.75,"repost_share":0,"time_to_fill_p50_days":55,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Washington, United States","New York, United States","San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":200000,"max":275000,"currency":"USD","period":"year","gross":null,"usd_annual":275000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Flink","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-03-12T18:35:52Z","employer_posted_date":"2026-09-25","last_verified_at":"2026-10-17T20:40:49Z","board_verified":true,"closed_at":null,"days_open":219,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":218},"description":"Backed by leading Silicon Valley investors, Peregrine helps public safety organizations, state and local and governments, federal agencies, and private-sector institutions address society’s challenges with unprecedented speed and accuracy. Our AI-enabled platform turns siloed and disconnected data into operational intelligence - instantly surfacing mission-critical information to empower better, faster decisions that improve outcomes at every touchpoint. Today Peregrine supports hundreds of customers across 30+ states and two countries, serving more than 125 million people - and we’re amplifying our impact as we expand into the enterprise and internationally. \nTeam\nAs an engineering team, we believe strongly that empathy improves our solutions. Seeing how people use the product is a priority and the way we get to the right answer. Engineers will have the opportunity to work closely with our team onsite to understand the variety of use cases that Peregrine serves.\nWe value both ownership and collaboration-you will take full responsibility for major features and work closely with other engineers to drive them to completion. We believe that humility and empathy are essential for building the right solutions-you will collaborate directly with our deployment team and users as we iterate to solve their problems. Perseverance and creativity are crucial to executing our vision.\nRole\nWe are looking for a Staff Data Infrastructure Engineer to join our growing team, where you will have deep ownership over the data layer that underpins everything Peregrine does. You will architect and build the systems that ingest, store, and serve massive volumes of real-time operational data - enabling our customers to make critical decisions with speed and confidence.\nThis is a senior individual contributor role for someone who thrives on hard technical problems and brings the experience and judgment to shape foundational infrastructure decisions. You will tackle a wide range of complex challenges, including:\nDesigning and operating a high-throughput, real-time data integration platform across diverse customer environments\nArchitecting a scalable open table format layer for reliable data storage at petabyte scale\nBuilding and optimizing distributed data processing pipelines with Apache Spark and adjacent streaming technologies\nDriving performance, reliability, and cost efficiency across the full data infrastructure stack\nCollaborating with platform and product engineering teams to define data contracts, schemas, and integration patterns\nEstablishing best practices, tooling, and patterns that raise the quality bar for data infrastructure across the organization\nOur stack is constantly evolving but is built on AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, Kubernetes, and more.\nAbout You\nDeep passion for data infrastructure - you care about building systems that are correct, fast, and resilient at scale\nThrive on ambiguity and are energized by defining the right solution to hard, open-ended problems\nStrong technical vision with the ability to translate complex data requirements into clean, durable infrastructure designs\nDesire to own significant portions of the data stack end-to-end, from ingestion to serving\nCommitted to operational excellence - you build things you’re proud to operate\nWhat We Look For\n8+ years of experience architecting and operating large-scale data infrastructure systems in production environments\nDeep expertise with open table formats, particularly Apache Iceberg - including schema evolution, partitioning strategies, compaction, and time travel\nExtensive hands-on experience with Apache Spark for batch and streaming data processing at scale\nStrong background in real-time data integration and stream processing, leveraging technologies such as Apache Kafka, Apache Flink, or equivalents\nSolid experience with data pipeline orchestration using Airflow or similar tools\nStrong software engineering fundamentals in Python and/or Scala, with a track record of writing production-quality code\nExtensive experience with AWS or comparable cloud platforms, including S3-based data lake architectures\nExperience with Kubernetes and containerized deployment of data workloads\nDegree in Computer Science, Engineering, or a related field, or equivalent practical experience\nLocated in San Francisco, New York, or Washington DC and open to working in office\nAnnual Salary + Benefits + Equity (if applicable) + Bonus (if applicable)\n$200,000—$275,000 USD\nActual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, certifications or licenses, and specific work location. Information on the benefits offered is here.\nPeregrine Technologies is committed to creating an inclusive environment for all employees. We celebrate diversity and are a proud equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.","description_format":"text","description_chars":5133,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Law Enforcement","National Security","Decision Intelligence"],"lifecycle":[{"event":"open","at":"2026-09-06T12:18:24Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6","filings_12m":6,"filings_prev_12m":4,"green_card_filings_12m":0,"median_offered_wage_usd":122500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":3}],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":1,"p_active":0.378,"p_room":0.28,"age_days":218,"expected_fill_days":55,"reasons":["conf:1","stale_co","velocity","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":275000,"is_top_pay":true},"html_url":"https://alion.io/job/peregrine-technologies-staff-software-engineer-data-infrastructure-2","json_url":"https://alion.io/job/peregrine-technologies-staff-software-engineer-data-infrastructure-2.json","meta":{"generated_at":"2026-10-17T22:09:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7199,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":179573},"rest":"https://alion.io/mcp/rest/get_company?id=179573"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fperegrine-technologies-staff-software-engineer-data-infrastructure-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fperegrine-technologies-staff-software-engineer-data-infrastructure-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fperegrine-technologies-staff-software-engineer-data-infrastructure-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/peregrine-technologies-staff-software-engineer-data-infrastructure-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fperegrine-technologies-staff-software-engineer-data-infrastructure-2"}]}