{"id":99251,"url":"https://alion.io/job/people-data-labs-senior-software-engineer-data-acquisition-2","title":"Senior Software Engineer, Data Acquisition","company":{"id":4933,"name":"People Data Labs","domain":"peopledatalabs.com","url":"https://alion.io/company/people-data-labs","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":160000,"max":200000,"currency":"USD","period":"year","gross":null,"usd_annual":200000},"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Apache Kafka","optional":false},{"name":"DNS","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Go","optional":false},{"name":"Linux","optional":false},{"name":"Python","optional":false},{"name":"Rust","optional":false},{"name":"Slack","optional":false},{"name":"Unix","optional":false},{"name":"Amazon Redshift","optional":true},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"BigQuery","optional":true},{"name":"Databricks","optional":true},{"name":"Delta Lake","optional":true},{"name":"GCP","optional":true},{"name":"Google BigQuery","optional":true},{"name":"Snowflake","optional":true},{"name":"Spark","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-07-23T19:38:35Z","employer_posted_date":"2026-07-23","last_verified_at":"2026-10-17T19:29:05Z","board_verified":true,"closed_at":null,"days_open":86,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":86},"description":"Note for all engineering roles: with the rise of fake applicants and AI-enabled candidate fraud, we have built in additional measures throughout the process to identify such candidates and remove them.\nAbout Us\nPeople Data Labs (PDL) is the provider of people and company data. We do the heavy lifting of data collection and standardization so our customers can focus on building and scaling innovative, compliant data solutions. Our sole focus is on building the best data available by integrating thousands of compliantly sourced datasets into a single, developer-friendly source of truth. Leading companies across the world use PDL’s workforce data to enrich recruiting platforms, power AI models, create custom audiences, and more.\nWe are looking for individuals who can balance extreme ownership with a “one-team, one-dream” mindset. Our customers are trying to solve complex problems, and we only help them achieve their goals as a team. Our Data Engineering & Acquisition Team ensures our customers have standardized and high quality data to build upon.\nYou will be crucial in accelerating our efforts to build standalone data products that enable data teams and independent developers to create innovative solutions at massive scale. In this role, you will be working with a team to continuously improve our existing datasets as well as pursuing new ones. If you are looking to be part of a team discovering the next frontier of data-as-a-service (DaaS) with a high level of autonomy and opportunity for direct contributions, this might be the role for you. We like our engineers to be thoughtful, quirky, and willing to fearlessly try new things. Failure is embraced at PDL as long as we continue to learn and grow from it.\nWhat You Get to Do\nContribute to the architecture and improvement of our data acquisition and processing platform, increasing reliability, throughput, and observability\n\nUse and develop web crawling technologies to capture and catalog data on the internet\n\nBuild, operate, and evolve large-scale distributed systems that collect, process, and deliver data from across the web\n\nDesign and develop backend services that manage distributed job orchestration, data pipelines, and large-scale asynchronous workloads\n\nStructure and model captured data, ensuring high quality and consistency across datasets\n\nContinuously improve the speed, scalability, and fault-tolerance of our ingestion systems\n\nPartner with data product and engineering teams to design and implement new data products powered by the data you help collect, and enhance and improve upon existing products\n\nLearn and apply domain-specific knowledge in web crawling and data acquisition, with mentorship from experienced teammates and access to existing systems\n\nThe Technical Chops You’ll Need\n7+ years of professional experience building or operating backend or infrastructure systems at scale\n\nSolid programming experience in Python, Go, Rust, or similar, including experience with async / await, coroutines, or concurrency frameworks\n\nStrong grasp of software architecture and backend fundamentals; you can reason clearly about concurrency, scalability, and fault tolerance\n\nSolid understanding of browser rendering pipeline, web application architecture (auth, cookies, http request / response)\n\nFamiliarity with network architecture and debugging (HTTP, DNS, proxies, packet capture and analysis)\n\nSolid understanding of distributed systems concepts: parallelism, asynchronous programming, backpressure, and message-driven design\n\nExperience designing or maintaining resilient data ingestion, API integration, or ETL systems\n\nProficiency with Linux / Unix command-line tools and system resource management\n\nFamiliarity with message queues, orchestration, and distributed task systems (Kafka, SQS, Airflow, etc.)\n\nExperience evaluating and monitoring data quality, ensuring consistency, completeness, and reliability across releases\n\nPeople Thrive Here Who Can\nWork independently in a fast-paced, remote-first environment, proactively unblocking themselves and collaborating asynchronously\n\nCommunicate clearly and thoughtfully in writing (Slack, docs, design proposals)\n\nWrite and maintain technical design documents, including pipeline design, schema design, and data flow diagrams\n\nScope and break down complex projects into deliverable milestones, and communicate progress, risks, and blockers effectively\n\nBalance pragmatism with craftsmanship, shipping reliable systems while continuously improving them\n\nSome Nice To Haves\nDegree in a quantitative field such as computer science, mathematics, or engineering\n\nExperience as a Red Teamer\n\nExperience working on large-scale data ingestion, crawling, or indexing systems\n\nExperience with Apache Spark, Databricks, or other distributed data platforms\n\nExperience with streaming data systems (Kafka, Pub/Sub, Spark Streaming, etc.)\n\nProficiency with SQL and data warehousing (Snowflake, Redshift, BigQuery, or similar)\n\nExperience with cloud platforms (AWS preferred, GCP or Azure also great)\n\nUnderstanding of modern data storage and design patterns (parquet, Delta Lake, partitioning, incremental updates)\n\nKnowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)\n\nExperience building and maintaining data pipelines on modern big-data or cloud platforms (Databricks, Spark, or equivalent)\n\nOur Benefits\nStock\n\nCompetitive Salaries\n\nUnlimited paid time off\n\nMedical, dental, & vision insurance\n\nHealth, fitness, and office stipends\n\nThe permanent ability to work wherever and however you want\n\nComp: $160K - $200K\nPeople Data Labs does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.\nQualified Applicants with arrest or conviction records will be considered for Employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.\nPersonal Privacy Policy for California Residents\nhttps://privacy.peopledatalabs.com/policies?name=applicant-privacy-policy","description_format":"text","description_chars":6269,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Providers & Datasets","B2B Company & Contact Data"],"lifecycle":[{"event":"open","at":"2026-07-23T19:38:35Z"}],"visa":[],"liveness":{"score":12,"band":"cold","label":"Long shot","p_open":1,"p_active":0.438,"p_room":0.28,"age_days":85,"expected_fill_days":35,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":200000,"is_top_pay":true},"html_url":"https://alion.io/job/people-data-labs-senior-software-engineer-data-acquisition-2","json_url":"https://alion.io/job/people-data-labs-senior-software-engineer-data-acquisition-2.json","meta":{"generated_at":"2026-10-17T22:27:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":402,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4933},"rest":"https://alion.io/mcp/rest/get_company?id=4933"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpeople-data-labs-senior-software-engineer-data-acquisition-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpeople-data-labs-senior-software-engineer-data-acquisition-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpeople-data-labs-senior-software-engineer-data-acquisition-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/people-data-labs-senior-software-engineer-data-acquisition-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpeople-data-labs-senior-software-engineer-data-acquisition-2"}]}