Scraping Engineer
About the Role
You'll be an embedded member of a fast-growing AI startup team, owning the reliability and quality of a web extraction infrastructure that processes millions of pages daily through hundreds of scripts. Reporting to a Forward Deployed Engineer, this role is critical to keeping a high-throughput data pipeline running smoothly and accurately.
What You'll Do
Monitor and triage a queue of broken scrapers and data quality alerts to keep operations running without interruption.
Build and deploy new web scraping scripts for websites that need to be added to the extraction pipeline.
Validate scraped data for accuracy and investigate any discrepancies that surface.
Create dashboards to visualize and monitor scraped data in real time.
Collaborate with AI agents to fill capability gaps, fix issues, and improve existing scripts.
What We're Looking For
1+ years of hands-on, professional experience building or maintaining web scraping solutions.
Strong proficiency in TypeScript and Node.js for building and debugging scraping scripts.
Solid SQL skills for data querying and validation.
Experience with Puppeteer or similar browser automation libraries.
Experience debugging and fixing broken scrapers in production environments.
Familiarity with message queues such as RabbitMQ and in-memory caching systems such as Redis.
Experience with Google Cloud Platform or equivalent cloud infrastructure, including data warehouse tools like BigQuery.
Comfort with bash scripting and git version control.
Experience validating data quality and accuracy in extracted datasets.
Experience building dashboards or data visualization tools is a plus.
Strong async communicator who sends proactive updates and flags blockers early.
Comfortable with ambiguity and able to scope project timelines independently in a fast-paced startup setting.
Location
Fully remote, open to any time zone. You will need 8+ hours of daily availability with overlap during US business hours. Visa sponsorship is not available.