Web Scraping Engineer - Python (Mid/Senior)

Job Description

Oxylabs is an enterprise-grade web data infrastructure, purpose-built for organizations operating at global scale. It helped define what public web data access could look like and still sets the standard others build against. That same ambition runs through the culture: engineers take ownership of problems no one else has solved and push each other to raise the bar.

The team waiting for you:

We run one of the most advanced and largest scraping and parsing products in the world. We serve thousands of requests per second with a very high success rate. Our scrapers and parsers are used by leading e-commerce, market intelligence, and AI industry players making the work challenging and truly global. The team is a blend of different interesting personalities from different walks of life and nationalities. Here you can find people who are experts in gaming, playing guitar, riding bicycles, and other areas. We, as a team, will support you in learning how to build your own scrapers and will share all the tips, tricks and hacks we know to ensure that you are onboard in no time.

In this role, you’ll:

• Develop scalable scrapers.
• Define resilient scraping strategies, unblock websites for scrapingImprove observability in the system.
• Develop back-end solutions for scraping & parsing problems of various magnitudes.
• Maintain the current system and develop new features related to scraping & parsing.

Requirements

• Experience working with Python.
• Understanding of computer science, including data structures, algorithms, computability and complexity.
• Version Control skills using Git.
• Knowledge on how to unblock websites for scraping.
• Is able to use different scraping techniques & open-source tools to build scrapers.
• Is comfortable with using Dev Tools.
• Network (TLS/SSL) knowledge.
• Worked with browser automations.
• Knows their way around asynchronous programming.

Nice to have

• Web development knowledge.
• Knows how to use CSS Selectors / XPaths for parsing.
• Experience working with Go & C++.
• Worked on browser source code.
• Knowledge of any front-end framework.
• Experience working with Pydantic, FastAPI, SQLAlchemy.
• Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
• Experience with machine learning that is scraping domain-specific.
• Has experience in building scalable systems.

Company offers

• Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing.
• Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app.
• Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together.
• Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need.
• Health insurance, hybrid work, learning budget, workation, 24/7 gym + more
• Cyber City office perks
• Hybrid work (3 office days / 2 WFH) & WFA options
• Latest tools, gadgets & tech stack
• Extra day off
• Inclusive family-related time-off policy
• Private health insurance
• 24/7 gym
• Physical well-being specialists
• Psychologist/psychotherapist sessions
• Inclusive family-related time-off policy
• Vast internal & external learning resources
• Guilds, communities & 800+ professionals by your side
• Source network & knowledge sharing
• Yearly workation
• Year-round internal & Source community events
• Team building budget