Web Scraper - Python Developer
First seen by Alion on Aug 31, 2026.
Job Description :
Role : Web Scraper
Hours : MondayFriday, up to 45 hours per week
Work Hours : EST Shift 6 : 00 PM to 03 : 00 AM (Fixed Shift)
Location : 801, 8th Floor, Cerebrum IT Park B3, Kalyani Nagar, Pune 411014
Length : Permanent position with a three-month probation period
About the Company :
Valasys Media is a globally acclaimed company based in Pune, specializing in Lead Generation, Lead Nurturing, Content Syndication, and Data Intelligence services.
Job Brief :
This is a full-time on-site role for a Web Scraper / Python Developer based in Pune. The candidate will be responsible for developing and maintaining web scraping solutions, automation scripts, API integrations, data processing workflows, and database operations to support large-scale data collection and business requirements.
Key Skills :
- Strong Python programming and OOP concepts
- Web scraping using Selenium, Playwright, BeautifulSoup, Requests, and/or Scrapy
- Knowledge of HTML DOM, XPath, CSS selectors, JavaScript/AJAX, sessions, and cookies
- Experience with REST APIs, JSON, API authentication, headers, and parameters
- Strong knowledge of Pandas and data processing
- Data cleaning, validation, transformation, and deduplication
- Knowledge of PostgreSQL/MySQL/MongoDB
- Experience with FastAPI
- Linux and AWS EC2
- Git/GitHub and version control
- Understanding of automation, scheduling, retries, and background jobs
- Good debugging and problem-solving skills
Requirements :
- Qualification Graduation / Post Graduation in Computer Science, IT, Engineering, or a related field.
- Python development, web scraping, automation, or a similar role.
- Strong hands-on experience with Python and web scraping tools.
- Experience handling dynamic websites, pagination, sessions, cookies, and JavaScript-based content.
- Good understanding of APIs and data processing.
- Basic to good knowledge of databases and SQL/NoSQL databases.
- Knowledge of Linux, AWS EC2, and Git/GitHub.
- Ability to work with large-volume datasets.
- Strong analytical and problem-solving skills.
- Ability to work independently as well as with a team.
- Willingness to work in a fixed EST shift from the Pune office.
Responsibilities :
- Develop and maintain Python-based web scraping and automation scripts.
- Build scraping solutions using Selenium, Playwright, BeautifulSoup, Requests, and/or Scrapy.
- Handle dynamic websites, pagination, AJAX, sessions, cookies, XPath, and CSS selectors.
- Integrate REST and third-party APIs.
- Develop basic backend APIs using FastAPI.
- Perform data cleaning, transformation, validation, and deduplication using Pandas.
- Work with CSV, Excel, JSON, and database data.
- Manage data using PostgreSQL, MySQL, or MongoDB.
- Implement error handling, logging, retries, and monitoring.
- Automate scheduled scraping and data-processing jobs using Cron/Celery or task queues.
- Debug and optimize scraping processes for performance and reliability.
- Deploy and manage Python applications on AWS EC2/Linux servers.
- Maintain code using Git/GitHub.
- Support internal data and automation requirements.
Skills
Web Scraping, Python, Scrapy, Pandas, SQL, NoSQL, Linux, IT Automation, REST API, Backend Architecture