Python Data Extraction Engineer
Confirmed on the employer's own hiring board on Oct 4, 2026. First seen by Alion on Oct 3, 2026.
Python Data Extraction Engineer - Web Scraping & Government Data
Location: Coimbatore
Experience: 3-7 years
Role Type: Full-time
About the Role
We are building a data intelligence platform that looks to analyze fragmented public information into structured, actionable business data.
We are looking for a strong Python Data Extraction Engineer who can discover, extract, clean, normalize and integrate data from government portals, public websites, PDFs, APIs and other open data sources.
This is not a conventional application-development role. The ideal candidate enjoys solving difficult data-acquisition problems involving poorly structured websites, inconsistent government portals, changing schemas, PDFs, JavaScript-rendered pages and large volumes of semi-structured information.
What You Will Own
You will build and maintain the data-acquisition layer of the platform.
Key responsibilities include:
Identify and evaluate government and public data sources relevant to property, businesses and commercial activity.
Build Python-based crawlers and extraction pipelines for government portals and public websites.
Extract structured information from HTML pages, tables, PDFs, downloadable files and publicly accessible APIs.
Work with JavaScript-rendered websites and multi-step public search interfaces.
Automate recurring extraction from multiple sources while respecting applicable access rules, rate limits, and terms.
Clean, standardize and normalize inconsistent data from different government authorities.
Perform entity matching and record linkage across datasets using fields such as owner name, company name, address, survey number, coordinates and project information.
Develop mechanisms to detect website/schema changes and extraction failures.
Build validation and QA processes to measure completeness and accuracy.
Store extracted information in structured databases and expose clean datasets to downstream applications.
Work closely with GIS, product and engineering teams to combine location-based signals with government/public records.
Research new public and open-data sources that can improve the accuracy and completeness of our intelligence.
Examples of Data Sources
The work may involve sources such as:
Municipal corporation portals
State planning and development authorities
DTCP and similar planning authorities
RERA databases
Building and planning permission records
Land and property records
Tender and procurement portals
Company/business registries
Government open-data portals
Environmental and regulatory approvals
Public notices and downloadable government documents
Maps and geospatial datasets
Other legally accessible public and open-source information
Required Technical Skills
Strong hands-on experience with:
Python
Web scraping and crawling
Requests / HTTP clients
BeautifulSoup / lxml
Selenium and/or Playwright
REST APIs and JSON
HTML/XML parsing
Pandas
SQL
Data cleaning and transformation
Regex and text processing
ETL/data pipelines
Git
What We Are Looking For
We particularly want someone who is a problem solver rather than simply a Python programmer.
The candidate should be able to investigate the available sources, understand how the underlying website works, determine the best extraction approach, build the pipeline and validate the resulting data.
Ideal Background
Candidates may come from backgrounds such as:
Web scraping / data extraction companies
Alternative-data companies
PropTech / real-estate data companies
Market-intelligence companies
OSINT/data intelligence companies
Government-data projects
Data aggregation platforms
Lead/data enrichment companies
GIS/location-intelligence companies
Success in This Role
Within the first few months, the successful candidate should be able to:
Map relevant government/public data sources.
Build reliable extraction pipelines across multiple portals.
Convert fragmented information into standardized records.
Cross-reference records from multiple sources.
Establish automated QA and monitoring.
Continuously discover additional datasets that improve our product's coverage and accuracy.
The objective is not simply to scrape websites. It is to build a scalable public-data acquisition and enrichment engine that becomes a core component of our intelligence platform.
Requirements
Python, pandas, webscraping, web crawling,selenium postman