{"id":4218236,"url":"https://alion.io/job/re-managers-data-extraction-pipeline-engineer-mfd","title":"Data Extraction & Pipeline Engineer (m/f/d)","company":{"id":3899847,"name":"RE-Managers","domain":"re-managers.de","url":"https://alion.io/company/re-managers","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Germany"],"countries":["DE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":true,"has_equity":false,"technologies":[{"name":"Beautiful Soup","optional":false},{"name":"Docker","optional":false},{"name":"Git","optional":false},{"name":"GraphQL","optional":false},{"name":"Linux","optional":false},{"name":"Playwright","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Rest API","optional":false},{"name":"Scrapy","optional":false},{"name":"Selenium","optional":false}],"status":"live","first_seen_at":"2026-11-12T12:00:00Z","employer_posted_date":null,"last_verified_at":"2026-11-12T12:00:00Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Job Title: Data Extraction & Pipeline Engineer (m/f/d) – Web Scraping & Market \nIntelligence \nReference ID: IRIS-KHI-DATA-04 \nLocation: Karachi Hub, Pakistan (DHA Phase 1 / Phase 2) \nContract Type: Full-time \nOrganization: IRIS – Institut für Resilienz, Innovation und Nachhaltigkeit \nApplication Channel: (Subject: Application IRIS-KHI-DATA-04 – [Your Name]) \nAbout the Organization \nThe IRIS – Institut für Resilienz, Innovation und Nachhaltigkeit develops intelligent data systems to observe, evaluate, and forecast market and sustainability developments across Europe. Our data pipelines extract and synthesize complex public, municipal, and real estate market indices into unified analytical models. \nRole Overview \nWe are seeking an experienced Backend & Data Extraction Engineer to design, deploy, and monitor scalable web crawlers, data scrapers, and data ingestion pipelines handling diverse, unstructured web sources. \nKey Responsibilities \nArchitect and maintain robust scraping and crawling pipelines targeting property portals, public registers, municipal gazettes, and economic data sources. \nImplement parsing, data normalization, deduplication, and quality-validation routines for incoming raw data. \nManage proxy rotation, anti-bot mechanisms, rate limiting, and headless browser workflows. \nStore and organize structured information using PostgreSQL, Redis, and document stores. \nPackage data services into Docker containers and interface them with internal analytics engines via REST/GraphQL APIs. \nRequirements & Qualifications \nBachelor’s Degree in Computer Science, Software Engineering, or Information Technology (e.g., FAST-NUCES, NED University, or equivalent). \nHands-on experience developing web scraping frameworks in Python: Scrapy, Playwright, Selenium, BeautifulSoup, or Puppeteer. \nPractical knowledge of relational (PostgreSQL) and NoSQL/caching databases (Redis, MongoDB). \nExperience with Linux environments, Docker, and Git. \nStructured problem-solving mindset, persistence with complex web structures, and solid English skills. \nWhat We Offer & Career Pathways \nCompetitive Package: Excellent compensation package aligned with regional developer salaries. \nModern Workspace: Air-conditioned, reliable office in DHA Phase 1/2 with generator backup. \nLocal Leadership Path: Opportunities to scale into Engineering Lead / Data Operations Manager as the Karachi hub grows, supported by ongoing technical mentorship and European project workflows. \nThe International Research Track (§ 18d AufenthG): Top-performing engineers with consistent code quality and reliability over 3–6 months can transition to our research development institute in Germany under the § 18d researcher framework, complete with full visa sponsorship, relocation assistance, and housing / accommodation support. \nHow to Apply: Send your CV by E-Mail: ","description_format":"text","description_chars":2879,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Relocation assistance"],"hiring_locations":[{"name":"Pakistan","iso":"PK","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Property Management","PropTech"],"lifecycle":[{"event":"open","at":"2026-11-13T03:15:55Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":27,"reasons":["seen:0","win:early"],"computed_at":"2026-11-13T04:31:29Z"},"pay":null,"html_url":"https://alion.io/job/re-managers-data-extraction-pipeline-engineer-mfd","json_url":"https://alion.io/job/re-managers-data-extraction-pipeline-engineer-mfd.json","meta":{"generated_at":"2026-11-13T04:31:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9571,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3899847},"rest":"https://alion.io/mcp/rest/get_company?id=3899847"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fre-managers-data-extraction-pipeline-engineer-mfd"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fre-managers-data-extraction-pipeline-engineer-mfd"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fre-managers-data-extraction-pipeline-engineer-mfd"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/re-managers-data-extraction-pipeline-engineer-mfd\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fre-managers-data-extraction-pipeline-engineer-mfd"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4218236}},{"tool":"search_jobs","arguments":{"company":"re-managers.de","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4218236},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}