{"id":966940,"url":"https://alion.io/job/competera-middle-scraping-engineer","title":"Middle Scraping Engineer","company":{"id":57068,"name":"Competera","domain":"competera.ai","url":"https://alion.io/company/competera","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"PeopleForce","truth_index":null},"role":"Industrial Engineering","role_family":"Industrial Engineering","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["UA"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":66000,"max_usd":128000,"period":"year","method":"global_role_seniority_cell","sample_n":5668},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Akamai","optional":false},{"name":"CI/CD","optional":false},{"name":"Cloudflare","optional":false},{"name":"Docker","optional":false},{"name":"JavaScript","optional":false},{"name":"Playwright","optional":false},{"name":"Python","optional":false},{"name":"Scrapy","optional":false},{"name":"WebSockets","optional":false}],"status":"live","first_seen_at":"2026-09-16T15:20:37Z","employer_posted_date":"2026-09-19","last_verified_at":"2026-11-18T12:54:38Z","board_verified":true,"closed_at":null,"days_open":63,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":63},"description":"We are looking for a sharp, proactive, and experienced Middle Scraping Engineer to join our team and drive our web data extraction operations forward.This is not a generic backend role. You will work with complex web structures, heavy anti-bot mechanisms, scale-driven infrastructure, and high-load scraping systems.\nYou will expand our crawling coverage, maintain a massive crawling fleet, architect unblocking solutions, and ensure high data quality under strict SLAs.\nWhy this role is exciting\nScraping at the Middle level is advanced web reverse engineering combined with scalable systems architecture.\nEvery target site is a dynamic battlefield: advanced anti-bots, CAPTCHAs, fingerprinting, dynamic JavaScript rendering, and changing structures. You won't just write scripts - you will build resilient, automated data-pipeline infrastructure that handles millions of requests seamlessly.\nWe offer an environment where your technical initiative leads directly to production impact. You will have full ownership of challenging scrapers and the freedom to experiment with new unblocking and engineering approaches.\nWhat you will do\nMaintain and optimize our existing large-scale crawling fleet to ensure high availability;\nExpand crawling coverage by developing scrapers for new, complex target websites;\nImprove the quality, throughput, and success rates of existing crawls;\nResearch, update, and develop custom unblocking solutions to bypass modern anti-bot protections;\nEnsure consistent data delivery while strictly maintaining client SLAs;\nSupport team bandwidth by actively taking on R&D tasks, solving complex edge cases, and mentoring junior engineers.\n What we expectStrong Python mastery (\"Python Ninja\") with clean, scalable code practices;\nDeep expertise in Scrapy, Playwright, and async networking;\nSolid hands-on experience with proxy management (residential, datacenter, rotating networks, session stickiness);\nExperience with advanced unblocking tools and techniques (bypassing Cloudflare, Akamai, Datadome, CAPTCHA solvers, TLS/browser fingerprinting);\nPractical DevOps knowledge (Docker, CI/CD pipelines, container orchestration, monitoring);\nStrong web reverse engineering skills (analyzing network traffic, API endpoints, WebSocket messages, minified JS);\nExperience in building or deploying scalable web scraping infrastructure;\nHigh level of responsibility, SLA-driven mindset, and target-oriented approach;\nExcellent teamwork, fast thinking, and strong problem-solving skills in high-pressure situations.\n You’re gonna love it, and here’s why:Rich innovative software stack, freedom to choose the best suitable technologies;\nRemote-first ideology: freedom to operate from the home office or any suitable coworking;\nFlexible working hours (we start from 8 to 11 am) and no time tracking systems on;\nRegular performance and compensation reviews;\nRecurrent 1-1s and measurable OKRs;\nIn-depth onboarding with a clear success track;\nCompetera covers 70% of your training/course fee;\n20 vacation days, 15 days off, and up to one week of paid Christmas holidays;\n20 business days of sick leave.\n Drive innovations with us. Be a Competerian.","description_format":"text","description_chars":3159,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Home office"],"hiring_locations":[{"name":"Ukraine","iso":"UA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Machine Learning","Retail & Shop Systems","Retail & Commerce AI"],"lifecycle":[{"event":"open","at":"2026-09-16T15:20:37Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.497,"p_room":0.28,"age_days":62,"expected_fill_days":28,"reasons":["conf:7","win:tail","crowd:"],"computed_at":"2026-11-18T05:48:20Z"},"pay":null,"html_url":"https://alion.io/job/competera-middle-scraping-engineer","json_url":"https://alion.io/job/competera-middle-scraping-engineer.json","meta":{"generated_at":"2026-11-18T18:08:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16546,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":57068},"rest":"https://alion.io/mcp/rest/get_company?id=57068"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcompetera-middle-scraping-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcompetera-middle-scraping-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcompetera-middle-scraping-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/competera-middle-scraping-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcompetera-middle-scraping-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":966940}},{"tool":"search_jobs","arguments":{"company":"competera.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":966940},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}