{"id":1495281,"url":"https://alion.io/job/dr-kaske-staff-crawling-engineer-mwd","title":"Staff Crawling Engineer (m/w/d)","company":{"id":1950144,"name":"Dr. Kaske","domain":"drkaske.de","url":"https://alion.io/company/drkaske","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Personio","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Industrial Engineering","role_family":"Industrial Engineering","seniority":"staff","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_company_offices","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["DE"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":100000,"max_usd":206000,"period":"year","method":"global_role_seniority_cell","sample_n":1702},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Docker","optional":false},{"name":"Git","optional":false},{"name":"JavaScript","optional":false},{"name":"Linux","optional":false},{"name":"Node JS","optional":false},{"name":"Playwright","optional":false},{"name":"Puppeteer","optional":false},{"name":"Selenium","optional":false},{"name":"SQL","optional":false},{"name":"CI/CD","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Python","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-09-01T17:50:48Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-29T01:28:54Z","board_verified":true,"closed_at":null,"days_open":57,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":57},"description":"That's us:\nThe Kaske Group, headquartered in Munich, provides data, software and AI solutions for companies in the healthcare and life sciences sectors. Since 1997, we have grown into an integrated platform provider, combining one of the largest digital healthcare databases in the DACH region with data-driven software, AI and consulting services. With more than 100 customers and projects across 22 European countries, we support our clients from strategic data analysis through to implementation.\nThis role sits within Smile BI Devs, the Kaske Group’s software and analytics unit, where we develop data-driven products for the healthcare and life sciences industry.\nTo strengthen the reliability and scalability of our crawling systems, we are looking for an experienced engineer who will expand our capacity, improve technical resilience and help prepare our platform for further international growth.Your mission:\nAs our Staff Crawling Engineer, you will take end-to-end technical ownership of reliable, production-ready crawling solutions - from analysis and estimation through to deployment, monitoring and maintenance.You will:\nDesign, build and maintain Node.js-based crawling and data-collection services for static, dynamic and JavaScript-rendered websites.\nDevelop reliable crawling processes with appropriate concurrency, scheduling, retries, monitoring and failure recovery.\nIntegrate crawling services with Kafka and downstream data-processing systems.\nEnsure the completeness, consistency, timeliness and quality of collected data.\nDiagnose and resolve production failures, website changes and performance issues.\nProvide realistic estimates and communicate assumptions, dependencies and delivery risks early.\nContribute to architecture, code reviews and technical standards while improving testability, documentation and maintainability.\nCollaborate across engineering, product and business teams, share knowledge and mentor other engineers without formal people-management responsibility.\nYour profile:\n10 years or more of professional software-engineering experience, or equivalent demonstrated Staff-level capability.\nSubstantial experience building and operating production web crawlers, web-scraping systems or comparable data-acquisition services.\nAdvanced Node.js and JavaScript skills, including asynchronous programming, concurrency and event-driven processing.\nStrong knowledge of HTTP, HTML, DOM structures, APIs and dynamically rendered websites.\nPractical experience with browser-automation tools such as Puppeteer, Playwright or Selenium.\nExperience designing reliable production processes involving queues, retries, rate limits, timeouts and failure recovery.\nExperience with SQL, relational databases, Git, Linux and Docker.\nStrong technical ownership, structured problem-solving and the ability to provide realistic estimates.\nClear, proactive communication around assumptions, blockers, risks and changing timelines.\nProfessional working proficiency in English.\nNice to have:\nTypeScript or Python experience.\nExperience with Kafka and PostgreSQL.\nKnowledge of CI/CD, monitoring, alerting and observability.\nExperience with proxy management, access restrictions or resilient browser automation.\nExperience working with international websites, multilingual data or e-commerce datasets.\nWhat we offer\nFlexible working setup: Work remotely, with occasional office days and a workspace available whenever you need it.\nFlexible working hours: Organise your day in a way that supports both effective collaboration and focused work.\nPrivate healthcare insurance: Additional support for your health and well-being.\nTraining budget: €1,000 per year for your professional development.\n35 days of annual leave: Because proper rest matters.\nPaid parking: Available for added convenience when you work from the office.\nOffice kitchen: Snacks, tea and coffee whenever you are onsite.\n Dog-friendly workplace: Well-behaved four-legged colleagues are welcome.","description_format":"text","description_chars":3977,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":["Annual leave","Flexible schedule","Professional development"],"hiring_locations":[{"name":"Germany","iso":"DE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Health Care","Pharma Marketing & Medical Communications"],"lifecycle":[{"event":"open","at":"2026-09-30T01:54:34Z"}],"visa":[],"liveness":{"score":22,"band":"cold","label":"Long shot","p_open":1,"p_active":0.624,"p_room":0.35,"age_days":57,"expected_fill_days":7,"reasons":["conf:4","win:tail"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/dr-kaske-staff-crawling-engineer-mwd","json_url":"https://alion.io/job/dr-kaske-staff-crawling-engineer-mwd.json","meta":{"generated_at":"2026-10-29T06:35:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9995,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1950144},"rest":"https://alion.io/mcp/rest/get_company?id=1950144"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdr-kaske-staff-crawling-engineer-mwd"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdr-kaske-staff-crawling-engineer-mwd"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdr-kaske-staff-crawling-engineer-mwd"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/dr-kaske-staff-crawling-engineer-mwd\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdr-kaske-staff-crawling-engineer-mwd"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1495281}},{"tool":"search_jobs","arguments":{"company":"drkaske.de","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1495281},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}