{"id":3573258,"url":"https://alion.io/job/guoshouchengda-pythonpachonggongchengshi-2","title":"Python爬虫工程师","company":{"id":4490822,"name":"国寿成达","domain":null,"url":"https://alion.io/company/Guoshouchengda","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Shanghai, China"],"countries":["CN"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":20000,"max":35000,"currency":"CNY","period":"month","gross":null,"usd_annual":63228},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":".NET","optional":false},{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"JavaScript","optional":false}],"status":"live","first_seen_at":"2026-10-27T12:20:43Z","employer_posted_date":null,"last_verified_at":"2026-10-27T12:20:43Z","board_verified":false,"closed_at":null,"days_open":5,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":5},"description":"岗位职责：\n\n1.负责爬虫引擎核心功能开发及优化、架构设计、系统规划，以及爬虫技术的技术调研；\n\n2.负责大数据的数据采集与爬取、解析处理、入库及备份等数据日常工作；\n\n3.负责数据的清洗、整理、整合及合并等工作；\n\n4.破解反爬机制，优化爬虫路由调度策略，同时负责反爬策略的设计及优化；\n\n5.负责高性能爬虫系统的后台监控、报警模块的开发。\n\n职位要求：\n\n1.熟练使用C/C++、Java、C#、.Net、Go中一种编程语言，熟悉至少一种脚本语言，如shell、python进行工作；\n\n2.熟悉爬虫的设计及实现流程，至少1年互联网数据抓取及爬虫经验；\n\n3.熟悉缓存数据库redis,关系型数据库mysql、Oracle等，非关系型数据库MangDB,具备sql调优经验；\n\n4.了解各种Web前端技术，包括XHTML/XML/CSS/JavaScript/AJAX等；\n\n5.了解文本分类、统计分析、自然语言处理、机器学习算法等技术；\n\n6.熟悉反爬虫机制并有对应的破解方案；\n\n7.处理爬取过超过百万数量级的数据量；\n\n8.有大数据相关开发经验者优先，熟悉分布式计算，有多线程、分布式、网络数据抓取及处理经验优先；\n\n9.有政府政务行业工作经验优先，尤其社会信用方向。","description_format":"text","description_chars":539,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-31T18:37:00Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":5,"expected_fill_days":23,"reasons":["seen:5","velocity","win:early"],"computed_at":"2026-11-02T06:13:15Z"},"pay":{"stated_usd_annual":63228,"is_top_pay":false},"html_url":"https://alion.io/job/guoshouchengda-pythonpachonggongchengshi-2","json_url":"https://alion.io/job/guoshouchengda-pythonpachonggongchengshi-2.json","meta":{"generated_at":"2026-11-02T08:44:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12287,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4490822},"rest":"https://alion.io/mcp/rest/get_company?id=4490822"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fguoshouchengda-pythonpachonggongchengshi-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fguoshouchengda-pythonpachonggongchengshi-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fguoshouchengda-pythonpachonggongchengshi-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/guoshouchengda-pythonpachonggongchengshi-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fguoshouchengda-pythonpachonggongchengshi-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3573258}},{"tool":"search_jobs","arguments":{"company":4490822,"detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3573258},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}