{"id":4144616,"url":"https://alion.io/job/kae-capital-data-acquisition-engineer","title":"Data Acquisition Engineer","company":{"id":704695,"name":"Kae Capital","domain":"kae-capital.com","url":"https://alion.io/company/kae-capital","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":true,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Akamai","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Celery","optional":false},{"name":"Cloudflare","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Scrapy","optional":false},{"name":"WebSockets","optional":false},{"name":"AWS","optional":true},{"name":"Burp Suite","optional":true},{"name":"Charles Proxy","optional":true},{"name":"Docker","optional":true},{"name":"Frida","optional":true},{"name":"GCP","optional":true},{"name":"Kubernetes","optional":true},{"name":"Playwright","optional":true},{"name":"RabbitMQ","optional":true},{"name":"Selenium","optional":true}],"status":"live","first_seen_at":"2026-11-12T06:03:27Z","employer_posted_date":null,"last_verified_at":"2026-11-12T06:03:27Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Role: Data Acquisition Engineer\n\nLocation: Gurugram\n\nAbout GobbleCube:\n\nGobbleCube is an agentic operational layer with hyperlocal intelligence that helps brands drive revenue growth across ecommerce and quick commerce. It doesn't just surface insights, it detects revenue leaks, diagnoses underperformance, and autonomously executes the right interventions, with city, dark store, and SKU-level precision. The product is built by the core team that helped build and scale Blinkit into a category defining leader. That deep operational context, combined with advanced AI systems, allows GobbleCube to solve one of commerce's hardest problems: how to grow faster at scale, without relying on dashboards, alerts, or fragmented tools. In just one year since emerging, GobbleCube has onboarded 600+ brands and crossed $2M+ in ARR. Backed by InfoEdge Ventures and Kae Capital, the company is doubling down on its AI agents and expanding across platforms and geographies, and building toward a future where growth systems don't just show data, but tell teams what matters and help them act on it, faster than ever.\n\nAbout the Role:\n\nThe role involves building and scaling automated web crawlers and data extraction systems using Python and Scrapy. You'll be also working on anti-bot and WAF challenges, optimizing proxies and crawler configurations, and building distributed systems using tools like Redis, Kafka, and Celery. Additionally, you will work on mobile API analysis, including understanding how iOS and Android applications communicate with backend systems and extracting data through APIs.\n\nKey Responsibilities:\n\n- Scale & Architecture: Architect, build, and optimize high-throughput crawler networks using Python and the Scrapy framework.\n\n- Anti-Bot & WAF Defense: Develop robust, automated mechanisms to bypass advanced anti-bot protections, rate limits, enterprise WAFs (e.g., Akamai Bot Manager, Cloudflare, Datadome), and complex CAPTCHA challenges.\n\n- Infrastructure Optimization: Implement proxy rotation, custom Scrapy middleware, request fingerprinting, header emulation, and TLS/JA3 fingerprint spoofing.\n\n- Distributed Orchestration: Build distributed queuing and scraping architectures using Scrapy, Redis, Kafka, and Celery for seamless execution at scale.\n\n- Mobile Reverse Engineering: Analyze mobile network traffic (iOS/Android), inspect API endpoints, perform certificate unpinning, and extract data directly from native mobile backend APIs.\n\nRequirements:\n\n- Scrapy Mastery: Deep internal knowledge of Scrapy (Twisted engine, asynchronous networking, custom pipelines, spider middleware, and extensions).\n\n- Anti-Bot Infra Expertise: Proven track record bypassing enterprise anti-scraping systems (Akamai Bot Detection, Cloudflare, Imperva, Datadome, PerimeterX).\n\n- Network & Protocol Mastery: Deep understanding of HTTP/HTTPS, HTTP/2, WebSocket protocols, TLS signatures/fingerprinting (JA3/JA4), request headers, and cookie management.\n\n- Scale Experience: Direct experience running distributed crawling infrastructure handling millions of requests daily.\n\nPreferred Qualifications:\n\n- Mobile Application Reverse Engineering: Experience with tools like Frida, Charles Proxy, Mitmproxy, or Burp Suite to intercept, analyze, and bypass mobile SSL pinners.\n\n- Device Farm Management: Hands-on experience working with mobile device farms (Real device or Emulated Android/iOS farms) for app automation.\n\n- Browser Automation & Bypassing: Experience integrating Scrapy with undetected headless engines (Playwright, Selenium-Stealth, Puppeteer-Extra).\n\n- Data Pipelines & Cloud Infrastructure: Familiarity with AWS/GCP, Docker, Kubernetes, and streaming message queues (Kafka, Redis, RabbitMQ).\nSkills\nData Engineering, Python, Scrapy, Web Scraping, Redis, Kafka, Celery, HTTPS","description_format":"text","description_chars":3800,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Venture Capital"],"lifecycle":[{"event":"open","at":"2026-11-12T06:33:20Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":27,"reasons":["seen:0","win:early"],"computed_at":"2026-11-12T09:21:52Z"},"pay":null,"html_url":"https://alion.io/job/kae-capital-data-acquisition-engineer","json_url":"https://alion.io/job/kae-capital-data-acquisition-engineer.json","meta":{"generated_at":"2026-11-12T09:21:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19052,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":704695},"rest":"https://alion.io/mcp/rest/get_company?id=704695"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkae-capital-data-acquisition-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkae-capital-data-acquisition-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkae-capital-data-acquisition-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/kae-capital-data-acquisition-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkae-capital-data-acquisition-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4144616}},{"tool":"search_jobs","arguments":{"company":"kae-capital.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4144616},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}