Data Acquisition Engineer
First seen by Alion on Nov 12, 2026.
Role: Data Acquisition Engineer
Location: Gurugram
About GobbleCube:
GobbleCube is an agentic operational layer with hyperlocal intelligence that helps brands drive revenue growth across ecommerce and quick commerce. It doesn't just surface insights, it detects revenue leaks, diagnoses underperformance, and autonomously executes the right interventions, with city, dark store, and SKU-level precision. The product is built by the core team that helped build and scale Blinkit into a category defining leader. That deep operational context, combined with advanced AI systems, allows GobbleCube to solve one of commerce's hardest problems: how to grow faster at scale, without relying on dashboards, alerts, or fragmented tools. In just one year since emerging, GobbleCube has onboarded 600+ brands and crossed $2M+ in ARR. Backed by InfoEdge Ventures and Kae Capital, the company is doubling down on its AI agents and expanding across platforms and geographies, and building toward a future where growth systems don't just show data, but tell teams what matters and help them act on it, faster than ever.
About the Role:
The role involves building and scaling automated web crawlers and data extraction systems using Python and Scrapy. You'll be also working on anti-bot and WAF challenges, optimizing proxies and crawler configurations, and building distributed systems using tools like Redis, Kafka, and Celery. Additionally, you will work on mobile API analysis, including understanding how iOS and Android applications communicate with backend systems and extracting data through APIs.
Key Responsibilities:
- Scale & Architecture: Architect, build, and optimize high-throughput crawler networks using Python and the Scrapy framework.
- Anti-Bot & WAF Defense: Develop robust, automated mechanisms to bypass advanced anti-bot protections, rate limits, enterprise WAFs (e.g., Akamai Bot Manager, Cloudflare, Datadome), and complex CAPTCHA challenges.
- Infrastructure Optimization: Implement proxy rotation, custom Scrapy middleware, request fingerprinting, header emulation, and TLS/JA3 fingerprint spoofing.
- Distributed Orchestration: Build distributed queuing and scraping architectures using Scrapy, Redis, Kafka, and Celery for seamless execution at scale.
- Mobile Reverse Engineering: Analyze mobile network traffic (iOS/Android), inspect API endpoints, perform certificate unpinning, and extract data directly from native mobile backend APIs.
Requirements:
- Scrapy Mastery: Deep internal knowledge of Scrapy (Twisted engine, asynchronous networking, custom pipelines, spider middleware, and extensions).
- Anti-Bot Infra Expertise: Proven track record bypassing enterprise anti-scraping systems (Akamai Bot Detection, Cloudflare, Imperva, Datadome, PerimeterX).
- Network & Protocol Mastery: Deep understanding of HTTP/HTTPS, HTTP/2, WebSocket protocols, TLS signatures/fingerprinting (JA3/JA4), request headers, and cookie management.
- Scale Experience: Direct experience running distributed crawling infrastructure handling millions of requests daily.
Preferred Qualifications:
- Mobile Application Reverse Engineering: Experience with tools like Frida, Charles Proxy, Mitmproxy, or Burp Suite to intercept, analyze, and bypass mobile SSL pinners.
- Device Farm Management: Hands-on experience working with mobile device farms (Real device or Emulated Android/iOS farms) for app automation.
- Browser Automation & Bypassing: Experience integrating Scrapy with undetected headless engines (Playwright, Selenium-Stealth, Puppeteer-Extra).
- Data Pipelines & Cloud Infrastructure: Familiarity with AWS/GCP, Docker, Kubernetes, and streaming message queues (Kafka, Redis, RabbitMQ).
Skills
Data Engineering, Python, Scrapy, Web Scraping, Redis, Kafka, Celery, HTTPS