{"id":592302,"url":"https://alion.io/job/hackerrank-lead-data-engineer","title":"Lead Data Engineer","company":{"id":2193,"name":"HackerRank","domain":"hackerrank.com","url":"https://alion.io/company/hackerrank","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":75,"open_postings":30,"ghost_share":0.4,"stale_share":0,"repost_share":0.067,"time_to_fill_p50_days":45,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":39000,"max_usd":68000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":16},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Apache Hudi","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"ClickHouse","optional":false},{"name":"Delta Lake","optional":false},{"name":"Druid","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Presto","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"StarRocks","optional":false},{"name":"Trino","optional":false}],"status":"live","first_seen_at":"2026-06-08T07:40:53Z","employer_posted_date":"2026-09-10","last_verified_at":"2026-10-17T06:23:26Z","board_verified":true,"closed_at":null,"days_open":131,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":130},"description":"HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill the next generation of developers based on skills, not pedigree. Our platform is trusted by over 2,500 of the world’s most innovative companies to build strong engineering teams ready for what’s next.\nSoftware has entered an era where humans and AI build side by side. As this shift accelerates, the definition of strong technical talent is changing. We give companies better ways to identify and invest in next-generation skills.\nPeople at HackerRank care deeply about the impact of their work and sweat the small details so our customers can be wildly successful with products they genuinely love to use. We move with urgency and believe great outcomes come from high standards.\nAbout the role\nHackerRank's data platform is at an inflection point. We've completed a multi-year modernisation - migrating from Redshift to StarRocks + Apache Hudi - and cut export latencies from 25 seconds to under 5 seconds. The infrastructure groundwork is done. Now we're building the AI-native data layer that will power revenue-generating features like natural language querying for HackerRank for Work customers.\nAs Lead Data Engineer, you'll be a senior individual contributor at the heart of the data organisation - owning complex platform decisions, collaborating cross-functionally with AI, product, and go-to-market teams, and shipping data-driven features that directly drive revenue. This is a greenfield opportunity to shape the next phase of data at HackerRank.\nWhat you will do\nOwn and evolve the data platform - StarRocks (OLAP), Apache Hudi (Data Lake), Trino, Spark, and Apache Ranger - ensuring performance, reliability, and security at scale.\nBuild the next-gen AI-optimised data layer: clean, structured datasets that power natural language querying and AI add-on features for HackerRank for Work customers.\nOwn in-product data features - exports, insights dashboards, interview analytics, and the self-serve Custom Reports interface.\nEnable self-service pipelines for internal teams (AI platform, analytics, go-to-market), reducing ad-hoc data requests and scaling data access across the org.\nEnforce robust data security - access controls, Apache Ranger policies, and confidence-scoring guardrails for AI-generated outputs.\nLead technical design reviews and define engineering standards for the data team.\nPartner with PMs and business stakeholders to proactively identify and scope AI-enabled data use cases.\nWho you are\n6+ years of data engineering experience, with at least 2 years in a senior or lead capacity.\nDeep hands-on expertise with OLAP databases - StarRocks, ClickHouse, Druid, or similar.\nStrong experience with data lake technologies - Apache Hudi, Iceberg, or Delta Lake.\nProficient with distributed query engines (Trino / Presto) and batch/streaming compute with Apache Spark.\nSolid understanding of data security, RBAC, and access control tools like Apache Ranger.\nComfortable working in a hybrid AWS + open-source self-managed environment.\nStrong communicator who can translate technical decisions for non-technical stakeholders and drive cross-functional projects independently.\nEven better if you have\nHands-on experience with AI/LLM-adjacent data work - confidence scoring, agentic pipelines, RAG architectures, or vector stores.\nPrior exposure to agentic workflows and understanding how to operationalise emerging AI concepts at production scale.\nExperience scaling data infrastructure at a SaaS or B2B product company.\nFamiliarity with natural language querying interfaces or building data products for end-customer consumption.\nYou will thrive in this role if\nYou're energised by working on a platform that's both technically mature and still has enormous greenfield ahead of it.\nYou don't wait for a PM to hand you a roadmap - you proactively connect data capabilities to business outcomes.\nYou care as much about how other teams use data as you do about the pipelines that produce it.\nYou're genuinely curious about AI and want to be close to where data and intelligence intersect.\nYou thrive in lean, cross-functional environments where your decisions have visible, company-wide impact.\nWant to learn more about HackerRank? Check out HackerRank.com to explore our products, solutions and resources, and dive into our story and mission here.\nHackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines. \nLinkedin | X | Blog | Instagram | Life@HackerRank\nNotice to prospective HackerRank job applicants:\nOur Recruiters use @hackerrank.com email addresses.\nWe never ask for payment or credit check information to apply, interview, or work here.","description_format":"text","description_chars":5021,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Skill Assessment","Recruiting Software & ATS"],"lifecycle":[{"event":"open","at":"2026-09-10T13:18:08Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":1,"p_active":0.588,"p_room":0.28,"age_days":130,"expected_fill_days":45,"reasons":["conf:3","velocity","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/hackerrank-lead-data-engineer","json_url":"https://alion.io/job/hackerrank-lead-data-engineer.json","meta":{"generated_at":"2026-10-17T07:51:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10589,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2193},"rest":"https://alion.io/mcp/rest/get_company?id=2193"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhackerrank-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhackerrank-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhackerrank-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hackerrank-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhackerrank-lead-data-engineer"}]}