{"id":166858,"url":"https://alion.io/job/cloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes","title":"Staff Software Engineer , Anywhere Cloud - AI Systems & Runtimes","company":{"id":58503,"name":"Cloudera","domain":"cloudera.com","url":"https://alion.io/company/cloudera","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":90,"open_postings":14,"ghost_share":0,"stale_share":0.357,"repost_share":0.071,"time_to_fill_p50_days":27,"computed_at":"2026-11-17T05:47:56Z"}},"role":"Backend","role_family":"Backend","seniority":"staff","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Jose, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":184000,"max":230000,"currency":"USD","period":"year","gross":null,"usd_annual":230000},"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWQ","optional":false},{"name":"C++","optional":false},{"name":"Docker","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Go","optional":false},{"name":"GPTQ","optional":false},{"name":"Hugging Face","optional":false},{"name":"Knative","optional":false},{"name":"KServe","optional":false},{"name":"Kubernetes","optional":false},{"name":"Llama","optional":false},{"name":"LlamaIndex","optional":false},{"name":"LLM","optional":false},{"name":"LoRA","optional":false},{"name":"Node JS","optional":false},{"name":"ONNX","optional":false},{"name":"PEFT","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"QLoRA","optional":false},{"name":"Quantization","optional":false},{"name":"Qwen","optional":false},{"name":"RAG","optional":false},{"name":"Rust","optional":false},{"name":"TorchServe","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"JavaScript","optional":true},{"name":"Transformers","optional":true}],"status":"closed","first_seen_at":"2026-06-08T00:00:00Z","employer_posted_date":"2026-09-14","last_verified_at":"2026-11-07T04:40:26Z","board_verified":false,"closed_at":"2026-11-07T04:40:26Z","days_open":152,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":151},"description":"Business Area:\nEngineeringSeniority Level:\nMid-Senior levelJob Description:\nAt Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.\nReady to take cloud innovation to the next level? Join Cloudera’s Anywhere Cloud team and help deliver a true “build your own pipeline, bring your own engine” experience - enabling data and AI workloads to run anywhere, without friction or vendor lock-in.\nWe bring the best of public cloud - cost efficiency, scalability, elasticity, and agility - to wherever data lives: public clouds, private data centers, and the edge. Powered by Kubernetes, our hybrid architecture separates compute and storage to maximize flexibility and optimize infrastructure usage.\nThis isn’t just cloud management - it’s about building a consistent, secure, and compliant cloud experience that gives organizations full access to all their data, anywhere.\nWith the acquisition of Taikun, we’re simplifying Kubernetes and cloud management even further, creating a unified, scalable, future-ready platform. If you’re passionate about Kubernetes - not just using it, but building it at the core, managing workloads across hybrid clouds and data centers, and obsessing over performance and DevOps - this is where you belong.\nWe are seeking a Staff Software Engineer to lead the architecture and delivery of our cloud-native AI platform. In this high-impact role, you will bridge the gap between cutting-edge AI research and production-grade Kubernetes environments. You will build the “nervous system” of our AI stack-optimizing how we run and manage open-source models (Llama, Qwen, etc.) using K8s-native patterns like Custom Resources (CRDs) and Operators, enabling agentic AI to thrive, and designing integration patterns that let our product teams and customers consume AI capabilities seamlessly.\nAs a Staff Software Engineer, you will:\nEnterprise AI Services: Design and implement elegant, scalable application services (Go/Node.js) that wrap AI capabilities for enterprise use.\n\nK8s-Native AI Orchestration: Lead the deployment of inference servers (vLLM, Triton) using KServe, KubeRay, or Knative to ensure serverless-style scaling for AI workloads.\n\nDeveloper Velocity: Build internal tooling, SDKs, and \"AI Gateways\" that enhance team agility and simplify the integration of Foundation Models (Llama, GPT) into product features.\n\nRAG & Prompt Engineering: Architect robust Retrieval-Augmented Generation (RAG) pipelines and prompt management services that integrate seamlessly with vector databases and enterprise data sources.\n\nCross-Functional Collaboration: Partner with UI engineers, UX designers, and Product Management to ensure the AI platform is not just powerful, but highly usable for internal developers.\n\nInfrastructure & Security: Ensure AI workloads are secure, multi-tenant, and optimized for GPU resource scheduling (MIG, fractional GPUs) within Kubernetes.\n\nWe’re excited about you if you have:\nBachelor’s degree with 6+ yearsof software engineering experience (or equivalent Masters/PhD tenure), with at least 2+ yearsfocused on AI/ML systems.\n\nExpert proficiency in Python(for AI ecosystem) and strong competence in a systems language like Goor Rust/C++(for high-performance serving layers).\n\nDeep understanding of LLM deployment challenges and runtimes (e.g., vLLM, ONNX, TorchServe, Triton). Familiarity with quantization techniques (AWQ, GPTQ) to optimize model size/speed.\n\nExperience building complex workflows using tools like LangChainor LlamaIndex, and deploying them on containerized infrastructure (Docker/Kubernetes).\n\nAbility to navigate the rapidly changing AI landscape, filtering hype from practical engineering solutions, and driving technical alignment across teams.\n\nYou May Also Have:\nModel Fine-Tuning:Experience with efficient fine-tuning techniques (PEFT, LoRA/QLoRA) on custom datasets.\n\nGPU Optimization:Familiarity with CUDAprogramming or profiling GPU performance (Nsight systems).\n\nOpen Source:Contributions to open-source AI projects (HuggingFace transformers, vLLM, etc.).\n\nWhy this role matters:\nThis is more than cloud management, it’s about building the foundation for a consistent, secure, and compliant cloud experience that gives organizations 100% access to 100% of their data, anywhere.\nWith the recent acquisition of Taikun, we are simplifying Kubernetes and cloud management even further, creating a platform that is unified, scalable, and future-ready.\nIf you are passionate about Kubernetes, not just using it but building it at the core managing workloads across hybrid clouds and datacenters and obsessed with performance, devops, etc. this is where you belong.\nThis role is not eligible for immigration sponsorship.\nThe anticipated annual base salary range for this position is:\nCalifornia: $184,000- $230,000\n\nIndividual compensation within the published range is determined by the candidate's skills, experience, qualifications, and primary work location. In addition to base pay, sales roles are eligible for Cloudera's commission plan, while non-sales roles are eligible for the corporate incentive plan. All employees receive a comprehensive benefits package.\nWhat you can expect from us:\nGenerous PTO Policy\n\nSupport work life balance with Unplugged Days\n\nFlexible WFH Policy\n\nMental & Physical Wellness programs\n\nPhone and Internet Reimbursement program\n\nAccess to Continued Career Development\n\nComprehensive Benefits and Competitive Packages\n\nPaid Volunteer Time\n\nEmployee Resource Groups\n\nEEO/VEVRAA","description_format":"text","description_chars":5806,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Internet reimbursement","Wellness"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Query Engines & Big Data Processing","Data Warehouses & Lakehouses","MLOps"],"lifecycle":[{"event":"open","at":"2026-06-08T00:00:00Z"},{"event":"close","at":"2026-11-07T04:40:26Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 38 · green card filings: 5","filings_12m":38,"filings_prev_12m":62,"green_card_filings_12m":5,"median_offered_wage_usd":177733,"route":null,"cap_exempt":false,"checked_at":"2026-11-17T07:35:00+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":27}],"liveness":null,"pay":{"stated_usd_annual":230000,"is_top_pay":false},"html_url":"https://alion.io/job/cloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes","json_url":"https://alion.io/job/cloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes.json","meta":{"generated_at":"2026-11-18T00:16:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":489,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58503},"rest":"https://alion.io/mcp/rest/get_company?id=58503"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/cloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcloudera-staff-software-engineer-anywhere-cloud-ai-systems-runtimes"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":166858}},{"tool":"search_jobs","arguments":{"company":"cloudera.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":166858},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}