{"id":3683489,"url":"https://alion.io/job/divar-ai-big-data-platform-engineer","title":"AI & Big Data Platform Engineer","company":{"id":62484,"name":"Divar","domain":"divar.ir","url":"https://alion.io/company/divar","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":true,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":95,"open_postings":3,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":363,"computed_at":"2026-11-04T06:34:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tehran, Iran"],"countries":["IR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"Ansible","optional":false},{"name":"Anthropic","optional":false},{"name":"Apache Kafka","optional":false},{"name":"ArgoCD","optional":false},{"name":"ClickHouse","optional":false},{"name":"Docker","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GitOps","optional":false},{"name":"Helm","optional":false},{"name":"Kubernetes","optional":false},{"name":"Langfuse","optional":false},{"name":"LiteLLM","optional":false},{"name":"LLM","optional":false},{"name":"Metabase","optional":false},{"name":"MLFlow","optional":false},{"name":"OpenAI","optional":false},{"name":"Pulumi","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"Terraform","optional":false},{"name":"Trino","optional":false},{"name":"vLLM","optional":false},{"name":"Grafana","optional":true},{"name":"Java","optional":true},{"name":"Prometheus","optional":true},{"name":"SGLang","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"VictoriaMetrics","optional":true}],"status":"live","first_seen_at":"2026-11-03T14:00:33Z","employer_posted_date":"2026-11-03","last_verified_at":"2026-11-04T09:54:44Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"At Divar, millions of people buy, sell and find what they need every day. Behind every data-driven decision and every AI feature in the product is a platform built and run by our team. We're looking for an AI & Big Data Platform Engineer to help build the next generation of that platform: on-premise, open source, and handling millions of events per day.\nWhat the team does\nProduct teams across Divar use our platform for two missions:\nData analysis: building pipelines, data products and dashboards to make data-driven decisions. This all runs on-premise on open-source tools such as Kafka, Spark, Trino, Iceberg, Ceph, S3, ClickHouse, Airflow, Metabase, DataHub, JupyterHub and Coder.\nAI in the product: fine-tuning, serving and evaluating models, and calling external AI providers safely. As the platform team, we build the self-service infrastructure behind this, so product teams can do it without managing GPUs or provider accounts themselves. We run our own GPU fleet with vLLM, operate a single AI gateway in front of both our self-hosted models and providers such as OpenAI, Anthropic and Google, and add cloud GPUs when extra capacity is needed.\nWe don't just move data. We build self-service platforms so that business data analysts, software engineers and ML engineers can ship on their own.\nResponsibilities\nDesign, build and operate our big data platform (lakehouse, query engines, orchestration) with a focus on reliability, performance and cost.\nBuild and run LLM-serving infrastructure on our GPU clusters (vLLM on Kubernetes), including capacity planning, benchmarking and model rollouts.\nOperate and evolve our AI gateway: provider routing and failover, virtual keys and quotas, observability and tracing (Langfuse), and usage and cost tracking for each team.\nBuild fine-tuning and MLOps infrastructure: training jobs on on-premise and rented GPUs, experiment tracking and a model registry (MLflow), and a clear path from experiment to production.\nProvide self-service development environments (JupyterHub, Coder) for data analysis and model development.\nProvide infrastructure for data governance, data quality, access control and privacy (e.g. PII anonymization) across the data and AI lifecycle.\nOwn monitoring, on-call and incident response for the services you run.\nRequirements\nBachelor's degree in Computer Science, Computer Engineering or a related field, or equivalent experience.\nProven experience as a Platform, Infrastructure/SRE, Data Infrastructure, MLOps or similar engineer.\nStrong Kubernetes and Docker skills, including running stateful services in production.\nExperience with GitOps and infrastructure as code: ArgoCD, Helm, Ansible, Terraform/Pulumi.\nHands-on experience with big data technologies such as Kafka, Spark, Trino, Iceberg, Ceph, S3 and with orchestration tools such as Airflow.\nProficiency in Python.\nA solid understanding of how LLMs work and how they're used in products: inference, context and tokens, prompting, RAG, and the basics of fine-tuning.\nExperience setting up, maintaining and customizing open-source tools (e.g. Airflow, JupyterHub, Coder, DataHub, MLflow, LiteLLM).\nA good understanding of data governance and security best practices.\nStrong problem-solving skills and a proactive approach to technical challenges.\nClear communication and effective teamwork.\nOwnership of what you build.\nNice to have\nExperience with Go or Java.\nFamiliarity with the ML lifecycle, model training workflows and MLOps tools such as MLflow.\nExperience with LLM serving (vLLM, SGLang, TensorRT-LLM) and GPU infrastructure (NVIDIA drivers, GPU scheduling on Kubernetes, multi-GPU inference).\nObservability (Prometheus/VictoriaMetrics, Grafana) and secret management (Vault).\nBenefits\nYou'll have a big impact. Your work will power data and AI features used by millions of people.\nYou'll work on hard, modern problems, from large-scale data to running LLMs on our own GPU fleet.\nYou'll be part of a team that values craftsmanship, speed and innovation.\nWe offer flexible working hours, health insurance, and a culture that values learning and autonomy.\nYou'll work with people who care about doing great work and enjoy it along the way.","description_format":"text","description_chars":4182,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Online Classifieds"],"lifecycle":[{"event":"open","at":"2026-11-03T14:00:33Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":363,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/divar-ai-big-data-platform-engineer","json_url":"https://alion.io/job/divar-ai-big-data-platform-engineer.json","meta":{"generated_at":"2026-11-04T14:17:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21657,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":62484},"rest":"https://alion.io/mcp/rest/get_company?id=62484"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdivar-ai-big-data-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdivar-ai-big-data-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdivar-ai-big-data-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/divar-ai-big-data-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdivar-ai-big-data-platform-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3683489}},{"tool":"search_jobs","arguments":{"company":"divar.ir","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3683489},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}