{"id":1829557,"url":"https://alion.io/job/atlassian-senior-machine-learning-engineer-ai-native-evaluation-search","title":"Senior Machine Learning Engineer, AI-Native Evaluation & Search","company":{"id":182,"name":"Atlassian","domain":"atlassian.com","url":"https://alion.io/company/atlassian","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"A","score":100,"open_postings":3,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":6,"computed_at":"2026-10-14T06:34:16Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","Mountain View, United States","Seattle, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":168000,"max_usd":299000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":295},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"Agile","optional":false},{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Embeddings","optional":false},{"name":"Fine-tuning","optional":false},{"name":"Function Calling","optional":false},{"name":"Java","optional":false},{"name":"Kotlin","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"NLP","optional":false},{"name":"Post-training","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tool Use","optional":false},{"name":"TypeScript","optional":false}],"status":"live","first_seen_at":"2026-10-04T11:58:41Z","employer_posted_date":"2026-10-04","last_verified_at":"2026-10-14T22:37:45Z","board_verified":true,"closed_at":null,"days_open":10,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":10},"description":"Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian’s AI products.\nWorking at Atlassian\nAtlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.\nResponsibilities\nYour role and impact\nYou will develop and productionize machine learning systems for search, retrieval, ranking, conversational experiences, and AI agents. You will own projects across the ML lifecycle, from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.\nA key part of this role is making evaluation a first-class part of AI development. You will help define quality, build evaluation datasets and benchmarks, analyze model behavior, and use results to guide product and engineering decisions.\nYou will collaborate with product managers, software engineers, data scientists, research scientists, and platform teams. You will independently solve complex problems, contribute to technical direction, and mentor other engineers.\nWhat you’ll do\nBuild and productionize machine learning models and AI systems for Search & Intelligence products.\n\nOwn projects from concept through deployment, monitoring, evaluation, and iteration.\n\nDevelop AI-native experiences across search, retrieval, ranking, recommendations, conversational systems, and agentic workflows.\n\nDesign evaluation-driven development processes, including quality metrics, test cases, benchmarks, and acceptance criteria.\n\nBuild evaluation datasets, regression suites, and pipelines for search, RAG, chat, and agentic systems.\n\nConduct offline and online evaluations, human assessments, model-based evaluations, and error analysis.\n\nDesign scalable architectures that meet requirements for quality, reliability, latency, privacy, and cost.\n\nApply modern techniques in information retrieval, ranking, embeddings, NLP, deep learning, and large language models.\n\nCommunicate technical decisions and results clearly across technical and non-technical audiences.\n\nMentor engineers and contribute to engineering and ML best practices.\n\nQualifications\nOn your first day, we’ll expect you to have\nA Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent experience.\n\nAt least 4 years of experience developing and deploying machine learning or AI systems in production.\n\nStrong Python skills and experience with Java, Kotlin, TypeScript, or another production language.\n\nExperience with SQL and large-scale data processing technologies such as Spark.\n\nExperience building, evaluating, deploying, and scaling models with large datasets.\n\nExperience designing evaluation strategies, analyzing model quality, and using results to guide improvements.\n\nFamiliarity with cloud-based ML and data platforms such as AWS or Databricks.\n\nAbility to independently solve ambiguous problems and deliver practical, production-quality solutions.\n\nStrong communication and collaboration skills.\n\nAn agile mindset and commitment to continuous improvement.\n\nIt’s great, but not required, if you have\nExperience building AI-native products, RAG systems, conversational assistants, or tool-using agents.\n\nExperience with evaluation-driven development, benchmarks, regression testing, human evaluation, or LLM-as-a-judge.\n\nExperience evaluating agent planning, tool use, task completion, or multi-step reasoning.\n\nExperience with search relevance, ranking, recommendations, personalization, embeddings, or NLP.\n\nExperience fine-tuning, post-training, evaluating, or optimizing large language models.\n\nExperience with ML platforms, model serving, data pipelines, observability, or responsible AI.\n\nExperience mentoring engineers or influencing technical direction within a team.\n\nBenefits & Perks\nAtlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more. To learn more, visit go.atlassian.com/perksandbenefits.\nAbout Atlassian\nAt Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.\nWe believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.\nTo provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.\nTo learn more about our culture and hiring process, visit go.atlassian.com/crh .\nIn line with local law, identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.","description_format":"text","description_chars":5564,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Service & Asset Management","Project & Work Management Software","Developer Tools","Intranet & Knowledge Management"],"lifecycle":[{"event":"open","at":"2026-10-04T11:58:41Z"}],"visa":[],"liveness":{"score":34,"band":"fade","label":"Fading","p_open":1,"p_active":0.758,"p_room":0.45,"age_days":9,"expected_fill_days":6,"reasons":["conf:4","velocity","win:tail","comp:brand"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/atlassian-senior-machine-learning-engineer-ai-native-evaluation-search","json_url":"https://alion.io/job/atlassian-senior-machine-learning-engineer-ai-native-evaluation-search.json","meta":{"generated_at":"2026-10-15T01:28:04Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1935,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":182},"rest":"https://alion.io/mcp/rest/get_company?id=182"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fatlassian-senior-machine-learning-engineer-ai-native-evaluation-search"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fatlassian-senior-machine-learning-engineer-ai-native-evaluation-search"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fatlassian-senior-machine-learning-engineer-ai-native-evaluation-search"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/atlassian-senior-machine-learning-engineer-ai-native-evaluation-search\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fatlassian-senior-machine-learning-engineer-ai-native-evaluation-search"}]}