{"id":4518908,"url":"https://alion.io/job/ntt-data-data-scientist-ai-evaluation-and-responsible-ai","title":"Data Scientist - AI Evaluation and Responsible AI","company":{"id":50348,"name":"NTT DATA","domain":"nttdata.com","url":"https://alion.io/company/ntt-data","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Phenom","truth_index":{"grade":"A","score":88,"open_postings":234,"ghost_share":0.004,"stale_share":0.637,"repost_share":0.081,"time_to_fill_p50_days":19,"computed_at":"2026-11-18T05:48:20Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Cluj-Napoca, Romania"],"countries":["RO"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon CloudWatch","optional":false},{"name":"CI/CD","optional":false},{"name":"Gmail","optional":false},{"name":"Langfuse","optional":false},{"name":"LLM","optional":false},{"name":"LLM Evaluation","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"LLMOps","optional":false},{"name":"Machine Learning","optional":false},{"name":"New Relic","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"SQL","optional":false},{"name":"WhatsApp","optional":false}],"status":"live","first_seen_at":"2026-11-17T00:00:00Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-18T19:56:53Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Who We Are\nWe operate beyond organizational silos, combining deep expertise in data engineering and AI-driven solutions to design and deliver scalable, user-centric applications and modern data architectures. We support a wide range of industries, including Automotive, Banking, Insurance, Telecommunications, E-commerce, and Public Services.\nWe are looking for a Senior Data Scientist to own a shared evaluation framework, release gates and responsible-AI controls across machine learning, RAG, agent, document and vision use cases. The role works directly with delivery teams from baseline creation through release decisions, production monitoring and quality reporting.\nWhat You’ll Be Doing\nDefine evaluation strategies, golden datasets, metrics, thresholds and release gates for ML, RAG, agent, document and vision solutions.\nBuild automated evaluation harnesses, regression tests, red-team and prompt-injection tests, and human-evaluation protocols.\nDefine responsible-AI controls covering explainability, bias, PII, human oversight, traceability and model risk.\nIntegrate evaluation into CI/CD and MLOps or LLMOps pipelines.\nSpecify monitoring, alerts, model cards and audit evidence, and investigate production quality issues.\nWork hands-on with use-case teams from baseline creation to release decisions and report quality against business measures.\nChallenge weak evidence or unsafe release decisions constructively.\nDeliver reusable, tested Python code, evaluation assets and governance templates.\nWhat you'll bring along\nAt least 10 years of professional experience preferred\n6+ years of experience in data science, ML evaluation, model validation, experimentation or responsible AI.\n4+ years of strong Python and SQL experience with model, log and monitoring data.\nProduction experience evaluating and monitoring AI or ML systems.\nStrong foundation in statistics, experimental design, error analysis and calibration.\nExperience with RAG, LLM or agent evaluation and safety testing.\nAbility to challenge weak evidence or unsafe release decisions constructively.\nStrong technical communication, stakeholder influence, ownership, mentoring and judgment under ambiguity.\nExperience with adversarial testing, PII validation, Bedrock Guardrails, CloudWatch, New Relic, Langfuse or safety-sensitive applications is preferred.\nExcellent command of English, both written and spoken\n\nDocument\n\nWhat’s in it for you\nNew beginnings can be a challenge. We promise a smooth integration and a supportive mentor\nPick your working style: choose from Remote, Hybrid or Office work opportunities\nEarly bird or night owl? Our projects have different working hours to suit your needs\nNobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms\nWe want you to stay healthy! Enjoy our Private Health Insurance - it’s custom-made for you\nA clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School\nMake the most of our epic parties or themed events - they’re lovingly designed for our people and their families\nNTT DATA recruiters will never ask job seekers and candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties that may try to impersonate NTT DATA recruiters, either in writing or by phone, in an attempt to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will be associated with an @nttdata.com email address. NTT DATA will not use any non-NTT DATA or personal email domains (Gmail, Yahoo, etc.) or personal communication channels (WhatsApp, Facebook etc) at any time during the recruitment process. If you suspect any fraudulent activity, please contact us.\nNTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.\nNot the job for you? Perhaps you have a friend who would be a perfect fit. Send them this link!\nWhat’s in it for you\nNew beginnings can be a challenge. We promise a smooth integration and a supportive mentor\nPick your working style: choose from Remote, Hybrid or Office work opportunities\nEarly bird or night owl? Our projects have different working hours to suit your needs\nNobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms\nWe want you to stay healthy! Enjoy our Private Health Insurance - it’s custom-made for you\nA clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School\nMake the most of our epic parties or themed events - they’re lovingly designed for our people and their families\nMake this the place you grow\nYour unique talent is what matters. NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ethnicity, age, gender, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic.\n\nDocument\n\nThird parties fraudulently posing as NTT DATA recruiters\nNTT DATA recruiters will never ask job seekers and candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties that may try to impersonate NTT DATA recruiters, either in writing or by phone, in an attempt to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will be associated with an @nttdata.com email address. NTT DATA will not use any non-NTT DATA or personal email domains (Gmail, Yahoo, etc.) or personal communication channels (WhatsApp, Facebook etc) at any time during the recruitment process. If you suspect any fraudulent activity, please contact us.","description_format":"text","description_chars":6213,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Data Centers & Colocation","IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Managed IT Services (MSP)"],"lifecycle":[{"event":"open","at":"2026-11-18T08:16:49Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":19,"reasons":["conf:0","win:early","comp:brand"],"computed_at":"2026-11-18T20:11:29Z"},"pay":null,"html_url":"https://alion.io/job/ntt-data-data-scientist-ai-evaluation-and-responsible-ai","json_url":"https://alion.io/job/ntt-data-data-scientist-ai-evaluation-and-responsible-ai.json","meta":{"generated_at":"2026-11-18T20:11:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2153,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":50348},"rest":"https://alion.io/mcp/rest/get_company?id=50348"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fntt-data-data-scientist-ai-evaluation-and-responsible-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fntt-data-data-scientist-ai-evaluation-and-responsible-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fntt-data-data-scientist-ai-evaluation-and-responsible-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ntt-data-data-scientist-ai-evaluation-and-responsible-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fntt-data-data-scientist-ai-evaluation-and-responsible-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4518908}},{"tool":"search_jobs","arguments":{"company":"nttdata.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4518908},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}