{"id":2090997,"url":"https://alion.io/job/tietoevry-genai-quality-engineer","title":"GenAI Quality Engineer","company":{"id":6293,"name":"Tieto","domain":"tieto.com","url":"https://alion.io/company/tieto","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":75,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":29,"computed_at":"2026-10-13T05:45:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sofia, Bulgaria"],"countries":["BG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"GCP","optional":false},{"name":"LLM","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-10-08T12:49:24Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-13T23:30:41Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"Tieto Tech Consulting (MentorMate from 2001 to 2026) provides design-led, data-centric, and AI-powered digital engineering & consulting services to enterprises worldwide. With a strong heritage of Nordic quality, local presence, and global-scale operations, we are backed by 8,500+ IT professionals. Our clients trust us for advanced data and analytics skills, top industry-specific expertise, specialized software R&D, and the capabilities of a multinational team. We are part of Tieto, a leading technology company with an annual revenue of approximately EUR 2bn.\nTieto Tech Consulting’s team in Bulgaria consists of 500+ professionals specializing in the development of tailored digital solutions in diverse industries.\nWe are looking for a Quality Engineer with experience testing AI-powered products and building automated testing solutions. In this role, you will help ensure the quality, reliability, and performance of modern AI-first applications, including products powered by Large Language Models (LLMs).\nYou will work closely with engineering, product, and AI teams to define testing strategies, validate complex user scenarios, and build automation frameworks for rapidly evolving products.\nThis role is based on a hybrid work model, with 3 days per week in our Sofia office.\nKey Responsibilities\nValidate LLM-based applications and AI-generated outputs\nEvaluate quality, reliability, and behavior of probabilistic AI systems\nCreate test cases from evolving requirements\nIdentify gaps, inconsistencies, and risks in product requirements\nCollaborate with product managers, engineers, and AI specialists throughout the development lifecycle\nAnalyze defects, perform root cause analysis, and drive issue resolution\nRequired Qualifications\nExperience testing AI-powered applications, GenAI solutions, chatbots, copilots, or similar products\nUnderstanding of AI/ML concepts and Large Language Models (LLMs)\nStrong analytical and problem-solving skills\nExperience creating test plans, test cases, and quality metrics\nExcellent spoken and written English\nA significant advantage would be\nExperience with AI testing tools and frameworks\nExperience evaluating LLM responses for accuracy, relevancy, safety, and consistency\nFamiliarity with prompt engineering and AI quality assessment techniques\nKnowledge of Python or another programming language used in automation\nExperience working in Agile development environments\nExposure to cloud platforms such as Azure, AWS, or GCP\n At Tieto, we believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation. Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity.\nDiversity, equity and inclusion | Sustainability | Tieto\nStay alert to recruitment scams:\nTieto only communicates via @tieto.com email addresses.\nWe never ask candidates to pay fees or share financial details during recruitment.\nIf you receive a suspicious message claiming to be from Tieto, don't respond - verify it via our official careers site.\nFor more information visit Important Advisory Regarding Recruitment Fraud | Tieto Blog","description_format":"text","description_chars":3317,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Equity","Hybrid work"],"hiring_locations":[{"name":"Bulgaria","iso":"BG","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Managed IT Services (MSP)","EHR & Clinical Software"],"lifecycle":[{"event":"open","at":"2026-10-08T14:32:12Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.604,"p_room":1,"age_days":4,"expected_fill_days":29,"reasons":["conf:1","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-13T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/tietoevry-genai-quality-engineer","json_url":"https://alion.io/job/tietoevry-genai-quality-engineer.json","meta":{"generated_at":"2026-10-14T02:36:16Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3986,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6293},"rest":"https://alion.io/mcp/rest/get_company?id=6293"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftietoevry-genai-quality-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftietoevry-genai-quality-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftietoevry-genai-quality-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/tietoevry-genai-quality-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftietoevry-genai-quality-engineer"}]}