{"id":4516001,"url":"https://alion.io/job/hostgator-software-development-engineer-in-test-ai","title":"Software Development Engineer in Test - AI","company":{"id":1845199,"name":"Hostgator","domain":"hostgator.com.br","url":"https://alion.io/company/hostgator-com-br","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":null},"role":"QA","role_family":"QA","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AI Agents","optional":false},{"name":"AutoGen","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Context Engineering","optional":false},{"name":"CrewAI","optional":false},{"name":"Cypress","optional":false},{"name":"Docker","optional":false},{"name":"Embeddings","optional":false},{"name":"FAISS","optional":false},{"name":"Function Calling","optional":false},{"name":"GCP","optional":false},{"name":"GitHub","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab CI","optional":false},{"name":"GraphQL","optional":false},{"name":"Hallucination","optional":false},{"name":"Jenkins","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Multimodal AI","optional":false},{"name":"OpenAI","optional":false},{"name":"Pinecone","optional":false},{"name":"Playwright","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"Qdrant","optional":false},{"name":"RAG","optional":false},{"name":"Rest API","optional":false},{"name":"Robot Framework","optional":false},{"name":"Scrum","optional":false},{"name":"Selenium","optional":false},{"name":"Semantic Kernel","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"SQL","optional":false},{"name":"Structured Outputs","optional":false},{"name":"Weaviate","optional":false},{"name":"Claude","optional":true},{"name":"Copilot","optional":true},{"name":"Cursor","optional":true},{"name":"Gemini","optional":true},{"name":"Human-in-the-Loop","optional":true},{"name":"Knowledge Graph","optional":true},{"name":"LlamaIndex","optional":true},{"name":"Red Teaming","optional":true},{"name":"Reinforcement Learning","optional":true},{"name":"Reinforcement Learning","optional":true},{"name":"Self-Healing","optional":true}],"status":"live","first_seen_at":"2026-11-02T00:00:00Z","employer_posted_date":"2026-11-02","last_verified_at":"2026-11-18T06:59:39Z","board_verified":true,"closed_at":null,"days_open":16,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":16},"description":"Who we are.\nNewfold Digital is a leading web technology company serving millions of customers globally. Our customers know us through our robust portfolio of brands. We have some of the industry's most prominent and storied go-to-market brands, including Bluehost, HostGator, Domain.com, Network Solutions, Register.com and Web.com. We help customers of all sizes build a digital presence that delivers results. With our extensive product offerings and personalized support, we take pride in collaborating with our customers to serve their online presence needs. The strength of our company lives in the intersection of our people, our customers, and our brands.\nRole Summary:\nThis role goes beyond traditional QA; the ideal candidate should be capable of validating, evaluating, and improving AI-powered systems, agents, copilots, and LLM-driven workflows while building scalable automation frameworks and intelligent quality solutions. You will work closely with Engineering, AI/ML, Platform, Product, and DevOps teams to ensure reliability, safety, observability, scalability, and quality of modern AI-native applications and Agentic systems.\nWhat you'll do & how you'll make your mark.\n1. AI/LLM Quality Engineering\nDesign, validate, and optimize testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents. \nDevelop AI evaluation (Evals) frameworks for: Hallucination detection Groundedness Toxicity & bias validation Response quality Context relevance Prompt regression testing Determinism & consistency Safety and guardrail validation \nBuild automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics. \nCreate synthetic datasets and benchmark datasets for AI testing scenarios. \nTest multi-agent orchestration workflows and agent memory/context retention. \nValidate MCP (Model Context Protocol) integrations and tool interoperability.\nWork on Context Engineering, Prompt Engineering, and Prompt Optimization strategies.\nEvaluate latency, token usage, model cost optimization, throughput, and scalability. \n2. Automation Engineering\nDevelop and maintain scalable UI/API automation frameworks using: Python (mandatory)Robot Framework (preferred)Playwright/Selenium/Cypress. \nAutomate testing for: REST APIs GraphQL APIs Event-driven systems Streaming systems Webhooks Microservices MFE (Micro Frontend) architectures.\nBuild reusable automation libraries, utilities, and AI-assisted testing workflows.\nIntegrate automation into CI/CD pipelines and quality gates.\n3. AI Engineering & Platform Validation\nValidate RAG architectures including Chunking strategies Embedding quality Retrieval accuracy Re-ranking Vector search relevance\nWork with vector databases such as: Pinecone Weaviate ChromaDB Qdrant FAISS\nBuild or validate AI agents leveraging: LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel OpenAI SDKs\nValidate AI workflows involving: Tool calling Function calling Agent memory Agent planning/execution Multi-modal AI systems Structured outputs \n4. DevOps, Observability & Reliability\nBuild and maintain quality workflows integrated with: GitHub Actions Jenkins GitLab CI/CD Azure DevOps\nWork with Docker and Kubernetes environments.\nPerform cloud-based testing and deployments across AWS/Azure/OCI/GCP.\nValidate distributed systems reliability and resiliency. \nMonitor AI system behaviors using observability platforms/logging/tracing tools. \nContribute to shift-left and quality engineering best practices.\nWho you are & what you'll need to succeed.\nBachelor’s/Master’s degree in Computer Science, Engineering, AI/ML, or related field preferred.\nEquivalent hands-on experience and demonstrated projects are highly valued. \nStrong programming experience in Python \nStrong understanding of Software Testing & Quality Engineering principles\nHands-on experience with: AI/LLM testing Prompt Engineering Context Engineering AI Evals RAG systems AI Agents\nExperience with: CI/CD pipelines Docker & KubernetesCloud platforms (AWS/Azure/OCI/GCP) API testing & automation Microservices testing UI automation\nExperience with SQL and data validation\nStrong debugging, analytical, and troubleshooting skills\nExperience working in Agile/Scrum environments\nGood to have skills:\nExperience with Robot Framework\nExperience with Playwright\nKnowledge of: LangChain, LangGraph, LlamaIndex CrewAI Semantic Kernel MCP (Model Context Protocol)\nHands-on experience with: Cursor GitHub Copilot Claude Gemini OpenAI APIs\nExperience with vector databases and embeddings\nExposure to MLOps workflows and ML lifecycle testing\nKnowledge of performance testing and security testing\nExperience validating AI governance/compliance requirements\nExperience with contract testing, chaos testing, or resilience engineering\nFamiliarity with accessibility testing and cross-browser/device testing\nExposure to synthetic monitoring and production observability\nBonus Skills (High Impact)\nAI Red Teaming\nLLM Security Testing (Prompt Injection, Jailbreaks, Data Leakage)\nAgent Reliability & Safety Testing\nAI Cost Optimization\nDistributed Systems Testing\nTest Data Engineering\nFeature Flag Testing\nAI Observability & Telemetry\nReinforcement Learning feedback workflows\nHuman-in-the-loop evaluation systems\nKnowledge Graph integrations\nMulti-modal AI testing (vision/audio/text) \nWhat We’re Looking For\nEngineers who actively experiment with AI tools and build side projects, prototypes, PoCs, or open-source contributions.\nStrong problem solvers who can combine traditional QE practices with modern AI-native engineering approaches.\nPassion for innovation, developer productivity, automation acceleration, and intelligent testing.\nAbility to rapidly learn emerging AI frameworks, tools, and architectures. \nNice Portfolio Signals\nCandidates with one or more of the following will stand out:\nGitHub repositories showcasing AI/automation projects\nAI agents or copilots built personally or professionally\nContributions to open-source automation or AI ecosystems\nBlogs, talks, workshops, or technical content on AI/testing\nExperience integrating AI into SDLC or QE workflows\nExperience with autonomous testing systems or self-healing automation \nWhy you'll love us.\nWork-life balance. Our work is thrilling and meaningful, but we know balance is key to living well. \nWe celebrate one another’s differences. We’re proud of our culture of diversity and inclusion. We foster a culture of belonging. Our company and customers benefit when employees bring their authentic selves to work. We have programs that bring us together on important issues and provide learning and development opportunities for all employees. We have 20 + affinity groups where you can network and connect with Newfolders globally. \nWe care about you. We are a family, and we care about you and your family’s physical and mental health by providing competitive HMO benefits - 175k MBL with one free dependent upon one year of service! We also give out Punctuality Bonus, Generous Vacation policy, and much more! \nWhere can we take you? We’re fans of helping our employees learn different aspects of the business, be challenged with new tasks, be mentored, and grow their careers. Unfold new possibilities with #teamnewfold! \nThis Job Description includes the essential job functions required to perform the job described above, as well as additional duties and responsibilities. This Job Description is not an exhaustive list of all functions that the employee performing this job may be required to perform. The Company reserves the right to revise the Job Description at any time, and to require the employee to perform functions in addition to those listed above.","description_format":"text","description_chars":7725,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Generous vacation"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence"],"lifecycle":[{"event":"open","at":"2026-11-18T06:59:39Z"}],"visa":[],"liveness":{"score":70,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.777,"p_room":0.9,"age_days":16,"expected_fill_days":28,"reasons":["conf:1","win:mid"],"computed_at":"2026-11-18T08:07:13Z"},"pay":null,"html_url":"https://alion.io/job/hostgator-software-development-engineer-in-test-ai","json_url":"https://alion.io/job/hostgator-software-development-engineer-in-test-ai.json","meta":{"generated_at":"2026-11-18T08:07:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14343,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1845199},"rest":"https://alion.io/mcp/rest/get_company?id=1845199"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhostgator-software-development-engineer-in-test-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhostgator-software-development-engineer-in-test-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhostgator-software-development-engineer-in-test-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hostgator-software-development-engineer-in-test-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhostgator-software-development-engineer-in-test-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4516001}},{"tool":"search_jobs","arguments":{"company":"hostgator.com.br","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4516001},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}