{"id":4497966,"url":"https://alion.io/job/gramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2","title":"Senior Software Security Engineer - AI Benchmark Development","company":{"id":5702,"name":"Gramian Consulting Group","domain":"gramianconsultinggroup.com","url":"https://alion.io/company/gramianconsultinggroup","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":null},"role":"Security","role_family":"Security","seniority":"senior","employment_type":"contractor","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["ID","KE","NG","PK","TR","VN"],"hiring_countries_total":6,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Bash","optional":false},{"name":"C#","optional":false},{"name":"C++","optional":false},{"name":"CodeQL","optional":false},{"name":"CVE","optional":false},{"name":"CWE","optional":false},{"name":"Docker","optional":false},{"name":"Git","optional":false},{"name":"Harbor","optional":false},{"name":"JavaScript","optional":false},{"name":"Kotlin","optional":false},{"name":"Linux","optional":false},{"name":"OWASP Top 10","optional":false},{"name":"PHP","optional":false},{"name":"Python","optional":false},{"name":"Ruby","optional":false},{"name":"Rust","optional":false},{"name":"Semgrep","optional":false},{"name":"TypeScript","optional":false}],"status":"live","first_seen_at":"2026-11-18T00:19:29Z","employer_posted_date":"2026-11-18","last_verified_at":"2026-11-18T00:19:29Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Gramian\nGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.\nAbout the Role\nWe are seeking an experienced Senior Software Security Engineer to develop high-quality training and evaluation tasks for advanced AI coding models. You will transform real-world software vulnerabilities, including CVEs, security advisories, and open-source bug reports, into realistic Harbor-format audit-and-patch tasks across multiple programming languages.\nThis role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. You will create tasks that assess whether AI systems can identify vulnerabilities, understand their underlying causes, reproduce security issues, and implement reliable fixes rather than simply recognizing familiar patterns or copying existing patches.\nThe ideal candidate has strong professional software engineering experience, deep practical knowledge of application security, and the ability to independently investigate vulnerabilities and build reproducible testing environments.\nEngagement Type: Contractor assignment\nDuration: 3 months\nStart Date: Expected to start next week\nCommitment: 40 hours per week\nWork Arrangement: Fully remote\nProject Focus: AI coding model training and evaluation, software vulnerability research, and secure patch development.\nKey Responsibilities\nVulnerability Research: Source and investigate real-world vulnerabilities from CVEs, security advisories, bug reports, and open-source repositories.\nSecurity Classification: Identify and classify vulnerabilities using the most specific applicable CWE and map them to relevant OWASP Top 10 categories where appropriate.\nVulnerability Reproduction: Reproduce security issues and develop reliable proof-of-vulnerability tests that demonstrate the underlying weakness.\nBenchmark Development: Build Harbor-format audit-and-patch tasks across multiple programming languages and software ecosystems.\nTask Authoring: Write realistic task instructions that describe the security issue without revealing vulnerable code, exploit details, or the expected remediation.\nEnvironment Setup: Create reproducible Docker-based environments with pinned dependencies, clear setup instructions, and reliable execution procedures.\nVerifier Development: Design and harden automated verifiers to prevent gaming, test manipulation, hardcoded solutions, and overfitting.\nPatch Evaluation: Review and score AI-generated patches and technical reasoning using structured security and engineering rubrics.\nQuality Assurance: Identify tasks that can be solved through superficial pattern matching or copying known upstream patches without understanding the vulnerability.\nTechnical Documentation: Document vulnerability context, reproduction steps, expected behavior, patch requirements, test methodology, and review decisions.\nRequirements\n5+ years of professional software engineering experience.\n\nExpert-level proficiency in at least one of the following programming languages:\n\nPython\n\nJavaScript / TypeScript\n\nJava\n\nC / C++\n\nC#\n\nGo\n\nRust\n\nRuby\n\nPHP\n\nKotlin\n\nSwift\n\nStrong understanding of software security principles and common vulnerability classes.\n\nPractical knowledge of CWE, CVE, and OWASP Top 10.\n\nAbility to independently reproduce vulnerabilities and develop proof-of-vulnerability tests.\n\nHands-on experience with security testing and analysis tools, including:\n\nSanitizers\n\nFuzzers\n\nStatic-analysis tools such as CodeQL or Semgrep\n\nStrong proficiency with Git, Linux, Bash, and Docker.\n\nAbility to create automated tests and reproducible technical evaluation environments.\n\nExcellent technical writing skills, with the ability to explain complex security issues and remediation requirements clearly.\n\nAbility to work independently in a fully remote, research-oriented environment.","description_format":"text","description_chars":4074,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Indonesia","iso":"ID","kind":"country"},{"name":"Kenya","iso":"KE","kind":"country"},{"name":"Nigeria","iso":"NG","kind":"country"},{"name":"Pakistan","iso":"PK","kind":"country"},{"name":"Turkey","iso":"TR","kind":"country"},{"name":"Vietnam","iso":"VN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Application Security","IT Consulting & Digital Transformation","Management Consulting"],"lifecycle":[{"event":"open","at":"2026-11-18T00:19:29Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":11,"reasons":["conf:4","win:early"],"computed_at":"2026-11-18T05:13:53Z"},"pay":null,"html_url":"https://alion.io/job/gramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2","json_url":"https://alion.io/job/gramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2.json","meta":{"generated_at":"2026-11-18T05:13:53Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9481,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5702},"rest":"https://alion.io/mcp/rest/get_company?id=5702"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fgramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fgramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fgramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/gramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fgramian-consulting-group-senior-software-security-engineer-ai-benchmark-development-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4497966}},{"tool":"search_jobs","arguments":{"company":"gramianconsultinggroup.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4497966},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}