Test Engineer Skill Level 3 [D.26.0165]

Applicants must already hold a TS/SCI clearance with a current Full Scope Polygraph before applying. We are not sponsoring or processing clearances for this position. Candidates who are seeking to obtain a clearance do not meet the minimum requirements.

Salary Range: $159k-$173k per year with an additional $40k-$43k in immediately vested company 401(k) contributions

Position Requirements: We are seeking a Senior Test Automation Engineer to design, build, and maintain automated test solutions across both back-end services (REST APIs) and web user interfaces. This role requires strong hands-on engineering skills in Linux command-line tooling, Python-based automation, containerized test execution (Docker/Podman), and CI/CD integration using Jenkins and GitLab pipelines. The successful candidate will also help evolve our existing in-house automation framework, including planning and executing migration efforts from legacy Robot Framework implementations to newer platforms.

Position Responsibilities

• Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
• Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
• Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
• Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
• Integrate automated test execution into Jenkins and GitLab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
• Use Linx command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
• Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
• Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
• Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests were appropriate.
• Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.
• Assist with any or all of the Level I tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts all related engineering acquisition and operations activities as needed to suppo1t the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&B schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&B planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan of data collected by the Testing Task
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
• Participate in the T&E Working-level Integrated Product Team (WIPT) and/or Integrated Test Team for coordination of evaluation plans
• Produce Evaluation Plans (metric framework, scenarios/threads, timelines, requirements/T&E cross-walk), Analysis Plans Data Requirements Risk Assessments, Evaluation Reports Status reports; provide input to Government T&E products (e.g., Technology Readiness Assessments, Test & Evaluation Strategy, Test & Evaluation Master Plan, T&E Plans & Procedures and Test Readiness Reports)
• Design data sampling schemes to optimize the information/resource balance and to control testing uncertainties
• Select, coordinate. and calibrate Instrumentation, collection and data management tools, targets, and facilities
• Ensure test readiness including training of test event participants re conduct of the event; equipment readiness, and security legal, and privacy compliance arrangements
• Participate in T&E WIPT and/or Integrated Test Team for coordination of data collection plan -
• Execute Testing and Data Collection per plan
• Produce associated Test Plans, Procedures, and Reports /Briefings, Data Management Plan
• Define and provide technical direction and guidance for the Level 1 tasks to the Level 0 and Level 1 TEs assigned to the task
• Recommend draft plans and reports from the Level 1 tasks for approval by the task leader
• Work directly with the Government sponsor to coordinate task implementation
• Maintain knowledge of current and evolving agency, national, and international standards applicable to the system development of interest
• Provide overall leadership of the T&E task and serve as primary liaison to the government for supporting contract coordination and task execution
• Communicate issues and solutions to the broader government and contract management structure as requested by Leadership
• Ensure the appropriate level of independence of the team from the solution provider to support government management of objectivity risk
• Manage T&E resources and tasks; ensure quality assurance of test processes and product
• Coordinate and integrate Evaluation and Testing tasks and products
• Participate in T&E WIPT and /or integrated Test Team as needed to ensure proper coordination of T&E activities
• Drive innovation and responsiveness to program changes and evolving T&E status to help manage program risk; develop alternative courses of action, work-arounds, and fall-back positions with a recommended course of action for each risk and monitor and re-evaluate risks at appropriate milestones

Basic Qualifications:

• Eight (8) years’ experience as a TE in programs and contracts of similar scope type and complexity is required. Bachelor’s degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or w1iversity is required. Four (4) years of additional TE experience may be substituted for a bache lor’ s degree.
• Strong experience with Linux and Bash shell scripting, with demonstrated ability to work effectively from the command-line and process/report on large data sets (logs, test artifacts, results).
• Advanced experience building test automation in Python, including Pytest-based frameworks and best practices for maintainable automated testing.
• Strong hands-on experience with Docker (or Podman) including building, versioning, and maintaining images used in automation and CI/CD workflows.
• Working knowledge of Jenkins and GitLab pipelines, including running containerized workloads and managing automated test stages.
• Experience with REST API testing, including validation of responses, authentication flows, and negative/error-path testing.
• Familiarity with Robot Framework UI automation using Selenium library (Python).
• Solid understanding of how to architect a test automation harness/framework for UI and/or API testing (test structure , configuration, reporting, environment management).
• Familiarity with SQL and tools such as SQL Developer, including writing queries and using them within automated validation steps.

Preferred Qualifications

• Experience planning and executing test automation framework migrations (e.g., Robot Framework to Microsoft Playwright or Robot Framework AIO).
• Experience improving CI performance, parallelization, and test execution efficiency in containerized environments.
• Strong debugging skills across services, CI logs, containers, and test reporting outputs.