{"id":2458513,"url":"https://alion.io/job/ontrac-solutions-production-engineer-ic4-2","title":"Production Engineer (IC4)","company":{"id":2634,"name":"Ontrac Solutions","domain":"ontracsolutions.net","url":"https://alion.io/company/ontrac-solutions","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Breezy","truth_index":{"grade":"B","score":75,"open_postings":8,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-20T05:45:00Z"}},"role":"DevOps","role_family":"DevOps","seniority":"middle","employment_type":"contractor","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Chicago, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":81000,"max_usd":164000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":620},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Ansible","optional":false},{"name":"Chef","optional":false},{"name":"CI/CD","optional":false},{"name":"Configuration Management","optional":false},{"name":"GitHub","optional":false},{"name":"GitLab","optional":false},{"name":"Linux","optional":false},{"name":"OpenSSL","optional":false},{"name":"Puppet","optional":false},{"name":"Python","optional":false},{"name":"Grafana","optional":true},{"name":"Perl","optional":true},{"name":"Prometheus","optional":true},{"name":"Splunk","optional":true}],"status":"live","first_seen_at":"2026-09-28T16:57:53Z","employer_posted_date":"2026-09-28","last_verified_at":"2026-10-20T03:19:59Z","board_verified":true,"closed_at":null,"days_open":21,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":21},"description":"Overview\nOntrac Solutions is seeking a high-aptitude Production Engineer (IC2) to support a large-scale enterprise OS modernization and infrastructure hardening program for one of our enterprise clients. This role is built for an engineer with real software engineering foundations - specifically Python - who has since moved into infrastructure and is comfortable working across OS modernizations (RHEL7 → EL8/EL9), packaging migrations (Chef → CINC), and CI/CD hardening, while simultaneously executing hands-on runbooks, automation, and service onboarding.\nThis is a genuine hybrid role: roughly half build - Python tooling, RPM packaging, pipeline and rollback work - and half operate - runbooks, service onboarding, and Tier-2 break/fix. You will work directly with the client's SRE organization, internal engineering teams, and customer stakeholders from initial definition through final delivery. Candidates who are pure application developers with no Linux fleet exposure, and candidates who are pure operations with no real software engineering behind them, will not clear screening.\nWhat your application must clearly show\nWe screen against the requirements below exactly as written - your resume should make these easy to find. Specifics matter more than vocabulary: a resume that restates this posting's terminology without the detail below will not advance.\n Python you actually wrote, described as software, not as a skills keyword. Name the project, what it did, who depended on it, and how it was tested and shipped. \"Python (scripting)\" in a skills list will not clear this bar. A GitHub, GitLab, or public repo link is strongly preferred - we look at code.\n RPM packaging you personally did. Name the .spec files you authored or maintained, how you handled dependencies and versioning, your build tooling (rpmbuild, mock, Koji, or an internal builder), roughly how many packages you owned, and where they were published.\nA real OS migration you worked on - with version numbers and what actually broke. System Python 2→3, OpenSSL and crypto-policy changes, systemd unit differences, deprecated or renamed packages. We are more interested in the failure modes you hit than in the name of the program.\n Configuration management you have run in production - Chef (cookbooks, recipes, Ohai, Test Kitchen/InSpec), CINC, Puppet, Ansible, or Salt. Say which resources you wrote and how you tested convergence.\nMonitoring and logging work you executed. Name the stack, what you onboarded to it, and what you actually instrumented - metrics, dashboards, alert rules, log pipelines - not just the product name.\nTier-2 or on-call experience: the rotation you carried, the scale of the fleet behind it, and one incident you personally drove to resolution.\nCI/CD pipelines you built or hardened, including how rollout and rollback were handled when a change went wrong.\nYour certifications, named, with dates and credential IDs or verification links - we verify certifications.\nShortly after you apply you will receive a short role-specific questionnaire - completing it promptly is the fastest way to move into screening.\nRequired Qualifications:\nSoftware engineering foundation: 3+ years of professional software engineering experience, with strong hands-on Python. You have written and maintained code other engineers depended on - modules, packaging, tests, code review, and version control, not just single-file scripts.\nEnterprise OS modernization: Hands-on experience with enterprise Linux at fleet scale and with large-scale OS upgrade programs - RHEL7 → EL8/EL9 or an equivalent major-version migration you executed rather than observed.\nPackaging migrations: Experience building RPM packages to replace legacy configuration, and with large-scale packaging or configuration-management migrations such as Chef → CINC.\nIndependent bug ownership: Able to triage, own, and resolve bugs end to end without hand-holding - reproduce, isolate, fix, test, and ship.\nCI/CD and release safety: Ability to harden CI/CD pipelines, observability frameworks, and rollout/rollback mechanisms specifically tailored for legacy-to-modern infrastructure transitions.\nTier-2 operational support: Willingness and experience to partner closely with an SRE team providing \"follow-the-sun\" tier-2 support, including hands-on incident response and break/fix operations on existing platforms.\nService onboarding: Experience onboarding services to newly established monitoring and logging stacks.\nAutomation and documentation: A demonstrated habit of automating repetitive operations and documenting technical procedures for others to run.\nLocation and work authorization: Must be located in the United States and authorized to work in the US.\nPreferred Qualifications:\nProven experience planning and executing logging and monitoring tool rollouts end to end - not only operating a stack someone else stood up.\nExperience supporting a team through cloud cutovers and component migrations to cloud environments.\nPerl scripting experience - legacy tooling in this environment is Perl, and the ability to read and safely modify it is a real advantage.\nHands-on exposure to modern observability tooling - Chronosphere, Prometheus, or Grafana - and to Splunk integrations.\nProvisioning and image work: Kickstart/PXE, golden images, or repository and mirror management.\nKey Responsibilities - OS Modernization & Packaging:\nDrive the technical transition of legacy systems to modern enterprise Linux environments, including RHEL7 → EL8/EL9 upgrade paths.\nBuild and maintain RPM packages to replace legacy configuration, and carry the packaging migration from Chef to CINC.\nDevelop and execute automated runbooks that make the migration repeatable rather than manual.\nTriage, own, and resolve migration bugs independently, from first report through verified fix.\nKey Responsibilities - Observability & Monitoring Transition:\nTransition monitoring infrastructure to a modern stack - Chronosphere, Prometheus, and Grafana - and manage Splunk integrations.\nOnboard services to the newly established monitoring and logging stacks, including metrics, dashboards, and alert rules.\nHarden observability frameworks alongside the pipelines they instrument, so regressions surface before users find them.\nKey Responsibilities - CI/CD, Rollout & Rollback:\nHarden CI/CD pipelines for legacy-to-modern infrastructure transitions, including build, test, and package promotion stages.\nDesign and maintain rollout and rollback mechanisms that make large-fleet changes reversible.\nAutomate repetitive operational work and replace manual runbook steps with tested, reviewed code.\nKey Responsibilities - Tier-2 Operations & Migration Support:\nProvide Tier-2 operational support and incident response under a follow-the-sun model, in close partnership with the client's SRE team.\nPerform hands-on break/fix operations on existing platforms while the modernization proceeds in parallel.\nAssist application developers with architectural support and troubleshooting during cloud migration phases.\nAuthor and maintain technical documentation - runbooks, migration procedures, and package and pipeline ownership notes.\n__________________________________\n\nOntrac Solutions has partnered with PinpointVerify to help genuine applicants rise above the noise. Today, qualified candidates are too often overshadowed by fake and fraudulent applications. PinpointVerify gives our recruiters confidence that you are exactly who you say you are - and gives you aportable verification credential you can share with any employer.\nApplicants who complete verification are prioritized over non-verified candidates with comparable experience. And if you're hired, Ontrac reimburses the full cost of your verification.\nGet verified → https://pinpointverify.com/ontrac","description_format":"text","description_chars":7804,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Predictive Analytics","AI Consulting & Integration","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-10-13T16:41:22Z"}],"visa":[],"liveness":{"score":73,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.812,"p_room":0.9,"age_days":21,"expected_fill_days":31,"reasons":["conf:2","velocity","win:mid"],"computed_at":"2026-10-20T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/ontrac-solutions-production-engineer-ic4-2","json_url":"https://alion.io/job/ontrac-solutions-production-engineer-ic4-2.json","meta":{"generated_at":"2026-10-20T06:31:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7132,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2634},"rest":"https://alion.io/mcp/rest/get_company?id=2634"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fontrac-solutions-production-engineer-ic4-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fontrac-solutions-production-engineer-ic4-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fontrac-solutions-production-engineer-ic4-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ontrac-solutions-production-engineer-ic4-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fontrac-solutions-production-engineer-ic4-2"}]}