Data Operations Engineer II
Want to be part of a team that builds, monitors, and maintains the data ingestion systems behind the world’s most accurate weather source, running reliably around the clock? We are looking for a Data Operations Engineer II who displays a deep interest in and passion for scripting, automation, and operational reliability; an experienced and detail-oriented individual who likes to diagnose systems and help identify areas of improvement. Reporting directly to the Manager, Data Operations, this position will be responsible for building, monitoring, and independently maintaining the data ingestion processes and systems that move, store, and transform data across platforms - including administering Databricks, our Data Marketplace and Ad Platform, and the core weather, locations, and provider data that power AccuWeather’s products. You will develop, maintain, and optimize complex scripts to automate data collection and monitoring, build end-to-end monitoring systems and automated alert mechanisms to ensure pipeline health, and troubleshoot issues to ensure continuous operation and data integrity.
You will demonstrate skill across multiple platforms, solve technical problems independently, and collaborate with peers and stakeholders in an Agile-based environment, to deliver reliable data operations that cater to a global audience.
We are open to hiring candidates to work from our global headquarters in State College, PA, USA, or remotely.
KEY RESPONSIBILITIES
· Build, monitor, and maintain data ingestion processes and systems that move, store, and transform data across platforms, administering Databricks and our Data Marketplace and Ad Platform.
· Develop, maintain, and optimize complex scripts using Python, PowerShell, or similar languages to automate data collection and monitoring.
· Own the operational state of a defined set of data pipelines - monitoring, incident response, maintenance procedures, and escalation for systems in your scope.
· Own SQL database maintenance (Forecast, current, historical, locations) for data loading and deployment.
· Develop and maintain unit test coverage for Data Ops code bases, ensuring scripts and pipelines behave as expected before deployment.
· Administer GoAnywhere and other managed file transfer platforms.
· Build and manage end-to-end monitoring systems and automated alert mechanisms to optimize the health and performance of data pipelines, ensuring alerts are appropriately calibrated to trigger the right notifications.
· Own incident diagnosis and resolution within established parameters - investigating alerts, identifying root causes, implementing fixes, validating recovery, and documenting resolutions.
· Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) to support reliable, repeatable deployments
· Own proactive operational maintenance - executing scheduled maintenance, applying patches and updates, and performing checks that prevent incidents before they occur.
· Create and maintain comprehensive documentation of scripts, automation and monitoring workflows, data pipelines, and deployment procedures.
· Contribute to and improve runbooks based on incidents you've worked through that weren't adequately covered before.
· Collaborate closely with cross-functional teams, providing support for scripting needs and contributing to automation strategy.
· Independently plan and prioritize work to meet deadlines.
· Begin sharing knowledge with peers; engage in informal coaching moments.
· Performs other duties as assigned.
QUALIFICATIONS
· Required Qualifications:
o BA/BS in Computer Science, Information Technology, or a related field, with 3+ years of experience in data operations, scripting, and automation.
o Intermediate proficiency in scripting languages such as Python, PowerShell, Bash, or similar.
o Fully competent in Azure, Databricks, Snowflake, and SQL Server.
o Experience managing relational databases such as SQL.
· Preferred Qualifications:
o Proficiency in Object-Oriented Programming (OOP) languages such as C++, Java, or similar.
o Experience with DataDog or similar tools for monitoring and performance tracking.
o Experience with deployment automation (CI/CD) tools and processes.
o Administration experience with managed file transfer tools (e.g. GoAnywhere)
o Experience working with cloud platforms (e.g., AWS, Azure, GCP).
o Familiarity with version control systems (e.g., Git).
· Skills & Competencies:
o Exceptional analytical and problem-solving skills with meticulous attention to detail.
o Demonstrated ability to debug systems, tracing issues back to their source.
o Excellent communication skills with the ability to collaborate effectively within a team environment.
o Ability to adapt to changing priorities and manage multiple tasks simultaneously.
o Provides clear incident updates on a defined cadence during active incidents.
ABOUT ACCUWEATHER
AccuWeather, recognized and documented as the most accurate and most used source of weather forecasts and warnings in the world, has saved over 12,000 lives, prevented injury to over 100,000 people, and saved companies tens of billions of dollars through better planning and decision-making.
Billions of people around the world rely on AccuWeather’s proven Superior Accuracy™ across our consumer digital platforms. AccuWeather.com is the #1 weather destination and one of the top 100 most-visited websites in the world, and our award-winning AccuWeather app delivers detailed real-time forecasts to millions of smartphones.
AccuWeather forecasts also appear on digital signage, in 700 newspapers, are heard on over 400 radio stations, and viewed on 100 television stations. The AccuWeather Network and AccuWeather NOW® reach an audience of over 125 million on cable and streaming platforms including DirecTV, Charter Communications - Spectrum, Verizon, Philo, Frndly TV, Comcast’s Xfinity X1 and Xfinity Stream, Roku, Xumo, Rockbot, LG, and Amazon Freevee.
AccuWeather For Business serves more than half of the Fortune 500 companies and thousands of other businesses and government agencies globally.
Dr. Joel Myers, Founder and Executive Chairman, established AccuWeather in 1962 and is considered the “father of modern commercial meteorology.” Myers, a leading creative thinker and visionary, has been called “the most accurate man in weather” by The New York Times and has been recognized as one of the top entrepreneurs in American history by Entrepreneur’s Encyclopedia of Entrepreneurs.
COMMITMENT TO DIVERSITY & INCLUSION
AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race, creed, color, national origin, sex (including pregnancy and gender identity/expression), sexual orientation, age, ancestry, physical or mental disability, marital status, political affiliation, religion, citizenship status, genetic information, veteran status, or any other basis protected under applicable federal, state, or local law. AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to [email protected] and let us know the nature of your request and your contact information.