Cloud Dataflow Engineer/Analyst

Description

Spatial Front, Inc. (SFI), a two-time USA Today Top Workplaces awardee and Washington Post Top Workplaces honoree, is seeking a Cloud Dataflow Engineer / Analyst to support a mission-critical enterprise data modernization initiative. In this role, you will join our Dataflow Team to serve as the critical operational bridge moving high-volume, real-time datasets from legacy on-premise infrastructure into a centralized, high-availability cloud platform.

Over the next 6-12 months, your primary focus will be supporting the ingestion, automation, and reliability of real-time data streams to power scalable data access, advanced scientific analytics, and future AI/ML capabilities across hybrid environments.

Key Responsibilities

Data Pipeline & Cloud Ingestion

• Execute and streamline large-scale data ingestion and migration processes from legacy on-premise systems to cloud environments (AWS/Azure/GCP).
• Transition legacy dataflow pipelines into automated, API-driven workflows using Python, Bash, and modern CI/CD practices.
• Maintain, refactor, and migrate legacy scripts and tools (Bash, Perl, SQL) to scalable, cloud-native solutions.
• This role offers a unique opportunity to learn the foundational legacy systems of the National Weather Service while simultaneously building the "Gold Standard" of cloud-based weather data dissemination.

Operations, Monitoring & Reliability

• Ensure continuous, low-latency delivery of mission-critical, high-volume data streams in a 24/7 operational environment.
• Monitor, troubleshoot, and optimize data routing applications, ingestion processes, and underlying cloud services.
• Serve as a Tier 2 technical escalation point for complex data ingestion, formatting, and delivery issues.
• Participate in a 24/7 on-call rotation to support mission-critical availability.

Data Lifecycle & System Integration

• Manage end-to-end data flow operations, including validation, quality control, archival, and retrieval.
• Collaborate with internal engineering teams and external stakeholders to resolve data access, formatting, and integration challenges.
• Author and maintain technical documentation, standard operating procedures (SOPs), and configuration standards.

Requirements

Education & Experience

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)
• Cloud Infrastructure: 1-2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP).
• Linux Administration: 2+ years of Linux/Unix system administration or engineering support experience.
• Scripting & Databases: Strong proficiency in Python and Bash scripting, alongside solid SQL experience and relational database fundamentals.
• Pipelines & CI/CD: Demonstrated experience supporting ETL pipelines, data integration workflows, and automated CI/CD deployment tools.
• Certification: At least one (1) active foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent).
• Ability to obtain and maintain a Public Trust clearance

Desired Skills & Qualifications

• Domain Expertise: Experience with scientific or meteorological data dissemination systems (NOAA, NASA, DoD) and familiarity with data formats such as METAR, TAF, GRIB, and BUFR.
• System Monitoring: Hands-on experience with monitoring tools (e.g., Big Brother, Nagios) or cloud-native monitoring solutions (e.g., AWS CloudWatch).
• Legacy Tools: Experience with Perl for legacy script migration.
• Version Control: Proficiency with Git, SVN, or similar version control tools.
• Advanced Certifications: Associate or Professional-level cloud engineering certifications

Additional Information:

• Clearance: Must be authorized to work in the U.S. and be able to obtain and keep a public trust clearance
• Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. (Public Trust investigations typically take 4-8 weeks and require fingerprinting.)
• Work Environment: Hybrid
• Salary Range: $75,000 - $110,000 annually
• Benefits: SFI offers a comprehensive benefits package. Details available at SFI Careers.
• This is a full-time, W2 position.
• No agencies, third parties, or Corp-to-Corp submissions.
• Spatial Front Inc. is an Equal Opportunity Employer - all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status.
• SFI participates in E-Verify.

Salary Description

$75,000.00 - $110,00.00 annually