{"id":2632417,"url":"https://alion.io/job/vivsoftgov-senior-data-engineer-vivsoft-technologies","title":"Senior Data Engineer - VivSoft Technologies","company":{"id":4376640,"name":"Vivsoftgov","domain":"vivsoftgov.com","url":"https://alion.io/company/vivsoftgov","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":160000,"max":180000,"currency":"USD","period":"year","gross":null,"usd_annual":180000},"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Grafana","optional":false},{"name":"Kubernetes","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Trino","optional":false},{"name":"dbt","optional":true},{"name":"GitOps","optional":true},{"name":"Helm","optional":true}],"status":"live","first_seen_at":"2026-10-15T16:32:23Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-15T16:32:23Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Title: Senior Data Engineer\nLocation: Remote\nPosition Type: Full-Time\nClearance Required: Secret Clearance\nAbout the company:\nAt VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies\nJob Summary:\nWe are seeking a Senior Data Engineer to support a DoW program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams.\nKey Responsibilities:\nArchitect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog.\nDevelop and optimize Apache Spark data pipelines on EMR and Kubernetes environments.\nDesign and implement event-driven data ingestion solutions using S3 events and Amazon SQS.\nOptimize query performance across Athena, Trino, and Spark SQL environments.\nOrchestrate data workflows and ETL pipelines using Apache Airflow.\nManage infrastructure deployment and automation using Terraform.\nDevelop, publish, monitor, and maintain data products and analytical dashboards.\nImplement data quality, governance, lineage, access controls, and cost management best practices.\nCreate technical documentation, architectural designs, and operational runbooks.\nProvide technical leadership and mentorship to junior engineering team members.\nRequired Skills:\nMust possess an active Secret Clearance \n8+ years of professional experience in Data Engineering or large-scale data platform development.\nExpertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew.\nStrong proficiency in Python or Scala and advanced SQL development.\nExperience with open table formats such as Apache Iceberg (preferred) or Delta Lake.\nStrong understanding of distributed query engines, including Athena, Trino, and Spark SQL.\nHands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures.\nExperience with Apache Airflow for workflow orchestration.\nProficiency with Terraform and Infrastructure as Code (IaC).\nExperience working with Kubernetes environments.\nExperience developing dashboards and data products using Grafana or similar visualization platforms.\nStrong understanding of data quality, data governance, lineage, and access control frameworks.\nExcellent technical leadership, mentoring, and stakeholder communication skills.\nAbility to translate business, operational, and analytics requirements into scalable data platform solutions.\nStrong collaboration skills with Data Scientists, AI Engineers, Cloud Engineers, and business stakeholders.\nProven ability to lead technical discussions and mentor junior engineers.\nExcellent written and verbal communication skills.\nStrong attention to detail regarding data quality, governance, lineage, security, and operational reliability.\nPreferred Skills:\nExperience operating and maintaining Apache Iceberg tables at enterprise scale.\nExperience with Trino administration and performance optimization.\nKnowledge of dbt or similar data transformation frameworks.\nExperience with Helm and GitOps deployment methodologies.\nExperience evaluating and implementing modern data visualization platforms beyond Grafana.\nFamiliarity with data catalog, metadata management, lineage, and governance tools.\nAWS Data Analytics Certification and/or Certified Kubernetes Administrator (CKA).\nPrior DoD, USAF, or Federal Government data platform experience.\nExperience supporting AI/ML, data science, or advanced analytics workloads in cloud environments.\nBenefits:\nComprehensive Medical, Dental, and Vision Plans (Healthcare benefits are 100% employer-paid for employees only) \nLife Insurance \nPaid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays) \n401K Retirement Plan with employer match \nProfessional Development Training Reimbursement\nSalary Range: $160K to $180K per Annually","description_format":"text","description_chars":4811,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[]},"benefits":["401k plan","Life insurance","Professional development","Retirement plans"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-15T16:32:23Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":7,"reasons":["conf:3","win:early"],"computed_at":"2026-10-15T20:06:38Z"},"pay":{"stated_usd_annual":180000,"is_top_pay":true},"html_url":"https://alion.io/job/vivsoftgov-senior-data-engineer-vivsoft-technologies","json_url":"https://alion.io/job/vivsoftgov-senior-data-engineer-vivsoft-technologies.json","meta":{"generated_at":"2026-10-15T20:06:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30570,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4376640},"rest":"https://alion.io/mcp/rest/get_company?id=4376640"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvivsoftgov-senior-data-engineer-vivsoft-technologies"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvivsoftgov-senior-data-engineer-vivsoft-technologies"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvivsoftgov-senior-data-engineer-vivsoft-technologies"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vivsoftgov-senior-data-engineer-vivsoft-technologies\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvivsoftgov-senior-data-engineer-vivsoft-technologies"}]}