{"id":2288094,"url":"https://alion.io/job/acuity-data-engineer-awsdatabricks-mid-level","title":"Data Engineer - AWS/Databricks - Mid Level","company":{"id":4409311,"name":"Acuity","domain":"myacuity.com","url":"https://alion.io/company/acuity-4","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Reston, United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":93000,"max_usd":170000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":77},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitLab","optional":false},{"name":"IAM","optional":false},{"name":"pySpark","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"closed","first_seen_at":"2026-10-11T14:28:21Z","employer_posted_date":null,"last_verified_at":"2026-10-12T03:33:15Z","board_verified":false,"closed_at":"2026-10-12T03:33:15Z","days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Acuity, Inc. is a management and technology consulting firm supporting critical federal missions, seeking a skilled Data Engineer to join their Engineering Team. The role involves designing and delivering AWS cloud-scale data platforms, building scalable data pipelines, and collaborating with data architects to implement cloud-native data solutions.\n\nResponsibilities\nBuild and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data\nDesign and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets\nDevelop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture\nLeverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices\nCollaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control\nOptimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning\nDeploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins\nMonitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs\nConduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows\nImplement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic\nSupport ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams\n\nSkills\n4+ years of experience in data engineering and Agile analytics\n4+ years of experience creating software for retrieving, parsing and processing structured and unstructured data\n2+ years of experience building scalable ETL and ELT workflows for reporting and analytics\n2+ years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks\nExperience with data quality, validation frameworks, and storage optimization strategies\nBA or BS degree\nMust be US Citizen with an ability to obtain and maintain US Suitability\n\nBenefits\nPersonalized development plans\nMentorship\nUp to $3,000 annually for training and certifications\nUp to $3,000 for degree seeking programs\nCompetitive compensation\nComprehensive benefits\nA strong focus on work-life balance\nWork remotely (#LI-Remote)\n\nCompany Overview\nAcuity is an information technology company that offers cybersecurity and project management services. It was founded in 2002, and is headquartered in Reston, Virginia, USA, with a workforce of 201-500 employees. Its website is http://myacuity.com.","description_format":"text","description_chars":3211,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-11T15:20:00Z"},{"event":"close","at":"2026-10-12T03:33:15Z"}],"visa":[],"liveness":null,"pay":null,"html_url":"https://alion.io/job/acuity-data-engineer-awsdatabricks-mid-level","json_url":"https://alion.io/job/acuity-data-engineer-awsdatabricks-mid-level.json","meta":{"generated_at":"2026-10-12T13:02:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":20276,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4409311},"rest":"https://alion.io/mcp/rest/get_company?id=4409311"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Facuity-data-engineer-awsdatabricks-mid-level"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Facuity-data-engineer-awsdatabricks-mid-level"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Facuity-data-engineer-awsdatabricks-mid-level"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/acuity-data-engineer-awsdatabricks-mid-level\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Facuity-data-engineer-awsdatabricks-mid-level"}]}