{"id":3371122,"url":"https://alion.io/job/ideal-innovations-etl-developer","title":"ETL Developer","company":{"id":3854329,"name":"Ideal Innovations","domain":"idealinnovations.com","url":"https://alion.io/company/ideal-innovations","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"UltiPro","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bethesda, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":87100,"max":133833,"currency":"USD","period":"year","gross":null,"usd_annual":133833},"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Apache NiFi","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"DynamoDB","optional":false},{"name":"ElasticSearch","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Java","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false}],"status":"live","first_seen_at":"2026-10-27T20:48:03Z","employer_posted_date":"2026-10-27","last_verified_at":"2026-10-30T10:44:52Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"Highlights:\nWe are looking for an ETL developer to play a pivotal role in shaping, and implementing cutting-edge data flow solutions centered around Apache NiFi.\nDesign and optimize complex NiFi data pipelines, supporting both batch and real-time processing through performance tuning, memory management, and load balancing.\nIntegrate across big data and cloud technologies, connecting NiFi with platforms and services such as AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.\nContribute across the full software development lifecycle within a DevOps framework, supporting the design, development, implementation, and testing of customer tools and applications.\nSolve complex data and integration challenges, collaborating with data architects, data engineers, developers, and other stakeholders to deliver robust, scalable, and secure solutions supporting critical customer needs.\nTypical Day:\nThe candidate will provide technical support in the design, development, implementation and testing of customer tools and applications in support of Extracting, Transforming and Loading (ETL) of data into an enterprise Data Lake. The candidate will be responsible for following architectural best practices, and optimizing performance in large-scale environments, ensuring the delivery of robust, scalable, and secure data flow solutions that drive critical customer needs. Based in a DevOps framework, the ETL Developer participates in the delivery of major projects through all aspects of the software development lifecycle.\nTasks:\nBuilding complex NiFi data pipeline design: Develop and implement enterprise-level ETL NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.\nPerformance optimization and tuning: Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.\nTroubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.\nIntegrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating familiarity in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS).\nFollow best practices and standards: Follow establish best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.\nDocumentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations.\nCollaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions.\nRequired Qualifications:\nTo be considered, must have an active TS/SCI with polygraph security clearance\nEducation: Bachelor's degree with 4 or more years of prior relevant experience or Master's degree with 2 or more years of relevant experience. Will consider experience in lieu of a degree.\nThe ideal candidate will possess:Direct experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.\nExperience in programming languages like Java and/or Python and scripting for automation.\nExperience writing and optimizing complex queries, along with experience in interacting with relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).\nExperience with real-time streaming, and API integration (REST) for seamless data connectivity.\nExperience with cloud platforms like AWS, Azure, or OCI and related data services\nAbility to analyze complex data challenges, identify root causes, and implement effective solutions.\nAbility to collaborate effectively with cross-functional teams and articulate technical concepts clearly.\n\nDesired Qualifications:\nExperience deploying ETL solutions in an AWS environment.\nExperience developing custom NiFi processors with Java and/or Python.\nDirect knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability.\nPosition Type Shift Information:\nMon-Fri, 40 hr work week\nCitizenship & Clearance: US Citizenship and TS/SCI with a Full-Scope Polygraph (FSP) Required\nLocation: Onsite- Bethesda, MD\n\nIdeal Innovations, Inc. is an Equal Opportunity Employer: \nAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or veteran status. \nIdeal Innovations, Inc. is a VEVRAA Federal Contractor .","description_format":"text","description_chars":4929,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Defense Manufacturing","Management Consulting"],"lifecycle":[{"event":"open","at":"2026-10-28T00:59:56Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":24,"reasons":["conf:3","velocity","win:early"],"computed_at":"2026-10-30T05:48:23Z"},"pay":{"stated_usd_annual":133833,"is_top_pay":true},"html_url":"https://alion.io/job/ideal-innovations-etl-developer","json_url":"https://alion.io/job/ideal-innovations-etl-developer.json","meta":{"generated_at":"2026-10-30T11:57:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17213,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3854329},"rest":"https://alion.io/mcp/rest/get_company?id=3854329"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fideal-innovations-etl-developer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fideal-innovations-etl-developer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fideal-innovations-etl-developer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ideal-innovations-etl-developer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fideal-innovations-etl-developer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3371122}},{"tool":"search_jobs","arguments":{"company":"idealinnovations.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3371122},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}