{"id":3781642,"url":"https://alion.io/job/nucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security","title":"Staff Agentic Data Engineer – Data Platform - Nucleus Security","company":{"id":1760375,"name":"Nucleus Security","domain":"nucleussec.com","url":"https://alion.io/company/nucleussec","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_company_offices","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Flink","optional":false},{"name":"Java","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Agile","optional":true},{"name":"Linux","optional":true},{"name":"LLM","optional":true},{"name":"Scrum","optional":true}],"status":"live","first_seen_at":"2026-11-05T01:08:50Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-05T19:17:08Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Are you looking for more in life than just building another data pipeline? Does upending cybersecurity resonate with you? We're a rapidly expanding cybersecurity company revolutionizing vulnerability management for organizations of all sizes. For our customers, vulnerability management has historically been a game of catch-up, with fragmented data, limited asset coverage, and manual processes.\nNucleus' primary mission is to create a fast, scalable platform that brings together large volumes of security data and transforms it into actionable insights, making vulnerability management simple, efficient, and effective.\nWe're looking for a Staff / Principal Data Engineer to help define and evolve the architecture behind our data platform. This is a senior technical leadership role for an engineer who thrives on solving complex data problems at scale, designing systems that process large and growing datasets, and establishing patterns that other engineers can build upon.\nWhat You Will Do\nOwn the architecture and evolution of large-scale data processing and analytics systems, from ingestion and normalization through transformation, aggregation, and customer-facing analytics.\n\nDesign and evolve data models that support high-volume analytical workloads while balancing query performance, storage efficiency, maintainability, and scalability.\n\nDesign and optimize complex analytical SQL queries operating across large datasets, identifying performance bottlenecks and developing scalable solutions.\n\nArchitect distributed and asynchronous job processing systems capable of reliably processing large volumes of data across concurrent workloads.\n\nDesign and evolve Spark, Flink or similar technologies based data processing workflows for large-scale transformation, enrichment, aggregation, and computation.\n\nDrive the effective use of SingleStore/MemSQL, including schema design, indexing and partitioning strategies, query optimization, and workload design.\n\nEstablish architectural patterns for batch processing, data transformation, job orchestration, failure recovery, idempotency, and reprocessing.\n\nDiagnose complex performance and scalability issues across databases, distributed processing systems, application services, and infrastructure.\n\nPartner with engineering and product teams to translate ambiguous analytical and data-processing requirements into scalable technical architectures.\n\nDefine technical standards and reusable patterns for data modeling, data processing, and analytical query development.\n\nProvide technical leadership across engineering initiatives, influencing architecture and mentoring engineers while remaining deeply hands-on with implementation.\n\nIdentify architectural limitations before they become operational problems and lead improvements that increase the scalability, reliability, and performance of the platform.\n\nThe Following Skills and Experience Are Key to Succeeding in This Role\n10+ years of professional software engineering, data engineering, or data platform experience, with significant experience designing and operating production data systems.\n\nDeep expertise in relational and analytical data modeling, including designing schemas for large-scale analytical and reporting workloads.\n\nExpert-level SQL, with demonstrated experience designing, analyzing, and optimizing complex analytical queries over large datasets.\n\nStrong experience with SingleStore/MemSQL or comparable distributed SQL/analytical database technologies.\n\nSignificant hands-on experience with Spark, Flink or similar technologies, including designing and optimizing distributed data-processing workloads.\n\nStrong understanding of distributed data processing, including partitioning, parallelism, data skew, resource utilization, and performance optimization.\n\nExperience designing high-throughput job processing systems, including scheduling, concurrency management, retries, failure recovery, idempotency, and observability.\n\nExperience designing data pipelines that support batch ingestion, transformation, enrichment, aggregation, and downstream analytics.\n\nStrong understanding of database performance characteristics, including indexing, partitioning, query execution plans, data distribution, and memory/compute trade-offs.\n\nExperience identifying and resolving performance bottlenecks across application, database, and data-processing layers.\n\nProficiency in Python, Java or another production programming language used to build data-processing and distributed systems.\n\nStrong understanding of testing strategies for data-intensive systems, including unit, integration, data-quality, and end-to-end testing.\n\nProven ability to independently own technically ambiguous problems and drive them from investigation through production implementation.\n\nDemonstrated ability to influence architecture and technical direction across multiple teams without relying solely on organizational authority.\n\nAbility to communicate complex data architecture and performance trade-offs clearly to engineers, product stakeholders, and technical leadership.\n\nAbility to collaborate effectively with distributed teams across multiple time zones.\n\nPreferred Qualifications\nDeep production experience with SingleStore/MemSQL, particularly with large-scale analytical workloads.\n\nAdvanced experience with pipeline performance tuning, partitioning strategies, memory management, and optimization of large distributed workloads.\n\nExperience designing platforms that support a combination of high-volume ingestion and low-latency analytical queries.\n\nExperience building or operating distributed job execution and orchestration systems.\n\nExperience with large-scale cybersecurity, vulnerability, asset, telemetry, or event datasets.\n\nExperience working with vulnerability scanning technologies across the security stack, including SCA, SAST, DAST, IAST, vulnerability scanning, and container security.\n\nExperience designing systems for incremental processing, backfills, replay/reprocessing, deduplication, and late-arriving data.\n\nExperience with data observability and operational monitoring for large-scale processing workloads.\n\nExperience integrating AI/LLM-driven capabilities with data platforms, including preparing and processing large datasets for AI-assisted analytical workflows.\n\nExperience operating data-intensive applications on Linux and cloud infrastructure.\n\nFamiliarity with Agile/Scrum methodologies in a professional engineering environment.\n\nWhy You Should Be Excited\nNucleus is a truly unique solution that’s defining a market AND making an actual impact. \nWe’re biased, but you will get to work with one of the best teams in security. We have a lot to get done and we work extremely hard, but we have fun in the process. \nThis role has the opportunity to directly influence how Nucleus approaches data architecture, analytical processing, and scalability as the platform and the datasets it processes continue to grow. \nOutstanding benefits include flexible PTO, 401k company contribution (not a match, a contribution), generous education and training budget, 100% company-paid healthcare, fully remote work, and more. \nAdditional Information\nAt Nucleus we are committed to achieving excellence in our field by combining diversity, collaboration, teamwork, and pride in our work. All qualified applicants will receive consideration for employment without regard to race, sex, color, religion, sexual orientation, gender identity, national origin, protected veteran status, or disability.","description_format":"text","description_chars":7529,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Application Security","Vulnerability Management"],"lifecycle":[{"event":"open","at":"2026-11-05T01:08:50Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":39,"reasons":["conf:4","win:early"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/nucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security","json_url":"https://alion.io/job/nucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security.json","meta":{"generated_at":"2026-11-05T20:45:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":407,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1760375},"rest":"https://alion.io/mcp/rest/get_company?id=1760375"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/nucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnucleus-security-staff-agentic-data-engineer-data-platform-nucleus-security"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3781642}},{"tool":"search_jobs","arguments":{"company":"nucleussec.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3781642},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}