{"id":3084342,"url":"https://alion.io/job/spidersilk-senior-backend-engineer-python-java-go","title":"Senior Backend Engineer (Python, Java, GO)","company":{"id":694348,"name":"spiderSilk","domain":"spidersilk.com","url":"https://alion.io/company/spidersilk","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":{"grade":"A","score":95,"open_postings":11,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":174,"computed_at":"2026-10-28T05:59:10Z"}},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dubai, United Arab Emirates"],"countries":["AE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon Neptune","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"ArangoDB","optional":false},{"name":"AutoGen","optional":false},{"name":"Cassandra","optional":false},{"name":"CI/CD","optional":false},{"name":"ClickHouse","optional":false},{"name":"CVE","optional":false},{"name":"Dagster","optional":false},{"name":"DNS","optional":false},{"name":"Docker","optional":false},{"name":"DuckDB","optional":false},{"name":"ElasticSearch","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab CI","optional":false},{"name":"Go","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Grafana","optional":false},{"name":"Java","optional":false},{"name":"Jenkins","optional":false},{"name":"KEDA","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LlamaIndex","optional":false},{"name":"Loki","optional":false},{"name":"MySQL","optional":false},{"name":"Neo4j","optional":false},{"name":"Nmap","optional":false},{"name":"pgvector","optional":false},{"name":"Pinecone","optional":false},{"name":"Playwright","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Prometheus","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"Qdrant","optional":false},{"name":"RabbitMQ","optional":false},{"name":"Redis","optional":false},{"name":"Snort","optional":false},{"name":"Suricata","optional":false},{"name":"TCP/IP","optional":false},{"name":"Threat Modeling","optional":false},{"name":"Weaviate","optional":false},{"name":"Wireshark","optional":false},{"name":"Zeek","optional":false},{"name":"Zero Trust","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Embeddings","optional":true},{"name":"GCP","optional":true},{"name":"InfluxDB","optional":true},{"name":"Time Series","optional":true},{"name":"TimescaleDB","optional":true}],"status":"live","first_seen_at":"2025-10-02T11:24:58Z","employer_posted_date":"2025-10-02","last_verified_at":"2026-10-28T18:40:35Z","board_verified":true,"closed_at":null,"days_open":391,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":390},"description":"Who We Are\nBack in 2019, spiderSilk was born with a bold idea: build regional, sovereign cybersecurity IP that could stand tall on the global stage. Our mission is to shake up the way organizations protect their ever-changing digital worlds - with continuous, intelligent, and autonomous security that doesn't miss a beat.\nWe're a global mix of curious minds, problem-solvers, and passionate builders, all united by one goal: making the internet a safer place for everyone. Around here, we thrive on vision, energy, and a strong sense of ownership.\nIf this feels like your kind of crew, you'll probably fit right in.\nAbout the Role\nAs a Senior Software Engineer (Backend), you'll take a leadership role in designing and building the mission-critical systems that power spiderSilk's cybersecurity platform. You'll architect scalable, secure, and intelligent backend infrastructure - integrating ML pipelines, designing agentic AI solutions, and ensuring the platform can handle the demands of real-world threat intelligence at scale.\nYou won't wait to be told what to do. You'll jump into architectural discussions, challenge assumptions, and drive decisions. You'll mentor junior engineers and set the bar for engineering quality across the team.\nWhat You'll Do\nArchitect and maintain distributed, microservices-based systems that operate reliably at scale\n\nOwn the design and delivery of standalone agentic AI solutions - from architecture through to production deployment\n\nBuild and optimise ML pipelines, agent workflows, and vector-based similarity search systems\n\nDesign and operate event-driven architectures using Kafka and message queues for real-time data streaming\n\nEngineer and optimise complex database schemas across relational, graph, search, and analytical data stores\n\nLead data pipeline development for ingesting, processing, and surfacing threat intelligence data\n\nProactively contribute to architectural decisions - bringing opinions, trade-off analysis, and technical leadership without waiting to be asked\n\nMentor junior and mid-level engineers through code reviews, design discussions, and pair programming\n\nChampion secure-by-design engineering practices across every layer of the stack\n\nRequirements\nLanguages & Stack\nPython, Go, and Java - strong proficiency in all three with production-grade backend experience across each\n\nDeep understanding of concurrency primitives - threads, goroutines, thread pools, locks, and race conditions; knowing when more parallelism makes things slower, not faster\n\nSolid working knowledge of Docker and Kubernetes for containerisation and orchestration\n\nExperience with Redis for caching, rate limiting, and distributed coordination\n\nDistributed Systems & Architecture\nDeep experience designing and operating distributed systems and microservices architectures\n\nProven track record building event-driven systems (Kafka, RabbitMQ, or equivalent)\n\nExpertise in data pipelines and stream processing at scale\n\nStrong system design instincts - able to reason independently about trade-offs across reliability, performance, and security, and step into architectural decisions without prompting\n\nHands-on experience with wide-column stores (Cassandra or equivalent) for high-write, high-scale workloads\n\nWorking knowledge of object storage (S3 or compatible) and workflow orchestration tools (Dagster, Airflow, or similar) for managing complex data pipelines\n\nAI / Agentic Systems\nHands-on experience building standalone agentic AI solutions in production - not just integrating APIs, but designing the agent architecture end-to-end\n\nDeep understanding of vector databases and similarity search (e.g. Pinecone, Weaviate, pgvector, Qdrant) and how to apply them effectively in AI-powered pipelines\n\nProven work on agent optimisation and performance tuning - latency reduction, retrieval quality, context management, tool-call efficiency\n\nFamiliarity with agentic frameworks (LangChain, LlamaIndex, AutoGen, or similar) and the ability to go beyond them when needed\n\nPractical experience with ML pipeline design, model serving, and feature engineering within production AI systems\n\nStrong prompt engineering skills and up-to-date fluency with the evolving AI tooling ecosystem\n\nExpert-level skills in database schema design and optimisation across multiple paradigms\n\nMySQL & PostgreSQL - advanced query optimisation, indexing strategies, performance tuning, and schema design for high-traffic systems\n\nElasticsearch - indexing, search relevance tuning, and cluster operations\n\nGraph databases - production experience with Neo4j or equivalent (Amazon Neptune, ArangoDB); ability to model complex relationship data for threat intelligence or entity resolution\n\nWorking knowledge of analytical / OLAP databases (e.g. ClickHouse, BigQuery, Redshift, DuckDB) and when to apply them\n\nAbility to select the right database technology for the problem and design schemas that scale\n\nData Collection & Web Technologies\nExperience collecting data from the web at scale - HTTP clients, headless browsers (Playwright or similar), handling sessions, rate limits, and sources that change without notice\n\nAbility to parse large, malformed, or untrusted files and archives safely and efficiently at volume\n\nBroad understanding of web servers, frameworks, CDNs and proxies - how they reveal themselves through headers, cookies, page content, and certificates\n\nFamiliarity with software fingerprinting and vulnerability mapping - understanding how product versions map to known vulnerabilities (CPE, CVE)\n\nSecurity\nWorking knowledge of cybersecurity principles and common security tooling\n\nDemonstrated ability to apply secure coding practices and security-by-design thinking\n\nUnderstanding of threat modeling, vulnerability patterns, and secure API design\n\nSolid understanding of network security fundamentals - TCP/IP stack, DNS, TLS/SSL, HTTP/S, firewalls, and network traffic analysis\n\nFamiliarity with network attack patterns - DDoS, MITM, port scanning, packet sniffing, and lateral movement techniques\n\nExperience working with or building systems that consume network telemetry data (e.g. NetFlow, PCAP, Zeek/Bro logs, SNMP)\n\nUnderstanding of zero-trust architecture principles and how to apply them in distributed, internet-facing systems\n\nFamiliarity with security tooling such as Snort, Suricata, Wireshark, Nmap, or similar network inspection and monitoring tools\n\nDevOps & Operational Awareness\nBasic working knowledge of CI/CD pipelines - setting up, maintaining, and debugging pipelines (GitHub Actions, GitLab CI, Jenkins, or equivalent)\n\nComfortable with deployment workflows - deploying services to VMs and Kubernetes clusters, managing rollouts, and handling rollbacks\n\nHands-on experience debugging live services on Kubernetes - inspecting pods, reading pod logs, exec-ing into containers, and triaging crashloops or resource issues\n\nAbility to fetch and analyse logs from VMs - SSH access, journald/systemd logs, log rotation, and using tools like grep, awk, tail, and jq to debug production issues\n\nFamiliarity with observability tooling - working with log aggregation (ELK, Loki) and basic metrics/alerting (Prometheus, Grafana) to diagnose issues in production\n\nUnderstanding of Kubernetes autoscaling in depth - resource requests/limits, HPA, and event-driven autoscaling (KEDA); able to diagnose OOM kills, CPU throttling, and unclean shutdowns\n\nOwnership & Leadership\n5-8 years of backend engineering experience with a proven track record of delivering at scale\n\nSelf-driven and proactive - comfortable jumping into architectural decisions, raising concerns early, and owning outcomes without hand-holding\n\nProven ability to lead projects and mentor engineers\n\nStrong written and verbal communication across technical and non-technical stakeholders\n\nNice to Have\nBackground in cybersecurity tooling, threat intelligence platforms, or security research\n\nExposure to cloud-native infrastructure (AWS, GCP, or Azure)\n\nExperience with time-series databases (InfluxDB, TimescaleDB) relevant to security telemetry\n\nContributions to open-source AI or security tooling\n\nBackground in offensive security, penetration testing, or vulnerability research\n\nExperience with threat intelligence work - tracking threat actors, leaked credentials, or underground forums\n\nHigh-volume pattern matching or text processing - large regex sets or parsers working on untrusted, multilingual input at scale\n\nApplied ML experience - clustering and visualising embeddings (e.g. UMAP) or other dimensionality reduction techniques for security data\n\nLeading a project or initiative that spans multiple teams or services","description_format":"text","description_chars":8647,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cybersecurity","Information Security"],"lifecycle":[{"event":"open","at":"2026-10-22T13:13:23Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":1,"p_active":0.497,"p_room":0.28,"age_days":390,"expected_fill_days":174,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/spidersilk-senior-backend-engineer-python-java-go","json_url":"https://alion.io/job/spidersilk-senior-backend-engineer-python-java-go.json","meta":{"generated_at":"2026-10-28T22:17:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30126,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":694348},"rest":"https://alion.io/mcp/rest/get_company?id=694348"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fspidersilk-senior-backend-engineer-python-java-go"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fspidersilk-senior-backend-engineer-python-java-go"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fspidersilk-senior-backend-engineer-python-java-go"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/spidersilk-senior-backend-engineer-python-java-go\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fspidersilk-senior-backend-engineer-python-java-go"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3084342}},{"tool":"search_jobs","arguments":{"company":"spidersilk.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3084342},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}