{"id":2120754,"url":"https://alion.io/job/fujitsu-senior-python-and-kafka-engineer","title":"Senior Python and Kafka Engineer","company":{"id":896,"name":"Fujitsu","domain":"fujitsu.com","url":"https://alion.io/company/fujitsu-poland-sp-z-o-o","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Costa Rica"],"countries":["CR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":103000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":6426},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"ArgoCD","optional":false},{"name":"Kubernetes","optional":false},{"name":"Kustomize","optional":false},{"name":"OpenTelemetry","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Airflow","optional":true},{"name":"Amazon S3","optional":true},{"name":"Apache Solr","optional":true},{"name":"AWS","optional":true},{"name":"External Secrets","optional":true},{"name":"Grafana","optional":true},{"name":"Istio","optional":true},{"name":"JavaScript","optional":true},{"name":"Loki","optional":true},{"name":"Node JS","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-10-08T23:55:13Z","employer_posted_date":"2026-10-08","last_verified_at":"2026-10-12T00:20:00Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"At Fujitsu, our purpose is to make the world more sustainable by building trust in society through innovation. Founded in Japan in 1935, Fujitsu has been a pioneer in technology and innovation for decades. Today, as a world-leading digital transformation partner, we are committed to transforming business and society in the digital age.\nWith approximately 130,000 employees across over 50 countries, Fujitsu offers a broad range of products, services, and solutions. We collaborate with our customers to co-create solutions that drive enterprise-wide digitalization while actively working to address social issues and contribute to the United Nations Sustainable Development Goals (SDGs).\nSenior Python and Kafka Engineer\nEvent-Driven Systems, Observability and Data Lineage\nPosition Summary\nWe are seeking a hands-on Senior Python and Kafka Engineer to join an established engineering team supporting a correctness-critical, event-driven digital repository processing platform.\nThe platform performs downstream processing after digital objects have been deposited and archived. Its services create persistent identifiers, update operational metadata and search stores, generate viewable and streamable derivatives, distribute content to image, media and full-text services, and notify depositors. The pipeline is event-driven, with an initial archival event being processed by multiple independent services that publish and consume subsequent events.\nThe successful candidate will work directly within the existing team to improve structured logging, end-to-end event visibility, reconciliation, completion verification, and Kafka delivery reliability. This is an implementation-focused engineering position. The architecture is owned internally, and the selected engineer will build enhancements into a live system rather than redesigning or replacing it.\nKey Responsibilities\nImplement a consistent structured JSON logging standard across Python services, including standardized fields, logging levels, contextual information, and actionable failure details.\nImprove Kafka producer and consumer reliability, with particular attention to:Offset commit behavior\nConsumer-group stability and rebalancing\nRetry processing\nDead-letter topic handling\nMessage-loss investigation\nDuplicate-processing and idempotency considerations\n\nInstrument distributed services to provide greater visibility into how individual digital objects move through the processing pipeline.\nImplement or contribute to an event-lineage capability that records:The processing stages an object passed through\nThe order in which stages occurred\nThe outcome of each stage\nWhere processing stopped or failed\n\nDevelop reconciliation and completion-tracking capabilities that compare expected workflow stages with recorded events.\nHelp produce an actionable completion verdict for processed objects, including the ability to identify incomplete processing and support alerting or delivery holds.\nImplement telemetry using OpenTelemetry and contribute to an OpenLineage-based lineage solution, with Marquez currently identified as the leading implementation option.\nDevelop and maintain Python services that interact with Kafka, PostgreSQL, MongoDB, object storage, and external APIs.\nWork with shared internal Python packages that provide message-envelope models, Kafka producer and consumer wrappers, retry and dead-letter handling, shared-state storage, and operational-metadata access.\nWrite automated tests and support safe delivery through the existing Kubernetes, Kustomize, and ArgoCD environment.\nTroubleshoot complex distributed-processing issues across services, messages, data stores, and external dependencies.\nPair closely with the internal engineer leading this work and contribute directly to implementation, testing, technical documentation, and operational readiness.\nThe principal areas of work are structured logging, event lineage and tracking, reconciliation and completion verification, and Kafka delivery semantics.\nRequired Qualifications\nCandidates should have strong, production-level experience in all four of the following areas:\nApache Kafka\nSignificant hands-on experience operating or developing Kafka-based production applications.\nDeep understanding of producer and consumer delivery semantics.\nExperience with Kafka offsets, commit strategies, consumer groups, partition assignment, and rebalancing.\nDemonstrated ability to diagnose missing, delayed, duplicated, or repeatedly retried messages.\nPractical experience implementing retry and dead-letter processing patterns.\nPython\nAdvanced Python software-engineering experience.\nStrong understanding of concurrency, threading, and runtime behavior.\nExperience building and supporting production services and shared Python libraries.\nAbility to write maintainable, testable, and operationally supportable code.\nObservability and Structured Logging\nExperience defining and implementing structured logging standards, not only configuring logging products.\nAbility to establish consistent log fields, severity levels, correlation information, error context, and diagnostic detail.\nUnderstanding of observability practices for distributed and event-driven systems.\nPostgreSQL\nStrong working knowledge of PostgreSQL.\nExperience using PostgreSQL JSON capabilities.\nAbility to design and query operational, tracking, or event-related data structures.\nThese four capabilities are the primary qualification bar for the role. The source brief specifically notes that candidates are not expected to possess every technology listed in the environment.\nPreferred Qualifications\nHands-on experience with OpenTelemetry.\nExperience with OpenLineage, Marquez, or comparable data-lineage and event-lineage solutions.\nWorking knowledge of Kubernetes sufficient to deploy, troubleshoot, and operate applications in a Kustomize and ArgoCD environment.\nExperience using Grafana and Grafana Loki, or equivalent metrics, dashboarding, and log-management platforms.\nStrong understanding of event-driven architecture patterns, including:Idempotent processing\nExactly-once delivery concerns\nAt-least-once processing implications\nTransactional boundaries between a datastore and a message bus\nFailure recovery in distributed workflows\n\nThe environment values OpenTelemetry, lineage tooling, Kubernetes, Grafana/Loki, and practical knowledge of event-driven architecture, but does not require deep Kubernetes platform-engineering expertise.\nAdditional Relevant Experience\nExperience with one or more of the following would be beneficial but is not required:\nMongoDB\nApache Solr\nAWS S3 or other S3-compatible object storage\nIstio\nAWS Secrets Manager\nExternal Secrets Operator\nAWS EFS and NFS-based shared storage\nImage or video processing pipelines\nDigital asset, library, archive, or repository platforms\nApache Airflow and PgBouncer\nTypeScript or Node.js\nMongoDB, Solr, S3-compatible storage, Istio, and image or video processing are identified as useful rather than required capabilities\nAt Fujitsu, we are committed to an inclusive recruitment process that values the diverse backgrounds and experiences of all applicants. We believe that hiring people from a wide variety of backgrounds makes us stronger, not because it's the right thing to do, but because it allows us to draw on a wider range of perspectives and life experiences.","description_format":"text","description_chars":7356,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Systems Integrators","High-Performance Computing"],"lifecycle":[{"event":"open","at":"2026-10-08T23:55:13Z"}],"visa":[],"liveness":{"score":30,"band":"fade","label":"Fading","p_open":1,"p_active":0.666,"p_room":0.45,"age_days":3,"expected_fill_days":2,"reasons":["conf:6","velocity","win:tail","comp:brand"],"computed_at":"2026-10-12T06:55:09Z"},"pay":null,"html_url":"https://alion.io/job/fujitsu-senior-python-and-kafka-engineer","json_url":"https://alion.io/job/fujitsu-senior-python-and-kafka-engineer.json","meta":{"generated_at":"2026-10-12T19:51:37Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32155,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":896},"rest":"https://alion.io/mcp/rest/get_company?id=896"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffujitsu-senior-python-and-kafka-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffujitsu-senior-python-and-kafka-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffujitsu-senior-python-and-kafka-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fujitsu-senior-python-and-kafka-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffujitsu-senior-python-and-kafka-engineer"}]}