{"id":2017577,"url":"https://alion.io/job/charli-data-engineer-python-aws-apache","title":"Data Engineer python AWS APACHE","company":{"id":3908509,"name":"Charli Group","domain":"charligroup.com","url":"https://alion.io/company/charli-4","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"freelance","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["France"],"countries":["FR"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":40000,"max":45000,"currency":"EUR","period":"year","gross":null,"usd_annual":50637},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-09-17T14:51:10Z","employer_posted_date":null,"last_verified_at":"2026-09-17T14:51:10Z","board_verified":false,"closed_at":null,"days_open":30,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":30},"description":"En tant que Data Engineer, vous intégrerez une équipe pluridisciplinaire composée de de développeurs, de DevOps, de Scrum masters et de Product Owners, travaillant en méthodologie Agile :\n\no Nos défis : Fiabiliser et industrialiser les flux de données du catalogue de contenus : métadonnées éditoriales, programmes, saisons, droits et disponibilités. Construire des pipelines performants, rejouables et scalables pour fournir des données fraîches et cohérentes.\nMéthode de travail : Agile / Scrum, intégration et déploiements continus, revue de code.\no Environnement technique : Apache Spark, Apache Iceberg, Amazon S3, AWS, Python et/ou Scala, SQL, Git, CI/CD, monitoring et alerting.\n\nProfil recherché\nLa mission :\n\n· Concevoir, développer et maintenir des pipelines de traitement de données avec Apache Spark.\n· Modéliser et faire évoluer les tables Apache Iceberg sur Amazon S3, en veillant à la performance, à l’évolutivité et à la gouvernance des données.\n· Mettre en place des contrôles de qualité : complétude, unicité, fraîcheur, cohérence et traçabilité des données du catalogue.\n· Construire un système résilient : traitements idempotents, reprise sur erreur, retries maîtrisés, gestion des données en retard, rejouabilité et backfill.\n· Déployer un monitoring opérationnel avec métriques, logs structurés, dashboards et alertes utiles sur les erreurs, les volumes, la fraîcheur et les temps de traitement.\n· Participer aux phases de développement et de tests : unitaires, intégration, qualité des données, performance et montée en charge.\n· Documenter les pipelines, les modèles de données, les procédures d’exploitation et les décisions techniques.","description_format":"text","description_chars":1661,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Cybersecurity","Information Security"],"lifecycle":[{"event":"open","at":"2026-10-07T13:04:23Z"}],"visa":[],"liveness":{"score":30,"band":"fade","label":"Fading","p_open":0.85,"p_active":0.651,"p_room":0.55,"age_days":29,"expected_fill_days":22,"reasons":["seen:29","velocity","win:tail"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":50637,"is_top_pay":false},"html_url":"https://alion.io/job/charli-data-engineer-python-aws-apache","json_url":"https://alion.io/job/charli-data-engineer-python-aws-apache.json","meta":{"generated_at":"2026-10-17T23:06:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"search","counted_by":"address","units_charged":0,"used_today":0,"day_limit":null,"remaining_today":null,"minute_limit":null,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3908509},"rest":"https://alion.io/mcp/rest/get_company?id=3908509"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcharli-data-engineer-python-aws-apache"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcharli-data-engineer-python-aws-apache"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcharli-data-engineer-python-aws-apache"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/charli-data-engineer-python-aws-apache\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcharli-data-engineer-python-aws-apache"}]}