{"id":2731030,"url":"https://alion.io/job/noemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh","title":"Data Engineer Senior Lead Python / PySpark / AWS - F/H","company":{"id":3908565,"name":"NOEMI Conseil","domain":"noemiconseil.fr","url":"https://alion.io/company/noemi-conseil","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"freelance","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["France"],"countries":["FR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":58000,"max_usd":116000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":15},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EventBridge","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-16T17:25:35Z","employer_posted_date":null,"last_verified_at":"2026-10-16T17:25:35Z","board_verified":false,"closed_at":null,"days_open":6,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":6},"description":"Nous recherchons pour une mission longue chez notre client secteur banque/finance en région parisienne un Data Engineer Senior à posture de lead, pour porter une plateforme de données AWS lancée from scratch pour une équipe des marchés actions.\n\nChaque nuit, des batchs produisent des prix, des sensibilités et du PnL sur plusieurs centaines de millions de lignes. Les équipes métier connaissent ces données, mais ont besoin d'un expert pour construire des pipelines industriels. Vous pilotez le projet au quotidien, en appui du Tech Lead qui valide les grandes orientations.\n\nVos missions :\n- Porter le projet de bout en bout : cadrage avec le métier, découpage, priorisation et plan de livraison.\n- Proposer et défendre les choix d'architecture, et arbitrer en autonomie.\n- Encadrer deux développeurs (un junior, un confirmé) : standards de code, revues, montée en compétences.\n- Définir la stratégie de refactoring d'un projet existant, priorisée par risque et par valeur.\n- Construire un framework commun piloté par configuration et développer les pipelines Python / PySpark sur AWS Glue.\n- Orchestrer avec Step Functions et EventBridge, organiser le stockage S3 (Parquet ou Iceberg) et l'exposition via Glue Data Catalog et Athena.\n- Mettre en place la qualité des données et le monitoring, et optimiser performances et coûts.\n- Industrialiser avec l'équipe DevOps : Terraform, CI/CD, tests.\n\nVous rejoignez Ingéniance en CDI et intégrez une communauté d'experts de la data et de la finance de marché.\n\nRef : O-SIYUA\nProfil recherché\nVous justifiez d'au moins 8 ans d'expérience en data engineering, dont un vrai pilotage technique de projet data (Tech Lead, lead dev ou équivalent) avec des décisions d'architecture prises et défendues.\n\nCompétences attendues :\n- Python maîtrisé en profondeur (compréhensions, collections, map/filter), sans dépendre de la documentation.\n- PySpark en production : Spark UI, skew, mémoire, AQE, UDF et fonctions natives.\n- AWS : Glue, Step Functions, S3, Athena, maîtrise des coûts.\n- Industrialisation : Git, CI/CD, tests, conception de frameworks réutilisables.\n- Appréciés : Terraform, Iceberg, Airflow, connaissance de la finance de marché (pricing, grecs, PnL, produits actions).\n\nVous êtes autonome, force de proposition face à un besoin flou, et à l'aise pour encadrer et faire grandir une équipe.","description_format":"text","description_chars":2343,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-10-16T17:56:00Z"}],"visa":[],"liveness":{"score":39,"band":"fade","label":"Fading","p_open":1,"p_active":0.67,"p_room":0.578,"age_days":5,"expected_fill_days":4,"reasons":["seen:5","velocity","win:tail"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/noemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh","json_url":"https://alion.io/job/noemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh.json","meta":{"generated_at":"2026-10-23T04:55:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8066,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3908565},"rest":"https://alion.io/mcp/rest/get_company?id=3908565"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnoemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnoemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnoemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/noemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnoemi-conseil-data-engineer-senior-lead-python-pyspark-aws-fh"}]}