{"id":3759172,"url":"https://alion.io/job/noemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh","title":"Data Engineer Apache Iceberg / AWS / PySpark - F/H","company":{"id":3908565,"name":"Noemi Conseil","domain":"noemiconseil.fr","url":"https://alion.io/company/noemi-conseil","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":{"grade":"A","score":100,"open_postings":24,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":9,"computed_at":"2026-11-05T05:54:30Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"freelance","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["France"],"countries":["FR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"IAM","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-04T14:21:19Z","employer_posted_date":null,"last_verified_at":"2026-11-04T14:21:19Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Nous recherchons pour une mission longue chez notre client secteur banque/finance en région parisienne un Data Engineer confirmé. Vous rejoignez une équipe qui construit un hub de données de marchés sur AWS, avec Apache Iceberg comme format de stockage central. Un projet structurant, qui s'inscrit dans la stratégie SI du client et interagit avec plusieurs grands programmes.\n\nVos missions :\n- Concevoir et mettre en œuvre les pipelines d'ingestion depuis les référentiels de données de marchés.\n- Structurer et modéliser des datasets cohérents à partir des référentiels sources.\n- Exploiter Apache Iceberg : partitionnement, time travel, évolution de schéma, compaction.\n- Développer les traitements de transformation et de chargement en Python / PySpark (EMR ou Glue ETL).\n- Garantir la qualité et la traçabilité des données : lineage, contrôles de cohérence, gouvernance.\n- Assurer la fiabilité en production : monitoring, alertes, reprises et gestion des incidents.\n- Échanger avec les équipes métier, data et infrastructure.\n\nVous êtes recruté en CDI cadre chez Ingéniance et rejoignez notre communauté d'experts data.\n\nRef : O-LPXHD\nProfil recherché\nVous avez une formation supérieure (BAC+4/5) et une expérience confirmée en data engineering. Vous maîtrisez Python et PySpark, l'écosystème AWS (S3, Glue, Athena, EMR, IAM, CloudWatch) et Apache Iceberg. Vous connaissez les formats Parquet, Avro et JSON ainsi que les concepts de data product, data contract, lineage et data quality. Une connaissance des données de marchés financiers (instruments, cotations, fournisseurs de données comme Bloomberg ou Refinitiv) serait un plus. Anglais courant, à l'écrit comme à l'oral. Rigoureux, vous aimez fiabiliser vos solutions en production et savez communiquer avec des interlocuteurs métier comme techniques.","description_format":"text","description_chars":1811,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology","IT Consulting & Digital Transformation","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-04T17:56:15Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":9,"reasons":["seen:0","velocity","win:early","comp:brand"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/noemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh","json_url":"https://alion.io/job/noemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh.json","meta":{"generated_at":"2026-11-05T21:27:24Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1324,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3908565},"rest":"https://alion.io/mcp/rest/get_company?id=3908565"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnoemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnoemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnoemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/noemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnoemi-conseil-data-engineer-apache-iceberg-aws-pyspark-fh"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3759172}},{"tool":"search_jobs","arguments":{"company":"noemiconseil.fr","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3759172},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}