{"id":2616711,"url":"https://alion.io/job/societe-generale-lead-software-engineer-data-ingestion","title":"Lead Software Engineer - Data Ingestion","company":{"id":1760180,"name":"Société Générale","domain":"societegenerale.com","url":"https://alion.io/company/societegenerale-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career sitemap","truth_index":{"grade":"B","score":80,"open_postings":93,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":17,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":24000,"max_usd":56000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":57},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Db2","optional":false},{"name":"ElasticSearch","optional":false},{"name":"ETL/ELT","optional":false},{"name":"HBase","optional":false},{"name":"MS SQL","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Apache NiFi","optional":true},{"name":"CI/CD","optional":true},{"name":"Git","optional":true},{"name":"ITSM","optional":true},{"name":"Jira","optional":true},{"name":"Linux","optional":true}],"status":"live","first_seen_at":"2026-10-05T00:00:00Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-18T11:41:05Z","board_verified":true,"closed_at":null,"days_open":13,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":13},"description":"Responsibilities\n\n Data Ingestion Specialist\nRole Summary\nWe are looking for a Medior Data Ingestion Specialist to support development, operation, and maintenance of data ingestion platform orchestrated by Apache Airflow. The role focuses on onboarding and maintaining data integrations from multiple source systems, troubleshooting operational issues, and supporting release and governance processes\nKey Responsibilities\nData Integration & Pipeline Development\nConfigure and maintain data ingestion pipelines\n\nDevelop and support Python-based ingestion components\n\nIntegrate data:\nRelational databases (Oracle, PostgreSQL, MS SQL, MySQL, DB2, etc)\n\nApache Kafka\n\nAWS S3, flat files\n\nElasticsearch, Hive, Impala, hBase\n\nTroubleshoot data flow, connectivity, and integration issues\n\nIngestion to Databricks, Databricks loader\n\nPlatform Operations\nSupport incident, problem, and change management activities\n\nMaintain Python libraries and dependencies\n\nCreate ETL/ELT pipelines focused on source ingestion\n\nMonitor pipeline execution and resolve operational issues\n\nAssist with platform upgrades, patching, and maintenance activities\n\nRelease & Governance\nSupport Dev/Test/Prod deployment processes\n\nReview configuration and template changes\n\nEnsure compliance with governance, security, and operational standards\n\nMaintain technical and operational documentation\n\nCollaboration\nWork closely with architects, engineering teams, and platform owners\n\nCollaborate with security, audit, and infrastructure teams\n\nParticipate in release planning and communication activities\n\nNice-to-Have Skills\nKnowledge of ETL Python frameworks (e.g. Meltano)\n\nExperience with other ETL/ELT tools\n\nExperience with Git, CI/CD pipelines, and DevOps practices\n\nKnowledge of Linux environments\n\nExperience with Jira and ITSM tooling\n\nExposure to cloud-based data platforms\n\nCandidate Profile\nMedior-level engineer capable of working independently on standard tasks\n\nAble to create and resolve customers' requirements\n\nAble to analyse integration issues and identify root causes\n\nComfortable working in an enterprise environment with governance and security requirements\n\nGood communication skills and ability to collaborate with multiple stakeholders\n\n Profile required\n\n Must-Have Skills\n2+ years of experience with Python development\n\nPractical (hands on) experience with Apache NiFi\n\nPractical (hands on) experience with Apache Airflow\n\nExperience integrating data from relational databases\n\nETL/ELT performance tuning, optimalizations\n\nBasic experience with Apache Kafka\n\nBasic experience with Elasticsearch\n\nSQL knowledge and understanding of data integration concepts\n\nExperience troubleshooting technical and connectivity issues\n\nUnderstanding of incident and release management processes\n\nAbility to create and maintain technical documentation\n\nStrong analytical and problem-solving skills","description_format":"text","description_chars":2872,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Investment Banking & M&A Advisory"],"lifecycle":[{"event":"open","at":"2026-10-15T12:22:30Z"}],"visa":[],"liveness":{"score":42,"band":"fade","label":"Fading","p_open":1,"p_active":0.555,"p_room":0.75,"age_days":12,"expected_fill_days":17,"reasons":["conf:1","stale_co","velocity","win:late","comp:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/societe-generale-lead-software-engineer-data-ingestion","json_url":"https://alion.io/job/societe-generale-lead-software-engineer-data-ingestion.json","meta":{"generated_at":"2026-10-18T13:24:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":19945,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1760180},"rest":"https://alion.io/mcp/rest/get_company?id=1760180"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsociete-generale-lead-software-engineer-data-ingestion"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsociete-generale-lead-software-engineer-data-ingestion"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsociete-generale-lead-software-engineer-data-ingestion"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/societe-generale-lead-software-engineer-data-ingestion\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsociete-generale-lead-software-engineer-data-ingestion"}]}