{"id":2776305,"url":"https://alion.io/job/societe-generale-global-solution-centre-lead-software-engineer-data-ingestion","title":"Lead Software Engineer - Data Ingestion","company":{"id":1910353,"name":"Societe Generale Global Solution Centre","domain":"societegenerale.ro","url":"https://alion.io/company/societegenerale-ro","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":24000,"max_usd":56000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":57},"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon S3","optional":false},{"name":"Databricks","optional":false},{"name":"Db2","optional":false},{"name":"ETL/ELT","optional":false},{"name":"MS SQL","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"CI/CD","optional":true},{"name":"Git","optional":true},{"name":"ITSM","optional":true},{"name":"Jira","optional":true},{"name":"Linux","optional":true}],"status":"live","first_seen_at":"2026-10-09T19:45:39Z","employer_posted_date":null,"last_verified_at":"2026-10-09T19:45:39Z","board_verified":false,"closed_at":null,"days_open":10,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":10},"description":"Responsibilities\n\nData Ingestion Specialist\n\nRole Summary\n\nWe are looking for a Medior Data Ingestion Specialist to support development, operation, and maintenance of data ingestion platform orchestrated by Apache Airflow. The role focuses on onboarding and maintaining data integrations from multiple source systems, troubleshooting operational issues, and supporting release and governance processes\n\nKey Responsibilities\n\nData Integration & Pipeline Development\n\nConfigure and maintain data ingestion pipelines\nDevelop and support Python-based ingestion components\nIntegrate data:\nRelational databases (Oracle, PostgreSQL, MS SQL, MySQL, DB2, etc)\nApache Kafka\nAWS S3, flat files\nElasticsearch, Hive, Impala, hBase\nTroubleshoot data flow, connectivity, and integration issues\nIngestion to Databricks, Databricks loader\n\nPlatform Operations\n\nSupport incident, problem, and change management activities\nMaintain Python libraries and dependencies\nCreate ETL/ELT pipelines focused on source ingestion\nMonitor pipeline execution and resolve operational issues\nAssist with platform upgrades, patching, and maintenance activities\n\nRelease & Governance\n\nSupport Dev/Test/Prod deployment processes\nReview configuration and template changes\nEnsure compliance with governance, security, and operational standards\nMaintain technical and operational documentation\n\nCollaboration\n\nWork closely with architects, engineering teams, and platform owners\nCollaborate with security, audit, and infrastructure teams\nParticipate in release planning and communication activities\n\nNice-to-Have Skills\n\nKnowledge of ETL Python frameworks (e.g. Meltano)\nExperience with other ETL/ELT tools\nExperience with Git, CI/CD pipelines, and DevOps practices\nKnowledge of Linux environments\nExperience with Jira and ITSM tooling\nExposure to cloud-based data platforms\n\nCandidate Profile\n\nMedior-level engineer capable of working independently on standard tasks\nAble to create and resolve customers requirements\nAble to analyse integration issues and identify root causes\nComfortable working in an enterprise environment with governance and security requirements\nGood communication skills and ability to collaborate with multiple stakeholders\n\nMust-Have Skills\n\n Profile required \n\n2+ years of experience with Python development\nPractical (hands on) experience with Apache NiFi\nPractical (hands on) experience with Apache Airflow\nExperience integrating data from relational databases\nETL/ELT performance tuning, optimalizations\nBasic experience with Apache Kafka\nBasic experience with Elasticsearch\nSQL knowledge and understanding of data integration concepts\nExperience troubleshooting technical and connectivity issues\nUnderstanding of incident and release management processes\nAbility to create and maintain technical documentation\nStrong analytical and problem-solving skills\n\n Why join us \n\nWe are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.\n\n Business insight \n\nAt Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you're joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!\n\nStill hesitating\n\nYou should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.\n\nWe are committed to support accelerating our Group's ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.","description_format":"text","description_chars":4490,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Business Process Outsourcing (BPO)"],"lifecycle":[{"event":"open","at":"2026-10-17T07:43:17Z"}],"visa":[],"liveness":{"score":18,"band":"cold","label":"Long shot","p_open":1,"p_active":0.493,"p_room":0.368,"age_days":9,"expected_fill_days":3,"reasons":["seen:9","velocity","win:tail"],"computed_at":"2026-10-19T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/societe-generale-global-solution-centre-lead-software-engineer-data-ingestion","json_url":"https://alion.io/job/societe-generale-global-solution-centre-lead-software-engineer-data-ingestion.json","meta":{"generated_at":"2026-10-19T22:11:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1191,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1910353},"rest":"https://alion.io/mcp/rest/get_company?id=1910353"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsociete-generale-global-solution-centre-lead-software-engineer-data-ingestion"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsociete-generale-global-solution-centre-lead-software-engineer-data-ingestion"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsociete-generale-global-solution-centre-lead-software-engineer-data-ingestion"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/societe-generale-global-solution-centre-lead-software-engineer-data-ingestion\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsociete-generale-global-solution-centre-lead-software-engineer-data-ingestion"}]}