Data engineer- SQL , Airflow & Python

Job Title: Data Engineer

Department: CARDIF Corporate – Data & AI

About Business Line/Function

BNP Paribas Cardif is the insurance subsidiary of BNP Paribas. We are a worldwide leader of the Credit Protection Insurance market with strong positions in savings and protection insurance in more than 30 countries in Europe, Asia and Latin America.

Within BNP Paribas Cardif, the Data & AI department significantly contributes to the strategic ambition of making BNP Paribas Cardif a data and analytics-driven company. The development of Data and Analytics is identified as one of the pillars of Cardif's strategy. To achieve its goals in Data Management, the Cardif Trusted Data Fabric platform was deployed in Cardif and over most of its countries where final business users use it to explore and get more and more insights from the data.

Cardif Trusted Data Fabric (CTDF)

The development and consolidation of those data solutions require a platform that fulfils the requirements (that most of the countries have in common) to get, ingest, prepare and expose the data. For example: different acquisition methods, data storage, exposition to analytics, AI, dataviz, etc.

To offer off-the-shelf solutions in Cardif and to pool skills, it's more than a platform that has been created, these are also generic tools have been created to speed and rationalize the data use cases of the platform.

Position Purpose

Data Engineer

Mission takes place within the Data for Worldwide squad whose common motivations are proximity to the business line, agility, and quality in deliveries services, combining business line skills and IT skills.

Our stakes in the Cardif Trusted Data Fabric product are to maintain and enhance it with new functionalities responding to a Cardif Data strategic line, business line needs and IT guidelines.

The mission is to support the business lines to define their needs regarding the Cardif Trusted Data Fabric product, to develop the right IT solutions and to deliver the related projects in compliance with the planning, budget, scope and quality commitments.

In an agile product environment (build/run activities), delivery is achieved through successive releases of features associated with the data scopes and uses prioritized with the different client business lines

The Data Engineer works closely with the entire squad and especially the Product Owner, the Solution Architect, the Tech Lead and the business analysts

The candidate will participate in the development of the data use cases and the definition of the software architecture of use cases.

Responsibilities

Direct Responsibilities

• carry out production monitoring (when needed)
• process business line requests (data pipelines creation/evolution/issues/...)
• provide quality user support to the business lines.
• collect/analyze/challenge business line needs, provideits technicalexpertiseand propose a technical response tailored to the needs, the BNPPCardifecosystem and existing technical-functional constraints.
• adapt itself to functional and technical contexts and increase skills if needed/required.
• followtechnicalroadmap required by IT Group andmaintain/develop IT solution by considering these requirements.
• monitorthe product's performance indicators (during build/run activities) and reporting to its management.
• fix issues and get their remediations.
• writeand keep updating technical documentation.
• be proactive about technical optimizations or efficiency gains.
  
  

Contributing Responsibilities

• Get knowledge overCardifTrusted Data Fabric product, itsfeaturesand several use cases.
• contribute, if needed, to the RUN tasks tomaintainthe data productsand, above all, havea critical point of view to propose/implement the improvements needed to simplify/make the tasks more reliable
• get and keepinformed about strategic plans about theCardifTrusted Data Fabric product defined and needed to transform the main functionalities and theproduct itselfinto the new Data Fabric product.
• activelyparticipatein projects by helping others squad members, managing, and doing building phases (pre-study/analysis/development/tests/documentation/...) of data engineering ranging from collection, ingestion,integrationand exposure ofCardifTrusted Data Fabric data
• close collaboration with the IT teams to ensure a good understanding of the needs and their IT implementations.
• active contribution to all agile rituals (sprint planning, backlog refinement, sprint review, sprint demo, sprint retrospective, daily meeting)
  
  

Technical & Behavioral Competencies

• SQL (Master)
• Python development (Master)
• Starburst, Trino, Airflow (Master)
• Toolchain CI/CD (principle, tools, automated test...)
• Cloud concept with container, Object Storage (COS)and exchange protocol (type S3)
• ETL/ELT (at least 1significant experience)
• KSH development
• Basics knowledges:
• Security rules and protocols
• Exchange file protocols (CFT)
• Distributed architecture
• LINUX environment
• Strong problem-solving skills, with the ability to debug and troubleshoot complex technical issues
  
  

Optional

• Java development Spring Batch (at least 1significant experience)
• Java development API (at least 1significant experience)
• Spark
• Oracle SQL
  
  

Specific Qualifications

• Minimum 7 years of experience along with Master Degree or equivalent
  
  

Technical Skills

Skills Referential (Required knowledge, skills and abilities)

• SQL (Master)
• Python (Master)
• Linux
• ETL/ELT (At least 1 year experience)
• Starburst, Trino, Airflow (Master)
  
  

Behavioral Skills

• Attention to detail / rigor
• Adaptability
• Creativity & Innovation / Problem solving
• Ability to deliver / Results driven
  
  

Transversal Skills

• Ability to understand, explain and support change
• Analytical Ability
• Ability toanticipatebusiness / strategic evolution
• Ability to develop others & improve their skills
  
  

Education Level: Master Degree or equivalent

Location: Chennai

About BNP Paribas Group

BNP Paribas is the European Union's leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group's commercial & personal banking and several specialized businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability.

About BNP Paribas India Solutions

Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union's leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.

Commitment to Diversity and Inclusion

At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.