Data Engineer (.Net)

Sobre a vaga

Develop and maintain data-driven applications using .NET (C#), ensuring high standards of quality, performance, and scalability. Design, build, and optimize data pipelines using Apache Spark and Databricks to support data ingestion, transformation, and processing requirements. Contribute to the design and implementation of scalable and modern data architectures.

O que vais fazer

• Develop and maintain data-driven applications using .NET (C#), ensuring high standards of quality, performance, and scalability
• Design, build, and optimize data pipelines using Apache Spark and Databricks to support data ingestion, transformation, and processing requirements
• Develop solutions leveraging Delta Lake and AutoLoader for efficient large-scale data processing
• Create and manage data workflows and orchestration processes using tools such as Dagster and Hangfire
• Design, implement, and optimize ETL/ELT processes to ensure reliable and efficient data integration
• Develop and maintain data access and transformation components using Entity Framework, SQL, and Python
• Contribute to the design and implementation of scalable and modern data architectures
• Collaborate with cross-functional teams to integrate data solutions with enterprise applications and platforms
• Implement and maintain CI/CD pipelines, monitoring, and observability practices to ensure platform reliability and performance
• Promote best practices in software engineering, data quality, governance, and documentation

O que é pedido

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
• Minimum of 5 years of experience in Data Engineering, with a strong software development background
• Proven experience developing applications with .NET (C#)
• Hands-on experience with Apache Spark and Databricks
• Strong knowledge of SQL and Python
• Experience with Entity Framework, Dagster, Hangfire, Delta Lake, and AutoLoader
• Solid understanding of modern data architectures, Data Lakes, and Big Data platforms
• Experience designing and optimizing ETL/ELT processes
• Familiarity with CI/CD practices, testing frameworks, and monitoring solutions
• Strong analytical and problem-solving skills
• Ability to work independently and collaboratively within multidisciplinary teams
• Excellent communication skills in both technical and business contexts
• Professional proficiency in English

O que é oferecido

• Wage according to candidate's professional experience
• Remote Work whenever possible
• Delivery of work equipment adjusted to the performance of functions
• Benefits plan
• And others

Resumo organizado por IA a partir do anúncio original. Confirma os detalhes no site da empresa.