Big Data Developer

Role: Developer. Skills: Big Data, Hadoop, Scala. Experience: 8 - 14 Years

Inclusion without Exception

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

TCS has been serving the Canadian marketplace for more than 35 years and today is the technology partner of choice for many of the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.

Rooted in the heritage and values of the Tata Group, TCS is focused on creating long-term value for its clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top Employer by the Top Employers Institute, including a recent top ranking at the country level.

TCS also sponsors 14 of the world's most prestigious marathons and endurance events, including the TCS Toronto Waterfront Marathon, reflecting its commitment to health, sustainability, and community empowerment.

Big Data Developer

Position Overview

We are seeking a talented Big Data Developer to build and maintain robust data processing solutions. The role involves leveraging Apache Spark, Scala, and Java to develop scalable applications that process massive datasets and deliver critical insights across the enterprise. This role is pivotal in supporting data-driven decision-making and operational excellence.

Key Responsibilities

• Design and implement end-to-end data pipelines using Apache Spark for ETL and analytics workloads.
• Write clean, efficient, and maintainable code in Scala and Java following best practices.
• Build solutions to ingest, transform, and aggregate large-scale financial and operational data.
• Analyze and optimize Spark applications for speed, memory efficiency, and cost-effectiveness.
• Collaborate with data scientists, analysts, and infrastructure teams to translate requirements into technical solutions.
• Identify, troubleshoot, and resolve production issues in big data systems.
• Implement comprehensive testing strategies and maintain code quality standards.
• Create technical documentation and knowledge base articles for developed solutions.

Required Qualifications

• Professional experience developing big data applications.
• Strong expertise in Apache Spark, including Spark Core, Spark SQL, and Spark Streaming.
• Advanced programming skills in Scala and/or Java.
• Solid understanding of distributed computing principles and architecture.
• Experience with data warehousing and SQL.
• Knowledge of Git and CI/CD pipelines.
• Strong analytical and problem-solving abilities.
• Excellent communication and teamwork skills.

Preferred Qualifications

• Experience with Kafka, Flink, or other real-time streaming platforms.
• Familiarity with Hadoop, Hive, HBase, or similar big data technologies.
• Cloud platform experience with AWS, Azure, or GCP.
• Background in financial services or banking.
• Knowledge of data modeling and schema design.
• Experience with Docker and Kubernetes.

Technical Skills

• Apache Spark
• Scala
• Java
• SQL
• ETL/ELT
• Distributed Computing
• Big Data Technologies
• Performance Tuning and Optimization
• Testing Frameworks and Methodologies
• Git
• CI/CD

TCS does not use artificial intelligence tools for candidate screening or evaluation. This post is for a current vacancy. The hiring process includes an initial screening, followed by a technical evaluation and managerial discussion.

Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.