368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$28k – $55k per year (Estimated)
Location
Remote/Hybrid (Bengaluru, India)
Seniority
Senior · 5+ years exp
Overview
Company
Impact
Profile match
Brillio is a global digital technology consulting and services firm headquartered in Edison, New Jersey, and founded in 2014. The company provides a range of services including artificial intelligence engineering, data analytics, cloud infrastructure management, and product design to help enterprises modernize their digital operations. Operating across North America, Europe, and Asia, the firm serves clients in sectors such as financial services, healthcare, and retail through a network of global delivery centers and strategic technology partnerships.

Lead Data Engineer

Primary Skills

  • Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front

Specialization

  • AWS Data EngineerIng Basic: Senior Data Engineer

Job requirements

    Job Description - AWS Senior Data Engineer

    Company: Brillio Technologies

    Role: Senior Data Engineer

    Experience: 5-10 Years

    Location: India (Hybrid/Remote)

    Employment Type: Full-time

    Role Overview

    We are looking for a Senior Data Engineer with strong Databricks and Big Data expertise to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have hands-on experience with Spark, PySpark, AWS ecosystem, and modern data architectures, along with exposure to APIs and real-time data processing.

    Key Responsibilities

    • Design and build scalable data pipelines using Spark / PySpark on Databricks
    • Develop and optimize ETL/ELT workflows for large-scale data processing
    • Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing
    • Build and maintain data lake and data warehouse solutions
    • Develop and integrate APIs for data ingestion and consumption
    • Implement data processing workflows using Airflow / Autosys
    • Optimize data performance using partitioning, caching, and query tuning
    • Handle structured and semi-structured data from multiple sources
    • Ensure data quality, governance, and reliability of pipelines
    • Collaborate with cross-functional teams (Analytics, Product, Engineering)
    • Technical Skills (Must-Have)

      • Strong expertise in:
        • Apache Spark / PySpark
        • Databricks (mandatory)
        • SQL (PostgreSQL or similar)
        • Hands-on experience with:
          • AWS EMR, S3
          • Hadoop, Hive ecosystem
          • Programming skills:
            • Python (must-have)
            • Scala (good exposure)
            • Strong knowledge of:
              • UNIX / Shell scripting
              • ETL pipelines and data engineering fundamentals
              • Additional Skills

                • Experience with:
                  • Elasticsearch (data storage & retrieval)
                  • Workflow orchestration tools (Airflow, Autosys)
                  • Exposure to:
                    • API development & integration
                    • Version control tools (Git / SVN)
                    • Basic knowledge of HTML (for web/data tasks)
                    • Experience Required

                      • Minimum 5+ years of Data Engineering experience
                      • Strong hands-on experience in Databricks + Big Data stack
                      • Proven experience working on large-scale distributed systems
                      • Education

                        • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
                        • Why Join Brillio

                          • Work on cloud-native, large-scale data platforms
                          • Exposure to cutting-edge Databricks & AWS ecosystems
                          • Collaborative and high-performance engineering culture
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Bengaluru
SDE - Intern 1 day ago
In office • Internship • Bengaluru
JavaScript
Node JS
TypeScript
Node JS
Express
Nest.JS
AI/ML
ChatGPT
Copilot
Cursor
Frontend
Angular
DevOps
Amazon EC2
AWS
CI/CD
Git
Rest API
Amazon CloudWatch
Amazon S3
GitHub
QA
Chrome DevTools
Postman
Apply
$19k – $53k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Pune
Bash
JavaScript
Python
TypeScript
Frontend
Angular
React.js
DevOps
AWS
Azure
Datadog
Docker
GCP
Grafana
Kubernetes
Prometheus
Splunk
IAM
Cybersecurity
Keycloak
Apply
SDET 1 day ago
$12k – $39k per year (Estimated) • In office • 4+ years exp • Gurgaon
Java
DevOps
AWS
Azure
CI/CD
Jenkins
QA
Appium
JMeter
Playwright
Rest-Assured
Selenium
Apply
$20k – $45k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Gurgaon
Python
SQL
Python
pySpark
Databases
Databricks
Microsoft Fabric
AI/ML
Hadoop
Spark
DevOps
AWS
Azure
Analytics
Power BI
Tableau
Apply
$67k – $173k per year (Estimated) • In office • Contractor • 3+ years exp • Bachelor's Degree • Singapore
JavaScript
Python
DevOps
AWS
Azure
GCP
Cybersecurity
ISO 27001
OWASP Top 10
Apply
$150k – $160k per year • In office • 8+ years exp • Bachelor's Degree • New York
Java
Node JS
Python
TypeScript
JavaScript
Databases
DynamoDB
Frontend
React.js
DevOps
Amazon EC2
AWS
AWS Lambda
CI/CD
CloudFormation
Kubernetes
Terraform
Amazon S3
IAM
Apply
$23k – $57k per year (Estimated) • Remote/Hybrid • 7+ years exp • Bengaluru
SQL
Databases
Azure SQL Database
Oracle
PostgreSQL
DevOps
Azure
GCP
Incident Management
Apply
$32k – $60k per year (Estimated) • In office • 4+ years exp • Bachelor's Degree • Mumbai
Design
Adobe XD
FigJam
Figma
Sketch
Management
Miro
Apply
$22k – $62k per year (Estimated) • In office • 4+ years exp • Bengaluru
JavaScript
Python
DevOps
CI/CD
QA
Cypress
Playwright
Postman
Rest-Assured
Selenium
Apply
$24k – $64k per year (Estimated) • In office • 7+ years exp • Bachelor's Degree • Bengaluru
Java
Python
TypeScript
Apex
Apex
MuleSoft
AI/ML
AI Agents
LangGraph
Semantic Kernel
LangChain
Function Calling
Human-in-the-Loop
Model Context Protocol
OpenAI
DevOps
AWS
Azure
Kubernetes
Apply
$41k – $89k per year (Estimated) • Remote/Hybrid • Full-Time • 8+ years exp • Bengaluru
C#
TypeScript
JavaScript
C#
.NET
Databases
Apache Kafka
AI/ML
Copilot
LLM
OpenAI
Frontend
Angular
GraphQL
DevOps
Azure
Azure AKS
Azure DevOps
CI/CD
Docker
GitHub
GitHub Actions
Grafana
Kubernetes
Prometheus
Rest API
Apply
$38k – $83k per year (Estimated) • In office • Full-Time • 12+ years exp • Bachelor's Degree • Bengaluru
Databases
Oracle
DevOps
AWS
Platform Engineering
Apply
Data Architect 2 hours ago
$38k – $91k per year (Estimated) • In office • Full-Time • 3+ years exp • Bengaluru • Pune
Node JS
Python
SQL
JavaScript
Databases
Databricks
MongoDB
Redis
Apply
$28k – $71k per year (Estimated) • In office • Full-Time • 5+ years exp • Bengaluru
DevOps
CI/CD
Platform Engineering
Apply
$26k – $69k per year (Estimated) • In office • Full-Time • 9+ years exp • Bachelor's Degree • Bengaluru • Hyderabad • Chennai • Noida
Databases
Db2
IMS
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.